--- title: "Percent Agree: Identify the most and least agreed upon open-end responses" description: Percent agree is an estimate of the percentage of participants that would agree with a particular response in an Ask Opinion or Branching question. --- [Skip to content](https://help.remesh.ai/percent-agree#main-content) English Show submenu for translations ![59b7eb52c29cb1fb87e1bba7bf1ef88c41152899.png\]](https://help.remesh.ai/hs-fs/hubfs/59b7eb52c29cb1fb87e1bba7bf1ef88c41152899.png?height=40&name=59b7eb52c29cb1fb87e1bba7bf1ef88c41152899.png) Open main navigation Close main navigation - English Show submenu for translations - Go to remesh.ai Go to remesh.ai How can we help? - There are no suggestions because the search field is empty. 1. [Knowledge Base](https://help.remesh.ai/?hsLang=en) 2. [Analyzing Your Data](https://help.remesh.ai/analyzing-your-data?hsLang=en) 3. [Remesh Definitions and Metrics](https://help.remesh.ai/analyzing-your-data?hsLang=en#remesh-definitions-and-metrics) # Percent Agree: Identify the most and least agreed upon open-end responses ### Overview Percent agree is an estimate of the percentage of participants that would agree with a particular response in an [Ask Opinion](https://help.remesh.ai/question-type-ask-opinion?hsLang=en) or [Branching](https://help.remesh.ai/question-type-branching?hsLang=en) question.  ### Included in this Article 1. [How it Works](https://help.remesh.ai/percent-agree#how-it-works) 2. [Locations and Best Practices](https://help.remesh.ai/percent-agree#locations-and-best) - [Remesh Live](https://help.remesh.ai/percent-agree#remesh-live) - [Post Conversation Analysis: Results](https://help.remesh.ai/percent-agree#post-conversation) - [Auto Code](https://help.remesh.ai/percent-agree#auto-code) 3. [Frequently Asked Questions](https://help.remesh.ai/percent-agree#faq) ### How it Works Percent Agree is specific to our Ask Opinion and [Branching](https://help.remesh.ai/question-type-branching?hsLang=en) questions. In these questions, participants submit their response in their own words then vote on other participants responses anonymously. We compute Percent Agree scores using a machine learning model called collaborative filtering, which uses the voting activities the participants complete after submitting their own responses. - **Agree/Disagree Voting Activity: **The agree/disagree exercise presents the participant with a single response that was submitted by someone in the audience and prompts them to select if they agree or disagree with that response. This exercise gives us an absolute baseline of what a participant does or doesn’t agree with. - **Binary Choice Voting Activity: **The binary choice exercise presents the participant with two responses that were submitted by individuals in the group and prompts them to select the response they prefer more. This exercise provides a relative signal of agreement or disagreement between the responses which assists in a relative ranking of responses. When a participant indicates that they agree with a response, we give the response a utility score for that participant that is greater than zero. When they disagree, we assign a score less than zero for that participant. During binary voting, as participants indicate which responses they prefer over other responses, we move their agreement scores higher or lower based on which they choose. We’ve implemented a machine learning model into the platform called collaborative filtering which uses inference to fill in utility scores for all thoughts for all participants. Given that we can have hundreds of participants online at a time, it is impossible to collect voting data for each participant on all responses during the voting period. This is where collaborative filtering comes into play to rank and structure the responses – the same model adopted by Netflix or Amazon to make predictions for consumers. To generate the percent agreement scores, we count how many participants had a utility score \> 0 for each response and divide that by the total number of participants that answered the question. This gives us an estimate of the percent of the group that agreed with that particular response. ### Locations and Best Practices You can find Percent Agree in a number of places throughout the platform, you can find a few of the most commonly used below. Percent Agree is available for [Ask Opinion](https://help.remesh.ai/question-type-ask-opinion?hsLang=en) and [Branching](https://help.remesh.ai/question-type-branching?hsLang=en) questions. #### Remesh Live Percent Agree appears once a question has stopped collecting responses and will appear to the right of each response. You can also view Percent Agree by clicking on Analyze beneath the question. This will allow you to view Percent Agree scores cut by [Segment](https://help.remesh.ai/segments?hsLang=en). - **Best Practices: **When conducting a Live Remesh Conversation, use the Percent Agree scores to quickly note the most agreed upon thoughts and use this information to craft follow up questions as needed. ![Percent Agree 1](https://help.remesh.ai/hs-fs/hubfs/Knowledge%20Base%20Article%20Images/Percent%20Agree/Percent%20Agree%201.png?width=688&height=362&name=Percent%20Agree%201.png) #### Post Conversation Analysis: Results When selecting an Ask Opinion or Branching question in Results, you can see the Percent Agree score associated with each response. You can compare Percent Agree scores across Segments by clicking the "Compare" drop down above the responses. - **Best Practices: **Compare Percent Agree scores to identify areas in which there are consensus or disagreement between key demographics. ![Percent Agree 2](https://help.remesh.ai/hs-fs/hubfs/Knowledge%20Base%20Article%20Images/Percent%20Agree/Percent%20Agree%202.png?width=688&height=362&name=Percent%20Agree%202.png) #### Auto Code Auto Coded responses will also include the associated Percent Agree score to the right of the response.  - **Best Practices: **Sort by highest and lowest agreement to see what themes are showing up most frequently in most frequently in most and least agreed upon responses. ### ![Percent Agree 3](https://help.remesh.ai/hs-fs/hubfs/Knowledge%20Base%20Article%20Images/Percent%20Agree/Percent%20Agree%203.png?width=688&height=362&name=Percent%20Agree%203.png) ### Frequently Asked Questions - **How long do participants have to submit their response in an Ask Opinion or Branching Question?** In Remesh Live participants have the first 80% of the Ask Opinion time to respond. If they don't submit their response in that time, their responses will be automatically submitted then they will move into voting exercises. Flex is self-paced, so participants will submit their response at their own pace. - **Where can I read more about how this works?** We recommend taking a look at [this document](https://help.remesh.ai/hubfs/One%20Pagers/How%20Remesh%20Works.pdf?hsLang=en) to learn more. ### Related Articles - [Remesh Question Types](https://help.remesh.ai/remesh-question-types?hsLang=en) - [Overview of Metrics & Measures Used in Remesh](https://help.remesh.ai/overview-of-metrics-measures-used-in-remesh-to-organize-and-analyze-data?hsLang=en) - [Getting Started](https://help.remesh.ai/getting-started?hsLang=en#main-content) - [Quick Start Guides](https://help.remesh.ai/getting-started?hsLang=en#quick-start-guides) - [Remesh Demo Resources](https://help.remesh.ai/getting-started?hsLang=en#remesh-demo-resources) - [Remy - Remesh's AI Agent](https://help.remesh.ai/getting-started?hsLang=en#remy-remeshs-ai-agent) - [Additional Resources](https://help.remesh.ai/getting-started?hsLang=en#additional-resources) - [MCP Server](https://help.remesh.ai/getting-started?hsLang=en#mcp-server) - [Preparing for Your Remesh Conversation](https://help.remesh.ai/preparing-for-your-remesh-conversation?hsLang=en#main-content) - [Creating a Conversation and Programming Details](https://help.remesh.ai/preparing-for-your-remesh-conversation?hsLang=en#creating-a-conversation-and-programming-details) - [Programming Your Discussion Guide](https://help.remesh.ai/preparing-for-your-remesh-conversation?hsLang=en#programming-your-discussion-guide) - [Question Types](https://help.remesh.ai/preparing-for-your-remesh-conversation?hsLang=en#question-types) - [Recruiting Participants](https://help.remesh.ai/preparing-for-your-remesh-conversation?hsLang=en#recruiting-participants) - [Additional Conversation Settings](https://help.remesh.ai/preparing-for-your-remesh-conversation?hsLang=en#additional-conversation-settings) - [Launching Your Conversation](https://help.remesh.ai/preparing-for-your-remesh-conversation?hsLang=en#launching-your-conversation) - [Best Practices](https://help.remesh.ai/preparing-for-your-remesh-conversation?hsLang=en#best-practices) - [Collecting Data](https://help.remesh.ai/collecting-data?hsLang=en#main-content) - [Conversation Moderation Basics (Live)](https://help.remesh.ai/collecting-data?hsLang=en#conversation-moderation-basics-live) - [Conversation Moderation Best Practices (Live)](https://help.remesh.ai/collecting-data?hsLang=en#conversation-moderation-best-practices-live) - [Monitoring Your Data (Flex)](https://help.remesh.ai/collecting-data?hsLang=en#monitoring-your-data-flex) - [Analyzing Your Data](https://help.remesh.ai/analyzing-your-data?hsLang=en#main-content) - [Getting Started Analyzing](https://help.remesh.ai/analyzing-your-data?hsLang=en#getting-started-analyzing) - [Remesh Definitions and Metrics](https://help.remesh.ai/analyzing-your-data?hsLang=en#remesh-definitions-and-metrics) - [Understanding the Big Picture](https://help.remesh.ai/analyzing-your-data?hsLang=en#understanding-the-big-picture) - [Finding Themes in Qualitative Data](https://help.remesh.ai/analyzing-your-data?hsLang=en#finding-themes-in-qualitative-data) - [Diving Deeper](https://help.remesh.ai/analyzing-your-data?hsLang=en#diving-deeper) - [Exporting Data](https://help.remesh.ai/analyzing-your-data?hsLang=en#exporting-data) - [Additional Tools and Features](https://help.remesh.ai/analyzing-your-data?hsLang=en#additional-tools-and-features) - [Remesh Workspace and Settings](https://help.remesh.ai/remesh-workspace-and-settings?hsLang=en#main-content) - [Workspace Management](https://help.remesh.ai/remesh-workspace-and-settings?hsLang=en#workspace-management) - [Organizing Conversations](https://help.remesh.ai/remesh-workspace-and-settings?hsLang=en#organizing-conversations) - [Settings](https://help.remesh.ai/remesh-workspace-and-settings?hsLang=en#settings) - [Use Cases and Problems Solved by Remesh](https://help.remesh.ai/use-cases-and-problems-solved-by-remesh?hsLang=en#main-content) - [Use Cases](https://help.remesh.ai/use-cases-and-problems-solved-by-remesh?hsLang=en#use-cases) [![remesh-logo.png](https://help.remesh.ai/hs-fs/hubfs/Remesh_Logo_WHITEBG-01-1.png?width=150&height=29&name=Remesh_Logo_WHITEBG-01-1.png "remesh-logo.png")](https://remesh.ai/) remesh.ai Help Center Copyright © 2025, Remesh Inc.