Question Type: Ask Opinion

Overview

Ask Opinion question types allow you to ask an open end question to your audience and our algorithm quickly pulls out audience responses that are most representative of the opinions of the group. Ask Opinion is one of our two open end question types, the other is Ask Experience. You can read more about Ask Experience questions here!

Included in this Article

  1. How it Works
  2. Participant Experience
  3. Associated Metrics
  4. Best Practices
  5. Frequently Asked Questions

How it Works

Use Ask Opinion questions to quickly surface thoughts and opinions from your audience. Ask Opinion questions are best used for situations when you imagine participants may have varying opinions on a given topic.

To program an Ask Opinion question, you simply input an open end question. Participants submit their response then vote on other participants responses, and our algorithm works in the background to organize and analyze your data. You can read more about the algorithm that powers Ask Opinion questions here.

Participant Experience

Participants submit their response in their own words, then they anonymously vote on other participants' responses. Participants are shown others' responses at random through two voting exercises: Agree/Disagree and Binary Choice. 

Agree/Disagree

  • The agree/disagree exercise presents the participant with a single response that was submitted by someone in the audience and prompts them to select if they agree or disagree with that response. This exercise gives us an absolute baseline of what a participant does or doesn’t agree with.

Binary Choice

  • The binary choice exercise presents the participant with two responses that were submitted by individuals in the group and prompts them to select the response they prefer more. This exercise provides a relative signal of agreement or disagreement between the responses which assists in a relative ranking of responses.

Participants continue voting on participants responses until the question timer has ended (Live) or they have completed up to 10 voting exercises (Flex). 

Associated Metrics

Once an Ask Opinion question has finished collecting responses, our system will help you organize and analyze the responses using a few metrics. Click below to learn more about each of these metrics, you can also learn more about Remesh's metrics overall here.

  • Common Topics: Key words that appear most frequently in responses
  • Percent Agree: The projected percentage of participants who would agree with a given response
  • Highlights: Pulls out approximately 10 unique responses that are likely to cover all of the opinions in the group.
  • Sentiment: Assigns positive, negative or neutral tags based upon content of the responses.
  • Thematic Clusters: Organizes responses based upon key themes.
  • Summarize: Generate summaries for your open end questions and for your whole conversation.
  • Auto Code: Automatically tag and organize themes from open end responses

Best Practices

  • When using Ask Opinion questions: Consider that participants will be voting on each others' responses. If you want to ask an open end question but don't want participants to vote, we recommend using an Ask Experience question.
  • Programming Your Discussion Guide: Limit each Ask Opinion question to one question in order to gather concise and actionable insights.
  • During a Live Conversation: Use Ask Opinion questions to quickly understand your audience in the moment and program follow up questions.
  • While Analyzing: Ask Opinion questions provide insight into what your participants are thinking and feeling. Use these to surface what opinions are resonating most with the group and identify key themes through Auto Code.
  • Example Ask Opinion Questions:
    • What do you think of this design?
    • What do you think of the company's new PTO policy?

Frequently Asked Questions

  • How long do participants have to submit their response in an Ask Opinion question?
    In Remesh Live participants have the first 80% of the Ask Opinion time to respond. If they don't submit their response in that time, their responses will be automatically submitted then they will move into voting exercises. Flex is self-paced, so participants will submit their response at their own pace.
  • What is the difference between Remesh's two open end questions: Ask Opinion and Ask Experience?
    1. Ask Opinion questions are best for quickly surfacing what thoughts and opinions shared by audience members resonate most with the audience as a whole. Ask Experience questions are best for collecting anecdotes and stories from your audience.
    2. Ask Opinion questions prompt users to vote anonymously on other participants responses. In an Ask Experience question, participants will not see other participants responses. 
    3. Ask Opinion questions gather qualitative feedback and use voting data and our machine learning model to organize and analyze your responses based upon how likely participants are to agree with responses. Ask Experience questions will gather qualitative feedback, but do not utilize machine learning to organize responses. If categories are programmed, responses will be organized by how participants self-selected categories.