Question Type: Ask Opinion

Overview

Ask Opinion question types allow you to ask an open end question to your audience and our algorithm quickly pulls out audience responses that are most representative of the opinions of the group. Ask Opinion is one of our two open end question types, the other is Ask Experience. You can read more about Ask Experience questions here!

Example Participant View (Live)

Example Moderator View (Live)

How it Works

Use Ask Opinion questions to quickly surface thoughts and opinions from your audience. Ask Opinion questions are best used for situations when you imagine participants may have varying opinions on a given topic.

To program an Ask Opinion question, you simply input an open end question. Participants submit their response then vote on other participants responses, and our algorithm works in the background to organize and analyze your data. You can read more about the algorithm that powers Ask Opinion questions here.

Participant Experience

Participants submit their response in their own words, then they anonymously vote on other participants' responses. Participants are shown others' responses at random through two voting exercises: Agree/Disagree and Binary Choice.

Agree/Disagree
The agree/disagree exercise presents the participant with a single response that was submitted by someone in the audience and prompts them to select if they agree or disagree with that response. This exercise gives us an absolute baseline of what a participant does or doesn’t agree with, example below.

Binary Choice
The binary choice exercise presents the participant with two responses that were submitted by individuals in the group and prompts them to select the response they prefer more. This exercise provides a relative signal of agreement or disagreement between the responses which assists in a relative ranking of responses. Example below.

The binary choice voting exercise also has additional options. By clicking "More Options" participants will see the following:

I disagree with both
These are similar
I agree with both
I'm not sure

Participants continue the two voting exercises with various responses until the question timer has ended (Live) or they have completed up to 10 voting exercises (Flex).

Associated Metrics

Once an Ask Opinion question has finished collecting responses, our system will help you organize and analyze the responses using a few metrics. Click below to learn more about each of these metrics, you can also learn more about Remesh's metrics overall here.

Common Topics: Key words that appear most frequently in responses
Percent Agree: The projected percentage of participants who would agree with a given response
Highlights: Pulls out approximately 10 unique responses that are likely to cover all of the opinions in the group.
Sentiment: Assigns positive, negative or neutral tags based upon content of the responses.
Thematic Clusters: Organizes responses based upon key themes.
Summarize: Generate summaries for your open end questions and for your whole conversation.
Auto Code: Automatically tag and organize themes from open end responses

Best Practices

When using Ask Opinion questions: Consider that participants will be voting on each others' responses. If you want to ask an open end question but don't want participants to vote, we recommend using an Ask Experience question.
Programming Your Discussion Guide: Limit each Ask Opinion question to one question in order to gather concise and actionable insights.
During a Live Conversation: Use Ask Opinion questions to quickly understand your audience in the moment and program follow up questions.
While Analyzing: Ask Opinion questions provide insight into what your participants are thinking and feeling. Use these to surface what opinions are resonating most with the group and identify key themes through Auto Code.
Example Ask Opinion Questions:
- What do you think of this design?
- What do you think of the company's new PTO policy?

Frequently Asked Questions

How long do participants have to submit their response in an Ask Opinion question?
In Remesh Live participants have the first 80% of the Ask Opinion time to respond. If they don't submit their response in that time, their responses will be automatically submitted then they will move into voting exercises. Flex is self-paced, so participants will submit their response at their own pace.
What is the difference between Remesh's two open end questions: Ask Opinion and Ask Experience?
1. Ask Opinion questions are best for quickly surfacing what thoughts and opinions shared by audience members resonate most with the audience as a whole. Ask Experience questions are best for collecting anecdotes and stories from your audience.
2. Ask Opinion questions prompt users to vote anonymously on other participants responses. In an Ask Experience question, participants will not see other participants responses.
3. Ask Opinion questions gather qualitative feedback and use voting data and our machine learning model to organize and analyze your responses based upon how likely participants are to agree with responses. Ask Experience questions will gather qualitative feedback, but do not utilize machine learning to organize responses. If categories are programmed, responses will be organized by how participants self-selected categories.
What is the character limit for responses to open-ended questions?
Participants can submit responses with up to 500 characters per question. Currently, you cannot adjust the character maximum for open end questions. You can adjust the minimum character count in the settings of your open-end question.
How many votes were cast on each response?

We do not explicitly show the number of times a response was selected during either voting activity for an Ask Opinion question. For a 2-minute question in a Live conversation, we expect every participant to complete between 15 - 20 exercises. In a Flex conversation, after enough voting data has been collected every participant will complete 10 voting exercises from that point on. The voting data from the participants is then used by our machine learning algorithm to calculate the percent agree metrics.
- NOTE: Participants have the first 80% of the Ask Opinion time to respond. If they don't respond in that time, their responses will be automatically submitted. Then the participants will move into voting exercises.
Will the first participant in a Flex Conversation participate in voting?

The first participant will not participate in voting, as there will not be enough responses yet to vote on. Participant 2+ will vote on as many responses as are available until there enough to create 10 voting exercises. After that point, every participant will see 10 voting exercises.