I'm trying to see how many times an option appeared in my survey. Average should be 160, as 80 participants voted 36 times on 36 options. 2 * (36*80) / 36 = 160, but because the pairs are randomly selected it won't be exactly that.
I think this information would be shown through the activity sort in results, however the number of voters stays at 0 for all options. If this is not what activity sort shows, what does it represent?
The Activity sort reflects administrative changes rather than voting frequency. An activity event is triggered only when an option is created, updated (e.g., text or description changes), or when it receives a comment or a tag.
While our system doesn't track how many times an option was displayed, every individual vote is recorded. To calculate the frequency, I recommend exporting your results. In a Pairwise Comparison, the export file lists each vote in a separate row with dedicated »winner« and »loser« columns, allowing you to see exactly which options were involved in each matchup.
I actually have a question myself: A Pairwise Comparison is specifically designed so that participants don't need to vote on every single option or pair to generate a reliable relative ranking. Did I understand correctly that each of your 80 voters completed 36 rounds? Also, would you prefer a different logic for selecting the pairs instead of a random selection?
Each of your 80 voters completed 36 rounds?
Yes. 36 options, 36 rounds of random pairs, 80 participants. So not every participant saw every choice, but overall each choice should have appeared around 160 times through the entire survey (subject to random fluctuation of course)
To calculate the frequency, I recommend exporting your results
I see. Exporting is locked behind a higher paid tier it seems. It would be good to have the frequency of each option visible since I don't really need to do deeper analysis, just check that the site worked as I thought it would. Either that or have win rate visible alongside the ELO ranking so I could figure that out myself.
I've upgraded your account to business. You should now be able to export the voters. The export does not include a summed number, but you should be able to generate those number with Excel.
I will bring this up as a feature request in our next planning meeting. Thank you for your feedback!
Ok thanks, appreciate it.
Must have messed up my formula somewhere because each option showed up around 137 times. Maybe partial completions were counted as participants? Either way I can work with it, this isn't important survey research
The export contains the complete voting dataset, regardless of whether a participant finished all rounds. In a pairwise comparison, each record captures both the winner and the loser for every individual matchup.
Ok that solves it then. Thanks for the help