Outcome Validator
Edited

The Outcome Validator is a way to test your different responses to ensure you have your outcome logic set properly.


Video Tutorial

Step by Step

  1. From the Outcome Logic page, toggle on the Outcome Validator in the upper right corner. This is only available for linear campaigns (campaigns without branching).

  2. When you turn on the Validator, you will notice percentages at the top of the page associated to each Outcome. These percentages tell you based on all the ways an end consumer can navigate through an experience, what percent of the time they would be given an Outcome based on the current pointing. This may be useful for giving a baseline of your pointing, but these percentages are not trying to predict how users will respond to questions. Every time you update your points you will be able to refresh the calculator.

  3. To test an Outcome match based on a combination of responses, start making response selections across all of your screens. There is a selector to the left of each response in the menu that allows you to do this.

  4. As you begin to select responses, you will notice the numbers next to the Outcomes change after each response. These numbers are showing you how many points you have earned towards each Outcome after each response. At the bottom of the screen you can see which Outcome is in the lead based on the way that points are allocated. We always match users to the Outcome that they have earned the most points towards.

  5. If you don't like the results you're seeing for each user path you're testing you can update your pointing logic in real-time and you can see if that has an impact on the winning outcome.

  6. If you wish to view a catch all file of how each response combination can lead to each outcome you can export your CSV at the bottom. Note: there is a cap of 100k combinations to take advantage of this export.

Frequently Asked Questions

Q: What Outcome is served in the case of a tie?

A: If there is an Outcome tie, which means that the same amount of points was earned towards more than one Outcome, Jebbit will serve the user one of the top Outcomes at random, since any of the Outcomes would be most relevant.

Q: Why can't I use the Outcome Validator?

A: If your campaign has branching then you will not be able to use the Outcome Validator. What may be helpful is creating a copy of your experience and then removing the branching on the copy, to test the outcome logic one one pathway at a time. You can also reach out to the Support Team for guidance on how to test logic on a campaign with branching.

Related Articles


Keywords: outcome validator, logic, testing logic, logic qa, points, matching outcomes