support Created with Sketch. (855) 776-7763 Log in Get Started Free

Articles in this section

After-Scenario Questionnaire (ASQ)

Avatar
Anastacia Valdespino
  • Updated

What you’ll find in this article:

What is the After-Scenario Questionnaire (ASQ)?

The After-Scenario Questionnaire or ASQ is a 3-question scale used to assess how difficult a user perceived a task in a usability test. Developed by J.R. Lewis in 1995, this survey is popular because of its simplicity. 

asq.png

What can you find out with ASQ?

Similar to the Single Ease Question (SEQ), ASQ quantifies usability/perceived ease. Specifically, the ASQ covers a rating of the ease of a task, the amount of time the task took to complete, and the level of support received throughout the process. 

  • ASQ Statements
    • Overall, I am satisfied with the ease of completing the task in this scenario.
    • Overall, I am satisfied with the amount of time it took to complete the task in this scenario.
    • Overall, I am satisfied with the support information (on-line help, messages, documentation) when completing the task.

While the ASQ has more questions than the SEQ, its results do not encompass the entire user experience. Instead, it isolates a part of it and gives us a method for quantifying perceived ease. 

When should you use it?

The ASQ is best used as part of usability testing, especially for testing prototypes or live websites and products. Specifically, you’ll want to launch this questionnaire instantly after a user performed a task, even if it wasn’t successfully completed. 

How to Use ASQ?

Getting started with ASQ is easier than ever with Qualaroo Templates. We’ll walk you through how to get it set up in the steps outlined below. 

Start running your ASQ Nudge with Qualaroo in 3 simple steps! 

  • Select the right channel. 
    • Decide where you want to run your Nudge (desktop, mobile web, prototype, mobile app) and select “Choose Template.”
    • Don’t worry–you can run this survey on as many channels as your organization needs. You’ll just need to create additional surveys to cover the different domains your organization spans.
  • Find your template. 
    • Select ASQ from our list of pre-vetted templates. You can type “ASQ” into the search bar to find it of filter by validate/prototype. 
  • Create, edit and publish your survey! 
    • Something to keep in mind for timing is:
      • Targeting based on exit-intent is a common strategy and is easy to do with Qualaroo. You may interpret a participant about to leave your page before completing a task as high perceived difficulty of the task or a lack of support opportunities available/easily findable. This could be an ideal time to launch your ASQ. 
      • Determine the average time it takes to complete the tasks you’re researching and use that information to time your questions. We suggest making sure that this part is tailored to the specific experience with your product or website, and not a general estimate. This is because the time it takes to complete similar tasks on different interfaces can vary. While logging into some apps may be straightforward and take only a minute or so, other decisions or tasks are not quite as straight forward, like deciding on the details of a larger purchase such as furniture. Once you’ve tested this with a few participants, you can adjust the timing of your Nudge as needed. 
    • Because the ASQ is pretty straightforward, you don’t need to do much customizing apart from making sure you get your targeting/timing correct. 

Interpreting Your Results 

Once you’ve collected your results, it’s time to calculate your ASQ score. Finding the score is pretty simple, you just need to take the average of your 3 responses. For times when participants skip questions, simply average the remaining scores. 

Once you’ve gotten your scores, keep in mind that higher scores are better than lower ones because of the way the Likert-scale is set up. A lower score would mean that participants found the task to be difficult or time-consuming or that they generally felt unsupported throughout the process (or all three). 

While we could not find an industry standard for this score, you can still interpret your scores by putting them into context. This information tends to be most helpful when compared across different tasks or over time when design changes are being made. Having a baseline to compare your scores to will make the information more actionable. 

Pros and Cons of ASQ

Pros

Because the ASQ is short and simple, participants won’t have difficulty filling it in and because of the way it is distributed, response rates shouldn’t be a concern. 

Another benefit of the ASQ that’s related to its simplicity is that determining your ASQ score is pretty straightforward. Unlike open-ended responses, which may require a number of methods to clearly discern, the ASQ score is just a matter of averaging the responses you’ve received. 

Cons 

Similarly to any survey that does not include an open-ended section, a limitation of the ASQ is the lack of context, or understanding of why behind scores. We’d generally recommend supplementing your ASQ by asking your participants why they gave the score they did. This information may be particularly valuable for noticeably low scores. 

Resources 

Related articles

Comments

0 comments

Please sign in to leave a comment.

Powered by Zendesk