ApproachDuring the evaluation, participants provided real-time feedback using the “think aloud” approach.
After the tasks were complete, adult participants completed a standard SUS survey using Qualtrics. We then had a debriefing session where they provided additional feedback. I used the RITE method to test often and adjust frequently (McGinn, 2013). |
Download the PDF above for more detailed information.
|
Quantitative data collection during usability test sessions focused on time to complete tasks and success rate versus errors. A standard SUS survey was given to gather feedback after the evaluation tasks were completed. For the children that used the application independently, I asked the parents to complete the survey based on their observation of their child and their own interest based on those observations, as they would be the purchase decision makers if this application were on the market.
Qualitative assessments were captured in observation logs as each participant performed the tasks. Additional feedback was gathered from the participants in a post-evaluation interview. The findings from the quantitative and qualitative assessments were analyzed to identify trends and to compile a recommended change log.
Qualitative assessments were captured in observation logs as each participant performed the tasks. Additional feedback was gathered from the participants in a post-evaluation interview. The findings from the quantitative and qualitative assessments were analyzed to identify trends and to compile a recommended change log.
Participants
I conducted 3 pilot evaluations for three user profiles: (1) adult recorder, (2) dependent child listener (the hands-on user is the parent/caregiver), and (3) independent child listener (able to perform the tasks with minimal or no training).
I conducted 6 evaluation sessions with 4 participants representing the adult recorder group, 1 participant representing the dependent child caregiver, and 1 participant representing the independent child listener.
I conducted 6 evaluation sessions with 4 participants representing the adult recorder group, 1 participant representing the dependent child caregiver, and 1 participant representing the independent child listener.
Demographics and EnvironmentThe following table provides an overview of the participant demographics, user group they represent, and the test environment in which the evaluation was conducted.
|
TasksP1 through P4 performed tasks 1 and 2 described in the table below. P5 and P6 performed tasks 3 and 4.
|
Results
Task Completion |
Errors |
References
McGinn, J. & Chang, A. (2013). RITE+Krug: A Combination of Usability Test Methods for Agile Design. Journal of Usability Studies, 8 (3), 61-68.