Joh Ming Logo

 


Usability testing is a technique used to evaluate a product by testing it with representative users. In the test, these users will try to complete typical tasks while observers watch, listen and takes notes. The goal is to identify any usability problems, collect quantitative data on participants' performance (time on task, error rates), and determine participant's satisfaction with the product.



Usability Evaluation: Dirge of Cerberus

“Dirge of Cerberus”, is a game based on Final Fantasy VII, it is unique in the sense that it is the first Final Fantasy game that is not a traditional role playing game. “Dirge of Cerberus” is the first, first person shooter game in the final fantasy collection. Because of the uniqueness of this game, summative usability study was conducted. The goals of usability testing include: Establishing a baseline of user performance, establishing and validating user performance measures and identifying potential design concerns to be addressed in order to improve the efficiency, productivity, and end‐user satisfaction for future game development.

IA | Test Facilitator/Moderator
Usability Test Plan
DocumentationView PDF
The Usability Test Plan is a document containing: Identification of User Goals & Testing Goals, Type of Test Conducted, Recruitment Screener, Testing Metrics & Type of Data Collected, Testing Scenarios, Consent Forms, Questionnaires (Post and Pre), Observation Forms, and Facilitator/Moderator Guide.
The Pilot Test
About the StudyView PDF
Usability FindingsView PDF
The Pilot Test was conducted to validate the usability test plan and tasks established. During the pilot test, experienced users were able to identify elements of the nagivation system easily due to familiarity with the game and labeling. Confusion over the terms used in the question, resulted in an increase in the time on task for inexperienced users. Based on these findings, the verbiage was altered for one question on the test so that the terms were unbiased.
Online Screeners and Surveys
Participant ScreenerView Screener
Pre-Test SurveyView Survey
Task 1: Pre-Task SurveyView Survey
Task 1: Observation FormView Survey (administrators only)
Task 1: Post-Task SurveyView Survey
Task 2: Pre-Task SurveyView Survey
Task 2: Observation FormView Survey (administrators only)
Task 2: Post SurveyView Survey
Task 3: Pre-Task SurveyView Survey
Task 3: Observation FormView Survey (administrators only)
Task 3: Post-Task SurveyView Survey
Task 4: Pre-Task SurveyView Survey
Task 4: Observation FormView Survey (administrators only)
Task 4: Post-Task SurveyView Survey
Task 5: Pre-Task SurveyView Survey
Task 5: Observation FormView Survey (administrators only)
Task 5: Post-Task SurveyView Survey
Task 6: Pre-Task SurveyView Survey
Task 6: Observation FormView Survey (administrators only)
Task 6: Post-Task SurveyView Survey
Post-Test SurveyView Survey
System Usability ScaleView Survey

Online surveys are structured interviews with users, where you display a list of questions online and record users' responses. The Dirge of Cerberus study, combined an online survey with individual interviews.


© 2005 - 2010 Joh Ming Design
Examples shown on this site contain client proprietary information
not to be re-distributed or used for commercial gain.