Frequently Asked Questions about User Validation: Prototyping

Return to BASELINE Home Page

Return to FAQ Overview Page

1. Are there any methods or techniques we could usefully use to carry out usability testing on the contents of the design documentation given that we do not have an interactive interface to assess yet? (a1)

2. How will a paper prototyping session be realized in detail ? (a2)

1. Are there any methods or techniques we could usefully use to carry out usability testing on the contents of the design documentation given that we do not have an interactive interface to assess yet?

   You can create paper mock-ups on the basis of the existing design documentation. Each mock-up should consist of a set of screen shots which show important, and different states of the system. A screen shot should show screen layout, menus, buttons, command names etc.

   Invite a few users for a test. Provide them with task scenarios which you have created in advance and let them define more tasks they consider relevant to perform with a system like the one described with the mock-up.Ask users to simulate task execution using the screen shots. Ask users to think aloud while they are performing a task. With this test you can elicit problems test users encounter when using the mock-up.

   If you create alternative mock-ups you can find out which alternative is prefered by the users and then forward the best of the solutions to those team members who will produce the user interface design specification to be implemented.

---




2. How will a paper prototyping session be realized in detail ?

   The main steps of a paper prototyping session are the following:

   1. Start recruiting real users for prototype testing and evaluation right in the beginning. Select users such that all user groups for which the product or service have been defined are covered.
   2. Prepare realistic task scenarios. Focus on critical and frequent tasks, include task sequences, and take workflow into account.
   3. Build paper prototypes. Do not strive for completeness of prototypes, only describe the most important aspects of the user interface. Prototypes can be created either by a single person or by a prototyping team, consisting of a usability expert, real users, user interface designer, and software developer.
   4. Organize test and evaluation sessions. You need a moderator who will confront the users with the design solutions, and who will instruct the users to simulate tasks with the paper prototypes. An assistant may help the moderator noting down comments from users while they are using the prototypes. You can also (video)record users while they are testing the prototypes.
   5. Analyse the user comments and describe the problems identified by test users. Order the user problems according to their severity. Compare the evaluation results for alternative design solutions and select the best solution. Provide user interface designers with recommendations for improvements.