Quality Factors and Evaluation Criteria (Form 8 of BASELINE UVA)

Please indicate which quality factors you targetted for the user validation and then outline briefly the quality criterion, and method used. For each method, please indicate the source where the method is described.

See NOTES at the foot of this section for more guidance if necessary.

Select one or more quality factors, add new factors to the list as necessary.

• Functionality of the application (does it have sufficient functionality)

  Criterion:______________

  Method: ______________

  Source: ______________
   

• Information content of the application (does it have sufficient information)

  Criterion:______________

  Method: ______________

  Source: ______________
   

• Efficiency of application as a tool for supporting the users' job/ role/ profession

  Criterion:______________

  Method: ______________

  Source: ______________
   

• Effectiveness in terms of ability of user to complete their tasks to specification

  Criterion:______________

  Method: ______________

  Source: ______________
   

• Satisfaction of users

  Criterion:______________

  Method: ______________

  Source: ______________

  (please indicate which of the following components of user satisfaction are critical for your application):
  • is it attractive to users
  • do users feel efficient with the application
  • do users feel in control of the application
  • is the application presented in a helpful way to the users
  • does the application offer users ability to learn how to operate it better
   
• Does the application make demands of the user's cognitive capacity (workload)

  Criterion:______________

  Method: ______________

  Source: ______________
   

• Is it safe to use

  Criterion:______________

  Method: ______________

  Source: ______________
   

• Portability of application to different user or technical environments

  Criterion:______________

  Method: ______________

  Source: ______________
   

• Ability of support staff to maintain the application

  Criterion:______________

  Method: ______________

  Source: ______________
   

• Ability of support staff to adapt the application to different work contexts/environments

  Criterion:______________

  Method: ______________

  Source: ______________
   

• Other 1 (please specify):___________________

  Criterion:______________

  Method: ______________

  Source: ______________
   

• Other 2 (please specify):___________________

  Criterion:______________

  Method: ______________

  Source: ______________

Notes:

• Criterion: (Examples: "Time to perform task 1 with the new product should be twice as fast compared to a traditional product"; "The user should be able to use the product without more than x number of breakdowns/ calls for assistance"; "Satisfaction should be higher than for standard market product")
• Method: If you are unsure of what method to use, or where to find a method, please consult the BASELINE helpdesk or the FAQ on the BASELINE web site.
• Source: If the method used is summarised in the ELPUB 105 Usability Study, then it is sufficient to cite "ELPUB 105"; otherwise in your description of the method, please indicate where the method is documented. Generic methods (eg interviews) or proprietary methods (eg company checklist) should be indicated as 'generic' or 'proprietary to company X'.

Return to Structure of UVA Form.