Usability of system and software—
Part 3: Method of evaluating and testing
1 Scope
This part of GB/T 29836 specifies the method of evaluating and testing for how to obtain the values of usability metrics.
This part is applicable to all kinds of systems and software with human-computer interaction, but it is not applicable to systems and software without human-computer interaction function or without usability requirements during use.
Note: The systems referred to in this part are mainly software systems.
2 Normative references
The following referenced documents are indispensable for the application of this document. For dated references, only the edition cited applies. For undated references, the latest edition of the referenced document (including any amendments) applies.
GB/T 11457 Information technology—Software engineering terminology
GB/T 16260.1 Software engineering—Product quality—Part 1: Quality model (GB/T 16260.1-2006, ISO/IEC 9126-1:2001, IDT)
GB/T 29836.1-2013 Usability of system and software—Part 1: Indicator system
GB/T 29836.2-2013 Usability of system and software—Part 2: Metric method
3 Terms and definitions
For the purposes of this document, the terms and definitions given in GB/T 29836.1-2013, GB/T 16260.1 and GB/T 11457 apply.
4 General
The usability of system and software is an external attribute of software, which usually requires users to participate in testing. Common usability testing methods can be generally divided into three categories: mathematical model, subjective testing and evaluation, and objective testing and evaluation. See clause 9 for a detailed description of the main usability methods.
In this part, the meaning of testing is consistent with that of testing and evaluation, and no obvious difference is made.
Annex A gives an example of usability testing and evaluation of online scoring system.
5 Understandability
5.1 Evident functions
The testing requirements for evident functions are as follows:
——Precondition
The requirements of the software under test have been determined and the software is ready to run;
——Test input
Requirements specification, user documentation and software package;
——Measurement type
Count/count;
——Test method
User test;
Note: The test method mentioned in this part is not unique. In practice, the testing and evaluation methods mentioned in clause 9 hereof or other applicable methods may be used.
——Key points of implementation:
Foreword i
Introduction ii
1 Scope
2 Normative references
3 Terms and definitions
4 General
5 Understandability
5.1 Evident functions
5.2 Completeness of description
5.3 Demonstration accessibility
5.4 Demonstration effectiveness
5.5 Input validity check
6 Learnability
6.1 Effectiveness of help documentation
6.2 Effectiveness of help mechanism
7 Operability
7.1 Default value availability in use
7.2 Steps to complete the designated task
7.3 Complexity of operation
7.4 Number of misoperations in the process of completing the designated task
7.5 Error correction
7.6 Effect of errors
7.7 Restorability
7.8 Operational error recoverability
7.9 Message understandability in use
7.10 Status monitoring capability
7.11 Customisability of interface elements
7.12 Customisability of interface layout
7.13 Customisability of shortcuts
7.14 Customisability of operation procedures
7.15 Special auxiliary functions
7.16 Physical accessibility
7.17 Consistency
8 Attractiveness
8.1 Visual attractiveness of interface color
8.2 Comfort of interface element shape
8.3 Reasonableness of interface element size
8.4 Reasonableness of layout
8.5 User perception
9 Description of testing and evaluation methods
9.1 Classification of methods
9.2 Description structure of method implementation process
9.3 User model method
9.4 User test method
9.5 Technical test method
9.6 Evaluation and review method
9.7 Investigation method
10 Selection of users during evaluating and testing
10.1 Principle for selection
10.2 Computer skills
10.3 Business experience
10.4 Cognitive ability
11 Test environment for usability
11.1 Expected effects
11.2 Required conditions
11.3 Optional equipment
Annex A (Informative) Example of usability testing and evaluation of online scoring system
Bibliography
