Authors : Amando P. Singun
Abstract: Vast range of educational systems and technologies seamlessly support or facilitate the educational setting which necessitate an increased attention on their usability. Usability is a relative key concept in the field of Human Computer Interaction (HCI) where main focus is on how the human uses the computer (or any interactive system) as a tool to perform, simplify or support a task. Improving the usability of such systems and technologies can increase productivity while the use of available organizational resources could be maximized, at the pleasure of the stakeholders of the institution. The ISO 92141-11 usability framework is used in this study, focusing on the use of usability metrics to measure the usability goals of the web-based test blueprint system in terms of its effectiveness and efficiency as well as users satisfaction. Effectiveness is measured through completion rates and number of errors whereas efficiency is measured based on the time-based efficiency or overall relative efficiency. Post-task users satisfaction and test-level users satisfaction are measured through standardized survey instruments such as Single Ease Question (SEQ) and System Usability Scale (SUS) questionnaire, respectively. The usability goals are dependent on its context of use ranging from the user characteristics, embedded technologies, required tasks and environment. The results of the usability metrics are influenced by the context-of-use or circumstances surrounding the system. The web-based test blueprint system has a SEQ score of 5.55 and SUS score of 90.00 which imply that the web-based system is highly-effective and highly-efficient which remarkably satisfies the users. The SUS mean value is interpreted as a promoter score because users tend to promote the system to others because of its high acceptability level and remarkable ease-of-use.
Amando P. Singun , 2017. Usability Metrics for a Web-Based Test Blueprint System. Journal of Engineering and Applied Sciences, 12: 6898-6903.