Usability evaluation of a mobile government service: mPAL-my cpf

  • Authors:
  • Yogesh Tadwalkar;Yi Xiaoli;Rudi Lim

  • Affiliations:
  • Human Factors International, Republic Plaza, Singapore;Nanyang Technological University, Singapore;Human Factors International, Republic Plaza, Singapore

  • Venue:
  • Mobility '07 Proceedings of the 4th international conference on mobile technology, applications, and systems and the 1st international symposium on Computer human interaction in mobile technology
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper presents findings from usability evaluation of 'mPAL-my cpf' - a mobile government service provided by Central Provident Fund, Singapore. 20 users between 22-45 years of age participated in the tests. The focus of evaluation was to assess the mental model, information architecture and perceived utility of the overall application as well as learnability, efficiency, and comprehension of the 6 specific offerings. A total of 65 usability problems were found with most severe issues observed in understanding how the m-service works and installing it on the mobile phone. Navigation problems included inconsistent placement of options tagged to soft keys and accidental logouts. Problems in information comprehension included excessive text and inability to find the key data quickly. Despite convenience of ubiquitous and anytime access, overall utility of 'mPAL' service was perceived as low by users due to complexity involved in using it, lack of unique value as compared to accessing the same information via website, and concerns about security. Based on these and other findings, the paper also recommends a broad framework for designing and evaluating future m-government applications.