Abstract
Since the release of the first mobile devices, the usability of on-board applications has been the concern not only of software vendors but hardware manufacturers as well. The academia community later willingly joined the discussion on usability in terms of theory and empirical measurement, having experience and knowledge in desktop settings. At first sight, such a background should guarantee a solid foundation to conduct research on software usability in a new setting. However, a preliminary study on the subject matter revealed methodological disorder in contemporary literature. As a matter of fact, a need emerged to review existing usability definitions, attributes and measures to recognize all associated aspects. In order to fill this void, we conducted a systematic literature review on usability studies indexed by the Scopus database and devoted to mobile applications. The input volume covers 790 documents from 2001 to 2018. The data analysis shows that the ISO 9241–11 usability definition has been adopted in an unchanged form and popularized as the standard by the HCI community. Secondly, in total, 75 attributes were identified and analysed. The most frequent are efficiency (70%), satisfaction (66%) and effectiveness (58%), which directly originate from the above definition. Subsequently, the less frequent are learnability (45%), memorability (23%), cognitive load (19%) and errors (17%). The last two concern simplicity (13%) and ease of use (9%). Thirdly, in the evaluation of usability, controlled observation and surveys are two major research methods applied, while eye-tracking, thinking aloud and interview are hardly used and serve as complementary to collect additional data. Moreover, usability evaluations are often confused with user experience dimensions, covering not only application quality characteristics, but also user beliefs, emotions and preferences. All these results indicate the need for further research on the usability of mobile applications, aiming to establish a consensus in the theory and practice among all interested parties.
Citations
-
9 2
CrossRef
-
0
Web of Science
-
9 6
Scopus
Author (1)
Cite as
Full text
- Publication version
- Accepted or Published Version
- License
- open in new tab
Keywords
Details
- Category:
- Articles
- Type:
- artykuły w czasopismach
- Published in:
-
IEEE Access
pages 55563 - 55577,
ISSN: 2169-3536 - Language:
- English
- Publication year:
- 2020
- Bibliographic description:
- Weichbroth P.: Usability of mobile applications: a systematic literature study// IEEE Access -,iss. 8 (2020), s.55563-55577
- DOI:
- Digital Object Identifier (open in new tab) 10.1109/access.2020.2981892
- Bibliography: test
-
- M. Rouse and I. Wigmore. (2013). Definition. Mobile App. [Online].
- Statista. (2019). Global Mobile Device Market Share in 2017 and 2018, by Device Type. [Online]. Available: https://www.statista.com/ statistics/183530/worldwide-market-share-mobile-device/ open in new tab
- Statista. (2019). Smartphone User Penetration as Percentage of Total Global Population From 2014 to 2021. [Online]. Available: https:// www.statista.com/statistics/203734/global-smartphone-penetration-per- capita-since-2005/ open in new tab
- H. M. Salman, W. F. Wan Ahmad, and S. Sulaiman, ''Usability evaluation of the smartphone user interface in supporting elderly users from experts' perspective,'' IEEE Access, vol. 6, pp. 22578-22591, 2018. open in new tab
- M. Sikorski, ''Beyond product usability: User satisfaction and quality management,'' in Proc. CHI Extended Abstr. Hum. Factors Comput. Syst. (CHI). New York, NY, USA: ACM, 2000, pp. 61-62. open in new tab
- H. Feng, T. Hoegler, and W. Stucky, ''Exploring the critical success factors for mobile commerce,'' in Proc. Int. Conf. Mobile Bus., Jun. 2006, p. 40. open in new tab
- E. Garcia-Lopez, A. Garcia-Cabot, C. Manresa-Yee, L. de-Marcos, and C. Pages-Arevalo, ''Validation of navigation guidelines for improving usability in the mobile Web,'' Comput. Standards Interfaces, vol. 52, pp. 51-62, May 2017. open in new tab
- N. Tractinsky, ''The usability construct: A dead end?'' Hum.-Comput. Interact., vol. 33, no. 2, pp. 131-177, Mar. 2018. open in new tab
- B. Shackel, ''Usability-Context, framework, definition, design and eval- uation,'' Interacting Comput., vol. 21, nos. 5-6, pp. 339-346, Dec. 2009. open in new tab
- J. Kjeldskov and J. Stage, ''New techniques for usability evaluation of mobile systems,'' Int. J. Hum.-Comput. Stud., vol. 60, nos. 5-6, pp. 599-620, May 2004. open in new tab
- K. Gulzar, J. Sang, M. Ramzan, and M. Kashif, ''Fuzzy approach to prioritize usability requirements conflicts: An experimental evaluation,'' IEEE Access, vol. 5, pp. 13570-13577, 2017. open in new tab
- P. Weichbroth, ''Delivering usability in IT products: Empirical lessons from the field,'' Int. J. Softw. Eng. Knowl. Eng., vol. 28, no. 7, pp. 1027-1045, Jul. 2018. open in new tab
- M. S. Bashir and A. Farooq, ''EUHSA: Extending usability heuristics for smartphone application,'' IEEE Access, vol. 7, pp. 100838-100859, 2019. open in new tab
- R. Parente Da Costa, E. D. Canedo, R. T. De Sousa, R. De Oliveira Albuquerque, and L. J. Garcia Villalba, ''Set of usability heuristics for quality assessment of mobile applications on smartphones,'' IEEE Access, vol. 7, pp. 116145-116161, 2019.
- A. Seffah, M. Donyaee, R. B. Kline, and H. K. Padda, ''Usability mea- surement and metrics: A consolidated model,'' Softw. Qual. J., vol. 14, no. 2, pp. 159-178, Jun. 2006. open in new tab
- S. Winter, S. Wagner, and F. Deissenboeck, ''A comprehensive model of usability,'' in Proc. IFIP Int. Conf. Eng. Hum.-Comput. Interact. Berlin, Germany: Springer, 2007, pp. 106-122. open in new tab
- K. Majrashi and M. Hamilton, ''A cross-platform usability measurement model,'' Lect. Notes Softw. Eng., vol. 3, no. 2, p. 132, 2015. open in new tab
- P. Weichbroth, ''Usability attributes revisited: A time-framed knowledge map,'' in Proc. Federated Conf. Comput. Sci. Inf. Syst., Sep. 2018, pp. 1005-1008. open in new tab
- Software Enginnering-Product Quality, Standard ISO/IEC 9126:1991, ISO/IEC, Geneva, Switzerland, 1991. open in new tab
- Ergonomic Requirements for Office Work With Visual Display Termi- nals (VDTs)-Part 11: Guidance on Usability, Standard ISO 9241- 11:1998(en), ISO, Geneva, Switzerland, 1998. [Online]. Available: https://www.iso.org/obp/ui/#iso:std:iso:9241:-11:ed-1:v1:en open in new tab
- Ergonomics of Human-System Interaction-Part 11: Usability: Defini- tions and Concepts, ISO 9241-11:2018(en), ISO, Geneva, Switzerland, 2018. [Online]. Available: https://www.iso.org/obp/ui/#iso:std:iso:9241:- 11:ed-2:v1:en open in new tab
- J. R. Lewis, ''Usability: Lessons learned. . . and yet to be learned,'' Int. J. Hum.-Comput. Interact., vol. 30, no. 9, pp. 663-684, Sep. 2014. open in new tab
- D. Quiñones and C. Rusu, ''How to develop usability heuristics: A systematic literature review,'' Comput. Standards Interfaces, vol. 53, pp. 89-122, Aug. 2017. open in new tab
- Systems and Software Engineering-Systems and Software Quality Requirements and Evaluation (SQuaRE)-System and Software Quality Models, Standard ISO/IEC 25010:2011, ISO, Geneva, Switzerland, 2011. open in new tab
- Software Engineering-Product Quality-Part 1: Quality Model, Standard ISO/IEC 9126-1:2001, ISO, Geneva, Switzerland, 2001. [Online]. Available: https://www.iso.org/standard/22749.html open in new tab
- J. Nielsen, ''Iterative user-interface design,'' Computer, vol. 26, no. 11, pp. 32-41, Nov. 1993. open in new tab
- N. Bevan, ''Usability is quality of use,'' in Advances in Human Fac- tors/Ergonomics, vol. 20. Amsterdam, The Netherlands: Elsevier, 1995, pp. 349-354. open in new tab
- J. M. C. Bastien, ''Usability testing: A review of some methodological and technical aspects of the method,'' Int. J. Med. Inform., vol. 79, no. 4, pp. e18-e23, Apr. 2010. open in new tab
- T. Boren and J. Ramey, ''Thinking aloud: Reconciling theory and practice,'' IEEE Trans. Prof. Commun., vol. 43, no. 3, pp. 261-278, 3rd Quart., 2000. open in new tab
- S. Richardson, R. Mishuris, A. O'Connell, D. Feldstein, R. Hess, P. Smith, L. McCullagh, T. McGinn, and D. Mann, '''Think aloud' and 'Near live' usability testing of two complex clinical decision support tools,'' Int. J. Med. Inform., vol. 106, pp. 1-8, Oct. 2017. open in new tab
- G. Deniz and P. O. Durdu, ''A comparison of mobile form controls for different tasks,'' Comput. Standards Interfaces, vol. 61, pp. 97-106, Jan. 2019. open in new tab
- T. Kato, ''What 'question-asking protocols' can say about the user inter- face,'' Int. J. Man-Mach. Stud., vol. 25, no. 6, pp. 659-673, Dec. 1986. open in new tab
- T. Obata, T. Daimon, and H. Kawashima, ''A cognitive study of in- vehicle navigation systems: Applying verbal protocol analysis to usability evaluation,'' in Proc. Vehicle Navigat. Inf. Syst. Conf. (VNIS), Oct. 1993, pp. 232-237. open in new tab
- R. Nagpal, D. Mehrotra, and P. K. Bhatia, ''The state of art in Website usability evaluation methods,'' in Design Solutions for User- Centric Information Systems. Harrisburg, PA, USA: IGI Global, 2017, pp. 275-296. open in new tab
- et. al. R. Nagpal, ''FAHP approach to rank educational Websites on usability,'' Int. J. Comput. Digit. Syst., vol. 4, no. 4, pp. 251-260, Oct. 2015.
- A. Hinderks, M. Schrepp, F. J. Domínguez Mayo, M. J. Escalona, and J. Thomaschewski, ''Developing a UX KPI based on the user experi- ence questionnaire,'' Comput. Standards Interfaces, vol. 65, pp. 38-44, Jul. 2019. open in new tab
- J.-P. Jain and W.-C. Shen, ''A study of the optimization of app design with regards to usability and user experience-a case study of SunlineApp,'' in Proc. Eng. Innov. Design, 7th Int. Conf. Innov., Commun. Eng. (ICICE), Hangzhou, China. CRC Press, May 2019, p. 175. open in new tab
- A. Holzinger, ''Usability engineering methods for software developers,'' Commun. ACM, vol. 48, no. 1, pp. 71-74, Jan. 2005. open in new tab
- L. F. Gonçalves, L. G. Vasconcelos, E. V. Munson, and L. A. Baldochi, ''Supporting adaptation of Web applications to the mobile environment with automated usability evaluation,'' in Proc. 31st Annu. ACM Symp. Appl. Comput. (SAC). New York, NY, USA: ACM, 2016, pp. 787-794. open in new tab
- J. Grigera, A. Garrido, J. M. Rivero, and G. Rossi, ''Automatic detection of usability smells in Web applications,'' Int. J. Hum.-Comput. Stud., vol. 97, pp. 129-148, Jan. 2017. open in new tab
- J. Falkowska, J. Sobecki, and M. Pietrzak, ''Eye tracking usability testing enhanced with EEG analysis,'' in Proc. Int. Conf. Design, User Exper., Usability. Cham, Switzerland: Springer, 2016, pp. 399-411. open in new tab
- P. Weichbroth, K. Redlarski, and I. Garnik, ''Eye-tracking Web usability research,'' in Proc. Federated Conf. Comput. Sci. Inf. Syst., Oct. 2016, pp. 1681-1684. open in new tab
- P. Realpe-Muñoz, C. A. Collazos, J. Hurtado, T. Granollers, J. Muñoz-Arteaga, and J. Velasco-Medina, ''Eye tracking-based behavioral study of users using e-voting systems,'' Comput. Standards Interfaces, vol. 55, pp. 182-195, Jan. 2018. open in new tab
- T. Tullis, S. Fleischman, M. McNulty, C. Cianchette, and M. Bergel, ''An empirical comparison of lab and remote usability testing of Web sites,'' in Proc. Usability Professionals Assoc. Conf., 2002, pp. 1-8.
- J. Dong, S. L. Martin, J. M. Mullaly, and A. R. Tannenbaum, ''Method, system and program for performing remote usability testing,'' U.S. Patent 6 526 526, Feb. 25, 2003.
- J. Sauer, A. Sonderegger, K. Heyden, J. Biller, J. Klotz, and A. Uebelbacher, ''Extra-laboratorial usability tests: An empirical com- parison of remote and classical field testing with lab testing,'' Appl. Ergonom., vol. 74, pp. 85-96, Jan. 2019. open in new tab
- M. J. Scott, F. Spyridonis, and G. Ghinea, ''Designing for design- ers: Towards the development of accessible ICT products and services using the VERITAS framework,'' Comput. Standards Interfaces, vol. 42, pp. 113-124, Nov. 2015. open in new tab
- J. Díaz, C. Rusu, and C. A. Collazos, ''Experimental validation of a set of cultural-oriented usability heuristics: E-commerce Websites evaluation,'' Comput. Standards Interfaces, vol. 50, pp. 160-178, Feb. 2017. open in new tab
- T. C. Lacerda and C. G. von Wangenheim, ''Systematic literature review of usability capability/maturity models,'' Comput. Standards Interfaces, vol. 55, pp. 95-105, Jan. 2018. open in new tab
- D. Quiñones, C. Rusu, and V. Rusu, ''A methodology to develop usabil- ity/user experience heuristics,'' Comput. Standards Interfaces, vol. 59, pp. 109-129, Aug. 2018. open in new tab
- I. Connell, A. Blandford, and T. Green, ''CASSM and cognitive walk- through: Usability issues with ticket vending machines,'' Behav. Inf. Technol., vol. 23, no. 5, pp. 307-320, Sep. 2004. open in new tab
- T. Hollingsed and D. G. Novick, ''Usability inspection methods after 15 years of research and practice,'' in Proc. 25th Annu. ACM Int. Conf. Design Commun. (SIGDOC). New York, NY, USA: ACM, 2007, pp. 249-255. open in new tab
- L. Alonso-Virgós, J. P. Espada, and R. G. Crespo, ''Analyzing compli- ance and application of usability guidelines and recommendations by Web developers,'' Comput. Standards Interfaces, vol. 64, pp. 117-132, May 2019. open in new tab
- Z. Zhang, V. Basili, and B. Shneiderman, ''Perspective-based usability inspection: An empirical validation of efficacy,'' Empirical Softw. Eng., vol. 4, no. 1, pp. 43-69, 1999. open in new tab
- M. N. Mahrin, P. Strooper, and D. Carrington, ''Selecting usability evaluation methods for software process descriptions,'' in Proc. 16th open in new tab
- Asia-Pacific Softw. Eng. Conf., Dec. 2009, pp. 523-529. open in new tab
- C. Wilson, User Interface Inspection Methods: A User-Centered Design Method. London, U.K.: Newnes, 2013. open in new tab
- J. Vanderdonckt and A. Beirekdar, ''Automated Web evaluation by guide- line review,'' J. Web Eng., vol. 4, no. 2, pp. 102-117, 2005. open in new tab
- M. Speicher, A. Both, and M. Gaedke, ''Towards metric-based usability evaluation of online Web interfaces,'' in Proc. Mensch Comput. Work- shopband, 2013, pp. 277-281. open in new tab
- T. S. D. Silva, M. S. Silveira, and F. Maurer, ''Usability evaluation practices within agile development,'' in Proc. 48th Hawaii Int. Conf. Syst. Sci., Jan. 2015, pp. 5133-5142. open in new tab
- G. Büyüközkan, ''Determining the mobile commerce user requirements using an analytic approach,'' Comput. Standards Interfaces, vol. 31, no. 1, pp. 144-152, Jan. 2009. open in new tab
- K. Curcio, A. Malucelli, S. Reinehr, and M. A. Paludo, ''An analysis of the factors determining software product quality: A comparative study,'' Comput. Standards Interfaces, vol. 48, pp. 10-18, Nov. 2016. open in new tab
- I. Arroyo, F. Giné, C. Roig, and A. Granollers, ''Performance and usabil- ity tradeoff in a cluster display wall,'' Comput. Standards Interfaces, vol. 62, pp. 53-63, Feb. 2019. open in new tab
- A. Darejeh and D. Singh, ''An investigation on ribbon interface design guidelines for people with less computer literacy,'' Comput. Standards Interfaces, vol. 36, no. 5, pp. 808-820, Sep. 2014. open in new tab
- A. Shrestha, A. Cater-Steel, M. Toleman, and T. Rout, ''Benefits and rel- evance of international standards in a design science research project for process assessments,'' Comput. Standards Interfaces, vol. 60, pp. 48-56, Nov. 2018. open in new tab
- P. Efe and O. Demirors, ''A change management model and its applica- tion in software development projects,'' Comput. Standards Interfaces, vol. 66, Oct. 2019, Art. no. 103353. open in new tab
- S. Caplan, ''Using focus group methodology for ergonomic design,'' Ergonomics, vol. 33, no. 5, pp. 527-533, May 1990. open in new tab
- J. Nielsen, ''The use and misuse of focus groups,'' IEEE Softw., vol. 14, no. 1, pp. 94-95, 1997. open in new tab
- A. Stefani and M. Xenos, ''Weight-modeling of B2C system qual- ity,'' Comput. Standards Interfaces, vol. 33, no. 4, pp. 411-421, Jun. 2011. open in new tab
- A. Sutcliffe, ''Task analysis, systems analysis and design: Sym- biosis or synthesis?'' Interacting Comput., vol. 1, no. 1, pp. 6-12, Apr. 1989. open in new tab
- D. Benyon, ''Adaptive systems: A solution to usability problems,'' User Model. User-Adapted Interact., vol. 3, no. 1, pp. 65-87, 1993. open in new tab
- A. Crystal and B. Ellington, ''Task analysis and human-computer inter- action: Approaches, techniques, and levels of analysis,'' in Proc. 10th open in new tab
- Americas Conf. Inf. Syst. (AMCIS), 2004, p. 391. open in new tab
- G. de Haan, G. C. van der Veer, and J. C. van Vliet, ''Formal mod- elling techniques in human-computer interaction,'' Acta Psychol., vol. 78, nos. 1-3, pp. 27-67, Dec. 1991. open in new tab
- A. Badre, Shaping Web Usability: Interaction Design in Context. Reading, MA, USA: Addison-Wesley, 2002.
- S. R. Humayoun, Y. Dubinsky, and T. Catarci, ''A three-fold integration framework to incorporate user-centered design into agile software devel- opment,'' in Proc. Int. Conf. Hum. Centered Design. Berlin, Germany: Springer, 2011, pp. 55-64. open in new tab
- S. K. Card, A. Newell, and T. P. Moran, The Psychology of Human- Computer Interaction. Trenton, NJ, USA: Lawrence Erlbaum Associates Inc., 1983.
- S. A. Oyewole and J. M. Haight, ''Determination of optimal paths to task goals using expert system based on GOMS model,'' Comput. Hum. Behav., vol. 27, no. 2, pp. 823-833, Mar. 2011. open in new tab
- D. Fernandez-Lanvin, J. D. Andres-Suarez, M. Gonzalez-Rodriguez, and B. Pariente-Martinez, ''The dimension of age and gender as user model demographic factors for automatic personalization in e-commerce sites,'' Comput. Standards Interfaces, vol. 59, pp. 1-9, Aug. 2018. open in new tab
- D. Zhang and B. Adipat, ''Challenges, methodologies, and issues in the usability testing of mobile applications,'' Int. J. Hum.-Comput. Interact., vol. 18, no. 3, pp. 293-308, Jul. 2005. open in new tab
- A. Hussain and M. Kutar, ''Usability metric framework for mobile phone application,'' in Proc. 10th Annu. PostGraduate Symp. Converg. Telecom- mun., Netw. Broadcast., 2009, pp. 978-982. open in new tab
- A. H. Kronbauer, C. A. S. Santos, and V. Vieira, ''Smartphone applica- tions usability evaluation: A hybrid model and its implementation,'' in Proc. Int. Conf. Hum.-Centred Softw. Eng. Berlin, Germany: Springer, 2012, pp. 146-163. open in new tab
- R. Harrison, D. Flood, and D. Duce, ''Usability of mobile applications: Literature review and rationale for a new usability model,'' J. Interact. Sci., vol. 1, no. 1, p. 1, 2013. open in new tab
- I. do Nascimento Mendes and A. C. Dias-Neto, ''A process-based approach to test usability of multi-platform mobile applications,'' in Proc. Int. Conf. Design, User Exper., Usability. Cham, Switzerland: Springer, 2016, pp. 456-468. open in new tab
- A. Saleh, R. B. Isamil, and N. B. Fabil, ''Extension of pacmad model for usability evaluation metrics using goal question metrics (GQM) approach,'' J. Theor. Appl. Inf. Technol., vol. 79, no. 1, pp. 90-100, 2015.
- N. Parsazadeh, R. Ali, and M. Rezaei, ''A framework for cooperative and interactive mobile learning to improve online information evaluation skills,'' Comput. Edu., vol. 120, pp. 75-89, May 2018. open in new tab
- E. A. Khan and M. K. Y. Shambour, ''An analytical study of mobile applications for Hajj and Umrah services,'' Appl. Comput. Informat., vol. 14, no. 1, pp. 37-47, Jan. 2018. open in new tab
- P. Lew and L. Olsina, ''Relating user experience with MobileApp quality evaluation and design,'' in Proc. Int. Conf. Web Eng. Cham, Switzerland: Springer, 2013, pp. 253-268. open in new tab
- H. I. Abubakar, N. Hashim, and A. Hussain, ''Verification process of usability evaluation model for m-banking application,'' in Proc. Recent Adv. Comput. Sci. 14th Int. Conf. Appl. Comput. Appl. Comput. Sci. (ACA- COS), 2015, pp. 23-25. open in new tab
- E. Kaur and P. D. Haghighi, ''A context-aware usability model for mobile health applications,'' in Proc. 14th Int. Conf. Adv. Mobile Comput. Multi Media (MoMM). New York, NY, USA: ACM, 2016, pp. 181-189. open in new tab
- B. Kitchenham, ''Procedures for performing systematic reviews,'' Keele, UK, Keele Univ., vol. 33, no. 2004, pp. 1-26, 2004.
- B. Kitchenham and S. Charters, ''Guidelines for performing systematic literature reviews in software engineering (version 2.3),'' Keele Univ. Durham Univ., Keele, U.K., & Durham, U.K., Tech. Rep., EBSE-2007- 01, 2007.
- H. Zhang and M. Ali Babar, ''Systematic reviews in software engineer- ing: An empirical investigation,'' Inf. Softw. Technol., vol. 55, no. 7, pp. 1341-1354, Jul. 2013. open in new tab
- Scopus. An Eye on Global Research: 5,000 Publishers. Over 71 M Records and 23,700 Titles, Amsterdam, The Netherlands, Elsevier, 2018. [Online]. Available: https://www.elsevier.com/__ data/assets/pdf_file/0017/114533/SC_FS_overview_WEB.pdf open in new tab
- C. K. Coursaris and D. Kim, ''A research agenda for mobile usability,'' in Proc. CHI Extended Abstr. Hum. Factors Comput. Syst. (CHI). New York, NY, USA: ACM, 2007, pp. 2345-2350. open in new tab
- IEEE Standard Glossary of Software Engineering Terminology, IEEE Standard 610.12-1990, 1990, pp. 1-84. open in new tab
- J. Nielsen, ''Durability of usability guidelines,'' Alertbox, Bengaluru, India, Tech. Rep., Jan. 2005.
- N. Bevan, ''International standards for HCI and usability,'' Int. J. Hum.- Comput. Stud., vol. 55, no. 4, pp. 533-552, Oct. 2001. open in new tab
- L. Barnett, C. Harvey, and C. Gatzidis, ''First time user experiences in mobile games: An evaluation of usability,'' Entertainment Comput., vol. 27, pp. 82-88, Aug. 2018. open in new tab
- N. Bessghaier and M. Souii, ''Towards usability evaluation of hybrid mobile user interfaces,'' in Proc. IEEE/ACS 14th Int. Conf. Comput. Syst. Appl. (AICCSA), Oct. 2017, pp. 895-900. open in new tab
- R. Duran-Saez, X. Ferre, H. Zhu, and Q. Liu, ''Task analysis-based user event logging for mobile applications,'' in Proc. IEEE 25th Int. Requirements Eng. Conf. Workshops (REW), Sep. 2017, pp. 152-155. open in new tab
- S. Caro-Alvaro, E. Garcia-Lopez, A. Garcia-Cabot, L. de-Marcos, and J.-J. Martinez-Herraiz, ''Identifying usability issues in instant messag- ing apps on iOS and Android platforms,'' Mobile Inf. Syst., vol. 2018, pp. 1-19, Oct. 2018. open in new tab
- J. Espinoza, P. Loarte, C. Espinoza, F. Paz, and J. Arenas, ''A new software development model: Innovation through mobile application with UCD,'' in Proc. Int. Conf. Design, Exper., Usability. Cham, Switzerland: Springer, 2018, pp. 673-692. open in new tab
- F. Z. Ghazizadeh and S. Vafadar, ''A quantitative evaluation of usability in mobile applications: An empirical study,'' in Proc. Int. Symp. Comput. Sci. Softw. Eng. Conf. (CSSE), Oct. 2017, pp. 1-6. open in new tab
- Z. Huang and Z. Tian, ''Analysis and design for mobile applications: A user experience approach,'' in Proc. Int. Conf. Design, User Exper., Usability. Cham, Switzerland: Springer, 2018, pp. 91-100. open in new tab
- A. Hussain, E. O. Mkpojiogu, S. Mortada, and W. S. Yue, ''Mobile experience evaluation of an e-reader app,'' J. Telecommun., Electron. Comput. Eng. (JTEC), vol. 10, nos. 1-10, pp. 11-15, 2018. open in new tab
- J. Krzewińska, A. Indyka-Piasecka, M. Kopel, E. Kukla, Z. Telec, and B. Trawiński, ''Usability testing of a responsive Web system for a school for disabled children,'' in Proc. Asian Conf. Intell. Inf. Database Syst. Cham, Switzerland: Springer, 2018, pp. 705-716. open in new tab
- K. M. Malan, J. H. P. Eloff, and J. A. De Bruin, ''Semi-automated usability analysis through eye tracking,'' South Afr. Comput. J., vol. 30, no. 1, pp. 66-84, 2018. open in new tab
- S. S. Nathan, A. Hussain, and N. L. Hashim, ''Usability evaluation of deaf mobile application interface: A systematic review,'' J. Eng. Appl. Sci., vol. 13, no. 2, pp. 291-297, 2018. open in new tab
- R. Pakomera, D. van Greunen, and A. Veldsman, ''Usability and use- fulness in designing patient-centric systems in afro-centric setting,'' in Proc. 6th Int. Conf. Rel., Infocom Technol. Optim. (Trends Future Direc- tions) (ICRITO), Sep. 2017, pp. 576-579. open in new tab
- S. Shafiq and T. A. Khan, ''Role & value of usability in educational learning via game based apps,'' Int. J. Sci. Technol. Res., vol. 7, pp. 70-77, Nov. 2018.
- V. N. Adama, I. S. Shehu, S. A. Adepoju, and R. G. Jimoh, ''Towards designing mobile banking user interfaces for novice users,'' in Proc. Int. Conf. Design, User Exper., Usability. Cham, Switzerland: Springer, 2017, pp. 181-197. open in new tab
- M. Aguilar and C. Zapata, ''Integrating UCD and an agile methodol- ogy in the development of a mobile catalog of plants,'' in Advances in Ergonomics Modeling, Usability & Special Populations. Cham, Switzer- land: Springer, 2017, pp. 75-87. open in new tab
- S. Caro-Alvaro, E. Garcia-Lopez, A. Garcia-Cabot, L. de-Marcos, and J.-M. Gutierrez-Martinez, ''A systematic evaluation of mobile applica- tions for instant messaging on iOS devices,'' Mobile Inf. Syst., vol. 2017, pp. 1-17, Oct. 2017. open in new tab
- Z. M. C. Cruz, J. J. R. Alpay, J. D. D. Depeno, M. J. C. Altabirano, and R. Bringula, ''Usability of 'Fatchum': A mobile application recipe recom- mender system,'' in Proc. 6th Annu. Conf. Res. Inf. Technol. New York, NY, USA: ACM, 2017, pp. 11-16. open in new tab
- S. Ibtasam, H. Mehmood, L. Razaq, J. Webster, S. Yu, and R. Anderson, ''An exploration of smartphone based mobile money applications in pakistan,'' in Proc. 9th Int. Conf. Inf. Commun. Technol. Develop. (ICTD). New York, NY, USA: ACM, 2017, p. 1. open in new tab
- S. Prezenski, D. Bruechner, and N. Russwinkel, ''Predictive cognitive modelling of applications,'' in Proc. 12th Int. Joint Conf. Comput. Vis., Imag. Comput. Graph. Theory Appl., 2017, pp. 165-171. open in new tab
- Y. Wang and R. Brennan, ''Building high usability consumer-oriented linked data mobile apps,'' in Proc. Irish Conf. Artif. Intell. Cogn. Sci. (AICS), Dublin, Republic of Ireland, Dec. 2017, pp. 1-12. open in new tab
- Q. Ye, S. A. Boren, U. Khan, and M. S. Kim, ''Evaluation of func- tionality and usability on diabetes mobile applications: A systematic literature review,'' in Proc. Int. Conf. Digit. Hum. Modeling Appl. Health, Saf., Ergonom. Risk Manage. Cham, Switzerland: Springer, 2017, pp. 108-116. open in new tab
- V. V. S. M. Chintapalli, W. Tao, Z. Meng, K. Zhang, J. Kong, and Y. Ge, ''A comparative study of spreadsheet applications on mobile devices,'' Mobile Inf. Syst., vol. 2016, pp. 1-10, Feb. 2016. open in new tab
- H. Hoehle, R. Aljafari, and V. Venkatesh, ''Leveraging Microsoft's mobile usability guidelines: Conceptualizing and developing scales for mobile application usability,'' Int. J. Hum.-Comput. Stud., vol. 89, pp. 35-53, May 2016. open in new tab
- R. Liu, J. Cao, K. Zhang, W. Gao, J. Liang, and L. Yang, ''When privacy meets usability: Unobtrusive privacy permission recommendation system for mobile apps based on crowdsourcing,'' IEEE Trans. Services Comput., vol. 11, no. 5, pp. 864-878, Sep. /Oct. 2018. open in new tab
- I. Nascimento, W. Silva, B. Gadelha, and T. Conte, ''Userbility: A tech- nique for the evaluation of user experience and usability on mobile appli- cations,'' in Proc. Int. Conf. Hum.-Comput. Interact. Cham, Switzerland: Springer, 2016, pp. 372-383. open in new tab
- P. Paškevicius and R. Damaševicius, ''Design of usable interface for a mobile e-commerce system,'' in Proc. Int. Conf. Young Researchers Inform., Math. Eng., 2016, pp. 31-35.
- M. Tenemaza, E. Mena-Maldonado, F. Ledesma, M. Llumiquinga, and S. Luján-Mora, ''Augmented reality in limited environment, analysis of usability,'' in Proc. 9th Int. Conf. ICT, Soc. Hum. Beings (ICT), 2016, pp. 277-279.
- A. S. A. Al-Aidaroos and A. Abdul Mutalib, ''Design of the usability measurement tool for multimodal mobile applications,'' J. Teknologi, vol. 77, no. 29, pp. 41-47, 2015. open in new tab
- M. Al-khomsan, A. Al-Arjan, A. Al-Amro, and K. Al-Nafjan, ''Usability evaluation of Twitter on Android platform for elderly arab users using morae evaluation tool,'' in Proc. 10th Int. Conf. Internet Technol. Secured Trans. (ICITST), Dec. 2015, pp. 446-447. open in new tab
- H. M. Az-Zahra, A. Pinandito, and H. Tolle, ''Usability evaluation of mobile application in culinary recommendation system,'' in Proc. IEEE Asia-Pacific Conf. Wireless Mobile (APWiMob), Aug. 2015, pp. 89-94. open in new tab
- Z. Elkheir and A. Abdul Mutalib, ''Mobile learning applications design- ing concepts and challenges: Survey,'' Res. J. Appl. Sci., Eng. Technol., vol. 10, no. 4, pp. 438-442, 2015. open in new tab
- H. Hoehle and V. Venkatesh, ''Mobile application usability: Concep- tualization and instrument development,'' MIS Quart., vol. 39, no. 2, pp. 435-472, Feb. 2015. open in new tab
- A. Hussain, H. I. Abubakar, and N. B. Hashim, ''Evaluating mobile banking application: Usability dimensions and measurements,'' in Proc. 6th Int. Conf. Inf. Technol. Multimedia, Nov. 2014, pp. 136-140. open in new tab
- M. S. Kim, A. A. Ben Ramadan, M. A. Clarke, M. K. Markey, K. J. Lage, M. R. Aro, K. L. Ingalls, and V. Sindhwani, ''Usability of mobile applica- tions supporting training in diagnostic decision-making by radiologists,'' in Int. Conf. Digit. Hum. Modeling Appl. Health, Saf., Ergonom. Risk Manage. Cham, Switzerland: Springer, 2015, pp. 448-454. open in new tab
- P. Kortum and M. Sorber, ''Measuring the usability of mobile applications for phones and tablets,'' Int. J. Hum.-Comput. Interact., vol. 31, no. 8, pp. 518-529, Aug. 2015. open in new tab
- S. J. Levulis and D. J. Harris, ''Are all tests equal? A comparison of emulator and device testing for mobile usability evaluation,'' in Proc. Hum. Factors Ergonom. Soc. Annu. Meeting, vol. 59, no. 1. Los Angeles, CA, USA: Sage, 2015, pp. 976-980. open in new tab
- M. Plachkinova, G. Faddoul, and S. Chatterjee, ''Designing a mobile application for complementary and alternative medicine: A usability approach,'' in Proc. Int. Conf. Hum.-Comput. Interact. Cham, Switzer- land: Springer, 2015, pp. 345-349. open in new tab
- F. Botella, J. P. Moreno, and A. Peñalver, ''How efficient can be a user with a tablet versus a smartphone?'' in Proc. 15th Int. Conf. Hum. Comput. Interact. New York, NY, USA: ACM, 2014, p. 64. open in new tab
- W. Y. Chua, M. P.-H. Wan, K. Chang, and W. Yi, ''Improving mobile applications usage experience of novice users through user-acclimatized interaction: A case study,'' in Proc. Americas Conf. Inf. Syst., 2014, pp. 1-10. open in new tab
- A. Hussain, N. L. Hashim, and N. Nordin, ''MGQM: Evaluation metric for mobile and human interaction,'' in Proc. Int. Conf. Hum.-Comput. Interact. Cham, Switzerland: Springer, 2014, pp. 42-47. open in new tab
- K. Lapin, ''Deriving usability goals for mobile applications,'' in Proc. Mulitmedia, Interact., Design Innov. Int. Conf. Multimedia, Interact., Design Innov. (MIDI). New York, NY, USA: ACM, 2014, pp. 1-6. open in new tab
- J.-M. López-Gil, M. Urretavizcaya, B. Losada, and I. Fernández-Castro, ''Integrating field studies in agile development to evaluate usability on context dependant mobile applications,'' in Proc. 15th Int. Conf. Hum. Comput. Interact. New York, NY, USA: ACM, 2014, pp. 24:1-24:8. open in new tab
- A. S. Tsiaousis and G. M. Giaglis, ''Mobile websites: Usability evaluation and design,'' Int. J. Mobile Commun., vol. 12, no. 1, pp. 29-55, 2014. open in new tab
- L. Wein, ''Visual recognition in museum guide apps: Do visitors want it?'' in Proc. 32nd Annu. ACM Conf. Hum. Factors Comput. Syst. (CHI). New York, NY, USA: ACM, 2014, pp. 635-638. open in new tab
- B. Aryana and T. Clemmensen, ''Mobile usability: Experiences from Iran and Turkey,'' Int. J. Hum.-Comput. Interact., vol. 29, no. 4, pp. 220-242, Mar. 2013. open in new tab
- M. N. Islam, ''A systematic literature review of semiotics perception in user interfaces,'' J. Syst. Inf. Technol., vol. 15, no. 1, pp. 45-77, 2013.
- P. Chynał, J. M. Szymański, and J. Sobecki, ''Using eyetracking in a mobile applications usability testing,'' in Proc. Asian Conf. Intell. Inf. Database Syst. Berlin, Germany: Springer, 2012, pp. 178-186. open in new tab
- D. Flood, R. Harrison, C. Iacob, and D. Duce, ''Evaluating mobile appli- cations: A spreadsheet case study,'' Int. J. Mobile Hum. Comput. Interact., vol. 4, no. 4, pp. 37-65, Oct. 2012. open in new tab
- F. Nayebi, J.-M. Desharnais, and A. Abran, ''The state of the art of mobile application usability evaluation,'' in Proc. 25th IEEE Can. Conf. Electr. Comput. Eng. (CCECE), Apr. 2012, pp. 1-4. open in new tab
- M. Nourbakhsh, R. Mohamad Zin, J. Irizarry, S. Zolfagharian, and M. Gheisari, ''Mobile application prototype for on-site information man- agement in construction industry,'' Eng., Construct. Architectural Man- age., vol. 19, no. 5, pp. 474-494, Aug. 2012. open in new tab
- R. Hegarty and J. Wusteman, ''Evaluating EBSCOhost mobile,'' Library Hi Tech, vol. 29, no. 2, pp. 320-333, 2011. open in new tab
- B. Biel, T. Grill, and V. Gruhn, ''Exploring the benefits of the combination of a software architecture analysis and a usability evaluation of a mobile application,'' J. Syst. Softw., vol. 83, no. 11, pp. 2031-2044, Nov. 2010. open in new tab
- K. Chen, S. Wang, and Y. Pei, ''The adoption and use of mobile com- merce: An information processing perspective,'' in Proc. Int. Conf. Man- age. Service Sci., Sep. 2009, pp. 1-4. open in new tab
- B. Falchuk, ''Visual and interaction design themes in mobile healthcare,'' in Proc. 6th Annu. Int. Conf. Mobile Ubiquitous Syst., Comput., Netw. Services, Jul. 2009, pp. 1-10. open in new tab
- D. Zhang, B. Adipat, and Y. Mowafi, ''User-centered context-aware mobile applications-The next generation of personal mobile comput- ing,'' Commun. Assoc. Inf. Syst., vol. 24, no. 1, p. 3, 2009. open in new tab
- K. Liukkunen, M. Eteläperä, M. Oivo, J.-P. Soininen, and M. Pellikka, ''Virtual prototypes in developing mobile software applications and devices,'' in Proc. Int. Conf. Product Focused Softw. Process Improve- ment. Berlin, Germany: Springer, 2008, pp. 174-188. open in new tab
- K. H. Moe, B. Dwolatzky, and R. V. Olst, ''Designing a usable mobile application for field data collection,'' in Proc. IEEE Africon. 7th Africon Conf. Afr., vol. 2, Sep. 2004, pp. 1187-1192. open in new tab
- C. D. de Oliveira, R. P. de Mattos Fortes, and E. F. Barbosa, ''An analysis of crossword learning: A mobile application for the elderly,'' in Proc. Int. Conf. Hum. Aspects IT Aged Population. Cham, Switzerland: Springer, 2018, pp. 501-515. open in new tab
- O. Korhan and M. Ersoy, ''Usability and functionality factors of the social network site application users from the perspective of uses and gratification theory,'' Qual. Quantity, vol. 50, no. 4, pp. 1799-1816, Jul. 2016. open in new tab
- W.-M. Han, C.-H. Hsu, and C.-Y. Yeh, ''Using dematel to analyze the quality characteristics of mobile applications,'' in Proc. Int. Conf. Future Inf. Eng. Manuf. Sci. (FIEMS), vol. 2. Boca Raton, FL, USA: CRC Press, 2015, p. 131.
- S. Geiger-Prat, B. Marin, S. Espana, and G. Giachetti, ''A GUI modeling language for mobile applications,'' in Proc. IEEE 9th Int. Conf. Res. Challenges Inf. Sci. (RCIS), May 2015, pp. 76-87. open in new tab
- R. Capilla, L. Carvajal, and H. Lin, ''Addressing usability requirements in mobile software development,'' in Relating System Quality and Software Architecture. Amsterdam, The Netherlands: Elsevier, 2014, pp. 303-324. open in new tab
- S. P. Osorio, L. M. Aristizabal, and C. A. Zuluaga, ''Development of a command interface based on handheld devices for remotely oper- ated vehicles,'' in Proc. IEEE Colombian Conf. Robot. Autom. (CCRA), Sep. 2016, pp. 1-5. open in new tab
- H. I. Abubakar, N. L. Hashim, and A. Hussain, ''Usability evaluation model for mobile banking applications interface: Model evaluation pro- cess using experts' panel,'' J. Telecommun., Electron. Comput. Eng., vol. 8, no. 10, pp. 53-57, 2016.
- R. Inostroza, C. Rusu, S. Roncagliolo, V. Rusu, and C. A. Collazos, ''Developing SMASH: A set of smartphone's usability heuristics,'' Com- put. Standards Interfaces, vol. 43, pp. 40-52, Jan. 2016. open in new tab
- M. A. Kabir, O. A. M. Salem, and M. U. Rehman, ''Discovering knowl- edge from mobile application users for usability improvement: A fuzzy association rule mining approach,'' in Proc. 8th IEEE Int. Conf. Softw. Eng. Service Sci. (ICSESS), Nov. 2017, pp. 126-129. open in new tab
- A. Kulpy and G. Bekaroo, ''Fruitify: Nutritionally augmenting fruits through markerless-based augmented reality,'' in Proc. IEEE 4th Int. Conf. Soft Comput. Mach. Intell. (ISCMI), Nov. 2017, pp. 149-153. open in new tab
- Y. Man, M. Lützhöft, N. A. Costa, M. Lundh, and S. N. MacKinnon, ''Gaps between users and designers: A usability study about a tablet- based application used on ship bridges,'' in Proc. Int. Conf. Appl. Hum. Factors Ergonom. Cham, Switzerland: Springer, 2017, pp. 213-224. open in new tab
- A. Widyanti and S. A. Q. Ainizzamani, ''Usability evaluation of online transportation' user interface,'' in Proc. Int. Conf. Inf. Technol. Syst. Innov. (ICITSI), Oct. 2017, pp. 82-86. open in new tab
- A. Hussain, H. A. Razak, and E. O. Mkpojiogu, ''The perceived usability of automated testing tools for mobile applications,'' J. Eng., Sci. Technol., vol. 12, no. 4, pp. 89-97, 2017. open in new tab
- W. Roh and S.-W. Lee, ''An ontological approach to predict trade- offs between security and usability for mobile application requirements engineering,'' in Proc. IEEE 25th Int. Requirements Eng. Conf. Work- shops (REW), Sep. 2017, pp. 69-75. open in new tab
- A. Saleh, R. Ismail, and N. Fabil, ''Evaluating usability for mobile appli- cation: A MAUEM approach,'' in Proc. Int. Conf. Softw. e-Bus. (ICSEB). New York, NY, USA: ACM, 2017, pp. 71-77. open in new tab
- Z. Zali, ''An initial theoretical usability evaluation model for assessing defence mobile e-based application system,'' in Proc. Int. Conf. Inf. Commun. Technol. (ICICTM), May 2016, pp. 198-202. open in new tab
- I. Costa, W. Silva, A. Lopes, L. Rivero, B. Gadelha, E. Oliveira, and T. Conte, ''An empirical study to evaluate the feasibility of a UX and usability inspection technique for mobile applications,'' in Proc. 28th Int. Conf. Softw. Eng. Knowl. Eng., Jul. 2016, pp. 1-5. open in new tab
- B. A. Kumar and P. Mohite, ''Usability of mobile learning applications: A systematic literature review,'' J. Comput. Edu., vol. 5, no. 1, pp. 1-17, Mar. 2018. open in new tab
- D. F. O. de Paula, B. H. X. M. Menezes, and C. C. Araújo, ''Building a quality mobile application: A user-centered study focusing on design thinking, user experience and usability,'' in Proc. Int. Conf. Design, User Exper., Usability. Cham, Switzerland: Springer, 2014, pp. 313-322. open in new tab
- A. Hussain, N. L. Hashim, N. Nordin, and H. M. Tahir, ''A metric-based evaluation model for applications on mobile phone,'' J. Inf. Commun. Technol., vol. 12, pp. 55-71, Dec. 2013.
- J. Eustáquio Rangel de Queiroz and D. de Sousa Ferreira, ''A multidimen- sional approach for the evaluation of mobile application user interfaces,'' in Proc. Int. Conf. Hum.-Comput. Interact. Berlin, Germany: Springer, 2009, pp. 242-251.
- M. Kenteris, D. Gavalas, and D. Economou, ''An innovative mobile electronic tourist guide application,'' Pers. Ubiquitous Comput., vol. 13, no. 2, pp. 103-118, Feb. 2009. open in new tab
- A. Hussain and E. Ferneley, ''Usability metric for mobile application: A goal question metric (GQM) approach,'' in Proc. 10th Int. Conf. Inf. Integr. Web-Based Appl. Services (iiWAS). New York, NY, USA: ACM, 2008, pp. 567-570. open in new tab
- J. Häkkilä, P. Korpipää, S. Ronkainen, and U. Tuomela, ''Interaction and end-user programming with a context-aware mobile application,'' in Proc. IFIP Conf. Hum.-Comput. Interact. Berlin, Germany: Springer, 2005, pp. 927-937. open in new tab
- C. Ryan and A. Gonsalves, ''The effect of context and application type on mobile usability: An empirical study,'' in Proc. 28th Australas. Conf. Comput. Sci., vol. 38. Darlinghurst, NSW, Australia: Australian Com- puter Society, 2005, pp. 115-124.
- P. Jarupunphol, W. Buathong, T. Chansaeng, and N. Laosen, ''A descrip- tive design for a smart kitchen management application (SKM),'' in Proc. Int. Conf. Inf. Comput. Technol. (ICICT), Mar. 2018, pp. 61-66. open in new tab
- K. McDonald, W. Abell, C. Smith, and S. Gibbs, ''Lessons learned from evaluating a mobile app out in the field,'' in Proc. 4th Int. Conf. User Sci. Eng. (i-USEr), Aug. 2016, pp. 5-10. open in new tab
- E. O. Mkpojiogu, N. L. Hashim, and R. Adamu, ''Observed demographic differentials in user perceived satisfaction on the usability of mobile banking applications,'' in Proc. 8th Knowl. Manage. Int. Conf. (KMICe), Chiang Mai, Thailand, 2016, pp. 29-30.
- P. Pocatilu, I. Ivan, A. Zamfiroiu, and C. Boja, ''An aggregate indicator for mobile application quality assessment,'' TURKISH J. Electr. Eng. Comput. Sci., vol. 23, pp. 956-973, 2015. open in new tab
- M. Fetaji, Z. Dika, and B. Fetaji, ''Usability testing and evaluation of a mobile software solution: A case study,'' in Proc. ITI-30th Int. Conf. Inf. Technol. Interfaces, Jun. 2008, pp. 501-506. open in new tab
- N. K. Chuan, A. Sivaji, F. A. Loo, W. F. W. Ahmad, and S. S. Nathan, ''Evaluating 'gesture interaction' requirements of mobile applications for deaf users: Discovering the needs of the hearing-impiared in using touch- screen gestures,'' in Proc. IEEE Conf. Open Syst. (ICOS), Nov. 2017, pp. 90-95. open in new tab
- S. A. A. Shukri, H. Arshad, and R. Z. Abidin, ''Mobile augmented reality system design guidelines based on tourist's emotional state,'' J. Telecom- mun., Electron. Comput. Eng., vol. 9, nos. 2-12, pp. 75-79, 2017. open in new tab
- T. Aljaber and N. Gordon, ''A guidance and evaluation approach for mHealth education applications,'' in Proc. Int. Conf. Learn. Collabo- ration Technol. Universiti Teknikal Malaysia Melaka: Springer, 2017, pp. 330-340.
- M. A. Redondo, A. I. Molina, and C. X. Navarro, ''Extending CIAM methodology to support mobile application design and evaluation: A case study in m-learning,'' in Proc. Int. Conf. Cooperat. Design, Visualizat. Eng. Cham, Switzerland: Springer, 2015, pp. 11-18. open in new tab
- S. Valdivia, R. Blanco, A. Uribe-Quevedo, L. Penuela, D. Rojas, and B. Kapralos, ''Development and evaluation of two posture-tracking user interfaces for occupational health care,'' Adv. Mech. Eng., vol. 10, no. 6, Jun. 2018, Art. no. 168781401876948. open in new tab
- A. Hussain and R. Fitria, ''Mobile flight and hotel booking application: A heuristic and UX test,'' J. Telecommun., Electron. Comput. Eng., vol. 10, nos. 1-11, pp. 93-101, 2018.
- Verified by:
- Gdańsk University of Technology
seen 488 times