A Review of Usability Evaluation Research on Land-Based Transport-Related Information Systems
Keywords:
Usability; usability evaluation methods; usability issues; land-based transport-related information systems.Abstract
The utilization of land-based transport information systems depends significantly on their usability, as it influences user satisfaction, decision-making and system adoption. However, the literature suggests that there is limited current knowledge regarding the state of usability research on these systems. This study examined recent research on the usability evaluation of land-based transport information systems, highlighting trends across various system categories, including public transportation applications, ride-sharing systems, mobile ticketing and booking applications and in-vehicle information systems. The study categorizes the evaluation methods employed in different transport contexts ranging from heuristic analyses and user testing to cognitive walkthroughs and surveys. Key usability challenges are identified, including interface complexity, information overload and real-time data accuracy. Furthermore, the review uncovers how qualitative analysis is vital to the identification of usability issues. Further research is recommended for underexplored and emerging land-based transport-related information systems, using diverse and complementary usability evaluation methods. Overall, this study highlights the importance of integrating usability evaluations early and continuously within the TRIS development lifecycle. It also provides a foundation for improving the design and assessment of transport information systems.
References
Ahmad, B. I., Langdon, P. M., Godsill, S. J., Hardy, R., Skrypchuk, L. and Donkor, R. (2015, September). Touchscreen usability and input performance in vehicles under different road conditions: an evaluative study. In Proceedings of the 7th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (pp. 47-54).
Ahmed, W., Hizam, S. M. and Sentosa, I. (2022). Reviewing the Components of Technology Acceptance Behavior in Transportation Sector. Communications - Scientific letters of the University of Zilina, 24 (3), E96 – E107. https://doi.org/10.26552/com.C.2022.3.E96-E107.
Alhwety, R. N. H. and Elfadil, N. (2024). Vehicle tracking system approaches: A systematic literature review. International Journal of Computer Science and Mobile Computing, 13(8), 23-31.
Anghelache, F., Goga, N., Marian, C. V., Mitrea, D. A. and Pavaloiu, I. B. (2025). Usability and Perceived Efficiency of an Adaptive Route Optimization Solution for Commercial Vehicles. IEEE Access.
Bartin, B., Ozbay, K. and Yang, H. (2018). Evaluation framework for mobile ticketing applications in public transit: a case study. IET Intelligent Transport Systems, 12(9), 1166-1173.
Bhalalusesa, N. P., Maro, S. and Chambua, J. (2026). Exploring Usability Heuristics, Evaluation Practices and Issues in Fleet Management Systems. International Journal of Human–Computer Interaction, 1-17.
Burger, G. and Guna, J. (2024). Enhancing Driving Safety through User Experience Evaluation of the C-ITS Mobile Application: A Case Study of the DARS Traffic Plus App in a Driving Simulator Environment. Sensors, 24(15), 4948. https://doi.org/10.3390/s24154948.
Cardoso, R., Ribeiro, F., Prandi, C. and Nunes, N. (2020). Gamification and engagement of tourists and residents in public transportation exploiting location-based technologies. arXiv preprint arXiv:2006.16077.
Chen, C. C., Chang, C. H. and Hsiao, K. L. (2022). Exploring the factors of using mobile ticketing applications: Perspectives from innovation resistance theory. Journal of Retailing and Consumer Services, 67, 102974.
Chen, K., Kao, T. Y. and Yeh, K. H. (2023). Designing a Mobile Payment-Driven Mobility-as-a-Service Architecture for Bus Transportation. Procedia Computer Science, 225, 4814-4823.
Cho, S., Seong, H., Kang, H., Cho, S. J. and Kang, B. (2025). Forensic investigation of vehicle-related data in Android phones connected to In-Vehicle Infotainment systems. Computer Networks, 111370.
Couto, R., Leal, J., Costa, P. M. and Galvão, T. (2015, September). Exploring ticketing approaches using mobile technologies: QR codes, NFC and BLE. In 2015 IEEE 18th International Conference on Intelligent Transportation Systems (pp. 7-12). IEEE.
Dabiri, S. and Heaslip, K. (2018). Transport-domain applications of widely used data sources in the smart transportation: A survey. arXiv preprint arXiv:1803.10902.
Darsena, D., Gelli, G., Iudice, I. and Verde, F. (2022). Sensing technologies for crowd management, adaptation, and information dissemination in public transportation systems: A review. IEEE Sensors Journal, 23(1), 68-87.
Davis, F. D. (1989). Technology acceptance model: TAM. Al-Suqri, MN, Al-Aufi, AS: Information seeking behavior and technology adoption, 205(219), 5.
de Amorim, D. M., Dias, T. G. and Ferreira, M. C. (2019). Usability Evaluation of a Public Transport Mobile Ticketing Solution. In Human Systems Engineering and Design: Proceedings of the 1st International Conference on Human Systems Engineering and Design (IHSED2018): Future Trends and Applications, October 25-27, 2018, CHU-Université de Reims Champagne-Ardenne, France 1 (pp. 345-351). Springer International Publishing.
Delfini, L., Spahiu, B. and Vizzari, G. (2024). Visual Analytics for Sustainable Mobility: Usability Evaluation and Knowledge Acquisition for Mobility-as-a-Service (MaaS) Data Exploration. Digital, 4(4), 821-845. https://doi.org/10.3390/digital4040041.
Falco, M., Nunez, I. and Tanzi, F. (2019). Improving the Fleet Monitoring Management, through a Software Platform with IoT. 2019 IEEE International Conference on Internet of Things and Intelligence System (IoTaIS). doi:10.1109/iotais47347.2019.8980429.
Farzandipour, M., Nabovati, E. and Sadeqi Jabali, M. (2022). Comparison of usability evaluation methods for a health information system: heuristic evaluation versus cognitive walkthrough method. BMC Medical Informatics and Decision Making, 22(1), 157.
Firmansyah, F. and Riskinanto, A. (2024). Review of Nielsen versus SMART in Heuristic Evaluation of Online Transportation Application. In E3S Web of Conferences (Vol. 483, p. 03007). EDP Sciences.
Glad, J., Raditya, I. G., Sukmaningsih, D. W. and Kristian, W. (2024, September). Usability Evaluation of the Public Transportation Mobile Application: Laboratory and Field Setting. In 2024 International Conference on ICT for Smart Society (ICISS) (pp. 1-7). IEEE.
Gupta, S. (2015). A Comparative study of Usability Evaluation Methods. International Journal of Computer Trends and Technology. 22. 103-106. 10.14445/22312803/IJCTT-V22P121.
Hasan, L. A. and Al-Sarayreh, K. T. (2015, November). An integrated measurement model for evaluating usability attributes. In Proceedings of the international conference on intelligent information processing, security and advanced communication (pp. 1-6).
Hsu, Y. H. and Chen, C. H. (2023). Usability Study on the User Interface Design of Ride-hailing Applications. In International Conference on Human-Computer Interaction (pp. 208-216). Cham: Springer Nature Switzerland.
Hussain, A., Mkpojiogu, E. O. and Jasin, N. M. (2017). Usability Metrics and Methods for Public Transportation Applications: A Systematic Review. Journal of Engineering Science and Technology, 12, 98-105.
Ilchenko, L. M., Sokolov, S. S., Egorova, K. V., Gubernatorov, O. and Knish, T. (2021, January). Analysis of the main types of automated information systems in the transport sector, functioning mainly in urban agglomerations. In 2021 IEEE Conference of Russian Young Researchers in Electrical and Electronic Engineering (ElConRus) (pp. 401-406). IEEE.
ISO 9241-11:2018. (2018). Ergonomics of human-system interaction – Part 11: Usability: Definitions and concepts. International Organization for Standardization.
Jiang, Q., Deng, L. and Zhang, J. (2025). How does aesthetic design affect continuance intention in in-vehicle infotainment systems? An exploratory study. International Journal of Human–Computer Interaction, 41(1), 429-444.
Jimenez, C., Lozada, P. and Rosas, P. (2016). Usability Heuristics: A Systematic Review. In 2016 IEEE 11th Colombian Computing Conference (CCC) (pp. 1-8). IEEE.
Jing, C., Zhi, J., Yang, S. and Wang, W. (2021). Impact of Driver Age and Experience in Software Usage on Driving Safety and Usability of Car‐Sharing Software. Journal of Advanced Transportation, 2021(1), 6633379.
Kalra, N. and Groves, D. G. (2017). RAND model of automated vehicle safety (MAVS): Model documentation (No. RR-1902-RC).
Khajouei, R., Zahiri Esfahani, M. and Jahani, Y. (2017). Comparison of heuristic and cognitive walkthrough usability evaluation methods for evaluating health information systems. Journal of the American Medical Informatics Association, 24(e1), e55-e60.
Khan, M. A., Nawaz, T., Khan, U. S., Hamza, A. and Rashid, N. (2023). IoT-based non-intrusive automated driver drowsiness monitoring framework for logistics and public transport applications to enhance road safety. Ieee Access, 11, 14385-14397.
Lakhan, A., Rashid, A. N., Mohammed, M. A., Zebari, D. A., Deveci, M., Wang, L., ... and Martinek, R. (2024). Multi-agent reinforcement learning framework based on information fusion biometric ticketing data in different public transport modes. Information Fusion, 110, 102471.
Li, R., Chen, Y. V., Sha, C. and Lu, Z. (2017). Effects of interface layout on the usability of in-vehicle information systems and driving safety. Displays, 49, 124-132.
Li, X., Wang, Z. abd Zhang, Y. (2021). Usability challenges in elderly access to mobile public transport apps. Transportation Research Record, 2675(3), 45–56.
Liao, J. H., Prasetyo, Y. T., Benito, O. P., Susanto, K. C., Cahigas, M. M. L., Nadlifatin, R. and Gumasing, M. J. J. (2024). The perceived usability of vehicle sharing mobile application: An integration of UTAUT, pro-environmental behavior, and system usability scale. Case Studies on Transport Policy, 18, 101276.
Macedo, E., Teixeira, J., Sampaio, C., Silva, N., Coelho, M. C., Glinos, M. and Bandeira, J. M. (2021). Real-time information systems for public transport: User perspective. Transportation Research Procedia, 52, 732-739.
Mancino, G. (2022). The Role of Autonomous Vehicles and AI in Smart Transportation Systems: Enhancing Traffic Management, Route Optimization, and Predictive Maintenance. Route Optimization, and Predictive Maintenance.
Masele, J. J. and Rwehikiza, D. P. (2024). Usability of social media for promoting higher learning institutions’ activities in Tanzania: A diffusion of innovation perspective. Journal of Nonprofit & Public Sector Marketing, 36(1), 91-122.
Meghana, A. V., Sarode, V., Tambade, D., Marathe, A. and Charniya, N. (2020, July). Automated crowd management in bus transport service. In 2020 International Conference on Electronics and Sustainable Communication Systems (ICESC) (pp. 104-109). IEEE.
Mehta, S. and Aneja, A. (2024, December). Innovative Fare Collection Systems: Integrating IoT for Enhanced Urban Mobility and Sustainability. In 2024 IEEE International Conference on Intelligent Signal Processing and Effective Communication Technologies (INSPECT) (pp. 1-5). IEEE.
Mesoraca, J. and Brakewood, C. (2018). A synthesis of mobile ticketing applications used by commuter railroads in the United States. Journal of Public Transportation, 21(2), 86-100.
Nowacki, G., Piotrkowski, K. and Masikowski, P. (2019). The vehicle fleet monitoring and personnel management system. Archives of Transport System Telematics, 12(3), 34-39.
Payre, W. and Diels, C. (2020). I want to brake free: The effect of connected vehicle features on driver behaviour, usability and acceptance. Applied ergonomics, 82, 102932.
Perrier, M. J., Louw, T. L. and Carsten, O. M. (2023). Usability testing of three visual HMIs for assisted driving: How design impacts driver distraction and mental models. Ergonomics, 66(8), 1142-1163.
Puspitasari, N. B., Aulia, Y. and Rosyada, Z. F. (2023). Usability evaluation of online transportation using Nielsen model. World Journal of Advanced Engineering Technology and Sciences. 10(02), 01–09. 10.30574/wjaets.2023.10.2.0283.
Putra, R. R., Yasirandi, R. and Qusyairi, M. M. (2024). Evaluation of Travel App’s Usability Using the System Usability Scale Method. Scientific Journal of Informatics, 11(2), 439-450.
Putri, S. N. and Subiyakto, A. (2021). Evaluating User Interface of A Transport Application Using Usability Evaluation Methods. In 2021 9th International Conference on Cyber and IT Service Management (CITSM) (pp. 1-7). IEEE.
Quiñones, D., Rojas, L. F. and Barraza, A. (2024). User experience heuristics for in-vehicle infotainment systems. Procedia Computer Science, 237, 725-732.
Rahman, M. M., Sarker, A., Khan, I. B. and Islam, M. N. (2020). Assessing the Usability of Ridesharing Mobile Applications in Bangladesh: an Empirical Study. In 2020 61st International Scientific Conference on Information Technology and Management Science of Riga Technical University (ITMS) (pp. 1-6). IEEE.
Sahu, A., Katlana, A., Sharma, A., Baniya, M. Y., Sureliya, S. and Kanungo, S. (2024, September). Vehicle Rental Management System: OnDemand Vehicle Ride. In 2024 International Conference on Advances in Computing Research on Science Engineering and Technology (ACROSET) (pp. 1-11). IEEE.
Stange, M. J., Louw, T. L. and Carsten, O. M. (2023). Usability testing of three visual HMIs for assisted driving: How design impacts driver distraction and mental models. Ergonomics, 66(8), 1142-1163.
Stange, V., Kuhlmann, K., Schrader, T., Brettin, L. J. and Maurer, M. (2025). Children’s perspectives on autonomous vehicles: A usability and user experience study in a high-fidelity prototype. Transportation Research Interdisciplinary Perspectives. 31.
Stange, V., Kuhlmann, K., Schrader, T., Brettin, L. J. and Maurer, M. (2025). Children’s perspectives on autonomous vehicles: A usability and user experience study in a high-fidelity prototype. Transportation Research Interdisciplinary Perspectives. 31.
Stiegemeier, D., Bringeland, S., Kraus, J. and Baumann, M. (2022). “Do I really need it?”: An explorative study of acceptance and usage of in-vehicle technology. Transportation research part F: traffic psychology and behaviour, 84, 65-82.
Tobing, C. I. L. (2023, August). User Experience Analysis of Indonesia Train Booking Mobile Application Using User Experience Questionnaire (UEQ) and Usability Testing. In 2023 International Conference on Information Management and Technology (ICIMTech) (pp. 385-390). IEEE.
Vanderschuren, M. and Baufeldt, J. (2018). Ride-sharing: A potential means to increase the quality and availability of motorised trips while discouraging private motor ownership in developing cities?. Research in Transportation Economics, 69, 607-614.
Widyanti, A. and Ainizzamani, S. A. Q. (2017, October). Usability evaluation of online transportation'user interface. In 2017 International Conference on Information Technology Systems and Innovation (ICITSI) (pp. 82-86). IEEE.
Witvoet, K., Vidal, C., Stiene, T. and Emadi, A. (2024, September). Towards Frictionless Public Transit: A Brief Review of Automatic Fare Collection. In 2024 IEEE International Conference on Smart Mobility (SM) (pp. 87-92). IEEE.
Wu, C., Le Vine, S. and Sivakumar, A. (2025a). Assessment of the barriers in establishing passenger mobility-as-a-service (MaaS) systems: An analogy with multimodal freight transport. Case Studies on Transport Policy, 101433
Wu, Z., Rao, K., Dou, W., Bao, Y. and Jin, T. (2025b). The effect of touchscreen layout division on the usability and driving safety of in-vehicle information systems. International Journal of Human–Computer Interaction, 41(5), 3340-3351.
Xu, N., Guo, G., Lai, H. and Chen, H. (2018). Usability study of two in-vehicle information systems using finger tracking and facial expression recognition technology. International Journal of Human–Computer Interaction, 34(11), 1032-1044.
Zaigham, M., Dasan, J. and Chin, C. P. Y. (2022). A systematic literature review on ridesharing: Determinants, theoretical grounds and methodologies. Journal of Information System and Technology Management, 7(27), 187-200.
Zhang-Kennedy, L., Aziz, S., Oluwadare, O., Pan, L., Wu, Z., Lamorea, S. E., Li, S., Sun, M and Mäkelä, V. (2023, April). Passenger Perceptions, Information Preferences, and Usability of Crowding Visualizations on Public Displays in Transit Stations and Vehicles. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (pp. 1-15).
