USABILITY EVALUATION OF RAD-BASED PRODUCTION MONITORING SYSTEMS IN AUTOMOTIVE MANUFACTURING USING SYSTEM USABILITY SCALE METHOD
Abstract
The rapid adoption of digital monitoring tools in the automotive sector often prioritizes technical deployment speed over user-centric design, leading to potential operational inefficiencies. This study evaluates the usability of a production monitoring system developed through Rapid Application Development (RAD) at an automotive manufacturing plant. Utilizing a purposive sampling of 20 active users comprising 15 shop-floor operators and 5 supervisors. This research employs the System Usability Scale (SUS) to quantify user experience post-implementation. Data integrity was rigorously verified through SPSS, yielding a Cronbach’s Alpha of 0.842, which confirms the high reliability of the evaluation instrument. The findings reveal an overall average SUS score of 71.25, categorized as Acceptable with a Good adjective rating and a Grade C classification. Despite this favorable total score, a notable disparity exists between user groups; supervisors rated the system at 74.0, while operators, who manage high-frequency data entry, provided a lower average of 68.5. This result underscores a usability friction inherent in rapidly developed systems that may hinder long-term industrial sustainability. The study concludes that while the RAD-based architecture meets professional functional standards, iterative refinements focusing on reducing interface complexity for operators are essential to minimize human error and optimize production performance
References
G. P. Fesa Kristianto, Yessi Nasia Ulfia, “Framework for Digital Transformation in Industry 4.0: Insights Data Driven Analysis in the Indonesia Manufacture Sector,” J. Adv. Inf. Ind. Technol., vol. 7, no. 1, pp. 45–60, 2025, doi: https://doi.org/10.52435/jaiit.v7i1.630.
I. Yeyen Dwi Atma, Insan, “Penerapan Model Rapid Application Development Dalam Perancangan Aplikasi Monitoring Bahan Baku Produksi UMKM,” J. Sains Inform. Terap., vol. 4, no. 3, pp. 465–472, 2025, doi: https://doi.org/10.62357/jsit.v4i3.734.
H. H. Farzaneh, “Usability Evaluation of Software Tools for Engineering Design,” in Proceedings of the Design Society International Conference on Engineering Design, 2019, pp. 1303–1312. doi: https://doi.org/10.1017/dsi.2019.136.
A. A.-A. Yasser Omar Abdallah, Essam Shehab, “Digital Transformation Challenges in the Manufacturing Industry,” in 18th International Conference in Manufacturing Research ICMR 2021, 2021, pp. 9–14. doi: https://doi.org/10.3233/ATDE210004.
B. R. Pressman, R. S., & Maxim, Software Engineering: A Practitioner’s Approach (8th ed). Amerika Serikat: McGraw-Hill Education, 2015.
L. E. P. Jayanti, “Evaluasi Usability pada Aplikasi Mobile JKN Menggunakan Metode System Usability Scale (SUS),” J. Nas. Komputasi dan Teknol. Inf., vol. 8, no. 2, pp. 839–846, 2025, doi: https://doi.org/10.32672/jnkti.v8i2.8942.
E. R. Diana Chandra Dewi, “Analisis Beban Kerja Mental Operator Produksi Menggunakan Pendekatan Ergonomi Kognitif di Pabrik Kelapa Sawit PT. X,” J. Tek. Mesin dan Ind., vol. 5, no. 1, pp. 33–40, 2026, doi: https://doi.org/10.55331/jutmi.v5i1.84.
J. Brooke, “SUS: A retrospective,” J. Usability Stud., vol. 8, no. 2, pp. 29–40, 2013.
A. Bangor, “An Empirical Evaluation of the System Usability Scale,” Int. J. Human–Computer Interact., vol. 24, no. 6, pp. 574–594, 2008, doi: https://doi.org/10.1080/10447310802205776.
N. P. Rifka Anrahvi, “Penerapan Metode System Usability Scale (SUS) dalam Mengukur Kepuasan Mahasiswa terhadap Website Direktori Akademik,” Indones. J. Bus. Econ. Manag., vol. 3, no. 2, pp. 74–80, 2024, doi: https://doi.org/10.57152/ijbem.v3i2.2020.
J. H. F. and H. H. Jonathan Lazar, Research methods in human-computer interaction. Morgan Kaufmann, 2017. doi: https://doi.org/10.1016/B978-0-12-805390-4.00001-4.
F. Rahman, “Digital Transformation in The Small To Medium Industries Automotive Components In Indonesia,” Int. J. Soc. Sci., vol. 3, no. 4, pp. 445–458, 2023, doi: https://doi.org/10.53625/ijss.v3i4.6994.
W. U. Sari, “Analisis Usability Pada Sistem Informasi Akademik Mahasiswa Universitas Muhammadiyah Riau Menggunakan Metode System Usability Scale (Sus),” J. Penelit. Saintek, vol. 25, no. 2, pp. 78–87, 2020, doi: https://doi.org/10.21831/jps.v25i2.28763.
et al. Rahma Yani, “System Usability Scale in Information System Application Development Using Systematic Mapping Study,” IJATIS Indones. J. Appl. Technol. Innov. Sci., vol. 2, no. 2, pp. 130–140, 2025, doi: https://doi.org/10.57152/ijatis.v2i2.2275.
N. Huda, “Implementasi Metode Usability Testing Dengan System Usability Scale Dalam Penilaian Website RS Siloam Palembang,” KLIK - Kumpul. J. Ilmu Komput., vol. 6, no. 1, pp. 36–47, 2019, doi: https://doi.org/10.56869/klik.v6i1.