SIPETA Performance Evaluation Integration : EUCS and Equivalence Partitioning Technique
Abstract
The development of information systems in higher education institutions requires comprehensive performance evaluations to ensure that the systems are capable of supporting learning and administrative processes effectively, efficiently, and in accordance with user needs. This study aims to evaluate the performance of SIPETA in supporting academic processes and to identify factors that affect the quality of the system. The main problems found were suboptimal information quality, data accuracy, and several system functions that affected user trust. The study used an integrative approach with the End User Computing Satisfaction (EUCS) model to measure user satisfaction and the Equivalence Partitioning technique in Black Box testing to assess system functionality. Data was collected through questionnaires administered to 100 users and direct testing of the system's features. The results showed that the system had an effectiveness rate of 86 percent and was rated as good in terms of appearance, ease of use, and timeliness of service. However, the content and accuracy variables were still in the poor category due to several functional failures such as schedule validation, notifications, revision uploads, and guidance history. Overall, SIPETA is suitable for use but requires improvements in data quality and system logic to increase reliability and user satisfaction.
References
Acosta-Enriquez, B. G., Ramos Farroñan, E. V., Villena Zapata, L. I., Mogollon Garcia, F. S., Rabanal-León, H. C., Morales Angaspilco, J. E., & Bocanegra, J. C. S. (2024). Acceptance of artificial intelligence in university contexts: A conceptual analysis based on UTAUT2 theory. Heliyon, 10(19). https://doi.org/10.1016/j.heliyon.2024.e38315
Afiah, N., Syahadiyanti, L., & Swastyastu, C. A. (2024). Pengukuran Tingkat Kepuasan Kinerja Sistem Informasi Perpustakaan Pada Aplikasi Opac Menggunakan Metode Tam Dan Eucs. ZONAsi: Jurnal Sistem Informasi, 6(1). https://doi.org/10.31849/zn.v6i1.18083
Aggelidis, V. P., & Chatzoglou, P. D. (2012). Hospital information systems: Measuring end user computing satisfaction (EUCS). Journal of Biomedical Informatics, 45(3). https://doi.org/10.1016/j.jbi.2012.02.009
Al-Mamary, Y. H. S. (2022). Understanding the use of learning management systems by undergraduate university students using the UTAUT model: Credible evidence from Saudi Arabia. International Journal of Information Management Data Insights, 2(2). https://doi.org/10.1016/j.jjimei.2022.100092
Amalia, N. N., & Jaya, H. P. (2023). Factors Hindering the Students in Completing Their Undergraduate Thesis: A Study at an English Education Study Program in Indonesia. Ijlecr - International Journal of Language Education and Culture Review, 9(2). https://doi.org/10.21009/ijlecr.v9i2.37472
Amin, N. F., Garancang, S., & Abunawas, K. (2023). Konsep Umum Populasi Dan Sampel Dalam Penelitian. JURNAL PILAR: Jurnal Kajian Islam Kontemporer, 14(1). https://doi.org/10.21070/2017/978-979-3401-73-7
Amrulloh, A., Septiadi, A. D., Septiara, M., & Wicaksono, P. A. (2023). Black Box Testing Using the Equivalence Partitions Technique to Test the Functionality of the Ternaku.id Website. Journal of Multimedia Trend and Technology, 2(3). https://doi.org/10.35671/jmtt.v2i3.43
Anggraini, M. (2021). Analisis Kepuasan Pengguna Terhadap Penerapan Opac Menggunakan Technology Acceptance Model Dan End User Computing Satisfaction (Studi Kasus : Perpustakaan Soeman Hs). Sistem Informasi, 5(3), 248–253.
Ayuningtyas, P. K., Atmodjo WP, D., & Rachmadi, P. (2023). Performance And Functional Testing With The Black Box Testing Method. International Journal of Progressive Sciences and Technologies, 39(2). https://doi.org/10.52155/ijpsat.v39.2.5471
Bayona-Oré, S. (2021). Perceptions of Postgraduate Students on the Relationship Between Thesis Development and Performance of a Supervisor. Journal of Turkish Science Education, 18(4). https://doi.org/10.36681/tused.2021.90
Darwati, L. (2022). Analisis Tingkat Kepuasan Pengguna Aplikasi WETV Menggunakan Metode End User Computing Satisfaction (EUCS). Jurnal Ilmiah Komputasi, 21(4), 34–42. https://doi.org/10.32409/jikstik.21.4.3217
Dwivedi, Y. K., Rana, N. P., Tamilmani, K., & Raman, R. (2020). A meta-analysis based modified unified theory of acceptance and use of technology (meta-UTAUT): a review of emerging literature. Current Opinion in Psychology, 36. https://doi.org/10.1016/j.copsyc.2020.03.008
Fadhilasari, A., Endah Wahanani, H., & Ali Akbar, F. (2024). Equivalence Partitioning Dan Boundary Value Analysis Dalam Black Box Testing Pada Platform E-Commerce Berbasis Web Di Lima Benua. JATI (Jurnal Mahasiswa Teknik Informatika), 8(3). https://doi.org/10.36040/jati.v8i3.9673
Fatoni, A., Adi, K., & Widodo, A. P. (2020). PIECES Framework and Importance Performance Analysis Method to Evaluate the Implementation of Information Systems. E3S Web of Conferences, 202. https://doi.org/10.1051/e3sconf/202020215007
Frayudha, A. D., Pande, I. R., & Juwita, M. B. (2024). Implementation of Black Box Testing with the Application of Equivalence Partitioning Techniques in the M-Magazine Android Application at Semen Gresik High School. Elinvo (Electronics, Informatics, and Vocational Education), 9(1). https://doi.org/10.21831/elinvo.v9i1.70382
Haleem, A., Javaid, M., Qadri, M. A., & Suman, R. (2022). Understanding the role of digital technologies in education: A review. Sustainable Operations and Computers, 3(May). https://doi.org/10.1016/j.susoc.2022.05.004
Hamzah, M. L., Hultari, L. A., Purwati, A. A., & Nazaruddin. (2022). Analysis of E-Library Based on Level of User Satisfaction Using Eucs and IPA Methods. Journal of Applied Engineering and Technological Science, 4(1). https://doi.org/10.37385/jaets.v4i1.1426
International Organization for Standardization. (2018). ISO 9241-11. https://standards.iteh.ai/catalog/standards/sist/d38dc274-d8d4-4fb9-8206-
Iyong, G. G., Moniaga, I. L., & Mandey, J. C. (2021). Community Participation in Tourism Special Economic Zones in East Likupang District. Sabua, 10(1).
Kristiyanti, M., Ndori, A., Mubin, M. I., Pamungkas, B. A., & Fachrurrozi, S. (2024). E-Logbook Application System to Support the Guidance Process Final Assignment for Semarang Maritime Science Polytechnic Cadets. International Journal of Economics and Management Sciences, 1(2). https://doi.org/10.61132/ijems.v1i2.51
Liulliyah, & Subriadi, A. P. (2020). Performance Measurement of Academic Information Systems using Performance Prism and ISO/IEC 25010. The Winners, 21(2). https://doi.org/10.21512/tw.v21i2.6505
Logachev, M. S., Orekhovskaya, N. A., Seregina, T. N., Shishov, S., & Volvak, S. F. (2021). Information system for monitoring and managing the quality of educational programs. Journal of Open Innovation: Technology, Market, and Complexity, 7(1). https://doi.org/10.3390/JOITMC7010093
Makkaraka, A. M. R. B., Iskandar, A., & Yang, W. (2024). Design of Web-Based Student Academic Information System. Ceddi Journal of Education, 3(2). https://doi.org/10.56134/cje.v3i2.102
Malatji, W. R., van Eck, R., & Zuva, T. (2020). Understanding the usage, modifications, limitations and criticisms of technology acceptance model (TAM). Advances in Science, Technology and Engineering Systems, 5(6). https://doi.org/10.25046/aj050612
Maspupah, A. (2024). Literature Review: Advantages and Disadvantages of Black Box and White Box Testing Methods. Jurnal Techno Nusa Mandiri, 21(2). https://doi.org/10.33480/techno.v21i2.5776
Nazir, M. (1985). Metode Penelitian. Ghalia Indonesia.
Nielsen, J. (1994). Usability inspection methods. Conference on Human Factors in Computing Systems - Proceedings, 1994-April, 413–414. https://doi.org/10.1145/259963.260531
Pratomo, A. B., Harahap, M. A. K., Oswari, T., Akhirianto, P. M., & Widarman, A. (2023). The Application of End User Computing Satisfaction (EUCS) to Analyze the Satisfaction of MyPertamina User. Jurnal Sistim Informasi Dan Teknologi, 5(1). https://doi.org/10.37034/jsisfotek.v5i1.205
Raihan, A. (2024). A review of the potential opportunities and challenges of the digital economy for sustainability. In Innovation and Green Development (Vol. 3, Number 4). Elsevier B.V. https://doi.org/10.1016/j.igd.2024.100174
Raihan, M., Jazman, M., & Ahsyar, T. K. (2025). Analysis of User Satisfaction Level Of the Online Lecture Information System ( Sikuli ) using The EUCS Method at Universitas Muhammadiyah Riau. Sistemasi: Jurnal Sistem Informasi, 14(4).
Razami, H. H., & Ibrahim, R. (2022). Models and constructs to predict students’ digital educational games acceptance: A systematic literature review. Telematics and Informatics, 73(July). https://doi.org/10.1016/j.tele.2022.101874
Sá, M. J., Santos, A. I., & Serpa, S. (2021). The academic supervisor of higher education students’ final projects: A gatekeeper of quality? Academic Journal of Interdisciplinary Studies, 10(1). https://doi.org/10.36941/ajis-2021-0013
Soegoto, Y., Meyliana, Prabowo, H., Hidayanto, A. N., Trisetyarso, A., & Pradipto, Y. D. (2023). Digital Transformation in Higher Education. International Journal of Research and Applied Technology, 3(2).
Sunarjo, R. A., Chakim, M. H. R., Maulana, S., & Fitriani, G. (2024). Management of Educational Institutions through Information Systems for Enhanced Efficiency and Decision-Making. International Transactions on Education Technology (ITEE), 3(1). https://doi.org/10.33050/itee.v3i1.670
Supriyono. (2020). Software Testing with the approach of Blackbox Testing on the Academic Information System. International Journal of Information System & Technology, 3(36).
Syahadiyanti, L., & Subriadi, A. P. (2018). Diffusion of Innovation Theory Utilization Online Financial Transaction: Literature Review. International Journal of Economics and Financial Issues, 8(3), 219–226. www.econjournals.com
Taufikurrohman, M., & Nuryasin, I. (2022). Pengujian Black Box Menggunakan Metode Equivelence Partitions Dan State Transition Pada Aplikasi Angrem Rsud Campurdarat Black Box Testing Using Equivalence Partitions and State Transition Methods on the Angrem RSUD Campurdarat Application. SMATIKA : STIKI Informatika Jurnal, 12(2). https://jurnal.stiki.ac.id/SMATIKA/article/view/1367
Thahir, M., Wicaksono, A., & Mindara, G. P. (2025). Black Box Testing using Equivalence Partitioning Technique on Bakkar Website. Jurnal Instek : Informatika Sains Dan Teknologi, 10(1).
UPT IT Universitas Dr Soetomo. (2025). Data Mahasiswa Wisuda Genap 24/25 dan Jumlah Dosen.
Varajão, J., Lourenço, J. C., & Gomes, J. (2022). Models and methods for information systems project success evaluation – A review and directions for research. Heliyon, 8(12). https://doi.org/10.1016/j.heliyon.2022.e11977
Wahyu, W. B., Candiasa, I. M., & Sariyasa, S. (2021). Evaluasi Sistem Informasi Dosen pada ITB Stikom Bali Menggunakan Metode PIECES (Performance Information Economics Control Efficiency and Service). Jurnal Nasional Pendidikan Teknik Informatika (JANAPATI), 10(3). https://doi.org/10.23887/janapati.v10i3.34973
