Mapping Determinants of Success through Information Systems in Higher Education: A Structural Equation Modeling Approach

Background/purpose. This research aims to identify the key factors influencing the successful implementation of information systems in universities, especially in Indonesia. The main focus of the research is on work efficiency, collaboration, decision-making, and output quality in the context of university information systems.

Materials/methods. The study used Structural Equation Modeling (SEM) method to analyze the data. The research sample consisted of 412 respondents, including university faculty, students, and administrative staff. The analysis was conducted to measure the influence of various factors on system quality, user satisfaction, and operational performance.

Results. The findings showed that management support had the strongest influence on system quality (path coefficient = 0.77, p < 0.001) and user satisfaction (path coefficient = 0.72, p < 0.001). User experience (path coefficient = 0.80) and ease of use (path coefficient = 0.70) also significantly influenced positive perceptions of the system, which contributed to improved operational performance (84.8%, rated "excellent") and collaborative effectiveness (83.3%, rated "excellent"). However, the quality of the system's output remains a challenge, with only 50% of respondents rating it "excellent".

Conclusion. Improved features, especially in automated data analysis and report generation, are needed to optimize academic and administrative outcomes. Management support is needed to improve higher education outcomes. The implications of the study emphasize the importance of management's role in supporting system implementation, as well as the need for more in-depth feature development to support improved output quality.

Keywords: Information systems, management education, user satisfaction, output quality, Structural Equation Modeling (SEM)

References

Abbasi, G. A., Tiew, L. Y., Tang, J., Goh, Y.-N., & Thurasamy, R. (2021). The adoption of cryptocurrency as a disruptive force: Deep learning-based dual stage structural equation modelling and artificial neural network analysis. Plos One, 16(3), 247–262.

Al-Adwan, A. S., Li, N., Al-Adwan, A., Abbasi, G. A., Albelbisi, N. A., & Habibi, A. (2023). Extending the technology acceptance model (TAM) to Predict University Students’ intentions to use metaverse-based learning platforms. Education and Information Technologies, 28(11), 15381–15413.

Alfadda, H. A., & Mahdi, H. S. (2021). Measuring students’ use of zoom application in language course based on the technology acceptance model (TAM). Journal of Psycholinguistic Research, 50(4), 883–900.

Alzahrani, A. I., Mahmud, I., Ramayah, T., Alfarraj, O., & Alalwan, N. (2019). Modelling digital library success using the DeLone and McLean information system success model. Journal of Librarianship and Information Science, 51(2), 291–306.

Aytekin, A., Özköse, H., & Ayaz, A. (2022). Unified theory of acceptance and use of technology (UTAUT) in mobile learning adoption: Systematic literature review and bibliometric analysis. COLLNET Journal of Scientometrics and Information Management, 16(1), 75–116.

Birnbaum, R., & Snowdon, K. (2003). Management fads in higher education. The Canadian Journal of Higher Education, 33(2), 78–93.

Burić, I., & Kim, L. E. (2020). Teacher self-efficacy, instructional quality, and student motivational beliefs: An analysis using multilevel structural equation modeling. Learning and Instruction, 66(3), 117–132.

Chatterjee, S., & Bhattacharjee, K. K. (2020). Adoption of artificial intelligence in higher education: A quantitative analysis using structural equation modelling. Education and Information Technologies, 25(6), 3443–3463.

Chen, X., Zou, D., Cheng, G., & Xie, H. (2020). Detecting latent topics and trends in educational technologies over four decades using structural topic modeling: A retrospective of all volumes of Computers & Education. Computers & Education, 151(3), 103–115.

Crompton, H., & Burke, D. (2023). Artificial intelligence in higher education: the state of the field. International Journal of Educational Technology in Higher Education, 20(1), 22–37.

Cullen, J., Joyce, J., Hassall, T., & Broadbent, M. (2003). Quality in higher education: from monitoring to management. Quality Assurance in Education, 11(1), 5–14.

De Winter, J. C. F., & Dodou, D. (2010). Five-point Likert items: t-test versus Mann-Whitney-Wilcoxon. Practical Assessment, Research & Evaluation, 15(11), 1–12.

DeLone, W. H., & McLean, E. R. (2003). The DeLone and McLean model of information systems success: a ten-year update. Journal of Management Information Systems, 19(4), 9–30.

Domingos, C., Pêgo, J. M., Costa, P., & Santos, N. C. (2022). Usability, Acceptability, and Satisfaction of a Wearable Activity Tracker in Older Adults: Observational Study in a Real-Life Context in Northern Portugal. Journal of Medical Internet Research, 24(1), 266–272. https://doi.org/10.2196/26652

Dwivedi, Y. K., Hughes, D. L., Coombs, C., Constantiou, I., Duan, Y., Edwards, J. S., Gupta, B., Lal, B., Misra, S., & Prashant, P. (2020). Impact of COVID-19 pandemic on information management research and practice: Transforming education, work and life. International Journal of Information Management, 55(3), 107–121.

Dwivedi, Y. K., Rana, N. P., Jeyaraj, A., Clement, M., & Williams, M. D. (2019). Re-examining the unified theory of acceptance and use of technology (UTAUT): Towards a revised theoretical model. Information Systems Frontiers, 21(3), 719–734.

Fedorova, E. P., & Skobleva, E. I. (2020). Application of blockchain technology in higher education. European Journal of Contemporary Education, 9(3), 552–571.

Foster, S., Maitland, C., Hooper, P., Bolleter, J., Duckworth-Smith, A., Giles-Corti, B., & Arundel, J. (2019). High Life Study protocol: A cross-sectional investigation of the influence of apartment building design policy on resident health and well-being. BMJ Open, 9(8). https://doi.org/10.1136/bmjopen-2019-029220

Hair, J. F., Hult, G. T. M., Ringle, C. M., & Sarstedt, M. (2017). A Primer on Partial Least Squares Structural Equation Modeling (PLS-SEM). Thousand Oaks. In Sage.

Idoga, P. E., Oluwajana, D., & Adeshola, I. (2022). Educational Quality and Technological Complexity on Recognition of Enhanced Learning Platform in Developing Countries Using PLS-SEM in a Post COVID Era. Educational Technology Research and Development, 70(6), 2255–2273. https://doi.org/10.1007/s11423-022-10150-8

Jang, J., Ko, Y., Shin, W. S., & Han, I. (2021). Augmented reality and virtual reality for learning: An examination using an extended technology acceptance model. IEEE Access, 9(6), 6798–6809.

Joshi, A., Kale, S., Chandel, S., & Pal, D. K. (2015). Likert scale: Explored and explained. British Journal of Applied Science & Technology, 7(4), 396–403.

Kline, R. B. (2023). Principles and practice of structural equation modeling. New Jersey: Guilford publications.

Nicolas, C., Kim, J., & Chi, S. (2020). Quantifying the dynamic effects of smart city development enablers using structural equation modeling. Sustainable Cities and Society, 53(2), 101–116.

Pereira, J., Varajão, J., & Takagi, N. (2022). Evaluation of information systems project success–Insights from practitioners. Information Systems Management, 39(2), 138–155.

Rainer, R. K., Prince, B., Sanchez-Rodriguez, C., Splettstoesser-Hogeterp, I., & Ebrahimi, S. (2020). Introduction to information systems. New Jersey: John Wiley & Sons.

Sutcliffe, A., & Hart, J. (2016). Analyzing the Role of Interactivity in User Experience. International Journal of Human-Computer Interaction, 33(3), 229–240. https://doi.org/10.1080/10447318.2016.1239797

Szymkowiak, A., Melović, B., Dabić, M., Jeganathan, K., & Kundi, G. S. (2021). Information technology and Gen Z: The role of teachers, the internet, and technology in the education of young people. Technology in Society, 65(4), 101–115.

Upadrista, V. (2021). IoT Business Strategy. IoT Standards with Blockchain, pp. 25–41. https://doi.org/10.1007/978-1-4842-7271-8_2

Wei, Q., Chang, Z., & Cheng, Q. (2015). Usability study of the mobile library App: an example from Chongqing University. Library Hi Tech, 33(3), 340–355. https://doi.org/10.1108/lht-05-2015-0047

Williams, M. D., Rana, N. P., & Dwivedi, Y. K. (2015). The unified theory of acceptance and use of technology (UTAUT): a literature review. Journal of Enterprise Information Management, 28(3), 443–488.

Yakubu, N., & Dasuki, S. (2018). Assessing eLearning systems success in Nigeria: An application of the DeLone and McLean information systems success model. Journal of Information Technology Education: Research, 17(2), 183–203.

Yuen, K. F., Cai, L., Qi, G., & Wang, X. (2021). Factors influencing autonomous vehicle adoption: An application of the technology acceptance model and innovation diffusion theory. Technology Analysis & Strategic Management, 33(5), 505–519.

Announcement

EDUPIJ Citation Metrics

EDUPIJ News!

► Educational Process International Journal has changed to publish in article number order instead of in page range order beginning with Volume 14 (2025).