Integration of Generative Artificial Intelligence and 3D Immersive Environments in Competency-Based Higher Education

Background/purpose. The incorporation of generative artificial intelligence (AI) into higher education is transforming competency-based learning by enabling adaptive, interactive, and immersive environments. This study aimed to design and evaluate an innovation mechanism that integrates AI agents with 3D interfaces, focusing not only on technical feasibility but also on pedagogical contribution, including motivation, personalization, and competency development.

Materials/methods. Three AI systems—Ser, Edu, and Male—were developed at Universidad Sergio Arboleda and integrated into Unity-based 3D environments. The modular architecture combined voice-to-text, large language model processing, summarization, and text-to-speech. A mixed-methods approach was employed with instructors at the School of Aeronautical Instruction, including surveys, focus groups, and learning analytics to capture interaction data.

Results. Findings showed high acceptance: 81% of instructors reported motivation to use the system, while 68% perceived AI as a complement to teaching. Whisper achieved 93% transcription accuracy, and response latency averaged under 2.5 seconds. Over 3,100 interactions were recorded, mainly focused on rubric design, motivational strategies, and instructional materials. Teachers highlighted the pedagogical value of AI-generated bullet-point summaries for reducing cognitive load and organizing content.

Conclusion. The study demonstrates that generative AI integrated with 3D immersive environments can reconceptualize the teaching role from content delivery to pedagogical design. Beyond technical performance, the system enhanced personalization, engagement, and competency-based instruction. These results provide evidence of AI’s potential as a pedagogical ally and offer practical insights for scaling innovation in curriculum design and teacher training.

Keywords: Generative Artificial Intelligence, Immersive Learning Environments, Competency-Based Education, Teacher Training, Learning Analytics

References

Anderson, T., & Shattuck, J. (2012). Design-based research: A decade of progress in education research? Educational Researcher, 41(1), 16–25. https://doi.org/10.3102/0013189X11428813

Ferguson, R. (2012). Learning analytics: Drivers, developments and challenges. International Journal of Technology Enhanced Learning, 4(5/6), 304–317. https://doi.org/10.1504/IJTEL.2012.051816

Holmes, W., Bialik, M., & Fadel, C. (2019). Artificial intelligence in education: Promises and implications for teaching and learning. Center for Curriculum Redesign. https://curriculumredesign.org/wp-content/uploads/AI-in-Education-Promises-and-Implications.pdf

Holmes, W., & Tuomi, I. (2021). State of AI in education: A review of empirical research. British Journal of Educational Technology, 52(4), 1663–1676. https://doi.org/10.1111/bjet.13156

Jensen, L., & Konradsen, F. (2018). A review of the use of virtual reality head-mounted displays in education and training. Education and Information Technologies, 23(4), 1515–1529. https://doi.org/10.1007/s10639-017-9676-0

Luckin, R., Holmes, W., Griffiths, M., & Forcier, L. B. (2016). Intelligence unleashed: An argument for AI in education. Pearson. https://www.pearson.com/content/dam/one-dot-com/one-dot-com/global/Files/about-pearson/innovation/open-ideas/Intelligence-Unleashed.pdf

Merchant, Z., Goetz, E. T., Cifuentes, L., Keeney-Kennicutt, W., & Davis, T. J. (2014). Effectiveness of virtual reality-based instruction on students’ learning outcomes in K-12 and higher education: A meta-analysis. Computers & Education, 70, 29–40. https://doi.org/10.1016/j.compedu.2013.07.033

Nunnally, J. C., & Bernstein, I. H. (1994). Psychometric theory (3rd ed.). McGraw-Hill.

Prinsloo, P. (2023). Generative AI, higher education and the futures of academic integrity. International Journal of Educational Technology in Higher Education, 20(1), 1–19. https://doi.org/10.1186/s41239-023-00420-8

Selwyn, N. (2019). Should robots replace teachers? AI and the future of education. Polity Press.Selwyn, N., & Macgilchrist, F. (2022). Should we be worried about generative AI in education? Learning, Media and Technology, 47(4), 373–377. https://doi.org/10.1080/17439884.2022.2150626

Siemens, G., & Baker, R. S. J. d. (2012). Learning analytics and educational data mining: Towards communication and collaboration. In S. Dawson & C. Haythornthwaite (Eds.), Proceedings of the 2nd International Conference on Learning Analytics and Knowledge (pp. 252–254). ACM. https://doi.org/10.1145/2330601.2330661

Smutny, P., Vaculík, J., & Procházka, D. (2023). The role of ChatGPT in higher education: Opportunities, challenges, and ethical dilemmas. Education and Information Technologies, 28(6), 6615–6635. https://doi.org/10.1007/s10639-023-11813-0

UNESCO. (2023). Guidance for generative AI in education and research. UNESCO. https://unesdoc.unesco.org/ark:/48223/pf0000385869

Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, Ł., & Polosukhin, I. (2017). Attention is all you need. In I. Guyon & U. V. Luxburg (Eds.), Advances in neural information processing systems (Vol. 30, pp. 5998–6008). Curran Associates, Inc. https://doi.org/10.48550/arXiv.1706.03762

Williamson, B. (2021). Education governance and datafication. Routledge. https://doi.org/10.4324/9780429286794

Zawacki-Richter, O., Marín, V. I., Bond, M., & Gouverneur, F. (2019). Systematic review of research on artificial intelligence applications in higher education – Where are the educators? International Journal of Educational Technology in Higher Education, 16(39), 1–27. https://doi.org/10.1186/s41239-019-0171-0

Announcement

EDUPIJ Citation Metrics

EDUPIJ News!