Critical Thinking in the Age of AI: A Systematic Review of AI's Effects on Higher Education

Rahyuni Melisa , Ashadi Ashadi , Anita Triastuti , Sari Hidayati , Achmad Salido , Priska Efriani Luansi Ero , Cut Marlini , Zefrin Zefrin , Zaki Al Fuad

Full text PDF | 1672 | 487

Abstract

Background: Artificial Intelligence has become an invaluable tool in academia, offering instant feedback, personalized learning experiences, and support for various academic tasks. This study investigates the impact of ChatGPT, an AI-driven language model, on developing critical thinking, evaluation, and independent judgment skills among higher education students across various academic disciplines.

Method: This research uses a systematic literature review methodology to examine studies from Scopus and Education Resources Information Center (ERIC), covering publications from 2023 to 2024. A total of 19 documents were included and analyzed in depth to address two research questions: (1) the effect of ChatGPT on the development of student's critical thinking skills in higher education, and (2) the impact of ChatGPT on students' ability to evaluate information and form independent judgments critically

Results: Findings reveal that ChatGPT can enhance students' critical thinking by facilitating quick access to diverse perspectives, aiding information analysis, and supporting argument construction. However, over-reliance on AI can hinder students' motivation for self-reflection and critical evaluation, raising concerns about academic integrity and the verification of AI-generated content.

Conclusions: To maximize the educational benefits of ChatGPT, educators must provide guidance on its responsible use, encouraging students to apply critical judgment and verify information accuracy.

Keywords: Critical thinking, ChatGPT, higher education, age of AI, students, learning

References

Adiguzel, T., Kaya, M. H., & Cansu, F. K. (2023). Revolutionizing education with AI: Exploring the transformative potential of ChatGPT. Contemporary Educational Technology, 15(3). https://doi.org/10.30935/cedtech/13152

Akhvlediani, M., Abdaladze, L., & Lataria, K. (2023). The Challenges of the XXI century – development of critical thinking among the students. KREBSI, 15, 275–285. https://doi.org/https://doi.org/10.52340/zssu.2023.15.11

Anandhi, A., & Keerthana, B. (2024). Research in engineering management ai-driven learning : Revolutionizing higher education with ChatGPT. International Journal of Progressive Research in Engineering Management and Science (IJPREMS), 04(02), 157–160. https://doi.org/10.58257/IJPREMS32676

Anderson, L. W., Krathwohl, D. R., Airasian, P. W., Cruikshank, K. A., Mayer, R. E., Pintrich, P. R., Raths, J., & Wittrock, M. C. (2001). A Taxonomy for Learning Teaching and Assessing: A Revision of Bloom’s Taxonomy of Educational Objectives. Longman.

Andreucci-Annunziata, P., Riedemann, A., Cortés, S., Mellado, A., del Río, M. T., & Vega-Muñoz, A. (2023). Conceptualizations and instructional strategies on critical thinking in higher education: A systematic review of systematic reviews. Frontiers in Education, 8, 1–18. https://doi.org/10.3389/feduc.2023.1141686

Bai, L., Liu, X., & Su, J. (2023). ChatGPT: The cognitive effects on learning and memory. Brain‐X, 1(3), 1–9. https://doi.org/10.1002/brx2.30

Baidoo-Anu, D., & Ansah, L. O. (2023). Education in the era of generative artificial intelligence (AI): Understanding the potential benefits of chatgpt in promoting teaching and learning. Journal of AI, 7(1), 52–62. https://doi.org/10.61969/jai.1337500

Banihashem, S. K., Kerman, N. T., Noroozi, O., Moon, J., & Drachsler, H. (2024). Feedback sources in essay writing: Peer-generated or AI-generated feedback? In International Journal of Educational Technology in Higher Education (Vol. 21). https://doi.org/10.1186/s41239-024-00455-4

Barana, A., Marchisio, M., & Roman, F. (2023). Fostering problem solving and critical thinking in mathematics through generative artificial intelligence. 20th International Conference on Cognition and Exploratory Learning in Digital Age (CELDA 2023), 377–385.

Baskara, F. R. (2023). The promises and pitfalls of using Chat GPT for self-determined learning in higher education: An argumentative review. Prosiding Seminar Nasional Fakultas Tarbiyah Dan Ilmu Keguruan IAIM Sinjai, 2, 95–101. https://doi.org/10.47435/sentikjar.v2i0.1825

Bennett, L., & Abusalem, A. (2024). Artificial intelligence (AI) and its potential impact on the future of higher education. Athens Journal of Education, 11(3), 195–212. https://doi.org/10.30958/aje.11-3-2

Berg, G. van den. (2024). Generative AI and educators: partnering in using open digital content for transforming education. Open Praxis, 16(2), 130–141. https://doi.org/10.55982/openpraxis.16.2.640

Berg, G. van den, & Plessis, E. du. (2023). ChatGPT and generative AI: possibilities for its contribution to lesson planning, critical thinking and openness in teacher education. Education Sciences, 13, 1–12. https://doi.org/10.3390/educsci13100998

Chan, C. K. Y., & Lee, K. K. W. (2023). The AI generation gap: Are Gen Z students more interested in adopting generative AI such as ChatGPT in teaching and learning than their Gen X and millennial generation teachers? Smart Learning Environments, 1–23. https://doi.org/10.1186/s40561-023-00269-3

Cong-Lem, N., Tran, T. N., & Nguyen, T. T. (2024). Academic integrity in the age of generative AI: Perceptions and responses of Vietnamese EFL teachers. Teaching English with Technology, 24(1), 28–48. https://doi.org/10.56297/FSYB3031/MXNB7567

Dempere, J., Modugu, K., Hesham, A., & Ramasamy, L. K. (2023). The impact of ChatGPT on higher education. Frontiers in Education, 8(September). https://doi.org/10.3389/feduc.2023.1206936

Duran, V. (2024). Analyzing teacher candidates’ arguments on AI integration in education via different Chatbots. Digital Education Review, 45, 68–83. https://doi.org/10.1344/der.2024.45.68-83

Ehlers, U.-D. (2020). Future Skills-Future Learning and Future Higher Education (U.-D. Ehlers (ed.)). Springer. https://doi.org/10.1007/978-3-658-29297-3

Ennis, R. H. (2018). Critical Thinking Across the Curriculum: A Vision. Topoi, 37(1), 165–184. https://doi.org/10.1007/s11245-016-9401-4

Esmaeil, A. A. A., Dzulkifli, D. N. A. K., Maakip, I., Matanluk, O. O., & Marshall, S. (2023). Understanding student perception regarding the use of ChatGPT in their argumentative writing: A qualitative inquiry. Jurnal Komunikasi: Malaysian Journal of Communication, 39(4), 150 – 165. https://doi.org/10.17576/JKMJC-2023-3904-08

Essel, H. B., Vlachopoulos, D., Essuman, A. B., & Amankwa, J. O. (2024). ChatGPT effects on cognitive skills of undergraduate students: Receiving instant responses from AI-based conversational large language models (LLMs). Computers and Education: Artificial Intelligence, 6, 1–13. https://doi.org/10.1016/j.caeai.2023.100198

Essien, A., Bukoye, O. T., O’Dea, X., & Kremantzis, M. (2024). The influence of AI text generators on critical thinking skills in UK business schools. Studies in Higher Education, 49(5), 865–882. https://doi.org/10.1080/03075079.2024.2316881

Facione, P. A. (2011). Critical thinking: What it is and why it counts. Insight Assessment, 1(1), 1–23.

Faisal, E. (2024). Unlock the potential for Saudi Arabian higher education: a systematic review of the benefits of ChatGPT. Frontiers in Education, 9(April), 1–12. https://doi.org/10.3389/feduc.2024.1325601

Fiialka, S., Kornieva, Z., & Honcharuk, T. (2023). ChatGPT in Ukrainian education: Problems and prospects. International Journal of Emerging Technologies in Learning, 18(17), 236–250. https://doi.org/10.3991/ijet.v18i17.42215

Graefen, B., & Fazal, N. (2024). From Chat bots to virtual tutors: An overview of Chat GPT’s role in the future of education. Archives of Pharmacy Practice, 15(2), 43–52. https://doi.org/10.51847/touppjedsx

Guo, Y., & Lee, D. (2023). Leveraging ChatGPT for enhancing critical thinking skills. Journal of Chemical Education, 100, 4876 – 4883. https://doi.org/10.1021/acs.jchemed.3c00505

İpek, Z. H., Gözüm, A. İ. C., Papadakis, S., & Kallogiannakis, M. (2023). Educational applications of the ChatGPT AI system: A systematic review research. Educational Process: International Journal, 12(3), 26–55. https://doi.org/10.22521/edupij.2023.123.2

Javaid, M., Haleem, A., Singh, R. P., Khan, S., & Khan, I. H. (2023). Unlocking the opportunities through ChatGPT Tool towards ameliorating the education system. BenchCouncil Transactions on Benchmarks, Standards and Evaluations, 3(2), 100115. https://doi.org/10.1016/j.tbench.2023.100115

Katsamakas, E., Pavlov, O. V., & Saklad, R. (2024). Artificial intelligence and the transformation of higher education institutions: A systems approach. Sustainability, 16(14), 6118. https://doi.org/10.3390/su16146118

Klayklung, P., Chocksathaporn, P., Limna, L., Kraiwanit, T., & Jangjarat, K. (2023). Revolutionizing education with ChatGPT: Enhancing learning through conversational AI. Universal Journal of Educational Research, 2(3), 217–225.

Klimova, B., Pikhart, M., & Al-Obaydi, L. H. (2024). Exploring the potential of ChatGPT for foreign language education at the university level. Frontiers in Psychology, 15, 1–10. https://doi.org/10.3389/fpsyg.2024.1269319

Mai, D. T. T., Da, C. Van, & Hanh, N. Van. (2024). The use of ChatGPT in teaching and learning: a systematic review through SWOT analysis approach. Frontiers in Education, 9(February), 1–17. https://doi.org/10.3389/feduc.2024.1328769

Michalon, B., & Camacho-Zuñiga, C. (2023). ChatGPT, a brand-new tool to strengthen timeless competencies. Frontiers in Education, 8, 1–13. https://doi.org/10.3389/feduc.2023.1251163

Michel-Villarreal, R., Vilalta-Perdomo, E., Salinas-Navarro, D. E., Thierry-Aguilera, R., & Gerardou, F. S. (2023). Challenges and opportunities of generative AI for higher education as explained by ChatGPT. Education Sciences, 13, 1–18. https://doi.org/10.3390/educsci13090856

Mohammed, S. I., Jasim, A. L., Al-Jumaili, A. A., Mikhael, E. M., & Ali, F. Z. (2024). Perceptions of senior pharmacy students towards the impact of artificial intelligence on university education and scientific writing: A qualitative study. Al-Rafidain Journal of Medical Sciences, 6(1), 142 – 146. https://doi.org/10.54133/ajms.v6i1.538

Mohebi, L. (2024). Empowering learners with ChatGPT: Insights from a systematic literature exploration. Discover Education, 3(1). https://doi.org/10.1007/s44217-024-00120-y

Moher, D., Liberati, A., Tetzlaff, J., & Altman, D. G. (2009). Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. BMJ (Online), 339(7716), 332–336. https://doi.org/10.1136/bmj.b2535

Murtiningsih, S., Sujito, A., & Khin Soe, K. (2024). Challenges of using ChatGPT in education: a digital pedagogy analysis. International Journal of Evaluation and Research in Education (IJERE), 13(5), 3466. https://doi.org/10.11591/ijere.v13i5.29467

Nikolic, S., Daniel, S., Haque, R., Belkina, M., Hassan, G. M., Grundy, S., Lyden, S., Neal, P., & Sandison, C. (2023). ChatGPT versus engineering education assessment: A multidisciplinary and multi-institutional benchmarking and analysis of this generative artificial intelligence tool to investigate assessment integrity. European Journal of Engineering Education, 48(4), 559 – 614. https://doi.org/10.1080/03043797.2023.2213169

Nikolopoulou, K. (2024). Generative artificial intelligence in higher education: Exploring ways of harnessing pedagogical practices with the assistance of ChatGPT. International Journal of Changes in Education, 1(2), 103–111. https://doi.org/10.47852/bonviewijce42022489

Nowell, L. S., Norris, J. M., White, D. E., & Moules, N. J. (2017). Thematic analysis: Striving to meet the trustworthiness criteria. International Journal of Qualitative Methods, 16(1), 1–13. https://doi.org/10.1177/1609406917733847

Nufus, R. H., Octoviani, R., Eliyana, S., & Sari, I. J. (2023). The Implementation of the Teaching Campus Program on Students’ 21st Century Skills: A Systematic Review. Jurnal Pendidikan Indonesia Gemilang, 3(2), 278–294. https://doi.org/10.53889/jpig.v3i2.208

Ogunleye, B., Ibilola, K., Zakariyyah, Ajao, O., Olayinka, O., & Sharma, H. (2024). Higher education assessment practice in the era of generative AI tools. Journal of Applied Learning & Teaching, 7(1), 25–34. https://doi.org/10.37074/jalt.2024.7.1.28 Abstract

Page, M. J., McKenzie, J. E., Bossuyt, P., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E., Brennan, S. E., Chou, R., Glanville, J., Grimshaw, J. M., Hróbjartsson, A., Lalu, M. M., Li, T., Loder, E. W., Mayo-Wilson, E., McDonald, S., … Moher, D. (2021). The prisma 2020 statement: An updated guideline for reporting systematic reviews. Medicina Fluminensis, 57(4), 444–465. https://doi.org/10.21860/medflum2021_264903

Rahman, M. M., & Watanobe, Y. (2023). ChatGPT for education and research: Opportunities, threats, and strategies. Applied Sciences (Switzerland), 13(9). https://doi.org/10.3390/app13095783

Raskin, R. (2020). Literacy strategies and instructional modalities in introductory accounting. In Teaching College-Level Disciplinary Literacy (pp. 79–105). https://doi.org/https://doi.org/10.1007/978-3-030-39804-0

Salido, A., Sugiman, S., Fauziah, P. Y., Kausar, A., Haskin, S., & Azhar, M. (2024). Parental involvement in students’ mathematics activities: A bibliometric analysis. EURASIA Journal of Mathematics, Science and Technology Education, 20(10), 1–13. https://doi.org/https://doi.org/10.29333/ejmste/15179

Sánchez-Ruiz, L. M., Moll-López, S., Nuñez-Pérez, A., Moraño-Fernández, J. A., & Vega-Fleitas, E. (2023). ChatGPT challenges blended learning methodologies in engineering education: A case study in mathematics. Applied Sciences (Switzerland), 13. https://doi.org/10.3390/app13106039

Silva, A. de O., & Janes, D. dos S. (2021). The emergence of ChatGPT and its implications for education and academic research in the 21st century. Review of Artificial Intelligence in Education, 2(00), e06. https://doi.org/10.37497/rev.artif.intell.education.v2i00.6

Sok, S., & Heng, K. (2023). ChatGPT for education and research: A review of benefits and risks. Cambodian Journal of Educational Research, 3(1), 110–121. https://doi.org/10.62037/cjer.2023.03.01.06

Stampfl, R., Geyer, B., Deissl-O‘meara, M., & Ivkic, I. (2024). Revolutionising role-playing games with ChatGPT. Advances in Artificial Intelligence and Machine Learning, 4(2), 2244 – 2257. https://doi.org/10.54364/aaiml.2024.42129

Supianto, Widyaningrum, R., Wulandari, F., Zainudin, M., Athiyallah, A., & Rizqa, M. (2024). Exploring the factors affecting ChatGPT acceptance among university students. Multidisciplinary Science Journal, 6(12). https://doi.org/10.31893/multiscience.2024273

Susnjak, T. (2024). ChatGPT : The end of online exam integrity ? Education Sciences, 14, 1–20. https://doi.org/10.3390/ educsci14060656

Tajik, E., & Tajik, F. (2024). A comprehensive examination of the potential application of Chat GPT in higher education institutions. SSRN Electronic Journal, April. https://doi.org/10.2139/ssrn.4699304

Tseng, Y.-C., & Lin, Y.-H. (2024). Enhancing english as a foreign language (EFL) learners’ writing with ChatGPT: A university-level course design. The Electronic Journal of E-Learning, 78–97. https://doi.org/10.34190/ejel.21.5.3329

Valova, I., Mladenova, T., & Kanev, G. (2024). Students’ perception of ChatGPT usage in education. International Journal of Advanced Computer Science and Applications, 15(1), 466 – 473. https://doi.org/10.14569/IJACSA.2024.0150143

Vargas-Murillo, A. R., Pari-Bedoya, I. N. M. de la A., & Guevara-Soto, F. de J. (2023). Challenges and opportunities of AI-assisted learning: A systematic literature review on the impact of ChatGPT usage in higher education. International Journal of Learning, Teaching and Educational Research, 22(7), 122 – 135. https://doi.org/10.26803/ijlter.22.7.7

You, S. (2024). A systematic review of the impact of ChatGPT on higher education. International Journal of Technology-Enhanced Education, 3(1), 1–14. https://doi.org/10.4018/ijtee.343528

Announcement

EDUPIJ Citation Metrics

EDUPIJ News!

► Educational Process International Journal has changed to publish in article number order instead of in page range order beginning with Volume 14 (2025).