Developing a Systems Thinking Skills Assessment for Upper Primary Students in Thailand

Background/purpose. The purposes of this research are to develop a reliable and valid assessment tool for measuring systems thinking skills in upper primary students in Thailand and to establish a normative criterion for evaluating their systems thinking abilities based on educational standards.

Materials/methods. The study followed a three-phase data collection process, involving a total of 1,000 students from 17 schools in the Thai educational context. The sample was divided into three groups: 70 students for item analysis difficulty (p) and discrimination (r), 430 students for construct validation using Confirmatory Factor Analysis (CFA), and 500 students for T-score ranking and normative criteria development. The Systems Thinking Skills Assessment for Upper Primary Students was developed as a multiple-choice test.

Results. The results showed that the assessment had strong content validity (IOC = 0.60–1.00), appropriate item difficulty (p = 0.30–0.66), acceptable discrimination indices (r = 0.20–0.45), and high internal consistency (KR-20 = 0.82). The CFA confirmed that the assessment model was well-aligned with empirical data, with χ² = 0.24, p = 0.62, RMSEA = 0.00, CFI = 1.00, GFI = 1.00, and AGFI = 1.00. Additionally, T-score ranking was established, providing normative criteria for interpreting students' systems thinking performance.

Conclusion. This study was conducted to develop and validate a reliable assessment tool for measuring systems thinking skills in upper primary students. The research followed a three-phase data collection process, involving content validation, construct validation through Confirmatory Factor Analysis (CFA), and the establishment of normative criteria using T-score ranking.

Keywords: Systems thinking, assessment, CFA, Primary students

References

Academic Service Center and Educational Innovation Dissemination and Department of Educational Research and Development. (2022). Research tools analysis program: RTAP), Faculty of Education, Mahasarakham University, https://edurtap.msu.ac.th/rtapapp/

Arnold, R. D., & Wade, J. P. (2015). A Definition of Systems Thinking: A Systems Approach. Procedia Computer Science, 44, 669–678. https://doi.org/10.1016/j.procs.2015.03.050

Basile, G., & Caputo, F. (2017). Theories and Challenges for Systems Thinking in Practice. Journal of Organizational Transformation & Social Change, 14(1), 1–3. https://doi.org/10.1080/14779633.2017.1291148

Brookhart, S. M., & Nitko, A. J. (2018). Educational Assessment of Students (8th edition). Pearson.

Brown, G., Anderson, A., Shilcock, R., & Yule, G. (1984). Teaching talk: Strategies for production and assessment. Cambridge University Press.

Cabrera, D., & Cabrera, L. (2023). What Is Systems Thinking? In J. M. Spector, B. B. Lockee, & M. D. Childress (Eds.), Learning, Design, and Technology: An International Compendium of Theory, Research, Practice, and Policy (pp. 1495–1522). Springer International Publishing. https://doi.org/10.1007/978-3-319-17461-7_100

Chaidir, M., Andini, S., Harahap, U.H.S. & Nasution, A.F. (2024). Peran dan Proses Berfikir Sistem dalam Konteks Pendidikan. Student Research Journal, 2(6), 84–92. https://doi.org/10.55606/srj-yappi.v2i6.1629

Chowdhury, R. (2023). Holistic Flexibility for Deploying Systems Thinking as a Cognitive Skill. Systemic Practice and Action Research, 36(5), 803–825. https://doi.org/10.1007/s11213-022-09626-8

Daellenbach, H., McNickle, D., & Dye, S. (2017). Management Science: Decision-making through systems thinking. Bloomsbury Publishing.

Dolansky, M. A., Moore, S. M., Palmieri, P. A., & Singh, M. K. (2020). Development and Validation of the Systems Thinking Scale. Journal of General Internal Medicine, 35(8), 2314–2320. https://doi.org/10.1007/s11606-020-05830-1

Hengpiya, A., Wea-U-Seng, N., & Sa-U, S. (2021). Senge’s Learning Organization: Measurement and Validation of the Model within Thailand Context. Journal of Islamic Studies, Prince of Songkla University, 12(2), 99–120. https://so03.tci-thaijo.org/index.php/JOIS/article/view/255372

Hopper, M., & Stave, K. (2008). What Constitutes Systems Thinking? A Proposed Taxonomy. Proceedings of the 25th International Conference of the System Dynamics Society., 1–26.

Hughes, P. (2013). Principles of Primary Education (3rd ed.). David Fulton Publishers. https://doi.org/10.4324/9780203709627

Kioupi, V., & Voulvoulis, N. (2019). Education for Sustainable Development: A Systemic Framework for Connecting the SDGs to Educational Outcomes. Sustainability, 11(21), Article 21. https://doi.org/10.3390/su11216104

Kongtoom, R., Wannagatesiri, T., & Nugultham, K. (2024). Construction of systems thinking ability assessment for undergraduate students in environmental science subject. Journal of Graduate Studies Valaya Alongkorn Rajabhat University, 18(3), 125-140. https://so02.tci-thaijo.org/index.php/JournalGradVRU/article/view/264302/182759

Kopainsky, B., Alessi, S., & Davidsen, P., I. (2011). Measuring Knowledge Acquisition in Dynamic Decision Making Tasks. Proceeding of the 29th International Conference of the System Dynamics Society, 1–31.

Maani, K., & Cavana, R. (2007). Systems Thinking and Modelling-Managing Change and Complexity (2nd ed.). Pearson Education, Prentice Hall.

Nguyen, H., & Santagata, R. (2021). Impact of computer modeling on learning and teaching systems thinking. Journal of Research in Science Teaching, 58(5), 661–688. https://doi.org/10.1002/tea.21674

Noonchoocan, P. (2022). The development of science instructional model to enhance system thinking process for secondary 3 students. Journal of Modern Learning Development, 7(10), 106-121. https://so06.tci-thaijo.org/index.php/jomld/article/view/260508/174711

Petchngam, B. (2022). The developing of systems thinking skills in digital classroom management by using problem based learning and STAD technique of student the demonstration school of suan sunandha rajabhat university. Journal of Roi Kaensarn Academi, 7(7), 207–224. https://so02.tci-thaijo.org/index.php/JRKSA/article/view/255306

Phewngam, S., Sirikanna, J., Taweepong, P., Sinthu, A., & Klaiklung, S. (2023). Developing critical thinking skills in managing digital learning. Journal of MCU Nakhondhat, 10(3), Article 3. https://so06.tci-thaijo.org/index.php/jomld/article/view/260508/174711

Richmond, B. (1994). Systems Dynamics/Systems Thinking: Let’s Just Get On With It. International Systems Dynamics Conference, Sterling, UK.

Sarasean, T. (2024). Challenges and Opportunities: Reforming the Thai Education System for Global Competitiveness. Journal of Exploration in Interdisciplinary Methodologies (JEIM), 1(3), 25-35 3. https://so19.tci-thaijo.org/index.php/JEIM/article/view/741/434

Senge, P. (2006). The Fifth Discipline: The art and practice of the learning organization. Random House Books.

Sheridan, K. & Satterwhite, R. (2024). Systems Thinking as a Critical Competency for Peace Leadership. Journal of Leadership Studies, 18(3), 105-111. https://doi.org/10.1002/jls.21911

Sockman, B. R., Clossey, L., Carducci, O. M., Batson-Magnuson, L., Mazure, D., White, G., Wehmeyer, A., Green, B. A., & Wells, H. (2023). Systems Thinking as a Heuristic for the Implementation of Service Learning in a University. In J. M. Spector, B. B. Lockee, & M. D. Childress (Eds.), Learning, Design, and Technology: An International Compendium of Theory, Research, Practice, and Policy (pp. 1891–1917). Springer International Publishing. https://doi.org/10.1007/978-3-319-17461-7_91

Streiling, S., Hörsch, C., & Rieß, W. (2021). Effects of Teacher Training in Systems Thinking on Biology Students—An Intervention Study. Sustainability, 13(14), 7631. https://doi.org/10.3390/su13147631

Sukkird, P., Baikularb, P., & Comesorn, S. (2021). The development of learning model to enhance system thinking process for grade 9 students. Journal of Faculty of Education Pibulsongkram Rajabhat University, 8(1), 85-96. https://so02.tci-thaijo.org/index.php/edupsru/article/view/245741/169611

Suyaprom, S., & Manmee, T. (2018). Education Reform in Thailand 4.0: A True Story or a Soap Opera. Asian Political Science Review, 2(2), Article 2.

Sweeney, L. B., & Sterman, J. D. (2000). Bathtub dynamics: Initial results of a systems thinking inventory. System Dynamics Review, 16(4), 249–286. https://doi.org/10.1002/sdr.198

The Ministry of Education. (2008). The basic education core curriculum. The Ministry of Education.

Van Deur, P., & Murray-Harvey, R. (2005). The Inquiry Nature of Primary Schools and Students’ Self-Directed Learning Knowledge. International Education Journal, 5(5), 166–177. https://openjournals.library.sydney.edu.au/IEJ/article/view/6799

Announcement

EDUPIJ Citation Metrics

EDUPIJ News!

► Educational Process International Journal has changed to publish in article number order instead of in page range order beginning with Volume 14 (2025).