Volume 13 Issue 3 (2024)

Development of Critical-Thinking Skills Rubric within the Scope of Multicultural Education

pp. 139-158  |  Published Online: October 2024  |  DOI: 10.22521/edupij.2024.133.8

Serkan Aslan , Birsel Aybek

Abstract

Background/Purpose. The study aimed to develop a rubric to measure students’ critical-thinking skills within a multicultural education scope.

Materials/Methods. The study’s participants were faculty members, teachers, and students, determined according to convenience sampling based on predetermined criterion. Initially, a story-based test and critical-thinking rubric were prepared and then validity studies conducted on these products. Subsequently, the prepared test and rubric were applied to fourth-grade elementary school students, with the data scored by their teachers, and reliability studies were then conducted. During the study’s analysis, scope, validity index and ratio, agreement percentage, correlation coefficient, Kendall’s concordance coefficient, and Cronbach’s alpha coefficient were all examined.

Results. The collected data were evaluated according to statistical analysis and the obtained findings showed the developed rubric to be both valid and reliable. The results revealed that the rubric developed to evaluate critical-thinking skills in a multicultural education scope was deemed to be an effective tool to assist teachers in measuring and evaluating students’ critical-thinking skills. In addition, use of the rubric can contribute to identifying and implementing strategies to improve students’ critical-thinking skills.

Conclusion. The study developed effective tools for practitioners and decision-makers in the field of education to measure and develop students’ critical-thinking skills. In particular, use of the developed rubric in the evaluation of students’ critical-thinking skills presents a significant step in increasing success in education and supporting students’ future academic and professional achievements. In conclusion, this research demonstrated the validity and reliability of a rubric that may be used as an effective tool for the evaluation and development of critical-thinking skills in education.

Keywords: Critical thinking, multicultural education, rubric development, validity and reliability studies

References

Alsaleh, N. J. (2020). Teaching critical thinking skills: Literature review. The Turkish Online Journal of Educational Technology, 19(1), 21-39. http://www.tojet.net/articles/v19i1/1913.pdf

Amanvermez İncirkuş, F., & Beyreli, L. (2019). Öyküleyici metinler aracılığıyla eleştirel düşünme becerilerini değerlendirmeye yönelik bir rubrik [Evaluation of Critical Thinking Skills in Narrative Texts through a Rubric]. Ana Dili Eğitimi Dergisi, 7(3), 597-629. https://doi.org/10.16916/aded.553569

Andrade, H. L., Du, Y., & Wang, X. (2008). Putting rubrics to the test: The effect of a model, criteria generation, and rubric-referenced self-assessment on elementary school students’ writing. Educational Measurement: Issues and Practice, 27(2), 3-13. https://doi.org/10.1111/j.1745-3992.2008.00118.x

Arter, J., & McTighe, J. (2000). Scoring rubrics in the classroom: Using performance criteria for assessing and improving student performance. Corwin Press.

Aybek, B. (2018). An examination of the relationship between the critical thinking dispositions of prospective teachers and their attitudes toward multicultural education. Yükseköğretim Dergisi, 8(3), 282-292. https://doi.org/10.2399/yod.18.012

Aydın, İ., & Uzun, M. (2020). Çocuk kitaplarının taşıması gereken özellikler: Cemil Kavukçu’nun Bir Öykü Yazalım Mı? ve Masal Anlatma Oyunu adlı eserlerine eleştirel bir bakış [Features that children's books should have: A critical look at the works of Cemil Kavukçu named Bir Öykü Yazalım Mı? and Masal Anlatma Oyunu]. RumeliDE Dil ve Edebiyat Araştırmaları Dergisi, 7, 315-340. https://doi.org/10.29000/rumelide.808713

Ayre, C., & Scally, A. J. (2014). Critical values for Lawshe’s content validity ratio: revisiting the original methods of calculation. Measurement and Evaluation in Counseling and Development, 47(1), 79-86. https://doi.org/10.1177/0748175613513808

Banks, J. A. (2015). Cultural diversity and education. Routledge.

Banks, J. A. (2019). Multicultural education: Characteristics and goals. In J. A. Banks & C. A. M. Banks (Eds.), Multicultural education: Issues and perspectives (pp. 3-30). Wiley.

Bennett, M. J. (2013). Basic concepts of intercultural communication: paradigms, principles, and practices. Brealey.

Brookhart, S. M. (2013). How to create and use rubrics for formative assessment and grading. ASCD.

Can, A. (2023). SPSS ile bilimsel araştırma sürecinde nicel veri analizi [add translation here]. Pegem Akademi.

Darwin, Rusdin, D., Mukminatien, N., Suryati, N., Laksmi, E. D., & Marzuki. (2024). Critical thinking in the AI era: An exploration of EFL students’ perceptions, benefits, and limitations. Cogent Education1 (1), Article: 2290342. https://doi.org/10.1080/2331186X.2023.2290342

Derman-Sparks, L., & Edwards, J. O. (2009). Anti-bias education for young children and ourselves. National Association for the Education of Young Children.

Ennis, R. H. (1987). A taxonomy of critical thinking dispositions and abilities. In J. B. Baron & R. J. Sternberg (Eds.), Teaching thinking skills: Theory and practice (pp. 9-26). Freeman.

Erkuş, A. (2022). Psikolojide ölçme ve ölçek geliştirme-I: Temel kavramlar ve işlemler [add translation here]. Pegem Akademi.

Facione, P. A. (1990). Critical thinking: A statement of expert consensus for purposes of educational assessment and instruction. Research findings and recommendations. California Academic Press.

Facione, P. A. (2011). Critical thinking: What it is and why it counts. California Academic Press.

Fraenkel, J. R., Wallen, N. E., & Hyun, H. H. (2022). How to design and evaluate research in education. McGraw-Hill.

Frey, B. B. (2014). 100 questions (and answers) about tests and measurement. Sage.

Garson, G. D. (2013). Validity and reliability. Statistical Publishing.

Gay, G. (2018). Culturally responsive teaching: Theory, research, and practice. Teachers College Press.

Goodrich, A. H. (2001). The effects of instructional rubrics on learning to write. Current Issues in Education, 4(4). https://scholarsarchive.library.albany.edu/etap_fac_scholar/6/

Gorski, P. C. (2013). Reaching and teaching students in poverty: Strategies for erasing the opportunity gap. Teachers College Press.

Griffard, P. B., Mosleh, T., & Kubba, S. (2012). Developing the inner scientist: Book club participation. Life Sciences Education, 12(1), 80-91. https://doi.org/10.1187/cbe.12-02-0020

Heaven, K. (2007). Story proof: The science behind the startling power of story. Libraries Unlimited.

Hjerm, M., Johansson Sevä, I., & Werner, L. (2018). How critical thinking, multicultural education and teacher qualification affect anti-immigrant attitudes. International Studies in Sociology of Education, 27(1), 42-59. https://doi.org/10.1080/09620214.2018.1425895

Johnson, R. B., & Christensen, L. (2019). Educational research: Quantitative, qualitative, and mixed approaches. Sage.

Kaya, M. M. (2021). The relationships between global citizenship, multicultural personality and critical thinking. Educational Policy Analysis and Strategic Research, 16(4), 274-292. https://doi.org/10.29329/epasr.2021.383.15

King, P. M., & Kitchener, K. S. (2002). The reflective judgment model: Twenty years of research on epistemic cognition. In B. K. Hofer & P. R. Pintrich (Eds.), Personal epistemology: The psychology of beliefs about knowledge and knowing (pp. 37-61). Erlbaum.

Kirk, J., & Miller, M. L. (1985). Reliability and validity in qualitative research. Sage.

Ku, K. Y.-L. (2009). Assessing students’ critical thinking performance: Urging for measurements using multi-response format. Thinking Skills and Creativity, 4(1), 70-76. https://doi.org/10.1016/j.tsc.2009.02.001

Kutlu, Ö., Doğan, C. D., & Karakaya, İ. (2023). Ölçme ve değerlendirme performansa ve portfolyoya dayalı durum belirleme [add translation here]. Pegem Akademi.

Lawshe, C. H. (1975). A quantitative approach to content validity. Personnel Psychology, 28(4), 563-575. https://doi.org/10.1111/j.1744-6570.1975.tb01393.x

Miles, M. B., & Huberman, A. M. (1994). Qualitative data analysis: A sourcebook of new materials. Sage.

Moskal, B. M. (2000). Scoring rubrics: What, when, and how? Practical Assessment, Research & Evaluation, 7(3). https://doi.org/10.7275/a5vq-7q66

Olson, J., & Krysiak, R. (2021). Rubrics as tools for effective assessment of student learning and program quality. In T. P. Fudge & S. S. Ferebee (Eds.), Curriculum development and online instruction for the 21st century (pp. 173-200). IGI Global.

Özdamar, K. (2017). Paket programlar ile istatistiksel [add translation here]. Nisan Kitapevi.

Öztoprak, F. B. (2006). Öykü öğretiminde öykü haritası kullanımının okuduğunu anlama üzerine etkisi [add translation here] [Master’s thesis]. Çanakkale Onsekiz Mart University, Çanakkale, Turkey.

Panadero, E., & Jonsson, A. (2013). The use of scoring rubrics for formative assessment purposes revisited: A review. Educational Research Review, 9, 129-144. https://doi.org/10.1016/j.edurev.2013.01.002

Paul, R., & Elder, L. (2021). Critical thinking: Tools for taking charge of your learning and your life (fourth ed.). Rowman & Littlefield.

Plano-Clark, V. L., & Creswell, J. W. (2014). Understanding research: A consumer’s guide. Pearson.

Reddy, Y. M., & Andrade, H. (2010). A review of rubric use in higher education. Assessment & Evaluation in Higher Education, 35(4), 435-448. https://doi.org/10.1080/02602930902862859

Reynders, G., Lantz, J., Ruder, S. M., Stanford, C. L., & Cole, R. S. (2020). Rubrics to assess critical thinking and information processing in undergraduate STEM courses. International Journal of STEM Education, 7(9), Article 9. https://doi.org/10.1186/s40594-020-00208-5

Ritchhart, R. (2015). Creating cultures of thinking: The 8 forces we must master to truly transform our schools. Jossey-Bass.

Rubba, P. A., & Harkness, W. J. (1996). A new scoring procedure for the views on science- technology-society instrument. International Journal of Science Education, 18(4), 387-400. https://doi.org/10.1080/0950069960180401

Sıvacı, S., & Altaş, B. (2023). The effect of critical thinking dispositions and democratic values of pre-service EFL teachers on their multicultural self-efficacy: A structural equation modeling approach. Thinking Skills and Creativity, 47, Article 101221. https://doi.org/10.1016/j.tsc.2022.101221

Sever, S. (1995). Çocuk kitaplarında bulunması gereken yapısal ve eğitsel özellikler [add translation here]. Abece Eğitim ve Ekin ve Sanat Dergisi, 107, 14-15.

Sever, S. (2008). Çocuk ve edebiyat [add translation here]. Tudem.

Sever, S. (2013). Çocuk edebiyatı ve okuma kültürü [add translation here]. Tudem.

Solar, B. (2012, October 5-7). Türkçe ders kitaplarında öyküleyici metinlerdeki kahramanların çocuğa göreliğinin değerlendirilmesi [add translation here] [Conference presentation]. 3. Ulusal Çocuk ve gençlik edebiyatı sempozyumu [3rd National Children and Youth Literature Symposium], Ankara University, Turkey.

Stevens, D. D., & Levi, A. J. (2013). Introduction to rubrics: An assessment tool to save grading time, convey effective feedback, and promote student learning. Stylus Publishing.

Sungur, O. (2014). Korelasyon analizi [add translation here]. In Ş. Kalaycı (Ed.), SPSS uygulamalı çok değişkenli istatistik teknikleri [add translation here]. Asil Yayıncılık.

Turgut, H., Kılıç, F. E., Aycan, R., & Ünal, C. E. (2024). Ortaokul öğrencilerinin eleştirel düşünme ve problem çözme becerilerinin ölçümü: Bir analitik rubrik geliştirme çalışması [add translation here]. Uluslararası Sosyal Bilimler ve Eğitim Dergisi, 6(10), 107-126. https://doi.org/10.5281/zenodo.10544137

Vincent-Lancrin, S. (2023). Fostering and assessing student critical thinking: From theory to teaching practice. European Journal of Education, 58, 354-368. https://doi.org/10.1111/ejed.12569

Wilson, M. (2023). Constructing measures and item response modeling approach. Routledge.

Yeşilyurt, S., & Çapraz, C. (2018). Ölçek geliştirme çalışmalarında kullanılan kapsam geçerliği için bir yol haritası [A Road Map for the Content Validity Used in Scale Development Studies]. Erzincan Üniversitesi Eğitim Fakültesi Dergisi, 20(1), 251-264. https://doi.org/10.17556/erziefd.297741

Announcement

EDUPIJ Citation Metrics

EDUPIJ News!

► Educational Process International Journal has changed to publish in article number order instead of in page range order beginning with Volume 14 (2025).