Developing Two Tier Test of Critical Thinking Ability using Rasch Model

Novika Lestari; Chairun Nisa; Mutazam Mutazam; Soeharto Soeharto

doi:10.26737/jipf.v8i2.3737

Developing Two Tier Test of Critical Thinking Ability using Rasch Model

Novika Lestari, Chairun Nisa, Mutazam Mutazam, Soeharto Soeharto

Abstract

Critical thinking ability refers to cognitive processes to solve problems so that students are able to relate learning to everyday life. This achievement needs to be measured with valid and reliable instruments. Therefore, the research was conducted with the aim of characterizing the critical thinking test type two tier tests using the Rasch model. This study used a construction design and test validation. The construction process resulted in a critical thinking test of the two-tier type in the form of multiple choice on physics material for class X semester 1 which measured three basic aspects of critical thinking. The validation procedure was based on a trial exam taken by 146 students in Melawi Regency and a test evaluation by two experts. The findings demonstrated that the Aiken's V content validity analysis and the analysis utilizing item response theory both supported the validity of the critical thinking test. The analysis's findings demonstrated the validity and reliability of this test of critical thinking. The 23 created questions were found to be valid based on the results of the content validity test utilizing Aiken V. This test's empirical validity demonstrates that every item has a good level of difficulty and meets the Rasch model. The physics material used in the designed critical thinking test for class X semester 1 was valid, dependable, and had a good level of difficulty.

Keywords

Critical thinking; Partial Credit Model (PCM); Rasch Model; High Order Thinking; Logic Model, Two-tier Test

Full Text:

PDF (English)

References

OECD. (2015). Programme for international student assessment (PISA). Results from PISA 2015.

Kalelioğlu, F., & Gülbahar, Y. (2014). The effect of instructional techniques on critical thinking and critical thinking dispositions in online discussion. Journal of Educational Technology & Society, 17(1): 248-258.

Chukwuyenum, A. N. (2013). Impact of critical thinking on performance in mathematics among senior secondary school students in Lagos State. IOSR Journal of Research & Method in education, 3(5): 18-25.

Hatcher, D. L. (2011). Which test? Whose scores? Comparing standardized critical thinking tests. New Directions for Institutional Research, 2011(149): 29-39.

McMurray, M. A., Beisenherz, P., & Thompson, B. (1991). Reliability and concurrent validity of a measure of critical thinking skills in biology. Journal of Research in Science Teaching, 28(2): 183-191.

Simpson, E., & Courtney, M. (2002). Critical thinking in nursing education: literature review. International Journal of Nursing Practice, 8(2): 89-98.

Barnett, J. E., & Francis, A. L. (2012). Using higher order thinking questions to foster critical thinking: A classroom study. Educational Psychology, 32(2): 201-211.

Kamali, Z., & Fahim, M. (2011). The Relationship between Critical Thinking Ability of Iranian EFL Learners and Their Resilience Level Facing Unfamiliar Vocabulary Items in Reading. Journal of Language Teaching and Research, 2(1): 104-111.

Sumintono, B., & Widhiarso, W. (2015). Aplikasi pemodelan rasch pada assessment pendidikan. Trim komunikata.

Sumintono, B. (2018, February). Rasch model measurements as tools in assesment for learning. In 1st International Conference on Education Innovation (ICEI 2017) (pp. 38-42). Atlantis Press.

Brookfield, S. D. (1997). Assessing critical thinking. New Directions for Adult and Continuing Education, 1997(75): 17-29.

Hambleton, R. K., Swaminathan, H., & Rogers, H. J. (1991). Fundamentals of item response theory (Vol. 2). Sage.

Retnawati, H. (2016). Validitas Reliabilitas & Karakteristik Butir. Parama Publishing.

Parmaningsih, T. J., & Saputro, D. R. S. (2021, February). Rasch analysis on item response theory: Review of model suitability. In AIP Conference Proceedings (Vol. 2326, No. 1, p. 020017). AIP Publishing LLC.

van der Linden, W. J., & Hambleton, R. K. (Eds.). (2013). Handbook of modern item response theory. Springer Science & Business Media.

Widhiarso, W. (2010). Model politomi dalam teori respons butir. Available at SSRN 2593459.

Engelhard, G. (2005). Item Response Theory (IRT) models for rating scale data. Encyclopedia of statistics in behavioral science.

Yilmaz, H. B. (2019). A Comparison of IRT Model Combinations for Assessing Fit in a Mixed Format Elementary School Science Test. International Electronic Journal of Elementary Education, 11(5): 539-545.

Amelia, R. N. (2021). Identifikasi Item Fit Dan Person Fit Dalam Pengukuran Hasil Belajar Kimia. Jurnal Ilmiah WUNY, 3(1).

Mellenbergh, G. J., & Vijn, P. (1981). The Rasch model as a loglinear model. Applied Psychological Measurement, 5(3): 369-376.

Aoyama, K. (2007). Investigating a hierarchy of students’ interpretations of graphs. International Electronic Journal of Mathematics Education, 2(3): 298-318.

Boone, W. J., & Noltemeyer, A. (2017). Rasch analysis: A primer for school psychology researchers and practitioners. Cogent Education, 4(1): 1416898.

Isgiyanto, A. (2013). Perbandingan Penyekoran Model Rasch dan Model Partial Credit pada Matematika. Jurnal Kependidikan, 43(1).

Masters, G. N. (1982). A Rasch model for partial credit scoring. Psychometrika, 47(2): 149-174.

Asysyifa, D. S., Wilujeng, İ., & Kuswanto, H. (2019). Analysis of students critical thinking skills using partial credit models (PCM) in physics learning. International Journal of Educational Research Review, 4(2): 245-253.

Ennis, R. (2011). Critical Thinking: Reflection and Perspective Part I. Inquiry: Critical Thinking Across the Disciplines, 26(1): 4-18.

Winsteps. (2022). WINSTEPS Rasch Software - Winsteps Facets. https://www.winsteps.com/winsteps.htm (accessed Oct. 12, 2022).

Tarigan, E. F., Nilmarito, S., Islamiyah, K., Darmana, A., & Suyanti, R. D. (2022). Analisis Instrumen Tes Menggunakan Rasch Model dan Software SPSS 22.0. Jurnal Inovasi Pendidikan Kimia, 16(2): 92-96.

Hardianti, H. Karakteristik Tes Kemampuan Berpikir Kritis Siswa SMA pada Materi Momentum dan Impuls: Perbandingan Classical Theory Test (CTT) dan Model Rasch. WaPFi (Wahana Pendidikan Fisika), 6(2): 167-173.

DeMars, C. (2010). Item response theory. Oxford University Press.

Adams, R., & Khoo, S. T. (1996). ACER Quest: the interactive test analysis system. Version 2.1.

Boone, W. J., Staver, J. R., & Yale, M. S. (2013). Rasch analysis in the human sciences. Springer Science & Business Media.

Meyer, J. P., & Zhu, S. (2013). Fair and equitable measurement of student learning in MOOCs: An introduction to item response theory, scale linking, and score equating. Research & Practice in Assessment, 8: 26-39.

Kim, S., Moses, T., & Yoo, H. H. (2015). Effectiveness of item response theory (IRT) proficiency estimation methods under adaptive multistage testing. ETS Research Report Series, 2015(1): 1-19.

Permata, A. R., Muslim, M., & Suyana, I. (2019, December). Analisis kemampuan berpikir kritis siswa SMA pada materi momentum dan impuls. In Prosiding Seminar Nasional Fisika (E-Journal) (Vol. 8, pp. SNF2019-PE).

Ridho, S., Ruwiyatun, R., Subali, B., & Marwoto, P. (2020). Analisis kemampuan berpikir kritis siswa pokok bahasan klasifikasi materi dan perubahannya. Jurnal Penelitian Pendidikan IPA, 6(1): 10-15.

Arini, W., & Juliadi, F. (2018). Analisis kemampuan berpikir kritis pada mata pelajaran fisika untuk pokok bahasan Vektor siswa kelas X SMA Negeri 4 Lubuklinggau, Sumatera Selatan. Berkala Fisika Indonesia, 10(1): 1-11.

Nuryanti, L., Zubaidah, S., & Diantoro, M. (2018). Analisis kemampuan berpikir kritis siswa SMP. Jurnal Pendidikan: Teori, Penelitian, dan Pengembangan, 3(2), 155-158.

DOI: http://dx.doi.org/10.26737/jipf.v8i2.3737