The Content Validity: Multiple Choices Complex Physics Instrument to Measure Critical Thinking Skills

Yoga Budi Bhakti; Riyan Arthur; Yetti Supriyati

doi:10.26737/jipf.v9i1.4765

The Content Validity: Multiple Choices Complex Physics Instrument to Measure Critical Thinking Skills

Yoga Budi Bhakti, Riyan Arthur, Yetti Supriyati

Abstract

This research is part of the development of critical thinking skills instruments in physics lessons for eleventh-grade high school students. In this section, the purpose of this study is to analyze the content validity of the instrument. The instruments developed consist of 20 multiple-choice questions constructed based on indicators of critical thinking skills, namely interpretation, analysis, evaluation, inference, and explanation. Furthermore, this instrument was assessed qualitatively and quantitatively by 6 experts with assessment aspects including: 1) The questions fit the CTS indicator, 2) The stimulus/stem fits the questions, 3) The questions are clearly formulated, and 4) The problem description is clear and unambiguous.The method used in this research is a descriptive analysis method for content validation based on Aikens' Formula. Data for content validation were obtained from 9 experts, comprising 6 lecturers and 3 physics teachers from high schools in Jakarta. Based on the results and discussion, it can be concluded that 20 items of the complex multiple-choice test instrument to measure the critical thinking ability of eleventh-grade high school physics students are declared valid based on Aiken's Validity.

Keywords

Critical Thinking Skills; Content Validity; Physics Test Instrument

Full Text:

PDF (English)

References

Bao, L., & Koenig, K. (2019). Physics education research for 21st century learning. Disciplinary and Interdisciplinary Science Education Research, 1(1), 1-12.

Hendawati, Y., Pratomo, S., Suhaedah, S., Lestari, N. A., Ridwan, T., & Majid, N. W. A. (2019, October). Contextual teaching and learning of physics at elementary school. In Journal of Physics: Conference Series (Vol. 1318, No. 1, p. 012130). IOP Publishing.

Tania, R. (2021, March). The Application of Physics Learning Media Based on Android with Learning Problem Based Learning (PBL) to Improve Critical Thinking Skills. In 7th International Conference on Research, Implementation, and Education of Mathematics and Sciences (ICRIEMS 2020) (pp. 583-590). Atlantis Press.

Aminudin, A. H., Rusdiana, D., Samsudin, A., Hasanah, L., & Maknun, J. (2019, November). Measuring critical thinking skills of 11th grade students on temperature and heat. In Journal of Physics: Conference Series (Vol. 1280, No. 5, p. 052062). IOP Publishing.

Sari, S. Y., Rahim, F. R., Sundari, P. D., & Aulia, F. (2022, July). The importance of e-books in improving students’ skills in physics learning in the 21st century: A literature review. In Journal of Physics: Conference Series (Vol. 2309, No. 1, p. 012061). IOP Publishing.

Chusni, M. M., Saputro, S., Suranto, S., & Rahardjo, S. B. (2020). Review of critical thinking skill in indonesia: Preparation of the 21st century learner. Journal of Critical Reviews, 7(9), 1230-35.

Taimur, S., & Sattar, H. (2020). Education for sustainable development and critical thinking competency. Quality education, 238-248.

Faridi, H., Tuli, N., Mantri, A., Singh, G., & Gargrish, S. (2021). A framework utilizing augmented reality to improve critical thinking ability and learning gain of the students in Physics. Computer Applications in Engineering Education, 29(1), 258-273.

Maknun, J. (2020). Implementation of Guided Inquiry Learning Model to Improve Understanding Physics Concepts and Critical Thinking Skill of Vocational High School Students. International Education Studies, 13(6), 117-130.

Graham, L. J., White, S. L., Cologon, K., & Pianta, R. C. (2020). Do teachers’ years of experience make a difference in the quality of teaching?. Teaching and teacher education, 96, 103190.

Adom, D., Mensah, J. A., & Dake, D. A. (2020). Test, measurement, and evaluation: Understanding and use of the concepts in education. International Journal of Evaluation and Research in Education, 9(1), 109-119.

Allal, L. (2020). Assessment and the co-regulation of learning in the classroom. Assessment in Education: Principles, Policy & Practice, 27(4), 332-349.

Maison, D., Astalini, K., DA, S., & Perdana, R. (2020). Supporting assessment in education: E-assessment interest in physics. Universal Journal of Educational Research, 8(1), 89-97.

Bhakti, Y. B., Astuti, I. A. D., & Prasetya, R. (2023, July). Four-Tier Optics Diagnostic Test (4T-ODT) to Identify Student Misconceptions. In 3rd International Conference on Education and Technology (ICETECH 2022) (pp. 308-314). Atlantis Press.

Maryani, I., Prasetyo, Z. K., Wilujeng, I., Purwanti, S., & Fitrianawati, M. (2021). HOTs Multiple Choice and Essay Questions: A Validated Instrument to Measure Higher-Order Thinking Skills of Prospective Teachers. Journal of Turkish Science Education, 18(4), 674-690.

Dewi, P. Y., & Primayana, K. H. (2019). Effect of learning module with setting contextual teaching and learning to increase the understanding of concepts. International Journal of Education and Learning, 1(1), 19-26.

Rintayati, P., Lukitasari, H., & Syawaludin, A. (2021). Development of Two-Tier Multiple Choice Test to Assess Indonesian Elementary Students' Higher-Order Thinking Skills. International Journal of Instruction, 14(1), 555-566.

Scully, D. (2017). Constructing multiple-choice items to measure higher-order thinking. Practical Assessment, Research, and Evaluation, 22(1), 4.

Gierl, M. J., Bulut, O., Guo, Q., & Zhang, X. (2017). Developing, analyzing, and using distractors for multiple-choice tests in education: A comprehensive review. Review of Educational Research, 87(6), 1082-1116.

Boud, D., & Falchikov, N. (2006). Aligning assessment with long‐term learning. Assessment & evaluation in higher education, 31(4), 399-413.

Fuentealba, C. (2011). The role of assessment in the student learning process. Journal of veterinary medical education, 38(2), 157-162.

Kimberlin, C. L., & Winterstein, A. G. (2008). Validity and reliability of measurement instruments used in research. American journal of health-system pharmacy, 65(23), 2276-2284.

Adams, W. K., & Wieman, C. E. (2011). Development and validation of instruments to measure learning of expert‐like thinking. International journal of science education, 33(9), 1289-1312.

Oluwatayo, J. A. (2012). Validity and reliability issues in educational research. Journal of educational and social research, 2(2), 391-400.

Goodwin, L. D., & Leech, N. L. (2003). The meaning of validity in the new standards for educational and psychological testing: Implications for measurement courses. Measurement and evaluation in Counseling and Development, 36(3), 181-191.

Shaw, S. D., & Newton, P. E. (2014). Validity in educational and psychological assessment. Validity in Educational and Psychological Assessment, 1-280.

Lina, E. Y., & Desnita, D. (2022). Validity and Reliability of Critical Thinking Instruments to Measure the Effectiveness of Context-Based Physics E-Module on Wave Materials. Jurnal Penelitian & Pengembangan Pendidikan Fisika, 8(1), 57-64.

Wati, M., & Misbah, M. (2021). The content validity of the assessment instrument on the characters of wasaka in wetland environment physics learning. In Journal of Physics: Conference Series (Vol. 1760, No. 1, p. 012016). IOP Publishing.

Mardapi, D. (2018). Development of Physics Lab Assessment Instrument for Senior High School Level. International Journal of Instruction, 11(4), 17-28.

Retnawati, H. (2016). Proving content validity of self-regulated learning scale (The comparison of Aiken index and expanded Gregory index). REiD (Research and Evaluation in Education), 2(2), 155-164.

Beck, C. T., & Gable, R. K. (2001). Ensuring content validity: An illustration of the process. Journal of nursing measurement, 9(2), 201-215.

Sireci, S. G. (1998). The construct of content validity. Social indicators research, 45, 83-117.

Kholis, N., Kartowagiran, B., & Mardapi, D. (2020). Development and Validation of an Instrument to Measure a Performance of Vocational High School. European Journal of Educational Research, 9(3), 955-966.

DOI: http://dx.doi.org/10.26737/jipf.v9i1.4765