Exploration of The Characteristics of Indonesian Final Semester Assessment Questions Using The Rasch Model

Rahmat Danni, Banun Havifah Cahyo Khosiyono, Berliana Henu Cahyani, Amir Hamzah, Rezkilaturahmi Rezkilaturahmi

Abstract

This research aims to describe the characteristics of final semester assessment items in Indonesian language subjects using the Rasch model. This research is quantitative descriptive. The research subjects were 36 students of class V MIN 1 East Belitung. The research data is in the form of answers to final Indonesian language semester assessment questions, totaling 30 multiple choice questions with four alternative answers. The results of this research indicate that the final semester assessment instrument for Indonesian Language for class V at MIN 1 East Belitung for the 2023/2024 academic year has met the criteria for a good test instrument based on the Rasch model approach. In addition, these results are proven by the large number of items that meet the fit criteria in the Rasch model, namely 77% of the items are fit and the remaining 23% are not fit and are also proven by the instrument reliability coefficients such as item reliability of 0.77, person reliability of 0.80 and alpha Cronbach's was 0.84. Items that are suitable are items number 1, 2, 4, 5, 8, 9, 19, 13, 14, 15, 16, 17, 18, 20, 21, 22, 24, 25, 26, 27, 28, 29 , and 30 while the items that are not fit are 3, 6, 7, 11, 12, 19, and 23. Items that are not fit are not suitable for measuring students' abilities so the questions need to be revised or eliminated. Therefore, if it is forced to be used, the resulting information will be invalid. Strengthening teacher competence in developing test items needs to be improved through training/workshops. Thus, this research is limited to multiple choice questions, further research needs to analyze items in the description form or mixed multiple choice and description questions using the Rasch model approach.

Keywords

Indonesian Language; Rasch Model; Elementary School

Full Text:

PDF

References

Abdellatif, H. (2023). Test results with and without blueprinting: Psychometric analysis using the Rasch model. Educación Médica, 24(3), 100802. https://doi.org/10.1016/j.edumed.2023.100802

Abdullaev, D., Shukhratovna, D. L., Rasulovna, J. O., Umirzakovich, J. U., & Staroverova, O. V. (2024). Examining Local Item Dependence in a Cloze Test with the Rasch Model. International Journal of Language Testing, 14(1), 75–81.

Akyol, Z., & Garrison, D. R. (2011). Understanding cognitive presence in an online and blended community of inquiry: Assessing outcomes and processes for deep approaches to learning. British Journal of Educational Technology, 42(2), 233–250. https://doi.org/10.1111/j.1467-8535.2009.01029.x

Anderson, L. W., & Krathwohl, D. R. (2001). A Taxonomy for Learning Teaching and Assessing: A Revision of Bloom’s Taxonomy of Education Objectives. New York: Addison Wesley Longman, Inc.

Arlinwibowo, J., Retnawati, H., & Kartowagiran, B. (2021). Item Response Theory Utilization for Developing the Student Collaboration Ability Assessment Scale in STEM Classes. Ingenierie Des Systemes d’Information, 26(4), 409–415. https://doi.org/10.18280/ISI.260409

Bond, T., & Fox, C. (2015). Applying the Rasch Model Fundamental measurement in the Human Sciences (3rd ed.). New York: Routledge.

Boone, W., Staver, J., & Yale, M. (2014). Rasch Analysis in the Human Sciences. Dordrecht: Springer.

Briggs, D. C. (2019). Interpreting and visualizing the unit of measurement in the Rasch Model. Measurement, 146, 961–971. https://doi.org/10.1016/j.measurement.2019.07.035

Cronbach, L. J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, (16), 297–334.

Danni, R., & Tauratiya, T. (2020). Analisis Kemampuan Berpikir Kritis Mahasiswa Program Studi Hukum Keluarga Islam IAIN Syaikh Abdurrahman Siddik Bangka Belitung. Tarbawy : Jurnal Pendidikan Islam, 7(1), 17–22. https://doi.org/10.32923/tarbawy.v7i1.1191

Danni, R., Wahyuni, A., & Tauratiya, T. (2021). Item Response Theory Approach: Kalibrasi Butir Soal Penilaian Akhir Semester Mata Pelajaran Bahasa Arab. Arabi : Journal of Arabic Studies, 6(1), 93–104. https://doi.org/10.24865/AJAS.V6I1.320

DeMars, C. E. (2018). Classical Test Theory and Item Response Theory. In The Wiley Handbook of Psychometric Testing (pp. 49–73). Chichester, UK: John Wiley & Sons, Ltd. Retrieved from http://doi.wiley.com/10.1002/9781118489772.ch2

Edelen, M. O., & Reeve, B. B. (2007). Applying item response theory (IRT) modeling to questionnaire development, evaluation, and refinement. Quality of Life Research, 16(1), 5–18. https://doi.org/10.1007/s11136-007-9198-0

Effatpanah, F., Baghaei, P., & Karimi, M. N. (2024). A mixed Rasch model analysis of multiple profiles in L2 writing. Assessing Writing, 59, 100803. https://doi.org/10.1016/j.asw.2023.100803

Fajrianthi, F., Hendriani, W., & Septarini, B. G. (2016). Pengembangan Tes Berpikir Kritis Dengan Pendekatan Item Response Theory. Jurnal Penelitian Dan Evaluasi Pendidikan, 20(1), 45–55. https://doi.org/10.21831/pep.v20i1.6304

Fauziana, A., & Wulansari, A. D. (2021). Analisis Kualitas Butir Soal Ulangan Harian di Sekolah Dasar dengan Model Rasch. Jurnal Ibriez : Jurnal Kependidikan Dasar Islam Berbasis Sains, 6(1), 10–19. https://doi.org/10.21154/ibriez.v6i1.112

Gana, K., & Guillaume Broc. (2019). Structural Equation Modeling with Lavaan. United States: John Wiley & Sons, Ltd.

Himelfarb, I. (2019). A primer on standardized testing: History, measurement, classical test theory, item response theory, and equating. Journal of Chiropractic Education, 33(2), 151–163. https://doi.org/10.7899/JCE-18-22

Istiyono, E., Mardapi, D., & Suparno, S. (2014). Pengembangan Tes Kemampuan Berpikir Tingkat Tinggi Fisika (Pysthots) Peserta Didik SMA. Jurnal Penelitian Dan Evaluasi Pendidikan, 18(1), 1–12. https://doi.org/10.21831/pep.v18i1.2120

Mahtari, S., Misbah, M., & Suryati, S. (2019). Analysis of the Ability of High School Students in Solving Science Literacy Questions Based on the Rasch Model. Kasuari: Physics Education Journal (KPEJ), 2(1), 11–16. https://doi.org/10.37891/KPEJ.V2I1.61

Mardapi, D. (2016). Pengukuran penilaian dan evaluasi pendidikan (2nd ed.). Yogyakarta: Nuha Litera.

Mustafa, N., Khairani, A. Z., & Ishak, N. A. (2021). Calibration of the science process skills among Malaysian elementary students: A Rasch model analysis. International Journal of Evaluation and Research in Education (IJERE), 10(4), 1344–1351. https://doi.org/10.11591/ijere.v10i4.21430

Petrillo, J., Cano, S. J., McLeod, L. D., & Coon, C. D. (2015). Using classical test theory, item response theory, and rasch measurement theory to evaluate patient-reported outcome measures: A comparison of worked examples. Value in Health, 18(1), 25–34. https://doi.org/10.1016/j.jval.2014.10.005

Qiu, C., Peabody, M. R., & Bradley, K. D. (2024). Exploring Construct Measures Using Rasch Models and Discretization Methods to Analyze Existing Continuous Data. Measurement: Interdisciplinary Research and Perspectives, 22(1), 108–120. https://doi.org/10.1080/15366367.2023.2210358

Ramadhan, S., Mardapi, D., Prasetyo, Z. K., & Utomo, H. B. (2019). The development of an instrument to measure the higher order thinking skill in Physics. European Journal of Educational Research, 8(3), 743–751.

Ramadhan, S., Sumiharsono, R., Mardapi, D., & Prasetyo, Z. K. (2020). The Quality of Test Instruments Constructed by Teachers in Bima Regency, Indonesia: Document Analysis. International Journal of Instruction, 13(2), 507–507. https://doi.org/10.29333/iji.2020.13235a

Retnawati, H. (2014). Teori Respons Butir dan Penerapannya. Yogyakarta: Nuha Medika.

Retnawati, H. (2016). Validitas, reliabilitas dan karakteristik butir. Yogyakarta: Nuha Medika.

Reynolds, C. R., Livingston, R. B., & Willson, V. (2009). Measurement and Assessment in Education (2nd ed.). Upper Saddle River, NJ: Pearson.

Sarea, M. S., & Ruslan, R. (2019). Karakteristik Butir Soal: Classical Test Theory Vs Item Response Theory? DIDAKTIKA : Jurnal Kependidikan, 13(1), 1–16. https://doi.org/10.30863/didaktika.v13i1.296

Stiggins, R., & Chappuis, J. (2012). Introduction to student invoved assessment for learning (6th ed.). Boston: Addison Wesley.

Sudjana, N. (2016). Penilaian Hasil Belajar Proses Belajar Mengajar. Bandung: Remaja Rosdakarya.

Sumintono, B., & Widhiarso, W. (2015). Aplikasi Pemodelan Rasch pada Assessment Pendidikan. Bandung: Trim Komunikata.

Susetyo, B. (2015). Prosedur Penyusunan dan Analasis Tes. Bandung: PT Refika Aditama.

Tavakol, M., & Dennick, R. (2011). Making sense of Cronbach’s alpha. International Journal of Medical Education, 2, 53–55. https://doi.org/10.5116/ijme.4dfb.8dfd

Tran, V. D., Dorofeeva, V. V., & Loskutova, E. E. (2018). Development and validation of a scale to measure the quality of patient medication counseling using Rasch model. Pharmacy Practice, 16(4), 1327. https://doi.org/10.18549/PharmPract.2018.04.1327

Vrotsou, K., Subiza-Pérez, M., Lertxundi, A., Vergara, I., Marti-Carrera, I., Ochoa de Retana, L., … Ibarluzea, J. (2023). Environmental health knowledge of healthcare professionals: Instrument development and validation using the Rasch model. Environmental Research, 235, 116582. https://doi.org/10.1016/j.envres.2023.116582

Zeigenfuse, M. D., Batchelder, W. H., & Steyvers, M. (2020). An item response theory model of matching test performance. Journal of Mathematical Psychology, 95, 102327–102327. https://doi.org/10.1016/j.jmp.2020.102327

Zhao, Y., Huen, J. M. Y., & Chan, Y. W. (2017). Measuring Longitudinal Gains in Student Learning: A Comparison of Rasch Scoring and Summative Scoring Approaches. Research in Higher Education, 58(6), 605–616. https://doi.org/10.1007/s11162-016-9441-z

DOI: http://dx.doi.org/10.21043/elementary.v12i1.27841

This work is licensed under a Creative Commons Attribution 4.0 International License.

indexed by:

Elementary : Islamic Teacher Journal by Program Studi PGMI Jurusan Tarbiyah STAIN Kudus is licensed under a Creative Commons Attribution 4.0 International License

Username
Password
Remember me