Development of science literacy competency evaluation instruments on human circulatory topic

Esty Setyo Utaminingsih, Ellianawati Ellianawati, Sri Sumartiningsih, FR Wuriningsih, Maria Ayu Puspita

Abstract


Teachers in elementary schools have not developed many science literacy problems so the science literacy competence of students has not been evaluated clearly and accurately. The purpose of this study is to develop a science literacy evaluation instrument and find out the feasibility of the developed instrument. The development of instruments in this study used a combination of Wilson and Oriondo and Antonio models. The instrument development steps include (1) test design, (2) test trials, and (3) test assembly. The sample number is 31 students. The sampling technique used is random sampling. The content validation test by four experts based on the Aiken assessment formula obtained a validity value of 0.9813 which means it is declared "valid" or worthy of use. Instrument validation is empirically declared "valid" and has an r value above 0.355. The value of all items is declared reliable with multiple-choice questions having a reliable value of 0.743, short-fill questions 0.744, and description questions 0.738. The results of the difference power analysis, the value of the Corrected Item-Total Correlation does not exceed the value of Cronbach's Alpha Item Deleted and has a "good" difference power interpretation value. Analysis of the difficulty level of the question items shows that the questions vary with the ideal level of difficulty with an easy comparison: medium: difficult which is 3: 5: 2. It can be concluded that overall the science literacy question items are in good condition and feasible for measuring students' science literacy competence.

Full Text:

PDF

References


Adnan, Mulbar, U., Sugiarti, & Bahri, A. (2021). Biology Science Literacy of Junior High School Students in South Sulawesi, Indonesia. Journal of Physics: Conference Series, 1752(1). https://doi.org/10.1088/1742-6596/1752/1/012084

Afriana, J., Permanasari, A., & Fitriani, A. (2016). Project based learning integrated to stem to enhance elementary school’s students scientific literacy. Jurnal Pendidikan IPA Indonesia, 5(2), 261–267. https://doi.org/10.15294/jpii.v5i2.5493

Ahied, M., Muharrami, L. K., Fikriyah, A., & Rosidi, I. (2020). Improving students’ scientific literacy through distance learning with augmented reality-based multimedia amid the covid-19 pandemic. Jurnal Pendidikan IPA Indonesia, 9(4), 499–511. https://doi.org/10.15294/jpii.v9i4.26123

Aiken, L. R. (1985). Three coefficients for analyzing the reliability and validity of ratings, Educational and Psychological Measurument. Journal Articles; Reports - Research; Numerical/Quantitative Data, 45(1), 131–142.

Amaringga, N. G., Amin, M., & Irawati, M. H. (2021). The effect of problem-based learning module containing research result to improve students’ scientific literacy. AIP Conference Proceedings, 2330(March). https://doi.org/10.1063/5.0043529

Arsi, A. (2021). Realibilitas Instrumen Dengan Menggunakan Spss. Validitas Realibilitas Instrumen Dengan Menggunakan Spss, 1–8. https://osf.io/m3qxs

Astuti, A. T., Supahar, Mundilarto, & Istiyono, E. (2020). Development of assessment instruments to measure problem solving skills in senior high school. Journal of Physics: Conference Series, 1440(1). https://doi.org/10.1088/1742-6596/1440/1/012063

Bahri, S., Simbolon, M., & Alhad, K. (2021). Development of Assessment Instrument of Scientific Literacy Ability for Students at Musamus University. Advances in Social Science, Education and Humanities Research Proceedings of the International Joined Conference on Social Science (ICSS 2021), 603(Icss), 395–398.

Bartimote-Aufflick, K., Bridgeman, A., Walker, R., Sharma, M., & Smith, L. (2016). The study, evaluation, and improvement of university student self-efficacy. Studies in Higher Education, 41(11), 1918–1942. https://doi.org/10.1080/03075079.2014.999319

Bashooir, K., & Supahar. (2018). Validitas dan reliabilitas instrumen asesmen kinerja literasi sains pelajaran Fisika berbasis STEM. Jurnal Penelitian Dan Evaluasi Pendidikan, 22(2), 168–181. https://doi.org/10.21831/pep.v22i2.20270

Bucchi, M., & Saracino, B. (2016). “Visual Science Literacy”: Images and Public Understanding of Science in the Digital Age. Science Communication, 38(6), 812–819. https://doi.org/10.1177/1075547016677833

Chung, C. C., Huang, S. L., Cheng, Y. M., & Lou, S. J. (2022). Using an iSTEAM project-based learning model for technology senior high school students: Design, development, and evaluation. In International Journal of Technology and Design Education (Vol. 32, Issue 2). Springer Netherlands. https://doi.org/10.1007/s10798-020-09643-5

Ding, C. (2022). Examining the context of better science literacy outcomes among U.S. schools using visual analytics: A machine learning approach. International Journal of Educational Research Open, 3(April), 100191. https://doi.org/10.1016/j.ijedro.2022.100191

Fakhriyah, F., Masfuah, S., Roysa, M., Rusilowati, A., & Rahayu, E. S. (2017). Student’s science literacy in the aspect of content science? Jurnal Pendidikan IPA Indonesia, 6(1), 81–87. https://doi.org/10.15294/jpii.v6i1.7245

Febriyanti, D. F., & Sari, P. M. (2022). Pengembangan Media Pembelajaran Berbasis Literasi Sains Menggunakan Software Ispring Suite 9 pada Pembelajaran IPA. Jurnal Basicedu, 6(4), 6620–6629. https://doi.org/10.31004/basicedu.v6i4.3323

Flores, C. (2018). Problem-based science, a constructionist approach to science literacy in middle school. International Journal of Child-Computer Interaction, 16, 25–30. https://doi.org/10.1016/j.ijcci.2017.11.001

Gurses, A., Gunes, K., Barin, T. B., Eroglu, Z., & Cozel, F. S. (2015). Relation Between Pre-Service Chemistry Teachers’ Science Literacy Levels and Their Some Scientific Process Skills. Procedia - Social and Behavioral Sciences, 197(February), 2395–2402. https://doi.org/10.1016/j.sbspro.2015.07.300

Herlina, Sartono, B., & Susetyo, B. (2020). Kajian Validitas Instrumen Pengukuran Skala. Indonesian Journal of Statistics and Its Applications, 4(1), 136–155.

Ilmi, R., Arnawa, I. M., Yerizon, & Bakar, N. N. (2021). Development of an Android-Based for Math E-Module by using Adobe Flash Professional CS6 for Grade X Students of Senior High School. Journal of Physics: Conference Series, 1742(1). https://doi.org/10.1088/1742-6596/1742/1/012026

Janna, N. M., & Herianto. (2021). Artikel Statistik yang Benar. Jurnal Darul Dakwah Wal-Irsyad (DDI), 18210047, 1–12.

Jiananda, A. (2017). Pengembangan Instrumen Penilaian Proyek Mind Mapping untuk Mengukur Penguasaan Konsep Fisika dan Keterampilan Berpikir Kreatif Development of Mind Mapping Project Assessment Instruments to Measure Mastery of Physics Concepts and Creative Thinking Skills. 1–5.

Kalkan, Ö. K., Altun, A., & Atar, B. (2020). Role of teacher-related factors and educational resources in science literacy: An international perspective. Studies in Educational Evaluation, 67(August). https://doi.org/10.1016/j.stueduc.2020.100935

Kasse, F., Ragil, I., Atmojo, W., Maret, U. S., Thinking, C., Solving, P., & Education, J. (2022). Analisis kecakapan abad 21 melalui literasi sains pada siswa sekolah dasar. 10(1), 124–128.

Khasanah, Q., Prasasti, P. A. T., & Kusumawati, N. (2022). Kelayakan E-Modul Berbasis T-PACK Dalam Memberdayakan Literasi Sains Pada Siswa Kelas IV SDN Pilangbango. Prosiding Konferensi …, 3. http://prosiding.unipma.ac.id/index.php/KID/article/view/3162%0Ahttp://prosiding.unipma.ac.id/index.php/KID/article/download/3162/2510

Kurniawati, T. D., Akhdinirwanto, R. W., & Fatmaryanti, S. D. (2021). Pengembangan E-Modul Menggunakan Aplikasi 3D PageFlip Professional Untuk Meningkatkan Kemampuan Literasi Sains Peserta Didik. Jurnal Inovasi Pendidikan Sains (JIPS), 2(1), 32–41. https://doi.org/10.37729/jips.v2i1.685

Laliyo, L. A. R., Tangio, J. S., Sumintono, B., Jahja, M., & Panigoro, C. (2020). Analytic Approach of Response Pattern of Diagnostic Test Items in Evaluating Students ’ Conceptual Understanding of Characteristics of Particle of Matter. Journal of Batlic Science Education, 19(5), 824–841.

Landis, J. R., & Koch, G. G. (1977). Landis amd Koch1977_agreement of categorical data. Biometrics, 33(1), 159–174.

Lawless, K. A., Brown, S. W., Rhoads, C., Lynn, L., Newton, S. D., Brodowiksa, K., Oren, J., Riel, J., Song, S., & Wang, M. (2018). Promoting students’ science literacy skills through a simulation of international negotiations: The GlobalEd 2 Project. Computers in Human Behavior, 78, 389–396. https://doi.org/10.1016/j.chb.2017.08.027

Li, L., Shi, J., Wu, D., & Li, H. (2020). Only child, parental educational expectation, self-expectation and science literacy in Zhuang adolescents in China: A serial mediation model. Children and Youth Services Review, 115(May), 105084. https://doi.org/10.1016/j.childyouth.2020.105084

Magdalena, I., Fauziah, S. N., Faziah, S. N., & Nupus, F. S. (2021). Analisis Validitas, Reliabilitas, Tingkat Kesulitan Dan Daya Beda Butir Soal Ujian Akhir Semester Tema 7 Kelas Iii Sdn Karet 1 Sepatan. BINTANG : Jurnal Pendidikan Dan Sains, 3(2), 198–214. https://ejournal.stitpn.ac.id/index.php/bintang

McComas, W. F. (2019). Programme for International Student Assessment (PISA). In OECD. https://doi.org/10.1007/978-94-6209-497-0_69

Moleong, L. J. (2017). Metodelogi Penelitian Kualitatif. PT Remaja Rosdakarya Offset.

Muthmainnah, & Istiyono, E. (2019). Constructing Reasoning Multiple Choice Test to Measure Bloomian Higher Order Thinking Skills in Physics of XI Grade Students. Journal of Physics: Conference Series, 1233(1). https://doi.org/10.1088/1742-6596/1233/1/012037

Nani, F. (2021). Analisis Tingkat Kesukaran, Daya Pembeda, Dan Efektivitas Pengecoh Soal Pelatihan Kewaspadaan Kegawatdaruratan Maternal Dan Neonatal. Paedagoria : Jurnal Kajian, Penelitian Dan Pengembangan Kependidikan, 12(2), 199–205.

Noroozi, O., & Mulder, M. (2017). Design and evaluation of a digital module with guided peer feedback for student learning biotechnology and molecular life sciences, attitudinal change, and satisfaction. Biochemistry and Molecular Biology Education, 45(1), 31–39. https://doi.org/10.1002/bmb.20981

Novalia, & Syazali, M. (2014). Olah Data Penelitian Pendidikan. Aura Publishing.

Payadnya, I. P. A. A., & Jayantika, I. G. A. N. T. (2018). Panduan Penelitian Eksperimen Beserta Analisis Statistik Dengan SPSS. Deepublish.

Polit, D. F., & Beck, C. T. (2006). The Content Validity Index: Are You Sure You Know What’s Being Reported? Critique and Recommendations. ResearchinNursing&Health, 29, 489–497. https://doi.org/10.1002/nur

Polit, D. F., Beck, C. T., & Owen, S. V. (2007). Focus on Research Methods Handling Missing Data in Self-Report Measures. ResearchinNursing&Health, 30, 459–467. https://doi.org/10.1002/nur

Pomalato, S. W. D., Ismail, R., Amin Otoni Harefa, Imawan, O. R., Ningsi, B. A., & Wulandar, D. (2021). Instrument test development of mathematics skill on elementary school. Mathematics and Statistics, 9(2), 106–111. https://doi.org/10.13189/ms.2021.090204

Pratiwiningtyas, B. N., Susilaningsih, E., & Sudana, I. M. (2017). Pengembangan Instrumen Penilaian Kognitif untuk Mengukur Literasi Membaca Bahasa Indonesia Berbasis Model Pirls pada Siswa Kelas IV SD. Journal of Educational Research and Evaluation, 6(1), 1–9. http://journal.unnes.ac.id/sju/index.php/jere

Qadar, R., Haryanto, Z., Subagiyo, L., Junus, M., & Syam, M. (2022). Indonesian Science Teachers’ Ability to Design Scientific Literacy Test. International Journal of STEM Education for Sustainability, 2(1), 133–139. https://doi.org/10.53889/ijses.v2i1.52

Rofiyadi, Y. A., & Handayani, S. L. (2021). Pengembangan Aplikasi E-Modul Interaktif Berbasis Android Materi Sistem Peredaran Darah Manusia Kelas V Sekolah Dasar. JPDI (Jurnal Pendidikan Dasar Indonesia), 6(2), 54. https://doi.org/10.26737/jpdi.v6i2.2575

Rohana, I. N., Rusilowati, A., & Khumaedi. (2018). Pengembangan Tes untuk Mengukur Kemampuan Literasi Sains Siswa SMP pada Materi Getaran dan Gelombang. UPEJ Unnes Physics Education Journal, 7(3), 1–10.

Rokhmah, A., Sunarno, W., & Masykuri, M. (2017). Science Literacy Indicators in Optical Instruments of Highschool Physics Textbooks Chapter. Jurnal Pendidikan Fisika Indonesia, 13(1), 19–24. https://doi.org/10.15294/jpfi.v13i1.8391

Rusilowati, A. (2018). Asesmen Literasi Sains: Analisis Karakteristik Instrumen dan Kemampuan Siswa Menggunakan Teori Tes Modern Rasch Model. Prosiding Seminar Nasional Fisika Universitas Riau Ke-3, September, 2–15. https://snf.fmipa.unri.ac.id/wp-content/uploads/2019/03/0.-300B-2-15NI.pdf

Schleicher, A. (2018). PISA 2018: Insight and Interpretations. In OECD.

Septiani, A. D., Sjaifuddin, S., & Berlian, L. (2022). Pengembangan Instrumen Evaluasi Tes Two-Tier Multiple Choice Berbasis Literasi Sains Siswa Kelas VII Pada Tema Hujan Asam. Biodik, 8(1), 167–174. https://doi.org/10.22437/bio.v8i1.17305

Solichin, M. (2017). Analisis Daya Beda Soal, Taraf Kesukaran, Validitas Butir Tes, Interpretasi Hasil Tes dan Validitas Ramalan dalam Evaluasi Pendidikan. Dirasat: Jurnal Manajemen & Pendidikan Islam, 2(2), 192–213. www.depdiknas.go.id/evaluasi-proses-

Sultan, A. Al, Jr, H. H., & Lickteig, D. (2021). Assessing preservice elementary teachers’ conceptual understanding of scientific literacy. Teaching and Teacher Education, 102, 103327. https://doi.org/10.1016/j.tate.2021.103327

Suparya, I. K., I Wayan Suastra, & Putu Arnyana, I. B. (2022). Rendahnya Literasi Sains: Faktor Penyebab Dan Alternatif Solusinya. Jurnal Ilmiah Pendidikan Citra Bakti, 9(1), 153–166. https://doi.org/10.38048/jipcb.v9i1.580

Susanto, H., Rinaldi, A., & Novalia. (2015). Analisis Validitas Reabilitas Tingkat Kesukaran dan Daya Beda pada Butir Soal Ujian Akhir Semester Ganjil Mata Pelajaran Matematika. The Journal of the Japan Society for Respiratory Endoscopy, 37(3), 343.

Trémolière, B., & Djeriouat, H. (2021). Exploring the roles of analytic cognitive style, climate science literacy, illusion of knowledge, and political orientation in climate change skepticism. Journal of Environmental Psychology, 74(January). https://doi.org/10.1016/j.jenvp.2021.101561

Ulva, T. S., Samitra, D., & Kusnanto, R. A. B. (2021). Pengembangan Instrumen Tes Literasi Sains pada Tema 8 Lingkungan Sahabat Kita untuk Siswa Sekolah Dasar. Jurnal Basicedu, 6(4), 7174–7187. https://doi.org/10.31004/basicedu.v5i4.1230

Utami, R. T., & Desstya, A. (2021). Analisis Cakupan Literasi Sains dalam Buku Siswa Kelas V Tema 4 Karya Ari Subekti di Sekolah Dasar. Jurnal Basicedu, 5(6), 5001–5013. https://doi.org/10.31004/basicedu.v5i6.1556

Utaminingsih, E. S. (2023). Pengembangan E-Modul Berbasis STEAM Topik Peredaran Darah Manusia untuk Meningkatkan Literasi Sains dan Karakter Pelajar Pancasila. Universitas Negeri Semarang.

Utaminingsih, E. S., Ellianawati, E., Sumartiningsih, S., & Puspita, M. A. (2023). STEAM Education. Jurnal Ilmiah Profesi Pendidikan, 8(3), 1605–1612.

Utaminingsih, E. S., Ellianawati, E., Widiarti, N., Sumartiningsih, S., & Puspita, M. A. (2023). A Systematic Review : Digital Literacy for Strenghthening Character in Facing the Era of Society 5.0. Research and Development Journal Of Education, 9(2), 638–647.

Utaminingsih, E. S., & Puspita, M. A. (2023). Emotional Intelligence and Its Important Role. Jurnal Ilmiah Profesi Pendidikan, 8(November 2021), 2003–2011.

Utaminingsih, E. S., Raharjo, T. J., & Ellianawati. (2023). Development of an E-module Based on STEAM on the Topic of Human Blood Circulation. Jurnal Penelitian Pendidikan IPA, 9(7), 5333–5340. https://doi.org/10.29303/jppipa.v9i7.3719

UZ, L. Z., Haryono, & Wardani, S. (2019). The Development of Chemical E-Module Based on Problem of Learning to Improve The Concept of Student Understanding Article Info. Innovative Journal of Curriculum and Educational Technology, 8(2), 59–66. https://journal.unnes.ac.id/sju/index.php/ujet/article/view/31340




DOI: http://dx.doi.org/10.21043/thabiea.v7i1.24091

Refbacks

  • There are currently no refbacks.