Development and Validation of Local Context-Based Literacy and Numeracy Instruments for the Sekolah Sepanjang Hari (SSH) Program

Quin Donspri Tulalessy; Achmad Rante  Suparman; Helena Trivona  Turirday; Kaleb Amaghi  Yenusi

doi:10.62775/edukasia.v7i1.1789

Authors

Quin Donspri Tulalessy Universitas Papua
Achmad Rante Suparman Universitas Papua https://orcid.org/0000-0003-3734-8919
Helena Trivona Turirday Universitas Papua
Kaleb Amaghi Yenusi Universitas Papua

DOI:

https://doi.org/10.62775/edukasia.v7i1.1789

Keywords:

Confirmatory Factor Analysis, construct validity, literacy, numeracy, sekolah sepanjang hari (SSH)

Abstract

This This study aims to develop and validate a basic literacy and numeracy assessment instrument for participants in the Sekolah Sepanjang Hari Program (SSH) in South Sorong Regency, for both regular students and dropouts. The instrument is designed to map Reading, writing, and numeracy skills as the foundation for lifelong learning. Development was carried out through four stages: theoretical construct analysis, expert content validation, field trials, and construct validity analysis using Confirmatory Factor Analysis (CFA). The content validation results showed an average Content Validity Index (CVI) of 0.92, indicating a high fit between the test items and the constructs. A pre-test on 30 students was used to refine the language and local context, while the main pre-test on 145 students ensured proportional levels of readability and difficulty. The CFA results confirmed a three-dimensional structure with perfect model fit (CFI = 1.000; TLI = 1.005; RMSEA = 0.000; SRMR = 0.043; GFI = 0.939). The factor loading values of 0.67–0.92, composite reliability of 0.899–0.918, and AVE of 0.598–0.653 indicate strong validity and reliability. This instrument has been proven feasible and contextually relevant, making it suitable for diagnostic assessment of students’ basic abilities in non-formal education, especially in the 3T regions

Downloads

Download data is not yet available.

References

Afriansyah, A. (2022). Refleksi dua puluh tahun pembangunan pendidikan di tanah Papua (2001-2021). Masyarakat Indonesia, 48(1), 63–77. https://doi.org/10.14203/jmi.v48i1.1170

Ajmal, M., & Hussain, J. (2022). Comparative Analysis of Literacy Skills, Writing and Numeracy Attained by the Students of Formal and Non-Formal Schools at Primary Level in Islamabad Capital Territory. Bulletin of Education & Research, 44(1), 23–38.

Azizah, S. (2022). The 21st century skillsthrough literacy and numeracyat public junior high schools in pamekasan madura. Proceedings of the 6thInternational Conference on Islamic Studies (ICONIS), 13–18. https://doi.org/10.19105/iconis.v6i.590

Azwar, S. (2013). Reliabilitas dan validitas (Keenam). Pustaka Pelajar.

Blanton, M. L., & Kaput, J. J. (2004). Elementary Grades Students’ Capacity for Functional Thinking. Proceedings of the 28th Conference of the International Group for the Pyschology of Mathematics Education, 2, 135–142.

Christianti, M., Retnowati, T. H., Wening, S., Hasan, A., & Ratnawati, H. (2022). Early Literacy Assessment among Kindergarten Teachers in Indonesia: A Phenomenological Study. European Journal of Educational Research, 11(4), 2401–2411. https://doi.org/10.12973/eu-jer.11.4.2401

Citrawan, I. W., Widana, I. W., Sumandya, I. W., Widana, I. N. S., Mukminin, A., Arief, H., Razak, R. A., Hadiana, D., & Meter, W. (2024). Special education teachers’ ability in literacy and numeracy assessments based on local wisdom. Mathematics and Science Education, 8(1). https://doi.org/10.22437/jiituj.v8i1.32608

Cornick, J. E. (2015). Factor structure of the exercise self-efficacy scale. Measurement in Physical Education and Exercise Science, 19(4), 208–218. https://doi.org/10.1080/1091367X.2015.1074579

Cui, Y., Chen, F., Lutsyk, A., Leighton, J. P., & Cutumisu, M. (2023). Data literacy assessments: a systematic literature review. Assessment in Education: Principles, Policy & Practice, 30(1), 76–96. https://doi.org/10.1080/0969594X.2023.2182737

Dagnall, N., Denovan, A., Parker, A., Drinkwater, K., & Stephen Walsh, R. (2018). Confirmatory factor analysis of the inventory of personality organization-reality testing subscale. Frontiers in Psychology, 9(Article 1116), 1–12. https://doi.org/10.3389/fpsyg.2018.01116

Datchuk, S. M., & Dembek, G. A. (2018). Adapting a Sentence Intervention with Spelling and Handwriting Support for Elementary Students with Writing Difficulties: A Preliminary Investigation. Insights into Learning Disabilities, 15(1), 7–27.

Dini, N. A. I., & Kuswanto, H. (2025). Integrating local wisdom: Innovative assessment instrument of critical thinking skills in science learning. Jurnal Eduscience (JES), 12(3), 621–630. https://doi.org/10.36987/jes.v12i3.6849

Dockrell, J. E., Connelly, V., & Arfè, B. (2019). Struggling writers in elementary school: Capturing drivers of performance. Learning and Instruction, 60, 75–84. https://doi.org/10.1016/j.learninstruc.2018.11.009

Ellemor-Collins, D., Wright, R., & Lewis, G. (2007). Documenting the Knowledge of Low-Attaining Third- and Fourth-Graders: Robyn’s and Bel’s Sequential Structure and Multidigit Addition and Subtraction. Proceedings of the 30th Annual Conference of the Mathematics Education Research Group of Australasia, Hobart, 1(1), 265–274. https://doi.org/10.7326/M18-0336

Geiger, V., Goos, M., & Forgasz, H. (2015). A rich interpretation of numeracy for the 21st century: a survey of the state of the field. ZDM Mathematics Education, 47(4), 531–548. https://doi.org/10.1007/s11858-015-0708-1

Ghozali, I., & Fuad. (2008). Structural equation modeling: teori, konsep, dan aplikasi dengan program lisrel 8.80. Badan Penerbit Universitas Diponegoro.

Gordon, E. W., & Campbell, E. B. (2014). Context and perspective: Implications for assessment in education. Teachers College Record, 116(11), 1–18. https://doi.org/10.1177/016146811411601103

Grotlüschen, A., Desjardins, R., & Liu, H. (2020). Literacy and numeracy: Global and comparative perspectives. International Review of Education, 66(2), 127–137. https://doi.org/10.1007/s11159-020-09854-x

Hanemann, U. (2015). Lifelong literacy: Some trends and issues in conceptualising and operationalising literacy from a lifelong learning perspective. International Review of Education, 61(3), 295–326. https://doi.org/10.1007/s11159-015-9490-0

Harris, K. R., Graham, S., Aitken, A. A., Barkel, A., Houston, J., & Ray, A. (2017). Teaching Spelling, Writing, and Reading for Writing: Powerful Evidence-Based Practices. Teaching Exceptional Children, 49(4), 262–272. https://doi.org/10.1177/0040059917697250

Huber, S., Fischer, U., Moeller, K., & Nuerk, H.-C. (2013). On the interrelation of multiplication and division in secondary school children. Frontiers in Psychology, 4. https://doi.org/10.3389/fpsyg.2013.00740

Istiyono, E. (2018). Pengembangan instrumen penilaian dan analisis hasil belajar fisika (Pertama). UNY Press.

Kementerian Pendidikan, Kebudayaan Riset, dan T. (2023). Laporan hasil asesmen nasional 2023: Literasi membaca dan numerasi. Badan Standar, Kurikulum, dan Asesmen Pendidikan (BSKAP), Kemendikbudristek. https://pusmendik.kemdikbud.go.id

Kwahk, K. Y., & Lee, J. N. (2008). The role of readiness for change in ERP implementation: Theoretical bases and empirical validation. Information and Management, 45(7), 474–481. https://doi.org/10.1016/j.im.2008.07.002

Lembke, E., Deno, S. L., & Hall, K. (2003). Identifying an Indicator of Growth in Early Writing Proficiency for Elementary School Students. Assessment for Effective Intervention, 28(4), 23–35. https://doi.org/10.1177/073724770302800304

Liljedahl, P. (2004). Repeating pattern or number pattern: The distinction is blurred. Focus on Learning Problems in Mathematics, 26(3), 24–42.

Ma, Y., Xie, S., Wang, Y., & McDougall, D. (2020). Analysis of Students’ Systematic Errors and Teaching Strategies for 3-Digit Multiplication. In S. C. Zhu, S. Xie, Y. Ma, & D. McDougall (Eds.), Reciprocal Learning for Cross-Cultural Mathematics Education : A Partnership Project Between Canada and China (pp. 159–182). Springer International Publishing. https://doi.org/10.1007/978-3-030-56838-2_9

Maharani, K., Effendi, M. M., & Nurjaman, A. (2020). Analisis tingkat ketercapaian angka partisipasi sekolah di papua (studi kasus di kabupaten merauke). Jurnal Kebijakan Dan Pengembangan Pendidikan, 7(2). https://doi.org/10.22219/jkpp.v7i2.12046

Mahpop, H. bin, & Sivasubramaniam, P. (2010). Addition of Whole Numbers with Regrouping using the “Soroban.” Procedia - Social and Behavioral Sciences, 8, 50–56. https://doi.org/10.1016/j.sbspro.2010.12.007

Mardapi, D. (2018). Teknik penyusunan instrumen tes dan nontes. Parama Publishing.

Marsh, H. W., Balla, J. R., & Mcdonald, R. P. (1988). Goodness-of-fit indexes in confirmatory factor analysis: The effect of sample size. Psychological Bulletin, 103(3), 391–410. https://doi.org/10.1037/0033-2909.103.3.391

Mauhibah, R., & Karso, K. (2020). Student Difficulties in Addition and Subtraction of Two Digit Numbers. International Conference on Elementary Education, 2(1), 618–623.

McComas, W. F. (2014). Programme for International Student Assessment (PISA). In W. F. McComas (Ed.), The Language of Science Education: An Expanded Glossary of Key Terms and Concepts in Science Teaching and Learning (p. 79). SensePublishers. https://doi.org/10.1007/978-94-6209-497-0_69

Moon, G., Aitken, G., Roderick, P., Fraser, S., & Rowlands, G. (2015). Towards an understanding of the relationship of functional literacy and numeracy to geographical health inequalities. Social Science & Medicine, 143, 185–193. https://doi.org/10.1016/j.socscimed.2015.08.045

Mulligan, J. T., & Mitchelmore, M. C. (1997). Young Children’s Intuitive Models of Multiplication and Division. Journal for Research in Mathematics Education JRME, 28(3), 309–330. https://doi.org/10.5951/jresematheduc.28.3.0309

Naumann, S., Byrne, M. L., de la Fuente, A., Harrewijn, A., Nugiel, T., Rosen, M., van Atteveldt, N., & Matusz, P. J. (2022). Assessing the degree of ecological validity of your study: Introducing the multidimensional assessment of research in context (MARC) tool. Mind, Brain, and Education, 16(3), 228–238. https://doi.org/10.1111/mbe.12318

Novia, F., Nurdianti, D., & Purwanto, M. B. (2024). English learning and innovation skills in 21st: Implementation of critical thinking, creativity, communication, and collaboration. Asian Journal of Applied Education (AJAE), 3(2), 113–124. https://doi.org/10.55927/ajae.v3i2.8318

OECD. (2019). PISA 2018 results (volume I): What students know and can do. OECD Publishing. https://doi.org/10.1787/5f07c754-en

Piasta, S. B., Park, S., Fitzgerald, L. R., & Libnoch, H. A. (2022). Young children’s alphabet learning as a function of instruction and letter difficulty. Learning and Individual Differences, 93, 102113. https://doi.org/10.1016/j.lindif.2021.102113

Pusmendik Kemdikbud. (2022). Komponen, Level, Domain, Subdomain, Kompetensi dan Contoh Soal. https://pusmendik.kemdikbud.go.id/an/asesmen_kompetensi_minimum/view/literasi-membaca

Retnawati, H. (2017). Validitas reliabilitas & karakteristik butir. Parama Publishing.

Ritchey, K. D. (2008). The building blocks of writing: Learning to write letters and spell words. Reading and Writing, 21(1), 27–47. https://doi.org/10.1007/s11145-007-9063-0

Saifullah, & Yawan, H. (2022). Poverty and students’ academic achievement in Papua, Indonesia. International Journal of Indonesian Education and Teaching, 6(2), 341–350. https://doi.org/10.24071/ijiet.v6i2.4457

Starkey, G. S., & McCandliss, B. D. (2014). The emergence of “groupitizing” in children’s numerical cognition. Journal of Experimental Child Psychology, 126, 120–137. https://doi.org/10.1016/j.jecp.2014.03.006

Strong, J. Z., Amendum, S. J., & Conradi Smith, K. (2018). Supporting Elementary Students’ Reading of Difficult Texts. The Reading Teacher, 72(2), 201–212. https://doi.org/10.1002/trtr.1702

Sülükçü, Y., & Kırboga, A. (2020). A study on the punctuation knowledge levels of freshmen students. Journal of Language and Linguistic Studies, 16(2), 684–710. https://doi.org/10.17263/jlls.759273

Sumandya, I. W., Mukminin, A., Widana, I. W., Suryawan, I. P. P., Dewi, N. W. D. P., Hendra, R., & Yaakob, M. F. M. (2025). Development of an instrument to measure students’ and teachers’ perceptions of understanding by design-based mathematics learning evaluation in inclusive schools. Discover Sustainability, 6(1), 797. https://doi.org/10.1007/s43621-025-01514-0

Suparman, A. R., Rohaeti, E., & Wening, S. (2022). Development of attitude assessment instruments towards socioscientific issues in chemistry learning. European Journal of Educational Research, 11(4), 1947–1958. https://doi.org/10.12973/eujer.11.4.1947

Suparman, A. R., Rohaeti, E., & Wening, S. (2024). Development of computer-based chemical five-tier diagnostic test instruments: A generalized partial credit model. Journal on Efficiency and Responsibility in Education and Science, 17(1), 91–105. https://doi.org/10.7160/eriesj.2024.170108

Tavşanlı, Ö. F., & Kara, Ü. E. (2021). The Effect of a Peer and Self-Assessment-Based Editorial Study on Students’ Ability to Follow Spelling Rules and Use Punctuation Marks Correctly. Participatory Educational Research, 8(3), 268–284. https://doi.org/10.17275/per.21.65.8.3

Thi, H. C., Le, T. A., Ngoc, B. T., & Phuong, T. P. T. (2023). Factors affecting the numeracy skills of students from mountainous ethnic minority regions in Vietnam: Learners’ perspectives. Cogent Education, 10(1). https://doi.org/10.1080/2331186X.2023.2202121

Wildmon, M. E., Skinner, C. H., McCurdy, M., & Sims, S. (1999). Improving secondary students’ perception of the “dreaded mathematics word problem assignment” by giving them more word problems. Psychology in the Schools, 36(4), 319–325. https://doi.org/10.1002/(SICI)1520-6807(199907)36:4<319::AID-PITS5>3.0.CO;2-T

Wilkins, J. L. M., Woodward, D., & Norton, A. (2021). Children’s number sequences as predictors of later mathematical development. Mathematics Education Research Journal, 33(3), 513–540. https://doi.org/10.1007/s13394-020-00317-y

Yasukawa, K., Brown, T., & Black, S. (2013). Production workers’ literacy and numeracy practices: using cultural-historical activity theory (CHAT) as an analytical tool. Journal of Vocational Education & Training, 65(3), 369–384. https://doi.org/10.1080/13636820.2013.820214