Detection of potential errors in measurement results of madrasa admission instruments in Indonesia

Ahmad Yusuf, Kusaeri Kusaeri, Ahmad Hidayatullah, Dian Candra Rini Novitasari, Ahmad Hanif Asyhar


Madrasas (Islamic Boarding School) in Indonesia have a strategic role in character building. At present madrasa education is still considered second class education, and to improve the quality of madrasas can be started by improving the quality of the student national admission to all madrassas in Indonesia. This study aims to trace the potential errors in the measurement results of SNPDB MAN-IC (Students National Admission of Madrasah Aliyah Negeri) 2020. Tracing was carried out on 2 aspects: (1) equality between test sets used based on evidence of test responses, and (2) further tests on equality between question sets based on evidence of relationship between variables, taking into account the origin of the participating schools (MTs/JHS) and the origin of the participating regions (West, Central and East of Indonesia). This study involved 13,115 participants in 23 MAN-ICs throughout Indonesia in 2020. The materials tested comprised learning potential and academic ability (Mathematics, Natural Sciences, Social Studies, English, Arabic, and Islamic Religious Education), with Mathematics as a sample of test subjects. Based on the test response evidence, it was found that 7 of the 15 questions were thought to have an indication of inequality between item sets. The results of tracing the evidence between variables indicated that it was the participants' origin of institutions that influenced the inequality between item sets. On the other hand, regional origin did not affect the inequality between item sets because the majority of participants came from the western region of Indonesia.


Admission; Madrasa; Measurement; Potential Errors; Religious Education


F. Alawiyah, “Pendidikan Madrasah di Indonesia,” J. Aspir., vol. 5, no. 1, pp. 51–58, 2014.

K. Kusaeri, “2nd International Conference on Statistics, Mathematics, Teaching, and Research 2017,” J. Phys. Conf. Ser., vol. 1028, p. 011001, Jun. 2018, doi: 10.1088/1742-6596/1028/1/011001.

S. Al-Hasani, A. Ismail, B. Kazeemkayode, and D. Elega, “Creating a Practicing Muslim: A Study of Qawmi Madrasah in Bangladesh,” Br. J. Educ. Soc. Behav. Sci., vol. 20, no. 3, pp. 1–9, May 2017, doi: 10.9734/BJESBS/2017/30910.

B. Lintner, “Religious Extremism and Nationalism in Bangladesh,” p. 24.

R. Lukens-Bull, “Madrasa by any other name: Pondok, pesantren, and islamic schools in Indonesia and larger southeast Asian Region,” J. Indones. Islam, vol. 4, p. 1, 2010, doi: 10.15642/JIIS.2010.4.1.1-21.

K. McClure, “Madrasas and Pakistan’s education agenda: Western media misrepresentation and policy recommendations,”[]/?t2000=026922/(100), vol. 29, 2009, doi: 10.1016/j.ijedudev.2009.01.003.

N. Nizah, “Dinamika Madrasah Diniyah: Suatu Tinjauan Historis (Dynamics Madrasah Diniyah: A Historical Review),” Edukasia J. Penelit. Pendidik. Islam, vol. 11, 2016, doi: 10.21043/edukasia.v11i1.810.

M. Ali and Furqon, “Madrasah Students’ Achievement Study In Indonesia,” Glob. Stoch. Anal., vol. Vol. 3, No, p. 10, 2016.

M. N. Asadullah and N. Chaudhury, “To madrasahs or not to madrasahs: The question and correlates of enrolment in Islamic schools in Bangladesh,” Int. J. Educ. Dev., vol. 49, pp. 55–69, May 2016, doi: 10.1016/j.ijedudev.2016.01.005.

K. Kusaeri and A. Ridho, “Learning outcome of mathematics and science: Features of Indonesian madrasah students,” J. Penelit. dan Eval. Pendidik., vol. 23, pp. 95–105, 2019, doi: 10.21831/pep.v23i1.24881.

A. Muhid, A. Ridho, A. Yusuf, M. Kurjum, M. Thohir, and A. H. Asyhar, “Cognitive and personality test as a predictor of religious education achievement among students of religious program of Islamic schools in Indonesia,” Elem. Educ. Online, vol. 19, no. 4, pp. 2408–2418, 2020, doi: 10.17051/ilkonline.2020.764424.

N. Ahid, “Problem Pengelolaan Madrasah Aliyah dan Solusinya (Madrasah Aliyah Management Problems and Its Solutions),” Islam. J. Stud. Keislam., vol. 4, no. 2, p. 336, May 2014, doi: 10.15642/islamica.2010.4.2.336-353.

R. Hashim, S. A. Rufai, and M. R. M. Nor, “Traditional Islamic education in Asia and Africa: a comparative study ofMalaysia’s Pondok, Indonesia’s Pesantren and Nigeria’s traditional madrasah,” May 2011.

S. Ladbury, “Madrassahs and Islamic education in South Asia: What the donor community needs to know? Report Prepared for the World Bank, South Asia Department,” 2004.

Z. Musthan, “An Effective Leadership Model for Madrasah Principals in Indonesia,” Pertanika J. Soc. Sci. Humanit., vol. 27, pp. 133–147, 2019.

N. Rao and M. Hossain, “Confronting Poverty and Educational Inequalities: Madrasas as a Strategy for Contesting Dominant Literacy in Rural Bangladesh,” Int. J. Educ. Dev., vol. 31, pp. 623–633, 2011, doi: 10.1016/j.ijedudev.2011.01.012.

Kemenag RI, “Seleksi Nasional Peserta Didik Baru (Student National Admission of Madrasa),” May 2020.

R. Jackson, “Cameron, ‘multiculturalism’ and education about religions and beliefs.” May 2011.

M. Sukarno, “Developing Insan Cendikia High School To Address Modernisation, Democracy, And Globalisation Challenges,” J. Kependud. Indones., vol. 9, no. 2, p. 19, 2014.

L. Fagioli, “Is the SAT the Root of all Evil? Reviewing the Evidence on Admission Policies and Diversity in Higher Education,” LUX, vol. 2, no. 1, pp. 1–17, May 2013, doi: 10.5642/lux.201301.15.

Asrijanty, “The Predictive Validity of Scholastic Aptitude Test and Achievement Test as Selection Criteria for University Entrance,” J. Pendidik. dan Kebud., vol. 20, no. 4, p. 515, May 2014, doi: 10.24832/jpnk.v20i4.163.

S. Azwar, “Keputusan seleksi dalam high stake exams: wacana psikometris (Selection decisions in high stake exams: psychometric discourse),” Universitas Gadjah Mada, 2010.

A. Muhid, A. Yusuf, Kusaeri, D. C. R. Novitasari, A. H. Asyhar, and A. Ridho, “Determining scholastic aptitude test as predictors of academic achievement on students of islamic school in indonesia,” New Educ. Rev., vol. 61, pp. 211–221, 2020, doi: 10.15804/tner.2020.61.3.17.

N. J. Dorans, Fairness in Educational Assessment and Measurement, 1st ed. Routledge, 2016.

B. Malau-Aduli, J. Walls, and C. Zimitat, “Validity, Reliability and Equivalence of Parallel Examinations in a University Setting,” Creat. Educ. J., pp. 923–930, 2012.

R. Schumacker, “Test Bias And Differential Item Functioning,” p. 2, 2010.

L. A. Banicky and H. K. Foss, “Assessing student learning. University of Delaware: Delaware Education Research and Development Center,” 2000.

P. T. (US) and N. C. on M. in E. American Educational Research Association, American Psychological Association, Joint Committee on Standards for Educational, Standards for educational and psychological testing-American Educational Research Association. Washington, D.C: American Educational Research Association, 2014.

D. A. Cook, B. Zendejas, S. J. Hamstra, R. Hatala, and R. Brydges, “What counts as validity evidence? Examples and prevalence in a systematic review of simulation-based assessment,” Adv. Heal. Sci. Educ., vol. 19, no. 2, pp. 233–250, Apr. 2014, doi: 10.1007/s10459-013-9458-4.

T. D. Reeves and G. Marbach-Ad, “Contemporary Test Validity in Theory and Practice: A Primer for Discipline-Based Education Researchers,” CBE—Life Sci. Educ., vol. 15, no. 1, p. rm1, Apr. 2016, doi: 10.1187/cbe.15-08-0183.

W. H. Finch and B. F. French, Educational and psychological measurement. New York, NY: Routledge, 2019.

J. Møen and M. Tjelta, “Grading standards, student ability and errors in college admission,” Scand. J. Educ. Res., vol. 54, no. 3, pp. 221–237, 2010, doi: 10.1080/00313831003764503.

D. David and N. Guspendri, “Impact of admission type on students’ achievement in economy and business school of Batusangkar State Institute of Islamic Studies,” J. Penelit. dan Eval. Pendidik., vol. 22, no. 2, pp. 197–207, Dec. 2018, doi: 10.21831/pep.v22i2.22367.

F. A. Montero, A. M. Heráldez, and C. A. López, “Criteria and instruments for doctoral program admission,” Electron. J. Res. Educ. Psychol., vol. 12, no. 3, pp. 853–886, 2014, doi: 10.14204/ejrep.34.13138.

S. Azwar, Metode Penelitian Psikologi (Psychological Research Methods), 2nd ed. Pustaka Pelajar, 2017.

A. Z. Abidin, E. Istiyono, N. Fadilah, and W. S. B. Dwandaru, “A computerized adaptive test for measuring the physics critical thinking skills,” Int. J. Eval. Res. Educ., vol. 8, no. 3, pp. 376–383, 2019, doi: 10.11591/ijere.v8i3.19642.

S. Lailiyah, T. Nusantara, C. Sa’Dijah, E. B. Irawan, Kusaeri, and A. H. Asyhar, “Structuring students’ analogical reasoning in solving algebra problem,” in IOP Conference Series: Materials Science and Engineering, 2018, vol. 296, no. 1, doi: 10.1088/1757-899X/296/1/012029.

K. Kusaeri and A. Aditomo, “Pedagogical Beliefs about Critical Thinking among Indonesian Mathematics Pre-service Teachers,” Int. J. Instr., vol. 12, pp. 573–590, 2019, doi: 10.29333/iji.2019.12137a.

N. Diana, D. Suryadi, and J. A. Dahlan, “Analysis of Students’ Mathematical Connection Abilities in Solving Problem of Circle Material: Transposition Study,” J. Educ. Gift. Young Sci., vol. 8, no. 2, pp. 829–842, Jun. 2020, doi: 10.17478/jegys.689673.

Syaiful, Kamid, and N. Huda, “Identifying of emotional quotient junior high school students in mathematics,” Int. J. Eval. Res. Educ., vol. 10, no. 1, pp. 202–208, 2021, doi: 10.11591/ijere.v10i1.20681.

H. Z. Chan and M. N. L. Y. Abdullah, “Validity and reliability of the Mathematics Self-Efficacy Questionnaire (MSEQ) on primary school students,” Pertanika J. Soc. Sci. Humanit., vol. 26, pp. 2161–2177, 2018.

L. Törnqvist, P. Vartia, and Y. O. Vartia, “How Should Relative Changes be Measured?,” Am. Stat., vol. 39, no. 1, pp. 43–46, Apr. 1985, doi: 10.1080/00031305.1985.10479385.

G. Camilli, “Test fairness,” in Educational measurement, 2006, pp. 221–256.

P. Kline, A handbook of test construction: introduction to psychometric design. London ; New York, NY: Methuen, 1986.

A. T. Fatimah and S. Prabawanto, “Mathematical Understanding and Reasoning of Vocational School Students in Agriculture-Based Mathematical Tasks,” J. Educ. Gift. Young Sci., vol. 8, no. 2, pp. 701–712, Jun. 2020, doi: 10.17478/jegys.702884.

C. Lubienski and S. T. Lubienski, “Charter, Private, Public Schools and Academic Achievement: New Evidence from NAEP Mathematics Data,” p. 48.

A. H. Asyhar et al., “Graph Degree Linkage Clustering for Identify Student’s Performance on Kompetisi Sains Madrasah in Indonesia,” in Smart Trends in Computing and Communications: Proceedings of SmartCom 2020, 2020, pp. 211–220.

D. C. R. Novitasari et al., “Identify Education Quality Based on Islamic Senior High School Data in Kompetisi Sains Madrasah Using Fuzzy C-Means Clustering,” in Smart Trends in Computing and Communications: Proceedings of SmartCom 2020, 2020, pp. 487–495.

A. Yusuf et al., “Identify Elementary Student Distribution Based on Kompetisi Sains Madrasah Data Using Probabilistic Distance Clustering,” in Smart Trends in Computing and Communications: Proceedings of SmartCom 2020, 2020, pp. 281–289.

Kusaeri et al., “Stepwise Iterative Maximum Likelihood Clustering Based on Kompetisi Sains Madrasah’ Scores for Identifying Quality of Junior High School Grading Distribution,” in Smart Trends in Computing and Communications: Proceedings of SmartCom 2020, 2020, pp. 221–229.

S. Nanang, “Jalur Seleksi Masuk PTKIN dan Asal Sekolah dalam Memprediksi Prestasi Belajar Mahasiswa Menggunakan Model Regresi Dummy (PTKIN Admission Test and School Origin in Predicting Student Learning Achievement Using the Dummy Regression Model),” Al-Jabar, vol. 10, no. 02, Apr. 2018.

F. A. Yahya, “Problem Manajemen Pesantren, Sekolah Dan Madrasah: Problem Mutu dan Kualitas Input-Proses-Output (Pesantren, School And Madrasah Management Problems: Quality and Input-Process-Output Quality Problems),” el-Tarbawi, vol. 8, no. 1, pp. 93–109, Apr. 2015.

G. N. Marks, “Demographic and socioeconomic inequalities in student achievement over the school career,” Aust. J. Educ., vol. 58, no. 3, pp. 223–247, Nov. 2014, doi: 10.1177/0004944114537052.

M. H. Davis, S. Capobianco, and L. A. Kraus, “Measuring Conflict-Related Behaviors: Reliability and Validity Evidence Regarding the Conflict Dynamics Profile,” Educ. Psychol. Meas., vol. 64, no. 4, pp. 707–731, Aug. 2004, doi: 10.1177/0013164404263878.



  • There are currently no refbacks.

Copyright (c) 2021 Institute of Advanced Engineering and Science

International Journal of Evaluation and Research in Education (IJERE)
p-ISSN: 2252-8822, e-ISSN: 2620-5440

View IJERE Stats

Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.