Development of Higher Order Thinking Skill Assessment Instruments in Learning Indonesian History

johan setiawan, ajat sudrajat, aman aman, dyah kumalasari


This study aims to: (1) produce Higher Order Thinking Skill (HOTS) assessment instruments in learning Indonesian history, (2) know the validity of HOTS assessment instruments in learning Indonesian history, (3) find out the characteristics of HOTS questions in learning Indonesian history. This study uses the research and development method of the Borg and Gall model. Validation was carried out by two Indonesian history learning assessment experts and three Indonesian history teachers. The HOTS test item was conducted on 36 students in class XI of 2 Ngaglik State Senior High School. Data analysis includes tests of validity, reliability, level of difficulty, distinguishing features and deception index. The results of the study: (1) the HOTS assessment instrument of multiple choice questions consisted of 25 items, (2) the results of the HOTS question validation by two Indonesian history learning assessment experts on the material, construction and language aspects were valid and appropriate. The results of the validation by three Indonesian history teachers also stated that the assessment instruments were valid and appropriate, (3) the characteristics of HOTS questions had fulfilled the validity criteria of 23 questions, reliability with a coefficient of 0.97 (very strong), the average difficulty level is 0.33 (moderate), the average differentiation test is 0.42 (good), and the average deception index is 0.56 (good).


Assessment instruments; Higher order thinking skill; Indonesian history learning


Chalkiadaki, A., “A systematic literature review of 21st century skills and competencies in primary education. International Journal of Instruction, vol. 11, no. 3, pp. 1-16, 2018.

Conklin, W., “Higher order thinking skills to develop 21 century learners. Huntington Beach,” California: Shell Education, 2012.

Quieng, M. C., Lim, P. P., & Lucas, M. R. D., “21st century-based soft skills: Spotlight on non-cognitive skills in a cognitive-laden dentistry program,” European Journal of Contemporary Education, vol. 11, no. 1, pp.72-81, 2015.

Chinedu, C.C., & Kamin, Y., “Strategies for improving higher order thinking skill in teaching and learning of design and tecnology education,” Journal of Technical Education and Training, vol. 7, no. 2, pp. 35-43, 2015

Wang, S., & Wang, H., “Teaching and learning higher-order thinking,” International Journal of Arts & Sciences, vol. 7, no. 2, pp. 179-189, 2014.

Adinata, Y.C., “Analysis of Ethno-based Valuation Instrumens Measuring Higher-Order Thinking Skills using item Response theory,” International Journal of Evaluation and Research in Education, vol. 9, no.2, 2020.

Kusuma, M.D., Rosidin, U., Abdurahman., & Suyatna, A., “The Development of Higher Order Thinking Skill (HOTS) instrumen Assessment in Physics Study,” Journal of Research and Method in Education, vol. 7, no. 1, pp. 26-32, 2017.

Mainali, B. P., “Higher order thinking in education.” A Multidisciplinary Journal, vol. 2 no, 1, pp. 5-10, 2012.

Wardany, K., Sajidan & Murni, R., “Pengembangan penilaian untuk mengukur higher order thinking siswa,” Jurnal Inkuir, vol. 6, no. 2, pp. 1-16, 2017.

Anderson, & Krtahwohl, D., “A Taxonomy for Learning, Teaching, and Assessing: A Revision of Bloom’s Taxonomy,” New York: Longman Publishing, 2011.

Madhuri, G. V, Kantamreddi, V. S. S. N., & Prakash Goteti, L. N. S., “Promoting higher order thinking skills using inquiry-based learning,” European Journal of Engineering Education, vol. 37, no. 2, pp.117-123, 2012.

Mahoney, J. W., & Harris-Reeves, B., “The effects of collaborative testing on higher order thinking: Do the brightget brighter?,” Active Learning in Higher Education, vol. 20, no. 1, pp.25-37, 2019.

Heong, Y, M., “The Level Marzano Higher Order Thinking Skills Among Technical Education Students,” International Journal of Social Science and Humanity, vol. 1, no. 2, pp. 121-125, 2011.

Limbach, B., & Waugh, W., “Developing higher level thinking,” Journal of Instructional Pedagogies, vol. 3, no. 1, pp. 1-9, 2010.

Fischer, C., Bol, L., & Pribesh, S., “An investigation of higher-order thinking skills in smaller learning community social studies classrooms,” American Secondary Education, vol. 39, no. 2, pp.5-26, 2011.

Nordin, A. B., & Alias, N., “Learning outcomes and student perceptions in using of blended learning in history,” Procedia - Social and Behavioral Sciences, vol. 103, pp.577–585, 2013.

Rahman, A., Ofianto., Yetferson., “Pengembangan Instrumen Tes Higher Order Thinking Skills (HOTS) pada mata pelajaran Sejarah Indonesia,” Jurnal Penelitian Aktual dan Analisis Reformasi Pendidikan, vol. 17, no. 1, pp. 47-59, 2019.

Gunduz, A. Y., Alemdag, E., Yasar, S., & Erdem, M., “Design of a problem-based online learning environment and evaluation of its effectiveness. The Turkish Online Journal of Educational Technology, vol. 15, no. 3, 49-57, 2016.

Saputri, A. C., Sajidan, S., Rinanto, Y., Afandi, A., & Prasetyanti, N. M., “Improving students’ critical thinking skills in cell-metabolism learning using stimulating higher order thinking skills model,” International Journal of Instruction, vol. 12, no. 1, pp. 327-342, 2018.

Afflerbach, P., Cho, B. Y., & Kim, J. Y., “Conceptualizing and assessing higher-order thinking in reading,” Theory into Practice, vol. 54, 3, pp. 203-212, 2015.

Boone, W. J., Staver, R. J., & Yale, S. M., “Rasch Analysis in the Human Sciences,” London: Springer, 2014.

Haley, S. M., Coster, W. J., Dumas, H. M., Fragala-Pinkham, M. A., Kramer, J., Ni, Ludlow, L. H., “Accuracy and precision of the Pediatric Evaluation of Disability Inventory computer-adaptive tests (PEDI-CAT),” Developmental Medicine and Child Neurology, vol. 53, no. 12, 1100-1106, 2011.

Yuniar, M. Rakhmat, C. Saepulrohman, A., “Analisis HOTS (Higher-Order Thinking Skill) pada Soal Objektif dalam Mata Pelajaran Ilmu Pengetahuan Sosial (IPS) Kelas V SD Negeri 7 Ciamis,” Jurnal Ilmiah Mahasiswa Pendidikan Guru Sekolah Dasar, vol. 2, no. 2, pp.187-195, 2015.

Pi’i., “Mengembangkan Pembelajaran dan Penilaian Berpikir Tingkat Tinggi pada Mata Pelajaran Sejarah,” Sejarah dan Budaya, vol. 10, no. 2, pp.197-208, 2016.

Avargil, S. Herscovitz, O. & Dori, Y. J., “Teaching Thinking Skills In Context-Based Learning: Teachers’Challenges and Assessment Knowledge,” Journal of Science Education and Technology, vol. 21, no.2, pp. 207-225, 2012.

Drake, D., Frederick, D & Nelson, L., R., “Engagement in teaching history theory and secondary teachers,” New Jersey: Pearson, 2005.

Sener, N., Turk, C., & Tas, E., “Improving science attitude and creative thinking through science education project: A design, implementation and assessment,” Journal of Education and Training Studies, vol. 3, no. 4, pp. 57-67, 2015.

Dam, G.T, & Volman, M., “Critical thinking as a citizenship competence: teaching strategies,” Learning and instruction, vol. 14, no. 4, pp. 359-379, 2004.

Andrian, D., Kartowagiran, B., & Hadi, S., “The instrumen development to evaluate local curriculum in Indonesia,” International Journal of Instruction, vol. 11, no. 4, pp. 922-934, 2018.

Karim, F.A., Puteh, M., “The Development of Higher Order Thinking Skill Assessment Instrumen for word Problem,” International Journal of Academic Research in Business and Social Sciences, vol. 9, no. 6, pp. 1097-1083, 2019.

Ramadhan, S., Mardapi, D., Prasetyo, Z.K., & Utomo, H.B., “The development of an instrumen to measure the higher order thinking skill in physics,” European Journal of Educational Research, vol. 8, no. 3, pp. 743-751, 2019.

Borg & Gall., “Education research,” New York: Allyn and Bacon, 2003.

Kinay, I., & Bagceci, B., “The investigation of the effects of authentic assessment approach on prospective teachers’ problem-solving skills,” International Education Studies, vol. 9, no. 8, pp. 51-59, 2016.

Weiss, D. J., “Better data from better measurements using computerized adaptive testing,” Journal of Methods and Measurement in the Social Sciences, vol. 2, no. 1, pp. 1-27, 2011.

Aman., “Final Examination Test Instruments for History Subject in Yogyakarta, Indonesia: A Quality Analysis." Universal Journal of Educational Research, vol. 7, no. 12, pp. 2857-2866, 2019.

Arifin, Z., “Evaluasi Pembelajaran,” Bandung: PT Remaja Rosdakarya, 2016.

Boopathiraj, C & Chellamani, K., “Analysis of test items on difficulty level and discrimination index in the test for research in education”, International journal of social science & interdisciplinary research, vol. 2, no. 2, p.183-193, 2013.

Brown, G. T. L., Irving, S. E., & Keegan, P. J., “An Introduction to educational Assesment, Measurement & Evaluation,” Auckland: Dunmore Publishing, 2014.

Pommerich, M., “Developing computerized versions of paper-and pencil tests: Mode effects for passage-based tests,” The Journal of Technology, Learning and Assessment, vol. 2, no. 6, pp. 3-44, 2004.

Szilagyi. J, Clements, D. H, & Sarama, J., “Young Children's Understandings of Length Measurement: Evaluating a Learning Trajectory,” Journal for Research in Mathematics Education, vol. 44, no. 3, pp.581-620, 2013.

Coaley, K.,” An Introduction to Psychological Assessment and Psychometrics,” London: SAGE Publications Inc, 2010.

Cavallo, A. M. L., Potter, W. H., & Rozman, M., “Gender differences in learning constructs, shifts in learning constructs, and their relationship to course achievement in a structured inquiry, yearlong college physics course for life science majors,” School Science and Mathematics, vol. 104, no. 6, pp. 288-300, 2004

Polit, D. F., & Beck, C. T., “The content validity index: are you sure you know what's being reported? Critique and recommendations,” Research in nursing & health, vol. 29, no. 5, pp.489-49, 2006.

Setiawan, J., Aman., & Wulandari., “Understanding Indonesian history. Interest in learning history and national insight with nationalism attitude,” International Journal of Evaluation and Research in Education, vol. 9, no.1, pp. 1-10, 2020.

Wynd, C. A., Schmidt, B., & Schaefer, M. A., “Two quantitative approaches for estimating content validity,” Western Journal of Nursing Research, vol. 25, no. 5, pp. 508–518, 2003.

Azwar, S., “Validitas dan reliabilitas,” Yogyakarta, Indonesia: Pustaka Pelajar, 2007.

Mardapi, D., “Teknik penyusunan instrumen tes dan nontes,” Jogjakarta, Indonesia: Mitra Cendekia, 2008.

Retnawati, H., “Validitas reliabilitas dan karakteristik butir,” Yogyakarta, Indonesia: Parama Publishing, 2016.

Sudijono, A., “Pengantar Evaluasi”, Jakarta: Rajawali Pers, 2012.

Mardapi, D., “Pengukuran penilaian dan evaluasi pendidikan,” Yogyakarta, Indonesia: Nuha Medika, 2012.

Arif, M., “Penerapan Aplikasi Anates Bentuk soal pilihan ganda,” Jurnal Ilmiah Edutic, vol.1, no.1, pp. 1-9, 2014

Barnett, J. E., & Francis, A. L., “Using higher order thinking questions to foster critical thinking: A classroom study,” Educational Psychology, vol. 32, no. 2, pp 201-211, 2012.

Total views : 70 times


  • There are currently no refbacks.

Copyright (c) 2021 Institute of Advanced Engineering and Science

International Journal of Evaluation and Research in Education (IJERE)
p-ISSN: 2252-8822, e-ISSN: 2620-5440

View IJERE Stats

Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.