Heat and temperature metacognitive awareness inventory: A confirmatory factor analysis

Moh. Irma Sukarelawan, Dwi Sulisworo, Jumadi Jumadi, Heru Kuswanto, Siti Anisatur Rofiqah

Abstract


This study aims to validate students' metacognition awareness inventory in Heat and Temperature material. This study used a cross-sectional design. A total of 167 public senior high school students in Yogyakarta, Indonesia were selected through convenience sampling technique. The HeTMAI inventory consists of six factors, namely (1) knowledge of cognition, (2) planning, (3) monitoring, (4) evaluation, (5) debugging, and (6) information management. HeTMAI uses a 5-point Likert scale. The data has been analyzed using the Confirmatory Factor Analysis (CFA) method through the Maximum Likelihood approach. All statistics were found to meet acceptance values. The four GOF indices (χ2/df = 2.36, CFI = 0.97, TLI = 0.97, and SRMR = 0.06) have supported the fit of the six-factor HeTMAI model. Standardized factor loading (SFL), construct reliability (CR), average variance extracted (AVE) and discriminant values provide evidence that HeTMAI has sufficient convergent and discriminant validity. Cronbach's alpha value of 0.96 indicates HeTMAI has very adequate evidence of reliability.

Keywords


Confirmatory factor analysis; Heat and temperature; Metacognitive awareness; Problem solving

References


Salman Khan, The One World Schoolhouse: Education Reimagined. New York, NY: Twelve, 2012.

L. M. Mendez Hinojosa, M. C. Rodriguez, and C. A. Ortiz Paez, “Measurement of Metacognition: Adaptation of Metacognitive State Inventory in Spanish to Mexican University Students,” Eurpean Journal of Educational Research, vol. 9, no. 1, pp. 413–421, Jan. 2020.

Sriyanto and M. I. Sukarelawan, “Mapping of Profile Students’ Metacognitive Awareness in Yogyakarta, Indonesia,” Journal of Research and Physics Education Research, vol. 6, no. 2, pp. 56–62, Oct. 2019.

S. A. Tachie, “Meta-cognitive Skills and Strategies Application: How This Helps Learners in Mathematics Problem-Solving,” Eurasia Journal of Mathematics, Science and Technology Education, vol. 15, no. 5, pp. 1–12, 2019.

Y. Coşkun, “A Study on Metacognitive Thinking Skills of University Students,” Journal of Education and Training Studies, vol. 6, no. 3, pp. 38–46, Feb. 2018.

F. Cubukcu, “Metacognition in the Classroom,” Procedia - Social and Behavioral Sciences, vol. 1, no. 1, pp. 559–563, 2009.

B. Kim, B. Zyromski, M. Mariani, S. M. Lee, and J. C. Carey, “Establishing the Factor Structure of the 18-Item Version of the Junior Metacognitive Awareness Inventory,” Measurement and Evaluation in Counseling and Development, vol. 50, no. 1–2, pp. 48–57, Apr. 2017.

G. Taasoobshirazi, M. Bailey, and J. Farley, “Physics Metacognition Inventory Part II: Confirmatory Factor Analysis and Rasch Analysis,” International Journal of Science Education, vol. 37, no. 17, pp. 2769–2786, Nov. 2015.

B. Çetin, “Metacognition and Self-Regulated Learning in Predicting University Students’ Academic Achievement in Turkey,” Journal of Education and Training Studies, vol. 5, no. 4, pp. 132–138, Mar. 2017.

A. Zohar and S. Barzilai, “A Review of Research on Metacognition in Science Education: Current and Future Directions,” Studies in Science Education, vol. 49, no. 2, pp. 121–169, 2013.

G. Taasoobshirazi and J. Farley, “Construct Validation of the Physics Metacognition Inventory,” International Journal of Science Education, vol. 35, no. 3, pp. 447–459, 2013.

L. Mihalca, C. Mengelkamp, and W. Schnotz, “Accuracy of Metacognitive Judgments as a Moderator of Learner Control Effectiveness in Problem-Solving Tasks,” Metacognition and Learning, vol. 12, no. 3, pp. 357–379, 2017.

G. M. Harrison and L. M. Vallin, “Evaluating the Metacognitive Awareness Inventory Using Empirical Factor-Structure Evidence,” Metacognition and Learning, vol. 13, no. 1, pp. 15–38, Apr. 2018.

M. Asy’ari, M. Ikhsan, and Muhali, “The Effectiveness of Inquiry Learning Model in Improving Prospective Teachers’ Metacognition Knowledge and Metacognition Awareness,” International Journal of Instruction, vol. 12, no. 2, pp. 455–470, 2019.

M. T. H. Chi, “Two Approaches to the Study of Experts’ Characteristics,” in The Cambridge Handbook of Expertise and Expert Performance, K. A. Ericsson, R. R. Hoffman, A. Kozbelt, and A. M. Williams, Eds. New York: Cambridge University Press, 2006, pp. 21–30.

K. Craig, D. Hale, C. Grainger, and M. E. Stewart, “Evaluating Metacognitive Self-Reports: Systematic Reviews of the Value of Self-Report in Metacognitive Research,” Metacognition and Learning, vol. 15, no. 2, pp. 155–213, Aug. 2020.

H. Haeruddin, Z. K. Prasetyo, and S. Supahar, “The Development of a Metacognition Instrument for College Students to Solve Physics Problems,” International Journal of Instruction, vol. 13, no. 1, pp. 767–782, Jan. 2020.

Z. K. Ünlü and İ. Dökme, “Adaptation of Physics Metacognition Inventory to Turkish,” International Journal of Assessment Tools in Education, vol. 6, no. 1, pp. 125–137, Mar. 2019.

Haeruddin, Z. K. Prasetyo, Supahar, E. Sesa, and G. Lembah, “Psychometric and Structural Evaluation of the Physics Metacognition Inventory Instrument,” European Journal of Educational Research, vol. 9, no. 1, pp. 215–225, Jan. 2020.

I. Aykutlu, S. Bezen, and C. Bayrak, “An Assessment of High School Students’ Conceptual Structures of Heat And Temperature Through Concept Maps,” AIP Conference Proceedings, vol. 1815, no. 1, pp. 1–4, 2017.

J. F. Hair, W. C. Black, B. J. Babin, and R. E. Anderson, Multivariate Data Analysis, 7th ed. British: Pearson Education Limited, 2014.

S. W. Huck, Reading Statistics and Research, 6th ed. Boston: Pearson, 2012.

J. Syahfitri, H. Firman, S. Redjeki, and S. Sriyati, “Development and Validation of Critical Thinking Disposition Test in Biology,” International Journal of Instruction, vol. 12, no. 4, pp. 381–392, Oct. 2019.

Y.-J. Son and M. H. Won, “Psychometric Validation of the Korean Version of the 9-Item European Heart Failure Self-Care Behaviour Scale,” Evaluation & the Health Professions, pp. 1–18, Dec. 2018.

G. Modarresi and E. Javan, “Construction and Validation of Foreign Language Learners’ Dropout Questionnaire,” International Journal of Instruction, vol. 11, no. 4, pp. 425–444, 2018.

G. Gürkan and S. Kahraman, “Development of an Attitude Scale to Measure Attitudes Towards Organ Transplantation and Donation of Preservice Teachers,” Journal of Baltic Science Education, vol. 17, no. 6, pp. 1005–1016, Dec. 2018.

J. Appianing and R. N. Van Eck, “Development and Validation of the Value-Expectancy STEM Assessment Scale for Students in Higher Education,” International Journal of STEM Education, vol. 5, no. 1, p. 24, Dec. 2018.

E. Ad’hiya and E. W. Laksono, “Development and Validation of an Integrated Assessment Instrument to Assess Students’ Analytical Thinking Skills in Chemical Literacy,” International Journal of Instruction, vol. 11, no. 4, pp. 241–256, Oct. 2018.

R. L. Worthington and T. A. Whittaker, “Scale Development Research: A Content Analysis and Recommendations for Best Practices,” The Counseling Psychologist, vol. 34, no. 6, pp. 806–838, 2006.

R. B. Kline, Principles and Practices of Structural Equation Modelling, 4th ed. New York: The Guilford Press, 2016.

Setyo H. Wijanto, Structural Equation Modeling with Lisrel 8.8: Concepts and Tutorials, 1st ed. Yogyakarta: Graha Ilmu, 2008.

M. Hanifah et al., “A Confirmatory Factor Analysis of Malaysian Primary School Students’ Energy Saving Practices,” Journal of Turkish Science Education, vol. 15, no. 3, pp. 51–63, 2018.

S. A. Chamberlin, A. D. Moore, and K. Parks, “Using Confirmatory Factor Analysis to Validate the Chamberlin Affective Instrument for Mathematical Problem Solving with Academically Advanced Students,” British Journal of Educational Psychology, vol. 87, no. 3, pp. 422–437, Sep. 2017.

Y. M. Lee, J.-E. Song, C. Park, and Y.-J. Son, “Psychometric Evaluation of the Korean Version of Patient-Centered Care Scale for Hospital Nurses,” Evaluation & the Health Professions, vol. 42, no. 3, pp. 344–365, Sep. 2018.

J. Pallant, SPSS Survival Manual: A Step by Step Guide to Data Analysis Using SPSS, 4th ed. London: McGraw-Hill, 2010.

D. F. Polit and C. T. Beck, Nursing Research: Generating and Assessing Evidence for Nursing Practice, 10th ed. Philadelphia: Wolters Kluwer, 2017.

A. S. Beavers, J. W. Lounsbury, J. K. Richards, S. W. Huck, G. J. Skolits, and S. L. Esquivel, “Practical Considerations for Using Exploratory Factor Analysis in Educational Research,” Practical Assessment, Research and Evaluation, vol. 18, no. 6, pp. 1–13, 2013.

E. B. K. Demir and G. F. Gündüz, “Development of a Scale for Students in Evaluating 2017 Information Technology and Software Curriculum,” International Journal of Instruction, vol. 12, no. 4, pp. 313–330, Oct. 2019.

L. R. Price, Psychometric Methods: Theory Into Practice. New York: The Guilford Press, 2017.

T. G. Bond and C. M. Fox, Applying the Rasch Model: Fundamental Measurement in the Human Sciences, 3rd ed. New York, NY: Routledge, 2015.

W. Sumintono, Bambang & Widhiarso, Rasch Modeling Application in Educational Assessment. Cimahi: Trim Komunikata, 2015.




DOI: http://doi.org/10.11591/ijere.v10i2.20917
Total views : 46 times

Refbacks

  • There are currently no refbacks.


Copyright (c) 2021 Institute of Advanced Engineering and Science

International Journal of Evaluation and Research in Education (IJERE)
p-ISSN: 2252-8822, e-ISSN: 2620-5440

View IJERE Stats

Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.