Designing and verifying a tool for diagnosing multidimensional scientific misconceptions in genetics topic

Sasithorn Kantahan, Putcharee Junpeng, Sompong Punturat, Keow Ngang Tang, Mark Wilson

Abstract


The main purpose of this study was to design and verify the quality of an assessment tool to diagnose multidimensional scientific misconceptions in the genetic topic of tenth-grade students. A total of 200 samples with three different levels of learning ability from schools under the administration of the Office of Secondary Educational Service 31, Nakhon Ratchasima province participated as test-takers. The design-based research consisting of four phases, namely construct maps, item design, outcome space, and Wright map was employed. Multidimensional Random Coefficient Multinomial Logit was used to verify the quality of the assessment tool. The assessment tool consists of two dimensions, namely, knowledge and reasoning with their respective five and four levels. It is comprised of 40 items encompassing 20 items for each dimension. The results revealed that there is internal structure evidence of validity based on the comparison of model fit and Wright map. Moreover, results also indicated that the reliability evidence and item fit are compliance with the quality of the assessment tool as reflected in the analysis of standard error of measurement and infit and outfit of the items.  It can be concluded that the assessment tool is currently prevalent to diagnose scientific misconceptions in the genetic topics.

Keywords


Assessment tool; Construct modeling; Genetic topic; Multidimensional model; Scientific misconceptions

References


S. Sripongwiwat, T. Bunterm, N. Srisawat and K. N. Tang, "The Construction and Neurocognitive-based Teaching Model for Promoting Science Learning Outcomes and Creative Thinking,” Asia Pacific Forum on Science Learning and Teaching, vol. 17, no. 2, Article 9, 2016.

M. R. Markovic, Creative Education and New Learning as Means of Encouraging Creativity, Original Thinking and Entrepreneurship. Retrieved from http://www.worldacademy.org, 2012.

C. E. Nelson, “Teaching Evolution (and all of Biology) More Effectively: Strategies for Engagement, Critical Reasoning, and Confronting Misconceptions,” Integrative and Comparative Biology Advance Access, Retrieved from http://icb.oxfordjournals.org/cgi/reprint/icn027vl.pdf.[pubMed], 2008.

K. K. Perkins and C. E. Wieman, “Innovative Teaching to Promote Innovative Thinking,” In R. L. DeHaan and K. M. V. Narayan (Eds.), Education for Innovation: Implications for India, China and America (pp. 181-210), (Rotterdam, The Netherland: Sense), 2008.

K. S. Taber, “Constructivism as Educational Theory: Contingency in Learning, and Optimally Guided Instruction,” In J. Hassaskhah (Ed.), Educational Theory (pp. 39-61), (New York: Nova), Retrieved from https://camtools.cam.ac.uk/wiki/eclipse/Constructivism.html, 2011.

K. S. Taber, Chemical Misconceptions – Prevention, Diagnosis and Cure. (London: Royal Society of Chemistry), 2002.

K. Garvin-Doxas and M. W. Klymkowsky, “Understanding Randomness and Its Impact on Student Learning: Lessons Learned from Building Biology Concept Inventory (BCI), “ CBE Life Sci Educ., vol. 7, no. 2, pp. 227-233, doi: 101187/cbe.07-08-0063. PMC 2424310. PMID 18519614, 2008.

J. Lewis and C. Wood-Robinson, “Genes, Chromosomes, Cell Division and Inheritance – Do Students See Any Relationship? ,” International Journal of Science Education, vol. 22, pp. 177-195, 2000.

S. J. Slack and J. Stewart, “High Schools Problem-solving Performance on Realistic Genetics Problem,” Journal of Research in Science Teaching, vol. 27, no. 1, pp. 55-67, 1990.

T. Inhatruad, “Comparison of the Incorrect Conceptual Diagnosis in the Subject – The Science of Upper Secondary School Students between Three and Four levels of Diagnostic Tests,” Unpublish Master Degree Thesis. (Bangkok: Chulalongkorn University), 2017.

M. Custer, “Sample size and item parameter estimation precision when utilizing the one-parameter ‘Rasch’ model,” Paper presented at the annual meeting of the mid-western Educational Research Association, Evanston, Illinois, 21-24 October, 2015.

S. Jiang, C. Wang and D. J. Weiss, “Sample Size Requirements for Estimation of Item Parameters in the Multidimensional Graded Response Model,” Frontiers in Psychology, vol. 7, p. 109, Retrieved from https://doi.org/10.3389/fpsyg.2016.00109, 2016.

R. J. Adams, M. Wilson and W. Wang, “The Multidimensional Random Coefficients Multinomial Logit Model,” Applied Psychological Measurement, vol. 23, issue 1, p. 21, 1997.

P. Junpeng, “Multidimensional Item Response Theory,” Application of Multidimensional Item Response Theory to Research, p. 75, 2018.

American Educational Research Association, American Psychological Association and National Council on Measurement in Education, Standards for Educational and Psychological Testing (6th ed.). (Washington, DC: American Educational Research Association), 2014.

T. C. Reeves, “Design Research from a Technology Perspective,” In J. van den Akkker, K. Gravemeijer, S. McKenney and N. Nieveen (Eds.), Educational Design Research, pp. 52-66, (London, UK: Routledge Sharples), 2006.

R. Adams and S. T. Khoo, “Quest: The Interactive Test Analysis System,” Quest (Computer Program), Retrieved from http://works.bepress.com/ray_adams/36/, 1996.

M. R. Wilson and P. De Boeck, “Descriptive and Explanatory Item Response Models,” In P. De Boeck & M. Wilson (Eds.), Explanatory Item Models: A Generalized Linear and Nonlinear. (New York: Springer-Verlag), 2004.

L. Yao and R. D. Schwarz, “A Multidimensional Partial Credit Model with Associated Item and Test Statistics: An Application to Mixed-format Tests,” Applied Psychological Measurement, vol. 30, no. 6, pp. 469-492, 2006.

G. Schwarz, “Estimating the Dimension of a Model,” The Annals of Statistics, vol. 6, no. 2, pp. 461-464, 1978.

T. H. Lin and C. M. Dayton, “Model Selection Information Criteria for Non-Nested Latent Class Models,” Journal of Educational and Behavioral Statistics, vol. 22, pp. 249-264, Retrieved from https://doi.org/10.3102/10769986022003249, 1997.

R. J. Adams, “Reliability as a Measurement Design Effect,” Studies In Educational Evaluation, vol. 31, no. 2-3, pp. 162-172, 2005.

C. Long, T. Dunne and H. de Kock, “Mathematics, Curriculum and Assessment: The Role of Taxonomies in the Quest for Coherence,” Pythagoras, vol. 35, no 2, Art.#240, pp. 1-14, http://dxdoi.org/10.4102/pythagoras.v35i2.240, 2014

M. Wilson, Constructing Measures: An Item Response Modeling Approach. (Mahwah, NJ: Lawrence Erlbaum Assoc.), 2005.




DOI: http://doi.org/10.11591/ijere.v9i3.20544
Total views : 50 times

Refbacks

  • There are currently no refbacks.


Copyright (c) 2020 Institute of Advanced Engineering and Science

International Journal of Evaluation and Research in Education (IJERE)
p-ISSN: 2252-8822, e-ISSN: 2620-5440

View IJERE Stats

Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.