AI-supported formative assessment and STEM communication competencies in engineering education

Dilyara Dulatkyzy, Gulden Akbayeva, Kamalbek Berkimbayev, Murat Mirzakhmetov, Nuraim Ibragimova, Saniya Nurgaliyeva

Abstract


This study examined the association between an artificial intelligence (AI)-supported formative assessment intervention and students’ science, technology, engineering, and mathematics (STEM) communication competencies, including written communication (WC), collaboration (COL), and critical thinking (CT), within a competency-based educational (CBE) context in Kazakhstan. A quasi-experimental pretest–posttest design was applied with 146 second-year engineering students. The intervention implemented a rule-based and natural language processing (NLP)-assisted formative feedback system, explicitly excluding generative AI models, to provide structured, rubric-aligned feedback on student performance. Results indicated statistically significant improvements in all competencies for both groups, with the experimental group (EG) demonstrating significantly greater gains and post-test differences between groups reaching statistical significance (p<0.05). Effect size analysis indicated moderate effects for WC (d=0.50), COL (d=0.48), and CT (d=0.40), while analysis of covariance (ANCOVA) results showed small-to-large intervention effects across competencies (η²p=0.08–0.15). These findings suggest a positive association between AI-supported formative feedback and STEM communication competency development. The study contributes empirical evidence on the role of structured AI-assisted formative feedback in competency-based STEM education.

Keywords


AI-supported formative assessment; Collaboration; Critical thinking; STEM communication; Written communication

Full Text:

PDF


DOI: http://doi.org/10.11591/ijere.v15i6.40372

Refbacks

  • There are currently no refbacks.


Copyright (c) 2026 Dilyara Dulatkyzy, Gulden Akbayeva, Kamalbek Berkimbayev, Murat Mirzakhmetov, Nuraim Ibragimova, Saniya Nurgaliyeva

International Journal of Evaluation and Research in Education (IJERE)
p-ISSN: 2252-8822, e-ISSN: 2620-5440
The journal is published by Institute of Advanced Engineering and Science (IAES).

View IJERE Stats

Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.