Method effects of negative items on mathematics self-confidence: confirmatory factor analysis of Indonesian pre-service teachers

Davi Apriandi, Heri Retnawati, Agus Maman Abadi, Annis Deshinta Ayuningtyas

Abstract


Negatively worded items remain common in psychological scales, despite evidence of their negative impact. This study developed a mathematics
self-confidence scale for Indonesian pre-service teachers and examined how negatively worded items affect factor structure in a non-Western context. Participants included 175 pre-service mathematics teachers from six Indonesian universities. The initial 24-item model, with 16 favorable and 8 unfavorable items, showed poor fit (Chi-square/degrees of freedom (χ²/df)=3.363; root mean square error of approximation (RMSEA)=0.117; comparative fit index (CFI)=0.720). All 8 unfavorable items had very low standardized factor loadings (λ=0.09–0.39), consistent with systematic method effects. After removing these items and respecifying the model, the final 16-item version showed good fit (χ²/df=1.96; RMSEA=0.074; CFI=0.92), with construct reliabilities ranging from 0.70 to 0.85 and a Cronbach’s alpha of 0.905. These results may relate to cognitive processing demands, Indonesian negation structures, and collectivist cultural response patterns. Due to the single-sample design, post hoc modifications, and the moderate sample size, these findings should be interpreted with caution. The study offers evidence-based guidance rather than definitive rules, supporting the use of positively worded items to measure affective constructs in similar cultural contexts, pending further replication.

Keywords


Construct validity; Method effect; Negatively worded items; Pre-service mathematics teachers; Self-confidence

Full Text:

PDF


DOI: http://doi.org/10.11591/ijere.v15i6.39691

Refbacks

  • There are currently no refbacks.


Copyright (c) 2026 Davi Apriandi, Heri Retnawati, Agus Maman Abadi, Annis Deshinta Ayuningtyas

International Journal of Evaluation and Research in Education (IJERE)
p-ISSN: 2252-8822, e-ISSN: 2620-5440
The journal is published by Institute of Advanced Engineering and Science (IAES).

View IJERE Stats

Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.