Design and Implementation of Performance Metrics for Evaluation of Assessments Data

Irfan Ahmed, Arif Bhatti

Abstract


Evocative evaluation of assessment data is essential to quantify the achievements at course and program levels. The objective of this paper is to design performance metrics and respective formulas to quantitatively evaluate the achievement of set objectives and expected outcomes at the course levels for program accreditation. Even though assessment processes for accreditation are well documented but existence of an evaluation process is assumed. This work provides performance metrics such as attainment, student achievement, and x-th percentile for the evaluation of assessment data at course and program level. Then, a sample course data and uniformly distributed synthetic data are used to analyze the results from designed metrics. The primary findings of this work are twofold: (i) analysis with sample course assessment data reveals that qualitative mapping between marks obtained in assessments to the defined outcomes is essential for meaningful results, (ii) analysis with synthetic data shows that higher values of one metric does not imply higher values of the other metrics and they depend upon the obtained marks distribution. In particular, for uniformly distributed marks, achievement < attainment for meanOfUniformDistr. < averageMarks < passingT hreshold(α). Authors hope that the articulated description of evaluation formulas will help convergence to high quality standard in evaluation process.


Keywords


Assessment, Evaluation, Higher education, Student outcomes

Full Text:

PDF


DOI: http://doi.org/10.11591/ijere.v5i3.4545
Total views : 194 times

Refbacks

  • There are currently no refbacks.


Copyright (c) 2016 International Journal of Evaluation and Research in Education (IJERE)

International Journal of Evaluation and Research in Education (IJERE)
p-ISSN: 2252-8822, e-ISSN: 2620-5440

View IJERE Stats

Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.