Evaluation of structural models and measurement models of student satisfaction in online learning

Herwin Herwin, Fathurrohman Fathurrohman, Wuri Wuryandani, Shakila Che Dahalan, Suparlan Suparlan, Firmansyah Firmansyah, Kurniawati Kurniawati,

Abstract


This study aims to evaluate structural models and measurement models of student satisfaction in online learning. This is a quantitative study using a survey research design. Structural model testing is done by examining the relationship between several variables. The variables in question are the learning management system (LMS), admin services, the performance of facilitator lecturers and student satisfaction in learning. The sample used in this study are 149 students. Data analysis was performed using the multivariate Structural Equation Modeling (SEM) technique. The findings of this study indicate that the facilitator lecturer performance is the variable that has the greatest effect in increasing student satisfaction in online learning. Admin service is another variable that has a positive effect on student satisfaction, both direct and indirect effects. The LMS variable does not show a direct effect on student satisfaction, but the LMS has an indirect effect on student satisfaction through the variable facilitator lecturer performance and admin services.

Keywords


structural and measurement models; student satisfaction; online learning

References


M. K. Hossain and B. Wood, “Enhancing student engagement in online learning environments Post-Covid-19: A case of higher education,” Foster. Commun. Learn. With Underutilized Technol. High. Educ., pp. 137–149, 2021, doi: 10.4018/978-1-7998-4846-2.ch010.

A. Yudiawan, B. Sunarso, Suharmoko, F. Sari, and Ahmadi, “Successful online learning factors in COVID-19 era: Study of Islamic higher education in West Papua, Indonesia,” Int. J. Eval. Res. Educ., vol. 10, no. 1, pp. 193–201, 2021, doi: 10.11591/ijere.v10i1.21036.

L. D. S. Lapitan, C. E. Tiangco, D. A. G. Sumalinog, N. S. Sabarillo, and J. M. Diaz, “An effective blended online teaching and learning strategy during the COVID-19 pandemic,” Educ. Chem. Eng., pp. 1–41, 2021, doi: 10.1016/j.ece.2021.01.012.

S. Juan, “Promoting engagement of nursing students in online learning: Use of the student-generated question in a nursing leadership course,” Nurse Educ. Today, vol. 97, pp. 1–5, 2021, doi: 10.1016/j.nedt.2020.104710.

D. M. Billings, E. R. Faan, and J. A. Halstead, Teaching in nursing: A guide for faculty. Elsevier Health Sciences, 2019.

S. J. Blackmon and C. Major, “Student experiences in online courses. a qualitative research synthesis,” Q. Rev. Distance Educ., vol. 13, no. 2, pp. 77–85, 2012.

S. Lage-Cal, M. B. Folgueras-Díaz, M. Alonso-Hidalgo, D. García-Menéndez, and F. J. Fernández-García, “Investigation of the effectiveness of online learning tools for energy performance certificates preparation,” in 6th International Conference on Energy and Environment Research, 2020, pp. 609–614, doi: 10.1016/j.egyr.2019.09.034.

S. Vanslambrouck, C. Zhu, K. Lombaerts, B. Philipsen, and J. Tondeur, “Students’ motivation and subjective task value of participating in online and blended learning environments,” Internet High. Educ., vol. 36, pp. 33–40, 2018, doi: 10.1016/j.iheduc.2017.09.002.

J. R. Buelow, T. Barry, and L. E. Rich, “Supporting learning engagement with online students,” Online Learn., vol. 22, no. 4, pp. 313–340, 2018, doi: 10.24059/olj.v22i4.1384.

M. S. A. El-Seoud, I. A. T. F. Taj-Eddin, N. Seddiek, M. M. El-Khouly, and A. Nossei, “E-Learning and students’ motivation: A Research study on the effect of e-learning on higher education,” Int. J. Emerg. Technol. Learn., vol. 9, no. 4, pp. 20–26, 2014, doi: 10.3991/ijet.v9i4.3465.

T. D. Hobson and K. K. Puruhito, “Going the distance: Online course performance and motivation of distance learning students,” Online Learn., vol. 22, no. 4, pp. 129–140, 2018, doi: 10.24059/olj.v22i4.1516.

A. Kumi-Yeboah, “Designing a cross-cultural collaborative online learning frameworkfor online instructors,” Online Learn., vol. 22, no. 4, pp. 181–201, 2018, doi: 10.24059/olj.v22i4.1520.

S. Haq, M. Giatman, and A. Inra, “Evaluation of teacher professional education program (PPG) teaching graduates edge area, front area, and left side area of Indonesia (SM-3T) of Universitas Negeri Padang,” Int. J. Educ. Dyn., vol. 1, no. 2, pp. 301–307, 2019, doi: 10.24036/ijeds.v1i2.157.

F. Fauzan and B. Bahrissalim, “Curriculum analysis teacher professional education program (PPG) of Islamic education in Indonesia,” TARBIYA J. Educ. Muslim Soc., vol. 4, no. 2, pp. 148–161, 2017, doi: 10.15408/tjems.v4i2.6400.

I. L. P. Utami, “The online learning of teacher profession education program (PPG) for in-service English Teachers: Challenges and accelerated learning factors,” J. Pendidik. Indones., vol. 7, no. 2, pp. 145–153, 2018, doi: 10.23887/jpi-undiksha.v7i2.15650.

Herwin, C. S. A. Jabar, A. Senen, and W. Wuryandani, “The evaluation of learning services during the COVID-19 Pandemic,” Univers. J. Educ. Res., vol. 8, no. 11B, pp. 5926–5933, 2020, doi: 10.13189/ujer.2020.082227.

D. Andriani, D. Purwana, and D. Susita, “Analysis of factors that effect lecturer productivity producing international scientific article in Private University: Motivation as a moderating variable,” Int. J. Hum. Cap. Manag., vol. 4, no. 1, pp. 87–107, 2020, doi: 10.21009/IJHCM.04.01.08.

I. Jaén, J. A. Moriano, and F. Liñán, “Personal values and entrepreneurial intention: an empirical study,” in Personal values and entrepreneurial intention: an empirical study, Edward Elgar Publishing, 2013, pp. 15–31.

P. Tungkunanan, “Learning model of undergraduate students: Confirmatory factor analysis,” Int. J. Instr., vol. 13, no. 3, pp. 665–678, 2020, doi: 10.29333/iji.2020.13345a.

Herwin and R. Nurhayati, “Measuring students’ curiosity character using confirmatory factor analysis,” Eur. J. Educ. Res., vol. 10, no. 2, pp. 773–783, 2021, doi: 10.12973/eu-jer.10.2.773.

D. Shi and A. Maydeu-Olivares, “The effect of estimation methods on SEM fit indices,” Educ. Psychol. Meas., vol. 80, no. 3, pp. 421–445, 2020, doi: 10.1177/0013164419885164.

S. Mulaik, “Another look at a cancer research model. Theory and indeterminacy in the BMC model,” in Annual meeting of the Society for Multivariate Experimental Psychology, 2010.

P. Prudon, “Confirmatory factor analysis as a tool in research using questionnaires: A critique,” Compr. Psychol., vol. 4, no. 10, pp. 1–19, 2015.

B. Williams, A. Onsman, and T. Brown, “Exploratory factor analysis: A five-step guide for novices,” Australas. J. Paramed., vol. 8, no. 3, pp. 1–13, 2010.

D. Shi, T. Lee, and A. Maydeu-Olivares, “Understanding the model size effect on SEM fit indices,” Educ. Psychol. Meas., vol. 79, no. 2, pp. 310–334, 2019, doi: 10.1177/0013164418783530.

M. Skordoulis, D. Drosos, and M. Mandalenaki, “An analysis of students’ satisfaction using a multicriteria method,” in Proceedings of 2nd International Conference on Lifelong Education and Leadership for All-ICLEL, 2016, pp. 21–23.

W. Wuryandani and H. Herwin, “The effect of the think–pair–share model on learning outcomes of Civics in elementary school students,” Cypriot J. Educ. Sci., vol. 16, no. 2, pp. 627–640, 2021, doi: 10.18844/cjes.v16i2.5640.

S. A. Tjabolo and Herwin, “The Influence of Teacher Certification on the Performance of Elementary School Teachers in Gorontalo Province, Indonesia,” Int. J. Instr., vol. 13, no. 4, pp. 347–360, 2020, doi: 10.29333/iji.2020.13422a.

A. . Rahman, “Students’perception toward good lecturer pedagogical competence,” English Lit. J., vol. 3, no. 2, pp. 141–155, 2016.

D. A. Duc, P. N. Thach, B. H. Phuong, C. C. Dung, L. H. Van, and P. T. H. Diep, “Adynamic fuzzy multiple criteria decision-making approach for lecturer performance evaluation,” J. Manag. Inf. Decis. Sci., vol. 22, no. 3, pp. 250–261, 2019.

A. Hassan, A. Ghaffar, and E. M. D. Dinglasan, “A cross-country analysis of students’ evaluation of university teaching: Relationship between faculty behavior, student satisfaction and teaching quality,” NUML J. Crit. Inq., vol. 16, no. 1, 2018.

T. Wubbels and M. Brekelmans, “Two decades of research on teacher–student relationships in class,” Int. J. Educ. Res., vol. 43, no. 1–2, pp. 6–24, 2005, doi: 10.1016/j.ijer.2006.03.003.

P. M. Cuarto and S. A. Arenillo, “Classroom climate among teacher education mathematics students,” Asia Pacific J. Multidiscip. Res., vol. 3, no. 4, pp. 78–85, 2015.

C. Ives and P. Walsh, “Perspectives of Canadian Distance Educators on the move to online learning,” Can. J. High. Educ., vol. 51, no. 1, pp. 28–40, 2021, doi: 10.47678/cjhe.vi0.188971.

Y. Wei-Ku, “The effects of service contact, experience value, and service quality in the 2018 Penghu ‘Chrysanthemum Island Bicycle Trip’ on behavioral intentions,” Int. J. Organ. Innov., vol. 12, no. 1, pp. 60–92, 2019.

Y. Yang, “Roles of administrators in ensuring the quality of online programs,” Knowl. Manag. E-Learning An Int. J., vol. 2, no. 4, pp. 363–369, 2010.

B. K. McKenzie, B. C. Ozkan, and K. Layton, “Distance leadership practices -what works in higher education,” in Proceedings of World Conference on E-Learning in Corporate, Government, Healthcare, and Higher Education, 2005, pp. 926–931.

A. Babcock, T. Lehan, and H. D. Hussey, “Mind the gaps: An online learning center’s needs assessment,” Learn. Assist. Rev., vol. 24, no. 1, pp. 27–58, 2019.

J. M. Paiz, “Expanding the writing center: A theoretical and practical toolkit for starting an online writing lab,” Electron. J. English as a Second Lang., vol. 21, no. 4, pp. 1–18, 2018.

B. K. McKenzie, N. Mims, E. Bennett, and M. Waugh, “Needs, concerns and practices of online instructors,” Online J. Distance Learn. Adm., vol. 3, no. 3, 2000.

D. . Husmann and M. T. Miller, “Improving distance education: Perceptions of program administrators,” Online J. Distance Learn. Adm., vol. 4, no. 3, 2001.

K. L. Giannoni and D. . Tesone, “What academic administrators should know to attract senior level faculty members to online learning environments?,” Online J. Distance Learn. Adm., vol. 6, no. 1, 2003.

Z. L. Berge, L. . Muilenburg, and J. . Haneghan, “Barriers to distance education and training,” Q. Rev. Distance Educ., vol. 3, no. 4, pp. 409–419, 2002.

J. Rhode, S. Richter, P. Gowen, T. Miller, and C. Wills, “Understanding faculty use of the learning management system,” Online Learn., vol. 21, no. 3, pp. 68–86, 2017.

I. U. Khan, Z. Hameed, Y. Yu, and S. U. Khan, “Assessing the determinants of flow experience in the adoption of learning management systems: the moderating role of perceived institutional support,” Behav. Inf. Technol., vol. 36, no. 11, pp. 1162–1176, 2017, doi: 10.1080/0144929X.2017.1362475.

D. Turnbull, R. Chugh, and J. Luck, “Learning Management Systems: An Overview,” in Encyclopedia of Education and Information Technologies, A. Tatnall, Ed. Cham: Springer, 2019, pp. 1–7.

K. A. Al-Busaidi and H. Al-Shihi, “Instructors’ acceptance of learning management systems: A theoretical framework,” Commun. IBIMA, pp. 1–10, 2010.

S. Lonn, S. D. Teasley, and A. E. Krumm, “Who needs to do what where?: Using learning management systems on residential vs. commuter campuses,” Comput. Educ., vol. 56, no. 3, pp. 642–649, 2011, doi: 10.1016/j.compedu.2010.10.006.

K. Mershad and P. Wakim, “A learning management system enhanced with internet of things applications,” J. Educ. Learn., vol. 7, no. 3, pp. 23–40, 2018, doi: 10.5539/jel.v7n3p23.

Ng Wen Lee, W. N. F. W. Shamsuddin, L. C. Wei, M. N. A. M. Anuardi, C. S. Heng, and A. N. Abdullah, “Using online multiple choice questions with multiple attempts: A case for self-directed learning among tertiary students,” Int. J. Eval. Res. Educ., vol. 10, no. 2, pp. 553–568, 2021, doi: 10.11591/ijere.v10i2.21008.

N. A. Alias and A. M. Zainuddin, “Innovation for better teaching and learning: Adopting the learning management system,” Malaysian online J. Instr. Technol., vol. 2, no. 2, pp. 27–40, 2005.

N. A. Adzharuddin and L. H. Ling, “Learning management system (LMS) among university students: Does it work,” Int. J. e-Education, e-Business, e-Management e-Learning, vol. 3, no. 3, pp. 248–252, 2013.

D. D. Prior, J. Mazanov, D. Meacheam, G. Heaslip, and J. Hanson, “Attitude, digital literacy and self efficacy: Flow-on effects for online learning behavior,” Internet High. Educ., vol. 29, pp. 91–97, 2016, doi: 10.1016/j.iheduc.2016.01.001.

H. Şenol, F. Y. Lesinger, and M. Çağlar, “Evaluation of Online Education Delivered by the Universities During Pandemic COVID-19: A Case of North Cyprus,” TOJET Turkish Online J. Educ. Technol., vol. 20, no. 2, pp. 51–61, 2021.




DOI: http://doi.org/10.11591/ijere.v11i1.22115

Refbacks

  • There are currently no refbacks.


Copyright (c) 2021 Institute of Advanced Engineering and Science

International Journal of Evaluation and Research in Education (IJERE)
p-ISSN: 2252-8822, e-ISSN: 2620-5440

View IJERE Stats

Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.