Hawthorne Effect and Mathematical Software Based Learning- A Meta-Analysis Study M Tamur1,2*, Y S Kusumah2, D Juandi2, T T Wijaya3, A Nurjaman4, and A O Samura5
1Universitas Katolik Indonesia Santu Paulus Ruteng, Jl. Jend. A. Yani No. 10, Ruteng 86511, Indonesia
2Departemen Pendidikan Matematika, Universitas Pendidikan Indonesia, Jl. DR. Setiabudi No 229, Bandung, 40154 Indonesia
3Guangxi Normal University, China
4Institut Keguruan dan Ilmu Pendidikan Siliwangi, Cimahi, Indonesia
5Institut Agama Islam Negeri Ternate, Ternate, Indonesia
Abstract
The use of mathematical software in learning has been widely applied. This meta-analysis study was conducted to examine the ^Hawthorne effect^, or the novelty of using mathematical software in learning. Related databases are sought for studies that qualify for examining the effects of using mathematical software compared to traditional teaching on students^ mathematical abilities. Random-effect models with 95% confidence intervals (CIs) were estimated. 40 effect sizes were analyzed from 40 primary studies that have been published in journals, or national and international proceedings from 2010 to 2020, and a total of 3072 students were included in this meta-analysis. The Comprehensive Meta-Analysis (CMA) program is used to assist analysis. As a result of the study, the overall effect size was 0.886 with a standard error of 0.092. The results of the follow-up analysis showed that the duration of the treatment was related to the use of mathematical software. It was found that the use of mathematical software given in the span of 0 - 4 weeks (effect size = 1.193) was more effective if carried out in more than 4 weeks (effect size = 0.535). Thus the Hawthorne effect influences the effectiveness of the use of mathematical software on students^ mathematical abilities. This fact is considered by education practitioners in using mathematical software in the future.
Keywords: Hawthorne effect, Meta-analysis, mathematical software, Mathematical ability, duration of the treatment
