Exploring the impact of artificial intelligence on mathematics learning: A meta-analysis
Main Article Content
Abstract
Despite the growing integration of artificial intelligence (AI) in education, empirical findings regarding its effectiveness in mathematics learning remain mixed, providing limited insight into the conditions under which AI-based interventions are most effective. This study aims to examine the effectiveness of AI in mathematics learning and investigate whether educational level, intervention duration, type of AI, mathematical competence, and mathematical content area moderate its effectiveness. A meta-analysis was conducted using 37 effect sizes from 16 studies that met the inclusion criteria. The studies were identified through a systematic search of the Scopus database, and the data were analysed using a random-effects model and Hedges' g, with the support of Comprehensive Meta-Analysis (CMA) software. The findings indicate that AI implementation has a statistically significant positive effect on mathematics learning (g = 0.65, p < 0.05). The moderator analysis revealed that mathematical competence and educational level were significant moderators, whereas intervention duration, type of AI, and mathematical content area were not. These findings highlight the importance of aligning AI-based interventions with the targeted mathematical competencies and learners' educational characteristics. This study contributes to the literature by synthesizing empirical evidence on the effectiveness of AI in mathematics learning and identifying key moderating factors that may influence its impact.
Downloads
Download data is not yet available.
Article Details
How to Cite
Onesimus Laia, H., Martadiputra, B. A. P., Mulyaning Asih, E. C., & Candraningsih, Y. (2026). Exploring the impact of artificial intelligence on mathematics learning: A meta-analysis. Kalamatika: Jurnal Pendidikan Matematika, 11(2), 197-215. https://doi.org/10.22236/KALAMATIKA.vol11no2.2026pp197-215
Section
Article

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
- Authors are asked to sign a "Copyright Transfer Agreement" upon acceptance of their manuscript, before the manuscript can be published. After the agreement is signed, copyright on the manuscript is transferred to the publisher (FKIP Universitas Muhammadiyah Prof. Dr. HAMKA), and the Authors grant the journal the right of first publication with the work simultaneously licensed under a CC-BY-SA or the Creative Commons Attribution–ShareAlike License.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal.
- Authors should note that text quotations of more than 250 words from a published or copyrighted work will require grant of permission from the original publisher to reprint. The written permission letter(s) must be submitted together with the manuscript.
References
Akavova, A., Temirkhanova, Z., & Lorsanova, Z. (2023). Adaptive learning and artificial intelligence in the educational space. E3S Web of Conferences, 451, 06011. https://doi.org/10.1051/e3sconf/202345106011
Al-Nawaiseh, S. J., Tabieh, A. A., Maqableh, W. F., Altawalbeh, M., & Ahmad, F. B. (2024). The effectiveness of using educational robots in enhancing engineering mathematics skills among students in basic school. International Journal of Education and Practice, 12(3), 906-921. https://doi.org/10.18488/61.v12i3.3768
Awang, L. A., Yusop, F. D., & Danaee, M. (2025). Current practices and future direction of artificial intelligence in mathematics education: A systematic review. International Electronic Journal of Mathematics Education, 20(2), em0823. https://doi.org/10.29333/iejme/16006
Baker, R., & Siemens, G. (2014). Educational Data Mining and Learning Analytics. In R. K. Sawyer (Ed.), The Cambridge Handbook of the Learning Sciences (pp. 253–272). chapter, Cambridge: Cambridge University Press. https://doi.org/10.1017/CBO9781139519526.016
Baker, T., Smith, L., & Anissa, N. (2019). Educ-AI-tion rebooted? exploring the future of artificial intelligence in schools and colleges. In www.nesta.org.uk. Nesta. https://media.nesta.org.uk/documents/Future_of_AI_and_education_v5_WEB.pdf
Belpaeme, T., Kennedy, J., Ramachandran, A., Scassellati, B., & Tanaka, F. (2018). Social robots for education: A review. Science Robotics, 3(21), 1–10. https://doi.org/10.1126/scirobotics.aat5954
Berida, O., Oguntimilehin, A., Ajisafe, B., Adebusola, T.-O., Babalola, G., Akinduyite, O., Okebule, T., Obamiyi, S., & Sanya, O. (2024, April). SMat-Bot: An interactive chatbot for facilitating students’ comprehension of mathematics. In 2024 International Conference on Science, Engineering and Business for Driving Sustainable Development Goals (SEB4SDG) (pp. 1-8). IEEE. https://doi.org/10.1109/SEB4SDG60871.2024.10630005
Borenstein, M., Hedges, L. V, Higgins, J. P. T., & Rothstein, H. R. (2021). Introduction to Meta-Analysis. Second Edition. Wiley. https://doi.org/10.1002/9780470743386
Chen, L., Chen, P., & Lin, Z. (2020). Artificial intelligence in education: A review. IEEE Access, 8, 75264–75278. https://doi.org/10.1109/ACCESS.2020.2988510
Choi, Y., & McClenen, C. (2020). Development of adaptive formative assessment system using computerized adaptive testing and dynamic bayesian networks. Applied Sciences (Switzerland), 10(22), 1–17. https://doi.org/10.3390/app10228196
D’Mello, S., & Graesser, A. C. (2015). Feeling, thinking, and computing with affect-aware learning technologies. Feeling, thinking, and computing with affect-aware learning technologies. In R. Calvo, S. D’Mello, J. Gratch, & A. Kappas (Eds.), The Oxford handbook of affective computing. Oxford University Press. https://doi.org/10.1093/oxfordhb/9780199942237.013.032
Duval, S., & Tweedie, R. (2000). Trim and fill: A simple funnel-plot-based method of testing and adjusting for publication bias in meta-analysis. Biometrics, 56(2), 455–463. https://doi.org/10.1111/j.0006-341X.2000.00455.x
Ellington, L. M. (2026). Adaptive learning systems: revolutionizing student-centered education. In V. Wang (Ed.), AI, Personalization, Equity, and the Future of Learning (pp. 345-368). IGI Global Scientific Publishing. https://doi.org/10.4018/979-8-3373-5097-4.ch012
Fardian, D., Suryadi, D., Prabawanto, S., & Jupri, A. (2025). Integrating Chat-GPT in the classroom: A study on linear algebra learning in higher education. International Journal of Information and Education Technology, 15(4), 732–751. https://doi.org/10.18178/ijiet.2025.15.4.2279
Garcia, M. B., Acut, D. P., Arif, Y. M., Maher, D., Alex, J. K., Wardat, Y., Chiu, T. K. F., & Damaševičius, R. (2026). Modernizing mathematics education with artificial intelligence: A narrative review of ai-powered tools, thematic trends, and instructional applications. In A. Mazı (Ed.), The Convergence of Mathematics and AI: A New Paradigm in Education (pp. 153-186). IGI Global Scientific Publishing. https://doi.org/10.4018/979-8-3373-1998-8.ch006
Gürefe, N., Sarpkaya Aktaş, G., & Öksüz, H. (2024). Investigating the Impact of the AI-Supported 5E (AI-s5E) Instructional Model on Spatial Ability. Behavioral Sciences, 14, 682. https://doi.org/10.3390/bs14080682
Holmes, W., Bialik, M., & Fadel, C. (2019). Artificial intelligence in education: Promises and implications for teaching and learning. Center for Curriculum Redesign.
Hwang, S. (2022). Examining the effects of artificial intelligence on elementary students’ mathematics achievement: A meta-analysis. Sustainability, 14(20), 13185. https://doi.org/10.3390/su142013185
Khairunnisa, K., Sari, F. F., Anggelena, M., Agustina, D., & Nursa’adah, E. (2022). Penggunaan Effect Size Sebagai Mediasi dalam Koreksi Efek Suatu Penelitian. Jurnal Pendidikan Matematika (Judika Education), 5(2), 138–151. https://doi.org/10.31539/judika.v5i2.4802
Lampropoulos, G., & Papadakis, S. (2024). Maker education and educational robotics in the age of artificial intelligence. In S. Papadakis & G. Lampropoulos (Eds.), Intelligent educational robots: Toward personalized learning environments (pp. 1–8). De Gruyter. https://doi.org/10.1515/9783111352695-001
Létourneau, A., Deslandes Martineau, M., Charland, P., Karran, J. A., Boasen, J., & Léger, P. M. (2025). A systematic review of AI-driven intelligent tutoring systems (ITS) in K-12 education. Npj Science of Learning, 10(1), 29. https://doi.org/10.1038/s41539-025-00320-7
Lu, Y., Pian, Y., Chen, P., Meng, Q., & Cao, Y. (2021). RadarMath: An Intelligent Tutoring System for Math Education. Proceedings of the AAAI Conference on Artificial Intelligence, 35(18), 16087–16090. https://doi.org/10.1609/aaai.v35i18.18020
Memiş, Y. (2025). Examining the potential and pitfalls of AI in problem solving. Journal of Pedagogical Research, 9(2), 177–190. https://doi.org/10.33902/JPR.202532099
Niño, F., Lancheros-Cuesta, D., Jiménez-Valderrama, M., Mestre, G., & Gómez, S. (2023). Systematic Review: Trends in Intelligent Tutoring Systems in Mathematics Teaching and Learning. International Journal of Education in Mathematics, Science and Technology, 12, 203–229. https://doi.org/10.46328/ijemst.3189
Onesimus Laia, H., Martadiputra, B. A. P., & Dahlan, J. A. (2025). The Effect of Logical-Mathematical Intelligence on Mathematics Learning and Moderator Analysis: A Meta- Analysis. Al-Jabar: Jurnal Pendidikan Matematika, 16(1), 129–149. https://doi.org/10.24042/ajpm.v16i1.25539
Opesemowo, O. A. G. (2025). Artificial Intelligence in Mathematics Education: The Pros and Cons. In M. Khosrow-Pour, D.B.A. (Ed.), Encyclopedia of Information Science and Technology, Sixth Edition. Advance online publication. https://doi.org/10.4018/978-1-6684-7366-5.ch084
Ouyang, F., & Xu, W. (2024). The effects of educational robotics in STEM education: A multilevel meta-analysis. International Journal of STEM Education, 11(1). https://doi.org/10.1186/s40594-024-00469-4
Ruppar, T. (2020). Meta-analysis: How to quantify and explain heterogeneity? European Journal of Cardiovascular Nursing, 19(7), 646–652. https://doi.org/10.1177/1474515120944014
Seban, P., & Urban, K. (2024). Examining the Utilisation of Learning Techniques and Strategies Among Pedagogy Students : Implications for Self-Regulated Learning. Journal of Pedagogy, 15, 27–49. https://doi.org/10.2478/jped-2024-0002
Sedgwick, P. (2015). Meta-analyses: What is heterogeneity? BMJ, 350, h1435. https://doi.org/10.1136/bmj.h1435
Sterne, J. A. C., Sutton, A. J., Ioannidis, J. P. A., Terrin, N., Jones, D. R., Lau, J., Carpenter, J., Rücker, G., Harbord, R. M., Schmid, C. H., Tetzlaff, J., Deeks, J. J., Peters, J., Macaskill, P., Schwarzer, G., Duval, S., Altman, D. G., Moher, D., & Higgins, J. P. T. (2011). Recommendations for examining and interpreting funnel plot asymmetry in meta-analyses of randomised controlled trials. BMJ, 343, d4002. https://doi.org/10.1136/bmj.d4002
Surbakti, R., Umboh, S., Pong, M., & Dara, S. (2024). Cognitive Load Theory: Implications for Instructional Design in Digital Classrooms. International Journal of Educational Narratives, 2, 483–493. https://doi.org/10.70177/ijen.v2i6.1659
Sweller, J. (2011). Cognitive load theory. In J. P. Mestre & B. H. Ross (Eds.), Psychology of learning and motivation (Vol. 55, pp. 37–76). Academic Press. https://doi.org/10.1016/B978-0-12-387691-1.00002-8
Thalheimer, W., & Cook, S. (2002). How to calculate effect sizes from published research. Work-Learning Research, 1(August), 1–9. www.work-learning.com
Wahba, F., Ajlouni, A., & Abumosa, M. (2024). The impact of ChatGPT-based learning statistics on undergraduates’ statistical reasoning and attitudes toward statistics. Eurasia Journal of Mathematics, Science and Technology Education, 20, em2468. https://doi.org/10.29333/ejmste/14726
Wu, X. -Y. (2024). Artificial intelligence in L2 learning: A meta-analysis of contextual, instructional, and social-emotional moderators. System, 126, 103498. https://doi.org/10.1016/j.system.2024.103498
Yi, L., Liu, D., Jiang, T., & Xian, Y. (2025). The effectiveness of AI on K-12 students’ mathematics learning: A systematic review and meta-analysis. International Journal of Science and Mathematics Education, 23(4), 1105–1126. https://doi.org/10.1007/s10763-024-10499-7
Yıldız, S. G., & Körpeoğlu, S. G. (2025). Trends and insights of AI in mathematics education: A bibliometric analysis. International Electronic Journal of Mathematics Education, 20(3), em0837. https://doi.org/10.29333/iejme/16401
Zhang, Y., Zhang, L., Zhang, H., & Wu, X. (2025). Development of a Computerized Adaptive Assessment and Learning System for Mathematical Ability Based on Cognitive Diagnosis. Journal of Intelligence, 13(9), 114. https://doi.org/10.3390/jintelligence13090114
Zimmerman, B. J. (2002). Becoming a self-regulated learner: An overview. Theory Into Practice, 41(2), 64–70. https://doi.org/10.1207/s15430421tip4102_2
Al-Nawaiseh, S. J., Tabieh, A. A., Maqableh, W. F., Altawalbeh, M., & Ahmad, F. B. (2024). The effectiveness of using educational robots in enhancing engineering mathematics skills among students in basic school. International Journal of Education and Practice, 12(3), 906-921. https://doi.org/10.18488/61.v12i3.3768
Awang, L. A., Yusop, F. D., & Danaee, M. (2025). Current practices and future direction of artificial intelligence in mathematics education: A systematic review. International Electronic Journal of Mathematics Education, 20(2), em0823. https://doi.org/10.29333/iejme/16006
Baker, R., & Siemens, G. (2014). Educational Data Mining and Learning Analytics. In R. K. Sawyer (Ed.), The Cambridge Handbook of the Learning Sciences (pp. 253–272). chapter, Cambridge: Cambridge University Press. https://doi.org/10.1017/CBO9781139519526.016
Baker, T., Smith, L., & Anissa, N. (2019). Educ-AI-tion rebooted? exploring the future of artificial intelligence in schools and colleges. In www.nesta.org.uk. Nesta. https://media.nesta.org.uk/documents/Future_of_AI_and_education_v5_WEB.pdf
Belpaeme, T., Kennedy, J., Ramachandran, A., Scassellati, B., & Tanaka, F. (2018). Social robots for education: A review. Science Robotics, 3(21), 1–10. https://doi.org/10.1126/scirobotics.aat5954
Berida, O., Oguntimilehin, A., Ajisafe, B., Adebusola, T.-O., Babalola, G., Akinduyite, O., Okebule, T., Obamiyi, S., & Sanya, O. (2024, April). SMat-Bot: An interactive chatbot for facilitating students’ comprehension of mathematics. In 2024 International Conference on Science, Engineering and Business for Driving Sustainable Development Goals (SEB4SDG) (pp. 1-8). IEEE. https://doi.org/10.1109/SEB4SDG60871.2024.10630005
Borenstein, M., Hedges, L. V, Higgins, J. P. T., & Rothstein, H. R. (2021). Introduction to Meta-Analysis. Second Edition. Wiley. https://doi.org/10.1002/9780470743386
Chen, L., Chen, P., & Lin, Z. (2020). Artificial intelligence in education: A review. IEEE Access, 8, 75264–75278. https://doi.org/10.1109/ACCESS.2020.2988510
Choi, Y., & McClenen, C. (2020). Development of adaptive formative assessment system using computerized adaptive testing and dynamic bayesian networks. Applied Sciences (Switzerland), 10(22), 1–17. https://doi.org/10.3390/app10228196
D’Mello, S., & Graesser, A. C. (2015). Feeling, thinking, and computing with affect-aware learning technologies. Feeling, thinking, and computing with affect-aware learning technologies. In R. Calvo, S. D’Mello, J. Gratch, & A. Kappas (Eds.), The Oxford handbook of affective computing. Oxford University Press. https://doi.org/10.1093/oxfordhb/9780199942237.013.032
Duval, S., & Tweedie, R. (2000). Trim and fill: A simple funnel-plot-based method of testing and adjusting for publication bias in meta-analysis. Biometrics, 56(2), 455–463. https://doi.org/10.1111/j.0006-341X.2000.00455.x
Ellington, L. M. (2026). Adaptive learning systems: revolutionizing student-centered education. In V. Wang (Ed.), AI, Personalization, Equity, and the Future of Learning (pp. 345-368). IGI Global Scientific Publishing. https://doi.org/10.4018/979-8-3373-5097-4.ch012
Fardian, D., Suryadi, D., Prabawanto, S., & Jupri, A. (2025). Integrating Chat-GPT in the classroom: A study on linear algebra learning in higher education. International Journal of Information and Education Technology, 15(4), 732–751. https://doi.org/10.18178/ijiet.2025.15.4.2279
Garcia, M. B., Acut, D. P., Arif, Y. M., Maher, D., Alex, J. K., Wardat, Y., Chiu, T. K. F., & Damaševičius, R. (2026). Modernizing mathematics education with artificial intelligence: A narrative review of ai-powered tools, thematic trends, and instructional applications. In A. Mazı (Ed.), The Convergence of Mathematics and AI: A New Paradigm in Education (pp. 153-186). IGI Global Scientific Publishing. https://doi.org/10.4018/979-8-3373-1998-8.ch006
Gürefe, N., Sarpkaya Aktaş, G., & Öksüz, H. (2024). Investigating the Impact of the AI-Supported 5E (AI-s5E) Instructional Model on Spatial Ability. Behavioral Sciences, 14, 682. https://doi.org/10.3390/bs14080682
Holmes, W., Bialik, M., & Fadel, C. (2019). Artificial intelligence in education: Promises and implications for teaching and learning. Center for Curriculum Redesign.
Hwang, S. (2022). Examining the effects of artificial intelligence on elementary students’ mathematics achievement: A meta-analysis. Sustainability, 14(20), 13185. https://doi.org/10.3390/su142013185
Khairunnisa, K., Sari, F. F., Anggelena, M., Agustina, D., & Nursa’adah, E. (2022). Penggunaan Effect Size Sebagai Mediasi dalam Koreksi Efek Suatu Penelitian. Jurnal Pendidikan Matematika (Judika Education), 5(2), 138–151. https://doi.org/10.31539/judika.v5i2.4802
Lampropoulos, G., & Papadakis, S. (2024). Maker education and educational robotics in the age of artificial intelligence. In S. Papadakis & G. Lampropoulos (Eds.), Intelligent educational robots: Toward personalized learning environments (pp. 1–8). De Gruyter. https://doi.org/10.1515/9783111352695-001
Létourneau, A., Deslandes Martineau, M., Charland, P., Karran, J. A., Boasen, J., & Léger, P. M. (2025). A systematic review of AI-driven intelligent tutoring systems (ITS) in K-12 education. Npj Science of Learning, 10(1), 29. https://doi.org/10.1038/s41539-025-00320-7
Lu, Y., Pian, Y., Chen, P., Meng, Q., & Cao, Y. (2021). RadarMath: An Intelligent Tutoring System for Math Education. Proceedings of the AAAI Conference on Artificial Intelligence, 35(18), 16087–16090. https://doi.org/10.1609/aaai.v35i18.18020
Memiş, Y. (2025). Examining the potential and pitfalls of AI in problem solving. Journal of Pedagogical Research, 9(2), 177–190. https://doi.org/10.33902/JPR.202532099
Niño, F., Lancheros-Cuesta, D., Jiménez-Valderrama, M., Mestre, G., & Gómez, S. (2023). Systematic Review: Trends in Intelligent Tutoring Systems in Mathematics Teaching and Learning. International Journal of Education in Mathematics, Science and Technology, 12, 203–229. https://doi.org/10.46328/ijemst.3189
Onesimus Laia, H., Martadiputra, B. A. P., & Dahlan, J. A. (2025). The Effect of Logical-Mathematical Intelligence on Mathematics Learning and Moderator Analysis: A Meta- Analysis. Al-Jabar: Jurnal Pendidikan Matematika, 16(1), 129–149. https://doi.org/10.24042/ajpm.v16i1.25539
Opesemowo, O. A. G. (2025). Artificial Intelligence in Mathematics Education: The Pros and Cons. In M. Khosrow-Pour, D.B.A. (Ed.), Encyclopedia of Information Science and Technology, Sixth Edition. Advance online publication. https://doi.org/10.4018/978-1-6684-7366-5.ch084
Ouyang, F., & Xu, W. (2024). The effects of educational robotics in STEM education: A multilevel meta-analysis. International Journal of STEM Education, 11(1). https://doi.org/10.1186/s40594-024-00469-4
Ruppar, T. (2020). Meta-analysis: How to quantify and explain heterogeneity? European Journal of Cardiovascular Nursing, 19(7), 646–652. https://doi.org/10.1177/1474515120944014
Seban, P., & Urban, K. (2024). Examining the Utilisation of Learning Techniques and Strategies Among Pedagogy Students : Implications for Self-Regulated Learning. Journal of Pedagogy, 15, 27–49. https://doi.org/10.2478/jped-2024-0002
Sedgwick, P. (2015). Meta-analyses: What is heterogeneity? BMJ, 350, h1435. https://doi.org/10.1136/bmj.h1435
Sterne, J. A. C., Sutton, A. J., Ioannidis, J. P. A., Terrin, N., Jones, D. R., Lau, J., Carpenter, J., Rücker, G., Harbord, R. M., Schmid, C. H., Tetzlaff, J., Deeks, J. J., Peters, J., Macaskill, P., Schwarzer, G., Duval, S., Altman, D. G., Moher, D., & Higgins, J. P. T. (2011). Recommendations for examining and interpreting funnel plot asymmetry in meta-analyses of randomised controlled trials. BMJ, 343, d4002. https://doi.org/10.1136/bmj.d4002
Surbakti, R., Umboh, S., Pong, M., & Dara, S. (2024). Cognitive Load Theory: Implications for Instructional Design in Digital Classrooms. International Journal of Educational Narratives, 2, 483–493. https://doi.org/10.70177/ijen.v2i6.1659
Sweller, J. (2011). Cognitive load theory. In J. P. Mestre & B. H. Ross (Eds.), Psychology of learning and motivation (Vol. 55, pp. 37–76). Academic Press. https://doi.org/10.1016/B978-0-12-387691-1.00002-8
Thalheimer, W., & Cook, S. (2002). How to calculate effect sizes from published research. Work-Learning Research, 1(August), 1–9. www.work-learning.com
Wahba, F., Ajlouni, A., & Abumosa, M. (2024). The impact of ChatGPT-based learning statistics on undergraduates’ statistical reasoning and attitudes toward statistics. Eurasia Journal of Mathematics, Science and Technology Education, 20, em2468. https://doi.org/10.29333/ejmste/14726
Wu, X. -Y. (2024). Artificial intelligence in L2 learning: A meta-analysis of contextual, instructional, and social-emotional moderators. System, 126, 103498. https://doi.org/10.1016/j.system.2024.103498
Yi, L., Liu, D., Jiang, T., & Xian, Y. (2025). The effectiveness of AI on K-12 students’ mathematics learning: A systematic review and meta-analysis. International Journal of Science and Mathematics Education, 23(4), 1105–1126. https://doi.org/10.1007/s10763-024-10499-7
Yıldız, S. G., & Körpeoğlu, S. G. (2025). Trends and insights of AI in mathematics education: A bibliometric analysis. International Electronic Journal of Mathematics Education, 20(3), em0837. https://doi.org/10.29333/iejme/16401
Zhang, Y., Zhang, L., Zhang, H., & Wu, X. (2025). Development of a Computerized Adaptive Assessment and Learning System for Mathematical Ability Based on Cognitive Diagnosis. Journal of Intelligence, 13(9), 114. https://doi.org/10.3390/jintelligence13090114
Zimmerman, B. J. (2002). Becoming a self-regulated learner: An overview. Theory Into Practice, 41(2), 64–70. https://doi.org/10.1207/s15430421tip4102_2