Regional Finalist, SARC 2025
To What Extent Does AI-Precision Education Improve Student Learning Outcomes Compared to Traditional Instructional Methods
By Bekam Jogora, Ethiopia
Abstract:
This study investigates the comparative effectiveness of AI-Precision education and traditional instructional methods in enhancing student learning outcomes. The study employs a mixedmethods approach, analyzing quantitative metrics like grades and engagement levels, alongside qualitative insights from student and teacher feedback. Using a dataset from the Kalboard 360 Learning Management System, the research compares two groups of 240 students each—one using AI-Precision tools and the other traditional methods—over one academic year. Through a mixed-methods approach, data from 480 students were analyzed across metrics such as academic performance, engagement, retention, and satisfaction. I hypothesize that AI-Precision education leads to significantly better learning outcomes. Engagement, retention, and satisfaction will all be higher, with large effect sizes across metrics (e.g., Cohen’s d > 2.0 in most categories) for AIprecision group. However, its scalability and suitability for humanities subjects (e.g., critical thinking) suggest a hybrid model may be optimal.
Introduction:
Background:
The integration of artificial intelligence (AI) in education has revolutionized learning paradigms, shifting from uniform instruction to personalized, data-driven approaches. AI-Precision education, akin to precision medicine, tailors content to individual student needs using adaptive algorithms and real-time feedback (Chen et al., 2023).
Problem Statement:
Traditional education often fails to accommodate diverse learning paces and styles, leading to disengagement and inequitable outcomes (Zhang, 2023). AI-Precision education offers a solution by dynamically adjusting to student needs, yet its broader impact—particularly in comparison to traditional methods—remains underexplored.
This study asks: To what extent does AI-Precision education improve student learning outcomes compared to traditional instructional methods?
Literature Review:
The concept of personalized learning is not new—thinkers like John Dewey and Maria Montessori championed student-centered approaches a century ago. However, technological limitations hindered widespread adoption until recent advancements in AI. Chen et al. (2023) highlight how machine learning algorithms, such as reinforcement learning and neural networks, analyze student data to optimize learning experiences. These technologies align with Vygotsky’s Zone of Proximal Development, dynamically adjusting task difficulty to match a student’s current ability. (Vygotsky, 1978)
Empirical studies underscore AI-Precision’s advantages. Huang et al. (2022) found that AIsupported environments increased student engagement and test performance compared to traditional settings. A meta-analysis by Smith (2022) confirmed that AI-Precision students consistently outperformed peers in traditional classrooms across grades, retention, and satisfaction. Zhang (2023) notes that real-time feedback and personalized learning paths enhance knowledge acquisition and retention, addressing gaps often ignored in standardized curricula.
Comparative studies reveal AI-Precision’s superiority in performance metrics (Lim, 2022), yet few examine its differential impact across demographics or subjects. This study fills these gaps by analyzing gender-based outcomes and subject-specific efficacy.
Methodology:
This study will adopt a quasi-experimental design, comparing two groups of 240 students each from diverse backgrounds, taught over one academic year using the Kalboard 360 Learning Management System. The AI-Precision group will access adaptive learning algorithms, real-time feedback, and personalized content, while the Traditional group will use standard, non-AIenabled lessons. Students will be assigned based on prior academic performance (low, medium, high) and willingness, with a chi-square test (𝜒 2 ) confirming balanced group composition to minimize selection bias.
Data collection includes:
• Academic Performance: Final grades and retention rates (0-10 scale).
• Engagement Metrics: Frequency of hand raises, resource visits, announcement views, and discussion group participation.
• Satisfaction: Student feedback ratings (0-10) and parental satisfaction scores (0-5). • Qualitative Insights: Interviews with students and teachers to capture experiences and perceptions.
To control for confounders like prior performance and absence days, an Analysis of Covariance (ANCOVA) will be conducted. Quantitative data will be analyzed using t-tests and chi-square tests, with effect sizes (Cohen’s d, Cramér’s V) to assess practical significance. Qualitative data will be thematically coded to identify patterns in student and teacher experiences. This mixedmethods approach ensures a comprehensive evaluation of AI-Precision’s impact across multiple dimensions of learning.
References :
Chen, X., Li, M., & Zhang, Y. (2023). A review of using machine learning approaches for precision education. Journal of Educational Technology, 18(2), 123–145.
Huang, Y., Wang, L., & Liu, J. (2022). Effects and acceptance of precision education in an AI-supported smart learning environment. Computers & Education, 168, 104209.
Lim, L., Lim, S. H., & Lim, R. W. Y. (2022). Measuring learner satisfaction in adaptive systems. Behavioral Sciences, 12(8), 120–145.
Smith, J. (2022). The impact of AI on personalized learning. Journal of Educational Technology, 15(2), 123–145.
Vygotsky, L. S. (1978). Mind in Society: The Development of Higher Psychological Processes. Harvard University Press.
Zhang, D., & Wang, Q. (2023). Educational data mining: Enhancing teaching and learning. International Journal of Educational Data Mining, 15(3), 212–230.