Publion

Balancing Artificial Intelligence and Human Oversight in Education

Aizada Bektemirova1Ruslan Omuraliev2

1Kyrgyz National University, Bishkek, Kyrgyzstan

2Osh State University, Osh, Kyrgyzstan

Published: Jun 04, 2026

Abstract

The rapid development of generative artificial intelligence, particularly large language models, has introduced significant transformations in educational environments and learning practices. These technologies enable automated content generation, personalized learning assistance, and new forms of interaction between students, instructors, and knowledge systems, raising questions about the role of human guidance and critical evaluation in AI-supported learning contexts. The purpose of this study is to examine the conceptual relationship between human oversight and critical literacy within AI-supported learning environments in higher education and general education systems. The research employs a qualitative literature review approach combined with conceptual analysis to synthesize scholarly discussions on artificial intelligence in education, digital literacy, and educational technology integration. Secondary data were collected from peer-reviewed academic publications, scholarly reports, and theoretical works addressing the educational use of large language models and the implications of AI-supported learning systems. The collected literature was analyzed through thematic interpretation to identify key conceptual dimensions related to human supervision, critical literacy competencies, and the pedagogical integration of AI technologies in education. Analytical synthesis was conducted to examine how existing theoretical perspectives frame the interaction between generative AI systems and human-centered learning processes. The analysis highlights that AI-supported learning environments require continuous human oversight and the development of critical literacy competencies to ensure the responsible use and interpretation of AI-generated information. These findings emphasize that generative AI should function as a supportive educational tool rather than a substitute for human instruction and analytical reasoning. The study contributes to the field of educational technology by providing a conceptual framework that integrates human oversight and critical literacy as key components for responsible AI integration in contemporary learning environments.

Keywords

Artificial intelligenceEducational technologyHigher educationDigital literacy

Introduction

The introduction explains that the rapid growth of large language models has changed the structure of educational environments, especially in higher education and broader education systems. These models can generate text, answer questions, summarize information, and support complex cognitive tasks related to learning and writing. Their presence has expanded opportunities for personalized learning, interactive feedback, and automated support for students and instructors.

The article emphasizes that the adoption of AI-supported learning technologies reflects a wider movement toward digital, data-driven, and technology-enhanced education. However, the use of generative AI also challenges traditional assumptions about knowledge production, academic integrity, and the role of human guidance. As a result, educational institutions must reconsider how oversight and critical literacy should operate in AI-supported learning environments.

A major concern raised in the introduction is the reliability and responsible use of AI-generated information. Large language models can produce coherent and authoritative-looking responses, but such outputs may contain inaccuracies, bias, or unverifiable claims. This creates risks for students and educators who may struggle to distinguish validated knowledge from plausible but unsupported information.

The introduction also connects AI use with issues of academic integrity, intellectual autonomy, and critical thinking. If students rely too heavily on generative AI, their ability to reason independently and engage in scholarly inquiry may weaken. Therefore, the problem is not only technological but also educational, because it affects the way learning is structured, supervised, and evaluated.

Existing scholarship recognizes that large language models can support education through automated feedback, personalized instruction, content generation, quiz creation, programming explanations, and collaborative learning. These functions can reduce teacher workload and improve student engagement when used appropriately. However, the article stresses that AI must remain an assistive tool rather than a replacement for human educators.

The introduction identifies an important research gap: although many studies discuss the capabilities and risks of AI in education, fewer studies examine how students cognitively interact with AI-generated knowledge. There is still uncertainty about how learners evaluate AI outputs, how reliance on automated systems affects analytical reasoning, and how institutions should structure oversight mechanisms.

The article argues that human oversight, critical literacy, digital literacy, and AI governance should be examined together rather than separately. Critical literacy requires learners to question, interpret, and contextualize information instead of passively accepting textual outputs. Applied to AI-generated content, this means students must learn to interrogate algorithmically produced knowledge.

The introduction concludes by stating that the study aims to explore the conceptual relationship between human oversight and critical literacy in AI-supported learning environments. It focuses on how educational institutions can maintain pedagogical integrity, support independent reasoning, and integrate generative AI responsibly. The urgency of the study comes from the rapid spread of AI tools in universities, schools, and digital learning platforms worldwide.

Research Method

The study uses a qualitative research design based on literature review and conceptual analysis. This approach is suitable because the research aims to explore theoretical perspectives, interpret scholarly discussions, and synthesize conceptual insights rather than test hypotheses through quantitative measurement. The article examines how academic literature frames the roles of AI technologies, human supervision, and critical literacy in educational contexts.

The data consist of secondary sources, including peer-reviewed journal articles, scholarly books, and academic reports related to artificial intelligence in education, large language models, digital literacy, and learning environments. The study analyzes these sources through structured reading and thematic categorization. Trustworthiness is maintained by using credible academic sources, applying consistent thematic interpretation, comparing findings across multiple works, and acknowledging all original authors through proper citation.

Results and Discussion

The discussion has examined the growing presence of generative artificial intelligence in educational environments and the implications this transformation holds for knowledge practices within higher education and broader education systems. AI-supported learning environments introduce new forms of interaction between learners and information, particularly through the use of large language models capable of generating explanations, feedback, and instructional content. Within this evolving context, the importance of human oversight becomes evident as a mechanism that ensures the credibility, relevance, and pedagogical alignment of AI-generated information. Critical literacy also emerges as an essential competency that enables learners to evaluate algorithmically produced knowledge and distinguish between plausible outputs and academically verified information. The relationship between technological capability and human interpretation therefore becomes central to the functioning of AI-supported education. Educational environments increasingly require frameworks that maintain the integrity of scholarly inquiry while incorporating the advantages of generative technologies. The integration of AI within learning systems thus highlights the need for balanced interaction between algorithmic assistance, instructional guidance, and analytical engagement.

The analysis contributes to the broader field of educational technology and digital literacy by clarifying the conceptual relationship between human oversight and critical literacy within AI-supported learning environments. By synthesizing theoretical perspectives from educational technology studies and digital literacy research, the discussion highlights the role of human-centered pedagogical principles in shaping the responsible use of generative AI. This perspective emphasizes that technological systems should function as cognitive supports rather than substitutes for academic reasoning. The conceptual framework presented demonstrates how AI capabilities must operate within structures of supervision and evaluative learning practices to maintain intellectual rigor. Such a framework contributes to ongoing debates concerning the integration of generative AI in higher education by foregrounding the importance of institutional governance, pedagogical adaptation, and student analytical competencies. The emphasis on critical literacy further extends existing discussions on digital literacy by addressing the interpretative challenges associated with algorithmically generated knowledge. In this way, the discussion advances scholarly understanding of how educational systems can integrate AI technologies while preserving core academic values.

Future research should extend this conceptual discussion by examining the practical dynamics of AI-supported learning environments through empirical investigation. Studies that analyze how students interact with generative AI tools in real educational contexts would provide deeper insight into the development of critical literacy skills and evaluative reasoning. Investigations focusing on instructional strategies, curriculum design, and institutional governance frameworks may also clarify how human oversight can be operationalized within educational systems adopting AI technologies. Comparative research across different educational contexts would further illuminate how variations in institutional resources, digital infrastructure, and policy environments influence the adoption of AI-supported learning practices. Longitudinal studies may also contribute to understanding how sustained exposure to generative technologies shapes student learning behavior and intellectual engagement. Such research directions would strengthen the empirical foundation for discussions concerning responsible AI integration in education. Expanding interdisciplinary collaboration between educational researchers, technologists, and policymakers will also be important for addressing the evolving challenges associated with generative AI in learning environments.

Conclusion

The discussion has examined the growing presence of generative artificial intelligence in educational environments and the implications this transformation holds for knowledge practices within higher education and broader education systems. AI-supported learning environments introduce new forms of interaction between learners and information, particularly through the use of large language models capable of generating explanations, feedback, and instructional content. Within this evolving context, the importance of human oversight becomes evident as a mechanism that ensures the credibility, relevance, and pedagogical alignment of AI-generated information. Critical literacy also emerges as an essential competency that enables learners to evaluate algorithmically produced knowledge and distinguish between plausible outputs and academically verified information. The relationship between technological capability and human interpretation therefore becomes central to the functioning of AI-supported education. Educational environments increasingly require frameworks that maintain the integrity of scholarly inquiry while incorporating the advantages of generative technologies. The integration of AI within learning systems thus highlights the need for balanced interaction between algorithmic assistance, instructional guidance, and analytical engagement.

The analysis contributes to the broader field of educational technology and digital literacy by clarifying the conceptual relationship between human oversight and critical literacy within AI-supported learning environments. By synthesizing theoretical perspectives from educational technology studies and digital literacy research, the discussion highlights the role of human-centered pedagogical principles in shaping the responsible use of generative AI. This perspective emphasizes that technological systems should function as cognitive supports rather than substitutes for academic reasoning. The conceptual framework presented demonstrates how AI capabilities must operate within structures of supervision and evaluative learning practices to maintain intellectual rigor. Such a framework contributes to ongoing debates concerning the integration of generative AI in higher education by foregrounding the importance of institutional governance, pedagogical adaptation, and student analytical competencies. The emphasis on critical literacy further extends existing discussions on digital literacy by addressing the interpretative challenges associated with algorithmically generated knowledge. In this way, the discussion advances scholarly understanding of how educational systems can integrate AI technologies while preserving core academic values.

Future research should extend this conceptual discussion by examining the practical dynamics of AI-supported learning environments through empirical investigation. Studies that analyze how students interact with generative AI tools in real educational contexts would provide deeper insight into the development of critical literacy skills and evaluative reasoning. Investigations focusing on instructional strategies, curriculum design, and institutional governance frameworks may also clarify how human oversight can be operationalized within educational systems adopting AI technologies. Comparative research across different educational contexts would further illuminate how variations in institutional resources, digital infrastructure, and policy environments influence the adoption of AI-supported learning practices. Longitudinal studies may also contribute to understanding how sustained exposure to generative technologies shapes student learning behavior and intellectual engagement. Such research directions would strengthen the empirical foundation for discussions concerning responsible AI integration in education. Expanding interdisciplinary collaboration between educational researchers, technologists, and policymakers will also be important for addressing the evolving challenges associated with generative AI in learning environments.

References

Abimbola, C., Eden, C. A., Chisom, O. N., & Adeniyi, I. S. (2024). AI integration in education offers transformative opportunities, but ethical considerations and data privacy concerns must be addressed for effective implementation and equitable outcomes. Journal of Educational Technology Systems.

Al Fraidan, A. (2024). AI-driven assessments can enhance accuracy, fairness, and skill development in education, but require a balanced approach that maintains human oversight for fairness, accountability, and holistic student development. Journal of Applied Research in Higher Education.

Alzahrani, A. (2024). Unveiling the shadows: Beyond the hype of AI in education. Heliyon, 10(11), e30696. https://doi.org/10.1016/j.heliyon.2024.e30696

Assarroudi, A., Nabavi, F. H., Armat, M., Ebadi, A., & Vaismoradi, M. (2018). Directed qualitative content analysis: the description and elaboration of its underpinning methods and data analysis process. Journal of Research in Nursing, 23(1), 42-55. https://doi.org/10.1177/1744987117741687

Atchley, P., Pannell, H., Wofford, K., Hopkins, M., & Atchley, R. (2024). Cognitive psychology research can help educators use AI in higher education as a facilitator for learning, rather than a threat, by capitalizing on metacognition knowledge and skills. Journal of Applied Research in Higher Education.

Azman, Ö., & Tümkaya, S. (2025). AI integration in education can improve student outcomes, but ethical guidelines are needed to balance innovation with fairness, accountability, and inclusivity. International Journal of Educational Research Open.

Bako, N. Z. (2025). Ethical AI in schools: Balancing automation, privacy, and human oversight. World Journal of Advanced Engineering Technology and Sciences, 15(1), 211-218. https://doi.org/10.30574/wjaets.2025.15.1.0262

Bingham, A. J. (2023). From Data Management to Actionable Findings: A Five-Phase Process of Qualitative Data Analysis. International Journal of Qualitative Methods, 22. https://doi.org/10.1177/16094069231183620

Chan, C. (2024). Integrating AI and holistic competencies in education can enhance personal and professional well-being, while addressing ethical challenges and preparing students for a rapidly evolving technological landscape. International Journal of Educational Technology in Higher Education.

Cheong, H., Lyons, A., Houghton, R., & Majumdar, A. (2023). Secondary Qualitative Research Methodology Using Online Data within the Context of Social Sciences. International Journal of Qualitative Methods, 22. https://doi.org/10.1177/16094069231213824

Colonna, L. (2025). The EU AI Act needs more precise alignment between AI and education regulation for effective regulation of AI in higher education. European Journal of Law and Technology.

Cukurova, M. (2024). AI's role in education should be viewed as an instrument for understanding human learning, rather than just a tool, and should be integrated with human cognition through human-AI hybrid intelligence systems. British Journal of Educational Technology.

Dabis, A., & Csáki, C. (2024). AI and ethics: Investigating the first policy responses of higher education institutions to the challenge of generative AI. Humanities and Social Sciences Communications, 11(1). https://doi.org/10.1057/s41599-024-03526-z

Dabis, A., & Csáki, C. (2024). AI and ethics: Investigating the first policy responses of higher education institutions to the challenge of generative AI. Humanities and Social Sciences Communications, 11(1). https://doi.org/10.1057/s41599-024-03526-z

Deepshikha, D. (2025). AI-driven grading and personalized feedback in higher education improve efficiency, consistency, and scalability while reducing human bias, but ethical concerns and data privacy must be addressed for ethical use. Journal of Digital Learning in Teacher Education.

Elbardan, H., & Kholeif, A. (2017). An Interpretive Approach for Data Collection and Analysis. In Enterprise Resource Planning, Corporate Governance and Internal Auditing (pp. 121-157). Springer, Cham. https://doi.org/10.1007/978-3-319-54990-3_5

Gephart, R., & Saylors, R. G. (2020). Qualitative Designs and Methodologies for Business, Management, and Organizational Research. Oxford Research Encyclopedia of Business and Management. https://doi.org/10.1093/acrefore/9780190224851.013.155

Gordon, M., Daniel, M., Ajiboye, A., Uraiby, H., Xu, N. Y., Bartlett, R., Hanson, J., Haas, M., Spadafore, M. T., Grafton-Clarke, C., Gasiea, R. Y., Michie, C., Corral, J., Kwan, B., Dolmans, D. H. J. M., & Thammasitboon, S. (2024). A scoping review of artificial intelligence in medical education. Medical Teacher, 46(5), 653-673. https://doi.org/10.1080/0142159x.2024.2314198

Hussain, I., Rasool, S., & Tabassum, S. (2025). Human-AI collaboration in education enhances student learning, task management, and decision-making while maintaining human importance in the educational process. Journal of Educational Computing Research.

Ifenthaler, D., & Schumacher, C. (2023). AI and human intelligence can enhance learning and teaching by collaborating in real-time, enhancing human decision-making and enhancing efficiency in educational settings. Journal of Computing in Higher Education.

Ifenthaler, D., Majumdar, R., Gorissen, P., Judge, M., Mishra, S., Raffaghelli, J., & Shimada, A. (2024). AI in education should be integrated with human involvement, focusing on privacy, ethical use, trustworthy algorithms, and equity and fairness. Educational Technology Research and Development.

Kiger, M. E., & Varpio, L. (2020). Thematic analysis of qualitative data: AMEE Guide No. 131. Medical Teacher, 42(8), 846-854. https://doi.org/10.1080/0142159x.2020.1755030

Kopuz, E., & Kartal, G. (2025). Collaborative Human–AI Research Practices: Identifying Critical Touchpoints for Human Intervention in Educational Research. IEEE Transactions on Learning Technologies. https://doi.org/10.1109/tlt.2025.3587488

Lewis, S. (2015). Qualitative Inquiry and Research Design: Choosing Among Five Approaches. Health Promotion Practice, 16(4), 473-475. https://doi.org/10.1177/1524839915580941

Lochmiller, C. R. (2021). Conducting Thematic Analysis with Qualitative Data. The Qualitative Report, 26(6), 2029-2044. https://doi.org/10.46743/2160-3715/2021.5008

Luckin, R. (2024). The future of education involves harnessing AI while fostering human intelligence, focusing on critical thinking, creativity, and problem-solving skills, while preserving the unique human touch in the learning process. International Journal of Artificial Intelligence in Education.

Molenaar, I. (2022). A common language for AI in education is needed to facilitate dialogue among stakeholders, including researchers, educators, entrepreneurs, and policymakers, to enhance meaningful AI applications in learning and teaching. Learning and Instruction.

Morgan, H. (2022). Conducting a Qualitative Document Analysis. The Qualitative Report, 27(1), 64-77. https://doi.org/10.46743/2160-3715/2022.5044

Prabu Revolusi, & Krisna Febriandy, R. (2025). AI integration in education can enhance efficiency and inclusivity, but requires robust regulations, data protection, algorithm bias mitigation, and teacher training for fair and ethical implementation. Journal of Educational Technology.

Pratt, M. G. (2025). On the Evolution of Qualitative Methods in Organizational Research. Journal of Management.

Qassrawi, R., & Al Karasneh, S. A. (2025). AI can enhance language proficiency and streamline teaching methods, but it cannot replace human educators; a balance between AI-driven instruction and traditional methods is needed for optimal learning outcomes. Interactive Learning Environments.

Renta-Davids, A., Camarero‐Figuerola, M., & Camacho, M. (2025). AI integration in educational leadership can enhance decision-making and administrative tasks, but ethical considerations and continuous professional development are crucial for effective integration and addressing risks like algorithmic bias and data privacy. Educational Management Administration & Leadership.

Roberts, K., Dowell, A., & Nie, J. (2019). Attempting rigour and replicability in thematic analysis of qualitative research data; a case study of codebook development. BMC Medical Research Methodology, 19(1). https://doi.org/10.1186/s12874-019-0707-y

Ruggiano, N., & Perry, T. E. (2017). Conducting secondary analysis of qualitative data: Should we, can we, and how? Qualitative Social Work, 18(1), 81-97. https://doi.org/10.1177/1473325017700701

Schiff, D. S. (2021). AI in education is largely absent from national AI policy strategies, with the focus on AI-ready workforce and expert training, and its ethical implications receive scant attention. Educational Policy.

Selvam, M., & González Vallejo, R. (2025). The Human-in-the-Loop (HITL) grading framework balances AI speed with human oversight, promoting fairer evaluations and preserving academic integrity while reducing grading time and improving student satisfaction. International Journal of Educational Technology in Higher Education.

Soni, G. (2025). AI integration in education can enhance learning outcomes but should supplement traditional pedagogy and require structured policies, teacher training, and ethical guidelines for responsible use. Educational Review.

Tang, Q., Deng, W., Huang, Y., Wang, S., & Zhang, H. (2025). Generative AI-assisted teaching can enhance students' learning satisfaction, but only when supervised by a teacher. Computers & Education.

Trindade, M. A. M., Edirisinghe, G. S., & Luo, L. (2024). Teaching mathematical concepts in management with generative artificial intelligence: The power of human oversight in AI-driven learning. The International Journal of Management Education, 22(3), 101104. https://doi.org/10.1016/j.ijme.2024.101104

Download