AI Literacy, AI Dependency, and Computational Thinking Skills of University Students in Linear Algebra Learning: A PLS-SEM Approach

Mahyudi Mahyudi; Endaryono Endaryono; Rifki Ristiawan; Aswin Saputra

doi:10.26737/var.v9i1.9694

AI Literacy, AI Dependency, and Computational Thinking Skills of University Students in Linear Algebra Learning: A PLS-SEM Approach

Mahyudi Mahyudi, Endaryono Endaryono, Rifki Ristiawan, Aswin Saputra

Abstract

The rapid integration of Artificial Intelligence (AI) into higher education has created new opportunities for learning while raising concerns about students’ cognitive autonomy. This study investigated the effects of AI literacy on AI dependency and computational thinking skills, as well as the relationship between AI dependency and computational thinking skills in Linear Algebra learning. The population comprised undergraduate students enrolled in Linear Algebra, with 120 students selected through purposive sampling based on their involvement in the course and experience with AI-supported learning. A quantitative survey method was employed, and the data were analysed using Partial Least Squares Structural Equation Modelling (PLS-SEM). The model consisted of AI Literacy (LA), AI Dependency (KD), and Computational Thinking Skills (CT). The initial measurement model included eight LA indicators, six KD indicators, and six CT indicators. Three indicators (LA7, KD6, and CT5) were removed because their loading factors were below 0.60. After re-estimation, all retained indicators exceeded 0.70, with AVE values of 0.842, 0.844, and 0.753 for AI literacy, AI dependency, and computational thinking skills, respectively. AI literacy positively and significantly predicted AI dependency (β=0.629, t=11.849, p<0.001) and computational thinking skills (β=0.527, t=4.893, p<0.001). AI dependency had a negative but non-significant relationship with computational thinking skills (β=-0.171, t=1.449, p=0.074). The R² was 0.198, while effect sizes were 2.073 for AI literacy and 0.022 for AI dependency. The findings indicated that AI literacy is more influential than AI dependency in explaining students’ computational thinking.

Keywords

AI Literacy; AI Dependency; Computational Thinking Skills; Linear Algebra; PLS-SEM

Full Text:

PDF

References

Abbas, M., Jam, F. A., & Khan, T. I. (2024). Is it harmful or helpful? Examining the causes and consequences of generative AI usage among university students. International Journal of Educational Technology in Higher Education, 21, 10. https://doi.org/10.1186/s41239-024-00444-7

Almatrafi, O., Johri, A., & Lee, H. (2024). A systematic review of AI literacy conceptualization, constructs, and implementation and assessment efforts (2019–2023). Computers and Education Open, 6, 100173. https://doi.org/10.1016/j.caeo.2024.100173

Ayanwale, M. A., Adelana, O. P., Molefi, R. R., Adeeko, O., & Ishola, A. M. (2024). Examining artificial intelligence literacy among pre-service teachers for future classrooms. Computers and Education Open, 6, 100179. https://doi.org/10.1016/j.caeo.2024.100179

Cheung, G. W., Cooper-Thomas, H. D., Lau, R. S., & Wang, L. C. (2024). Reporting reliability, convergent and discriminant validity with structural equation modeling: A review and best-practice recommendations. Asia Pacific Journal of Management, 41, 745–783. https://doi.org/10.1007/s10490-023-09871-y

Chiu, T. K. F. (2023). The impact of generative AI (GenAI) on practices, policies and research direction in education: A case of ChatGPT and Midjourney. Interactive Learning Environments. https://doi.org/10.1080/10494820.2023.2253861

Chiu, T. K. F., Ahmad, Z., Ismailov, M., & Sanusi, I. T. (2024). What are artificial intelligence literacy and competency? A comprehensive framework to support them. Computers and Education Open, 6, 100171. https://doi.org/10.1016/j.caeo.2024.100171

Essien, A. E., Bukoye, T., O’Dea, C., & Kremantzis, M. D. (2024). The influence of AI text generators on critical thinking skills in UK business schools. Studies in Higher Education, 49(5), 865–882. https://doi.org/10.1080/03075079.2024.2316881

Hair, J. F., & Alamer, A. (2022). Partial least squares structural equation modeling (PLS-SEM) in second language and education research: Guidelines using an applied example. Research Methods in Applied Linguistics, 1(3), 100027. https://doi.org/10.1016/j.rmal.2022.100027

Hair, J. F., Hult, G. T. M., Ringle, C. M., Sarstedt, M., Danks, N. P., & Ray, S. (2021). Partial least squares structural equation modeling (PLS-SEM) using R: A workbook. Springer.

Hornberger, M., Bewersdorff, A., & Nerdel, C. (2023). What do university students know about artificial intelligence? Development and validation of an AI literacy test. Computers and Education: Artificial Intelligence, 5, 100165. https://doi.org/10.1016/j.caeai.2023.100165

Korte, S.-M., Cheung, W. M.-Y., Maasilta, M., Kong, S.-C., Keskitalo, P., Wang, L., Lau, C. M., Lee, J. C. K., & Gu, M. M. (2024). Enhancing artificial intelligence literacy through cross-cultural online workshops. Computers and Education Open, 6, 100164. https://doi.org/10.1016/j.caeo.2024.100164

Mansoor, H. M. H., Bawazir, A., Alsabri, M. A., Alharbi, A., & Okela, A. H. (2024). Artificial intelligence literacy among university students—a comparative transnational survey. Frontiers in Communication, 9, 1478476. https://doi.org/10.3389/fcomm.2024.1478476

Moorhouse, B. L., Yeo, M. A., & Wan, Y. (2023). Generative AI tools and assessment: Guidelines of the world's top-ranking universities. Computers and Education Open, 4, 100151. https://doi.org/10.1016/j.caeo.2023.100151

Ruiz-Rojas, L. I., Salvador-Ullauri, L., & Acosta-Vargas, P. (2024). Collaborative working and critical thinking: Adoption of generative artificial intelligence tools in higher education. Sustainability, 16(13), 5367. https://doi.org/10.3390/su16135367

Sarstedt, M., Hair, J. F., Nitzl, C., Ringle, C. M., & Howard, M. C. (2020). Beyond a tandem analysis of SEM and PROCESS: Use of PLS-SEM for mediation analyses! International Journal of Market Research, 62(3), 288–299. https://doi.org/10.1177/1470785320915686

Sperling, K., Stenberg, C.-J., McGrath, C., Åkerfeldt, A., Heintz, F., & Stenliden, L. (2024). In search of artificial intelligence (AI) literacy in teacher education: A scoping review. Computers and Education Open, 6, 100169. https://doi.org/10.1016/j.caeo.2024.100169

Stolpe, K., & Hallström, J. (2024). Artificial intelligence literacy for technology education. Computers and Education Open, 6, 100159. https://doi.org/10.1016/j.caeo.2024.100159

Supriyadi, S., & Nasution, Z. (2024). Teknologi artificial intelligence (AI) dan literasi digital mahasiswa terhadap hasil belajar mata kuliah evaluasi pembelajaran. Jurnal TEKNODIK. https://doi.org/10.32550/teknodik.vi.1185

Tian, J., & Zhang, R. (2025). Learners' AI dependence and critical thinking: The psychological mechanism of fatigue and the social buffering role of AI literacy. Acta Psychologica, 260, 105725. https://doi.org/10.1016/j.actpsy.2025.105725

Tzirides, A. O., Zapata, G., Kastania, N. P., Saini, A. K., Castro, V., Ismael, S. A. R., You, Y., Santos, T. A. dos, Searsmith, D., O'Brien, C., Cope, B., & Kalantzis, M. (2024). Combining human and artificial intelligence for enhanced AI literacy in higher education. Computers and Education Open, 6, 100184. https://doi.org/10.1016/j.caeo.2024.100184

Walter, Y. (2024). Embracing the future of artificial intelligence in the classroom: The relevance of AI literacy, prompt engineering, and critical thinking in modern education. International Journal of Educational Technology in Higher Education, 21, 15. https://doi.org/10.1186/s41239-024-00448-3

Xiao, J., Alibakhshi, G., Zamanpour, A., Zarei, M. A., Sherafat, S., & Behzadpoor, S.-F. (2024). How AI literacy affects students' educational attainment in online learning: Testing a structural equation model in higher education context. The International Review of Research in Open and Distributed Learning, 25(3), 179–198. https://doi.org/10.19173/irrodl.v25i3.7720

Yılmaz, R., & Karaoglan Yılmaz, F. G. (2023). The effect of generative artificial intelligence (AI)-based tool use on students' computational thinking skills, programming self-efficacy and motivation. Computers and Education: Artificial Intelligence, 4, 100147. https://doi.org/10.1016/j.caeai.2023.100147

Zhai, C., Wibowo, S., & Li, L. D. (2024). The effects of over-reliance on AI dialogue systems on students' cognitive abilities: A systematic review. Smart Learning Environments, 11, 28. https://doi.org/10.1186/s40561-024-00316-7

Zhang, D., Wijaya, T. T., Wang, Y., et al. (2025). Exploring the relationship between AI literacy, AI trust, AI dependency, and 21st century skills in preservice mathematics teachers. Scientific Reports, 15, 14281. https://doi.org/10.1038/s41598-025-99127-0

Zhang, S., Zhao, X., Zhou, T., et al. (2024). Do you have AI dependency? The roles of academic self-efficacy, academic stress, and performance expectations on problematic AI usage behavior. International Journal of Educational Technology in Higher Education, 21, 34. https://doi.org/10.1186/s41239-024-00467-0

Zhong, B., & Liu, X. (2024). Evaluating AI literacy of secondary students: Framework and scale development. Computers & Education, 214, 105230. https://doi.org/10.1016/j.compedu.2024.105230

DOI: http://dx.doi.org/10.26737/var.v9i1.9694

Refbacks

There are currently no refbacks.

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.

Publisher:

Institute of Managing and Publishing of Scientific Journals, STKIP Singkawang

Address : STKIP Singkawang, Jalan STKIP - Kelurahan Naram, Singkawang, Kalimantan Barat, INDONESIA, 79251
No. Telp. : +62562 420 0344
No. Fax. : +62562 420 0584

VARIABEL

e-ISSN : 2599-3038

p-ISSN : 2599-302X