Chapter 10 A Critical Review of Two Automated Adaptive Teaching Systems in Mathematics and Chemistry

Cognitive Tutor and ALEKS

In: Handbook of Research in Online Learning
Authors:
Gina Deckard
Search for other papers by Gina Deckard in
Current site
Google Scholar
PubMed
Close
and
Kay K. Seo
Search for other papers by Kay K. Seo in
Current site
Google Scholar
PubMed
Close

Purchase instant access (PDF download and unlimited online access):

$40.00

Abstract

The advancement of adaptive learning technologies has made tailored educational experiences possible in different settings across the education spectrum. Adaptive learning technology is any system that collects and interprets learner data to tailor the content, difficulty, and pace of instruction to their individual needs. Adaptive learning technologies are used in K-12 and higher education to support STEM learning across the US. However, the widespread use of these technologies is not assessed with the necessary robustness to declare their effectiveness in the different settings in which they are employed. This study describes current research dedicated to the analysis of adaptive learning for students 6–12 through college and addresses the lack of research in the literature on widely used adaptive technologies. Considering the technological advancements in the field of artificial intelligence (AI) of the last decade, systems built on AI frameworks should be scrutinized more carefully to determine their effectiveness and impact on students of different learning environments.

  • Collapse
  • Expand
  • ALEKS Accessibility Statement. (2023). ALEKS. Retrieved May 1, 2023, from http://www.mheducation.com/prek-12/program/microsites/MKTSP-GAB02M0/accessibility.html

  • Aravind, V. R., & McConnell, M. K. (2018). A computer-based tutor for learning energy and power. World Journal on Educational Technology: Current Issues, 10(3), 174185.

    • Search Google Scholar
    • Export Citation
  • Ashback, H. (2013). Bridging the gap. UCI News. Retrieved May 1, 2023, from https://news.uci.edu/2013/07/01/bridging-the-gap

  • Assistive Technology Industry Association. (2019) What is AT? Retrieved May 2, 2023, from https://www.atia.org/at-resources/what-is-at/

  • Avgerinos, E., & Karageorgiadis, A. (2017, April). On an adaptive formative assessment platform for STEM education. In 2017 IEEE Global Engineering Education Conference (EDUCON). IEEE.

    • Search Google Scholar
    • Export Citation
  • Barton, J. M. (2016). Mathematics intervention utilizing Carnegie learning’s cognitive tutor and compass learning’s odyssey math. Wilmington University (Delaware).

    • Search Google Scholar
    • Export Citation
  • Bernacki, M. L., Greene, M. J., & Lobczowski, N. G. (2021). A systematic review of research on personalized learning: Personalized by whom, to what, how, and for what purpose? Educational Psychology Review, 33(4), 16751715.

    • Search Google Scholar
    • Export Citation
  • Bloom, B. S. (1984). The 2 sigma problem: The search for methods of group instruction as effective as one-to-one tutoring. Educational Researcher, 13(6), 416.

    • Search Google Scholar
    • Export Citation
  • Boyce, S., & O’Halloran, J. (2020). Active learning in computer-based college algebra. Primus, 30(4), 458474.

  • Brewer, R., & Movahedazarhouligh, S. (2019). Flipped learning in flipped classrooms: A new pathway to prepare future special educators. Journal of Digital Learning in Teacher Education, 35(3), 128143.

    • Search Google Scholar
    • Export Citation
  • Cai, W., Grossman, J., Lin, Z. J., Sheng, H., Wei, J. T. Z., Williams, J. J., & Goel, S. (2021). Bandit algorithms to personalize educational chatbots. Machine Learning, 110(9), 23892418.

    • Search Google Scholar
    • Export Citation
  • Caldwell, C., & Hughes, R. (2021, August). An engineering summer bridge program utilizing a safe space to increase math efficacy. In 2021 first-year engineering experience.

    • Search Google Scholar
    • Export Citation
  • Cancado, L., Reisel, J., & Walker, C. (2018). Impacts of a summer bridge program in engineering on student retention and graduation. Journal of STEM Education, 19(2).

    • Search Google Scholar
    • Export Citation
  • Chase, W. G., & Simon, H. A. (1973). Perception in chess. Cognitive Psychology, 4(1), 5581.

  • Clark, R. M., Kaw, A. K., & Braga Gomes, R. (2022). Adaptive learning: Helpful to the flipped classroom in the online environment of COVID? Computer Applications in Engineering Education, 30(2), 517531.

    • Search Google Scholar
    • Export Citation
  • Craig, S. D., Hu, X., Graesser, A. C., Bargagliotti, A. E., Sterbinsky, A., Cheney, K. R., & Okwumabua, T. (2013). The impact of a technology-based mathematics after-school program using ALEKS on student’s knowledge and behaviors. Computers & Education, 68, 495504.

    • Search Google Scholar
    • Export Citation
  • Cosyn, E., Uzun, H., Doble, C., & Matayoshi, J. (2021). A practical perspective on knowledge space theory: ALEKS and its data. Journal of Mathematical Psychology, 101, 102512.

    • Search Google Scholar
    • Export Citation
  • Dare, E. A., Keratithamkul, K., Hiwatig, B. M., & Li, F. (2021). Beyond Content: The role of STEM disciplines, real-world problems, 21st century skills, and STEM careers within science teachers’ conceptions of integrated STEM education. Education Sciences, 11(11), 737.

    • Search Google Scholar
    • Export Citation
  • De Jong, T. (2010). Cognitive load theory, educational research, and instructional design: Some food for thought. Instructional Science, 38(2), 105134.

    • Search Google Scholar
    • Export Citation
  • Eichler, J. F., & Peeples, J. (2013). Online homework put to the test: A report on the impact of two online learning systems on student performance in general chemistry. Journal of Chemical Education, 90(9), 11371143.

    • Search Google Scholar
    • Export Citation
  • Engzell, P., Frey, A., & Verhagen, M. D. (2021). Learning loss due to school closures during the COVID-19 pandemic. Proceedings of the National Academy of Sciences, 118(17), e2022376118. https://doi.org/10.1073/pnas.2022376118

    • Search Google Scholar
    • Export Citation
  • Fang, Y., Ren, Z., Hu, X., & Graesser, A. C. (2019). A meta-analysis of the effectiveness of ALEKS on learning. Educational Psychology, 39(10), 12781292.

    • Search Google Scholar
    • Export Citation
  • Fautch, J. M. (2019). Adaptive learning technology in general chemistry: Does it support student success? In Enhancing retention in introductory chemistry courses: Teaching practices and assessments. American Chemical Society.

    • Search Google Scholar
    • Export Citation
  • Filges, T., Sonne-Schmidt, C. S., & Nielsen, B. C. V. (2018). Small class sizes for improving student achievement in primary and secondary schools: A systematic review. Campbell Systematic Reviews, 14(1), 1107.

    • Search Google Scholar
    • Export Citation
  • Fung, C. H. (2020). How does flipping classroom foster the STEM education: A case study of the FPD model. Technology, Knowledge and Learning, 25(3), 479507.

    • Search Google Scholar
    • Export Citation
  • Galbraith, A., Massey, L. B., Schluterman, H. A., & Crisel, B. (2021, August). Preparing engineering students for the fall semester through a summer math bridge program. In 2021 first-year engineering experience.

    • Search Google Scholar
    • Export Citation
  • Garrick, B., Pendergast, D., Geelan, D., Garrick, B., Pendergast, D., & Geelan, D. (2017). Personalised learning, pedagogy, and e-mediated tools. Theorising Personalised Education: Electronically Mediated Higher Education, 2746.

    • Search Google Scholar
    • Export Citation
  • Gautam, S., Rosson, M. B., & Akgun, M. (2023, April). Exploring potential contributions of social learning to adaptive learning systems. In Extended abstracts of the 2023 CHI Conference on human factors in computing systems (pp. 16).

    • Search Google Scholar
    • Export Citation
  • Gibson, S. M., Brinkley, K., Griggs, L. A., James, B. N., Smith, M., Schwitzerlett, M., Waller, L. M., & Hargraves, R. H. (2021). Implementing a hybrid summer transition program. Frontiers in Education, 6. https://doi.org/10.3389/feduc.2021.674337

    • Search Google Scholar
    • Export Citation
  • Griggs, L., Vanderhoof, C., Cohan, C., Mattingly, A., & Peeples, T. (2022, August). Reimagining summer bridge: an evolution in best practices to support incoming first-year engineering students. In 2022 ASEE Annual Conference & Exposition.

    • Search Google Scholar
    • Export Citation
  • Harati, H., Sujo-Montes, L., Tu, C. H., Armfield, S. J., & Yen, C. J. (2021). Assessment and Learning in Knowledge Spaces (ALEKS) adaptive system impact on students’ perception and self-regulated learning skills. Education Sciences, 11(10), 603.

    • Search Google Scholar
    • Export Citation
  • Hu, X., Xu, Y. J., Hall, C., Walker, K., & Okwumabua, T. (2013). A potential technological solution for reducing the achievement gap between White and Black students. In Knowledge spaces: Applications in education (pp. 7991).

    • Search Google Scholar
    • Export Citation
  • Huang, X., Craig, S. D., Xie, J., Graesser, A., & Hu, X. (2016). Intelligent tutoring systems work as a math gap reducer in 6th grade after-school program. Learning and Individual Differences, 47, 258265.

    • Search Google Scholar
    • Export Citation
  • Imhof, C., Bergamin, P., & McGarrity, S. (2020). Implementation of adaptive learning systems: Current state and potential. In P. Isaias, D. G. Sampson, & D. Ifenthaler (Eds.), Online teaching and learning in higher education. Springer.

    • Search Google Scholar
    • Export Citation
  • Jeong, J. S., González-Gómez, D., & Yllana Prieto, F. (2020). Sustainable and flipped STEM education: Formative assessment online interface for observing pre-service teachers’ performance and motivation. Education Sciences, 10(10), 283.

    • Search Google Scholar
    • Export Citation
  • Jiang, Y., Almeda, M., Kai, S., Baker, R. S., Ostrow, K., Inventado, P. S., & Scupelli, P. (2020). Single template vs. multiple templates: Examining the effects of problem format on performance [Paper presentation]. The 14th International Conference on the Learning Sciences, Nashville, Tennessee.

    • Search Google Scholar
    • Export Citation
  • Johanes, P., & Lagerstrom, L. (2017, June). Adaptive learning: The premise, promise, and pitfalls. In 2017 ASEE Annual Conference & Exposition.

    • Search Google Scholar
    • Export Citation
  • Kallio, J. M., & Halverson, R. (2020). Distributed leadership for personalized learning. Journal of Research on Technology in Education, 52(3), 371390.

    • Search Google Scholar
    • Export Citation
  • Kaw, A., Clark, R., Delgado, E., & Abate, N. (2019). Analyzing the use of adaptive learning in a flipped classroom for preclass learning. Computer Applications in Engineering Education, 27(3), 663678.

    • Search Google Scholar
    • Export Citation
  • Keuning, T., & van Geel, M. (2021). Differentiated teaching with adaptive learning systems and teacher dashboards: the teacher still matters most. IEEE Transactions on Learning Technologies, 14(2), 201210.

    • Search Google Scholar
    • Export Citation
  • Kraft, M. A., List, J. A., Livingston, J. A., & Sadoff, S. (2022, May). Online tutoring by college volunteers: Experimental evidence from a pilot program. In AEA Papers and Proceedings, 112, 614618.

    • Search Google Scholar
    • Export Citation
  • Kuhfeld, M., Soland, J., Tarasawa, B., Johnson, A., Ruzek, E., & Liu, J. (2020). Projecting the potential impact of COVID-19 school closures on academic achievement. Educational Researcher, 49(8), 549565. https://doi.org/10.3102/0013189X20965918

    • Search Google Scholar
    • Export Citation
  • Lee, J., & Bonk, C. J. (2019). Integrating flipped learning with team-based learning in a pre-service teacher education course: Experiences and outcomes. International Journal on E-Learning, 18(1), 529.

    • Search Google Scholar
    • Export Citation
  • Li, K. C., & Wong, B. T. M. (2023). Personalisation in STE(A)M education: A review of literature from 2011 to 2020. Journal of Computing in Higher Education, 35(1), 186201.

    • Search Google Scholar
    • Export Citation
  • Lim, L., Lim, S. H., & Lim, W. Y. R. (2022). A Rasch analysis of students’ academic motivation toward Mathematics in an adaptive learning system. Behavioral Sciences, 12(7), 244.

    • Search Google Scholar
    • Export Citation
  • Louhab, F. E., Bahnasse, A., Bensalah, F., Khiat, A., Khiat, Y., & Talea, M. (2020). Novel approach for adaptive flipped classroom based on learning management system. Education and Information Technologies, 25, 755773.

    • Search Google Scholar
    • Export Citation
  • Mahmud, M. M., Wong, S. F., & Ismail, O. (2022). Emerging learning environments and technologies post covid-19 pandemic: What’s next? Advances in Information, Communication and Cybersecurity: Proceedings of ICI2C’21, 308319.

    • Search Google Scholar
    • Export Citation
  • McCulloch, A. W., Hollebrands, K., Lee, H., Harrison, T., & Mutlu, A. (2018, August). Factors that influence secondary mathematics teachers’ integration of technology in mathematics lessons. Computers & Education, 123, 2640. https://doi.org/10.1016/j.compedu.2018.04.008

    • Search Google Scholar
    • Export Citation
  • McGraw Hill Education. (n.d.-a). Unlocking potential: An insider’s guide to adaptive learning. Retrieved September 6, 2023, from https://learn.mheducation.com/rs/303-FKF-702/images/eBook_TOFU_Unlocking-Potential-eBook_2017.pdf

    • Search Google Scholar
    • Export Citation
  • McGraw Hill Education. (n.d.-b). ALEKS Case study: Emory University. Retrieved September 7, 2023, from https://www.mheducation.com/unitas/highered/platforms/aleks/aleks-case-study-chem-emory.pdf

    • Search Google Scholar
    • Export Citation
  • Meeter, M. (2021). Primary school mathematics during the COVID-19 pandemic: No evidence of learning gaps in adaptive practicing results. Trends in Neuroscience and Education, 25, 100163.

    • Search Google Scholar
    • Export Citation
  • Mills, N. J. (2021). ALEKS constructs as predictors of high school mathematics achievement for struggling students. Heliyon, 7(6), e07345.

    • Search Google Scholar
    • Export Citation
  • Minn, S. (2022). AI-assisted knowledge assessment techniques for adaptive learning environments. Computers and Education: Artificial Intelligence, 3, 100050.

    • Search Google Scholar
    • Export Citation
  • Mirata, V., Hirt, F., Bergamin, P., & van der Westhuizen, C. (2020). Challenges and contexts in establishing adaptive learning in higher education: findings from a Delphi study. International Journal of Educational Technology in Higher Education, 17, 125.

    • Search Google Scholar
    • Export Citation
  • Molnár, G., & Hermann, Z. (2023). Short-and long-term effects of COVID-related kindergarten and school closures on first-to eighth-grade students’ school readiness skills and mathematics, reading and science learning. Learning and Instruction, 83, 101706.

    • Search Google Scholar
    • Export Citation
  • Muñoz, J. L. R., Ojeda, F. M., Jurado, D. L. A., Peña, P. F. P., Carranza, C. P. M., Berríos, H. Q., & Vasquez-Pauca, M. J. (2022). Systematic review of adaptive learning technology for learning in higher education. Eurasian Journal of Educational Research, 98(98), 221233.

    • Search Google Scholar
    • Export Citation
  • Nabulsi, L., Nguyen, A., & Odeleye, O. (2021). A comparison of the effects of two different online homework systems on levels of knowledge retention in general chemistry students. Journal of Science Education and Technology, 30, 3139.

    • Search Google Scholar
    • Export Citation
  • Nuri, K. A. R. A., & Sevim, N. (2013). Adaptive learning systems: Beyond teaching machines. Contemporary Educational Technology, 4(2), 108120.

    • Search Google Scholar
    • Export Citation
  • Office of Educational Technology. (2017). Reimagining the role of technology in education: 2017 National Education Technology Plan Update. U.S. Department of Education.

    • Search Google Scholar
    • Export Citation
  • O’Neil, C. (2017). Weapons of math destruction: How big data increases inequality and threatens democracy. Crown.

  • Panagouli, E., Stavridou, A., Savvidi, C., Kourti, A., Psaltopoulou, T., Sergentanis, T. N., & Tsitsika, A. (2021). School performance among children and adolescents during COVID-19 pandemic: A systematic review. Children, 8(12), 1134.

    • Search Google Scholar
    • Export Citation
  • Park, E., Ifenthaler, D., & Clariana, R. B. (2023). Adaptive or adapted to: Sequence and reflexive thematic analysis to understand learners’ self-regulated learning in an adaptive learning analytics dashboard. British Journal of Educational Technology, 54(1), 98125.

    • Search Google Scholar
    • Export Citation
  • Pelánek, R. (2020). A classification framework for practice exercises in adaptive learning systems. IEEE Transactions on Learning Technologies, 13(4), 734747.

    • Search Google Scholar
    • Export Citation
  • Phillips, A., Pane, J. F., Reumann-Moore, R., & Shenbanjo, O. (2020). Implementing an adaptive intelligent tutoring system as an instructional supplement. Educational Technology Research and Development, 68, 14091437.

    • Search Google Scholar
    • Export Citation
  • Ran, H., Kim, N. J., & Secada, W. G. (2022). A meta-analysis on the effects of technology’s functions and roles on students’ mathematics achievement in K-12 classrooms. Journal of computer assisted learning, 38(1), 258284.

    • Search Google Scholar
    • Export Citation
  • Ragan, L. C., & Ramirez Villarin, L. J. (2021). Emergent guiding principles for STEM education. Innovative Learning Environments in STEM Higher Education: Opportunities, Challenges, and Looking Forward, 107119.

    • Search Google Scholar
    • Export Citation
  • Reid, S. A., MacBride, L., Nobile, L., Fiedler, A. T., & Gardinier, J. R. (2021). Implementation and evaluation of an adaptive online summer preparatory course for general chemistry: Whom does it benefit? Chemistry Education Research and Practice, 22(2), 303311.

    • Search Google Scholar
    • Export Citation
  • Reiser, R. A. (2017). Eight trends affecting the field of instructional design and technology: Opportunities and challenges. In F. Q. Lai & J. D. Lehman (Eds.), Learning and knowledge analytics in open education (pp. 139147). Springer.

    • Search Google Scholar
    • Export Citation
  • Ritter, S., & Fancsali, S. (2016). MATHia X: The next generation cognitive tutor. In EDM (pp. 624625).

  • Ruan, S. S. (2021). Smart tutoring through conversational interfaces. Stanford University.

  • Rutherford, T., Duck, K., Rosenberg, J. M., & Patt, R. (2022). Leveraging mathematics software data to understand student learning and motivation during the COVID-19 pandemic. Journal of research on Technology in education, 54(1), S94S131.

    • Search Google Scholar
    • Export Citation
  • Salame, I. I., & Hanna, E. (2020). Studying the impact of online homework on the perceptions, attitudes, study habits, and learning experiences of chemistry students. Interdisciplinary Journal of Environmental and Science Education, 16(4), e2221.

    • Search Google Scholar
    • Export Citation
  • Sullins, J., Meister, R., Craig, S. D., Wilson, W. M., Bargagliotti, A., & Hu, X. (2013). Is there a relationship between interacting with a mathematical intelligent tutoring system and students performance on standardized high-stake tests. In Knowledge spaces: Applications to education (pp. 6978).

    • Search Google Scholar
    • Export Citation
  • STEM Education Teaching and Learning. (2020). National Science Teaching Association. Retrieved May 14, 2023, from https://www.nsta.org/nstas-official-positions/stem-education-teaching-and-learning

    • Search Google Scholar
    • Export Citation
  • Spitzer, M. W. H., & Moeller, K. (2023). Performance increases in mathematics during covid-19 pandemic distance learning in Austria: Evidence from an intelligent tutoring system for mathematics. Trends in Neuroscience and Education, 100203.

    • Search Google Scholar
    • Export Citation
  • Steenbergen-Hu, S., & Cooper, H. (2013). A meta-analysis of the effectiveness of intelligent tutoring systems on K–12 students’ mathematical learning. Journal of Educational Psychology, 105(4), 970.

    • Search Google Scholar
    • Export Citation
  • Sweller, J., Van Merrienboer, J. J., & Paas, F. G. (1998). Cognitive architecture and instructional design. Educational Psychology Review, 251296.

    • Search Google Scholar
    • Export Citation
  • Taylor, D. L., Yeung, M., & Bashet, A. Z. (2021). Personalized and adaptive learning. Innovative Learning Environments in STEM Higher Education: Opportunities, Challenges, and Looking Forward, 1734.

    • Search Google Scholar
    • Export Citation
  • Teräs, M., Suoranta, J., Teräs, H., & Curcher, M. (2020). Post-Covid-19 education and education technology ‘solutionism’: A seller’s market. Postdigital Science and Education, 2(3), 863878.

    • Search Google Scholar
    • Export Citation
  • Tomasik, M. J., Helbling, L. A., & Moser, U. (2021). Educational gains of in-person vs. distance learning in primary and secondary schools: A natural experiment during the COVID-19 pandemic school closures in Switzerland. International Journal of Psychology, 56(4), 566576.

    • Search Google Scholar
    • Export Citation
  • van der Velde, M., Sense, F., Spijkers, R., Meeter, M., & van Rijn, H. (2021). Lockdown learning: Changes in online foreign-language study activity and performance of Dutch secondary school students during the COVID-19 pandemic. Frontiers in Education, (6). https://doi.org/10.3389/feduc.2021.712987

    • Search Google Scholar
    • Export Citation
  • Van Sickle, J., Schuler, K. R., Quinn, C., Holcomb, J. P., Carver, S. D., Resnick, A., Jackson, D. K., Duffy, S. F., & Sridhar, N. (2020). Closing the achievement gap for underrepresented minority students in STEM: A deep look at a comprehensive intervention. Journal of STEM Education, 21(2), 518.

    • Search Google Scholar
    • Export Citation
  • Vincent-Ruz, P., & Boase, N. R. (2022). Activating discipline specific thinking with adaptive learning: A digital tool to enhance learning in chemistry. PLoS One, 17(11), e0276086.

    • Search Google Scholar
    • Export Citation
  • Vyas, V. S., Kemp, B., & Reid, S. A. (2021). Zeroing in on the best early-course metrics to identify at-risk students in general chemistry: An adaptive learning pre-assessment vs. traditional diagnostic exam. International Journal of Science Education, 43(4), 552569.

    • Search Google Scholar
    • Export Citation
  • Vygotsky, L. S., & Cole, M. (1978). Mind in society: Development of higher psychological processes. Harvard university press.

  • Wang, S., Christensen, C., Cui, W., Tong, R., Yarnall, L., Shear, L., & Feng, M. (2023). When adaptive learning is effective learning: comparison of an adaptive learning system to teacher-led instruction. Interactive Learning Environments, 31(2), 793803.

    • Search Google Scholar
    • Export Citation
  • Weng, X., & Chiu, T. K. (2023). Instructional design and learning outcomes of intelligent computer assisted language learning: Systematic review in the field. Computers and Education: Artificial Intelligence, 100117.

    • Search Google Scholar
    • Export Citation
  • What Works Clearinghouse. (2016). Cognitive tutor. Retrieved May 4, 2023, from https://ies.ed.gov/ncee/wwc/Docs/InterventionReports/wwc_cognitivetutor_062116.pdf

    • Search Google Scholar
    • Export Citation
  • Xie, H., Chu, H. C., Hwang, G. J., & Wang, C. C. (2019). Trends and development in technology-enhanced adaptive/personalized learning: A systematic review of journal publications from 2007 to 2017. Computers & Education, 140, 103599.

    • Search Google Scholar
    • Export Citation
  • Yannier, N., Hudson, S. E., & Koedinger, K. R. (2020). Active learning is about more than hands-on: A mixed-reality AI system to support STEM education. International Journal of Artificial Intelligence in Education, 30(1), 7496.

    • Search Google Scholar
    • Export Citation
  • Zhai, X. (2022). ChatGPT user experience: Implications for education. SSRN 4312418.

Metrics

All Time Past 365 days Past 30 Days
Abstract Views 53 53 5
Full Text Views 1 1 0
PDF Views & Downloads 5 5 1