Chapter 20 Analysis of Patterns in Time for Evaluating Online Instruction

In: Handbook of Research in Online Learning
Author:
Theodore W. Frick
Search for other papers by Theodore W. Frick in
Current site
Google Scholar
PubMed
Close

Purchase instant access (PDF download and unlimited online access):

$40.00

Abstract

Analysis of Patterns in Time (APT) is a quantitative research method for counting occurrences and durations of temporal patterns within temporal maps. APT has been used successfully in past research studies to detect patterns that linear models cannot. This is because APT measures relations directly within temporal maps, whereas linear models statistically relate variables that are measured separately.

Queries in APT yield frequency counts of matching segments within temporal maps, as well as segment durations. These query results, in turn, can be used to estimate the likelihood of temporal patterns.

Google Analytics 4 (GA4) includes features so that APT can be accomplished. GA4 tracking can be activated in websites and apps designed for online learning. This tracking results in temporal maps which are stored in Google’s cloud. Educational researchers can then use GA4 tools to do APT. This chapter illustrates how GA4 can be used to do APT to identify effective online instructional strategies.

I conclude by discussing the potential of APT temporal maps for use in machine learning to train neural networks. Online instruction and learning provide a context for efficiently collecting the big data needed for initially training a neural network. This network can, in turn, be used to adapt and individualize online instruction.

  • Collapse
  • Expand
  • An, J. (2003). Understanding mode errors in modern human-computer interfaces: Toward the design of usable software [Unpublished doctoral dissertation]. Indiana University Graduate School.

    • Search Google Scholar
    • Export Citation
  • CDC: Centers for Disease Control and Prevention. (2022). What are the risk factors for lung cancer? https://www.cancercenter.com/cancer-types/lung-cancer/risk-factors

    • Search Google Scholar
    • Export Citation
  • Dagli, C. (2017). Relationships of first principles of instruction and student mastery: A MOOC on how to recognize plagiarism [Unpublished doctoral dissertation]. Indiana University Graduate School.

    • Search Google Scholar
    • Export Citation
  • Frick, T. W, Myers, R. D., & Dagli, C. (2022a). Analysis of Patterns in Time for evaluating first principles of instruction (Featured research). Educational Technology Research and Development, 70(1), 129. https://doi.org/10.1007/s11423-021-10077-6

    • Search Google Scholar
    • Export Citation
  • Frick, T. W. (1983). Nonmetric temporal path analysis (NTPA): An alternative to the linear models approach for verification of stochastic educational relations [Unpublished doctoral dissertation]. Indiana University Graduate School. https://tedfrick.sitehost.iu.edu/ntpa

    • Search Google Scholar
    • Export Citation
  • Frick, T. W. (1990). Analysis of Patterns in Time (APT): A method of recording and quantifying temporal relations in education. American Educational Research Journal, 27(1), 180204. https://doi.org/10.3102/00028312027001180

    • Search Google Scholar
    • Export Citation
  • Frick, T. W. (2022, October). Analysis of Patterns in Time (APT): A fruitful methodology for investigating learning journeys in education. At the annual conference of the Association of Educational Communications and Technology. https://plagiarism.iu.edu/apt/aect2022APTFruitfulMethod.html

    • Search Google Scholar
    • Export Citation
  • Frick, T. W., Chadha, R., Watson, C., Wang, Y., & Green, P. (2009). College student perceptions of teaching and learning quality. Educational Technology Research and Development, 57(5), 705720. https://doi.org/10.1007/s11423-007-9079-9

    • Search Google Scholar
    • Export Citation
  • Frick, T. W., Chadha, R., Watson, C., & Zlatkovska, E. (2010). Improving course evaluations to improve instruction and complex learning in higher education. Educational Technology Research and Development, 58(2), 115136. https://doi.org/10.1007/s11423-009-9131-z

    • Search Google Scholar
    • Export Citation
  • Frick, T. W., & Dagli, C. (2016). MOOC s for research: The case of the Indiana University plagiarism tutorials and tests. Technology, Knowledge and Learning, 21(2), 255276. https://doi.org/10.1007/s10758-016-9288-6

    • Search Google Scholar
    • Export Citation
  • Frick, T. W., Myers, R. D., Dagli, C., & Barrett, A. F. (2022b). Innovative learning analytics for evaluating instruction: A big data roadmap to effective online learning. Routledge. https://doi.org/10.4324/9781003176343

    • Search Google Scholar
    • Export Citation
  • Frick, T., Myers, R., Thompson, K., & York, S. (2008). New ways to measure systemic change: Map & Analyze Patterns & Structures across Time (MAPSAT). Featured research paper presented at the annual conference of the Association for Educational Communications & Technology, Orlando, FL. Retrieved February 18, 2021, from https://www.indiana.edu/~tedfrick/MAPSATAECTOrlando2008.pdf

    • Search Google Scholar
    • Export Citation
  • GA4: Google Analytics 4 (2023). Session. https://support.google.com/analytics/answer/12798876?hl=en#:~:text=A%20session%20is%20a%20group,Learn%20more%20about%20sessions

    • Search Google Scholar
    • Export Citation
  • Google Ads. (n.d.). Retrieved August 7, 2023 from https://ads.google.com

  • Google Analytics. (n.d.). Retrieved June 2, 2023, from https://en.wikipedia.org/wiki/Google_Analytics

  • Howard, C. D., Barrett A. F., & Frick, T. W. (2010). Anonymity to promote peer feedback: Pre-service teachers’ comments in asynchronous computer-mediated communication. Journal of Educational Computing Research, 43(1), 89112. https://doi.org/10.2190/EC.43.1.f

    • Search Google Scholar
    • Export Citation
  • IPTAT. (n.d.). Indiana University Plagiarism Tutorials and Tests. Retrieved June 3, 2023, from https://plagiarism.iu.edu/

  • Kirk, R. E. (1999). Statistics: An introduction (4th ed.). Harcourt Brace.

  • Kirk, R. E. (2013). Experimental design: Procedures for the behavioral sciences (4th ed.). Sage.

  • Koh, J. H. (2008). The use of scaffolding in introductory technology skills instruction for preservice teachers [Unpublished doctoral dissertation]. Indiana University Graduate School.

    • Search Google Scholar
    • Export Citation
  • Koh, J. H., & Frick, T. W. (2009). Instructor and student classroom interactions during technology skills instruction for facilitating preservice teachers’ computer self-efficacy. Journal of Educational Computing Research, 40(2), 207224. https://doi.org/10.2190/EC.40.2.d

    • Search Google Scholar
    • Export Citation
  • Kumar, V., Abbas, A., & Fausto, N., (2005). Robbins and Cotran pathologic basis of disease (7th ed.). Elsevier/Saunders.

  • Lara, M. (2013). Personality traits and performance in online game-based learning: Collaborative vs. individual settings [Unpublished doctoral dissertation]. Indiana University Graduate School.

    • Search Google Scholar
    • Export Citation
  • Lewis, M. (2004). Moneyball: The art of winning an unfair game (Kindle ed.). W. W. Norton & Company.

  • Luk, H.-K. (1994). A Comparison of an expert systems approach to computer adaptive testing and the three-parameter item response theory model [Unpublished doctoral dissertation]. Indiana University Graduate School.

    • Search Google Scholar
    • Export Citation
  • Marcus, G., & Davis, E. (2020). Rebooting AI: Building artificial intelligence we can trust (Kindle ed.). Pantheon Books.

  • Merriam, S. (1997). Qualitative research and case study applications in education. Jossey Bass.

  • Merrill, M. D. (2013). First principles of instruction: Identifying and designing effective, efficient, and engaging instruction. Pfeiffer.

    • Search Google Scholar
    • Export Citation
  • Merrill, M. D. (2020). M. David Merrill’s first principles of instruction. Association for Educational Communications and Technology.

  • Myers, R. D. (2012). Analyzing interaction patterns to verify a simulation/game model [Unpublished doctoral dissertation]. Indiana University Graduate School.

    • Search Google Scholar
    • Export Citation
  • Myers, R. D., & Frick, T. W. (2015). Using pattern matching to assess gameplay. In C. S. Loh, Y. Sheng, & D. Ifenthaler (Eds.), Serious games analytics: Methodologies for performance measurement, assessment, and improvement, (pp. 435458). Springer. https://doi.org/10.1007/978-3-319-05834-4_19

    • Search Google Scholar
    • Export Citation
  • Nader, R. (1965). Unsafe at any speed: The designed-in dangers of the American automobile. Grossman. https://en.wikipedia.org/wiki/Unsafe_at_Any_Speed

    • Search Google Scholar
    • Export Citation
  • NHTSA: National Highway Transportation and Safety Administration. (n.d.). Seatbelts. Retrieved June 20, 2023, from https://www.nhtsa.gov/risky-driving/seat-belts

    • Search Google Scholar
    • Export Citation
  • Plew, T. (1989). An empirical investigation of major adaptive testing methodologies and an expert systems approach [Unpublished doctoral dissertation]. Indiana University Graduate School.

    • Search Google Scholar
    • Export Citation
  • Steiner, E. (1988). Methodology of theory building. Educology Research Associates. https://tedfrick.me/Steiner/Methodology%20of%20Theory%20Building%204mb.pdf

    • Search Google Scholar
    • Export Citation
  • Sundararajan, M., Taly, A., & Yan, Q. (2017). Axiomatic attribution for deep networks. arXiv. https://arxiv.org/abs/1703.01365

  • Wolfram, S. (2023, February 14). What is ChatGPT doing … and why does it work? Writings. https://writings.stephenwolfram.com/2023/02/what-is-chatgpt-doing-and-why-does-it-work/

    • Search Google Scholar
    • Export Citation
  • Yin, R. (1998). Dynamic learning patterns during individualized instruction [Unpublished doctoral dissertation]. Indiana University Graduate School.

    • Search Google Scholar
    • Export Citation

Metrics

All Time Past 365 days Past 30 Days
Abstract Views 68 68 16
Full Text Views 2 2 1
PDF Views & Downloads 6 6 3