skip to main content
10.1145/3636555.3636900acmotherconferencesArticle/Chapter ViewAbstractPublication PageslakConference Proceedingsconference-collections
research-article
Open access

Analytics of Planning Behaviours in Self-Regulated Learning: Links with Strategy Use and Prior Knowledge

Published: 18 March 2024 Publication History

Abstract

A sophisticated grasp of self-regulated learning (SRL) skills has become essential for learners in computer-based learning environment (CBLE). One aspect of SRL is the plan-making process, which, although emphasized in many SRL theoretical frameworks, has attracted little research attention. Few studies have investigated the extent to which learners complied with their planned strategies, and whether making a strategic plan is associated with actual strategy use. Limited studies have examined the role of prior knowledge in predicting planned and actual strategy use. In this study, we developed a CBLE to collect trace data, which were analyzed to investigate learners’ plan-making process and its association with planned and actual strategy use. Analysis of prior knowledge and trace data of 202 participants indicated that 1) learners tended to adopt strategies that significantly deviated from their planned strategies, 2) the level of prior knowledge was associated with planned strategies, and 3) neither the act of plan-making nor prior knowledge predicted actual strategy use. These insights bear implications for educators and educational technologists to recognise the dynamic nature of strategy adoption and to devise approaches that inspire students to continually revise and adjust their plans, thereby strengthening SRL.

References

[1]
Omolola A Adedokun and Wilella D Burgess. 2012. Analysis of paired dichotomous data: A gentle introduction to the McNemar test in SPSS. Journal of MultiDisciplinary Evaluation 8, 17 (2012), 125–131.
[2]
Icek Ajzen. 1991. The theory of planned behaviour. Organizational behaviour and human decision processes, 50 (2), 179-211.
[3]
Tuija Alasalmi. 2021. Students Expectations on Learning Analytics: Learning Platform Features Supporting Self-regulated Learning. In CSEDU (2). 131–140.
[4]
Roger Azevedo, François Bouchet, Melissa Duffy, Jason Harley, Michelle Taub, Gregory Trevors, Elizabeth Cloude, Daryn Dever, Megan Wiedbusch, Franz Wortha, 2022. Lessons learned and future directions of metatutor: Leveraging multichannel data to scaffold self-regulated learning with an intelligent tutoring system. Frontiers in Psychology 13 (2022), 813632.
[5]
Roger Azevedo, Amy Johnson, Amber Chauncey, and Candice Burkett. 2010. Self-regulated learning with MetaTutor: Advancing the science of learning with MetaCognitive tools. In New science of learning. Springer, 225–247.
[6]
Roger Azevedo, Daniel C Moos, Jeffrey A Greene, Fielding I Winters, and Jennifer G Cromley. 2008. Why is externally-facilitated regulated learning more effective than self-regulated learning with hypermedia?Educational Technology Research and Development 56 (2008), 45–72.
[7]
Maria Bannert. 2007. Metakognition beim lernen mit hypermedien. Waxmann Verlag.
[8]
Maria Bannert and Peter Reimann. 2012. Supporting self-regulated hypermedia learning through prompts. Instructional Science 40 (2012), 193–211.
[9]
Maria Bannert, Peter Reimann, and Christoph Sonnenberg. 2014. Process mining techniques for analysing patterns and strategies in students’ self-regulated learning. Metacognition and learning 9 (2014), 161–185.
[10]
Gregory L Callan and Timothy J Cleary. 2019. Examining cyclical phase relations and predictive influences of self-regulated learning processes on mathematics task performance. Metacognition and Learning 14 (2019), 43–63.
[11]
Ismail Celik, Egle Gedrimiene, Anni Silvola, and Hanni Muukkonen. 2023. Response of learning analytics to the online education challenges during pandemic: Opportunities and key examples in higher education. Policy Futures in Education 21, 4 (2023), 387–404.
[12]
Dan Davis, Guanliang Chen, Tim Van der Zee, Claudia Hauff, and Geert-Jan Houben. 2016. Retrieval practice and study planning in MOOCs: Exploring classroom-based self-regulated learning strategies at scale. In Proc. the 11th European Conf. on Technology Enhanced Learning. 57–71.
[13]
Jiahui Du, Khe Foon Hew, and Lejia Liu. 2023. What can online traces tell us about students’ self-regulated learning? A systematic review of online trace data analysis. Computers & Education (2023), 104828.
[14]
Yizhou Fan, Lyn Lim, Joep Van der Graaf, Jonathan Kilgour, Mladen Raković, Johanna Moore, Inge Molenaar, Maria Bannert, and Dragan Gašević. 2022. Improving the measurement of self-regulated learning using multi-channel data. Metacognition and Learning 17, 3 (2022), 1025–1055.
[15]
Yizhou Fan, Joep van der Graaf, Lyn Lim, Mladen Raković, Shaveen Singh, Jonathan Kilgour, Johanna Moore, Inge Molenaar, Maria Bannert, and Dragan Gašević. 2022. Towards investigating the validity of measurement of self-regulated learning based on trace data. Metacognition and Learning 17, 3 (2022), 949–987.
[16]
Dragan Gasevic, Jelena Jovanovic, Abelardo Pardo, and Shane Dawson. 2017. Detecting learning strategies with analytics: Links with self-reported measures and academic performance. Journal of Learning Analytics 4, 2 (2017), 113–128.
[17]
Dragan Gašević, Vitomir Kovanović, Srećko Joksimović, and George Siemens. 2014. Where is research on massive open online courses headed? A data analysis of the MOOC Research Initiative. International Review of Research in Open and Distributed Learning 15, 5 (2014), 134–176.
[18]
Roberto Gatta, Mauro Vallati, Jacopo Lenkowicz, Eric Rojas, Andrea Damiani, Lucia Sacchi, Berardino De Bari, Arianna Dagliati, Carlos Fernandez-Llatas, Matteo Montesi, 2017. Generating and comparing knowledge graphs of medical processes using pMineR. In Proceedings of the Knowledge Capture Conference. 1–4.
[19]
Jeffrey Alan Greene and Roger Azevedo. 2009. A macro-level analysis of SRL processes and their relations to the acquisition of a sophisticated mental model of a complex system. Contemporary educational psychology 34, 1 (2009), 18–29.
[20]
Lin Guo. 2022. Using metacognitive prompts to enhance self-regulated learning and learning outcomes: A meta-analysis of experimental studies in computer-based learning environments. Journal of Computer Assisted Learning 38, 3 (2022), 811–832.
[21]
Sami Heikkinen, Mohammed Saqr, Jonna Malmberg, and Matti Tedre. 2023. Supporting self-regulated learning with learning analytics interventions–a systematic literature review. Education and Information Technologies 28, 3 (2023), 3059–3088.
[22]
Nina Hood, Allison Littlejohn, and Colin Milligan. 2015. Context counts: How learners’ contexts influence learning in a MOOC. Computers & Education 91 (2015), 83–91.
[23]
René F Kizilcec, Mar Pérez-Sanagustín, and Jorge J Maldonado. 2017. Self-regulated learning strategies predict learner behavior and goal attainment in Massive Open Online Courses. Computers & education 104 (2017), 18–33.
[24]
Tongguang Li, Yizhou Fan, Yuanru Tan, Yeyu Wang, Shaveen Singh, Xinyu Li, Mladen Raković, Joep Van Der Graaf, Lyn Lim, Binrui Yang, 2023. Analytics of self-regulated learning scaffolding: effects on learning processes. Frontiers in Psychology 14 (2023).
[25]
Tongguang Li, Jionghao Lin, Sehrish Iqbal, Zachari Swiecki, Yi-Shan Tsai, Yizhou Fan, and Dragan Gašević. 2023. Do Learners Appreciate Adaptivity? An Epistemic Network Analysis of How Learners Perceive Adaptive Scaffolding. In ICQE. Springer, 3–17.
[26]
Lyn Lim, Maria Bannert, Joep van der Graaf, Shaveen Singh, Yizhou Fan, Surya Surendrannair, Mladen Rakovic, Inge Molenaar, Johanna Moore, and Dragan Gašević. 2023. Effects of real-time analytics-based personalized scaffolds on students’ self-regulated learning. Computers in Human Behavior 139 (2023), 107547.
[27]
Edwin A Locke and Gary P Latham. 2002. Building a practically useful theory of goal setting and task motivation: A 35-year odyssey.American psychologist 57, 9 (2002), 705.
[28]
Jorge Maldonado-Mahauad, Mar Pérez-Sanagustín, Pedro Manuel Moreno-Marcos, Carlos Alario-Hoyos, Pedro J Muñoz-Merino, and Carlos Delgado-Kloos. 2018. Predicting learners’ success in a self-paced MOOC through sequence patterns of self-regulated learning. In Proceedings of the 13th European Conference on Technology Enhanced Learning. Springer, 355–369.
[29]
Wannisa Matcha, Dragan Gašević, Abelardo Pardo, 2019. A systematic review of empirical studies on learning analytics dashboards: A self-regulated learning perspective. IEEE Transactions on Learning Technologies 13, 2 (2019), 226–245.
[30]
Wannisa Matcha, Dragan Gašević, Nora’Ayu Ahmad Uzir, Jelena Jovanović, and Abelardo Pardo. 2019. Analytics of learning strategies: Associations with academic performance and feedback. In Proceedings of the 9th international conference on learning analytics & knowledge. 461–470.
[31]
Danielle S McNamara. 2001. Reading both high-coherence and low-coherence texts: Effects of text sequence and prior knowledge.Canadian Journal of Experimental Psychology/Revue canadienne de psychologie expérimentale 55, 1 (2001), 51.
[32]
Daniel C Moos and Roger Azevedo. 2008. Self-regulated learning with hypermedia: The role of prior domain knowledge. Contemporary Educational Psychology 33, 2 (2008), 270–298.
[33]
Daniel C Moos and Roger Azevedo. 2009. Self-efficacy and prior domain knowledge: to what extent does monitoring mediate their relationship with hypermedia learning?Metacognition and Learning 4 (2009), 197–216.
[34]
Anabil Munshi, Gautam Biswas, Ryan Baker, Jaclyn Ocumpaugh, Stephen Hutt, and Luc Paquette. 2023. Analysing adaptive scaffolds that help students develop self-regulated learning behaviours. Journal of Computer Assisted Learning 39, 2 (2023), 351–368.
[35]
Ernesto Panadero. 2017. A review of self-regulated learning: Six models and four directions for research. Frontiers in psychology (2017), 422.
[36]
Ronald Antonio Pérez-Álvarez, Jorge Maldonado-Mahauad, Kshitij Sharma, Diego Sapunar-Opazo, and Mar Pérez-Sanagustín. 2020. Characterizing learners’ engagement in MOOCs: An observational case study using the NoteMyProgress tool for supporting self-regulation. IEEE Transactions on Learning Technologies 13, 4 (2020), 676–688.
[37]
Mar Pérez-Sanagustín, Diego Sapunar-Opazo, Ronald Pérez-Álvarez, Isabel Hilliger, Anis Bey, Jorge Maldonado-Mahauad, and Jorge Baier. 2021. A MOOC-based flipped experience: Scaffolding SRL strategies improves learners’ time management and engagement. Computer Applications in Engineering Education 29, 4 (2021), 750–768.
[38]
Sanne FE Rovers, Geraldine Clarebout, Hans HCM Savelberg, Anique BH de Bruin, and Jeroen JG van Merriënboer. 2019. Granularity matters: comparing different ways of measuring self-regulated learning. Metacognition and Learning 14 (2019), 1–19.
[39]
James R Segedy, John S Kinnebrew, and Gautam Biswas. 2013. The effect of contextualized conversational feedback in a complex open-ended learning environment. Educational Technology Research and Development 61 (2013), 71–89.
[40]
Melody Siadaty, Dragan Gašević, and Marek Hatala. 2016. Associations between technological scaffolding and micro-level processes of self-regulated learning: A workplace study. Computers in Human Behavior 55 (2016), 1007–1019.
[41]
Melody Siadaty, Dragan Gašević, and Marek Hatala. 2016. Measuring the impact of technological scaffolding interventions on micro-level processes of self-regulated workplace learning. Computers in Human Behavior 59 (2016), 469–482.
[42]
Christoph Sonnenberg and Maria Bannert. 2015. Discovering the effects of metacognitive prompts on the sequential structure of SRL-processes using process mining techniques. Journal of Learning Analytics 2, 1 (2015), 72–100.
[43]
Christoph Sonnenberg and Maria Bannert. 2019. Using process mining to examine the sustainability of instructional support: How stable are the effects of metacognitive prompting on self-regulatory behavior?Computers in Human Behavior 96 (2019), 259–272.
[44]
Namrata Srivastava, Yizhou Fan, Mladen Rakovic, Shaveen Singh, Jelena Jovanovic, Joep Van Der Graaf, Lyn Lim, Surya Surendrannair, Jonathan Kilgour, Inge Molenaar, 2022. Effects of internal and external conditions on strategies of self-regulated learning: A learning analytics study. In LAK22: 12th international learning analytics and knowledge conference. 392–403.
[45]
Joep van der Graaf, Lyn Lim, Yizhou Fan, Jonathan Kilgour, Johanna Moore, Dragan Gašević, Maria Bannert, and Inge Molenaar. 2022. The dynamics between self-regulated learning and learning outcomes: An exploratory approach and implications. Metacognition and Learning 17, 3 (2022), 745–771.
[46]
Philip H Winne. 2013. Self-regulated learning viewed from models of information processing. Self-regulated learning and academic achievement (2013), 145–178.
[47]
Philip H Winne. 2017. Learning analytics for self-regulated learning. Handbook of learning analytics 754 (2017), 241–249.
[48]
Philip H Winne. 2022. Modeling self-regulated learning as learners doing learning science: How trace data and learning analytics help develop skills for self-regulated learning. Metacognition and Learning 17, 3 (2022), 773–791.
[49]
Philip H. Winne and Allyson Hadwin. 1998. Studying as self-regulated learning.https://api.semanticscholar.org/CorpusID:143411461
[50]
Philip H Winne and Nancy E Perry. 2000. Measuring self-regulated learning. In Handbook of self-regulation. Elsevier, 531–566.
[51]
Tzu-Chi Yang, Meng Chang Chen, and Sherry Y Chen. 2018. The influences of self-regulated learning support and prior knowledge on improving learning performance. Computers & Education 126 (2018), 37–52.
[52]
Michael Yeomans and Justin Reich. 2017. Planning prompts increase and forecast course completion in massive open online courses. In Proceedings of the seventh international learning analytics & knowledge conference. 464–473.

Cited By

View all
  • (2024)Secondary School Students’ Enacted Self-Regulated Learning Strategies in a Computer-Based Writing Task–Insights from Digital Trace Data and InterviewsTechnology, Knowledge and Learning10.1007/s10758-024-09789-4Online publication date: 28-Oct-2024

Index Terms

  1. Analytics of Planning Behaviours in Self-Regulated Learning: Links with Strategy Use and Prior Knowledge

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    LAK '24: Proceedings of the 14th Learning Analytics and Knowledge Conference
    March 2024
    962 pages
    ISBN:9798400716188
    DOI:10.1145/3636555
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 18 March 2024

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. learning analytics
    2. learning strategies
    3. self-regulated learning
    4. strategic planning

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Funding Sources

    Conference

    LAK '24

    Acceptance Rates

    Overall Acceptance Rate 236 of 782 submissions, 30%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)508
    • Downloads (Last 6 weeks)46
    Reflects downloads up to 17 Jan 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Secondary School Students’ Enacted Self-Regulated Learning Strategies in a Computer-Based Writing Task–Insights from Digital Trace Data and InterviewsTechnology, Knowledge and Learning10.1007/s10758-024-09789-4Online publication date: 28-Oct-2024

    View Options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Login options

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media