When Do Learners Study?

An Analysis of the Time-of-Day and Weekday-Weekend Usage Patterns of Learning Management Systems from Mobile and Computers in Blended Learning

Authors

  • Varshita Sher Simon Fraser University
  • Marek Hatala Simon Fraser University
  • Dragan Gašević Monash University

DOI:

https://doi.org/10.18608/jla.2022.6697

Keywords:

time flexibility, learner time, mobile learning, technology-enhanced learning, learning analytics, learning management systems, research paper

Abstract

Recent advances in smart devices and online technologies have facilitated the emergence of ubiquitous learning environments for participating in different learning activities. This poses an interesting question about modality access, i.e., what students are using each platform for and at what time of day. In this paper, we present a log-based exploratory study on learning management system (LMS) use comparing three different modalities—computer, mobile, and tablet—based on the aspect of time. Our objective is to better understand how and to what extent learning sessions via mobiles and tablets occur at different times throughout the day compared to computer sessions. The complexity of the question is further intensified because learners rarely use a single modality for their learning activities but rather prefer a combination of two or more. Thus, we check the associations between patterns of modality usage and time of day as opposed to the counts of modality usage and time of day. The results indicate that computer-dominant learners are similar to limited-computer learners in terms of their session-time distribution, while intensive learners show completely different patterns. For all students, sessions on mobile devices are more frequent in the afternoon, while the proportion of computer sessions was higher at night. On comparison of these time-of-day preferences with respect to modalities on weekdays and weekends, they were found consistent for computer-dominant and limited-computer learners only. We demonstrate the implication of this research for enhancing contextual profiling and subsequently improving the personalization of learning systems such that personalized notification systems can be integrated with LMSs to deliver notifications to students at appropriate times.

References

Ahmad Uzir, N., Gašević, D., Matcha, W., Jovanović, J., & Pardo, A. (2020). Analytics of time management strategies in a flipped classroom. Journal of Computer Assisted Learning, 36(1), 70–88. https://doi.org/10.1111/jcal.12392

Arneberg, P., Guardia, L., Keegan, D., Lõssenko, J., Mázár, I., Michels, P., & Rekkedal, T. (2007). Analyses of European megaproviders of E-learning. Megatrends Project. https://www.researchgate.net/publication/264871599_Analyses_of_European_Megaproviders_of_E-learning

Barbera, E., Gros, B., & Kirschner, P. (2015). Paradox of time in research on educational technology. Time & Society, 24(1), 96–108. https://doi.org/10.1177/0961463X14522178

Beasley, T. M., & Schumacker, R. E. (1995). Multiple regression approach to analyzing contingency tables: Post hoc and planned comparison procedures. The Journal of Experimental Education, 64(1), 79–93. https://doi.org/10.1080/00220973.1995.9943797

Blake, M. (1967). Relationship between circadian rhythm of body temperature and introversion–extraversion. Nature, 215(5103), 896. https://doi.org/10.1038/215896a0

Boroujeni, M. S., & Dillenbourg, P. (2018). Discovery and temporal analysis of latent study patterns in MOOC interaction sequences. In Proceedings of the Eighth International Conference on Learning Analytics and Knowledge (LAK 2018), 5–9 March 2018, Sydney, Australia (pp. 206–215). New York: ACM. https://doi.org/10.1145/3170358.3170388

Casany Guerrero, M. J., Alier Forment, M., Galanis, N., Mayol Sarroca, E., & Piguillem Poch, J. (2012). Analyzing Moodle/LMS logs to measure mobile access. In Proceedings of UBICOMM 2012: The Sixth International Conference on Mobile Ubiquitous Computing, Systems, Services and Technologies, 23–28 September 2012, Barcelona, Spain (pp. 35–40). https://upcommons.upc.edu/handle/2117/19058

Chen, B., Knight, S., & Wise, A. F. (2018). Critical issues in designing and implementing temporal analytics. Journal of Learning Analytics, 5(1), 1–9. https://doi.org/10.18608/jla.2018.53.1

Chen, X., Zou, D., Xie, H., & Wang, F. L. (2020). Smart learning environments: A bibliometric analysis. In Proceedings of the International Conference on Blended Learning (ICBL 2020), 24–27 August 2020, Bangkok, Thailand (pp. 353–364). https://doi.org/10.1007/978-3-030-51968-1_29

Cheng, H. N., Liu, Z., Sun, J., Liu, S., & Yang, Z. (2017). Unfolding online learning behavioral patterns and their temporal changes of college students in SPOCs. Interactive Learning Environments, 25(2), 176–188. https://doi.org/10.1080/10494820.2016.1276082

Cheon, J., Lee, S., Crooks, S. M., & Song, J. (2012). An investigation of mobile learning readiness in higher education based on the theory of planned behavior. Computers & Education, 59(3), 1054–1064. https://doi.org/10.1016/j.compedu.2012.04.015

Davidson, A., & Ritchie, K. L. (2016). The early bird catches the worm! The impact of chronotype and learning style on academic success in university students. Teaching and Learning Innovations, 18, 1–11. https://journal.lib.uoguelph.ca/index.php/tli/article/view/3553

Duck, S., Rutt, D. J., Hoy, M., & Strejc, H. H. (1991). Some evident truths about conversations in everyday relationships: All communications are not created equal. Human Communication Research, 18(2), 228–267. https://doi.org/10.1111/j.1468-2958.1991.tb00545.x

Fischer, J. E., Yee, N., Bellotti, V., Good, N., Benford, S., & Greenhalgh, C. (2010). Effects of content and time of delivery on receptivity to mobile interruptions. In Proceedings of the 12th International Conference on Human Computer Interaction with Mobile Devices and Services (MobileHCI ’10), 7–10 September 2010, Lisbon, Portugal (pp. 103–112). New York: ACM. https://doi.org/10.1145/1851600.1851620

Gabadinho, A., Ritschard, G., Mueller, N. S., & Studer, M. (2011). Analyzing and visualizing state sequences in R with TraMineR. Journal of Statistical Software, 40(4), 1–37. https://doi.org/10.18637/jss.v040.i04

Goodyear, P. (2011). Emerging methodological challenges for educational research. In L. Markauskaite, P. Freebody, & J. Irwin (Eds.), Methodological Choice and Design (pp. 253–266). Springer. https://doi.org/10.1007/978-90-481-8933-5_22

Greiff, S., Scherer, R., & Kirschner, P. A. (2017). Some critical reflections on the special issue: Current innovations in computer-based assessments. Computers in Human Behavior, 76, 715–718. https://doi.org/10.1016/j.chb.2017.08.019

Gromada, A., & Shewbridge, C. (2016). Student learning time. In OECD Education Working Papers. OECD iLibrary. https://doi.org/10.1787/5jm409kqqkjh-en

Grundspenkis, J., Lavendels, J., Novitsky, L., & Sitikovs, V. (2006). Compatibility of the principles of computer-based and classical teachings. In Proceeding of IADIS International Conference Web Based Communities 2006, 26–28 February 2006, San Sebastian, Spain (pp. 335–339).

Hattie, J., & Timperley, H. (2007). The power of feedback. Review of Educational Research, 77(1), 81–112. https://doi.org/10.3102/003465430298487

Itzek-Greulich, H., Randler, C., & Vollmer, C. (2016). The interaction of chronotype and time of day in a science course: Adolescent evening types learn more and are more motivated in the afternoon. Learning and Individual Differences, 51, 189–198. https://doi.org/10.1016/j.lindif.2016.09.013

Knight, S., Wise, A. F., & Chen, B. (2017). Time for change: Why learning analytics needs temporal analysis. Journal of Learning Analytics, 4(3), 7–17. https://doi.org/10.18608/jla.2017.43.2

Kolari, S., Savander-Ranne, C., & Viskari, E.-L. (2008). Learning needs time and effort: A time-use study of engineering students. European Journal of Engineering Education, 33(5-6), 483–498. https://doi.org/10.1080/03043790802564046

Kovanović, V., Gašević, D., Joksimović, S., Hatala, M., & Adesope, O. (2015). Analytics of communities of inquiry: Effects of learning technology use on cognitive presence in asynchronous online discussions. The Internet and Higher Education, 27, 74–89. https://doi.org/10.1016/j.iheduc.2015.06.002

Lee, H., Ahn, H., Nguyen, T. G., Choi, S.-W., & Kim, D. J. (2017). Comparing the self-report and measured smartphone usage of college students: A pilot study. Psychiatry Investigation, 14(2), 198. https://doi.org/10.4306/pi.2017.14.2.198

Leeuwen, A. v., Bos, N., Ravenswaaij, H. v., & Oostenrijk, J. v. (2019). The role of temporal patterns in students’ behaviour for predicting course performance: A comparison of two blended learning courses. British Journal of Educational Technology, 50(2), 921–933. https://doi.org/10.1111/bjet.12616

Lima, R. H., El-Bishouty, M. M., & Graf, S. (2013). A framework for automatic identification and visualization of mobile device functionalities and usage. In A. Holzinger & G. Pasi (Eds.), Human-Computer Interaction and Knowledge Discovery in Complex, Unstructured, Big Data (pp. 148–159). Springer. https://doi.org/10.1007/978-3-642-39146-0_14

Loureiro, F., & Garcia-Marques, T. (2015). Morning or evening person? Which type are you? Self-assessment of chronotype. Personality and Individual Differences, 86, 168–171. https://doi.org/10.1016/j.paid.2015.06.022

Luo, Y., Pan, R., Choi, J. H., & Strobel, J. (2018). Effects of chronotypes on students’ choice, participation, and performance in online learning. Journal of Educational Computing Research, 55(8), 1069–1087. https://doi.org/10.1177/0735633117697729

Lust, G., Elen, J., & Clarebout, G. (2013). Regulation of tool-use within a blended course: Student differences and performance effects. Computers & Education, 60(1), 385–395. https://doi.org/10.1016/j.compedu.2012.09.001

MacDonald, P. L., & Gardner, R. C. (2000). Type I error rate comparisons of post hoc procedures for I j chi-square tables. Educational and Psychological Measurement, 60(5), 735–754. https://doi.org/10.1177/00131640021970871

Macfadyen, L. P., & Dawson, S. (2010). Mining LMS data to develop an “early warning system” for educators: A proof of concept. Computers & Education, 54(2), 588–599. https://doi.org/10.1016/j.compedu.2009.09.008

Malmberg, J., Järvelä, S., & Järvenoja, H. (2017). Capturing temporal and sequential patterns of self-, co-, and socially shared regulation in the context of collaborative learning. Contemporary Educational Psychology, 49, 160–174. https://doi.org/10.1016/j.cedpsych.2017.01.009

McGorry, S. Y. (2003). Measuring quality in online programs. The Internet and Higher Education, 6(2), 159–177. https://doi.org/10.1016/S1096-7516(03)00022-8

Morrison, L. G., Hargood, C., Pejovic, V., Geraghty, A. W., Lloyd, S., Goodman, N., . . . Yardley, L. (2017). The effect of timing and frequency of push notifications on usage of a smartphone-based stress management intervention: An exploratory trial. PloS one, 12(1), e0169162. https://doi.org/10.1371/journal.pone.0169162

Parsons, D. (2016). The future of mobile learning and implications for education and training. In K. Alshahrani & M. Ally (Eds.), Transforming Education in the Gulf Region. Taylor & Francis. https://www.taylorfrancis.com/chapters/edit/10.4324/9781315621586-26/future-mobile-learning-implications-education-training-david-parsons

Pomerantz, J., & Brooks, D. C. (2017). ECAR Study of Faculty and Information Technology, 2017 (Tech. Rep.). https://library.educause.edu/resources/2017/10/ecar-study-of-faculty-and-information-technology-2017

Randler, C., & Frech, D. (2006). Correlation between morningness–eveningness and final school leaving exams. Biological Rhythm Research, 37(3), 233–239. https://doi.org/10.1080/09291010600645780

Rogers, Y., Connelly, K., Hazlewood, W., & Tedesco, L. (2010). Enhancing learning: A study of how mobile devices can facilitate sensemaking. Personal and Ubiquitous Computing, 14(2), 111–124. https://doi.org/10.1007/s00779-009-0250-7

Romero, M., & Barberà, E. (2011). Quality of e-learners’ time and learning performance beyond quantitative time-on-task. The International Review of Research in Open and Distributed Learning, 12(5), 125–137. https://doi.org/10.19173/irrodl.v12i5.999

Romero, M., & Barberà, E. (2015). Lifelong learners and teachers’ time-management competency in e-learning. In M. Ally & B. H. Khan (Eds.), International Handbook of E-Learning (Vol. 2: Implementation and Case Studies). Routledge. https://www.taylorfrancis.com/chapters/edit/10.4324/9781315760902-13/lifelong-learners-teachers-time-management-competency-learning-margarida-romero-elena-barber%C3%A0?context=ubx&refId=7a3d6608-7ec0-45d2-8f97-310d66302e38

Saqr, M., Nouri, J., & Fors, U. (2019). Time to focus on the temporal dimension of learning: A learning analytics study of the temporal patterns of students’ interactions and self-regulation. International Journal of Technology Enhanced Learning, 11(4), 398–412. https://doi.org/10.1504/ijtel.2019.102549

Sharpe, D. (2015). Chi-square test is statistically significant: Now what? Practical Assessment, Research, and Evaluation, Article 8, 20. https://doi.org/10.7275/tbfa-x148

Sharples, M. (2015). Making sense of context for mobile learning. In J. Traxler & A. Kukulska-Hulme (Eds.), Mobile Learning (pp. 154–167). Routledge. https://www.taylorfrancis.com/chapters/edit/10.4324/9780203076095-9/making-sense-context-mobile-learning-mike-sharples

Sher, V., Hatala, M., & Gašević, D. (2019). On multi-device use: Using technological modality profiles to explain differences in students’ learning. In Proceedings of the Ninth International Conference on Learning Analytics & Knowledge (LAK 2019), 4–8 March 2019, Tempe, AZ, USA (pp. 1–10). New York: ACM. https://doi.org/10.1145/3303772.3303790

Smith, C. S., Folkard, S., Schmieder, R. A., Parra, L. F., Spelten, E., Almiral, H., . . . Tisak, J. (2002). Investigation of morning–evening orientation in six countries using the preferences scale. Personality and Individual Differences, 32(6), 949–968. https://doi.org/10.1016/S0191-8869(01)00098-8

Song, Y., Ma, H., Wang, H., & Wang, K. (2013). Exploring and exploiting user search behavior on mobile and tablet devices to improve search relevance. In Proceedings of the 22nd International Conference on World Wide Web (WWW 2013), 13–17 May 2013, Rio de Janiero, Brazil (pp. 1201–1212). New York: ACM. https://doi.org/10.1145/2488388.2488493

Srinivasan, V., Koehler, C., & Jin, H. (2018). Ruleselector: Selecting conditional action rules from user behavior patterns. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 2(1), 35:1–34. https://doi.org/10.1145/3191767

Stockwell, G. (2010). Using mobile phones for vocabulary activities: Examining the effect of platform. Language Learning Technology, 14(2), 95–110. https://doi.org/10125/44216

Stockwell, G. (2013). Tracking learner usage of mobile phones for language learning outside of the classroom. CALICO Journal, 30(1), 118–136. https://doi.org/10.1558/cj.v30i0.118-136

Tabuenca, B., Kalz, M., Börner, D., Ternier, S., & Specht, M. (2014). Where is my time? Identifying productive time of lifelong learners for effective feedback services. In Proceedings of the International Computer Assisted Assessment Conference, 30 June–1 July 2014, Zeist, Netherlands (pp. 149–161). Springer. https://doi.org/10.1007/978-3-319-08657-6_15

Tabuenca, B., Kalz, M., Drachsler, H., & Specht, M. (2015). Time will tell: The role of mobile learning analytics in self-regulated learning. Computers & Education, 89, 53–74. https://doi.org/10.1016/j.compedu.2015.08.004

Tortorella, R. A., & Graf, S. (2012). Personalized mobile learning via an adaptive engine. In Proceedings of the 12th International Conference on Advanced Learning Technologies (ICALT 2012), 4–6 July 2012, Rome, Italy (pp. 670–671). IEEE. https://doi.org/10.1109/ICALT.2012.112

Trevor, H., Robert, T., & Friedman, J. H. (2009). The Elements of Statistical Learning: Data Mining, Inference, and Prediction. New York: Springer. https://doi.org/10.1007/978-0-387-84858-7

Wolk, S. (2001). The benefits of exploratory time. Educational Leadership, 59(2), 56–59. https://www.ascd.org/el/articles/the-benefits-of-exploratory-time

Xu, K., Zhu, M., Zhang, D., & Gu, T. (2008). Context-aware content filtering & presentation for pervasive & mobile information systems. In Proceedings of the First International Conference on Ambient Media and Systems (Ambi-Sys08), 11–14 February 2008, Quebec, Quebec, Canada (pp. 1–8). New York: ACM. https://dl.acm.org/doi/10.5555/1363163.1363183

Downloads

Published

2022-05-26

How to Cite

Sher, V., Hatala, M., & Gašević, D. (2022). When Do Learners Study? An Analysis of the Time-of-Day and Weekday-Weekend Usage Patterns of Learning Management Systems from Mobile and Computers in Blended Learning. Journal of Learning Analytics, 1-23. https://doi.org/10.18608/jla.2022.6697

Issue

Section

Research Papers

Most read articles by the same author(s)

1 2 3 > >>