Timing Matters: Approaches for Measuring and Visualizing Behaviours of Timing and Spacing of Work in Self-Paced Online Teacher Professional Development Courses
DOI:
https://doi.org/10.18608/jla.2018.51.3Keywords:
Timing, participation, engagement, repetition, online learning, distance education, informal learning, self-paced learning, professional development, procrastination, spacing effect.Abstract
One feature of self-paced online courses is greater learner control over the timing of their work in a course. However, the greater timing flexibility that learners enjoy in such environments may play a different role in the learning process than has been previously observed in formal online or face-to-face courses. As such, the study of work timing merits further investigation. Toward this goal, this study forwards two measures that represent the timing of coursework: 1) the timing index, or the degree to which a participant completes 50% of their work, and 2) the spacing count, the frequency of work performed across the course timeframe. In this study, the authors demonstrate the use of these measures from a data set of 42 U.S. middle-school teachers who participated in a self-paced, online professional development course to support teacher implementation of a new blended-learning curriculum. Using the two measures, the authors identify timing behaviours of participants and examine the effects that timing has on teacher self-efficacy after completing the course. The two measures and visualizations demonstrated in this paper yield useful individual-level variables for course timing that can be used for further study on the effects on learning outcomes.
References
Admiraal, W., Wubbels, T., & Pilot, A. (1999). College teaching in legal education: Teaching method, students’ time-on-task, and achievement. Research in Higher Education, 40(6), 687–704. http://doi.org/10.1023/A:1018712914619
Andergassen, M., Mödritscher, F., & Neumann, G. (2014). Practice and repetition during exam preparation in blended learning courses: Correlations with learning results. Journal of Learning Analytics, 1(1), 48–74.
Beck, B. L., Koons, S. R., & Milgrim, D. L. (2000). Correlates and consequences of behavioral procrastination: The effects of academic procrastination, self-consciousness, self-esteem and self-handicapping. Journal of Social Behavior and Personality, 15(5), 3–13.
Benjamin, A. S., & Tullis, J. (2010). What makes distributed practice effective?. Cognitive Psychology, 61(3), 228-247.
Berzonsky, M., & Ferrari, J. (1996). Identity orientation and decisional strategies. Personality and Individual Differences, 20, 597–606.
Brownlow, S., & Reasinger, R. D. (2000). Putting off until tomorrow what is better done today: Academic procrastination as a function of motivation toward college work. Journal of Social Behavior and Personality, 15(5), 15–34.
Bruce, D., & Bahrick, H. P. (1992). Perceptions of past research. American Psychologist, 47(2), 319-328. http://dx.doi.org/10.1037/0003-066X.47.2.319.
Broadbent, J., & Poon, W. L. (2015). Self-regulated learning strategies & academic achievement in online higher education learning environments: A systematic review. The Internet and Higher Education, 27, 1-13. http://doi.org/10.3102/0013189X14523038.
Calderwood, C., Ackerman, P. L., & Conklin, E. M. (2014). What else do college students “do” while studying? An investigation of multitasking. Computers & Education, 75, 19–29. http://doi.org/10.1016/j.compedu.2014.02.004.
Carpenter, S. K., Cepeda, N. J., Rohrer, D., Kang, S. H., & Pashler, H. (2012). Using spacing to enhance diverse forms of learning: Review of recent research and implications for instruction. Educational Psychology Review, 24(3), 369-378.
Carroll, J. (1963). A model of school learning. Teachers College Record, 64(8), 723–733.
Cepeda, N.J., Vul, E., Rohrer, D., Wixted, J.T., & Pashler, H. (2008). Spacing effects in learning: A temporal ridgeline of optimal retention. Psychological Science, 19(11), 1095–1102. http://doi.org/10.1111/j.14679280.2008.02209.x.
Chu, A. H. C., & Choi, J. N. (2005). Rethinking procrastination: Positive effects of “active” procrastination behavior on attitudes and performance. The Journal of Social Psychology, 145(3), 245–264.
Cotton, K. (1989). Educational time factors (No. Close‐Up #8). Northwest Regional Educational Laboratory. Retrieved from http://educationnorthwest.org/webfm_send/564.
DeBoer, J., Ho, A. D., Stump, G. S., & Breslow, L. (2014). Changing “course”: Reconceptualizing educational variables for massive open online courses. Educational Researcher, 43(2), 74–84. http://dx.doi.org/10.3102/0013189X14523038.
Delaney, P. F., Verkoeijen, P. P., & Spirgel, A. (2010). Spacing and testing effects: A deeply critical, lengthy, and at times discursive review of the literature. Psychology of learning and motivation, 53, 63-147.
Dempster, F. N., & Farris, R. (1990). The spacing effect: research and practice. Journal of Research & Development in Education. 23(2), 97-101.
Donovan, J. J., & Radosevich, D. J. (1999). A meta-analytic review of the distribution of practice effect: Now you see it, now you don't. Journal of Applied Psychology, 84(5), 795-805. http://doi.org/10.1037/0021-9010.84.5.795.
Dunlosky, J., Rawson, K.A., Marsh, E.J., Nathan, M.J., & Willingham, D.T. (2013). Improving students’ learning with effective learning techniques promising directions from cognitive and educational psychology. Psychological Science in the Public Interest, 14(1), 4–58. http://doi.org/10.1177/1529100612453266.
Ferrari, J. (1992). Procrastinators and perfect behavior: An exploratory factor analysis of self-presentation, self-awareness, and self-handicapping components. Journal of Research in Personality, 26, 75–84.
Ferrari, J., & Tice, D. (2000). Procrastination as a self-handicap for men and women: A task-avoidance strategy in a laboratory setting. Journal of Research in Personality, 34, 73–83
Fournier, H., Kop, R., & Durand, G. (2014). Challenges to research in MOOCs. Journal of Online Learning and Teaching 10(1), 1-15.
Goda, Y., Yamada, M., Kato, H., Matsuda, T., Saito, Y., & Miyagawa, H. (2015). Procrastination and other learning behavioral types in e-learning and their relationship with learning outcomes. Learning and Individual Differences, 37, 72-80.
Greene, J. A., Oswald, C. A., & Pomerantz, J. (2015). Predictors of retention and achievement in a massive open online course. American Educational Research Journal, 52(5), 925-955.
Howell, A. J., Watson, D. C., Powell, R. A., & Buro, K. (2006). Academic procrastination: The pattern and correlates of behavioural postponement. Personality and Individual Differences, 40, 1519–1530
Jo, I., Kim, Y. (2013). Impact of learner`s time management strategies on achievement in an e-learning environment: A learning analytics approach. Journal of Korean Association for Educational Information and Media, 19(1), 83-107
Jossberger, H., Brand‐Gruwel, S., Boshuizen, H., & Van de Wiel, M. (2010). The challenge of self‐directed and self‐regulated learning in vocational education: A theoretical analysis and synthesis of requirements. Journal of Vocational Education and Training, 62(4), 415-440.
Karweit, N. (1984). Time-on-task reconsidered: Synthesis of research on time and learning. Educational Leadership, 41(8), 32–35.
Karweit, N., & Slavin, R. E. (1982). Time-on-task: Issues of timing, sampling, and definition. Journal of Educational Psychology, 74(6), 844–851. http://doi.org/10.1037/0022-0663.74.6.844
Klassen, R. M., Krawchuk, L. L., Lynch, S. L., & Rajani, S. (2008). Procrastination and mo- tivation of undergraduates with learning disabilities: A mixed-methods inquiry. Learning Disabilities Research and Practice, 23(3), 137–147
Kovanović, V., Gašević, D., Dawson, S., Joksimović, S., Baker, R. S., & Hatala, M. (2015). Does time-on-task estimation matter? Implications for the validity of learning analytics findings. Journal of Learning Analytics, 2(3), 81–110. http://doi.org/10.18608/jla.2015.23.6.
Lemke, J. (2001). The long and the short of it: Comments on multiple timescale studies of human activity. Journal of the Learning Sciences, 10(1-2), 17–26.
Liyanagunawardena, T. R., Adams, A. A., & Williams, S. A. (2013). MOOCs: A systematic study of the published literature 2008-2012. International Review of Research in Open and Distance Learning, 14(3), 202-227.
Lowenthal, P. R. & Hodges, C. B. (2015). In search of quality: Using quality matters to analyze the quality of massive, open, online courses (MOOCs). International Review of Research in Open and Distributed Learning, 16(5), 83-101.
Means, B., Toyama, Y., Murphy, R., Bakia, M., & Jones, K. (2010). Evaluation of evidence-based practices in online learning: A meta-analysis and review of online learning studies. Report. Washington, D.C.: US Department of Education Office of Planning, Evaluation, and Policy Development.
Mercer, N. (2008). The seeds of time: Why classroom dialogue needs a temporal analysis. Journal of the Learning Sciences, 17(1), 33–59. http://doi.org/10.1080/10508400701793182.
Meyer, C. L. (2000). Academic procrastination and self-handicapping: Gender differences in response to noncontingent feedback. Journal of Social Behavior and Personality, 15(5), 87–102.
Michinov, N., Brunot, S., Le Bohec, O., Juhel, J., & Delaval, M. (2011). Procrastination, participation, and performance in online learning environments. Computers & Education, 56(1), 243–252. http://doi.org/10.1016/j.compedu.2010.07.025
Miyamoto, Y. R., Coleman, C. A., Williams, J. J., Whitehill, J., Nesterko, S., & Reich, J. (2015). Beyond time-on-task: The relationship between spaced study and certification in MOOCs. Journal of Learning Analytics, 2(2), 70–74.
Penuel, W. R., Fishman, B. J., Yamaguchi, R., & Gallagher, L. P. (2007). What makes professional development effective? Strategies that foster curriculum implementation. American Educational Research Journal, 44(4), 921-958.
Perna, L. L., Ruby, A., Boruch, R. F., Wang, N., Scull, J., Ahmad, S., & Evans, C. (2014). Moving through MOOCs: Understanding the progression of users in massive open online courses. Educational Researcher, 43(9), 421-432.
Rawson, K.A., & Dunlosky, J. (2011). Optimizing schedules of retrieval practice for durable and efficient learning: How much is enough? Journal of Experimental Psychology. General, 140(3), 283–302. http://doi.org/10.1037/a0023956.
Riel, J., & Lawless, K. A. (2015). Massive open online courses (MOOCs) and the technologies that support learning with them. In Khosrow-Pour, M. (Ed.) Encyclopedia of Information Science and Technology (3rd Ed.). Hershey, PA: IGI Global.
Riel, J., & Lawless, K. A. (2016a). “Spread index:” A metric for identifying when work is completed and quantifying procrastination in self-paced, online teacher professional development courses. Method report – Personal Working Paper 1. http://doi.org/10.13140/RG.2.1.1119.3840.
Riel, J., & Lawless, K. A. (2016b). “Spacing count:” A metric for identifying the degree to which work is spaced out and distributed over time in distance learning and online professional development courses. Method report – Personal Working Paper 2. http://doi.org/10.13140/RG.2.2.32359.24486/1.
Riel, J., Lawless, K. A., & Brown, S. W. (2016). Completion, time-in-intervention, and movement: Relationships between dimensions of participation in oTPD and knowledge growth. Paper presented at the 2016 American Educational Research Association Annual Meeting, Washington, D.C. http://doi.org/10.13140/RG.2.1.3452.7123.
Roediger, H. L., & Butler, A. C. (2011). The critical role of retrieval practice in long-term retention. Trends in cognitive sciences, 15(1), 20-27.
Rohrer, D. (2012). Interleaving helps students distinguish among similar concepts. Educational Psychology Review, 24(3), 355-367.
Roth, W. M. (2006). Learning science: A singular plural perspective. Rotterdam, The Netherlands: Sense.
Schraw, G., & Olafson, T. W. (2007). Doing the things we do: A grounded theory of academic procrastination. Journal of Educational Psychology, 99(1), 12–25. http://doi.org/10.1037/0022-0663.99.1.12.
Shen, C., & Kuo, C.-J. (2015). Learning in massive open online courses: Evidence from social media mining. Computers in Human Behavior, 51, 568-577.
Strunk, K. K., Cho, Y., Steele, M. R., & Bridges, S. L. (2013). Development and validation of a 2×2 model of time-related academic behavior: Procrastination and timely engagement. Learning and Individual Differences, 25, 35–44. http://doi.org/10.1016/j.lindif.2013.02.007.
Terras, M. M., & Ramsay, J. (2015). Massive open online courses (MOOCs): Insights and challenges from a psychological perspective. British Journal of Educational Technology, 46(3), 472-487. http://doi.org/10.1111/bjet.12274.
Wang, Y., Paquette, L., & Baker, R. (2014). A longitudinal study on learner career advancement in MOOCs. Journal of Learning Analytics, 1(3), 203-206. Retrieved from http://epress.lib.uts.edu.au/journals/index.php/JLA/article/view/4200.
Wäschle, K., Allgaier, A., Lachner, A., Fink, S., & Nückles, M. (2014). Procrastination and self-efficacy: Tracing vicious and virtuous circles in self-regulated learning. Learning and Instruction, 29, 103–114. http://doi.org/10.1016/j.learninstruc.2013.09.005
Wolters, C. A. (2003). Understanding procrastination from a self-regulated learning perspective. Journal of Educational Psychology, 95(1), 179–187. http://doi.org/10.1037/0022-0663.95.1.179
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2018 Journal of Learning Analytics
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
Authors who publish with this journal agree to the following terms:- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons License, Attribution - NonCommercial-NoDerivs 3.0 Unported (CC BY-NC-ND 3.0) license that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
