Learning Design and Learning Analytics: Snapshot 2020

Authors

DOI:

https://doi.org/10.18608/jla.2020.73.2

Keywords:

learning analytics, learning design

Abstract

“Learning design” belongs to that interesting class of concepts that appear on the surface to be simple and self-explanatory, but which are actually definitionally vague and contested in practice. Like “learning analytics,” the field of learning design aspires to improve teaching practice, the learning experience, and learning outcomes. And like learning analytics, this interdisciplinary field also lacks a shared language, common vocabulary, or agreement over its definition and purpose, resulting in uncertainty even about who its practitioners are — Educators? Designers? Researchers? All of these? (Law, Li, Farias Herrera, Chan & Pong, 2017). Almost a decade ago, however, learning analytics researchers pointed to the rich potential for synergies between learning analytics and learning design (Lockyer & Dawson, 2011). These authors (and others since, as cited below) argued that effective alignment of learning analytics and learning design would benefit both fields, and would offer educators and investigators the evidence they need that their efforts and innovations in learning design are “worth it” in terms of improving teaching practice and learning: "The integration of research related to both learning design and learning analytics provides the necessary contextual overlay to better understand observed student behavior and provide the necessary pedagogical recommendations where learning behavior deviates from pedagogical intention" (Lockyer & Dawson, 2011, p. 155).

References

Bakharia, A., Corrin, L., De Barba, P., Kennedy, G., Gašević, D., Mulder, R., … Lockyer, L. (2016). A conceptual framework linking learning design with learning analytics. Proceedings of the 6th International Conference on Learning Analytics and Knowledge (LAK ʼ16), 25–29 April 2016, Edinburgh, UK (pp. 329–338). New York, NY: ACM. https://dx.doi.org/10.1145/2883851.2883944

Bennett, S., Lockyer, L., & Agostinho, S. (2018). Towards sustainable technology-enhanced innovation in higher education: Advancing learning design by understanding and supporting teacher design practice. British Journal of Educational Technology, 49(6), 1014–1026. https://dx.doi.org/10.1111/bjet.12683

Conole, G. (2012). Designing for learning in an open world. New York, NY: Springer Science & Business Media.

Corrin, L., Kennedy, G., de Barba, P. G., Lockyer, L., Gašević, D., Williams, D., … Bakharia, A. (2016). Completing the loop: Returning meaningful learning analytic data to teachers. A handbook for educators and learning analytics specialists. Sydney, NSW, Australia: Government of Australia Office for Learning and Teaching. Retrieved from https://melbourne-cshe.unimelb.edu.au/__data/assets/pdf_file/0006/2083938/Loop_Handbook.pdf

Corrin, L., Law, N., Ringtved, U., & Milligan, S. (2018). DesignLAK18: Evaluating systems and tools that link learning analytics and learning design. Companion Proceedings of the 8th International Conference on Learning Analytics and Knowledge: Towards User-Centred Learning Analytics (LAK ’18), 5–9 March 2018, Sydney, NSW, Australia (pp. 1–5). Beaumont, AB, Canada: Society for Learning Analytics Research (SoLAR). Retrieved from http://bit.ly/lak18-companion-proceedings

Donald, C., Blumenstein, M., McDonald, J., Milne, J., & Gunn, C. (2016). Matching the rhythms of teaching to learning analytics. Paper presented at the International Consortium of Educational Developers and the Higher Education Learning and Teaching Association of Southern Africa (ICED/HELTASA).

Fritz, J. (2016). LMS course design as learning analytics variable. Paper presented at the 1st Learning Analytics for Curriculum and Program Quality Improvement Workshop (PCLA 2016). Companion Proceedings of the 6th International Conference on Learning Analytics and Knowledge: Towards User-Centred Learning Analytics (LAK ’16), 25–29 April 2016, Edinburgh, UK (pp. 15–19). Beaumont, AB, Canada: Society for Learning Analytics Research (SoLAR). Retrieved from http://ceur-ws.org/Vol-1590/

Gagnon, G. W., & Collay, M. (2005). Constructivist learning design: Key questions for teaching to standards. Thousand Oaks, CA: Corwin Press.

Gašević, D., Dawson, S., Rogers, T., & Gasevic, D. (2016). Learning analytics should not promote one size fits all: The effects of instructional conditions in predicting academic success. The Internet and Higher Education, 28, 68–84. https://dx.doi.org/10.1016/j.iheduc.2015.10.002

Gašević, D., Dawson, S., & Siemens, G. (2015). Let’s not forget: Learning analytics are about learning. TechTrends, 59(1), 64–71. https://dx.doi.org/10.1007/s11528-014-0822-x

Hernández-Leo, D., Martinez-Maldonado, R., Pardo, A., Muñoz-Cristóbal, J. A., & Rodríguez-Triana, M. J. (2019). Analytics for learning design: A layered framework and tools. British Journal of Educational Technology, 50(1), 139–152. https://dx.doi.org/10.1111/bjet.12645

Knight, S., Buckingham Shum, S., & Littleton, K. (2013). Epistemology, pedagogy, assessment and learning analytics. Proceedings of the 3rd International Conference on Learning Analytics and Knowledge (LAK ’13), 8–12 April 2013, Leuven, Belgium (pp. 75–84). New York, NY: ACM. https://dx.doi.org/10.1145/2460296.2460312

Koh, E., Shibani, A., Tan, J. P.-L., & Hong, H. (2016). A pedagogical framework for learning analytics in collaborative inquiry tasks: An example from a teamwork competency awareness program. Proceedings of the 6th International Conference on Learning Analytics and Knowledge (LAK ʼ16), 25–29 April 2016, Edinburgh, Scotland (pp. 74–83). New York: ACM. https://dx.doi.org/10.1145/2883851.2883914

Koper, R. (2006). Current research in learning design. Journal of Educational Technology & Society, 9(1), 13–22.

Law, N., Li, L., Farias Herrera, L., Chan, A., & Pong, T. C. (2017). A pattern language based learning design studio for an analytics informed inter-professional design community. Interaction Design and Architecture(s) Journal, 33, 92–-112. Retrieved from http://www.mifav.uniroma2.it/inevent/events/idea2010/doc/33_5.pdf

Lockyer, L., & Dawson, S. (2011). Learning designs and learning analytics. In P. Long, G. Siemens, G. Conole, & D. Gašević (Eds.), Proceedings of the 1st International Conference on Learning Analytics and Knowledge (LAK ʼ11), 27 February–1 March 2011, Banff, AB, Canada (pp. 153–156). New York, NY: ACM. https://dx.doi.org/10.1145/2090116.2090140

Lockyer, L., Heathcote, E., & Dawson, S. (2013). Informing pedagogical action: Aligning learning analytics with learning design. American Behavioral Scientist, 57(10), 1439–1459. https://dx.doi.org/10.1177/0002764213479367

Mangaroska, K., & Giannakos, M. (2019). Learning analytics for learning design: A systematic literature review of analytics-driven design to enhance learning. IEEE Transactions on Learning Technologies, 12(4), 516–534. https://dx.doi.org/10.1109/TLT.2018.2868673

Mor, Y., & Craft, B. (2012). Learning design: Reflections upon the current landscape. Research in Learning Technology, 20, 85–94. https://dx.doi.org/10.3402/rlt.v20i0.19196

Mor, Y., Craft, B., & Maina, M. (2015). Introduction. Learning design: Definitions, current issues and grand challenges. In Y. Mor, B. Craft, & M. Maina (Eds.), The art & science of learning design (pp. ix–xxvi). Rotterdam, NL: Sense.

Nguyen, Q., Huptych, M., & Rienties, B. (2018). Using temporal analytics to detect inconsistencies between learning design and students’ behaviours. Journal of Learning Analytics, 5(3), 120–135. https://dx.doi.org/10.18608/jla.2018.53.8

Nguyen, Q., Rienties, B., Toetenel, L., Ferguson, R., & Whitelock, D. (2017). Examining the designs of computer-based assessment and its impact on student engagement, satisfaction, and pass rates. Computers in Human Behavior, 76, 703–714. https://dx.doi.org/10.1016/j.chb.2017.03.028

Persico, D., & Pozzi, F. (2015). Informing learning design with learning analytics to improve teacher inquiry. British Journal of Educational Technology, 46(2), 230–248. https://dx.doi.org/10.1111/bjet.12207

Reiser, R. A., & Dempsey, J. V. (2007). Trends and issues in instructional design and technology. Boston, MA: Allyn & Bacon.

Rienties, B., Nguyen, Q., Holmes, W., & Reedy, K. (2017). A review of ten years of implementation and research in aligning learning design with learning analytics at the Open University UK. Interaction Design and Architecture(s) Journal, 33, 134–154. Retrieved from http://www.mifav.uniroma2.it/inevent/events/idea2010/doc/33_7.pdf

Rienties, B., & Toetenel, L. (2016). The impact of learning design on student behaviour, satisfaction and performance: A cross-institutional comparison across 151 modules. Computers in Human Behavior, 60, 333–341. https://dx.doi.org/10.1016/j.chb.2016.02.074

Schmitz, M., Van Limbeek, E., Greller, W., Sloep, P., & Drachsler, H. (2017). Opportunities and challenges in using learning analytics in learning design. Proceedings of the 12th European Conference on Technology Enhanced Learning (EC-TEL 2017), 12–15 September 2017, Tallinn, Estonia.Lecture Notes in Computer Science (pp. 209–223). Cham, Switzerland: Springer. https://dx.doi.org/10.1007/978-3-319-66610-5_16

Schott, F., & Seel, N. M. (2015). Instructional design. In International encyclopedia of the social and behavioral sciences (2nd ed., pp. 196–200). Oxford, UK: Elsevier. https://dx.doi.org/10.1016/B978-0-08-097086-8.92032-4

Seel, N. M., Lehmann, T., Blumschein, P., & Podolskiy, O. A. (2017). Instructional design for learning: Theoretical foundations. Rotterdam, NL: Sense.

Stewart, C. (2017). Learning analytics: Shifting from theory to practice. Journal on Empowering Teaching Excellence, 1(1), 10. https://dx.doi.org/10.15142/T3G63W

Wise, A. (2014). Designing pedagogical interventions to support student use of learning analytics. Proceedings of the 4th International Conference on Learning Analytics and Knowledge (LAK ʼ14), 24–28 March 2014, Indianapolis, IN, USA (pp. 203–211). New York, NY: ACM. https://dx.doi.org/10.1145/2567574.2567588

Wise, A., & Vytasek, J. (2017). Learning analytics implementation design. In C. Lang, G. Siemens, A. F. Wise, & D. Gaševic (Eds.), The handbook of learning analytics (1st ed., pp. 151–160). Beaumont, AB: Society for Learning Analytics Research (SoLAR). https://dx.doi.org/10.18608/hla17.013

Downloads

Published

2020-12-17

How to Cite

Macfadyen, L. P., Lockyer, L., & Rienties, B. (2020). Learning Design and Learning Analytics: Snapshot 2020. Journal of Learning Analytics, 7(3), 6-12. https://doi.org/10.18608/jla.2020.73.2

Issue

Section

Special Section: Learning Design and Learning Analytics