Learning Analytics Impact: Critical Conversations on Relevance and Social Responsibility

Authors

  • Xavier Ochoa
  • Simon Knight
  • Alyssa Friend Wise

DOI:

https://doi.org/10.18608/jla.2020.73.1

Abstract

Our 2019 editorial opened a dialogue about what is needed to foster an impactful field of learning analytics (Knight, Wise, & Ochoa, 2019). As we head toward the close of a tumultuous year that has raised profound questions about the structure and processes of formal education and its role in society, this conversation is more relevant than ever. That editorial, and a recent online community event, focused on one component of the impact: standards for scientific rigour and the criteria by which knowledge claims in an interdisciplinary, multi-methodology field should be judged. These initial conversations revealed important commonalities across statistical, computational, and qualitative approaches in terms of a need for greater explanation and justification of choices in using appropriate data, models, or other methodological approaches, as well as the many micro-decisions made in applying specific methodologies to specific studies. The conversations also emphasize the need to perform different checks (for overfitting, for bias, for replicability, for the contextual bounds of applicability, for disconfirming cases) and the importance of learning analytics research being relevant by situating itself within a set of educational values, making tighter connections to theory, and considering its practical mobilization to affect learning. These ideas will serve as the starting point for a series of detailed follow-up conversations across the community, with the goal of generating updated standards and guidance for JLA articles.

References

Buckingham Shum, S. (2019). Critical data studies, abstraction and learning analytics. Journal of Learning Analytics, 6(3), 5–10. https://dx.doi.org/10.18608/jla.2019.63.2

Chen, F., & Cui, Y. (2020). Utilizing student time series behaviour in learning management systems for early prediction of course performance. Journal of Learning Analytics, 7(2), 1–17. https://dx.doi.org/10.18608/jla.2020.72.1

Crossley, S. A., Karumbaiah, S., Ocumpaugh, J., Labrum, M. J., & Baker, R. S. (2020). Predicting math identity through language and click-stream patterns in a blended learning mathematics program for elementary students. Journal of Learning Analytics, 7(1), 19–37. https://dx.doi.org/10.18608/jla.2020.71.3

Dowell, N., Lin, Y., Godfrey, A., & Brooks, C. (2020). Exploring the relationship between emergent sociocognitive roles, collaborative problem-solving skills and outcomes: A group communication analysis. Journal of Learning Analytics, 7(1), 38–57. https://dx.doi.org/10.18608/jla.2020.71.4

Faucon, L., Olsen, J. K., Haklev, S., & Dillenbourg, P. (2020). Real-time prediction of students’ activity progress and completion rates. Journal of Learning Analytics, 7(2), 18–44. https://dx.doi.org/10.18608/jla.2020.72.2

Herodotou, C., Naydenova, G., Boroowa, A., Gilmour, A., & Rienties, B. (2020). How can predictive learning analytics and motivational interventions increase student retention and enhance administrative support in distance education? Journal of Learning Analytics, 7(2), 72–83. https://dx.doi.org/10.18608/jla.2020.72.4

Joksimovic, S., Siemens, G., Wang, Y. E., San Pedro, M. O. Z., & Way, J. (2020). Editorial: Beyond cognitive ability. Journal of Learning Analytics, 7(1), 1–4. https://dx.doi.org/10.18608/jla.2020.71.1

Kent, C., & Cukurova, M. (2020). Investigating collaboration as a process with theory-driven learning analytics. Journal of Learning Analytics, 7(1), 59–71. https://dx.doi.org/10.18608/jla.2020.71.5

Knight, S., Wise, A., & Ochoa, X. (2019). Fostering an impactful field of learning analytics. Journal of Learning Analytics, 6(3), 1–4. https://dx.doi.org/10.18608/jla.2019.63.1

Liang, L., & Law, N. (2020). A multilevel framework and method for learning analytics integrated learning design. Journal of Learning Analytics, 7(3), 97–116. https://dx.doi.org/10.18608/jla.2020.73.8

Macfadyen, L., Lockyer, L., & Rienties, B. (2020). Learning design and learning analytics: Snapshot 2020. Journal of Learning Analytics, 7(3), 5–11. https://dx.doi.org/10.18608/jla.2020.73.2

Mangaroska, K., Sharma, K., Giannakos, M., & Gasevic, D. (2020). Multimodal learning analytics to inform actionable interventions in learning design. Journal of Learning Analytics, 7(3), 78–96. https://dx.doi.org/10.18608/jla.2020.73.7

Means, B., & Neisler, J., with Langer Research Associates. (2020). Suddenly online: A national survey of undergraduates during the COVID-19 pandemic. San Mateo, CA: Digital Promise. Retrieved from https://digitalpromise.org/wp-content/uploads/2020/07/ELE_CoBrand_DP_FINAL_3.pdf

New America & Third Way (2020). New America Higher Ed survey. New York, NY: Global Strategy Group. Retrieved from https://www.thirdway.org/memo/new-polling-from-new-america-third-way-on-covid-19s-impact-on-current-and-future-college-students

Porter, T., Catalán Molina, D., Blackwell, L., Roberts, S., Quirk, A., Lee Duckworth, A., & Trzesniewski, K. (2020). Measuring mastery behaviors at scale: The Persistence, Effort, Resilience and Challenge-Seeking Task (PERC). Journal of Learning Analytics, 7(1), 5–18. https://dx.doi.org/10.18608/jla.2020.71.2

Society for Learning Analytics Research (SoLAR) (2020, June). Statement of support and call for action on social justice and dismantling injustice in education. Edmonton, AB: SoLAR. Retreived from https://www.solaresearch.org/2020/06/statement-of-support-and-call-for-action/

Wise, A., Knight, S., & Ochoa, X. (2018). When are learning analytics ready and what are they ready for? Journal of Learning Analytics, 5(3), 1–4. https://dx.doi.org/10.18608/jla.2018.53.1e

Downloads

Published

2020-12-17

How to Cite

Ochoa, X., Knight, S., & Wise, A. F. (2020). Learning Analytics Impact: Critical Conversations on Relevance and Social Responsibility. Journal of Learning Analytics, 7(3), 1-5. https://doi.org/10.18608/jla.2020.73.1

Most read articles by the same author(s)

1 2 > >>