Microeconometric Approaches in Exploring the Relationships Between Early Alert Systems and Student Retention
A Case Study of a Regionally Based University in Australia
Keywords:student retention, logistic regression, survival analysis, treatment effects, learning analytics, early alert systems, research paper
Early alert systems (EAS) are an important technological tool to help manage and improve student retention. Data spanning 16,091 students over 156 weeks was collected from a regionally based university in Australia to explore various microeconometric approaches that establish links between EAS and student retention outcomes. Controlling for numerous confounding variables, significant relationships between the EAS and student retention were identified. Capturing dynamic relationships between the explanatory variables and the hazard of discontinuing provides new insight into understanding student retention factors. We concluded that survival models are the best methods of understanding student retention when temporal data is available.
Aguilar, S., Lonn, S., & Teasley, S. D. (2014). Perceptions and use of an early warning system during a higher education transition program. In Proceedings of the Fourth International Conference on Learning Analytics and Knowledge (LAK ’14), 24–28 March 2014, Indianapolis, IN, USA (pp. 113–117). New York: ACM. https://doi.org/10.1145/2567574.2567625
Arnold, K. E., Tanes, Z., & King, A. S. (2010). Administrative perceptions of data-mining software signals: Promoting student success and retention. The Journal of Academic Administration in Higher Education, 6(2), 29–39.
Astin, A. W. (1984). Student involvement: A developmental theory for higher education. Journal of College Student Personnel, 25(4), 297–308.
Bean, J. P. (1980). Dropouts and turnover: The synthesis of a causal model of student attrition. Research in Higher Education, 12(2), 155–187. https://doi.org/10.1007/BF00976194
Bean, J. P., & Metzner, B. S. (1985). A conceptual model of nontraditional undergraduate student attrition. Review of Educational Research, 55(4), 485–540. https://doi.org/10.3102/00346543055004485
Department of Education. (2014). Data from: Selected Higher Education Statistics — 2013 Student Data, All Students Table (Dataset). Department of Education. Canberra. Accessed 20 June 2015. http://docs.education.gov.au/system/files/doc/other/2013allstudents_0.xls
DesJardins, S. L., Ahlburg, D. A., & McCall, B. P. (2002). A temporal investigation of factors related to timely degree completion. The Journal of Higher Education, 73(5), 555–581. https://www.jstor.org/stable/1558433
Ferguson, R., & Clow, D. (2017). Where is the evidence? A call to action for learning analytics. In Proceedings of The Seventh International Conference on Learning Analytics and Knowledge (LAK ’17), 13–17 March 2017, Vancouver, BC, Canada (pp. 56–65). New York: ACM. https://doi.org/10.1145/3027385.3027396
Harrison, S., Villano, R., Lynch, G., & Chen, G. (2014). Timing student departure by estimating the length of enrolment for discontinuing students. Paper presented at the 2014 Australian Learning Analytics Summer Institute, University of Technology Sydney, 20–21 November 2014.
Harrison, S., Villano, R., Lynch, G., & Chen, G. (2015). Likelihood analysis of student enrollment outcomes using learning environment variables: A case study approach. In Proceedings of the Fifth International Conference on Learning Analytics and Knowledge (LAK ’15), 16–20 March 2015, Poughkeepsie, NY, USA (pp. 141–145). New York: ACM. https://doi.org/10.1145/2723576.2723621
Harrison, S. (2016). Microeconometric analysis of the relationships between early alert systems and student retention. PhD dissertation, University of New England, Armidale, NSW, Australia.
Harrison, S., Villano, R., Lynch, G., & Chen, G. (2016). Measuring financial implications of an early alert system. In Proceedings of the Sixth International Conference on Learning Analytics & Knowledge (LAK ’16), 25–29 April 2016, Edinburgh, UK (241–248). New York: ACM. https://doi.org/10.1145/2883851.2883923
Ishitani, T. T. (2003). A longitudinal approach to assessing attrition behavior among first-generation students: Time-varying effects of pre-college characteristics. Research in Higher Education, 44(4), 433–449. https://doi.org/10.1023/A:1024284932709
Ishitani, T. T. (2006). Studying attrition and degree completion behavior among first-generation college students in the United States. The Journal of Higher Education, 77(5), 861–885. https://doi.org/10.1080/00221546.2006.11778947
Ishitani, T. T., & DesJardins, S. L. (2003). A longitudinal investigation of dropout from college in the United States. Journal of College Student Retention: Research, Theory & Practice, 4(2): 173–201. https://doi.org/10.2190/V4EN-NW42-742Q-2NTL
Jayaprakash, S. M., Moody, E.W., Lauría, E. J. M., Regan, J. R., & Baron, J. D. (2014). Early alert of academically at-risk students: An open source analytics initiative. Journal of Learning Analytics, 1(1), 6–47. https://doi.org/10.18608/jla.2014.11.3
Jones-White, D. R., Radcliffe, P. M., Huesman, R. L., & Kellogg, J. P. (2010). Redefining student success: Applying different multinomial regression techniques for the study of student graduation across institutions of higher education. Research in Higher Education, 51(2): 154–174. https://doi.org/10.1007/s11162-009-9149-4
Lin, T.-C., Yu, W. W.-C., & Chen, Y.-C. (2012). Determinants and probability prediction of college student retention: New evidence from the probit model. International Journal of Education Economics and Development, 3(3), 217–236. http://doi.org/10.1504/IJEED.2012.049174
Marrington, A. D., Nelson, K. J., & Clarke, J. A. (2010). An economic case for systematic student monitoring and intervention in the first year in higher education. In Proceedings of the 13th Pacific Rim First Year in Higher Education Conference, 27–30 June 2010, Adelaide, Australia (pp. 1–4). Brisbane, Australia: Queensland University of Technology Publications. Retrieved from https://eprints.qut.edu.au/33231/
Nelson, K. J., & Creagh, T. (2013). A Good Practice Guide: Safeguarding Student Learning Engagement. Brisbane: Queensland University of Technology. Retrieved from https://eprints.qut.edu.au/59189/
Parnell, A., Jones, D., Wesaw, A., & Brooks, D. C. (2018). Institutions’ use of data and analytics for student success: Results from a national landscape analysis. EDUCAUSE Center for Analysis and Research (ECAR). Retrieved from https://www.naspa.org/images/uploads/main/DATA2018_DOWNLOAD.pdf
Siemens, G., Dawson, S., & Lynch, G. (2013). Improving the quality and productivity of the higher education sector: Policy and strategy for systems-level deployment of learning analytics. Sydney, Australia: Office for Learning and Teaching. Retrieved from https://solaresearch.org/wp-content/uploads/2017/06/SoLAR_Report_2014.pdf
Simons, J. M. (2011). A national study of student early alert models at four-year institutions of higher education. ProQuest LLC. Retrieved from https://eric.ed.gov/?id=ED535792
Singell, L. D., & Waddell, G. R. (2010). Modeling retention at a large public university: Can at-risk students be identified early enough to treat? Research in Higher Education, 51(6), 546–572. https://doi.org/10.1007/s11162-010-9170-7
Stratton, L. S., O’Toole, D. M., & Wetzel, J. N. (2007). Are the factors affecting dropout behavior related to initial enrollment intensity for college undergraduates? Research in Higher Education, 48(4), 453–485. https://doi.org/10.1007/s11162-006-9033-4
Tinto, V. (1975). Dropout from higher education: A theoretical synthesis of recent research. Review of Educational Research, 45(1), 89–125. https://doi.org/10.3102/00346543045001089
Tinto, V. (2006). Research and practice of student retention: What next? Journal of College Student Retention: Research, Theory & Practice, 8(1), 1–19. https://doi.org/10.2190/4YNU-4TMB-22DJ-AN4W
Villano, R., Harrison, S., Lynch, G., & Chen, G. (2018). Linking early alert systems and student retention: A survival analysis approach. Higher Education, 76, 903–920. https://doi.org/10.1007/s10734-018-0249-y
How to Cite
Copyright (c) 2021 Journal of Learning Analytics
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons License, Attribution - NonCommercial-NoDerivs 3.0 Unported (CC BY-NC-ND 3.0) license that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).