Gaining Insight by Transforming Between Temporal Representations of Human Interaction
Keywords:temporal representation, emotion,
Recordings of human interaction data can be organized into temporal representations with different affordances. We use audio data of a learning-related discussion analyzed for its low-level emotional indicators and divided into four phases, each characterized by an overarching emotion. After arguing for the relevance of emotion to learning, we examine this original analysis with the help of three different representations, transforming the data between them in order to connect micro- and macro-levels of analysis and give meaning to these connections. The first is a FRIEZE representation showing the temporal distribution of the low-level indicators of emotion as well as the phases. The second is an epistemic network analysis with an aggregated representation that shows how the pattern of associations among indicators of emotion differs between phases. The third is a transcription of the original data that re-anchors the aggregation back into the temporal interaction, giving it meaning. This is a methods paper, and if the findings are not specifically focused on measuring learning, the data do concern a student narrative of interactions with her teacher. More importantly, the stage is set for giving meaning to micro- and macro-connections in pedagogical contexts, with a view to automated analyses.
Andrist, S., Collier, W., Gleicher, M., Mutlu, B., & Shaffer, D. (2015). Look together: Analyzing gaze coordination with epistemic network analysis. Frontiers in Psychology, 6(1016). http://dx.doi.org/10.3389/fpsyg.2015.01016
Arastoopour, G., Shaffer, D. W., Swiecki, Z., Ruis, A. R., & Chesler, N. C. (2016). Teaching and assessing engineering design thinking with virtual internships and epistemic network analysis. International Journal of Engineering Education, 32(3B), 1492–1501.
Baker, M., Andriessen, J., & Lund, K. (2009). Socio-relational, affective and cognitive dimensions of CSCL interactions: Integrating theoretical-methodological perspectives. In C. O’Malley, D. Suthers, P. Reimann, & A. Dimitracopoulou (Eds.), Proceedings of the 8th International Conference on Computer-Supported Collaborative Learning (CSCL 2009), 8–13 June 2009, Rhodes, Greece (Vol. 2, pp. 31–33). International Society of the Learning Sciences.
Baker, M., Järvelä, S., & Andriessen, J. (Eds.) (2013). Affective learning together: Social and emotional dimensions of collaborative learning. London: Routledge.
Bakhtin, M. (1986). Speech genres and other late essays. Trans. Vern W. McGee. Austin, TX: University of Texas Press.
Boersma, P., & Weenink, D. (2017). Praat: Doing phonetics by computer [Computer program]. Version 6.0.24. http://www.praat.org/
Bransford, J. D., Brown, A. L., & Cocking, R. R. (1999). How people learn: Brain, mind, experience, and school. Washington, DC: National Academies Press.
Chi, M. T., Feltovich, P. J., & Glaser, R. (1981). Categorization and representation of physics problems by experts and novices. Cognitive Science, 5(2), 121–152. http://dx.doi.org/10.1207/s15516709cog0502_2
Cosnier, J. (1994). La psychologie des émotions et des sentiments, Paris, Retz; en version actualisée : Émotions et sentiments, Conférences Université Saint-Joseph, Beyrouth, 2004.
DiSessa, A. A. (1988). Knowledge in pieces. In G. Forman & P. Pufall (Eds.), Constructivism in the computer age (pp. 47–70). Lawrence Erlbaum Publishers.
Dorogovtsev, S. N., & Mendes, J. F. F. (2013). Evolution of networks: From biological nets to the Internet and WWW. Oxford, UK: Oxford University Press.
Dyke, G., Kumar, R., Ai, H., & Rosé, C. P. (2012). Challenging assumptions: Using sliding window visualizations to reveal time-based irregularities in CSCL processes. In J. van Aalst, B. J. Reiser, C. Hmelo-Silver, & K. Thompson (Eds.), The Future of Learning: Proceedings of the 10th International Conference of the Learning Sciences (ICLS ʼ12), 2–6 July 2012, Sydney, Australia (Vol. 1, pp. 363–370). International Society of the Learning Sciences.
Dyke, G., Lund, K., & Girardot, J.-J. (2009). Tatiana: An environment to support the CSCL analysis process. In C. O’Malley, D. Suthers, P. Reimann, & A. Dimitracopoulou (Eds.), Proceedings of the 8th International Conference on Computer-Supported Collaborative Learning (CSCL 2009), 8–13 June 2009, Rhodes, Greece (Vol 1, pp. 58–67). International Society of the Learning Sciences.
Dyke, G., Lund, K., Suthers, D. D., & Teplovs, C. (2013). Analytic representations and affordances for productive multivocality. In D. D. Suthers, K. Lund, C. P. Rosé, C. Teplovs, & N. Law (Eds.), Productive multivocality in the analysis of group interactions. In C.
Hoadley & N. Miyake (Series Eds.), Computer Supported Collaborative Learning Series: Vol. 15 (pp. 639–658). New York: Springer. http://dx.doi.org/10.1007/978-1-4614-8960-3_33
Fernández, M., Wegerif, R., Mercer, N., & Rojas-Drummond, S. (2002). Reconceptualizing “scaffolding” and the zone of proximal development in the context of symmetrical collaborative learning. Journal of Classroom Interaction, 36(2/1), 40–54.
Grize, J.-B. (1996). Logique naturelle et communication. Paris: Presses universitaires de France.
Grize, J.-B. (1997 ). Logique et langage. Paris: Ophrys.
Hatfield, D. L. (2015). The right kind of telling: An analysis of feedback and learning in a journalism epistemic game. International Journal of Gaming and Computer-Mediated Simulations, 7(2), 1–23.
Hmelo-Silver, C. E., Liu, L., & Jordan, R. (2009). Visual representation of a multidimensional coding scheme for understanding technology-mediated learning about complex natural systems. Research and Practice in Technology Enhanced Learning, 4(3), 253–280. http://dx.doi.org/10.1142/S1793206809000714
Cancho, R. F., & Solé, R. V. (2001). The small world of human language. Proceedings of the Royal Society of London B: Biological Sciences, 268(1482), 2261–2265.
Knight, S., Arastoopour, G., Shaffer, D. W., Shum, S. B., & Littleton, K. (2014). Epistemic networks for epistemic commitments. Paper presented at the International Conference of the Learning Sciences (ICLS ’14), 23–27 June 2014, Boulder, CO, USA.
Landauer, T. K., McNamara, D. S., Dennis, S., & Kintsch, W. (2007). Handbook of latent semantic analysis. Mahwah, NJ: Erlbaum.
Lipman, M. (2003). Thinking in education. Cambridge, UK: Cambridge University Press.
Lund, K., & Burgess, C. (1996). Producing high-dimensional semantic spaces from lexical co-occurrence. Behavior Research Methods, Instruments, & Computers, 28(2), 203–208. http://dx.doi.org/10.3758/BF03204766
Lund, K., & Suthers, D. D. (2013). Methodological dimensions. In D. D. Suthers, K. Lund, C. P. Rosé, C. Teplovs, & N. Law (Eds.), Productive multivocality in the analysis of group interactions. In C. Hoadley & N. Miyake (Series Eds.), Computer Supported Collaborative Learning Series: 15, 21–35, New York: Springer. http://dx.doi.org/10.1007/978-1-4614-8960-3
Molinari, G., & Lund, K. (2012). How a power game shapes expressing opinions in a chat and in an argument graph during a debate: A case study. In J. van Aalst, B. J. Reiser, C. Hmelo-Silver, & K. Thompson (Eds.), The Future of Learning: Proceedings of the 10th International Conference of the Learning Sciences (ICLS ʼ12), 2–6 July 2012, Sydney, Australia (Vol. 2, pp. 232–236). International Society of the Learning Sciences.
Mondada, L. (2001). Pour une linguistique interactionnelle, Marges Linguistiques, 1, mai, 142–162.
Newman, M. E. J. (2004). Analysis of weighted networks. Physical Review E, 70(5), 56131. http://dx.doi.org/10.1103/PhysRevE.70.056131
Orrill, C., Shaffer, D. W., & Burke, J. (2013). Exploring coherence in teacher knowledge using epistemic network analysis. Presented at the American Educational Research Association Annual Conference (AERA 2013), 27 April–1 May 2013, San Francisco, CA, USA.
Perret-Clermont, A.-N., Perret, J.-F., & Bell, N. (1991). The social construction of meaning and cognitive activity in elementary school children. In L. Resnick, J. Levine, & S. Teasley. Perspectives on socially shared cognition (pp. 41–62). Hyattsville, MD: American Psychological Association.
Plantin, C., Doury, M., & Traverso, V. (2000). Les émotions dans les interactions. Lyon: Presses Universitaires de Lyon.
Polo, C., Lund, K., Plantin, C., & Niccolai, G. (2016). Group emotions: The social and cognitive functions of emotions in argumentation. International Journal of Computer Supported Collaborative Learning, 11(2), 123–156. http://dx.doi.org/10.1007/s11412-016-9232-8
Polo, C., Plantin, C., Lund, K., & Niccolai, G. (2016). Group emotions in collective reasoning: A model. Argumentation. http://dx.doi.org/10.1007/s10503-016-9407-5
Quardokus Fisher, K., Hirshfield, L., Siebert-Evenstone, A. L., Arastoopour, G., & Koretsky, M. (2016). Network analysis of interactions between students and an instructor during design meetings. Proceedings of the Annual Conference of the American Society for Engineering Education (ASEE 2016), 26–29 June, New Orleans, LA, USA (17035). ASEE.
Quignard, M., Ursi, B., Rossi-Gensane, N., André, V., Baldauf-Quilliatre, H., et al. (2016). Une méthode instrumentée pour l’analyse multidimensionnelle des tonalités émotionnelles dans l’interaction. Congrès Mondial de Linguistique Française 2016, Tours, France. http://dx.doi.org/10.1051/shsconf/20162715004
Siebert-Evenstone, A. L., Arastoopour, G., Collier, W., Swiecki, Z., Ruis, A. R., & Shaffer, D. W. (2016). In search of conversational grain size: Modeling semantic structure using moving stanza windows. Paper presented at the 12th International Conference of the Learning Sciences (ICLS ’16), 20–24 June 2016, Singapore. http://dx.doi.org/10.22318/icls2016.82
Shaffer, D. W. (2012). Models of situated action: Computer games and the problem of transfer. In C. Steinkuehler, K. Squire, & S. Barab (Eds.), Games learning, and society: Learning and meaning in the digital age (pp. 403–433). Cambridge, UK: Cambridge University Press.
Shaffer, D. W. (2014). User guide for epistemic network analysis web version 3.3. Madison, WI: Games and Professional Simulations Technical Report 2014-1.
Shaffer, D. W. (2017). Quantitative ethnography. Madison, WI: Cathcart Press.
Shaffer, D. W., Collier, W., & Ruis, A. R. (2016). A tutorial on epistemic network analysis: Analyzing the structure of connections in cognitive, social, and interaction data. Journal of Learning Analytics, 3(3), 9–45. http://dx.doi.org/10.18608/jla.2016.33.3
Shaffer, D. W., Hatfield, D., Svarovsky, G., Nash, P., Nulty, A., Bagley, E. A., … Mislevy, R. J. (2009). Epistemic network analysis: A prototype for 21st century assessment of learning. The International Journal of Learning and Media, 1(1), 1–21. http://dx.doi.org/10.1162/ijlm.2009.0013
Shaffer, D. W., & Ruis, A. R. (2017). Epistemic network analysis: A worked example of theory-based learning analytics. In C. Lang, G. Siemens, A. Wise, & D. Gašević (Eds.), Handbook of learning analytics (pp. 175–187). Society for Learning Analytics Research. http://dx.doi.org/10.18608/hla17.015
Smagorinsky, P. (2011). Vygotsky and literacy research: A methodological framework (Vol. 2). Rotterdam, Netherlands/Boston, MA: Sense Publishers.
Suthers, D. D., & Desiato, C. (2012). Exposing chat features through analysis of uptake between contributions. Proceedings of the 45th Hawaii International Conference on System Sciences (HICSS-45), 4–7 January 2012, Maui, HI, USA (pp. 3368–3377). IEEE Computer Society. http://dx.doi.org/10.1109/HICSS.2012.274
Svarovsky, G. N. (2011). Exploring complex engineering learning over time with epistemic network analysis. Journal of Pre-College Engineering Education Research, 1(2), 19–30. http://dx.doi.org/10.5703/1288284314638
Wells, G. (1999). Dialogic inquiry: Towards a sociocultural practice and theory of education. Cambridge, UK: Cambridge University Press.
How to Cite
Copyright (c) 2017 Journal of Learning Analytics
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons License, Attribution - NonCommercial-NoDerivs 3.0 Unported (CC BY-NC-ND 3.0) license that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).