Handbook of Learning Analytics
Chapter 9
Learning Analytics for Understanding and Supporting Collaboration
Bodong Chen & Stephanie D. Teasley
Abstract
Collaboration is an important competency in the modern society. To harness the intersection of learning, work, and collaboration with analytics, several fundamental challenges need to be addressed. This chapter about collaboration analytics aims to highlight these challenges for the learning analytics community. We first survey the conceptual landscape of collaboration and learning with a focus on the computer-supported collaborative learning (CSCL) literature while attending to perspectives from computer supported cooperative work (CSCW). Grounded in the conceptual exploration, we then distinguish two salient strands of collaboration analytics: (a) \textit{computational analysis of collaboration} that applies computational methods to examining collaborative processes; and (b) \textit{analytics for collaboration} which is primarily concerned with designing and deploying data analytics in authentic contexts to facilitate collaboration. Examples and cases representing different contexts for learning and analytical frames are presented, followed by a discussion of key challenges and future directions.
Alavi, Hamed S., and Pierre Dillenbourg. 2012. “An Ambient Awareness Tool for Supporting Supervised Collaborative Problem Solving.” IEEE Transactions on Learning Technologies 5 (3): 264–74. https://doi.org/10.1109/TLT.2012.7.
Bergner, Yoav, Jessica J Andrews, Mengxiao Zhu, and Joseph E Gonzales. 2016. “Agent-Based Modeling of Collaborative Problem Solving.” ETS Research Report Series 2016 (2): 1–14.
Berkowitz, Marvin W., and John C. Gibbs. 1983. “Measuring the Developmental Features of Moral Discussion.” Merrill-Palmer Quarterly (1982-), 399–410.
Burtis, P. J. 1998. Analytic Toolkit for Knowledge Forum. Centre for Applied Cognitive Science, Ontario Institute for Studies in Education of the University of Toronto.
Chen, Bodong, Yizhou Fan, Guogang Zhang, Min Liu, and Qiong Wang. 2020. “Teachers’ Networked Professional Learning with Moocs.” Plos One 15 (7): e0235170.
Chen, Bodong, Hong Shui, and Stian Håklev. 2020. “Designing Orchestration Support for Collaboration and Knowledge Flows in a Knowledge Community.” In Proceedings of the 14th International Conference of the Learning Sciences (ICLS). Nashville, TN: International Society of the Learning Sciences.
Collins, Allan, Gerhard Fischer, Brigid Barron, Chen-Chung Liu, and Hans Spada. 2009. “Long-Tail Learning: A Unique Opportunity for Cscl?”
Cosley, Dan, Dan Frankowski, Loren Terveen, and John Riedl. 2007. “SuggestBot: Using Intelligent Task Routing to Help People Find Work in Wikipedia.” In Proceedings of the 12th International Conference on Intelligent User Interfaces, 32–41. IUI ’07. New York, NY, USA: ACM. https://doi.org/10.1145/1216295.1216309.
Cranshaw, Justin, Emad Elwany, Todd Newman, Rafal Kocielnik, Bowen Yu, Sandeep Soni, Jaime Teevan, and Andrés Monroy-Hernández. 2017. “Calendar.help: Designing a Workflow-Based Scheduling Agent with Humans in the Loop.” In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems - CHI ’17, 2382–93. Denver, Colorado, USA: ACM Press. https://doi.org/10.1145/3025453.3025780.
Dillenbourg, Pierre, Sanna Järvelä, and Frank Fischer. 2009. “The Evolution of Research on Computer-Supported Collaborative Learning.” In Technology-Enhanced Learning, 3–19. Springer.
Dix, Alan, Alan John Dix, Janet Finlay, Gregory D. Abowd, and Russell Beale. 2003. Human-Computer Interaction. Pearson Education.
Echeverria, Vanessa, Roberto Martinez-Maldonado, and Simon Buckingham Shum. 2019. “Towards Collaboration Translucence: Giving Meaning to Multimodal Group Data.” In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, 39:1–39:16. CHI ’19. New York, NY, USA: ACM. https://doi.org/10.1145/3290605.3300269.
Ferguson, Rebecca. 2012. “Learning Analytics: Drivers, Developments and Challenges.” International Journal of Technology Enhanced Learning 4 (5-6): 304–17.
Fischer, Gerhard. 2018. “Massive Open Online Courses (Moocs) and Rich Landscapes of Learning: A Learning Sciences Perspective.” International Handbook of the Learning Sciences. Routledge/Taylor-Francis, 368–79.
Gašević, Dragan, Shane Dawson, and George Siemens. 2015. “Let’s Not Forget: Learning Analytics Are About Learning.” TechTrends 59 (1): 64–71.
Gašević, Dragan, Srećko Joksimović, Brendan R. Eagan, and David Williamson Shaffer. 2018. “SENS: Network Analytics to Combine Social and Cognitive Perspectives of Collaborative Learning.” Computers in Human Behavior, July. https://doi.org/10.1016/j.chb.2018.07.003.
Geiger, R. Stuart. 2009. “The Social Roles of Bots and Assisted Editing Programs.” In Proceedings of the 5th International Symposium on Wikis and Open Collaboration - WikiSym ’09, 1. Orlando, Florida: ACM Press. https://doi.org/10.1145/1641309.1641351.
Goggins, Sean P., and Isa Jahnke. 2013. “CSCL@ Work: Computer-Supported Collaborative Learning at the Workplace—Making Learning Visible in Unexpected Online Places Across Established Boundaries.” In Computer-Supported Collaborative Learning at the Workplace, 1–20. Springer.
Greeno, James G. 1998. “The Situativity of Knowing, Learning, and Research.” American Psychologist 53 (1): 5–26. https://doi.org/10.1037/0003-066X.53.1.5.
Grudin, Jonathon. 1994. “Computer-Supported Cooperative Work: History and Focus.” Computer 27 (5): 19–26. https://doi.org/10.1109/2.291294.
Håklev, Stian, Louis Faucon, Thanasis Hadzilacos, and Pierre Dillenbourg. 2017. “Orchestration Graphs: Enabling Rich Social Pedagogical Scenarios in MOOCs.” In Proceedings of the Fourth (2017) ACM Conference on Learning @ Scale, 261–64. L@S ’17. New York, NY, USA: ACM. https://doi.org/10.1145/3051457.3054000.
Halatchliyski, Iassen, Tobias Hecking, Tilman Goehnert, and H Ulrich Hoppe. 2014. “Analyzing the Main Path of Ideas and Activity of Contributors in an Open Learning Community.” Journal of Learning Analytics 1 (2): 72–93.
Haythornthwaite, Caroline, Priya Kumar, Anatoliy Gruzd, Sarah Gilbert, Marc Esteve del Valle, and Drew Paulin. 2018. “Learning in the Wild: Coding for Learning and Practice on Reddit.” Learning, Media and Technology 43 (3): 219–35. https://doi.org/10.1080/17439884.2018.1498356.
Howley, Iris, Elijah Mayfield, and Carolyn Penstein Rosé. 2013. “Linguistic Analysis Methods for Studying Small Groups.” In The International Handbook of Collaborative Learning, edited by Cindy E Hmelo-Silver, Carol K K O’Donnell AChan, and Clark A Chinn, 184–202. Abingdon, Oxford, UK: Taylor & Francis.
Hutchins, Edwin. 1995. “How a Cockpit Remembers Its Speeds.” Cognitive Science 19 (3): 265–88. https://doi.org/10.1207/s15516709cog1903_1.
Jeong, Heisawn, Cindy E Hmelo-Silver, and Yawen Yu. 2014. “An Examination of CSCL Methodological Practices and the Influence of Theoretical Frameworks 2005–2009.” International Journal of Computer-Supported Collaborative Learning 9 (3): 305–34. https://doi.org/10.1007/s11412-014-9198-3.
Kim, Taemie, Erin McFee, Daniel Olguin Olguin, Ben Waber, and Alex “Sandy” Pentland. 2012. “Sociometric Badges: Using Sensor Technology to Capture New Forms of Collaboration: Sensor technology and collaboration in teams.” Journal of Organizational Behavior 33 (3): 412–27. https://doi.org/10.1002/job.1776.
Leeuwen, Anouschka van, Nikol Rummel, and Tamara van Gog. 2019. “What Information Should CSCL Teacher Dashboards Provide to Help Teachers Interpret CSCL Situations?” International Journal of Computer-Supported Collaborative Learning, May. https://doi.org/10.1007/s11412-019-09299-x.
Leeuwen, Anouschka van, Alyssa Friend Wise, and Stephanie D. Teasley. 2021. “Teacher and Student Facing Learning Analytics.” In The Handbook of Learning Analytics, 2nd ed. Vancouver, B.C: SOLAR.
LIFE Center. 2005. “The LIFE Center Lifelong and Lifewide Learning Diagram.” http://life-slc.org/about/citationdetails.html.
Littlejohn, Allison. 2017. “Learning and Work: Professional Learning Analytics.” In Handbook of Learning Analytics, edited by Charles Lang, George Siemens, Alyssa Friend Wise, USA New York University, and Dragan Gasevic, First, 269–77. Society for Learning Analytics Research (SoLAR). https://solaresearch.org/hla-17/hla17-chapter23.
Ma, Leanne, Yoshiaki Matsuzawa, Bodong Chen, and Marlene Scardamalia. 2016. “Community Knowledge, Collective Responsibility: The Emergence of Rotating Leadership in Three Knowledge Building Communities.” In Transforming Learning, Empowering Learners: The International Conference of the Learning Sciences (ICLS) 2016, Volume 1, edited by C K Looi, J L Polman, U Cress, and P Reimann, 1:615–22. The International Society of the Learning Sciences.
Messmann, Gerhard, Mien Segers, and Filip Dochy, eds. 2018. Informal Learning at Work. 1st ed. Routledge.
Michaels, Sarah, Catherine O’Connor, and Lauren B. Resnick. 2008. “Deliberative Discourse Idealized and Realized: Accountable Talk in the Classroom and in Civic Life.” Studies in Philosophy and Education 27 (4): 283–97. https://doi.org/10.1007/s11217-007-9071-1.
Miller, Mariel, and Allyson Hadwin. 2015. “Scripting and Awareness Tools for Regulating Collaborative Learning: Changing the Landscape of Support in Cscl.” Computers in Human Behavior 52: 573–88.
Mockus, Audris, Roy T Fielding, and James D Herbsleb. 2002. “Two Case Studies of Open Source Software Development: Apache and Mozilla.” ACM Transactions on Software Engineering and Methodology (TOSEM) 11 (3): 309–46.
Modi, Pragnesh Jay, Manuela Veloso, Stephen F. Smith, and Jean Oh. 2005. “CMRadar: A Personal Assistant Agent for Calendar Management.” In Agent-Oriented Information Systems II, edited by Paolo Bresciani, Paolo Giorgini, Brian Henderson-Sellers, Graham Low, and Michael Winikoff, 3508:169–81. Berlin, Heidelberg: Springer Berlin Heidelberg. http://link.springer.com/10.1007/11426714_12.
Oshima, Jun, Ritsuko Oshima, and Yoshiaki Matsuzawa. 2012. “Knowledge Building Discourse Explorer: A Social Network Analysis Application for Knowledge Building Discourse.” Educational Technology Research and Development: ETR & D 60 (5): 903–21. https://doi.org/10.1007/s11423-012-9265-2.
Piaget, Jean. 1985. The Equilibration of Cognitive Structures: The Central Problem of Intellectual Development. University of Chicago Press.
Puntambekar, Sadhana, Gijsbert Erkens, and Cindy Hmelo-Silver. 2011. Analyzing Interactions in Cscl: Methods, Approaches and Issues. Vol. 12. Springer Science & Business Media.
Ronaghi Khameneh, F, A Saberi, A Goel, and R Johari. 2017. “Collaborative Learning at Scale.” PhD thesis, PhD Thesis]. Stanford University.
Roschelle, Jeremy, and Stephanie D Teasley. 1995. “The Construction of Shared Knowledge in Collaborative Problem Solving.” In Computer Supported Collaborative Learning, 69–97. Springer, Berlin, Heidelberg.
Schneider, Bertrand, and Roy Pea. 2015. “Does Seeing One Another’s Gaze Affect Group Dialogue a Computational Approach.” Journal of Learning Analytics 2 (2): 107–33. https://doi.org/10.18608/jla.2015.22.9.
Siemens, George. 2013. “Learning Analytics: The Emergence of a Discipline.” The American Behavioral Scientist 57 (10): 1380–1400.
Singer, Janice, Stephanie D. Behrend, and Jeremy Roschelle. 1988. “Children’s Collaborative Use of a Computer Microworld.” In Proceedings of the 1988 ACM Conference on Computer-Supported Cooperative Work - CSCW ’88, 271–81. Portland, Oregon, United States: ACM Press. https://doi.org/10.1145/62266.62288.
Spikol, Daniel, Emanuele Ruffaldi, and Mutlu Cukurova. 2017. “Using Multimodal Learning Analytics to Identify Aspects of Collaboration in Project-Based Learning.” In Proceedings of the International Society of the Learning Sciences. Philadelphia, PA: International Society of the Learning Sciences.
Stahl, Gerry, and Kai Hakkarainen. 2020. “Theories of CSCL.” In International Handbook of Computer Supported Collaborative Learning.
Stahl, Gerry, Timothy D. Koschmann, and Daniel D. Suthers. 2014. “Computer-Supported Collaborative Learning.” In Cambridge Handbook of the Learning Sciences, edited by R Keith Sawyer, 479–500. Cambridge: Cambridge University Press.
Suebnukarn, Siriwan, and Peter Haddawy. 2004. “A Collaborative Intelligent Tutoring System for Medical Problem-Based Learning.” In Proceedings of the 9th International Conference on Intelligent User Interfaces, 14–21. IUI ’04. Funchal, Madeira, Portugal: Association for Computing Machinery. https://doi.org/10.1145/964442.964447.
Suthers, Daniel D. 2006. “Technology Affordances for Intersubjective Meaning Making: A Research Agenda for Cscl.” International Journal of Computer-Supported Collaborative Learning 1 (3): 315–37.
Suthers, Daniel D., Kristine Lund, Carolyn Penstein Rosé, Chris Teplovs, and Nancy Law, eds. 2013. Productive Multivocality in the Analysis of Group Interactions. Boston, MA: Springer US.
Suthers, Daniel D., and Devan Rosen. 2011. “A Unified Framework for Multi-Level Analysis of Distributed Learning.” In Proceedings of the 1st International Conference on Learning Analytics and Knowledge, 64–74.
Tegos, Stergios, and Stavros Demetriadis. 2017. “Conversational Agents Improve Peer Learning Through Building on Prior Knowledge.” Journal of Educational Technology & Society 20 (1): 99–111. http://login.ezproxy.lib.umn.edu/login?url=http://search.ebscohost.com/login.aspx?direct=true&AuthType=ip,uid&db=aph&AN=120706105&site=ehost-live.
Teplovs, Chris, Zoe Donoahue, and Marlene Scardamalia. 2007. “Tools for Concurrent, Embedded, and Transformative Assessment of Knowledge Building Processes and Progress.” In Proceedings of the 8th Iternational Conference on Computer Supported Collaborative Learning, 721–23. New Brunswick, New Jersey, USA: International Society of the Learning Sciences.
Tissenbaum, Mike, and Jim Slotta. 2019. “Supporting Classroom Orchestration with Real-Time Feedback: A Role for Teacher Dashboards and Real-Time Agents.” International Journal of Computer-Supported Collaborative Learning 14 (3): 325–51.
Tsai, Yi-Shan, Carlo Perrotta, and Dragan Gašević. 2020. “Empowering Learners with Personalised Learning Approaches? Agency, Equity and Transparency in the Context of Learning Analytics.” Assessment & Evaluation in Higher Education 45 (4): 554–67.
Tsvetkova, Milena, Ruth Garc’ıa-Gavilanes, Luciano Floridi, and Taha Yasseri. 2017. “Even Good Bots Fight: The Case of Wikipedia.” PloS One 12 (2): e0171774.
Wang, Zhijun, Terry Anderson, and Li Chen. 2018. “How Learners Participate in Connectivist Learning: An Analysis of the Interaction Traces from a cMOOC.” The International Review of Research in Open and Distributed Learning 19 (1). https://doi.org/10.19173/irrodl.v19i1.3269.
Wen, Miaomiao, Keith Maki, Steven Dow, James D. Herbsleb, and Carolyn Rose. 2017. “Supporting Virtual Team Formation Through Community-Wide Deliberation.” Proc. ACM Hum.-Comput. Interact. 1 (CSCW): 109:1–109:19. https://doi.org/10.1145/3134744.
Wilson, Paul. 1991. Computer Supported Cooperative Work: An Introduction. Springer Netherlands. https://www.springer.com/gp/book/9780792314462.
Winkler, Rainer, Maya Lisa Neuweiler, Eva Bittner, and Matthias Söllner. 2019. “Hey Alexa, Please Help Us Solve This Problem! How Interactions with Smart Personal Assistants Improve Group Performance.” In ICIS International Conference of Information Systems. Munich: ACM Digital. https://www.alexandria.unisg.ch/258542/.
Wise, Alyssa Friend, Roger Azevedo, Karsten Stegmann, Jonna Malmberg, Carolyn Penstein Rosé, Nicholas Mudrick, Michelle Taub, et al. 2015. “CSCL and Learning Analytics: Opportunities to Support Social Interaction, Self-Regulation and Socially Shared Regulation.” In Exploring the Material Conditions of Learning: The Computer Supported Collaborative Learning (CSCL) Conference 2015, Volume 2, edited by Oskar Lindwall, Päivi Häkkinen, Timothy Koschmann, Pierre Tchounikine, and Sten Ludvigsen, 607–14. Gothenburg, Sweden: The International Society of the Learning Sciences.
Wise, Alyssa Friend, and Baruch B. Schwarz. 2017. “Visions of CSCL: Eight Provocations for the Future of the Field.” International Journal of Computer-Supported Collaborative Learning 12 (4): 423–67. https://doi.org/10.1007/s11412-017-9267-5.
Wise, Alyssa Friend, and David Williamson Shaffer. 2015. “Why Theory Matters More Than Ever in the Age of Big Data.” Journal of Learning Analytics 2 (2): 5–13.
Zhang, Jianwei, Dan Tao, Mei-Hwa Chen, Yanqing Sun, Darlene Judson, and Sarah Naqvi. 2018. “Co-Organizing the Collective Journey of Inquiry with Idea Thread Mapper.” Journal of the Learning Sciences 27 (3): 390–430. https://doi.org/10.1080/10508406.2018.1444992.
Zheng, Lei (Nico), Christopher M. Albano, Neev M. Vora, Feng Mai, and Jeffrey V. Nickerson. 2019. “The Roles Bots Play in Wikipedia.” Proceedings of the ACM on Human-Computer Interaction 3 (CSCW): 1–20. https://doi.org/10.1145/3359317.
Zhu, Haiyi, Bowen Yu, Aaron Halfaker, and Loren Terveen. 2018. “Value-Sensitive Algorithm Design: Method, Case Study, and Lessons.” In Proceedings of the ACM on Human-Computer Interaction, 2:194. https://doi.org/10.1145/3274463.
No Supplementary Material Available
Title
Learning Analytics for Understanding and Supporting Collaboration
Book Title
Handbook of Learning Analytics
Pages
pp. 86-95
Copyright
2022
DOI
10.18608/hla22.009
ISBN
978-0-9952408-3-4
Publisher
Society for Learning Analytics Research
Authors
Bodong Chen
Stephanie D. Teasley
Editors
Charles Lang
Alyssa Friend Wise
Agathe Merceron
Dragan Gašević
George Siemens