Handbook of Learning Analytics
Chapter 18
Learning Analytics and Learning at Scale
Justin Reich
Abstract
Learning at scale -- an interdisciplinary field at the intersection of learning science and computer science -- investigates learning environments with many, many learners and few experts to guide them. In recent decades, new large-scale learning environments have been announced with much fanfare about their potential to transform or “disrupt” traditional systems of formal schooling. This disruption has not occurred. Rather, new technologies are put to use in limited ways in specific niches of the existing education system, and the growth in their adoption is more steady and linear than abrupt or exponential. Though the societal impact of learning at scale has been uneven and incremental, the best hope for making the most of new large-scale technologies is through a continuous process of research and improvement.
Ames, Morgan G. 2019. The Charisma Machine. The MIT Press. https://doi.org/10.7551/mitpress/10868.001.0001.
“Build a School in the Cloud.” 2013. TED. https://www.ted.com/talks/sugata_mitra_build_a_school_in_the_cloud.
Chen, Guanliang, Dan Davis, Claudia Hauff, and Geert-Jan Houben. 2016. “Learning Transfer: Does It Take Place in Moocs? An Investigation into the Uptake of Functional Programming in Practice.” In Proceedings of the Third (2016) Acm Conference on Learning@ Scale, 409–18.
Christensen, Clayton M, Michael B Horn, and Curtis W Johnson. 2011. Disrupting Class: How Disruptive Innovation Will Change the Way the World Learns. Vol. 1. McGraw-Hill New York.
Colvin, Kimberly F., John Champaign, Alwina Liu, Qian Zhou, Colin Fredericks, and David E Pritchard. 2014. “Learning in an Introductory Physics MOOC: All Cohorts Learn Equally, Including an on-Campus Class.” The International Review of Research in Open and Distributed Learning 15 (4). https://doi.org/10.19173/irrodl.v15i4.1902.
Dean, Peter G., and Seymour Papert. 1981. “Mindstorms: Children, Computers and Powerful Ideas.” The Mathematical Gazette 65 (434): 298. https://doi.org/10.2307/3616611.
DeBoer, Jennifer, Andrew D. Ho, Glenda S. Stump, and Lori Breslow. 2014. “Changing “Course”.” Educational Researcher 43 (2): 74–84. https://doi.org/10.3102/0013189x14523038.
Glotzbach, Matthew. 2018. “New Monthly Milestone for Quizlet: 50 Million Monthly Learners.” Quilt Blog. https://quizlet.com/blog/a-new-milestone-for-quizlet-50-million-monthly- learners.
Hansen, John D., and Justin Reich. 2015. “Democratizing Education? Examining Access and Usage Patterns in Massive Open Online Courses.” Science 350 (6265): 1245–8. https://doi.org/10.1126/science.aab3782.
Hollands, Fiona M., and Devayani Tirthali. 2014. “MOOCs: Expectations and Reality.” Center for Benefit-Cost Studies of Education, Teachers College, Columbia University 138.
Kizilcec, Rene F., Mar Perez-Sanagustin, and Jorge J. Maldonado. 2017. “Self-Regulated Learning Strategies Predict Learner Behavior and Goal Attainment in Massive Open Online Courses.” Computers & Education 104 (January): 18–33. https://doi.org/10.1016/j.compedu.2016.10.001.
Kizilcec, René F., Andrew J. Saltarelli, Justin Reich, and Geoffrey L. Cohen. 2017. “Closing Global Achievement Gaps in MOOCs.” Science 355 (6322): 251–52. https://doi.org/10.1126/science.aag2063.
Koedinger, Kenneth R., Jihee Kim, Julianna Zhuxin Jia, Elizabeth A. McLaughlin, and Norman L. Bier. 2015. “Learning Is Not a Spectator Sport.” In Proceedings of the Second (2015) ACM Conference on Learning @ Scale. ACM. https://doi.org/10.1145/2724660.2724681.
Koedinger, Kenneth R., Elizabeth A. McLaughlin, Julianna Zhuxin Jia, and Norman L. Bier. 2016. “Is the Doer Effect a Causal Relationship?” In Proceedings of the Sixth International Conference on Learning Analytics & Knowledge. ACM. https://doi.org/10.1145/2883851.2883957.
Koller, Daphne. 2012. “What We’re Learning from Online Education.” American Psychological Association (APA). https://doi.org/10.1037/e619852012-001.
Kop, Rita. 2011. “The Challenges to Connectivist Learning on Open Online Networks: Learning Experiences During a Massive Open Online Course.” The International Review of Research in Open and Distributed Learning 12 (3): 19. https://doi.org/10.19173/irrodl.v12i3.882.
Leckart, Steven. 2012. “The Stanford Education Experiment Could Change Higher Learning Forever.” Wired. https://www.wired.com/2012/03/ff_aiclass/.
Littlejohn, Allison, and Colin Milligan. 2015. “Designing Moocs for Professional Learners: Tools and Patterns to Encourage Self-Regulated Learning.” eLearning Papers 42.
Milligan, Colin, Allison Littlejohn, and Anoush Margaryan. 2013. “Patterns of Engagement in Connectivist Moocs.” Journal of Online Learning and Teaching 9 (2): 149–59.
Mitra, Sugata. 2016. “The Future of Learning.” In Proceedings of the Third (2016) ACM Conference on Learning @ Scale. ACM. https://doi.org/10.1145/2876034.2876053.
Murphy, Robert, Larry Gallagher, Andrew E. Krumm, Jessica Mislevy, and Amy Hafter. 2014. “Research on the Use of Khan Academy in Schools: Research Brief.” SRI International.
Napier, Alyssa, Elizabeth Huttner-Loan, and Justin Reich. 2018. “From Online Learning to Offline Action.” In Proceedings of the Fifth Annual ACM Conference on Learning at Scale. ACM. https://doi.org/10.1145/3231644.3231674.
Reich, Justin. 2013. “EdTech Start-Ups and the Curse of the Familiar.” EdTechResearcher blog. http://www.edtechresearcher.com/2013/11/edtech_start-ups_and_the_curse_of_the_familar/.
———. 2014. “Will Computers Ever Replace Teachers.” The New Yorker: Elements Blog. https://www.newyorker.com/tech/annals-of-technology/will-computers-ever-replace-teachers.
———. 2015. “Rebooting MOOC Research.” Science 347 (6217): 34–35. https://doi.org/10.1126/science.1261627.
———. n.d. Failure to Disrupt Book Club with Cristina and Neil Heffernan. 33. TeachLab with Justin Reich.
Reich, Justin, and Mizuko Ito. 2017. “From Good Intentions to Real Outcomes: Equity by Design in Learning Technologies.” Digital Media and Learning Research Hub.
Resnick, Mitchel, John Maloney, Andres Monroy-Hernandez, Natalie Rusk, Evelyn Eastmond, Karen Brennan, Amon Millner, et al. 2009. “Scratch.” Communications of the ACM 52 (11): 60–67. https://doi.org/10.1145/1592761.1592779.
Ruiperez-Valiente, Jose A., Ruth Cobos, Pedro J. Munoz-Merino, Alvaro Andujar, and Carlos Delgado Kloos. 2017. “Early Prediction and Variable Importance of Certificate Accomplishment in a MOOC.” In Digital Education: Out to the World and Back to the Campus, 263–72. Springer International Publishing. https://doi.org/10.1007/978-3-319-59044-8_31.
Sandoval, William A., and Philip Bell. 2004. “Design-Based Research Methods for Studying Learning in Context: Introduction.” Educational Psychologist 39 (4): 199–201. https://doi.org/10.1207/s15326985ep3904_1.
Siemens, George. 2016. “Connectivism: A Learning Theory for the Digital Age.” Foundations of Educational Technology: Interdisciplinary Approaches to Educational Technology, 2014–2214.
Sweller, John. 2011. “Cognitive Load Theory.” In Psychology of Learning and Motivation, 37–76. Elsevier. https://doi.org/10.1016/b978-0-12-387691-1.00002-8.
Thorndike, Edward L. 1906. “The Principles of Teaching Based on Psychology.” The Elementary School Teacher 6 (8): 440–40. https://doi.org/10.1086/453574.
Trucano, Michael. 2013. “The Matthew Effect in Educational Technology.” EduTech. https://blogs.worldbank.org/edutech/matthew-effect-educational-technology.
Wang, Yuan, Ryan S. J. d. Baker, and Luc Paquette. 2017. “Behavioral Predictors of Mooc Post-Course Development.” In Proceedings of the Workshop on Integrated Learning Analytics of Mooc Post-Course Development.
Whitehill, Jacob, Kiran Mohan, Daniel Seaton, Yigal Rosen, and Dustin Tingley. 2017. “MOOC Dropout Prediction.” In Proceedings of the Fourth (2017) ACM Conference on Learning @ Scale. ACM. https://doi.org/10.1145/3051457.3053974.
Ye, Cheng, and Gautam Biswas. 2014. “Early Prediction of Student Dropout and Performance in MOOCs Using Higher Granularity Temporal Information.” Journal of Learning Analytics 1 (3): 169–72. https://doi.org/10.18608/jla.2014.13.14.
No Supplementary Material Available
Title
Learning Analytics and Learning at Scale
Book Title
Handbook of Learning Analytics
Pages
pp. 188-195
Copyright
2022
DOI
10.18608/hla22.018
ISBN
978-0-9952408-3-4
Publisher
Society for Learning Analytics Research
Authors
Justin Reich
Editors
Charles Lang
Alyssa Friend Wise
Agathe Merceron
Dragan Gašević
George Siemens