Handbook of Learning Analytics

Ai, Hua, Diane J. Litman, Kate Forbes-Riley, Mihai Rotaru, Joel Tetreault, and Amruta Purandare. 2006. “Using System and User Performance Features to Improve Emotion Detection in Spoken Tutoring Dialogs.” Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH 2: 797–800.

Arroyo, Ivon, David G. Cooper, Winslow Burleson, Beverly Park Woolf, Kasia Muldner, and Robert Christopherson. 2009. “Emotion Sensors Go to School.” Frontiers in Artificial Intelligence and Applications 200 (1): 17–24. https://doi.org/10.3233/978-1-60750-028-5-17.

Aslan, Sinem, Nese Alyuz, Cagri Tanriover, Sinem E. Mete, Eda Okur, Sidney K. D’Mello, and Asli Arslan Esme. 2019. “Investigating the Impact of a Real-Time, Multimodal Student Engagement Analytics Technology in Authentic Classrooms.” In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems - CHI ’19, 1–12. New York, New York, USA: ACM Press. https://doi.org/10.1145/3290605.3300534.

Avry, Sunny, Guillaume Chanel, Mireille Bétrancourt, and Gaëlle Molinari. 2020. “Achievement Appraisals, Emotions and Socio-Cognitive Processes: How They Interplay in Collaborative Problem-Solving?” Computers in Human Behavior, January. https://doi.org/10.1016/j.chb.2020.106267.

Azevedo, Roger, and Robert M. Bernard. 1995. “A Meta-Analysis of the Effects of Feedback in Computer-Based Instruction.” Journal of Educational Computing Research 13 (2): 111–27. https://doi.org/10.2190/9lmd-3u28-3a0g-ftqt.

Baker, Ryan S.J.d., Albert T. Corbett, Kenneth R. Koedinger, Shelley Evenson, Ido Roll, Angela Z. Wagner, Meghan Naim, Jay Raspat, Daniel J. Baker, and Joseph E. Beck. 2006. “Adapting to When Students Game an Intelligent Tutoring System.” In Intelligent Tutoring Systems, edited by Mitsuru Ikeda, Kevin D Ashley, and Tak-Wai Chan, 392–401. Berlin: Springer Berlin Heidelberg.

Baker, Ryan S.J.d., and Jaclyn Ocumpaugh. 2015. “Interaction-Based Affect Detection in Educational Software.” In The Oxford Handbook of Affective Computing, edited by Rafael A. Calvo, Sidney K. D’Mello, Jonathan Gratch, and Arvid Kappas. Oxford University Press. https://doi.org/10.1093/oxfordhb/9780199942237.013.009.

Barth, Carola M., and Joachim Funke. 2010. “Negative Affective Environments Improve Complex Solving Performance.” Cognition & Emotion 24 (7): 1259–68. https://doi.org/10.1080/02699930903223766.

Bosch, Nigel, Huili Chen, Sidney K. D’Mello, Ryan S.J.d. Baker, and Valerie J. Shute. 2015. “Accuracy Vs. Availability Heuristic in Multimodal Affect Detection in the Wild.” In Proceedings of the 2015 ACM on International Conference on Multimodal Interaction - ICMI ’15, 267–74. New York: ACM Press. https://doi.org/10.1145/2818346.2820739.

Bosch, Nigel, Sidney K. D’Mello, Jaclyn Ocumpaugh, Ryan S.J.d. Baker, and Valerie Shute. 2016. “Using Video to Automatically Detect Learner Affect in Computer-Enabled Classrooms.” ACM Transactions on Interactive Intelligent Systems 6 (2): 1–26. https://doi.org/10.1145/2946837.

Calvo, Rafael A., and Sidney K. D’Mello. 2010. “Affect Detection: An Interdisciplinary Review of Models, Methods, and Their Applications.” IEEE Transactions on Affective Computing 1 (1): 18–37. https://doi.org/10.1109/T-AFFC.2010.1.

Clore, Gerald L., and Jeffrey R. Huntsinger. 2007. “How Emotions Inform Judgment and Regulate Thought.” Trends in Cognitive Sciences 11 (9): 393–99. https://doi.org/10.1016/j.tics.2007.08.005.

Conati, Cristina, and Heather Maclaren. 2009. “Empirically Building and Evaluating a Probabilistic Model of User Affect.” User Modeling and User-Adapted Interaction 19 (3): 267–303. https://doi.org/10.1007/s11257-009-9062-8.

Csikszentmihalyi, Mihaly. 1990. Flow: The Psychology of Optimal Experience. New York: Harper & Row.

Darwin, Charles. 1872. The Expression of the Emotions in Man and Animals. London: John Murray. https://doi.org/10.1037/10001-000.

Dillon, John, Nigel Bosch, Malolan Chetlur, Nirandika Wanigasekara, G. Alex Ambrose, Bikram Sengupta, and Sidney K. D’Mello. 2016. “Student Emotion, Co-Occurrence, and Dropout in a MOOC Context.” In Proceedings of the 9th International Conference on Educational Data Mining, 353–57. International Educational Data Mining Society.

D’Mello, Sidney K. 2016. “On the Influence of an Iterative Affect Annotation Approach on Inter-Observer and Self-Observer Reliability.” IEEE Transactions on Affective Computing 7 (2): 136–49. https://doi.org/10.1109/TAFFC.2015.2457413.

D’Mello, Sidney K., Scotty Craig, Jeremiah Sullins, and Arthur C. Graesser. 2006. “Predicting Affective States Expressed Through an Emote-Aloud Procedure from Autotutor’s Mixed-Initiative Dialogue.” International Journal of Artificial Intelligence in Education 16 (1): 3–28.

D’Mello, Sidney K., and Arthur C. Graesser. 2012a. “Malleability of Students’ Perceptions of an Affect-Sensitive Tutor and Its Influence on Learning.” In Proceedings of the Twenty-Fifth International FLAIRS Conference, edited by G. Youngblood and P. McCarthy, 432–37. Menlo Park: AAAI Press.

———. 2012b. “AutoTutor and Affective Autotutor: Learning by Talking with Cognitively and Emotionally Intelligent Computers That Talk Back.” ACM Transactions on Interactive Intelligent Systems 2 (4): 1–39. https://doi.org/10.1145/2395123.2395128.

———. 2014. “Confusion.” In International Handbook of Emotions in Education, edited by Reinhard Pekrun and Lisa Linnenbrink-Garcia, 289–310. New York: Routledge.

D’Mello, Sidney K., and Jacqueline M. Kory. 2015. “A Review and Meta-Analysis of Multimodal Affect Detection Systems.” ACM Computing Surveys 47 (3): 1–36. https://doi.org/10.1145/2682899.

D’Mello, Sidney K., Blair Lehman, Jeremiah Sullins, Rosaire Daigle, Rebekah Combs, Kimberly Vogt, Lydia Perkins, and Arthur C. Graesser. 2010. “A Time for Emoting: When Affect-Sensitivity Is and Isn’t Effective at Promoting Deep Learning.” In Proceedings of the 10th International Conference on Intelligent Tutoring Systems, edited by Vincent Aleven, Judy Kay, and Jack Mostow, 245–54. Berlin, Heidelberg: Springer. https://doi.org/10.1007/978-3-642-13388-6_29.

D’Mello, Sidney K., and Caitlin Mills. 2014. “Emotions While Writing About Emotional and Non-Emotional Topics.” Motivation and Emotion 38 (1): 140–56. https://doi.org/10.1007/s11031-013-9358-1.

Ekman, Paul, and Wallace Friesen. 1978. The Facial Action Coding System: A Technique for the Measurement of Facial Movement. Palo Alto: Consulting Psychologists Press.

Emotient. 2014. “FACET: Facial Expression Recognition Software.”

Farrington, Camille A., Melissa Roderick, Elaine Allensworth, Jenny Nagaoka, Tasha Seneca Keyes, David W. Johnson, and Nicole O. Beechum. 2012. Teaching Adolescents to Become Learners: The Role of Noncognitive Factors in Shaping School Performance: A Critical Literature Review. Chicago: University of Chicago Consortium on Chicago School Research.

Forbes-Riley, Kate, and Diane Litman. 2011. “Benefits and Challenges of Real-Time Uncertainty Detection and Adaptation in a Spoken Dialogue Computer Tutor.” Speech Communication 53 (9-10): 1115–36. https://doi.org/10.1016/j.specom.2011.02.006.

Fredrickson, Barbara L., and Christine Branigan. 2005. “Positive Emotions Broaden the Scope of Attention and Thought-Action Repertoires.” Cognition & Emotion 19 (3): 313–32. https://doi.org/10.1080/02699930441000238.

Galla, Brian M., Benjamin D. Plummer, Rachel E. White, David Meketon, Sidney K. D’Mello, and Angela L. Duckworth. 2014. “The Academic Diligence Task (ADT): Assessing Individual Differences in Effort on Tedious but Important Schoolwork.” Contemporary Educational Psychology 39 (4): 314–25. https://doi.org/10.1016/j.cedpsych.2014.08.001.

Graesser, Arthur C., P. Chipman, B.C. Haynes, and Andrew M. Olney. 2005. “AutoTutor: An Intelligent Tutoring System with Mixed-Initiative Dialogue.” IEEE Transactions on Education 48 (4): 612–18. https://doi.org/10.1109/TE.2005.856149.

Grawemeyer, Beate, Manolis Mavrikis, Wayne Holmes, Sergio Gutiérrez-Santos, Michael Wiedmann, and Nikol Rummel. 2017. “Affective Learning: Improving Engagement and Enhancing Learning with Affect-Aware Feedback.” User Modeling and User-Adapted Interaction 27 (1): 119–58. https://doi.org/10.1007/s11257-017-9188-z.

Gross, James J. 2008. “Emotion Regulation.” In Handbook of Emotions, 3rd Ed., 497–512. New York: The Guilford Press.

Hess, Ursula. 2003. “Now You See It, Now You Don’t–the Confusing Case of Confusion as an Emotion: Commentary on Rozin and Cohen (2003).” Emotion 3 (1): 76–80. https://doi.org/10.1037/1528-3542.3.1.76.

Hutt, Stephen, Joseph F. Grafsgaard, and Sidney K. D’Mello. 2019. “Time to Scale : Generalizable Affect Detection for Tens of Thousands of Students Across an Entire School Year.” In 2019 CHI Conference on Human Factors in Computing Systems Proceedings (CHI 2019). ACM Press. https://doi.org/10.1145/3290607.3300726.

Hutt, Stephen, Kristina Krasich, Caitlin Mills, Nigel Bosch, Shelby White, James R. Brockmole, and Sidney K. D’Mello. 2019. “Automated Gaze-Based Mind Wandering Detection During Computerized Learning in Classrooms.” User Modeling and User-Adapted Interaction, 1–35. https://doi.org/10.1007/s11257-019-09228-5.

Isen, Alice M. 2008. “Some Ways in Which Positive Affect Influences Decision Making and Problem Solving.” In Handbook of Emotions, 3rd Ed., 548–73. New York, NY, US: The Guilford Press.

Izard, Carroll E. 2010. “The Many Meanings/Aspects of Emotion: Definitions, Functions, Activation, and Regulation.” Emotion Review 2 (4): 363–70. https://doi.org/10.1177/1754073910374661.

Jayaprakash, Sandeep M., Erik W. Moody, Eitel J. M. Lauría, James R. Regan, and Joshua D. Baron. 2014. “Early Alert of Academically at-Risk Students: An Open Source Analytics Initiative.” Journal of Learning Analytics 1 (1): 6–47.

Jensen, Emily, Meghan Dale, Patrick J. Donnelly, Cathlyn Stone, Sean Kelly, Amanda Godley, and Sidney K. D’Mello. 2020. “Toward Automated Feedback on Teacher Discourse to Enhance Teacher Learning.” In 2020 CHI Conference on Human Factors in Computing Systems Proceedings (CHI 2020). ACM Press. https://doi.org/10.1145/3313831.3376418.

Jensen, Emily, Stephen Hutt, and Sidney K. D’Mello. 2019. “Generalizability of Sensor-Free Affect Detection Models in a Longitudinal Dataset of Tens of Thousands of Students.” In The 12th International Conference on Educational Data Mining, edited by Michel Desmarais, Collin F. Lynch, Agathe Merceron, and Roger Nkambou, 324–29.

Kai, Shiming, Luc Paquette, Ryan S.J.d. Baker, Nigel Bosch, Sidney K. D’Mello, Jaclyn Ocumpaugh, Valerie J. Shute, and Matthew Ventura. 2015. “Comparison of Face-Based and Interaction-Based Affect Detectors in Physics Playground.” In Proceedings of the 8th International Conference on Educational Data Mining, 77–84. International Educational Data Mining Society.

Karumbaiah, Shamya, Ryan S.J.d. Baker, and Valerie J. Shute. 2018. “Predicting Quitting in Students Playing a Learning Game.” In Proceedings of the 11th International Conference on Educational Data Mining, EDM 2018. International Educational Data Mining Society.

Kory, Jacqueline, Sidney K. D’Mello, and Andrew M. Olney. 2015. “Motion Tracker: Camera-Based Monitoring of Bodily Movements Using Motion Silhouettes.” Edited by Philip Allen. PLOS ONE 10 (6). https://doi.org/10.1371/journal.pone.0130293.

Lehman, Blair, Sidney K. D’Mello, Amber Chauncey Strain, Melissa Gross, Allyson Dobbins, Patricia Wallace, Keith Millis, and Arthur C. Graesser. 2011. “Inducing and Tracking Confusion with Contradictions During Critical Thinking and Scientific Reasoning.” In, edited by Gautam Biswas, Susan Bull, Judy Kay, and Antonija Mitrovic, 171–78. Berlin: Springer Berlin Heidelberg.

Lewis, Marc D. 2005. “Bridging Emotion Theory and Neurobiology Through Dynamic Systems Modeling.” Behavioral and Brain Sciences 28 (2): 169–94. https://doi.org/10.1017/S0140525X0500004X.

McClendon, Christie, Robin Massey Neugebauer, and Amanda King. 2017. “Grit, Growth Mindset, and Deliberate Practice in Online Learning.” Journal of Instructional Research 6 (1): 8–17. https://doi.org/10.9743/jir.2017.2.

McKeown, Gary J., and Ian Sneddon. 2014. “Modeling Continuous Self-Report Measures of Perceived Emotion Using Generalized Additive Mixed Models.” Psychological Methods 19 (1): 155–74. https://doi.org/10.1037/a0034282.

Mesquita, Batja, and Michael Boiger. 2014. “Emotions in Context: A Sociodynamic Model of Emotions.” Emotion Review 6 (4): 298–302. https://doi.org/10.1177/1754073914534480.

Moors, Agnes. 2014. “Flavors of Appraisal Theories of Emotion.” Emotion Review 6 (4): 303–7. https://doi.org/10.1177/1754073914534477.

Nystrand, Martin, Adam Gamoran, Robert Kachur, and Catherine Prendergast. 1997. Opening Dialogue: Understanding the Dynamics of Language and Learning in the English Classroom. New York: Teachers College Press.

Ocumpaugh, Jaclyn, Ryan S.J.d. Baker, and Ma. Mercedes T. Rodrigo. 2012. “Baker-Rodrigo Observation Method Protocol (BROMP) 1.0. Training Manual Version 1.0.” New York, NY.

OECD. 2015. “PISA 2015 Collaborative Problem Solving Framework.”

Ohman, A, and J. J. Soares. 1994. “"Unconscious Anxiety": Phobic Responses to Masked Stimuli.” Journal of Abnormal Psychology 103 (2): 231–40. https://doi.org/10.1037//0021-843x.103.2.231.

Pardos, Zach A., Ryan S.J.d. Baker, Maria San Pedro, Sujith M. Gowda, and Supreeth M. Gowda. 2014. “Affective States and State Tests: Investigating How Affect and Engagement During the School Year Predict End-of-Year Learning Outcomes.” Journal of Learning Analytics 1 (1): 107–28. https://doi.org/10.18608/jla.2014.11.6.

Parkinson, Brian, Agneta H Fischer, and Antony S R Manstead. 2005. Emotion in Social Relations: Cultural, Group, and Interpersonal Processes. Parkinson, Brian: Oxford University, Experimental Psychology, Oxford, United Kingdom: Psychology Press.

Pekrun, Reinhard, and Elizabeth J. Stephens. 2012. “Academic Emotions.” In APA Educational Psychology Handbook, Vol 2: Individual Differences and Cultural and Contextual Factors., 3–31. Washington: American Psychological Association. https://doi.org/10.1037/13274-001.

Price, Megan J, Nicholas V Mudrick, Michelle Taub, and Roger Azevedo. 2018. “The Role of Negative Emotions and Emotion Regulation on Self-Regulated Learning with MetaTutor.” In Proceedings of the International Conference on Intelligent Tutoring Systems, edited by Roger Nkambou, Roger Azevedo, and Julita Vassileva, 170–79. Cham: Springer International Publishing.

Ramakrishnan, Anand, Erin Ottmar, Jennifer LoCasale-Crouch, and Jacob Whitehill. 2019. “Toward Automated Classroom Observation : Predicting Positive and Negative Climate.” In IEEE Conference on Automatic Face and Gesture Recognition.

Razzaq, Leena, Mingyu Feng, Goss Nuzzo-Jones, Neil T. Heffernan, Kenneth Koedinger, Brian Junker, Steven Ritter, et al. 2005. “The Assistment Project: Blending Assessment and Assisting.” In Proceedings of the 12th International Conference on Artificial Intelligence in Education, edited by C. Loi and G. McCalla, 555–62. Amsterdam: IOS Press.

Ringeval, Fabien, Andreas Sonderegger, Juergen Sauer, and Denis Lalanne. 2013. “Introducing the RECOLA Multimodal Corpus of Remote Collaborative and Affective Interactions.” In 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG), 1–8. IEEE. https://doi.org/10.1109/FG.2013.6553805.

Rosenberg, Erika L. 1998. “Levels of Analysis and the Organization of Affect.” Review of General Psychology 2 (3): 247–70. https://doi.org/10.1037/1089-2680.2.3.247.

Rozin, Paul, and Adam B. Cohen. 2003. “High Frequency of Facial Expressions Corresponding to Confusion, Concentration, and Worry in an Analysis of Naturally Occurring Facial Expressions of Americans.” Emotion (Washington, D.C.) 3 (1): 68–75. https://doi.org/10.1037/1528-3542.3.1.68.

Sabourin, Jennifer, Bradford Mott, and James C Lester. 2011. “Modeling Learner Affect with Theoretically Grounded Dynamic Bayesian Networks.” In Proceedings of the 4th International Conference on Affective Computing and Intelligent Interaction, edited by Sidney K. D’Mello, Arthur C. Graesser, Björn Schuller, and Jean-Claude Martin, 286–95. Berlin, Heidelberg: Springer Berlin Heidelberg.

San Pedro, Maria Ofelia Clarissa Z., Ryan S.J.d. Baker, Alex J. Bowers, and Neil T. Heffernan. 2013. “Predicting College Enrollment from Student Interaction with an Intelligent Tutoring System in Middle School.” In Proceedings of the 6th International Conference on Educational Data Mining, edited by Sidney K. D’Mello, Rafael A. Calvo, and Andrew M. Olney, 177–84. International Educational Data Mining Society.

Schwarz, Norbert. 2012. “Feelings-as-Information Theory.” In Handbook of Theories of Social Psychology, Vol. 1, 289–308. Thousand Oaks, CA: Sage Publications Ltd. https://doi.org/10.4135/9781446249215.n15.

Shute, Valerie J., Matthew Ventura, and Yoon Jeon Kim. 2013. “Assessment and Learning of Qualitative Physics in Newton’s Playground.” The Journal of Educational Research 106 (6): 423–30. https://doi.org/10.1080/00220671.2013.832970.

Strain, Amber Chauncey, and Sidney K. D’Mello. 2015. “Affect Regulation During Learning: The Enhancing Effect of Cognitive Reappraisal.” Applied Cognitive Psychology 29 (1): 1–19. https://doi.org/10.1002/acp.3049.

Tracy, Jessica L. 2014. “An Evolutionary Approach to Understanding Distinct Emotions.” Emotion Review 6 (4): 308–12. https://doi.org/10.1177/1754073914534478.

Tze, Virginia M. C., Lia M. Daniels, Erin Buhr, and Lily Le. 2017. “Affective Profiles in a Massive Open Online Course and Their Relationship with Engagement.” Frontiers in Education 2 (December). https://doi.org/10.3389/feduc.2017.00065.

Wang, Zuowei, Kevin F. Miller, and Kai S. Cortina. 2013. “Using the LENA in Teacher Training: Promoting Student Involvement Through Automated Feedback.” Unterrichtswissenshaft 4: 290–305.

Wen, Miaomiao, Diyi Yang, and Carolyn P. Rosé. 2014. “Sentiment Analysis in MOOC Discussion Forums: What Does It Tell Us?” In Proceedings of the 7th International Conference on Educational Data Mining, 130–37. London: International Educational Data Mining Society.

Woolf, Beverly, Winslow Burleson, Ivon Arroyo, Toby Dragon, David Cooper, and Rosalind Picard. 2009. “Affect-Aware Tutors: Recognising and Responding to Student Affect.” International Journal of Learning Technology 4 (3/4): 129–29. https://doi.org/10.1504/IJLT.2009.028804.

Xing, Wanli, Hengtao Tang, and Bo Pei. 2019. “Beyond Positive and Negative Emotions: Looking into the Role of Achievement Emotions in Discussion Forums of MOOCs.” The Internet and Higher Education 43 (October). https://doi.org/10.1016/j.iheduc.2019.100690.

Zeng, Zhihong, M. Pantic, G.I. Roisman, and T.S. Huang. 2009. “A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions.” IEEE Transactions on Pattern Analysis and Machine Intelligence 31 (1): 39–58. https://doi.org/10.1109/TPAMI.2008.52.