Handbook of Learning Analytics
Chapter 5
Natural Language Processing: Towards a Multi-Dimensional View of the Learning Process
Laura K. Allen, Sarah C. Creer, & Püren Öncel
Abstract
As educators turn to technology to supplement classroom instruction, the integration of natural language processing (NLP) into educational technologies is vital for increasing student success. NLP involves the use of computers to analyze and respond to human language, including students’ responses to a variety of assignments and tasks. While NLP is widely used to deliver students with formative feedback, it can also be used to provide educators with information about task difficulty, students’ individual differences, and student performance. In this chapter, we will first provide an overview of NLP, followed by a discussion of how NLP could be used to examine the learning process across a number of time points. Finally, we consider the future applications of NLP in the learning analytics domain.
Allen, Laura K., Matthew E. Jacovina, and Danielle S. McNamara. 2016. “Cohesive Features of Deep Text Comprehension Processes.” In. https://eric.ed.gov/?id=ED577140.
Allen, Laura K., Aaron D. Likens, and Danielle S. McNamara. 2019. “Writing Flexibility in Argumentative Essays: A Multidimensional Analysis.” Reading and Writing 32 (6): 1607–34. https://doi.org/10.1007/s11145-018-9921-y.
Allen, Laura K., and Danielle S. McNamara. 2015. “You Are Your Words: Modeling Students’ Vocabulary Knowledge with Natural Language Processing Tools.” In. International Educational Data Mining Society. https://eric.ed.gov/?id=ED560539.
Allen, Laura K., Caitlin Mills, Matthew E. Jacovina, Scott Crossley, Sidney D’Mello, and Danielle S. McNamara. 2016a. “Investigating Boredom and Engagement During Writing Using Multiple Sources of Information: The Essay, the Writer, and Keystrokes.” In Proceedings of the Sixth International Conference on Learning Analytics & Knowledge, 114–23. LAK ’16. New York, NY, USA: Association for Computing Machinery. https://doi.org/10.1145/2883851.2883939.
———. 2016b. “Investigating Boredom and Engagement During Writing Using Multiple Sources of Information: The Essay, the Writer, and Keystrokes.” In Proceedings of the Sixth International Conference on Learning Analytics & Knowledge, 114–23. LAK ’16. New York, NY, USA: Association for Computing Machinery. https://doi.org/10.1145/2883851.2883939.
Bergh, Huub van den, and Gert Rijlaarsdam. 2007. “Chapter 9: The Dynamics of Idea Generation During Writing: An Online Study.” In Writing and Cognition, 125–50. https://brill.com/view/book/edcoll/9781849508223/B9781849508223-s010.xml.
Bird, Steven, Ewan Klein, and Edward Loper. 2009. Natural Language Processing with Python: Analyzing Text with the Natural Language Toolkit. " O’Reilly Media, Inc.".
Bixler, Robert, and Sidney D’Mello. 2013. “Towards Automated Detection and Regulation of Affective States During Academic Writing.” In Artificial Intelligence in Education, edited by H. Chad Lane, Kalina Yacef, Jack Mostow, and Philip Pavlik, 904–7. Berlin, Heidelberg: Springer Berlin Heidelberg.
Crossley, Scott A., Laura K. Allen, and Danielle S. McNamara. 2014. “A Multi-Dimensional Analysis of Essay Writing.” Multi-Dimensional Analysis 25: 197–237.
Crossley, Scott A., Mihai Dascalu, Danielle S. McNamara, Ryan Baker, and Stefan Trausan-Matu. 2017. “Predicting Success in Massive Open Online Courses (MOOCs) Using Cohesion Network Analysis.” In. Philadelphia, PA: International Society of the Learning Sciences.
Crossley, Scott A., Danielle S. McNamara, Ryan Baker, Yuan Wang, Luc Paquette, Tiffany Barnes, and Yoav Bergner. 2015. “Language to Completion: Success in an Educational Data Mining Massive Open Online Class.” In. International Educational Data Mining Society. https://eric.ed.gov/?id=ED560771.
Crossley, Scott, and Danielle McNamara. 2011. “Text Coherence and Judgments of Essay Quality: Models of Quality and Coherence.” In Proceedings of the Annual Meeting of the Cognitive Science Society. Vol. 33.
Dowell, Nia, and Vitomir Kovanović. 2022. “Modeling Educational Discourse with Natural Language Processing.” In The Handbook of Learning Analytics, edited by Charles Lang, Alyssa Friend Wise, Agathe Merceron, Dragan Gašević, and George Siemens, 2nd ed. Vancouver, Canada: SOLAR. https://www.solaresearch.org/publications/hla-22/.
Ericsson, K. Anders, and Herbert A. Simon. 1984. Protocol Analysis: Verbal Reports as Data. the MIT Press.
Fiacco, James, Elena Cotos, and Carolyn Rosé. 2019. “Towards Enabling Feedback on Rhetorical Structure with Neural Sequence Models.” In Proceedings of the 9th International Conference on Learning Analytics & Knowledge - LAK19, 310–19. Tempe, AZ, USA: ACM Press. https://doi.org/10.1145/3303772.3303808.
Fromkin, V., R. Rodman, and N. Hyams. 2013. An Introduction to Language. Cengage Learning.
Gibson, Andrew, and Antonette Shibani. 2022. “NLP - Writing Analytics.” In The Handbook of Learning Analytics, edited by Charles Lang, Alyssa Friend Wise, Agathe Merceron, Dragan Gašević, and George Siemens, 2nd ed. Vancouver, Canada: SOLAR. https://www.solaresearch.org/publications/hla-22/.
Gilliam, Sara, Joseph P. Magliano, Keith K. Millis, Irwin Levinstein, and Chutima Boonthum. 2007. “Assessing the Format of the Presentation of Text in Developing a Reading Strategy Assessment Tool (R-SAT).” Behavior Research Methods 39 (2): 199–204. https://doi.org/10.3758/BF03193148.
Graesser, Arthur C., Zhiqiang Cai, Max M. Louwerse, and Frances Daniel. 2006. “Question Understanding Aid (QUAID) a Web Facility That Tests Question Comprehensibility.” Public Opinion Quarterly 70 (1): 3–22.
Graesser, Arthur C., Shulan Lu, George Tanner Jackson, Heather Hite Mitchell, Mathew Ventura, Andrew Olney, and Max M. Louwerse. 2004. “AutoTutor: A Tutor with Dialogue in Natural Language.” Behavior Research Methods, Instruments, & Computers 36 (2): 180–92. https://doi.org/10.3758/BF03195563.
Graesser, Arthur C., Danielle S. McNamara, and Jonna M. Kulikowich. 2011. “Coh-Metrix: Providing Multilevel Analyses of Text Characteristics.” Educational Researcher 40 (5): 223–34. https://doi.org/10.3102/0013189X11413260.
Graesser, Arthur C., Danielle S. McNamara, and Max M. Louwerse. 2003. “What Do Readers Need to Learn in Order to Process Coherence Relations in Narrative and Expository Text.” Rethinking Reading Comprehension, 82–98.
Graesser, Arthur C., Danielle S. McNamara, and Kurt VanLehn. 2005. “Scaffolding Deep Comprehension Strategies Through Point&Query, AutoTutor, and iSTART.” Educational Psychologist 40 (4): 225–34. https://doi.org/10.1207/s15326985ep4004_4.
Haberlandt, Karl F., and Arthur C. Graesser. 1985. “Component Processes in Text Comprehension and Some of Their Interactions.” Journal of Experimental Psychology: General 114 (3): 357–74.
Halliday, M. A. K., and Ruqaiya Hasan. 1978. Grammatical Cohesion in Spoken and Written English. Londres, Logman.
Just, Marcel A., and Patricia A. Carpenter. 1980. “A Theory of Reading: From Eye Fixations to Comprehension.” Psychological Review 87 (4): 329–54. https://doi.org/10.1037/0033-295X.87.4.329.
Kintsch, Walter. 1988. “The Role of Knowledge in Discourse Comprehension: A Construction-Integration Model.” Psychological Review 95 (2): 163–82. https://doi.org/10.1037/0033-295X.95.2.163.
Kintsch, Walter, and Teun A. van Dijk. 1978. “Toward a Model of Text Comprehension and Production.” Psychological Review 85 (5): 363–94. https://doi.org/10.1037/0033-295X.85.5.363.
Knight, Simon, Antonette Shibani, and Simon Buckingham-Shum. 2018. “Augmenting Formative Writing Assessment with Learning Analytics: A Design Abstraction Approach.” In. International Society of the Learning Sciences, Inc.[ISLS].
Kyle, Kristopher, and Scott A. Crossley. 2018. “Measuring Syntactic Complexity in L2 Writing Using Fine‐grained Clausal and Phrasal Indices.” The Modern Language Journal 102 (2): 333–49. https://doi.org/10.1111/modl.12468.
Lu, Xiaofei. 2011. “A Corpus-Based Evaluation of Syntactic Complexity Measures as Indices of College-Level ESL Writers’ Language Development.” TESOL Quarterly 45 (1): 36–62.
Magliano, Joseph P., Keith K. Millis, and Irwin Levinstein. 2011. “Assessing Comprehension During Reading with the Reading Strategy Assessment Tool (RSAT).” Metacognition and Learning 6 (2): 131–54. https://doi.org/10.1007/s11409-010-9064-2.
McDonald, Scott A., R. H. S. Carpenter, and Richard C. Shillcock. 2005. “An Anatomically Constrained, Stochastic Model of Eye Movement Control in Reading.” Psychological Review 112 (4): 814–40. https://doi.org/10.1037/0033-295X.112.4.814.
McNamara, Danielle S., Eileen Kintsch, Nancy Butler Songer, and Walter Kintsch. 1996. “Are Good Texts Always Better? Interactions of Text Coherence, Background Knowledge, and Levels of Understanding in Learning from Text.” Cognition and Instruction 14 (1): 1–43.
McNamara, Danielle S., Irwin B. Levinstein, and Chutima Boonthum. 2004. “iSTART: Interactive Strategy Training for Active Reading and Thinking.” Behavior Research Methods, Instruments, & Computers 36 (2): 222–33. https://doi.org/10.3758/BF03195567.
McNamara, Danielle S., and Joe Magliano. 2009. “Chapter 9 Toward a Comprehensive Model of Comprehension.” In Psychology of Learning and Motivation, 51:297–384. Academic Press. http://www.sciencedirect.com/science/article/pii/S0079742109510092.
Millis, Keith, and Joseph Magliano. 2012. “Assessing Comprehension Processes During Reading.” Reaching an Understanding, 35–54.
Millis, Keith, Joseph Magliano, and Stacey Todaro. 2006. “Measuring Discourse-Level Processes with Verbal Protocols and Latent Semantic Analysis.” Scientific Studies of Reading 10 (3): 225–40.
Oakhill, Jane, and N. Yuill. 1986. “Pronoun Resolution in Skilled and Less-Skilled Comprehenders: Effects of Memory Load and Inferential Complexity.” Language and Speech 29 (1): 25–37. https://doi.org/10.1177/002383098602900104.
Ortega, Lourdes. 2003. “Syntactic Complexity Measures and Their Relationship to L2 Proficiency: A Research Synthesis of College-Level L2 Writing.” Applied Linguistics 24 (4): 492–518.
Ozuru, Yasuhiro, Kyle Dempsey, and Danielle S. McNamara. 2009. “Prior Knowledge, Reading Skill, and Text Cohesion in the Comprehension of Science Texts.” Learning and Instruction 19 (3): 228–42. https://doi.org/10.1016/j.learninstruc.2008.04.003.
Pressley, Michael, and Peter Afflerbach. 1995. Verbal Protocols of Reading: The Nature of Constructively Responsive Reading. Lawrence Erlbaum Associates, Inc.
Sardinha, Tony Berber, and Marcia Veirano Pinto. 2014. Multi-Dimensional Analysis, 25 Years on: A Tribute to Douglas Biber. John Benjamins Publishing Company.
Slater, Stefan, Jaclyn Ocumpaugh, Ryan Baker, Ma Victoria Almeda, Laura Allen, and Neil Heffernan. 2017. “Using Natural Language Processing Tools to Develop Complex Models of Student Engagement.” In 2017 Seventh International Conference on Affective Computing and Intelligent Interaction (ACII), 542–47. IEEE.
Van Waes, Luuk, Mariëlle Leijten, Eva Lindgren, and Å Wengelin. 2016. “Keystroke Logging in Writing Research: Analyzing Online Writing Processes.” In Handbook of Writing Research, 410–26. The Guilford Press.
Vytasek, Jovita M., Alexandra Patzak, and Philip H. Winne. 2019. “Topic Development to Support Revision Feedback.” In Proceedings of the 9th International Conference on Learning Analytics & Knowledge - LAK19, 220–24. Tempe, AZ, USA: ACM Press. https://doi.org/10.1145/3303772.3303816.
Yang, Shunnan, and George W. McConkie. 2001. “Eye Movements During Reading: A Theory of Saccade Initiation Times.” Vision Research 41 (25): 3567–85. https://doi.org/10.1016/S0042-6989(01)00025-6.
No Supplementary Material Available
Title
Natural Language Processing: Towards a Multi-Dimensional View of the Learning Process
Book Title
Handbook of Learning Analytics
Pages
pp. 46-53
Copyright
2022
DOI
10.18608/hla22.005
ISBN
978-0-9952408-3-4
Publisher
Society for Learning Analytics Research
Authors
Laura K. Allen
Sarah C. Creer
Püren Öncel
Editors
Charles Lang
Alyssa Friend Wise
Agathe Merceron
Dragan Gašević
George Siemens