Handbook of Learning Analytics
Chapter 23
Learning Analytics Policies
Maren Scheffel, Yi-Shan Tsai, Dragan Gašević, & Hendrik Drachsler
Abstract
More and more higher education institutions have been making use of learning analytics in the last few years. But despite an increased funding and more research in the learning analytics domain, there is still a lack of systematic and large-scale implementations of learning analytics. In order to improve learning analytics adoption and to establish it sustainably, higher education institutions need to align learning analytics-related activities with their goals and visions. Their making us of data requires a set of guidelines and principles, i.e. a policy, that fits their context and speaks to all involved stakeholders. Only then can the effective and responsible use of learning analytics be ensured and will higher education institutions be truly able to establish learning analytics in a sustainable way.
Alexander, Bryan, Kevin Ashford-Rowe, Noreen Barajas-Murphy, Gregory Dobbin, Jessica Knott, Mark McCormack, Jeffery Pomerantz, Ryan Seilhamer, and Nicole Weber. 2019. “EDUCAUSE Horizon Report: 2019 Higher Education Edition.” Louisville, CO. https://library.educause.edu/resources/2019/4/2019-horizon-report.
Arnold, Kimberly E., Steven Lonn, and Matthew D. Pistilli. 2014. “An Exercise in Institutional Reflection: The Learning Analytics Readiness Instrument (LARI).” In Proceedings of the Fourth International Conference on Learning Analytics and Knowledge, 163–67. LAK ’14. New York, NY, USA: Association for Computing Machinery. https://doi.org/10.1145/2567574.2567621.
Arroway, Pam, Glenda Morgan, Molly O’Keefe, and Ronald Yanosky. 2016. “Learning Analytics in Higher Education.” Louisville, CO. https://library.educause.edu/resources/2016/2/learning-analytics-in-higher-education.
Baer, Linda L., Ann Hill Duin, Donald Norris, and Robert Brodnick. 2013. “Crafting Transformative Strategies for Personalized Learning/Analytics.” In Proceedings of the Third International Conference on Learning Analytics and Knowledge, 275–77. LAK ’13. New York, NY, USA: Association for Computing Machinery. https://doi.org/10.1145/2460296.2460354.
Bakharia, Aneesha, Linda Corrin, Paula de Barba, Gregor Kennedy, Dragan Gašević, Raoul Mulder, David Williams, Shane Dawson, and Lori Lockyer. 2016. “A Conceptual Framework Linking Learning Design with Learning Analytics.” In Proceedings of the Sixth International Conference on Learning Analytics & Knowledge, 329–38. LAK ’16. New York, NY, USA: Association for Computing Machinery. https://doi.org/10.1145/2883851.2883944.
Bakker, Theo, Petra Tolen, and Tom Paffen. 2017. “Code of Practice Student Analytics. Vrije Universiteit Amsterdam (VU).” https://www.vu.nl/nl/Images/Code-of-practice-privacy-ethiek-SA2017_v1_CC_tcm289-878414.pdf.
Bichsel, Jacqueline. 2012. “Analytics in Higher Education: Benefits, Barriers, Progress, and Recommendations.” Louisville, CO. https://library.educause.edu/~/media/files/library/2012/6/ers1207.pdf.
Biedermann, Daniel, Lea Kalbfell, Jan Schneider, and Hendrik Drachsler. 2019. “Stakeholder Attitudes Towards Digitalization in Higher Education Institutions.” In DELFI 2019, edited by Niels Pinkwart and Johannes Konert, 57–66. Bonn: Gesellschaft für Informatik e.V. https://doi.org/10.18420/delfi2019_332.
Brown, Malcolm, Mark McCormack, Jamie Reeves, D. Christopher Brook, Susan Grajek, Bryan Alexander, Maha Bali, Stephanie Bulger, Shawna Dark, and Nicole Engelbert. 2020. “2020 EDUCAUSE Horizon Report, Teaching and Learning Edition.” Louisville, CO. https://library.educause.edu/-/media/files/library/2020/3/2020_horizon_report_pdf.pdf?
Colvin, Cassandra, Tim Rogers, Alexandra Wade, Shane Dawson, Dragan Gašević, S Buckingham Shum, Karen Nelson, Shirley Alexander, Lori Lockyer, and Gregor Kennedy. 2015. “Student Retention and Learning Analytics: A Snapshot of Australian Practices and a Framework for Advancement.” Canberra, ACT. https://opus.lib.uts.edu.au/bitstream/10453/117173/1/AUS_OLT_LearningAnalytics_2016.pdf.
Dawson, Shane, Srecko Joksimovic, Oleksandra Poquet, and George Siemens. 2019. “Increasing the Impact of Learning Analytics.” In Proceedings of the 9th International Conference on Learning Analytics & Knowledge, 446–55. LAK19. New York, NY, USA: Association for Computing Machinery. https://doi.org/10.1145/3303772.3303784.
Dollinger, Mollie, and Jason M. Lodge. 2018. “Co-Creation Strategies for Learning Analytics.” In Proceedings of the 8th International Conference on Learning Analytics and Knowledge, 97–101. LAK ’18. New York, NY, USA: Association for Computing Machinery. https://doi.org/10.1145/3170358.3170372.
Dragan, Gašević, Tsai Yi-Shan, Dawson Shane, and Pardo Abelardo. 2019. “How Do We Start? An Approach to Learning Analytics Adoption in Higher Education.” The International Journal of Information and Learning Technology 36 (4): 342–53. https://doi.org/10.1108/IJILT-02-2019-0024.
Engelfriet, Arnoud, Evelijn Jeunink, and Jocelyn Manderveld. 2016. “Handreiking Learning Analytics Onder de Wet Bescherming Persoonsgegevens.” https://www.surf.nl/handreiking-learning-analytics-onder-de-wet-bescherming-persoonsgegevens.
Ferguson, Rebecca, and Doug Clow. 2017. “Where Is the Evidence? A Call to Action for Learning Analytics.” In Proceedings of the Seventh International Learning Analytics & Knowledge Conference, 56–65. LAK ’17. New York, NY, USA: Association for Computing Machinery. https://doi.org/10.1145/3027385.3027396.
Ferguson, Rebecca, Leah P. Macfadyen, Doug Clow, Belinda Tynan, Shirley Alexander, and Shane Dawson. 2014. “Setting Learning Analytics in Context: Overcoming the Barriers to Large-Scale Adoption.” Journal of Learning Analytics 1 (3): 120–44. https://doi.org/10.18608/jla.2014.13.7.
Greller, Wolfgang, and Hendrik Drachsler. 2012. “Translating Learning into Numbers: A Generic Framework for Learning Analytics.” Educational Technology & Society 15 (3): 42–57.
Hansen, Jan, Christoph Rensing, Oliver Hermann, and Hendrik Drachsler. 2020. “Verhaltenskodex Für Trusted Learning Analytics: Entwurf Für Die Hessischen Hochschulen.” http://www.dipfdocs.de/volltexte/2020/18903/pdf/Hansen_Rensing_Herrmann_Drachsler_2020_Verhaltenskodex_Trusted_Learning_Analytics_A.pdf.
Herodotou, Christothea, Bart Rienties, Barry Verdin, and Avinash Boroowa. 2019. “Predictive Learning Analytics ’at Scale’: Guidelines to Successful Implementation in Higher Education.” Journal of Learning Analytics 6 (1): 85–95. https://doi.org/10.18608/jla.2019.61.5.
Hilliger, Isabel, Margarita Ortiz-Rojas, Paola Pesántez-Cabrera, Eliana Scheihing, Yi-Shan Tsai, Pedro J. Muñoz-Merino, Tom Broos, Alexander Whitelock-Wainwright, and Mar Perez-Sanagustín. 2020. “Identifying Needs for Learning Analytics Adoption in Latin American Universities: A Mixed-Methods Approach.” The Internet and Higher Education 45: 100726–6. https://doi.org/10.1016/j.iheduc.2020.100726.
Howell, Joel A., Lynne D. Roberts, Kristen Seaman, and David C. Gibson. 2018. “Are We on Our Way to Becoming a ‘Helicopter University’? Academics’ Views on Learning Analytics.” Technology, Knowledge and Learning 23 (1): 1–20. https://doi.org/10.1007/s10758-017-9329-9.
JISC. 2015. “Code of Practice for Learning Analytics.” https://www.jisc.ac.uk/guides/code-of-practice-for-learning-analytics.
Long, Phillip, George Siemens, Grainne Conole, and Dragan Gašević. 2011. LAK’11: Proceedings of the 1st International Conference on Learning Analytics and Knowledge. New York, NY, USA: Association for Computing Machinery. https://doi.org/10.1145/2090116.
Macfadyen, Leah, Shane Dawson, Abelardo Pardo, and Dragan Gašević. 2014. “Embracing Big Data in Complex Educational Systems: The Learning Analytics Imperative and the Policy Challenge.” Research & Practice in Assessment 9: 17–28.
Mahroeian, Hamidreza, Ben Daniel, and Russell Butson. 2017. “The Perceptions of the Meaning and Value of Analytics in New Zealand Higher Education Institutions.” International Journal of Educational Technology in Higher Education 14 (1): 35–35. https://doi.org/10.1186/s41239-017-0073-y.
Mao, Jin, Dirk Ifenthaler, Toru Fujimoto, Andrea Garavaglia, and Pier Giuseppe Rossi. 2019. “National Policies and Educational Technology: A Synopsis of Trends and Perspectives from Five Countries.” TechTrends 63 (3): 284–93. https://doi.org/10.1007/s11528-019-00396-0.
Newland, Barbara, Lindsey Martin, and Neil Ringan. 2015. “Learning Analytics in UK HE 2015: A Helf Survey Report.”
Nouri, Jalal, Martin Ebner, Dirk Ifenthaler, Mohammed Sqr, Jonna Malmberg, Mohammad Khalil, Jesper Bruun, Olga Viberg, Miguel Ángel Conde González, and Zacharoula Papamitsiou. 2019. “Efforts in Europe for Data-Driven Improvement of Education – a Review of Learning Analytics Research in Seven Countries.” International Journal of Learning Analytics and Artificial Intelligence for Education 1 (1): 8–27. https://doi.org/10.3991/ijai.v1i1.11053.
Oster, Meghan, Steven Lonn, Matthew D. Pistilli, and Michael G. Brown. 2016. “The Learning Analytics Readiness Instrument.” In Proceedings of the Sixth International Conference on Learning Analytics & Knowledge, 173–82. LAK ’16. New York, NY, USA: Association for Computing Machinery. https://doi.org/10.1145/2883851.2883925.
Pardo, Abelardo, and George Siemens. 2014. “Ethical and Privacy Principles for Learning Analytics.” British Journal of Educational Technology 45 (3): 438–50. https://doi.org/10.1111/bjet.12152.
Pontual Falcao, Taciana, Rafael Ferreira Mello, Rodrigo Lins Rodrigues, Juliana Regueira Basto Diniz, Yi-Shan Tsai, and Dragan Gašević. 2020. “Perceptions and Expectations About Learning Analytics from a Brazilian Higher Education Institution.” In Proceedings of the Tenth International Conference on Learning Analytics & Knowledge, 240–49. LAK ’20. New York, NY, USA: Association for Computing Machinery. https://doi.org/10.1145/3375462.3375478.
Prieto, Luis P., María Jesús Rodríguez-Triana, Roberto Martínez-Maldonado, Yannis Dimitriadis, and Dragan Gašević. 2019. “Orchestrating Learning Analytics (OrLA): Supporting Inter-Stakeholder Communication About Adoption of Learning Analytics at the Classroom Level.” Australasian Journal of Educational Technology 35 (4). https://doi.org/10.14742/ajet.4314.
Prinsloo, Paul, and Sharon Slade. 2013. “An Evaluation of Policy Frameworks for Addressing Ethical Considerations in Learning Analytics.” In Proceedings of the Third International Conference on Learning Analytics and Knowledge, 240–44. LAK ’13. New York, NY, USA: Association for Computing Machinery. https://doi.org/10.1145/2460296.2460344.
Prinsloo, Paul, Sharon Slade, and Mohammad Khalil. 2018. “Stuck in the Middle? Making Sense of the Impact of Micro, Meso and Macro Institutional, Structural and Organisational Factors on Implementing Learning Analytics.” In Proceedings of the EDEN 2018 Annual Conference, 43–43. Budapest: EDEN.
Roberts, Lynne D., Joel A. Howell, Kristen Seaman, and David C. Gibson. 2016. “Student Attitudes Toward Learning Analytics in Higher Education: ‘The Fitbit Version of the Learning World’.” Frontiers in Psychology 7: 1–11. https://doi.org/10.3389/fpsyg.2016.01959.
Sanagustín, Mar Pérez, Isabel Hilliger, Jorge Maldonado, Ronald Pérez, Luís Ramírez, Pedro J. Muñoz-Merino, Yi-Shan Tsai, Margarita Ortiz, Tom Broos, and Miguel Zúñiga-Prieto. 2019. “LALA Framework.” https://www.lalaproject.org/wp-content/uploads/2019/04/LALA_framework_English.pdf.
Scheffel, Maren, Yi-Shan Tsai, Dragan Gašević, and Hendrik Drachsler. 2019. “Policy Matters: Expert Recommendations for Learning Analytics Policy.” In Transforming Learning with Meaningful Technologies, edited by Maren Scheffel, Julien Broisin, Viktoria Pammer-Schindler, Andri Ioannou, and Jan Schneider, 510–24. Cham: Springer International Publishing.
Sclater, N., A. Peasgood, and J. Mullan. 2016. “Learning Analytics in Higher Education.” Bristol, UK. https://www.jisc.ac.uk/sites/default/files/learning-analytics-in-he-v3.pdf.
Siemens, George, Shane Dawson, and Grace Lynch. 2013. “Improving the Quality and Productivity of the Higher Education Sector: Policy and Strategy for Systems-Level Deployment of Learning Analytics.” https://solaresearch.org/wp-content/uploads/2017/06/SoLAR_Report_2014.pdf.
Slade, Sharon, and Paul Prinsloo. 2013. “Learning Analytics: Ethical Issues and Dilemmas.” American Behavioral Scientist 57 (10): 1510–29. https://doi.org/10.1177/0002764213479366.
Slade, Sharon, Paul Prinsloo, and Mohammad Khalil. 2019. “Learning Analytics at the Intersections of Student Trust, Disclosure and Benefit.” In Proceedings of the 9th International Conference on Learning Analytics & Knowledge, 235–44. LAK19. New York, NY, USA: Association for Computing Machinery. https://doi.org/10.1145/3303772.3303796.
Swartz, David. 1998. Culture and Power: The Sociology of Pierre Bourdieu. New Edition. University of Chicago Press.
Tsai, Yi-Shan, and Dragan Gašević. 2017. “Learning Analytics in Higher Education — Challenges and Policies: A Review of Eight Learning Analytics Policies.” In Proceedings of the Seventh International Learning Analytics & Knowledge Conference, 233–42. LAK ’17. New York, NY, USA: Association for Computing Machinery. https://doi.org/10.1145/3027385.3027400.
Tsai, Yi-Shan, Pedro Manuel Moreno-Marcos, Ioana Jivet, Maren Scheffel, Kairit Tammets, Kaire Kollom, and Dragan Gašević. 2018. “The SHEILA Framework: Informing Institutional Strategies and Policy Processes of Learning Analytics.” Journal of Learning Analytics 5 (3): 5–20. https://doi.org/10.18608/jla.2018.53.2.
Tsai, Yi-Shan, Carlo Perrotta, and Dragan Gašević. 2020. “Empowering Learners with Personalised Learning Approaches? Agency, Equity and Transparency in the Context of Learning Analytics.” Assessment & Evaluation in Higher Education 45 (4): 554–67. https://doi.org/10.1080/02602938.2019.1676396.
Tsai, Yi-Shan, Oleksandra Poquet, Dragan Gašević, Shane Dawson, and Abelardo Pardo. 2019. “Complexity Leadership in Learning Analytics: Drivers, Challenges and Opportunities.” British Journal of Educational Technology 50 (6): 2839–54. https://doi.org/10.1111/bjet.12846.
Viberg, Olga, Mathias Hatakka, Olof Bälter, and Anna Mavroudi. 2018. “The Current Landscape of Learning Analytics in Higher Education.” Computers in Human Behavior 89: 98–110. https://doi.org/10.1016/j.chb.2018.07.027.
Waheed, Hajra, Saeed-Ul Hassan, Naif Radi Aljohani, and Muhammad Wasif. 2018. “A Bibliometric Perspective of Learning Analytics Research Landscape.” Behaviour & Information Technology 37 (10): 941–57. https://doi.org/10.1080/0144929X.2018.1467967.
West, Deborah, David Heath, and Henk Huijser. 2015. “Let’s Talk Learning Analytics: A Framework for Implementation in Relation to Student Retention.” Online Learning 20 (2). https://doi.org/10.24059/olj.v20i2.792.
Whitelock-Wainwright, Alexander, Dragan Gašević, Yi-Shan Tsai, Hendrik Drachsler, Maren Scheffel, Pedro J. Munoz-Merino, Kairit Tammets, and Carlos Delgado Kloos. 2020. “Assessing the Validity of a Learning Analytics Expectation Instrument: A Multinational Study.” Journal of Computer Assisted Learning 36 (2): 209–40. https://doi.org/10.1111/jcal.12401.
Yanosky, Ronald, and Pam Arroway. 2015. “The Analytics Landscape in Higher Education.” https://library.educause.edu/~/media/files/library/2015/5/ers1504cl.pdf.
Young, John, and Enrique Mendizabel. 2009. “Helping Researchers Become Policy Entrepreneurs-How to Develop Engagement Strategies for Evidence-Based Policy-Making.” http://www.alnap.org/resource/8431.
No Supplementary Material Available
Title
Learning Analytics Policies
Book Title
Handbook of Learning Analytics
Pages
pp. 231-239
Copyright
2022
DOI
10.18608/hla22.023
ISBN
978-0-9952408-3-4
Publisher
Society for Learning Analytics Research
Authors
Maren Scheffel
Yi-Shan Tsai
Dragan Gašević
Hendrik Drachsler
Editors
Charles Lang
Alyssa Friend Wise
Agathe Merceron
Dragan Gašević
George Siemens