Handbook of Learning Analytics
Chapter 1
Handbook of Learning Analytics
First Edition
Theory and Learning Analytics
Simon Knight & Simon Buckingham Shum
Abstract
The challenge of understanding how theory and analytics relate is to move “from clicks to constructs” in a principled way. Learning analytics are a specific incarnation of the bigger shift to an algorithmically pervaded society, and their wider impact on education needs careful consideration. In this chapter, we argue that by design — or else by accident — the use of a learning analytics tool is always aligned with assessment regimes, which are in turn grounded in epistemological assumptions and pedagogical practices. Fundamentally then, we argue that deploying a given learning analytics tool expresses a commitment to a particular educational worldview, designed to nurture particular kinds of learners. We outline some key provocations in the development of learning analytic techniques, key questions to draw out the purpose and assumptions built into learning analytics. We suggest that using “claims analysis” — analysis of the implicit or explicit stances taken in the design and deploying of technologies — is a productive human-centred method to address these key questions, and we offer some examples of the method applied to those provocations.
Export Citation: Plain Text (APA) BIBTeX RIS
No Supplementary Material Available
Arastoopour, G., Buckingham Shum, S., Collier, W., Kirschner, P., Knight, S. K., Shaffer, D. W., & Wise, A. F. (2014). Analytics for learning and becoming in practice. In J. L. Polman et al. (Eds.), Learning and Becoming in Practice: Proceedings of the International Conference of the Learning Sciences (ICLS ’14), 23–27 June 2014, Boulder, CO, USA (Vol. 3, pp. 1680–1683). Boulder, CO: International Society of the Learning Sciences
boyd, danah, & Crawford, K. (2011, September). Six provocations for big data. Presented at A Decade in Internet Time: Symposium on the Dynamics of the Internet and Society. http://ssrn.com/abstract=1926431
Buckingham Shum, S. (2012). Learning analytics policy brief. UNESCO. http://iite.unesco.org/pics/publications/en/files/3214711.pdf
Davis, A. (1999). The limits of educational assessment. Wiley.
Davis, A., & Williams, K. (2002). Epistemology and curriculum. In N. Blake, P. Smeyers, & R. Smith (Eds.), Blackwell guide to the philosophy of education. Blackwell Reference Online.
Deakin Crick, R. (2017). Learning analytics: Layers, loops, and processes in a virtual learning infrastructure. In C. Lang, G. Siemens, A. Wise, & D. Gašević (Eds.), Handbook on Learning Analytics (this volume).
Hey, T., Tansley, S., & Tolle, K. (Eds.). (2009). The fourth paradigm: Data-intensive scientific discovery. Redmond, WA: Microsoft Research. http://research.microsoft.com/en-us/collaboration/fourthparadigm/
Knight, S., Buckingham Shum, S., & Littleton, K. (2013). Collaborative sensemaking in learning analytics. CSCW and Education Workshop (2013): Viewing education as a site of work practice, co-located with the 16th ACM Conference on Computer Support Cooperative Work and Social Computing (CSCW 2013), 23 February 2013, San Antonio, Texas, USA. http://oro.open.ac.uk/36582/
Knight, S., Buckingham Shum, S., & Littleton, K. (2014). Epistemology, assessment, pedagogy: Where learning meets analytics in the middle space. Journal of Learning Analytics, 1(2). http://epress.lib.uts.edu.au/journals/index.php/JLA/article/view/3538
Macfadyen, L. P., Dawson, S., Pardo, A., & Gašević, D. (2014). Embracing big data in complex educational systems: The learning analytics imperative and the policy challenge. Research & Practice in Assessment, 9, 17–28.
Mayer-Schönberger, V., & Cukier, K. (2013). Big data: A revolution that will transform how we live work and think. London: John Murray Publisher.
Olson, D. R., & Bruner, J. S. (1996). Folk psychology and folk pedagogy. In D. R. Olson & N. Torrance (Eds.), The Handbook of Education and Human Development (pp. 9–27). Hoboken, NJ: Wiley-Blackwell.
Pardo, A., & Siemens, G. (2014). Ethical and privacy principles for learning analytics. British Journal of Educational Technology, 45(3), 438–450. http://doi.org/10.1111/bjet.12152
Pietsch, W. (2014). Aspects of theory-ladenness in data-intensive science. Paper presented at the 24th Biennial Meeting of the Philosophy of Science Association (PSA 2014), 6–9 November 2014, Chicago, IL. http://philsci-archive.pitt.edu/10777/
Prinsloo, P., & Slade, S. (2015). Student privacy self-management: Implications for learning analytics. Proceedings of the 5th International Conference on Learning Analytics and Knowledge (LAK ʼ15), 16–20 March, Poughkeepsie, NY, USA (pp. 83–92). New York: ACM.
Rittel, H. (1984). Second generation design methods. In N. Cross (Ed.), Developments in design methodology (pp. 317–327). Chichester, UK: John Wiley & Sons.
Shaffer, D. W. (2011, December). Epistemic network assessment. Presentation at the National Academy of Education Summit, Washington, DC.
Wells, G., & Claxton, G. (2002). Learning for life in the 21st century: Sociocultural perspectives on the future of education. Hoboken, NJ: Wiley-Blackwell.
Wise, A. F. (2014). Data archeology: A theory informed approach to analyzing data traces of social interaction in large scale learning environments. Proceedings of the Workshop on Modeling Large Scale Social Interaction in Massively Open Online Courses at the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP 2014), 25 October 2014, Doha, Qatar (pp. 1–2). Association for Computational Linguistics. https://www.aclweb.org/anthology/W/W14/W14-4100.pdf
Wise, A. F., & Shaffer, D. W. (2015). Why theory matters more than ever in the age of big data. Journal of Learning Analytics, 2(2), 5–13.
Young, M., & Muller, J. (2015). Curriculum and the specialization of knowledge: Studies in the sociology of education. London: Routledge.
Title
Theory and Learning Analytics
Book Title
Handbook of Learning Analytics
Pages
pp. 17-22
Copyright
2017
DOI
10.18608/hla17.001
ISBN
978-0-9952408-0-3
Publisher
Society for Learning Analytics Research
Authors
Simon Knight
Simon Buckingham Shum
Author Affiliations
Connected Intelligence Centre, University of Technology Sydney, Australia
Editors
Charles Lang1
George Siemens2
Alyssa Wise3
Dragan Gašević4
Editor Affiliations
1. Teachers College, Columbia University, USA
2. LINK Research Lab, University of Texas at Arlington, USA
3. Learning Analytics Research Network, New York University, USA
4. Schools of Education and Informatics, University of Edinburgh, UK