Handbook of Learning Analytics

Chapter 1

Handbook of Learning Analytics
First Edition

Theory and Learning Analytics

Simon Knight & Simon Buckingham Shum


The challenge of understanding how theory and analytics relate is to move “from clicks to constructs” in a principled way. Learning analytics are a specific incarnation of the bigger shift to an algorithmically pervaded society, and their wider impact on education needs careful consideration. In this chapter, we argue that by design — or else by accident — the use of a learning analytics tool is always aligned with assessment regimes, which are in turn grounded in epistemological assumptions and pedagogical practices. Fundamentally then, we argue that deploying a given learning analytics tool expresses a commitment to a particular educational worldview, designed to nurture particular kinds of learners. We outline some key provocations in the development of learning analytic techniques, key questions to draw out the purpose and assumptions built into learning analytics. We suggest that using “claims analysis” — analysis of the implicit or explicit stances taken in the design and deploying of technologies — is a productive human-centred method to address these key questions, and we offer some examples of the method applied to those provocations.

Export Citation: Plain Text (APA)     BIBTeX     RIS

Supplementary Material

No Supplementary Material Available

References (22)

Anderson, C. (2008, 23 June). The end of theory: The data deluge makes the scientific method obsolete. Wired Magazine. http://archive.wired.com/science/discoveries/magazine/16-07/pb_theory

Arastoopour, G., Buckingham Shum, S., Collier, W., Kirschner, P., Knight, S. K., Shaffer, D. W., & Wise, A. F. (2014). Analytics for learning and becoming in practice. In J. L. Polman et al. (Eds.), Learning and Becoming in Practice: Proceedings of the International Conference of the Learning Sciences (ICLS ’14), 23–27 June 2014, Boulder, CO, USA (Vol. 3, pp. 1680–1683). Boulder, CO: International Society of the Learning Sciences

boyd, danah, & Crawford, K. (2011, September). Six provocations for big data. Presented at A Decade in Internet Time: Symposium on the Dynamics of the Internet and Society. http://ssrn.com/abstract=1926431

Buckingham Shum, S. (2012). Learning analytics policy brief. UNESCO. http://iite.unesco.org/pics/publications/en/files/3214711.pdf

Davis, A. (1999). The limits of educational assessment. Wiley.

Davis, A., & Williams, K. (2002). Epistemology and curriculum. In N. Blake, P. Smeyers, & R. Smith (Eds.), Blackwell guide to the philosophy of education. Blackwell Reference Online.

Deakin Crick, R. (2017). Learning analytics: Layers, loops, and processes in a virtual learning infrastructure. In C. Lang, G. Siemens, A. Wise, & D. Gašević (Eds.), Handbook on Learning Analytics (this volume).

Hey, T., Tansley, S., & Tolle, K. (Eds.). (2009). The fourth paradigm: Data-intensive scientific discovery. Redmond, WA: Microsoft Research. http://research.microsoft.com/en-us/collaboration/fourthparadigm/

Knight, S., Buckingham Shum, S., & Littleton, K. (2013). Collaborative sensemaking in learning analytics. CSCW and Education Workshop (2013): Viewing education as a site of work practice, co-located with the 16th ACM Conference on Computer Support Cooperative Work and Social Computing (CSCW 2013), 23 February 2013, San Antonio, Texas, USA. http://oro.open.ac.uk/36582/

Knight, S., Buckingham Shum, S., & Littleton, K. (2014). Epistemology, assessment, pedagogy: Where learning meets analytics in the middle space. Journal of Learning Analytics, 1(2). http://epress.lib.uts.edu.au/journals/index.php/JLA/article/view/3538

Macfadyen, L. P., Dawson, S., Pardo, A., & Gašević, D. (2014). Embracing big data in complex educational systems: The learning analytics imperative and the policy challenge. Research & Practice in Assessment, 9, 17–28.

Mayer-Schönberger, V., & Cukier, K. (2013). Big data: A revolution that will transform how we live work and think. London: John Murray Publisher.

Olson, D. R., & Bruner, J. S. (1996). Folk psychology and folk pedagogy. In D. R. Olson & N. Torrance (Eds.), The Handbook of Education and Human Development (pp. 9–27). Hoboken, NJ: Wiley-Blackwell.

Pardo, A., & Siemens, G. (2014). Ethical and privacy principles for learning analytics. British Journal of Educational Technology, 45(3), 438–450. http://doi.org/10.1111/bjet.12152

Pietsch, W. (2014). Aspects of theory-ladenness in data-intensive science. Paper presented at the 24th Biennial Meeting of the Philosophy of Science Association (PSA 2014), 6–9 November 2014, Chicago, IL. http://philsci-archive.pitt.edu/10777/

Prinsloo, P., & Slade, S. (2015). Student privacy self-management: Implications for learning analytics. Proceedings of the 5th International Conference on Learning Analytics and Knowledge (LAK ʼ15), 16–20 March, Poughkeepsie, NY, USA (pp. 83–92). New York: ACM.

Rittel, H. (1984). Second generation design methods. In N. Cross (Ed.), Developments in design methodology (pp. 317–327). Chichester, UK: John Wiley & Sons.

Shaffer, D. W. (2011, December). Epistemic network assessment. Presentation at the National Academy of Education Summit, Washington, DC.

Wells, G., & Claxton, G. (2002). Learning for life in the 21st century: Sociocultural perspectives on the future of education. Hoboken, NJ: Wiley-Blackwell.

Wise, A. F. (2014). Data archeology: A theory informed approach to analyzing data traces of social interaction in large scale learning environments. Proceedings of the Workshop on Modeling Large Scale Social Interaction in Massively Open Online Courses at the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP 2014), 25 October 2014, Doha, Qatar (pp. 1–2). Association for Computational Linguistics. https://www.aclweb.org/anthology/W/W14/W14-4100.pdf

Wise, A. F., & Shaffer, D. W. (2015). Why theory matters more than ever in the age of big data. Journal of Learning Analytics, 2(2), 5–13.

Young, M., & Muller, J. (2015). Curriculum and the specialization of knowledge: Studies in the sociology of education. London: Routledge.

About this Chapter

Theory and Learning Analytics

Book Title
Handbook of Learning Analytics

pp. 17-22




Society for Learning Analytics Research

Simon Knight
Simon Buckingham Shum

Author Affiliations
Connected Intelligence Centre, University of Technology Sydney, Australia

Charles Lang1
George Siemens2
Alyssa Wise3
Dragan Gašević4

Editor Affiliations
1. Teachers College, Columbia University, USA
2. LINK Research Lab, University of Texas at Arlington, USA
3. Learning Analytics Research Network, New York University, USA
4. Schools of Education and Informatics, University of Edinburgh, UK


Register | Lost Password