Handbook of Learning Analytics
Chapter 25
Handbook of Learning Analytics
First Edition
Learning Analytics: Layers,
Loops and Processes in a Virtual Learning
Infrastructure
Ruth Crick
Abstract
This chapter explores the challenges of learning analytics within a virtual learning infrastructure to support self-directed learning and change for individuals, teams, organizational leaders, and researchers. Drawing on sixteen years of research into dispositional learning analytics, it addresses technical, political, pedagogical, and theoretical issues involved in designing learning for complex systems whose purpose is to improve or transform their outcomes. Using the concepts of 1) layers — people at different levels in the system, 2) loops — rapid feedback for self-directed change at each level, and 3) processes — key elements of learning as a journey of change that need to be attended to, it explores these issues from practical experience, and presents working examples. Habermasian forms of rationality are used to identify challenges at the human/data interface showing how the same data point can be apprehended through emancipatory, hermeneutical, and strategic ways of knowing. Applications of these ideas to education and industry are presented, linking learning journeys with customer journeys as a way of organizing a range of learning analytics that can be collated within a technical learning infrastructure designed to support organizational or community transformation.
Export Citation: Plain Text (APA) BIBTeX RIS
No Supplementary Material Available
Aberdeen, H. (2014). Learning power and teacher development. Graduate School of Education Bristol, UK.
Barr, S. (2014). An integrated approach to decision support with complex problems of management. University of Bristol, UK.
Bateson, G. (1972). Steps to an ecology of mind. San Francisco, CA: Chandler.
Bauman, Z. (2001). The individualized society. Cambridge, UK: Polity Press.
Blockley, D. (2010). The importance of being process. Civil Engineering and Environmental Systems, 27(3), 189–199.
Blockley, D., & Godfrey, P. (2000). Doing it differently: Systems for rethinking construction. London: Telford.
Broadfoot, P., Pollard, A., Osborn, M., McNess, E., & Triggs, P. (1998). Categories, standards and instrumentalism: Theorising the changing discourse of assessment policy in English primary education. https://eric.ed.gov/?id=ED421491
Brueggemann, W. (1982). The creative word: Canon as a model for biblical education. Philadelphia, PA: Fortress Press.
Bruno, M. (2015). A foresight review of resilience engineering: Designing for the expected and unexpected. London: The Lloyds Register Foundation.
Bryk, A., Gomez, L., Grunrow, A., & LeMahieu, P. (2015). Learning to improve: How America’s schools can get better at getting better. Harvard, MA: Harvard Educational Press.
Bryk, A., Gomez, L. M., & Grunow, A. (2011). Getting ideas into action: Building networked improvement communities in education. In M. T. Hallinan (Ed.), Frontiers in sociology of education (pp. 127–162). Springer Netherlands.
Bryk, A., Sebring, P., Allensworth, E., Luppescu, S., & Easton, J. (2010). Organizing schools for improvement: Lessons from Chicago. Chicago, IL: University of Chicago Press.
Buckingham Shum, S. (2008). Cohere: Towards web 2.0 argumentation. Paper presented at the 2nd International Conference on Computational Models of Argument, 28–30 May 2008, Toulouse, France.
Buckingham Shum, S. (2012). Learning analytics. Moscow: UNESCO Institute for Information Technologies.
Buckingham Shum, S., & Deakin Crick, R. (2012). Learning dispositions and transferable competencies: Pedagogy, modelling and learning analytics. Proceedings of the 2nd International Conference on Learning Analytics and Knowledge (LAK ʼ12), 29 April–2 May 2012, Vancouver, BC, Canada (pp. 92–101). New York: ACM.
Buckingham Shum, S., & De Liddo, A. (2010). Collective intelligence for OER sustainability. Paper presented at the 7th Annual Open Education Conference, 2–4 November 2010, Barcelona, Spain.
Buckingham Shum, S., & Ferguson, R. (2010). Towards a social learning space for open educational resources. Paper presented at the 7th Annual Open Education Conference, 2–4 November 2010, Barcelona, Spain.
Castells, M. (2000). The rise of the network society, vol. 1 of The information age: Economy, society and culture. Oxford, UK: Blackwell.
Checkland, P. (1999). Systems thinking, systems practice. John Wiley.
Checkland, P., & Scholes, J. (1999). Soft systems methodology in action. Chichester, UK: Wiley.
Claxton, G. (1999). Wise up: The challenge of lifelong learning. London: Bloomsbury.
Crick, T., & MacDonald, E. (2013). One customer at a time. Cranfield University.
Cui, W., & Blockley, D. I. (1990). Interval probability theory for evidential support. International Journal of Intelligent Systems, 5(2), 183–192.
Deakin Crick, R. (2007a). Enquiry based curricula and active citizenship: A democratic, archaeological pedagogy. CitizEd International Conference Active Citizenship, Sydney.
Deakin Crick, R. (2007b). Learning how to learn: The dynamic assessment of learning power. Curriculum Journal, 18(2), 135–153.
Deakin Crick, R. (2014). Learning to learn: A complex systems perspective. In R. Deakin Crick, C. Stringer, & K. Ren (Eds.), Learning to learn: International perspectives from theory and practice. London: Routledge.
Deakin Crick, R., Broadfoot, P., & Claxton, G. (2004). Developing an effective lifelong learning inventory: The ELLI project. Assessment in Education, 11(3), 248–272.
Deakin Crick, R., & Goldspink, C. (2014). Learner dispositions, self-theories and student engagement. British Journal of Educational Studies, 62(1), 19–35.
Deakin Crick, R., & Grushka, K. (2010). Signs, symbols and metaphor: Linking self with text in inquiry based learning. Curriculum Journal, 21(1), 447–464.
Deakin Crick, R., Haigney, D., Huang, S., Coburn, T., & Goldspink, C. (2013). Learning power in the workplace: The effective lifelong learning inventory and its reliability and validity and implications for learning and development. International Journal of Human Resource Management, 24, 2255–2272.
Deakin Crick, R., Huang, S., Ahmed Shafi, A., & Goldspink, C. (2015). Developing resilient agency in learning: The internal structure of learning power. British Journal of Educational Studies, 63(2), 121–160.
Deakin Crick, R., & Jelfs, H. (2011). Spirituality, learning and personalisation: Exploring the relationship between spiritual development and learning to learn in a faith-based secondary school. International Journal of Children’s Spirituality, 16(3), 197–217.
Deakin Crick, R., Jelfs, H., Huang, S., & Wang, Q. (2011). Learning futures final report. London: Paul Hamlyn Foundation.
Deakin Crick, R., Jelfs, H., Symonds, J., Ren, K., Grushka, K., Huang, S., Wang, Q., & Varnavskaja, N. (2010). Learning futures evaluation report. University of Bristol, UK.
Deakin Crick, R., & McCombs, B. (2006). The assessment of learner centred principles: An English case study. Eudcational Research and Evaluation, 12(5), 423–444.
Deakin Crick, R., McCombs, B., Broadfoot, P., Tew, M., & Hadden, A. (2004). The ecology of learning: The ELLI two project report. Bristol, UK: Lifelong Learning Foundation.
Deakin Crick, R., McCombs, B., & Haddon, A. (2007). The ecology of learning: Factors contributing to learner centred classroom cultures. Research Papers in Education, 22(3), 267–307.
Deakin Crick, R., & Yu, G. (2008). Assessing learning dispositions: Is the effective lifelong learning inventory valid and reliable as a measurement tool? Educational Research, 50(4), 387–402.
Deci, E., & Ryan, R. (1985). Intrinsic motivation and self-determination in human behaviour. New York: Plenum.
Dweck, C. S. (2000). Self-theories: Their role in motivation, personality, and development. New York: Psychology Press.
Godfrey, P., Deakin Crick, R., & Huang, S. (2014). Systems thinking, systems design and learning power in engineering education. International Journal of Engineering Education, 30(1), 112–127.
Goldspink, C., & Foster, M. (2013). A conceptual model and set of instruments for measuring student engagement in learning. Cambridge Journal of Education, 43(3), 291–311.
Goodson, I., & Deakin Crick, R. (2009). Curriculum as narration: Tales from the children of the colonised. Curriculum Journal, 20(3), 225–236.
Grushka, K. (2009). Identity and meaning: A visual performative pedagogy for socio-cultural learning. Curriculum Journal, 20(3), 237–251.
Habermas, J. (1973). Knowledge and human interests. Cambridge, UK: Cambridge University Press.
Habermas, J. (1989). The theory of communicative action: The critique of functionalist reason, vol. 2. Cambridge, UK: Polity Press.
Harlen, W. (2004). A systematic review of the evidence of reliability and validity of assessment by teachers used for summative purposes. Research Evidence in Education Library, EPPI-Centre, Social Science Research Unit, Institute of Education, London.
Harlen, W., & Deakin Crick, R. (2002). A systematic review of the impact of summative assessment and testing on pupils’ motivation for learning. Evidence for Policy and Practice Co-ordinating Centre, Department for Education and Skills, London.
Harlen, W., & Deakin Crick, R. (2003). Testing and motivation for learning. Assessment in Education, 10(2), 169–207.
Huang, S. (2014). Imposed or emergent? A critical exploration of authentic pedagogy from a complexity perspective. University of Bristol, UK.
Jacobi, J. (1980). The psychology of C. G. Jung. London: Routledge & Kegan Paul.
John-Steiner, V. (2000). Creative collaboration. Oxford, UK: Oxford University Press.
John-Steiner, V., Panofsky, C., & Smith, L. (1994). Socio-cultural approaches to language and literacy: An interactionist perspective. New York: Cambridge University Press.
Kelly, G. A. (1963). A theory of personality New York: Norton.
Laloux, F. (2015). Reinventing organisations: A guide to creating organizations inspired by the next stage of human consciousness. Nelson Parker.
Long, P., & Siemens, G. (2011). Penetrating the fog: Learning analytics and education. Educause Review, September/October, 31–40. https://net.educause.edu/ir/library/pdf/ERM1151.pdf
Morin, E. (2008). On complexity. New York: Hampton Press.
Outhwaite, W. (1994). Habermas: A critical introduction. Cambridge, UK: Polity Press.
Ren, K. (2010). “Could do better, so why not?” Empowering underachieving adolescents. University of Bristol, UK.
Ren, K., & Deakin Crick, R. (2013). Empowering underachieving adolescents: An emancipatory learning perspective on underachievement. Pedagogies: An International Journal, 8(3), 235–254.
Rutter, M. (2012). Resilience as a dynamic concept. Development and Psychopathology, 24, 335–344.
Seely Brown, J. (2015). Re-imagining libraries and learning for the 21 century. Aspen Institute Roundtable on Library Innovation, 10 August 2015, Aspen, Colorado. http://www.johnseelybrown.com/reimaginelibraries.pdf
Seely Brown, J., & Thomas, D. (2009). Learning for a world of constant change. Paper presented at the 7th Gillon Colloquium, University of Southern California.
Seely Brown, J., & Thomas, D. (2010). Learning in/for a world of constant flux: Homo sapiens, homo faber & homo ludens revisited. In L. Weber & J. J. Duderstadt (Eds.), University Research for Innovation: Glion VII Colloquium (pp. 321–336). Paris: Economica.
Selvin, A., & Buckingham Shum, S. (2014). Constructing knowledge art: An experiential perspective on crafting participatory representations. San Rafael CA: Morgan & Claypool.
Sillitto, H. (2015). Architecting systems: Concepts, principles and practice. London: College Publications Systems Series.
Simsek, D., Sandor, A., Buckingham Shum, S., Ferguson, R., De Liddo, A., & Whitelock, D. (2015). Correlations between automated rhetorical analysis and tutors’ grades on student essays. Proceedings of the 5th International Conference on Learning Analytics and Knowledge (LAK ʼ15), 16–20 March 2015, Poughkeepsie, NY, USA (pp. 355–359). New York: ACM. doi:10.1145/2723576.2723603
Snowden, D., & Boone, M. E. (2007, November). A leader’s framework for decision making. Harvard Business Review. https://hbr.org/2007/11/a-leaders-framework-for-decision-making
Thomas, D., & Seely Brown, J. (2011). A new culture of learning: Cultivating the imagination for a world of constant change. CreateSpace Independent Publishing Platform.
Wang, Q. (2013). Coaching psychology for learning: A case study of enquiry based learning and learning power development in secondary education in the UK. University of Bristol, UK.
Wertsch, J. (1985). Vygotsky and the social formation of mind. Cambridge, MA: Harvard University Press.
Willis, J. (2014). Learning to learn with indigenous Australians. In R. Deakin Crick, C. Stringher, & K. Ren (Eds.), Learning to learn: International perspectives from theory and practice (pp. 306–327). London: Routledge.
Yeager, D., Bryk, A., Muhich, J., Hausman, H., & Morales, L. (2013, December). Practical measurement. San Francisco, CA: Carnegie Foundation for the Advancement of Teaching. https://www.carnegiefoundation.org/resources/publications/practical-measurement/
Title
Learning Analytics: Layers, Loops and Processes in a Virtual Learning Infrastructure
Book Title
Handbook of Learning Analytics
Pages
pp. 291-307
Copyright
2017
DOI
10.18608/hla17.025
ISBN
978-0-9952408-0-3
Publisher
Society for Learning Analytics Research
Authors
Ruth Crick
Author Affiliations
Institute for Sustainable Futures, University of Technology Sydney, Australia
Department of Civil Engineering , University of Bristol, United Kingdom
Editors
Charles Lang1
George Siemens2
Alyssa Wise3
Dragan Gašević4
Editor Affiliations
1. Teachers College, Columbia University, USA
2. LINK Research Lab, University of Texas at Arlington, USA
3. Learning Analytics Research Network, New York University, USA
4. Schools of Education and Informatics, University of Edinburgh, UK