Action Research and Learning Analytics in Higher Education

Teaching is a dynamic activity. It can be very effective, if its impact is constantly monitored and adjusted to the demands of changing social contexts and needs of learners. This implies that teachers need to be aware about teaching and learning processes. Moreover, they should constantly question their didactical methods and the learning resources, which they provide to their students. They should reflect if their actions are suitable, and they should regulate their teaching, e.g., by updating learning materials based on new knowledge about learners, or by motivating learners to engage in further learning activities. In the last years, a rising interest in ‘learning analytics’ is observable. This interest is motivated by the availability of massive amounts of educational data. Also, the continuously increasing processing power, and a strong motivation for discovering new information from these pools of educational data, is pushing further developments within the learning analytics research field. Learning analytics could be a method for reflective teaching practice that enables and guides teachers to investigate and evaluate their work in future learning scenarios. However, this potentially positive impact has not yet been sufficiently verified by learning analytics research. Another method that pursues these goals is ‘action research’. Learning analytics promises to initiate action research processes because it facilitates awareness, reflection and regulation of teaching activities analogous to action research. Therefore, this thesis joins both concepts, in order to improve the design of learning analytics tools. Central research question of this thesis are: What are the dimensions of learning analytics in relation to action research, which need to be considered when designing a learning analytics tool? How does a learning analytics dashboard impact the teachers of technology-enhanced university lectures regarding ‘awareness’, ‘reflection’ and ‘action’? Does it initiate action research? Which are central requirements for a learning analytics tool, which pursues such effects? This project followed design-based research principles, in order to answer these research questions. The main contributions are: a theoretical reference model that connects action research and learning analytics, the conceptualization and implementation of a learning analytics tool, a requirements catalogue for useful and usable learning analytics design based on evaluations, a tested procedure for impact analysis, and guidelines for the introduction of learning analytics into higher education.

Education and Ideologies of the Knowledge Economy: Europe and the Politics of Emulation

The Austrian philosopher Ludwig Wittgenstein famously proposed a style of philosophy that was directed against certain pictures [bild] that tacitly direct our language and forms of life. His aim was to show the fly the way out of the fly bottle and to fight against the bewitchment of our intelligence by means of language: “A picture held us captive. And we could not get outside it, for it lay in our language and language seemed to repeat it to us inexorably” (Wittgenstein 1953, 115). In this context Wittgenstein is talking of philosophical pictures, deep metaphors that have structured our language but he does also use the term picture in other contexts (see Owen 2003, 83). I want to appeal to Wittgenstein in my use of the term ideology to refer to the way in which powerful underlying metaphors in neoclassical economics have a strong rhetorical and constitutive force at the level of public policy. Indeed, I am specifically speaking of the notion of ‘the performative’ in Wittgenstein and Austin. The notion of the knowledge economy has a prehistory in Hayek (1937; 1945) who founded the economics of knowledge in the 1930s, in Machlup (1962; 1970), who mapped the emerging employment shift to the US service economy in the early 1960s, and to sociologists Bell (1973) and Touraine (1974) who began to tease out the consequences of these changes for social structure in the post-industrial society in the early 1970s. The term has been taken up since by economists, sociologists, futurists and policy experts recently to explain the transition to the so-called ‘new economy’. It is not just a matter of noting these discursive strands in the genealogy of the ‘knowledge economy’ and related or cognate terms. We can also make a number of observations on the basis of this brief analysis. First, there has been a succession of terms like ‘postindustrial economy’, ‘information economy’, ‘knowledge economy’, ‘learning economy’, each with a set of related concepts emphasising its social, political, management or educational aspects. Often these literatures are not cross-threading and tend to focus on only one aspect of phenomena leading to classic dichotomies such as that between economy and society, knowledge and information. Second, these terms and their family concepts are discursive, historical and ideological products in the sense that they create their own meanings and often lead to constitutive effects at the level of policy. Third, while there is some empirical evidence to support claims concerning these terms, at the level of public policy these claims are empirically underdetermined and contain an integrating, visionary or futures component, which necessarily remains untested and is, perhaps, in principle untestable.

The Integration of Formal and Non-formal Education: The Dutch “brede school”

The Dutch “brede school” (BS) development originates in the 1990s and has spread unevenly since: quicker in the primary than secondary educational sector. In 2007, there were about 1000 primary and 350 secondary BS schools and it is the intention of the government as well as the individual municipalities to extend that number and make the BS the dominant school form of the near future. In the primary sector, a BS cooperates with crèche and preschool facilities, besides possible other neighborhood partners. The main targets are, first, to enhance educational opportunities, particularly for children with little (western-) cultural capital, and secondly to increase women’s labor market participation by providing extra familial care for babies and small children. All primary schools are now obliged to provide such care. In the secondary sector, a BS is less neighborhood-orientated than a primary BS because those schools are bigger and more often located in different buildings. As in the primary sector, there are broad and more narrow BS, the first profile cooperating with many non-formal and other partners and facilities and the second with few. On the whole, there is a wide variety of BS schools, with different profiles and objectives, dependent on the needs and wishes of the initiators and the neighborhood. A BS is always the result of initiatives of the respective school and its partners: parents, other neighborhood associations, municipality etc. BS schools are not enforced by the government although the general trend will be that existing school organizations transform into BS. The integration of formal and non-formal education and learning is more advanced in primary than secondary schools. In secondary education, vocational as well as general, there is a clear dominance of formal education; the non-formal curriculum serves mainly two lines and objectives: first, provide attractive leisure activities and second provide compensatory courses and support for under-achievers who are often students with migrant background. In both sectors, primary and secondary, it is the formal school organization with its professionals which determines the character of a BS; there is no full integration of formal and non-formal education resulting in one non-disruptive learning trajectory, nor is there the intention to go in that direction. Non-formal pedagogues are partly professionals, like youth- and social workers, partly volunteers, like parents, partly non-educational partners, like school-police, psycho-medical help or commercial leisure providers. Besides that, the BS is regarded by government educational and social policy as a potential partner and anchor for community development. It is too early to make reliable statements about the effects of the BS movement in the Netherlands concerning the educational opportunities for disadvantaged children and their families, especially those with migrant background, and combat further segregation. Evaluation studies made so far are moderately positive but also point to problems of overly bureaucratized structures and layers, lack of sufficient financial resources and, again, are uncertain about long-term effects.

Digital Systems for Open Access to Formal and Informal Learning

Today, Digital Systems and Services for Technology Supported Learning and Education are recognized as the key drivers to transform the way that individuals, groups and organizations “learn” and the way to “assess learning” in 21st Century. These transformations influence: Objectives - moving from acquiring new “knowledge” to developing new and relevant “competences”; Methods – moving from “classroom” based teaching to “context-aware” personalized learning; and Assessment – moving from “life-long” degrees and certifications to “on-demand” and “in-context” accreditation of qualifications. Within this context, promoting Open Access to Formal and Informal Learning, is currently a key issue in the public discourse and the global dialogue on Education, including Massive Open Online Courses (MOOCs) and Flipped School Classrooms. This volume on Digital Systems for Open Access to Formal and Informal Learning contributes to the international dialogue between researchers, technologists, practitioners and policy makers in Technology Supported Education and Learning. It addresses emerging issues related with both theory and practice, as well as, methods and technologies that can support Open Access to Formal and Informal Learning. In the twenty chapters contributed by international experts who are actively shaping the future of Educational Technology around the world, topics such as: - The evolution of University Open Courses in Transforming Learning - Supporting Open Access to Teaching and Learning of People with Disabilities - Assessing Student Learning in Online Courses - Digital Game-based Learning for School Education - Open Access to Virtual and Remote Labs for STEM Education - Teachers’ and Schools’ ICT Competence Profiling - Web-Based Education and Innovative Leadership in a K-12 International School Setting are presented. An in-depth blueprint of the promise, potential, and imminent future of the field, Digital Systems for Open Access to Formal and Informal Learning is necessary reading for researchers and practitioners, as well as, undergraduate and postgraduate students, in educational technology.