Action Research and Learning Analytics in Higher Education

Teaching is a dynamic activity. It can be very effective, if its impact is constantly monitored and adjusted to the demands of changing social contexts and needs of learners. This implies that teachers need to be aware about teaching and learning processes. Moreover, they should constantly question their didactical methods and the learning resources, which they provide to their students. They should reflect if their actions are suitable, and they should regulate their teaching, e.g., by updating learning materials based on new knowledge about learners, or by motivating learners to engage in further learning activities. In the last years, a rising interest in ‘learning analytics’ is observable. This interest is motivated by the availability of massive amounts of educational data. Also, the continuously increasing processing power, and a strong motivation for discovering new information from these pools of educational data, is pushing further developments within the learning analytics research field. Learning analytics could be a method for reflective teaching practice that enables and guides teachers to investigate and evaluate their work in future learning scenarios. However, this potentially positive impact has not yet been sufficiently verified by learning analytics research. Another method that pursues these goals is ‘action research’. Learning analytics promises to initiate action research processes because it facilitates awareness, reflection and regulation of teaching activities analogous to action research. Therefore, this thesis joins both concepts, in order to improve the design of learning analytics tools. Central research question of this thesis are: What are the dimensions of learning analytics in relation to action research, which need to be considered when designing a learning analytics tool? How does a learning analytics dashboard impact the teachers of technology-enhanced university lectures regarding ‘awareness’, ‘reflection’ and ‘action’? Does it initiate action research? Which are central requirements for a learning analytics tool, which pursues such effects? This project followed design-based research principles, in order to answer these research questions. The main contributions are: a theoretical reference model that connects action research and learning analytics, the conceptualization and implementation of a learning analytics tool, a requirements catalogue for useful and usable learning analytics design based on evaluations, a tested procedure for impact analysis, and guidelines for the introduction of learning analytics into higher education.

A Q-Methodology approach to investigating the relationship between level of reflection and typologies among prospective teachers in the physics learning assistant program at Florida International University

The purpose of this mixed methods study was to understand physics Learning Assistants' (LAs) views on reflective teaching, expertise in teaching, and LA program teaching experience and to determine if views predicted level of reflection evident in writing. Interviews were conducted in Phase One, Q methodology was used in Phase Two, and level of reflection in participants' writing was assessed using a rubric based on Hatton and Smith's (1995) "Criteria for the Recognition of Evidence for Different Types of Reflective Writing" in Phase Three. Interview analysis revealed varying perspectives on content knowledge, pedagogical knowledge, and experience in relation to expertise in teaching. Participants revealed that they engaged in reflection on their teaching, believed reflection helps teachers improve, and found peer reflection beneficial. Participants believed teaching experience in the LA program provided preparation for teaching, but that more preparation was needed to teach. Three typologies emerged in Phase Two. Type One LAs found participation in the LA program rewarding and believed expertise in teaching does not require expertise in content or pedagogy, but it develops over time from reflection. Type Two LAs valued reflection, but not writing reflections, felt the LA program teaching experience helped them decide on non-teaching careers and helped them confront gaps in their physics knowledge. Type Three LAs valued reflection, believed expertise in content and pedagogy are necessary for expert teaching, and felt LA program teaching experience increased their likelihood of becoming teachers, but did not prepare them for teaching. Writing assignments submitted in Phase Three were categorized as 19% descriptive writing, 60% descriptive reflections, and 21% dialogic reflections. No assignments were categorized as critical reflection. Using ordinal logistic regression, typologies that emerged in Phase Two were not found to be predictors for the level of reflection evident in the writing assignments. In conclusion, viewpoints of physics LAs were revealed, typologies among them were discovered, and their writing gave evidence of their ability to reflect on teaching. These findings may benefit faculty and staff in the LA program by helping them better understand the views of physics LAs and how to assess their various forms of reflection.

Tratamento didático do erro na produção escrita dos alunos do 1.º ciclo do ensino básico : um estudo de caso

Relatório de Estágio apresentado à Escola Superior de Educação do Instituto Politécnico de Castelo Branco para cumprimento dos requisitos necessários à obtenção do grau de Mestre em Educação Pré-Escolar e Ensino do 1.º Ciclo do Ensino Básico.

Building a supportive environment for teaching and learning : a reflective commentary

Universities are increasingly caught in the transition between college institutions of independant academics to become managed businesses of research and teaching and learning. This is introducing substantial issues with the work, approach and personal development needs of individual academics. It is causing even greater concerns for managers within universities. The developments in University Management have increasingly become driven towards issues of finance, quality and marketing. Organizational development in teaching and learning practices has been less commonly a point of focus. This paper outlines developments of this nature at the University of Salford. Through its combination of authors it does so at whole University, Faculty and School levels. It outlines the variety of ways in which teaching and learning developments can be supported within an organisation.

Theorising a model for teaching and assessing reflective learning in higher education

The importance of reflection in higher education, and across disciplinary fields is widely recognised; it is generally included in university graduate attributes, professional standards and program objectives. Furthermore, reflection is commonly embedded into assessment requirements in higher education subjects, often without necessary scaffolding or clear expectations for students. Despite the rhetoric around the importance of reflection for ongoing learning, there is scant literature on any systematic, developmental approach to teaching reflective learning across higher education programs/courses. Given that professional or academic reflection is not intuitive, and requires specific pedagogic intervention to do well, a program/course-wide approach is essential. This paper draws on current literature to theorise a new, transferable and customisable model for teaching and assessing reflective learning across higher education, which foregrounds and explains the pedagogic field of higher education as a multi-dimensional space. We argue that explicit and strategic pedagogic intervention, supported by dynamic resources, is necessary for successful, broad-scale approaches to reflection in higher education.

Reflections around artefacts : using a deliberative approach to teaching reflective practices in fashion

While asking students to think reflectively is a desirable teaching goal, it is often fraught with complexity and sometimes poorly implemented in higher education. Here we describe an approach to academic reflective practice that fitted well within an existing design subject in fashion education and was perceived as effective in enhancing student learning outcomes. In many design based disciplines it is essential to evaluate, through a reflective lens, the quality of tangible design outcomes - referred to as artefacts in this case. Fashion studio based practice (unlike many other theory based disciplines) requires an artefact to be viewed, in order to initiate the reflective process. This reflection is not solely limited to reflective writing - the reflection happens through sight, touch and other non traditional approaches. Fashion students were asked to reflect before, during and after the development of an artefact and through a variety of media a review of the first garment prototype, called 'Sample Review', occurred. This teaching approach has been formalised as a "pedagogic pattern" in order to abstract successful experience for re use by other university teachers in different contexts. This case study fits within the broader project outlined in Paper 1. In this presentation we explore some of the complexities associated with teaching academic reflection along with the value in representing successful practices as pedagogical patterns. The teaching practice and student outcomes associated with the case study will be described. Finally, we shall argue that the pedagogical pattern, called 'Reflection Around Artefacts', can be applied in diverse discipline areas, and especially where students are engaged and reflecting on the design of an artefact(such as an assignment that includes the making of a professionally-relevant product).

Reflections around artefacts : using a deliberative approach to teaching reflective practices in fashion studies

While requiring students to think reflectively is a desirable teaching goal, it is often fraught with complexity and is sometimes poorly implemented in higher education. In this paper, we describe an approach to academic reflective practices that fitted a design subject in fashion education and was perceived as effective in enhancing student learning outcomes. In many design-based disciplines, it is essential to evaluate, through a reflective lens, the quality of tangible design outcomes - referred to here as artefacts. Fashion studio based practice (unlike many other theory based disciplines)requires an artefact to be viewed in order to initiate the reflective process. This reflection is not solely limited to reflective writing; the reflection happens through sight, touch and other non-traditional approaches. Fashion students were asked to reflect before, during and after the development of an artefact. Through a variety of media, a review of the first garment prototype - called a Sample Review - occurred. The reflective practices of students during the Sample Review provided a valuable insight into their own learning, as well as a valid assessment indicator for the lecturer. It also mirrored industry practices for design evaluation. We believe that this deliberative approach, characterised by artefact-prompted reflection, has wide applicability across undergraduate courses in a variety of discipline areas.

Mentoring preservice teachers' reflective practices towards producing teaching outcomes

Reflective practice appears crucial for professional growth, and making connections between mentoring practices and mentees’ reflections may assist mentors to guide reflective processes. This interpretive study initially explores, through the literature (e.g., Dewey, Schön), common processes of reflective thinking and uses a mentoring feedback framework with six practices to collect and analyse video, audio and observational data around two mentor-mentee case studies. The findings showed that these mentors (experienced primary teachers) articulated expectations for teaching, modelled reflective practices to their mentees (preservice teachers), and facilitated time and opportunities for advancing teaching practices, which influenced the mentees’ reflective practices and their pedagogical development. This study showed that the mentors’ personal attributes influenced the mentoring relationship and the mentees’ abilities to critically reflect on their practices.

Teaching peer review reflective processes in accounting

A well designed peer review process in higher education subjects can lead to more confident and reflective learners who become skilled at making independent judgements of their own and others’ work; essential requirements for successful lifelong learning. The challenge for educators is to ensure their students gain these important graduate attributes within the constraints of a range of internal and external tensions currently facing higher education systems, including, respectively, the realities of large undergraduate Accounting subjects, culturally diverse and time-poor academics and students, and increased calls for public accountability of the Higher Education sector by groups such as the OECD. Innovative curriculum and assessment design and collaborative technologies have the capacity to simultaneously provide some measure of relief from these internal and external tensions and to position students as responsible partners in their own learning. This chapter reports on a two phase implementation of an online peer review process as part of the assessment in a large, under-graduate, International Accounting class. Phase One did not include explicit reflective strategies within the process, and anonymous and voluntary student views served to clearly highlight that students were ‘confused’ and ‘hesitant’ about moving away from their own ideas; often mistrusting the conflicting advice received from multiple peer reviewers. A significant number of students also felt that they did not have the skills to constructively review the work of their peers. Phase Two consequently utilised the combined power of e-Technology, peer review feedback and carefully scaffolded and supported reflective practices from Ryan and Ryan’s Teaching and Assessing Reflective Learning (TARL) model (see Chap. 2). Students found the reflective skills support workshop introduced in Phase Two to be highly useful in maximising the benefits of the peer review process, with 83 % reporting it supported them in writing peer reviews, while 90 % of the respondents reporting the workshop supported them in utilising peer and staff feedback.

Teaching Reflective Learning in Higher Education : A Systematic Approach Using Pedagogic Patterns

This book is about understanding the nature and application of reflection in higher education. It provides a theoretical model to guide the implementation of reflective learning and reflective practice across multiple disciplines and international contexts in higher education. The book presents research into the ways in which reflection is both considered and implemented in different ways across different professional disciplines, while maintaining a common purpose to transform and improve learning and/or practice. Readers will find this book innovative and new in three key ways. First, in its holistic theorisation of reflection within the pedagogic field of higher education; Secondly, in conceptualising reflection in different modes to achieve specific purposes in different disciplines; and finally, in providing conceptual guidance for embedding reflective learning and reflective practice in a systematic way across whole programmes, faculties or institutions in higher education. The book considers important contextual factors that influence the teaching of forms and methods of reflection. It provides a functional analysis of multiple modes of reflection, including written, oral, visual, auditory, and embodied forms. Empirical chapters analyse the application of these modes across disciplines and at different stages of a programme. The theoretical model accounts for students’ stage of development in the disciplinary field, along with progressive and cyclical levels of higher order thinking, and learning and professional practice that are expected within different disciplines and professional fields. The book provides: • A conceptual model for the application of reflection across disciplines in a variety of contexts. • Empirical examples of different modes and pedagogic patterns for reflection. • Guidance and support for embedding systemic pedagogical and curriculum change.

Teaching and Assessing Reflective Writing in a Large Undergraduate Core Substantive Law Unit

The focus of higher education has shifted towards building students’ skills and self-awareness for future employment, in addition to developing substantive discipline knowledge. This means that there is an increasing need for embedding approaches to teaching and learning which provide a context for skills development and opportunities for students to prepare for the transition from legal education to professional practice. This chapter reports on a large (500-600 students) core undergraduate Equity law unit in an Australian University. ePortfolio has been embedded in Equity as a means of enabling students to document their reflections on their skill development in that unit. Students are taught, practice and are assessed on their teamwork and letter writing skills in the context of writing a letter of advice to a fictional client in response to a real world problem. Following submission of the team letter, students are asked to reflect on their skill development and document their reflections in ePortfolio. A scaffolded approach to teaching reflective writing is adopted using a blended model of delivery which combines face to face lectures and online resources, including an online module, facts sheets designed to guide students through the process of reflection by following the TARL model of reflection, and exemplars of reflective writing. Although students have engaged in the process of reflective writing in Equity for some years, in semester one 2011 assessment criteria were developed and the ePortfolio reflections were summatively assessed for the first time. The model of teaching and assessing reflective practice was evaluated in a range of ways by seeking feedback from students and academic staff responsible for implementing the model and asking them to reflect on their experiences. This chapter describes why skill development and reflective writing were embedded in the undergraduate law unit Equity; identify the teaching and learning approaches which were implemented to teach reflective writing to online and internal Equity students; explain the assessment processes; analyse the empirical evidence from evaluations; document the lessons learnt and discuss planned future improvements to the teaching and assessment strategies.

Teaching mathematics : developing as a reflective secondary teacher series.

Publicación para orientar al profesor para realizar una práctica reflexiva de las matemáticas: Pensar en lo que hace y por qué lo hace, qué modelo de enseñanza está utilizando, conocimiento de lo que está intentando conseguir y por qué, cómo se aplica en situaciones específicas de enseñanza, cómo hacer un buen uso de los recursos y cómo evaluar eficazmente los avances de los alumnos para lograr una enseñanza eficaz. Tiene un acceso a un sitio Web donde se pueden encontrar: videos de ejemplos reales de profesores con experiencia, donde se muestran las habilidades que se necesitan para impartir con éxito las lecciones; enlaces a sitios que ofrecen apoyos útiles; planificaciones y recursos materiales.