Developing a robust self evaluation framework for active learning:the first stage of an ERASMUS+ project (QAEMarketPlace4HEI)

In ensuring the quality of learning and teaching in Higher Education, self-evaluation is an important component of the process. An example would be the approach taken within the CDIO community whereby self-evaluation against the CDIO standards is part of the quality assurance process. Eight European universities (Reykjavik University, Iceland; Turku University of Applied Sciences, Finland; Aarhus University, Denmark; Helsinki Metropolia University of Applied Sciences, Finland; Ume? University, Sweden; Telecom Bretagne, France; Aston University, United Kingdom; Queens University Belfast, United Kingdom) are engaged in an EU funded Erasmus + project that is exploring the quality assurance process associated with active learning. The development of a new self-evaluation framework that feeds into a ?Marketplace? where participating institutions can be paired up and then engage in peer evaluations and sharing around each institutions approach to and implementation of active learning. All of the partner institutions are engaged in the application of CDIO within their engineering programmes and this has provided a common starting point for the partnership to form and the project to be developed. Although the initial focus will be CDIO, the longer term aim is that the approach could be of value beyond CDIO and within other disciplines. The focus of this paper is the process by which the self-evaluation framework is being developed and the form of the draft framework. In today?s Higher Education environment, the need to comply with Quality Assurance standards is an ever present feature of programme development and review. When engaging in a project that spans several countries, the wealth of applicable standards and guidelines is significant. In working towards the development of a robust Self Evaluation Framework for this project, the project team decided to take a wide view of the available resources to ensure a full consideration of different requirements and practices. The approach to developing the framework considered: a) institutional standards and processes b) national standards and processes e.g. QAA in the UK c) documents relating to regional / global accreditation schemes e.g. ABET d) requirements / guidelines relating to particular learning and teaching frameworks e.g. CDIO. The resulting draft self-evaluation framework is to be implemented within the project team to start with to support the initial ?Marketplace? pairing process. Following this initial work, changes will be considered before a final version is made available as part of the project outputs. Particular consideration has been paid to the extent of the framework, as a key objective of the project is to ensure that the approach to quality assurance has impact but is not overly demanding in terms of time or paperwork. In other words that it is focused on action and value added to staff, students and the programmes being considered.

Development of a work-based learning MSc course which incorporates the development and demonstration of professional engineering competence standards

UK engineering standards are regulated by the Engineering Council (EC) using a set of generic threshold competence standards which all professionally registered Chartered Engineers in the UK must demonstrate, underpinned by a separate academic qualification at Masters Level. As part of an EC-led national project for the development of work-based learning (WBL) courses leading to Chartered Engineer registration, Aston University has started an MSc Professional Engineering programme, a development of a model originally designed by Kingston University, and build around a set of generic modules which map onto the competence standards. The learning pedagogy of these modules conforms to a widely recognised experiential learning model, with refinements incorporated from a number of other learning models. In particular, the use of workplace mentoring to support the development of critical reflection and to overcome barriers to learning is being incorporated into the learning space. This discussion paper explains the work that was done in collaboration with the EC and a number of Professional Engineering Institutions, to design a course structure and curricular framework that optimises the engineering learning process for engineers already working across a wide range of industries, and to address issues of engineering sustainability. It also explains the thinking behind the work that has been started to provide an international version of the course, built around a set of globalised engineering competences. © 2010 W J Glew, E F Elsworth.

Bootcamp EMMA MOOC Assessment for learning in practice

At the EDEN Conference an introduction to the EMMA platform will be combined with learning activities relevant to the topic of Formative Assessment. EDEN conference participants will have an opportunity to join the MOOC prior to the conference or at the conference. A range of learning activities will be offered during the training to ensure that all interested have sufficient opportunities to learn.

Bootcamp EMMA MOOC Assessment for learning in practice

Formative assessment or assessment for learning is a relevant theme for teachers and educationalists. Formative assessment is a valuable tool for supporting the learning process. It is applied during learning and offers you more and better opportunities to guide your students. Formative assessment allows for more individual and/or personalised guidance. In this MOOC Assessment for learning in practice we will provide you with theory and guidelines for knowledge construction on the topic of formative assessment while offering support in designing assessments that can be applied as a tool for learning and training of competences. In this MOOC you can learn what formative assessment is, learn to differentiate between summative and formative assessment, and how formative assessment can contribute to the learning of your pupils or students. Design of rubrics, the role and functions of feedback, the use of technology for formative assessment are the topics of the MOOC.

Students’ Use of Knowledge Resources in Environmental Interaction on an Outdoor Learning Trail

This study examined how students leveraged different types of knowledge resources on an outdoor learning trail. We positioned the learning trail as an integral part of the curriculum with a pre- and post-trail phase to scaffold and to support students’ meaning-making process. The study was conducted with two classes of secondary two students. We coded two groups’ discourse to examine the use of knowledge resource types in the meaning-making process in an outdoor learning setting: contextual resource, new conceptual resource, prior knowledge resource, as well as the relationship among these knowledge resource types. Next, we also examined environmental interaction and integration in the students’ use of these knowledge resource types. Analysis showed that contextual resources are chiefly instrumental in fostering students’ capacity to harness new conceptual resource and to activate prior knowledge resource in interacting with and integrating the outdoor learning environment in the meaning-making process.

Designing Massive Open Online Learning Processes: The importance of the social element

This is a pre-print for personal use only. Please refer to the Springer website for the official, published version http://www.springer.com/978-3-662-52923-2

Predicting Student Performance and Differences in Learning Styles based on Textual Complexity Indices applied on Blog and Microblog Posts

Social media tools are increasingly popular in Computer Supported Collaborative Learning and the analysis of students' contributions on these tools is an emerging research direction. Previous studies have mainly focused on examining quantitative behavior indicators on social media tools. In contrast, the approach proposed in this paper relies on the actual content analysis of each student's contributions in a learning environment. More specifically, in this study, textual complexity analysis is applied to investigate how student's writing style on social media tools can be used to predict their academic performance and their learning style. Multiple textual complexity indices are used for analyzing the blog and microblog posts of 27 students engaged in a project-based learning activity. The preliminary results of this pilot study are encouraging, with several indexes predictive of student grades and/or learning styles.

Professional development of teacher-educators towards transformative learning

This study explores the specific characteristics of teacher-educator professional development interventions that enhance their transformative learning towards stimulating the inquiry-based attitude of students. An educational design research method was followed. Firstly, in partnership with five experienced educators, a professional development programme was designed, tested and redesigned. Secondly, a qualitative multiple case study was conducted to examine the active ingredients of the designed interventions with regard to educators changes in beliefs and behaviour. The study was carried out in four different educational settings in which 20 educators participated during nine months. Data sources included videos, questionnaires, interviews and written personal theories of practice. The analyses indicated that aligned self-study interventions on a personal, peer and group level guided by a trained facilitator supported the intended leaning.

Applying standards to systematize learning analytics in serious games

Learning Analytics is an emerging field focused on analyzing learners’ interactions with educational content. One of the key open issues in learning analytics is the standardization of the data collected. This is a particularly challenging issue in serious games, which generate a diverse range of data. This paper reviews the current state of learning analytics, data standards and serious games, studying how serious games are tracking the interactions from their players and the metrics that can be distilled from them. Based on this review, we propose an interaction model that establishes a basis for applying Learning Analytics into serious games. This paper then analyzes the current standards and specifications used in the field. Finally, it presents an implementation of the model with one of the most promising specifications: Experience API (xAPI). The Experience API relies on Communities of Practice developing profiles that cover different use cases in specific domains. This paper presents the Serious Games xAPI Profile: a profile developed to align with the most common use cases in the serious games domain. The profile is applied to a case study (a demo game), which explores the technical practicalities of standardizing data acquisition in serious games. In summary, the paper presents a new interaction model to track serious games and their implementation with the xAPI specification.

Game Learning Analytics: Learning Analytics for Serious Games

Video games have become one of the largest entertainment industries, and their power to capture the attention of players worldwide soon prompted the idea of using games to improve education. However, these educational games, commonly referred to as serious games, face different challenges when brought into the classroom, ranging from pragmatic issues (e.g. a high development cost) to deeper educational issues, including a lack of understanding of how the students interact with the games and how the learning process actually occurs. This chapter explores the potential of data-driven approaches to improve the practical applicability of serious games. Existing work done by the entertainment and learning industries helps to build a conceptual model of the tasks required to analyze player interactions in serious games (gaming learning analytics or GLA). The chapter also describes the main ongoing initiatives to create reference GLA infrastructures and their connection to new emerging specifications from the educational technology field. Finally, it explores how this data-driven GLA will help in the development of a new generation of more effective educational games and new business models that will support their expansion. This results in additional ethical implications, which are discussed at the end of the chapter.

Science learning in the outdoors to support primary-secondary transition

This study provides additional insight into how outdoor learning can be used as a vehicle to address transition issues. This study analyses the benefits of outdoor learning through the use of shared learning days with young people in the primary-secondary transition phase. This paper argues that a carefully designed programme of outdoor ‘shared learning days’ with young people in both phases working together is a sound model to help address the recommendations arising from specific transition issues (Mullan, 2014; Rose, 2009) through the delivery of aligned outcomes (cognitive, affective, interpersonal/social and physical/behavioural) and impact from learning science outdoors (Rickinson et al., 2004).

A literature review to Examine the Validity and Reliability of group poster presentations as an assessment method of a module in an undergraduate nursing degree programme

The introduction of a poster presentation as a formative assessment method over a multiple choice examination after the first phase of a three phase “health and well-being” module in an undergraduate nursing degree programme was greeted with a storm of criticism from fellow lecturers stating that poster presentations are not valid or reliable and totally irrelevant to the assessment of learning in the module. This paper seeks to investigate these criticisms by investigating the literature regarding producing nurses fit for practice, nurse curriculum development and wider nurse education, the purpose of assessment, validity and reliability to critically evaluate the poster presentation as a legitimate assessment method for these aims.

Phonic skills mediate improved literacy outcomes in at-risk primary school children: results from the Ready-to-Learn Programme

Background
Learning to read is a key goal during primary school: reading difficulties may curtail children’s learning trajectories. Controversy remains regarding what types of interventions are effective for children at risk for academic failure, such as children in disadvantaged areas. We present data from a complex intervention to test the hypothesis that phonic skills and word recognition abilities are a pivotal and specific causal mechanism for the development of reading skills in children at risk for poorer literacy outcomes.
Method
Over 500 pupils across 16 primary schools took part in a Cluster Randomised Controlled Trial from school year 1 to year 3. Schools were randomly allocated to the intervention or the control arm. The intervention involved a literacy-rich after-school programme. Children attending schools in the control arm of the study received the curriculum normally provided. Children in both arms completed batteries of language, phonic skills, and reading tests every year. We used multilevel mediation models to investigate mediating processes between intervention and outcomes.
Findings
Children who took part in the intervention displayed improvements in reading skills compared to those in the control arm. Results indicated a significant indirect effect of the intervention via phonics encoding.
Discussion
The results suggest that the intervention was effective in improving reading abilities of children at risk, and this effect was mediated by improving children’s phonic skills. This has relevance for designing interventions aimed at improving literacy skills of children exposed to socio-economic disadvantage. Results also highlight the importance of methods to investigate causal pathways from intervention to outcomes.

The Impact of Student Response Systems on the Learning Experience of Undergraduate Psychology Students

Student response systems (SRS) are hand-held devices or mobile phone polling systems which collate real-time, individual responses to on-screen questions. Previous research examining their role in higher education has highlighted both advantages and disadvantages of their use. This paper explores how different SRS influence the learning experience of psychology students across different levels of their programme. Across two studies, first year students’ experience of using Turningpoint clickers and second year students’ experience of using Poll Everywhere was investigated. Evaluations of both studies revealed that SRS has a number of positive impacts on learning, including enhanced engagement, active learning, peer interaction, and formative feedback. Technical and practical issues emerged as consistent barriers to the use of SRS. Discussion of these findings and the authors’ collective experiences of these technologies are used to provide insight into the way in which SRS can be effectively integrated within undergraduate psychology programmes.

Graja - Autobewerter für Java-Programme

In diesem Bericht wird der Autobewerter Graja für Java-Programme vorgestellt. Wir geben einen Überblick über die unterstützten Bewertungsmethoden sowie die beteiligten Nutzerrollen. Wir gehen auf technische Einzelheiten und Randbedingungen der in Graja eingesetzten Bewertungsmethoden ein und zeigen die Einbindung von Graja in eine technische Gesamtarchitektur. An einem durchgehenden Beispiel stellen wir die Struktur einer Programmieraufgabe sowie die von Graja unterstützten Feedback-Möglichkeiten dar. Informationen zum bisherigen Einsatz des Graders runden den Bericht ab.