Evaluation Framework EFI for Measuring the Impact of Learning, Education and Training

This article introduces the Evaluation Framework EFI for the Impact Measurement of learning, education and training: The Evaluation Framework for Impact Measurement was developed for specifying the evaluation phase and its objectives and tasks within the IDEAL Reference Model for the introduction and optimization of quality development within learning, education and training. First, a description of the Evaluation Framework for Impact Measurement will be provided, followed by a brief overview of the IDEAL Reference Model. Finally, an example for the implementation of the Evaluation Framework for Impact Measurement within the ARISTOTELE project is presented.

A First Step Towards Video Enhanced Rubrics for the Formative Assessment of Complex Skills : A literature review and a plea

Paper presentation at the TEA2016 conference, Tallinn, Estonia.

Ultrasound in undergraduate medical education: A systematic and critical review

Introduction: Point-of-care ultrasound (POCUS) use in clinical care is growing rapidly, and advocates have recently proposed the integration of ultrasound into undergraduate medical education (UME). The evidentiary basis for this integration has not been evaluated critically or systematically. In this study, we conducted a critical and systematic review framed by the rationales enumerated by advocates of ultrasound in UME in academic publications.

Methods: This research was conducted in two phases. First, the dominant discursive rationales for the integration of ultrasound in UME were identified using techniques from Foucauldian critical discourse analysis (CDA) from an archive of 403 academic publications. We then sought empirical evidence in support of theses rationales, using a critical synthesis methodology also adapted from CDA.

Results: We identified four dominant discursive rationales, with different levels of evidentiary support. Ultrasound was not demonstrated to improve students’ understanding of anatomy. The benefit of ultrasound in teaching physical examination was inconsistent,and rests on minimal evidence. With POCUS, students’ diagnostic accuracy was improved for certain pathologies, but findings were inconsistent for others. Finally, the rationale that ultrasound training in UME will improve quality of patient care was difficult to evaluate.

Discussion: Our analysis has shown that the frequently repeated rationales for the integration of ultrasound in UME are not supported by a sufficient base of empirical research. The repetition of these dominant discursive rationales in academic publications legitimizes them and may preclude further primary research. Since the value of clinical ultrasound use by medical students remains unproven, educators must consider whether the associated financial and temporal costs are justified or whether more research is required.

Opening discourses of citizenship education : a theorization with Foucault

We argue two major difficulties in current discourses of citizenship education. The first is a relative masking of student discourses of citizenship by positioning students as lacking citizenship and as outside the community that acts. The second is in failing to understand the discursive and material support for citizenship activity. We, thus, argue that it is not a lack of citizenship that education research might address, but identification and exploration of the different forms of citizenship that students already engage in. We offer a fragmentary, poststructuralist theorization oriented to explore the contemporary limits of the necessary', drawing on specific resources from the work of Michel Foucault and others for the constitution of local, partial accounts of citizenship discourses and activities, and exploration of their possibilities and constraints. We argue this as a significant tactic of theorization in support of an opening of discourses of citizenship and in avoiding the discursive difficulties that we have identified. Our theorization, then, is significant in its potential to unsettle discourses that confine contemporary thought regarding citizenship education and support exploration of what might be excessive to that confinement.

Exploring critical literacy in Swedish education : Introductory notes

This article is an introductory note to The thematic section in this issue of Education Inquiry has its background in the need for research interpreting literacy from a critical perspective. Teaching literacy is not solely about technical reading skills but is also about understanding and the making of meaning. From that point of view, teaching must also consider the use of language, the context within which language is used, and issues of power. The thematic section includes five articles about critical literacy in Swedish education. The contributions were developed after a workshop conducted by Professor Hilary Janks, University of the Witwatersrand, Johannesburg. She introduces the framework of a critical literacy theory in the first article of the issue. Further, the contributions of Swedish scholars are united in their interest in applying a mode of critical literacy designed by Janks to different practices, sites and speech-events, for example policy documents, home reading, teaching and learning practices. The articles offer a wide perspective of critical literacy in education and further understanding of the complex processes in teaching.

Parents’ Preparedness for Their Infants’ Discharge Following First-stage Cardiac Surgery: Development of a Parental Early Warning Tool

Aim The aim of this study was to explore parental preparedness for discharge and their experiences of going home with their infant after the first-stage surgery for a functionally univentricular heart. Background Technological advances worldwide have improved outcomes for infants with a functionally univentricular heart over the last 3 decades; however, concern remains regarding mortality in the period between the first and second stages of surgery. The implementation of home monitoring programmes for this group of infants has improved this initial inter-stage survival; however, little is known about parents’ experiences of going home, their preparedness for discharge, and parents’ recognition of deterioration in their fragile infant. Method This study was conducted in 2011–2013; eight sets of parents were consulted in the research planning stage in September, 2011, and 22 parents with children aged 0–2 years responded to an online survey during November, 2012–March, 2013. Description of categorical data and deductive thematic analysis of the open-ended questions were undertaken. Results Not all parents were taught signs of deterioration or given written information specific to their baby. The following three themes emerged from the qualitative data: mixed emotions about going home, knowledge and preparedness, and support systems. Conclusions Parents are not adequately prepared for discharge and are not well equipped to recognise deterioration in their child. There is a role for greater parental education through development of an early warning tool to address the gap in parents’ understanding of signs of deterioration, enabling appropriate contact and earlier management by clinicians.

Meeting the challenges of globalisation in legal education

The focus of this paper is a critical review of the impact of globalisation on international higher education at my own institution, the University of East London (UEL), where I am Programme Leader for LLB (Hons) Law, an undergraduate qualifying law degree. Globalisation, along with internationalisation, has been one of the forces that have most changed the educational landscape in this country over the last two decades. Although closely related to each other, globalisation and internationalisation are usually regarded as distinct forces – the former being defined as the economic, political, and societal forces pushing twenty-first-century higher education towards greater international involvement, while the latter describes the policies and practices of higher education developed to deal with this. Whilst these phenomena have wide implications for higher education as a whole, they present opportunities and challenges that are very specific both to an institution like UEL, which has a high proportion of students from international backgrounds, and to my own discipline, law, which has an increasingly global profile in terms of both legal education and professional practice.

All the Lab's a Stage: the Use of Drama to Promote Engagement in Higher Education Science

Communicating science can be challenging at any educational level. We used informal and experiential learning to engage groups of potential University applicants in one project that involved staging a play in one of the teaching laboratories at the University of Worcester whilst a second project designed a play in house and took this to schools. In the first project the plot centred on stem cell research. School pupils and students from FE Colleges were offered complementary sessions including a lecture exploring the science behind stem cell research, a discussion on ethical aspects involved and a practical using university facilities. We ascertained attitudes to Higher Education in the students participating before and after the event. We found an enhanced view of the science and a highly significant change in attitude to attending University for students taking vocational subjects at FE level. The second project was aimed at exploring attitudes to ethics and animal welfare among a cohort of 15 – 18 year olds. Students engaged with the issues in the drama to a high degree. Our conclusions are that drama is an excellent way to inform potential students about higher education and HE level science in particular. Additionally we demonstrated the importance of events taking place at HE institutions in order to maximise change in attitudes to HE.

Developing Innovative TEL Practice in Teacher Education

This interactive symposium will focus on the use of different technologies in developing innovative practice in teacher education at one university in England. Technology Enhanced Learning (TEL) is a field of educational policy and practice that has the power to ignite diametrically opposing views and reactions amongst teachers and teacher educators, ranging across a spectrum from immense enthusiasm to untold terror. In a field where the skills and experience of individuals vary from those of digital natives (Prensky 2001) to lags and lurkers in digital spaces, the challenges of harnessing the potential of TEL are complex. The challenges include developing the IT skills of trainees and educators and the creative application of these skills to pedagogy in all areas of the curriculum. The symposium draws on examples from primary, secondary and post-compulsory teacher education to discuss issues and approaches to developing research capacity and innovative practice using different etools, many of which are freely available. The first paper offers theoretical and policy perspectives on finding spaces in busy professional lives to engage in research and develop research-informed practice. It draws on notions of teachers as researchers, practitioner research and evidenc-ebased practice to argue that engagement in research is integral to teacher education and an empowering source of creative professional learning for teachers and teacher educators. Whilst acknowledging the challenges of this stance, examples from our own research practice illustrate how e-tools can assist us in building the capacity and confidence of staff and students in researching and enhancing teaching, learning and assessment practice. The second paper discusses IT skills development through the TEL pathway for trainee teachers in secondary education across different curriculum subjects. The lead tutor for the TEL pathway will use examples of activities developed with trainee teachers and university subject tutors to enhance their skills in using e-tools, such as QR codes, Kahoot, Padlet, Pinterest and cloud based learning. The paper will also focus on how these skills and tools can be used for action Discussant - the wider use of technologies in a university centre for teacher education; course management, recruitment and mentor training. research, evaluation and feedback and for marking and administrative tasks. The discussion will finish with thoughts on widening trainee teachers’ horizons into the future direction of educational technology. The third paper considers institutional policies and strategies for promoting and embedding TEL, including an initiative called ‘The Learning Conversation’, which aims ‘to share, highlight, celebrate, discuss, problematise, find things out...’ about TEL through an online space. The lead for ‘The Learning Conversation’ will offer reflections on this and other initiatives across the institution involving trainee teachers, university subject tutors, librarians and staff in student support services who are using TEL to engage, enthuse and support students on campus and during placements in schools. The fourth paper reflects on the use of TEL to engage with trainee teachers in post-compulsory education. This sector of education and training is more fragmented than primary and secondary schools sectors and so the challenges of building a community of practice that can support the development of innovative practice are greater.

Investigating Social Mobility: Cultural Frames and Cultural Frame Switching in First-Generation College Students

Thesis (Ph.D.)--University of Washington, 2016-08

Higher Education - Border or Boundary? Can Theatre in Education Help Promote a University Education?

With the expansion and increased availability of Higher Education the progression to study for an undergraduate degree has been viewed as a simple stepping stone with examination success a straight - forward border pass. Changes in the funding of degree courses has established a series of more challenging boundaries to entry which demand a rigorous assessment of the benefits of Higher Education. The Widening Participation Unit at The University of Worcester has sought to ease this border crossing for pupils whose parents have not been to university. Their experience from previous projects was that school pupils more easily relate to undergraduate students whose experience of Higher Education is recent and relevant. With this in mind they commissioned the Drama and Performance Department to create a Theatre in Education programme that introduced an awareness of post sixteen options and future choices to challenge Higher Education stereotypes. As a result of this collaboration Why Bother? was created, directed by myself and devised and researched with four students who were studying drama. Their own experiences were used to inform the character development and dealt with worrying as a mature student about integration into full – time education, loss of income after working, the pressures of emotional commitments to partners and being away from home. The programme toured to two thousand year 9 – 11 pupils in Worcestershire and Herefordshire schools in January and May 2011. Devising and touring Why Bother provided students with an opportunity to work as a professional paid TIE team that it is not possible for them to do as part of their undergraduate degree course. My initial research looks at the effectiveness and limitations of this project based on pupil questionnaires and the experiences of the team which are explored within the broader context of TIE and its potential for affecting attitudinal change. This has given rise to a number of questions that need consideration in the development of a new TIE programme aimed at raising the awareness of sixth form students who are about to make the decision whether to apply to university or not. Collaboration with university students in exploring the value of an education that they have subscribed to raises issues of bias and whether their powers of persuasion actually prevent pupils from making their own individual decision. The ethics of promoting a “free” university education seem much less complex than the decision required now which involves balancing the real value against the high financial cost suggested in the working title of Is it Worth it? This paper will present my first attempts to develop research methods and methodologies that will enable me to evaluate the success of this and future TIE.

Setting the agenda for dental education in Scotland: a priority setting exercise including multiple stakehiolders

Introduction The Scottish Oral Health Research Collaboration identified dental education research (DER) as a key strand of their strategy,(1) leading to the formation of the Dental Education Research Group. The starting point for this group was to understand various stakeholders’ perceptions of research priorities, yet no existing studies were found. The aim of the current study was to identify DER priorities for Scotland in the next 3-5 years. Methods The study utilised a similar methodology to that of Dennis et al,(2) in medical education. Data were collected sequentially using two online questionnaires with multiple dental stakeholders represented at undergraduate and postgraduate levels across urban and rural Scotland. 85 participants completed questionnaire 1 (qualitative) and 649 participants completed questionnaire 2 (quantitative). Qualitative and quantitative data analysis approaches were used. Results Of the 24 priorities identified, the top priorities were: role of assessments in identifying competence; undergraduate curriculum prepares for practice; and promoting teamwork within the dental team. Following factor analysis, the priorities loaded on four factors: teamwork and professionalism, measuring and enhancing performance, personal and professional development challenges, and curriculum integration and innovation. The top barriers were lack of time, funding, staff motivation, valuing of DER, and resources/ infrastructure. Discussion There were many similarities between the identified priorities for dental and medical education research2, but also some notable differences, which will be discussed. Overwhelmingly, the identified priorities in dentistry related to fitness for practice and robust assessment practices. Take home message Priority setting exercises with multiple stakeholders are an important first step in developing a national research strategy. References 1. Bagg J, Macpherson L, Mossey P, Rennie J, Saunders B, Taylor M (2010) Strategy for Oral Health Research in Scotland. Edinburgh: The Scottish Government. 2. Dennis A A, Cleland J A, Johnston P, Ker JS, Lough, M Rees CE (2014) Exploring stakeholders’ views of medical education research priorities: a national study. Medical Education, 48(11): 1078-1091.

From policy development to effectiveness and alignment: An analysis of the UK’s Higher Education Open Access policy landscape

The number of Open Access (OA) policies that have been adopted by universities, research institutes and research funders has been increasing at a fast pace. The Registry of Open Access Repository Mandates and Policies (ROARMAP) records the existence of 724 OA policies across the world, of which 512 have been adopted by universities and research institutions. The UK is one of the leading countries in terms of OA policy development and implementation with a total of 85 institutional1 and an estimated 35 funder2 OA policies. In order to understand and contextualise how OA policies are developed and how they can be effectively implemented and aligned, this brief looks at two areas. The first section provides an overview on the processes evolving around policy making, policy effectiveness and policy alignment. In particular, it summarises the criteria and elements generally specified in OA policies, it points out some of the relevant steps informing the development, monitoring and revision of OA policies, it outlines what OA policy elements contribute to policy effectiveness, and highlights the benefits in aligning OA policies. The second section revisits the issues previously discussed within the context of the UK institutional (universities) OA policy landscape.

“PROSPERING BECAUSE THAT’S ITS HISTORY”: BLACK RESILIENCE AND HONORS DEVELOPMENT IN HIGHER EDUCATION: MORGAN STATE UNIVERSITY AND THE STATE OF MARYLAND, 1867-1988

This study explores the origins and development of honors education at a Historically Black College and University (HBCU), Morgan State University, within the context of the Maryland higher education system. During the last decades, public and private institutions have invested in honors experiences for their high-ability students. These programs have become recruitment magnets while also raising institutional academic profiles, justifying additional campus resources. The history of higher education reveals simultaneous narratives such as the tension of post-desegregated Black colleges facing uncertain futures; and the progress of the rise and popularity of collegiate honors programs. Both accounts contribute to tracing seemingly parallel histories in higher education that speaks to the development of honors education at HBCUs. While the extant literature on honors development at Historically White Institutions (HWIs) of higher education has gradually emerged, our understanding of activity at HBCUs is spotty at best. One connection of these two phenomena is the development of honors programs at HBCUs. Using Morgan State University, I examine the role and purpose of honors education at a public HBCU through archival materials and oral histories. Major unexpected findings that constructed this historical narrative beyond its original scope were the impact of the 1935/6 Murray v Pearson, the first higher education desegregation case. Other emerging themes were Morgan’s decades-long efforts to resist state control of its governance, Maryland’s misuse of Morrill Act funds, and the border state’s resistance to desegregation. Also, the broader histories of Black education, racism, and Black citizenship from Dred Scott and Plessy, the 1863 Emancipation Proclamation to Brown, inform this study. As themes are threaded together, Critical Race Theory provides the framework for understanding the emerging themes. In the immediate wake of the post-desegregation era, HBCUs had to address future challenges such as purpose and mission. Competing with HWIs for high-achieving Black students was one of the unanticipated consequences of the Brown decision. Often marginalized from higher education research literature, this study will broaden the research repository of honors education by documenting HBCU contributions despite a challenging landscape.