Reflection and reflexivity in reviewing and evaluating CDIO:an empirical approach to evaluation

Facilitated by an Engineer and a Social Scientist, both of whom have expertise in Engineering Education Research and Evaluation (EERE), this interactive workshop is divided into three main sections, each one focusing on a different area of evaluation. It will build on research conducted at Aston University School of Engineering and Applied Science to explore and critique the value of introducing CDIO across the first year undergraduate curriculum. Participants will be invited to consider the pedagogical and engineering related challenges of evaluating the academic and practical value of CDIO as a strategy for learning and teaching in the discipline. An empirical approach to evaluation developed by the researchers to provide empirically grounded evidence of the pedagogical and vocational value of CDIO will form the theoretical and conceptual basis of the workshop. This approach is distinctive in that it encapsulates both engineering and social science methods of evaluation. It is also contemporaneous in nature, with the researchers acting as a ‘fly on the wall’ capturing data as the programme unfolds. Through facilitated discussion and participation, the workshop will provide colleagues with the opportunity to develop a cross-disciplinary, empirically grounded research proposal specifically for the purposes of critically evaluating CDIO. It is anticipated that during the workshop, colleagues will work together in small groups. Suitable pedagogical approaches and tools will be suggested and a purposefully developed Engineering Education Research Guide, written by the workshop facilitators, will be given to all participants to inform and support the Workshop approach.

Today's pupils tomorrow's engineers! Pedagogy and policy:a UK perspective

Purpose – This paper aims to provide a critical analysis of UK Government policy in respect of recent moves to attract young people into engineering. Drawing together UK and EU policy literature, the paper considers why young people fail to look at engineering positively. Design/methodology/approach – Drawing together UK policy, practitioner and academic-related literature the paper critically considers the various factors influencing young people's decision-making processes in respect of entering the engineering profession. A conceptual framework providing a diagrammatic representation of the “push” and “pull” factors impacting young people at pre-university level is given. Findings – The discussion argues that higher education in general has a responsibility to assist young people overcome negative stereotypical views in respect of engineering education. Universities are in the business of building human capability ethically and sustainably. As such they hold a duty of care towards the next generation. From an engineering education perspective, the major challenge is to present a relevant and sustainable learning experience that will equip students with the necessary skills and competencies for a lifelong career in engineering. This may be achieved by promoting transferable skills and competencies or by the introduction of a capabilities-driven curriculum which brings together generic and engineering skills and abilities. Social implications – In identifying the push/pull factors impacting young people's decisions to study engineering, this paper considers why, at a time of global recession, young people should select to study the required subjects of mathematics, science and technology necessary to study for a degree in engineering. The paper identifies the long-term social benefits of increasing the number of young people studying engineering. Originality/value – In bringing together pedagogy and policy within an engineering framework, the paper adds to current debates in engineering education providing a distinctive look at what seems to be a recurring problem – the failure to attract young people into engineering.

Reflective journals:can they be used to identify struggling students?

The ability to identify early failure in knowledge accquisition amongst students is important because it enables tutors to put in place suitable interventions to help struggling students. We hypothesised that if a reflective learning journal is a useful learning tool, there ought to be relationship between the type of journal entries and the depth of knowledge acquisition. Our research question is: can reflectiuve journals be used to identify struggling students? Previous work with reflective journals has not related the level of reflection with module outcomes obtained by the student. In our study, we have classified journal entries written by first year students in a foundationalprogramming module based on the SOLO taxonomy and compared this against the outcomes of two module assessments. Our results suggest that there is potential for using reflective journals to identify struggling stuidents in first year programming.

Sustainable purchasing practices:an investigation into current industry awareness and practice

This research study illustrates the importance of sustainable purchasing practices for organizations in the U.S. distribution industry and answers several important questions: what is the current awareness of U.S. organizations regarding sustainable purchasing practices; to what extent are U.S. organizations evaluating, selecting, and retaining suppliers based upon sustainable purchasing practices; and to what extent are sustainable purchasing practices being implemented by the U.S. organizations under study? With an ever increasing global economy, is it critically important for organizations to put in place sustainability practices; the biggest impact organizations can make is often in an organization’s purchasing department. The researcher begins by explaining the reasoning for conducting the research, and then builds the readers’ understanding of sustainability in a supply chain environment. It then moves to the subject of how sustainable purchasing can be an advantageous method for bringing about “triple bottom line” savings to an organization. This section is followed by the researcher’s methodology and ending results for a survey conducted to examine the current awareness and implementation of sustainable purchasing practices among U.S. plumbing, heating, cooling and piping (PHCP) distribution firms who participated in the study.

A quest for helpful feedback to programming coursework

The 2011 National Student Survey (NSS) revealed that 40% of full-time students in England do not think that the feedback on their work has been helpful, even though 66% of these students agreed that the feedback was detailed and 62% of them agreed that the feedback has been prompt. Detailed feedback that is not considered helpful by students means a waste of tutors' time while students continue to struggle with their learning. What do students consider as helpful feedback? What are the qualities of helpful feedback? What are the preferred forms of feedback? How should tutors write feedback so that students will find it helpful? Can ICT help to improve the quality of feedback? In our ongoing search for answers to the above questions, we have trialled the use of a novel online application (eCAF) to assess programming coursework from engineering, mathematics and computing students and, through a survey, have collected their views on the feedback received. The survey reveals that most students prefer electronic feedback as given through eCAF, with verbal feedback ranked second and hand-written feedback ranked even lower. The survey also indicates that the feedback from some tutors is considered more helpful than others. We report on the detailed findings of the survey. By comparing the kinds of feedback given by each tutor who took part in the trial, we explore ways to improve the helpfulness of feedback on programming coursework in a bid to promote learning amongst engineering students.

Collaborative design of assessment criteria to improve undergraduate student engagement and performance

Student engagement is vital in enhancing the student experience and encouraging deeper learning. Involving students in the design of assessment criteria is one way in which to increase student engagement. In 2011, a marking matrix was used at Aston University (UK) for logbook assessment (Group One) in a project-based learning module. The next cohort of students in 2012 (Group Two) were asked to collaboratively redesign the matrix and were given a questionnaire about the exercise. Group Two initially scored a lower average logbook mark than Group One. However, Group Two showed the greatest improvement between assessments, and the quality of, and commitment to, logbooks was noticeably improved. Student input resulted in a more defined, tougher mark scheme. However, this provided an improved feedback system that gave more scope for self-improvement. The majority of students found the exercise incorporated their ideas, enhanced their understanding, and was useful in itself.

Developing a robust self evaluation framework for active learning:the first stage of an ERASMUS+ project (QAEMarketPlace4HEI)

In ensuring the quality of learning and teaching in Higher Education, self-evaluation is an important component of the process. An example would be the approach taken within the CDIO community whereby self-evaluation against the CDIO standards is part of the quality assurance process. Eight European universities (Reykjavik University, Iceland; Turku University of Applied Sciences, Finland; Aarhus University, Denmark; Helsinki Metropolia University of Applied Sciences, Finland; Ume? University, Sweden; Telecom Bretagne, France; Aston University, United Kingdom; Queens University Belfast, United Kingdom) are engaged in an EU funded Erasmus + project that is exploring the quality assurance process associated with active learning. The development of a new self-evaluation framework that feeds into a ?Marketplace? where participating institutions can be paired up and then engage in peer evaluations and sharing around each institutions approach to and implementation of active learning. All of the partner institutions are engaged in the application of CDIO within their engineering programmes and this has provided a common starting point for the partnership to form and the project to be developed. Although the initial focus will be CDIO, the longer term aim is that the approach could be of value beyond CDIO and within other disciplines. The focus of this paper is the process by which the self-evaluation framework is being developed and the form of the draft framework. In today?s Higher Education environment, the need to comply with Quality Assurance standards is an ever present feature of programme development and review. When engaging in a project that spans several countries, the wealth of applicable standards and guidelines is significant. In working towards the development of a robust Self Evaluation Framework for this project, the project team decided to take a wide view of the available resources to ensure a full consideration of different requirements and practices. The approach to developing the framework considered: a) institutional standards and processes b) national standards and processes e.g. QAA in the UK c) documents relating to regional / global accreditation schemes e.g. ABET d) requirements / guidelines relating to particular learning and teaching frameworks e.g. CDIO. The resulting draft self-evaluation framework is to be implemented within the project team to start with to support the initial ?Marketplace? pairing process. Following this initial work, changes will be considered before a final version is made available as part of the project outputs. Particular consideration has been paid to the extent of the framework, as a key objective of the project is to ensure that the approach to quality assurance has impact but is not overly demanding in terms of time or paperwork. In other words that it is focused on action and value added to staff, students and the programmes being considered.

'Catching them young':inspiring future engineers, an exploratory study

The requirement that primary school children appreciate fully the pivotal role played by engineering in the sustainable development of future society is reflected in the literature with much attention being paid to the need to spark childrens engineering imagination early-on in their school careers. Moreover, UK policy documents highlight the value of embedding engineering into the school curriculum, arguing that programmes aimed at inspiring children through a process of real-life learning experiences are vital pedagogical tools in promoting engineering to future generations. Despite such attention, engineering education at school-level remains sporadic, often reliant on individual engineering-entrepreneurs such as teachers who, through personal interest, get children involved in what are usually extra-curriculum, time-limited engineering focused programmes and competitions. This paper briefly discusses an exploratory study aimed at investigating the issues surrounding embedding engineering into the primary school curriculum. It gives some insight into the perceptions of various stakeholders in respect of the viability and value of introducing engineering education into the primary school curriculum from the age of 6 or 7. A conceptual framework of primary level engineering education, bringing together the theoretical, pedagogical and policy related phenomena influencing the development of engineering education is proposed. The paper concludes by arguing that in order to avert future societal disaster, childrens engineering imagination needs to be ignited from an early age and that to do this primary engineering education needs to be given far more educational, social and political attention. © 2009 Authors.

Engaging future engineers:pedagogy, policy & practice

Despite being frequently misrepresented as outdated or old fashioned (IMechE, 2009, p1), engineering is increasingly called upon to deal with some of societies biggest challenges including those associated with climate, infrastructure and security. In order to meet such challenges there needs to be a supply of engineering talent able to turn its collective mind to what is required. Yet at a time when demands for engineers able to provide innovative solutions to contemporary problems is possibly at its highest, the profession is plagued by shortages and an inability to attract young people (DIUS, 2008; RAE 2008; NSF, 2009). Although the current situation appears critical, potential future shortages of engineers means that unless action is taken urgently, matters will get worse during the next 20 to 30 years. For higher education, the challenge is how to change young peoples perceptions of engineering in such a manner that it is seen as a worthwhile and rewarding career. This paper considers this challenge, looking in detail at why young people fail to view engineering positively. A theoretical framework outlining the various real-life barriers and drivers is proposed. A critical analysis of current policy and practice suggests that in order to promote engineering as a profession that young people want to enter, both pedagogic and policy grounded solutions need to be found. By bringing together pedagogy and policy within an engineering framework the paper adds to current debates in engineering education whilst providing a distinctive look at what seems to be a recurring problem. © 2009 Authors.

From phenomenography study to planning teaching

A phenomenographic study uncovers variations in the way that the subjects are aware of a phenomenon. In the categories of description that represent the variations in awareness there are features that, through their variation, define the characteristics of the categories. Teaching seeks to foster a change in the way that the learner is aware of a phenomenon through opening up a space of learning. This paper outlines the way that the outcome spaces from a phenomenographic study can be used to plan a teaching programme that utilises variations in the features. It discusses a strategy for teaching programming based on a phenomenographic study of practitioner conceptions of an object-oriented program. The strategy covers features related to the nature of an object-oriented program. Copyright 2010 ACM.