Evaluating and developing project-based learning:an empirical approach to evaluating CDIO

As a global profession, engineering is integral to the maintenance and further development of society. Indeed, contemporary social problems requiring engineering solutions are not only a consequence of natural and ‘manmade’ disasters (such as the Japanese earthquake or the oil leakage in the Gulf of Mexico) but also encapsulate 21st Century dilemmas around sustainability, poverty and pollution [2,6,7]. Given the complexity of such problems and the constant need for innovation, the demand for engineering education to provide a ready supply of suitably qualified engineering graduates, able to make innovative decisions has never been higher [3,5]. Bearing this in mind, and taking account problems of attrition in engineering education [1,6,4] innovation in the way in which the curriculum is developed and delivered is crucial. CDIO [Conceive, Design, Implement, Operate] provides a potentially ground-breaking solution to such dilemmas. Aimed at equipping students with practical engineering skills supported by the necessary theoretical background, CDIO could potentially change the way engineering is perceived and experienced within higher education. Aston University introduced CDIO into its Mechanical Engineering and Design programmes in October 2011. From its induction, engineering education researchers have ‘shadowed’ the staff responsible for developing and teaching the programme. Utilising an Action Research Design, and adopting a mixed methodological research design, the researchers have worked closely with the teaching team to critically reflect on the processes involved in introducing CDIO into the curriculum. Concurrently, research has been conducted to capture students’ perspectives of CDIO. In evaluating the introduction of CDIO at Aston, the researchers have developed a distinctive research strategy with which to evaluate CDIO. It is the emergent findings from this research that form the basis of this paper. Although early-on in its development CDIO is making a significant difference to engineering education at the University. The paper draws attention to pedagogical, practical and professional issues – discussing each one in turn and in doing so critically analysing the value of CDIO from academic, student and industrial perspectives. The paper concludes by noting that whilst CDIO represents a forwardthinking approach to engineering education, the need for constant innovation in learning and teaching should not be forgotten. Indeed, engineering education needs to put itself at the forefront of pedagogic practice. Providing all-rounded engineers, ready to take on the challenges of the 21st Century!

The Library of Birmingham project:lifelong learning for the digital age

The Library of Birmingham (LoB) is a £193million project designed to provide a new space for lifelong learning and knowledge growth, a physical and virtual portal for Birmingham's citizens to the wider world. In cooperation with a range of private, public, and third-sector bodies, as well as individual citizens, the library, due to open in June 2013, will articulate a continuing process of organic growth and emergence. Key delivery themes focus on: arts and creativity, citizenship and community, enterprise and innovation, learning and skills and the new media ecology. A landmark design in the heart of the cultural district of the city, the LoB aims to stimulate sustainable economic growth, urban regeneration and social inclusion by offering a wide range of new digital learning services, real and virtual community spaces, and new opportunities for interpreting and exploiting internationally significant collections of documentary archives, photography, moving image, and rare printed books. Additionally, the LoB will offer physical space for creative, cultural, enterprise, and knowledge development. This paper outlines the cultural and educational thinking that informs the project and the challenges experienced in developing innovative service redesign.

The design and evaluation of distributed virtual environment to support learning in global operations management

The primary goal of this research is to design and develop an education technology to support learning in global operations management. The research implements a series of studies to determine the right balance among user requirements, learning methods and applied technologies, on a view of student-centred learning. This research is multidisciplinary by nature, involving topics from various disciplines such as global operations management, curriculum and contemporary learning theory, and computer aided learning. Innovative learning models that emphasise on technological implementation are employed and discussed throughout this research.

Students interviewing students: the Aston-Hong Kong Project

This article provides an account of undergraduate sociology students conducting indepth interviews with international students from Hong Kong. The research is locating in a broader project of identifying rationales for the recruitment of international students. One of the shortcomings of previous research was that the student voice and rationale were missing. We have addressed this by involving undergraduate researchers in the collection and analysis of data. This project report draws on one of the reflections of the student researcher.

Technology enhanced learning in Higher Education

Technology-Enhanced Learning in Higher Education is an anthology produced by the international association, Learning in Higher Education (LiHE). LiHE, whose scope includes the activities of colleges, universities and other institutions of higher education, has been one of the leading organisations supporting a shift in the education process from a transmission-based philosophy to a student-centred, learning-based approach. Traditionally education has been envisaged as a process in which the teacher disseminates knowledge and information to the student, and directs them to perform – instructing, cajoling, encouraging them as appropriate – despite different students’ abilities. Yet higher education is currently experiencing rapid transformation, with the introduction of a broad range of technologies which have the potential to enhance student learning. This anthology draws upon the experiences of those practitioners who have been pioneering new applications of technology in higher education, highlighting not only the technologies themselves but also the impact which they have had on student learning. The anthology illustrates how new technologies – which are increasingly well-known and accepted by today’s ‘digital natives’ undertaking higher education – can be adopted and incorporated. One key conclusion is that learning remains a social process even in technology-enhanced learning contexts. So the technology-based proxies we construct need to retain and reflect the agency of the teacher. Technology-Enhanced Learning in Higher Education showcases some of the latest pedagogical technologies and their most creative, state-of-the-art applications to learning in higher education from around the world. Each of the chapters explores technology-enhanced learning in higher education in terms of either policy or practice. They contain detailed descriptions of approaches taken in very different curriculum areas, and demonstrate clearly that technology may and can enhance learning only if it is designed with the learning process of students at its core. So the use of technology in education is more linked to pedagogy than it is to bits and bytes.

Forging futures? Engineering in the primary school curriculum

Starting with the research question, "How can the Primary School Curriculum be developed so as to spark Children's Engineering Imaginations from an early age?" this paper sets out to critically analyse the issues around embedding Engineering in the Primary School Curriculum from the age of 5 years. Findings from an exploratory research project suggest that in order to promote the concept of Engineering Education to potential university students (and in doing so begin to address issues around recruitment / retention within Engineering) there is a real need to excite and engage children with the subject from a young age. Indeed, it may be argued that within today's digital society, the need to encourage children to engage with Engineering is vital to the future sustainable development of our society. Whilst UK Government policy documents highlight the value of embedding Engineering into the school curriculum there is little or no evidence to suggest that Engineering has been successfully embedded into the elementary level school curriculum. Building on the emergent findings of the first stage of a longitudinal study, this paper concludes by arguing that Engineering could be embedded into the curriculum through innovative pedagogical approaches which contextualise project-based learning experiences within more traditional subjects including science, history, geography, literacy and numeracy.

Collaborative design of assessment criteria to improve undergraduate student engagement and performance

Student engagement is vital in enhancing the student experience and encouraging deeper learning. Involving students in the design of assessment criteria is one way in which to increase student engagement. In 2011, a marking matrix was used at Aston University (UK) for logbook assessment (Group One) in a project-based learning module. The next cohort of students in 2012 (Group Two) were asked to collaboratively redesign the matrix and were given a questionnaire about the exercise. Group Two initially scored a lower average logbook mark than Group One. However, Group Two showed the greatest improvement between assessments, and the quality of, and commitment to, logbooks was noticeably improved. Student input resulted in a more defined, tougher mark scheme. However, this provided an improved feedback system that gave more scope for self-improvement. The majority of students found the exercise incorporated their ideas, enhanced their understanding, and was useful in itself.

How do engineering students develop practical competencies during a period of industrial placement? - Students' perceptions

This paper explores engineering students' perceptions of developing practical competencies as experienced in their industrial placements. In addition, it discusses the criticisms in the literature on Problem Based Learning, Project Based Learning and Conceive-Design-Implement-Operate in relation to the evaluation of effective learning and teaching during placements. The paper goes on to discuss a study which examines how undergraduate engineering students develop practical competencies during their industrial placements. A phenomenological research approach is adopted using in-depth interviews and document analysis. The research findings from this PhD study will contribute to the knowledge, theory and practice for the students, the industries and the institutions of higher education as students' practical competencies are developed and graduate employability rises. In conclusion, this study explores students' experiences of developing practical competencies during industrial placements. Hence, the study should be able to contribute to a set of evidence-based guidelines for higher education institutions and industry.

User-centred ontology learning for knowledge management

Automatic ontology building is a vital issue in many fields where they are currently built manually. This paper presents a user-centred methodology for ontology construction based on the use of Machine Learning and Natural Language Processing. In our approach, the user selects a corpus of texts and sketches a preliminary ontology (or selects an existing one) for a domain with a preliminary vocabulary associated to the elements in the ontology (lexicalisations). Examples of sentences involving such lexicalisation (e.g. ISA relation) in the corpus are automatically retrieved by the system. Retrieved examples are validated by the user and used by an adaptive Information Extraction system to generate patterns that discover other lexicalisations of the same objects in the ontology, possibly identifying new concepts or relations. New instances are added to the existing ontology or used to tune it. This process is repeated until a satisfactory ontology is obtained. The methodology largely automates the ontology construction process and the output is an ontology with an associated trained leaner to be used for further ontology modifications.

Your students have excellent knowledge and skills but they don’t think about them...:a reflective learning project

This paper describes two phases of a project set up to encourage students to be more reflective about their studies and their career goals. it takes as its starting point a discussion with employers about the Jack of reflection that they observed in otherwise highly skilled management graduates. The project.examin!ld.a number of processes, including mentoring, logbooks and learning style questionnaires to gauge which was the most effective in inspiring students to be reflective. Having identified the best methods the project entered a second phase which involved rolling out the findings to large numbers of students. The challenges of doing this are analysed in the paper.

Developing a robust self evaluation framework for active learning:the first stage of an ERASMUS+ project (QAEMarketPlace4HEI)

In ensuring the quality of learning and teaching in Higher Education, self-evaluation is an important component of the process. An example would be the approach taken within the CDIO community whereby self-evaluation against the CDIO standards is part of the quality assurance process. Eight European universities (Reykjavik University, Iceland; Turku University of Applied Sciences, Finland; Aarhus University, Denmark; Helsinki Metropolia University of Applied Sciences, Finland; Ume? University, Sweden; Telecom Bretagne, France; Aston University, United Kingdom; Queens University Belfast, United Kingdom) are engaged in an EU funded Erasmus + project that is exploring the quality assurance process associated with active learning. The development of a new self-evaluation framework that feeds into a ?Marketplace? where participating institutions can be paired up and then engage in peer evaluations and sharing around each institutions approach to and implementation of active learning. All of the partner institutions are engaged in the application of CDIO within their engineering programmes and this has provided a common starting point for the partnership to form and the project to be developed. Although the initial focus will be CDIO, the longer term aim is that the approach could be of value beyond CDIO and within other disciplines. The focus of this paper is the process by which the self-evaluation framework is being developed and the form of the draft framework. In today?s Higher Education environment, the need to comply with Quality Assurance standards is an ever present feature of programme development and review. When engaging in a project that spans several countries, the wealth of applicable standards and guidelines is significant. In working towards the development of a robust Self Evaluation Framework for this project, the project team decided to take a wide view of the available resources to ensure a full consideration of different requirements and practices. The approach to developing the framework considered: a) institutional standards and processes b) national standards and processes e.g. QAA in the UK c) documents relating to regional / global accreditation schemes e.g. ABET d) requirements / guidelines relating to particular learning and teaching frameworks e.g. CDIO. The resulting draft self-evaluation framework is to be implemented within the project team to start with to support the initial ?Marketplace? pairing process. Following this initial work, changes will be considered before a final version is made available as part of the project outputs. Particular consideration has been paid to the extent of the framework, as a key objective of the project is to ensure that the approach to quality assurance has impact but is not overly demanding in terms of time or paperwork. In other words that it is focused on action and value added to staff, students and the programmes being considered.

Good practice guide in learning and teaching

Once again this publication is produced to celebrate and promote good teaching and learning support and to offer encouragement to those imaginative and innovative staff who continue to wish to challenge students to learn to maximum effect. It is hoped that others will pick up some good ideas from the articles contained in this volume. We have again changed our approach for this 2006/07 edition (our fourth) of the Aston Business School Good Practice Guide. As before, some contributions were selected from those identifying interesting best practice on their Annual Module reflection forms in 2005/2006. Other contributors received HELM (Research Centre in Higher Education Learning and Management) small research grants in 2005/2006. Part of the conditions were for them to write an article for this publication. We have also been less tight on the length of the articles this year. Some contributions are, therefore, on the way to being journal articles. HELM will be working with these authors to help develop these for publication. The themes covered in this year?s articles are all central to the issues faced by those providing HE teaching and learning opportunities in the 21st Century. Specifically this is providing support and feedback to students in large classes, embracing new uses of technology to encourage active learning and addressing cultural issues in a diverse student population. Michael Grojean and Yves Guillaume used Blackboard™ to give a more interactive learning experience and improve feedback to students. It would be easy for other staff to adopt this approach. Patrick Tissington and Qin Zhou (HELM small research grant holders) were keen to improve the efficiency of student support, as does Roger McDermott. Celine Chew shares her action learning project, completed as part of the Aston University PG Certificate in Teaching and Learning. Her use of Blackboard™ puts emphasis on the learner having to do something to help them meet the learning outcomes. This is what learning should be like, but many of our students seem used to a more passive learning experience, so much needs to be done on changing expectations and cultures about learning. Regina Herzfeldt also looks at cultures. She was awarded a HELM small research grant and carried out some significant new research on cultural diversity in ABS and what it means for developing teaching methods. Her results fit in with what many of us are experiencing in practice. Gina leaves us with some challenges for the future. Her paper certainly needs to be published. This volume finishes with Stuart Cooper and Matt Davies reflecting on how to keep students busy in lectures and Pavel Albores working with students on podcasting. Pavel?s work, which was the result of another HELM small research grant, will also be prepared for publication as a journal article. The students learnt more from this work that any formal lecture and Pavel will be using the approach again this year. Some staff have been awarded HELM small research grants in 2006/07 and these will be published in the next Good Practice Guide. In the second volume we mentioned the launch of the School?s Research Centre in Higher Education Learning and Management (HELM). Since then HELM has stimulated a lot of activity across the School (and University) particularly linking research and teaching. A list of the HELM seminars for 2006/2007 is listed as Appendix 1 of this publication. Further details can be obtained from Catherine Foster (c.s.foster@aston.ac.uk), who coordinates the HELM seminars. For 2006 and 2005 HELM listed, 20 refereed journal articles, 7 book chapters, 1 published conference papers, 20 conference presentations, two official reports, nine working papers and £71,535 of grant money produced in this research area across the School. I hope that this shows that reflection on learning is alive and well in ABS. We have also been working on a list of target journals to guide ABS staff who wish to publish in this area. These are included as Appendix 2 of this publication. May I thank the contributors for taking time out of their busy schedules to write the articles and to Julie Green, the Quality Manager, for putting the varying diverse approaches into a coherent and publishable form and for agreeing to fund the printing of this volume.