Can computer-based testing achieve quality and efficiency in assessment?

This paper reports findings of a two year study concerning the development and implementation of a general-purpose computer-based assessment (CBA) system at a UK University. Data gathering took place over a period of nineteen months, involving a number of formative and summative assessments. Approximately 1,000 students, drawn from undergraduate courses, were involved in the exercise. The techniques used in gathering data included questionnaires, observation, interviews and an analysis of student scores in both conventional examinations and computer-based assessments. Comparisons with conventional assessment methods suggest that the use of CBA techniques may improve the overall performance of students. However it is clear that the technique must not be seen as a "quick fix" for problems such as rising student numbers. If one accepts that current systems test only a relatively narrow range of skills, then the hasty implementation of CBA systems will result in a distorted and inaccurate view of student performance. In turn, this may serve to reduce the overall quality of courses and - ultimately - detract from the student learning experience. On the other hand, if one adopts a considered and methodical approach to computer-based assessment, positive benefits might include increased efficiency and quality, leading to improved student learning.

Work-based HE pathways for the electrical power engineering industry

Aston University has been working closely with key companies from within the electricity industry for several years, initially in the development and delivery of an employer-led foundation degree programme in electrical power engineering, and more recently, in the development of a progression pathway for foundation degree graduates to achieve a Bachelors-level qualification. The Electrical Power Engineering foundation degree was developed in close consultation with the industry such that the programme is essentially owned by the sector. Programme delivery has required significant shifts away from traditional HE teaching patterns whilst maintaining the quality requirement and without compromise of the academic degree standard. Block teaching (2-week slots), partnership delivery, off-site student support and work-based learning have all presented challenges as we have sought to maximise the student learning experience and to ensure that the graduates are fit-for purpose and "hit the ground running" within a defined career structure for sponsoring companies. This paper will outline the skills challenges facing the sector; describe programme developments and delivery challenges; before articulating some observations and conclusions around programme effectiveness, impact of foundation degree graduates in the workplace and the significance of the close working relationship with key sponsoring companies. Copyright © 2012, September.

Teacher use of personal narratives in the Japanese university english language classroom

While storytelling in conversation has been extensively investigated, much less is known about storytelling in the English language classroom, particularly teachers telling their personal experience stories, termed teacher personal narratives in this study. Teacher personal narratives, a combination of the ancient art of human storytelling and the current practices of teaching, offer an innovative approach to language teaching and learning. This thesis examines teacher personal narrative use in Japanese university English language classrooms and is of relevance to both practicing classroom teachers and teacher educators because it explores the role, significance, and effectiveness of personal stories told by teachers. The pedagogical implications which the findings may have for language teaching and learning as well as for teacher education programs are also discussed. Four research questions were posed: 1. What are the characteristics of teacher personal narratives? 2. When, how, and why do language teachers use personal narratives in the classroom? 3. What is the reaction of learners to teacher personal narratives? 4. How do teacher personal narratives provide opportunities for student learning? A mixed methods approach using the tradition of multiple case studies provided an in-depth exploration of the personal narratives of four teachers. Data collection consisted of classroom observations and audio recordings, teacher and student semi-structured interviews, student diaries, and Japan-wide teacher questionnaires. Ninety-seven teacher personal narratives were analyzed for their structural and linguistic features. The findings showed that the narrative elements of orientation, complication, and evaluation are almost always present in these stories, and that discourse and tense markers may aid in student noticing of the input which can lead to eventual student output. The data also demonstrated that reasons for telling narratives mainly fall into two categories: affectiveoriented and pedagogical-oriented purposes. This study has shown that there are significant differences between conversational storytelling and educational storytelling.

Engineering education research - the UK perspective at a time of change

Engineering education in the United Kingdom is at the point of embarking upon an interesting journey into uncharted waters. At no point in the past have there been so many drivers for change and so many opportunities for the development of engineering pedagogy. This paper will look at how Engineering Education Research (EER) has developed within the UK and what differentiates it from the many small scale practitioner interventions, perhaps without a clear research question or with little evaluation, which are presented at numerous staff development sessions, workshops and conferences. From this position some examples of current projects will be described, outcomes of funding opportunities will be summarised and the benefits of collaboration with other disciplines illustrated. In this study, I will account for how the design of task structure according to variation theory, as well as the probe-ware technology, make the laws of force and motion visible and learnable and, especially, in the lab studied make Newton's third law visible and learnable. I will also, as a comparison, include data from a mechanics lab that use the same probe-ware technology and deal with the same topics in mechanics, but uses a differently designed task structure. I will argue that the lower achievements on the FMCE-test in this latter case can be attributed to these differences in task structure in the lab instructions. According to my analysis, the necessary pattern of variation is not included in the design. I will also present a microanalysis of 15 hours collected from engineering students' activities in a lab about impulse and collisions based on video recordings of student's activities in a lab about impulse and collisions. The important object of learning in this lab is the development of an understanding of Newton's third law. The approach analysing students interaction using video data is inspired by ethnomethodology and conversation analysis, i.e. I will focus on students practical, contingent and embodied inquiry in the setting of the lab. I argue that my result corroborates variation theory and show this theory can be used as a 'tool' for designing labs as well as for analysing labs and lab instructions. Thus my results have implications outside the domain of this study and have implications for understanding critical features for student learning in labs. Engineering higher education is well used to change. As technology develops the abilities expected by employers of graduates expand, yet our understanding of how to make informed decisions about learning and teaching strategies does not without a conscious effort to do so. With the numerous demands of academic life, we often fail to acknowledge our incomplete understanding of how our students learn within our discipline. The journey facing engineering education in the UK is being driven by two classes of driver. Firstly there are those which we have been working to expand our understanding of, such as retention and employability, and secondly the new challenges such as substantial changes to funding systems allied with an increase in student expectations. Only through continued research can priorities be identified, addressed and a coherent and strong voice for informed change be heard within the wider engineering education community. This new position makes it even more important that through EER we acquire the knowledge and understanding needed to make informed decisions regarding approaches to teaching, curriculum design and measures to promote effective student learning. This then raises the question 'how does EER function within a diverse academic community?' Within an existing community of academics interested in taking meaningful steps towards understanding the ongoing challenges of engineering education a Special Interest Group (SIG) has formed in the UK. The formation of this group has itself been part of the rapidly changing environment through its facilitation by the Higher Education Academy's Engineering Subject Centre, an entity which through the Academy's current restructuring will no longer exist as a discrete Centre dedicated to supporting engineering academics. The aims of this group, the activities it is currently undertaking and how it expects to network and collaborate with the global EER community will be reported in this paper. This will include explanation of how the group has identified barriers to the progress of EER and how it is seeking, through a series of activities, to facilitate recognition and growth of EER both within the UK and with our valued international colleagues.

Entrepreneurship and innovation through experience:student and employer perspectives of the value of work-based learning in promoting entrepreneurialism

The 'internationalisation' of Business and Management education, reflective of EU enlargement and the unprecedented globalisation of education, has resulted in growing numbers of overseas students adding a diversity and richness to the learning environment within many contemporary European Higher Educational Institutions (Green, 2006, Sliwa & Grandy, 2006). However, cross-national studies analyzing the impact that the internationalisation of business education has on the employability of business and management graduates are rare. Furthermore, there exists a notable gap in research aimed at identifying and conceptualising the generic business skills and competencies required by European employers of business and management graduates. By proposing a conceptual framework based upon a working model of business graduate employability, this goes some way to addressing this gap.

A virtual learning environment for operations management:Assessing the student's perspective

This paper describes a project aimed at assessing the experience of a virtual learning environment (VLE) among students studying courses in operations management. The project was supported by the Higher Education Funding Council for England (HEFCE) under its Teaching Quality Enhancement Fund (TQEF). The main aim of the project was through the use of a questionnaire to establish the student experience of using a VLE through an examination of the learning and technical features which they encountered. The study also examines the approaches to learning adopted by the students, through the inclusion of a shortened version of the approaches and study skills inventory for students (ASSIST) which the students were asked to complete.