Development, evaluation and use of a student experience survey in undergraduate science laboratories: the advancing science by enhancing learning in the laboratory student laboratory learning experience survey

Student experience surveys have become increasingly popular to probe various aspects of processes and outcomes in higher education, such as measuring student perceptions of the learning environment and identifying aspects that could be improved. This paper reports on a particular survey for evaluating individual experiments that has been developed over some 15 years as part of a large national Australian study pertaining to the area of undergraduate laboratories—Advancing Science by Enhancing Learning in the Laboratory. This paper reports on the development of the survey instrument and the evaluation of the survey using student responses to experiments from different institutions in Australia, New Zealand and the USA. A total of 3153 student responses have been analysed using factor analysis. Three factors, motivation, assessment and resources, have been identified as contributing to improved student attitudes to laboratory activities. A central focus of the survey is to provide feedback to practitioners to iteratively improve experiments. Implications for practitioners and researchers are also discussed.

Assessment of student development and learning in IB PYP schools

The aim of this study is to examine how International Baccalaureate (IB) Primary Years Programme (PYP) schools define the purpose of educational assessment in their assessment policies and practices. Educational assessment in this study is broadly defined to include standardized tests, and formative and summative assessment. This investigation offers a deeper understanding of the assessment cultures of eight PYP schools and provides insights into the current assessment literacy of teachers. The researchers employed a multiple case-study approach, with two phases of data collection: an online survey of teachers and detailed teacher focus groups and coordinator interviews to follow-up on themes identified in the survey. Assessment in the PYP case-study schools was described as holistic and ongoing, and involved a wide range of assessment strategies. Assessment as learning, however, emerged as an approach still in development in the schools. Teachers enthusiastically supported the development of learner profile attributes, although assessing progress in any particular attribute was regarded as challenging. Finally, while teacher feedback and student self-assessment were common practices, teachers were more equivocal about peer assessment. The authors conclude the report with a number of recommendations for further improving PYP assessment practices.

Translating evidence-based guidelines to improve feedback practices: the interACT case study

BACKGROUND: There has been a substantial body of research examining feedback practices, yet the assessment and feedback landscape in higher education is described as 'stubbornly resistant to change'. The aim of this paper is to present a case study demonstrating how an entire programme's assessment and feedback practices were re-engineered and evaluated in line with evidence from the literature in the interACT (Interaction and Collaboration via Technology) project. METHODS: Informed by action research the project conducted two cycles of planning, action, evaluation and reflection. Four key pedagogical principles informed the re-design of the assessment and feedback practices. Evaluation activities included document analysis, interviews with staff (n = 10) and students (n = 7), and student questionnaires (n = 54). Descriptive statistics were used to analyse the questionnaire data. Framework thematic analysis was used to develop themes across the interview data. RESULTS: InterACT was reported by students and staff to promote self-evaluation, engagement with feedback and feedback dialogue. Streamlining the process after the first cycle of action research was crucial for improving engagement of students and staff. The interACT process of promoting self-evaluation, reflection on feedback, feedback dialogue and longitudinal perspectives of feedback has clear benefits and should be transferable to other contexts. CONCLUSIONS: InterACT has involved comprehensive re-engineering of the assessment and feedback processes using educational principles to guide the design taking into account stakeholder perspectives. These principles and the strategies to enact them should be transferable to other contexts.

Improving student-industry engagement through project oriented curriculum

Industry expects a creative and innovative academic practice that provides students with valuable practical knowledge focused on graduate ready skills for future careers. The learning environment in engineering is inadequate for students to become a skillful graduate. The practical role of engineering is gained through working on real world problems in an industry collaborative environment through projects. Industry academia collaboration seems to be actively increasing in the development of engineering education in various parts of the globe. The close relationship between industry and academia is a vital component of the engineering pedagogy to improve student engagement in industry through projects. By engaging students with industry, students will acquire global perspective about the core attributes expected in future engineering jobs. In today’s large-scale industrial market, companies tend to prefer graduates with design skills attained through the project approach. Thus, universities should open their doors and accept the challenges of interacting with students with industrial experiences and expectations. This paper is focused on improving student industry engagement through project/design oriented curriculum. Through quantitative and qualitative research, the paper shows the industry perspectives and students views on university and industry collaboration. The research results show that students and industry can possibly maintain their engagement by providing regular feedback, reviewing goals and objectives, improving communication, keeping focused, and sharing a similar vision.

Evaluation of student learning outcomes in fourth year engineering mechatronics through design based learning curriculum

This paper focuses on evaluation of student learning outcomes in fourth year engineering mechatronics through design based learning curriculum. The purpose of all engineering degrees is to provide strong grounding with principles of engineering science and technology. By learning engineering methods and approaches in an academic environment, graduates can enter the world of work and tackle real world problems with innovation and creativity. In many cases, academic staff are responsible for driving and setting high expectations in their classrooms. Sometimes staff are expected to teach subjects outside their expertise. This research paper is concerned with evaluating student learning outcomes through feedback sought from students on design-based learning approach.

A trial of e-simulation of sudden patient deterioration (FIRST2ACT WEB) on student learning

BACKGROUND: High-fidelity simulation pedagogy is of increasing importance in health professional education; however, face-to-face simulation programs are resource intensive and impractical to implement across large numbers of students. OBJECTIVES: To investigate undergraduate nursing students' theoretical and applied learning in response to the e-simulation program-FIRST2ACT WEBTM, and explore predictors of virtual clinical performance. DESIGN AND SETTING: Multi-center trial of FIRST2ACT WEBTM accessible to students in five Australian universities and colleges, across 8 campuses. PARTICIPANTS: A population of 489 final-year nursing students in programs of study leading to license to practice. METHODS: Participants proceeded through three phases: (i) pre-simulation-briefing and assessment of clinical knowledge and experience; (ii) e-simulation-three interactive e-simulation clinical scenarios which included video recordings of patients with deteriorating conditions, interactive clinical tasks, pop up responses to tasks, and timed performance; and (iii) post-simulation feedback and evaluation. Descriptive statistics were followed by bivariate analysis to detect any associations, which were further tested using standard regression analysis. RESULTS: Of 409 students who commenced the program (83% response rate), 367 undergraduate nursing students completed the web-based program in its entirety, yielding a completion rate of 89.7%; 38.1% of students achieved passing clinical performance across three scenarios, and the proportion achieving passing clinical knowledge increased from 78.15% pre-simulation to 91.6% post-simulation. Knowledge was the main independent predictor of clinical performance in responding to a virtual deteriorating patient R(2)=0.090, F(7, 352)=4.962, p<0.001. DISCUSSION: The use of web-based technology allows simulation activities to be accessible to a large number of participants and completion rates indicate that 'Net Generation' nursing students were highly engaged with this mode of learning. CONCLUSION: The web-based e-simulation program FIRST2ACTTM effectively enhanced knowledge, virtual clinical performance, and self-assessed knowledge, skills, confidence, and competence in final-year nursing students.

Student voice and teacher accountability: possibilities and problematics

The focus in this paper is on a student voice initiative at an English secondary school designed to improve the quality of teaching and learning. The initiative invites Year 8 students to train and work as ‘lesson observers’ who provide feedback to teachers about their practice. The possibilities of this initiative to reflect a rich and intelligent form of teacher accountability are explored in relation to its capacity to (1) enhance students’ understanding and appreciation of teachers, teaching and the learning process; (2) support students to work in partnership with teachers to improve pedagogy and relationships; and (3) develop students’ positive self-image as learners. In its exploration of this initiative the paper also considers matters of authenticity, inclusion and power and highlights ways in which student voice initiatives can be undermined when these matters are not adequately engaged with. Such engagement, it is argued, is imperative in guarding against a misappropriation or undermining of student voice to align with traditional teacher–student power relations or to fit with the dictates of school improvement as framed by narrow and reductive measures.