Audience response systems can facilitate communal course feedback

Background At Queensland University of Technology (QUT), the Bachelor of Radiation Therapy course evaluation has previously suffered from low online survey participation rates. A communal instantaneous feedback event using an audience response system (ARS) was evaluated as a potential solution to this problem. The aims of the project were to determine the extent to which this feedback event could be facilitated by ARS technology and to evaluate the impact the technology made on student satisfaction and engagement. Methods Students were invited to a timetabled session to provide feedback on individual study units and the course overall. They provided quantitative Likert-style responses to prompts for each unit and the course using an ARS as well as anonymous typed qualitative comments. Data collection was performed live so students were able to view collective class responses. This prompted further discussion and enabled a prospective action plan to be developed. To inform future ARS use, students were asked for their opinions on the feedback method. Results Despite technological difficulties, student evaluation indicated that all responders enjoyed the session and the opportunity to view the combined responses. All students felt that useful feedback was generated and that this method should be used in the future. The student attendance and response rates were high, and it was clear that the session had led to the development of some insightful qualitative feedback comments. Conclusions: An ARS contributed well to the collection of course feedback in a communal and interactive environment. Students found it enjoyable to use, and it helped to stimulate useful qualitative comments

Taiwanese Learners’ Motivation and Attitude Towards Completing an Online Distance Education Course During a One Year Industrial Placement

This mixed methods study investigated language learning motivation in an one-year e-learning course for technological university students to bridge the geographical divide between students on industrial placements when studying graded readers using an e-learning course to improve their English competence and to pass the General English Proficiency Test. Data was collected through questionnaires and course feedback. The results of this study extend Gardner’s socio-educational model in an e-learning environment by adding the new category, Computer Attitudes, which was proven to be highly correlated with Motivation. Although the low proficiency English students had good computer skills, their habits of using the computer for entertainment and their lack of the skill of “technological communication efficacy” caused increased anxiety when using computers and thus provided them with a lower computer confidence over time. Consequently, it is recommended that sound e-learning training should be provided to all of the students prior to embarking on an e-leaning course so that these learners can benefit from online language learning in the future.

Teknillisen korkeakoulun konetekniikan osaston opettajien ja opiskelijoiden kokemukset oppimisen arvioinnista ja palautteesta

Objectives. The purpose of this study was to examine perceptions of evaluation of learning and feedback among teachers and students of mechanical engineering at the Helsinki University of Technology. The differences and similarities between the perceptions of these two groups were also studied. Course feedback was examined, and a target was set to rationalize the collation and exploitation of the feedback data. The theoretical background for the evaluation of learning was based primarily on the theories of Brown (1997), Karjalainen (2001) and Rowntree (1977, 1988). The Biggs (2003) model on aligned teaching was used as an example of quality university education. Feedback practices were examined through the theory of Ramsden (1992) and many recent research articles. Methods. The qualitative study was executed by examining the evaluation of learning and feedback prac-tices of the courses in mechanical engineering at the Helsinki University of Technology. The data was gathered by interviewing the teachers responsible of basic and postgraduate studies, as well as students taking their basic studies. Four group interviews were arranged for both teachers and students, each with three participants. The data from these themed interviews were analyzed by means of content analysis. Result and conclusions. This study showed that teachers and students have similar perceptions of evalua-tion of learning and feedback excluding a few significant differences. The most essential difference in evaluation of learning was that students perceived the evaluation of the examinations to be inaccurate. Teachers on the other hand thought that the existing practice for the exam evaluation is working fine. Stu-dents also felt that they are not giving enough information on the opportunities to get feedback. Teachers instead expected students to actively ask for feedback. Students perceived the need for exploiting the course feedback for course development purposes more than before. Teachers saw foremost the challenges and problems in the exploitation of the feedback. In the future, more effort must be put on the research of the evaluation of learning and feedback, as the quality assurance and continuous improvement of the teaching calls for new data.

A universally delivered CBT based intervention in a Scottish secondary school: a pilot feasibility study

Objectives: To evaluate the feasibility of a universally delivered CBT-based programme for pupils within a Scottish secondary school setting. Design: A pre-post, within and between groups design was utilised. Setting: Religious Moral Citizenship and Education (RMCE) classes in a Scottish secondary school. Participants: Four (n = 103) classes of third year secondary school pupils were arbitrarily allocated to two conditions: RMCE-as usual (RMCE-AU) controls, and LLTTF intervention. Intervention: Living Life to the Full (LLTTF) is a series of Cognitive Behavioural Therapy (CBT)-based booklets and accompanying 8 classes to improve coping skills. An adolescent version of LLTTF was recently developed. This was delivered over nine weeks by school teachers trained in the approach. Outcome measures: The Strengths and Difficulties Questionnaire, Rosenberg Self-Esteem scale, General Self-Efficacy Scale, and Locus of Control scale were administered at baseline and 9 week follow-up. To determine acceptability and utility of the materials course feedback was gathered weekly from the intervention group and a focus group (n=5) was conducted at 3 month follow up. Results: Outcome measures showed no significant improvement in overall wellbeing of those in the intervention group compared with that of the control group. Weekly feedback suggested that the majority of pupils found the materials useful and relevant. Focus group feedback suggested that pupils found the intervention useful, had utilised strategies in everyday life and would welcome recurring provision of such interventions within the school setting. Conclusions: Universally delivered CBT intervention is acceptable and feasible within the secondary school environment. However, objective measurement using standardised tools does not adequately corroborate qualitative feedback from pupils. Issues relating to measurement, study design and implementation of future interventions are discussed.

Sustained impact of a short small group course with systematic feedback in addition to regular clinical clerkship activities on musculoskeletal examination skills-a controlled study.

BACKGROUND The discrepancy between the extensive impact of musculoskeletal complaints and the common deficiencies in musculoskeletal examination skills lead to increased emphasis on structured teaching and assessment. However, studies of single interventions are scarce and little is known about the time-dependent effect of assisted learning in addition to a standard curriculum. We therefore evaluated the immediate and long-term impact of a small group course on musculoskeletal examination skills. METHODS All 48 Year 4 medical students of a 6 year curriculum, attending their 8 week clerkship of internal medicine at one University department in Berne, participated in this controlled study. Twenty-seven students were assigned to the intervention of a 6×1 h practical course (4-7 students, interactive hands-on examination of real patients; systematic, detailed feedback to each student by teacher, peers and patients). Twenty-one students took part in the regular clerkship activities only and served as controls. In all students clinical skills (CS, 9 items) were assessed in an Objective Structured Clinical Examination (OSCE) station, including specific musculoskeletal examination skills (MSES, 7 items) and interpersonal skills (IPS, 2 items). Two raters assessed the skills on a 4-point Likert scale at the beginning (T0), the end (T1) and 4-12 months after (T2) the clerkship. Statistical analyses included Friedman test, Wilcoxon rank sum test and Mann-Whitney U test. RESULTS At T0 there were no significant differences between the intervention and control group. At T1 and T2 the control group showed no significant changes of CS, MSES and IPS compared to T0. In contrast, the intervention group significantly improved CS, MSES and IPS at T1 (p < 0.001). This enhancement was sustained for CS and MSES (p < 0.05), but not for IPS at T2. CONCLUSIONS Year 4 medical students were incapable of improving their musculoskeletal examination skills during regular clinical clerkship activities. However, an additional small group, interactive clinical skills course with feedback from various sources, improved these essential examination skills immediately after the teaching and several months later. We conclude that supplementary specific teaching activities are needed. Even a single, short-lasting targeted module can have a long lasting effect and is worth the additional effort.

How should a vocational education and training course be evaluated?

The course evaluation process used by a large VET provider was evaluated using guidelines suggested by the course evaluation literature and feedback obtained from multiple stakeholders. A modified model is presented as an exemplar for course evaluation in the VET sector.

Postgraduate response to an information retrieval credit course

Information skills instruction for research candidates bas recently been formalised as coursework at the Queensland University of Technology. Feedback solicited from participants suggests that students benefit from such coursework in a number of ways. Their perception of the value of specific content areas to their literature review and thesis presentation is favourable. A small group of students who participated in Interviews identified five ways in which the coursework assisted the research process. As Instructors continue to work with the post·graduate community it would be useful to deepen our understanding of how such instruction is perceived and the benefits which can be derived from it.

Course evaluation : reconfigurations for learning with learning management systems

The introduction of online delivery platforms such as learning management systems (LMS) in tertiary education has changed the methods and modes of curriculum delivery and communication. While course evaluation methods have also changed from paper-based in-class-administered methods to largely online-administered methods, the data collection instruments have remained unchanged. This paper reports on a small exploratory study of two tertiary-level courses. The study investigated why design of the instruments and methods to administer surveys in the courses are ineffective measures against the intrinsic characteristics of online learning. It reviewed the students' response rates of the conventional evaluations for the courses over an eight-year period. It then compared a newly developed online evaluation and the conventional methods over a two-year period. The results showed the response rates with the new evaluation method increased by more than 80% from the average of the conventional evaluations (below 30%), and the students' written feedback was more detailed and comprehensive than in the conventional evaluations. The study demonstrated the possibility that the LMS-based learning evaluation can be effective and efficient in terms of the quality of students' participation and engagement in their learning, and for an integrated pedagogical approach in an online learning environment.

Review of the ACT Road Ready and Road Ready Plus Novice Driver Road Safety Education Course Material

This report documents research that was commissioned in order to review the materials used in the Road Ready program for relevancy and acceptability to the target audiences as part of the implementation of the ACT Road Safety Strategy Action Plan. Relevant literature on young driver crash risk and best practice principles in driver education was reviewed as a first step (Section 2). The evidence for effectiveness of driver education programs in Australia was summarised (Section 3) and a separate review of the use of incentives in relation to driver education was performed. The brief called for an expert review of the materials and delivery design for both the Road Ready and Road Ready Plus programs. This is reported in Section 5, along with the overall recommendations for program improvement. More specific comments on individual modules in the Road Ready program are listed at the end of Section 5. Lastly, feedback from stakeholders, specifically the facilitators and teachers of the programs, as well as former students who have completed the Road Ready program, was sought. Interviews and surveys were conducted with these groups. Summaries of the methods and findings are contained in Section 6.

Service-learning through multiple client-sponsored projects in an MBA marketing course

This paper outlines an approach for teaching Marketing Principles in an MBA course through service-learning to enable adult learners to connect the lectures’ marketing content to a real-world marketing project. During the course, 40 students in groups of four to five individuals were involved in eight different client-sponsored marketing projects executed simultaneously. The rationale, planning and management of this approach utilised current research on service-learning, living cases and client-sponsored projects in marketing education. The experimental curriculum design is presented in a timeline that mirrors the preparation and management of the group projects and the considerations to be taken into account when initiating and facilitating the projects. Reflections from this iteration of the service-learning design suggest the importance of: detailed project planning, the involvement of students in choosing the projects, the introduction of forms and feedback loops, the role of the instructor in facilitating the students and managing expectations, and the role of the company representative in supporting the groups.

The experience of forging new emergency nursing curriculum development, through a course advisory network

Queensland University of Technology (QUT), School of Nursing (SoN), has offered a postgraduate Graduate Certificate in Emergency Nursing since 2003, for registered nurses practising in an emergency clinical area, who fulfil key entry criteria. Feedback from industry partners and students evidenced support for flexible and extended study pathways in emergency nursing. Therefore, in the context of a growing demand for emergency health services and the need for specialist qualified staff, it was timely to review and redevelop our emergency specialist nursing courses. The QUT postgraduate emergency nursing study area is supported by a course advisory group, whose aim is to provide input and focus development of current and future course planning. All members of the course advisory were invited to form an expert panel to review current emergency course documents. A half day “brainstorm session”, planning and development workshop was held to review the emergency courses to implement changes from 2009. Results from the expert panel planning day include: proposal for a new emergency specialty unit; incorporation of the College of Emergency Nurses (CENA) Standards for Emergency Nursing Specialist in clinical assessment; modification of the present core emergency unit; enhancing the focus of the two other units that emergency students undertake; and opening the emergency study area to the Graduate Diploma in Nursing (Emergency Nursing) and Master of Nursing (Emergency Nursing). The conclusion of the brainstorm session resulted in a clearer conceptualisation, of the study pathway for students. Overall, the expert panel group of enthusiastic emergency educators and clinicians provided viable options for extending the career progression opportunities for emergency nurses. In concluding, the opportunity for collaboration across university and clinical settings has resulted in the design of a course with exciting potential and strong clinical relevance.

“Success in (Surviving) Bioscience and Pharmacology” – an eBook to improve the retention of diploma nurses transitioning to a Bachelor of Nursing course

Diploma students transitioning into the NS40 BNursing (BN) course at QUT withdraw from the bioscience and pharmacology units, and leave the university at higher rates than traditional students. The diploma students, entering in second year, have missed out on 2 units of bioscience taught to the traditional students in their first year, and miss out on a 3rd unit of bioscience taught to the traditional students in their 2nd year. Instead the diploma students receive one specialized unit in bioscience only i.e. a bridging unit. As a consequence, the diploma students may not have the depth of bioscience knowledge to be able to successfully study the bridging unit (LSB111) or the pharmacology unit (LSB384). Our plan was to write an eBook which refreshed and reinforced diploma students’ knowledge of bioscience aiming to prepare them with the concepts and terminology, and to build a level of confidence to support their transition to the BN. We have previously developed an intervention associated with reduced attrition of diploma nursing students, and this was our starting point. The study skills part of the initial intervention was addressed in the eBook, by links to the specialist services and resources available from our liaison librarian and academic skills adviser. The introductory bioscience/pharmacology information provided by the previous intervention involved material from standard textbooks. However, we considered this material too difficult for diploma students. Thus, we created simplified diagrams to go with text as part of our eBook. The outcome is an eBook, created and made available to the diploma students via the Community Website: “Surviving Bioscience and Pharmacology”. Using simplified diagrams to illustrate the concise text, definition to explain the concepts, the focus has been on encouraging self-awareness and help-seeking strategies and building students who take responsibility for their learning. All the nursing students in the second semester LSB384 Pharmacology Unit have been surveyed face-to-face to get feedback on their engagement with the eBook resource. The data has not been analysed to date. An important consideration is that the website be evaluated by the diploma students as they come into bioscience in first semester (LSB111), the student population for whom the eBook is primarily intended. To get a good response rate we need to do a face-to-face survey. However, we have not been able to do this, as the co-ordinator of the unit has changed since we started the project, and the present co-ordinator will not allow us access to these students.

Feedback on HE in FE bids

An analysis of the bids submitted to the HE in FE programme call for proposals as part of Circular 4/06. The call was for projects to implement and pilot e-learning technologies within one or more HE course delivered in one or more FE college.