Overseas students evaluation of teaching effectiveness

DUE TO COPYRIGHT RESTRICTIONS ONLY AVAILABLE FOR CONSULTATION AT ASTON UNIVERSITY LIBRARY AND INFORMATION SERVICES WITH PRIOR ARRANGEMENT

An evaluation of English language instruction in universities/colleges in Taiwan

The purpose of this study is about to survey the effectiveness of English teaching in universities/colleges in Taiwan and provide suggestions to the educational authorities for upgrading or improving the English language teaching techniques or methods currently in use. On the one hand, the suggestions of English teachers in universities/colleges are the main concerns in this study. On the other hand, equal attention is given to the opinions and learning attitudes of the students, including the interaction between the teachers and the students.^ A social investigation methodology, consisting of questionnaire and data analysis, is devoted to this evaluation and analysis of teaching effectiveness. Among the significant findings reported in this study is the fact that both students and teachers consider evaluation of teaching effectiveness as a very important aspect of English Language programs at the university/college level. Another significant finding is that students are less concerned about the grades earned or awarded in English Language courses and more concerned about how much they learned in these classes.^ The analysis and suggestions based on the results for English teaching evaluation of universities/colleges in this dissertation can help teachers modify their teaching techniques and methods, the students to adjust their learning attitudes, and the authorities to schematize the English teaching plan that can facilitate the teaching goals to be realized. ^

Integration of medical images to the teaching of systematic pathology : an evaluation of relevance

A sound knowledge of pathological disease processes is required for professional practice within health professions. The project described in this paper reviewed the resources currently available for the delivery of systematic pathology tutorials. Additional complementary resources were developed and the inclusion of these additional learning resources in practical tutorial sessions was evaluated for their impact on student learning. Student evaluation of the learning resources was undertaken across one semester with two different cohorts of health profession students using questionnaires and focus group discussion. Both cohorts reported an enhancement to their understanding of pathological disease processes through the use of the additional resources. Results indicate student perception of the value of the resources correlates with staff perception and is independent of prior experiences.

Evaluation of the quality of diverse teaching practice in higher education research methods

The purpose of this paper is to report on a methods research project investigating the evaluation of diverse teaching practice in Higher Education. The research method is a single site case study of an Australian university with data collected through published documents, surveys, interviews and focus groups. This project provides evidence of the wide variety of evaluation practice and diverse teaching practice across the university. This breadth identifies the need for greater flexibility of evaluation processes, tools and support to assist teaching staff to evaluate their diverse teaching practice. The employment opportunities for academics benchmark the university nationally and position the case study in the field. Finally this reaffirms the institutional responsibility for services to support teaching staff in an ongoing manner.

Reframing evaluation of learning and teaching: An approach to change

Evaluation practices in the Higher Education sector have been criticised for having unclear purpose and principles; ignoring the complexity and changing nature of learning and teaching and the environments in which they occur; relying almost exclusively on student ratings of teachers working in classroom settings; lacking reliability and validity; using data for inappropriate purposes; and focusing on accountability and marketing rather than the improvement of learning and teaching. In response to similar criticism from stakeholders, in 2011 Queensland University of Technology (QUT) began a project which aims to reframe the organisation’s approach to the evaluation of learning and teaching. This paper describes the existing evaluation system; the emergence and early development of the project; and formulation of a conceptual framework identifying key dimensions of evaluation. It then compares the draft framework with other conceptualisations and models of evaluation identified in the literature, to determine its validity and suitability for supporting QUT’s plans for the future. Overall, the paper represents a structured evaluation of the REFRAME project at a particular point in its lifecycle. Given that the project follows an evidence based, practice-led process and applies an ongoing action research cycle, the findings are presented in the belief that QUT’s experience is broadly applicable to other institutions which may be contemplating change in relation to evaluation of learning and teaching.

From policy borrowing to implementation : an illuminative evaluation of learning and teaching in higher education in Australia (2002 to 2008)

This study documents and theorises the consequences of the 2003 Australian Government Reform Package focussed on learning and teaching in Higher Education during the period 2002 to 2008. This is achieved through the perspective of program evaluation and the methodology of illuminative evaluation. The findings suggest that the three national initiatives of that time, Learning and Teaching Performance Fund (LTPF), Australian Learning and Teaching Council (ALTC), and Australian Universities Quality Agency (AUQA), were successful in repositioning learning and teaching as a core activity in universities. However, there were unintended consequences brought about by international policy borrowing, when the short-lived nature of LTPF suggests a legacy of quality compliance rather than one of quality enrichment.

The use of interactive video in teaching teachers: an evaluation of a link with a primary school

This paper presents an evaluation of the use of videoconferencing in learning and teaching in a United Kingdom higher education institution involved in initial teacher education. Students had the opportunity to observe naturalistic teaching practices without physically being present in the classroom. The study consisted of semi-structured interviews with the co-ordinator of the link, the head of ICT services in Stranmillis University College and the teacher of the classroom being observed. Students were invited to complete an online questionnaire. The views of the students, the co-ordinator of the link, the teacher of the classroom being observed and the head of ICT services in Stranmillis University College were then triangulated to gain an overall view of the effectiveness of the videoconferencing link. Interviews suggested students benefited in terms of pedagogy. In the early stages of the project, the teacher thought it acted as a form of classroom control. Technical problems were encountered initially and camera control was modified in the light of these. The online questionnaire suggested that students viewed this experience in a positive way and were impressed with the content, technical quality, and potential benefits of the use of this example of new technologies.

Evaluation of the contribution of theatre attendance to medical undergraduate neuroscience teaching - a pilot study.

Introduction: Medical students often attend the neurosurgical theatre during their clinical neurosciences attachment. However, few studies have been performed to objectively assess the value of this theatre-based learning experience. The main aim of this study was to explore student perceptions on the contribution of neurosurgical theatre attendance to clinical neuroscience teaching.

Materials and Methods: Third-year medical students undergoing their 2-week clinical neurosciences rotation at the Royal Hospitals Belfast were invited to participate in this study. A multi-method strategy was employed using a survey questionnaire comprising of closed and open-ended questions followed by semi-structured interviews to gain a greater 'in-depth' analysis of the potential contribution of neurosurgical theatre attendance to neuroscience teaching.

Results: Based on the completed survey responses of 22 students, the overall experience of neurosurgical theatre-based learning was a positive one. 'In-depth' analysis from semi-structured interviews indicated that students felt that some aspects of their neurosurgical theatre attendance could be improved. Better preparation such as reading up on the case in hand and an introduction to simple theatre etiquette to put the student at ease (in particular, for students who had never attended theatre previously), would improve the learning experience. In addition, having an expectation of what students are expected to learn in theatre making it more learning outcomes-based would probably make it feel a more positive experience by the student.

Conclusions: The vast majority of students acknowledged the positive learning outcomes of neurosurgical theatre attendance and felt that it should be made a mandatory component of the curriculum.

Evaluation of Video Presentation to Deliver Surgical Anatomy Teaching

Title Evaluation of Video Presentation to Deliver Surgical Anatomy Teaching

Authors Walsh I.K., Boohan M., Dorman A.

Objectives To evaluate the efficacy of newly introduced video presentation to deliver Surgical Anatomy teaching to undergraduate medical students.

Design and Setting Qualitative and quantitative study using questionnaires and focus groups, employing students undertaking the perioperative medicine module of the phase 4 undergraduate medical curriculum at Queen’s University Belfast.

Outcome Measures To determine:
(1) if video presentation is effective in delivering surgical anatomy teaching,
(2) student’s learning preferences regarding this teaching method.
Results The questionnaire response rate was 89% (216 of 244 students; female: male ratio 1.25) and 42 students participated in 6 focus groups. Mean questionnaire responses indicated a favourable opinion on quality assurance items, with a mixed response to video presentation as a learning method. 71% of students preferred to receive a lecture in person, rather than via video presentation. There were no statistically significant differences between genders regarding learning preferences in general and regarding video versus live presentation in particular. Exploratory factor analysis demonstrated that favourable responses to video presentation were strongly associated with perceived audiovisual quality and learning preferences (Cronbach’s alpha coefficient 0.77), with 72% of students considering video presentation worthwhile. Positive perception of overall quality was strongly associated with learning preferences as well as more generic quality assurance issues (80% students; alpha coefficient 0.83).
The results were supported by triangulation of the above quantitative data with qualitative data generated by the focus groups. Students further articulated the view that video presentation may be more appropriate and effective in a mixed method setting.

Reference Basu Roy R, McMahon GT. Video-based cases disrupt deep critical thinking in problem-based learning. Med Educ 2012 Apr;46(4):426-435.

Evaluation of Multidisciplinary Delivery of Surgical Anatomy Teaching

Title Evaluation of Multidisciplinary Delivery of Surgical Anatomy Teaching

Authors Walsh I.K., Taylor S.J., Dorman A, Boohan M.

Objectives To evaluate the efficacy of newly introduced multidisciplinary methods to deliver Surgical Anatomy teaching to undergraduate medical students.

Design and Setting Qualitative and quantitative study using questionnaires and focus groups, employing students of the perioperative and emergency medicine (POEM) module of the phase 4 undergraduate medical curriculum at Queen’s University Belfast.

Outcome Measures To determine:
(1) if multidisciplinary teaching is effective in delivering surgical anatomy teaching,
(2) student’s learning preferences regarding this teaching method.
Results The questionnaire response rate was 89% (216 of 244 students; female: male ratio 1.25) and 42 students participated in 6 focus groups. Mean questionnaire responses indicated a favourable opinion on quality assurance items and multidisciplinary teaching. 81% of students agreed that multidisciplinary teaching enhanced learning and 86% felt that this did not adversely affect interaction. A positive contribution towards POEM learning was reported for Radiology (95% of students), Anatomy (93%) and Surgery (78%). The benefits of multidisciplinary teaching were congruent for Anatomy, Radiology and Surgery with 78% of students indicating a perceived favourable association with learning. Multidisciplinary teaching was not associated with diluted interaction, with 62% of students describing interaction as sufficient. 88% of students positively ranked tutor characteristics of enthusiasm and encouragement as being strongly associated with teacher quality. Positive perception of overall quality was strongly associated with learning preferences as well as more generic quality assurance issues (80% students; alpha coefficient 0.83).
The results were supported by triangulation of the above quantitative data with qualitative data generated by the focus groups. Whilst students frequently misunderstood the meaning of “multidisciplinary teaching”, there was an appreciation of the method’s worth; students recognised and valued the relevance of Anatomy, Radiology and Surgery teaching to POEM learning. The importance of vertically integrating Anatomy into all stages of the undergraduate curriculum was especially recognised.

Reference Aarnio M, Nieminen J, Pyorala E, Lindbolm-Ylanne S. Motivating medical students to learn. 2010 Med Teach;32(4):199-204.

Data analysis applied to the evaluation of a technological nature teaching model as a regional development tool

This paper presents the creation and development of technological schools directly linked to the business community and to higher public education. Establishing themselves as the key interface between the two sectors they make a signigicant contribution by having a greater competitive edge when faced with increasing competition in the tradional markets. The development of new business strategies supported by references of excellence, quality and competitiveness also provides a good link between the estalishment of partnerships aiming at the qualification of education boards at a medium level between the technological school and higher education with a technological foundation. We present a case study as an example depicting the success of Escola Tecnológica de Vale de Cambra.