Investigation of assessment methods for final year optometry undergraduates

This retrospective study was designed to investigate the factors that influence performance in examinations comprised of multiple-choice questions (MCQs), short-answer questions (SAQs), and essay questions in an undergraduate population. Final year optometry degree examination marks were analyzed for two separate cohorts. Direct comparison found that students performed better in MCQs than essays. However, forward stepwise regression analysis of module marks compared with the overall score showed that MCQs were the least influential, and the essay or SAQ mark was a more reliable predictor of overall grade. This has implications for examination design.

Do work placements improve final year academic performance or do high-calibre students choose to do work placements?

This study investigates whether the completion of an optional sandwich work placement enhances student performance in final year examinations. Using Propensity Score Matching, our analysis departs from the literature by controlling for self-selection. Previous studies may have overestimated the impact of sandwich work placements on performance because it might be the case that high-calibre students choose to go on placement. Our results, utilising a large student data set, indicate that self-selection is present, but the effects of a placement on student performance still have an impact. This robust finding is found to be of a remarkably similar magnitude across two UK universities.

Measuring the benefits of a psychology placement year

Placement programmes are considered to provide students with an induction into the work environment and a valuable learning experience. Aston University maintains one of the highest success rates of any UK university for graduate employment and it is thought that the placement year plays a large role in this success. However, the benefits of placements in theoretical subjects like Psychology are often less obvious than those for practical subjects like Optometry or Engineering. Here we compared Psychology students on the 3-year vs. the 4-year sandwich course on a number of attributes using both quantitative and qualitative methodologies. Final year students who had taken a placement year achieved significantly higher marks in their final year (F 1,407=31.52, p<0.001) and were rated more favourably by academic staff on a measure of transferable skills (F1,43= 11.08, p<0.005). In addition, post-graduation, students who had taken a placement year reported a better idea of their career direction and could be argued to be further on in terms of their career progression and pay levels. Qualitatively, focus groups of placement and non-placement students suggested a number of benefits of taking a placement year, including better time management, confidence and responsibility. Whether the benefits of a sandwich placement in a psychology degree outweigh the costs to students and their families, and the need for further research to identify the scope and longevity of possible early career benefits are discussed. © 2006 Taylor & Francis.

Peer mentoring in higher education:a multidimensional approach to conceptualising the role of peer mentoring programmes in enhancing the first year undergraduate experience

Across the literature researchers agree that the concept of mentoring results in positive outcomes for both mentors and mentees alike (Enrich et al, 2004). From a pedagogical perspective, student focused mentoring activities in Higher Education are generally perceived to comprise dyadic or triadic relationships that encapsulate a diverse range of learning strategies and/or support mechanisms. Whilst there exists a significant amount of literature regarding the wider value of Peer Mentoring in Higher Education, there remains a notable gap in knowledge about the value of such programmes in enhancing the first year undergraduate experience and thus promoting a smooth transition to University. Using the emergent study findings of a large international project, a multidimensional conceptual framework bringing together the theoretical, conceptual and contextual determinants of Peer Mentoring is proposed. This framework makes a distinctive contribution to current pedagogical theory and practice – particularly in relation to the first year experience.

The UK MPharm (2) - Do we over assess?

Introduction-The pace of structural change in the UK health economies, the new focus on regulation and the breaking down of professional boundaries means that the Royal Pharmaceutical Society of Great Britain (RPSGB) has to continually review the scope, range and outputs of education provided by schools of pharmacy (SOPs). In SOPs, the focus is on equipping students with the knowledge, skills and attitudes necessary to successfully engage with the pre-registration year. The aim of this study [1] was to map current programmes and undergraduate experiences to inform the RPSGB debate. The specific objectives of this paper are to describe elements of the survey of final year undergraduates, to explore student opinions and experiences of their workload, teaching, learning and assessment. Material and methods-The three main research techniques were: (1) quantitative course document review, (2) qualitative staff interview and (3) quantitative student self completion survey. The questions in the survey were based on findings from exploratory focus group work with BPSA (British Pharmaceutical Students’ Association) members and were designed to ascertain if views expressed in the focus groups on the volume and format of assessments were held by the general student cohort. The student self completion questionnaire consisting of 31 questions, was administered in 2005 to all (n=1847) final year undergraduates, using a pragmatic mixture of methods. The sample was 15 SOPs within the UK (1 SOP opted out). The total response rate was 50.62% (n=935): it varied by SOP from 14.42% to 84.62%. The survey data were analysed (n=741) using SPSS, excluding non-UK students who may have undertaken part of their studies within a non-UK university. Results and discussion • 76% (n=562) respondents considered that the amount of formal assessment was about right, 21% (n=158) thought it was too much. • There was agreement that the MPharm seems to have more assessment than other courses, with 63% (n=463) strongly agreeing or agreeing. • The majority considered the balance between examinations and coursework was about right (67%, n=498), with 27% (n=198) agreeing that the balance was too far weighted towards examinations. • 57% (n=421) agreed that the focus of MPharm assessment was too much towards memorised knowledge, 40% (n=290) that it was about right. • 78% (n= 575) agreed with the statement “Assessments don’t measure the skills for being a pharmacist they just measure your knowledge base”. Only 10% (n=77) disagreed. • Similarly 49% (n=358) disagreed with, and 35% (n=256) were not sure about the statement “I consider that the assessments used in the MPharm course adequately measure the skills necessary to be a pharmacist”. Only 17% (n=124) agreed. Experience from this study shows the difficulty of administering survey instruments through UK Schools of Pharmacy. It is heavily dependent on timing, goodwill and finding the right person. The variability of the response rate between SOPs precluded any detailed analysis by School. Nevertheless, there are some interesting results. Issues raised in the exploratory focus group work about amount of assessment and over reliance on knowledge have been confirmed. There is a real debate to be had about the extent to which the undergraduate course, which must instil scientific knowledge, can provide students with the requisite qualities, skills, attitudes and behaviour that are more easily acquired in the pre-registration year. References [1] Wilson K, Jesson J, Langley C, Clarke L, Hatfield K. MPharm Programmes: Where are we now? Report commissioned by the Pharmacy Practice Research Trust., 2005.

‘Let’s talk about feedback’:an exploration of academic feedback practices in pharmacy education

Feedback is considered one of the most effective mechanisms to aid learning and achievement (Hattie and Timperley, 2007). However, in past UK National Student Surveys, perceptions of academic feedback have been consistently rated lower by final year undergraduate students than other aspects of the student experience (Williams and Kane, 2009). For pharmacy students in particular, Hall and colleagues recently reported that almost a third of students surveyed were dissatisfied with feedback and perceived feedback practice to be inconsistent (Hall et al, 2012). Aims of the Workshop: This workshop has been designed to explore current academic feedback practices in pharmacy education across a variety of settings and cultures as well as to create a toolkit for pharmacy academics to guide their approach to feedback. Learning Objectives: 1. Discuss and characterise academic feedback practices provided by pharmacy academics to pharmacy students in a variety of settings and cultures. 2. Develop academic feedback strategies for a variety of scenarios. 3. Evaluate and categorise feedback strategies with use of a feedback matrix. Description of Workshop Activities: Introduction to workshop and feedback on pre-reading exercise (5 minutes). Activity 1: A short presentation on theoretical models of academic feedback. Evidence of feedback in pharmacy education (10 minutes). Activity 2: Discussion of feedback approaches in participants’ organisations for differing educational modalities. Consideration of the following factors will be undertaken: experiential v. theoretical education, formative v. summative assessment, form of assessment and the effect of culture (20 minutes, large group discussion). Activity 3: Introduction of a feedback matrix (5 minutes). Activity 4: Development of an academic feedback toolkit for pharmacy education. Participants will be divided into 4 groups and will discuss how to provide effective feedback for 2 scenarios. Feedback strategies will be categorised with the feedback matrix. Results will be presented back to the workshop group (20 minutes, small group discussion, 20 minutes, large group presentation). Summary (10 minutes). Additional Information: Pre-reading: Participants will be provided with a list of definitions for academic feedback and will be asked to rank the definitions in order of perceived relevance to pharmacy education. References Archer, J. C. (2010). State of the science in health professional education: effective feedback. Medical education, 44(1), 101-108. Hall, M., Hanna, L. A., & Quinn, S. (2012). Pharmacy Students’ Views of Faculty Feedback on Academic Performance. American journal of pharmaceutical education, 76(1). Hattie, J., & Timperley, H. (2007). The power of feedback. Review of educational research, 77(1), 81-112. Medina, M. S. (2007). Providing feedback to enhance pharmacy students’ performance. American Journal of Health-System Pharmacy, 64(24), 2542-2545.

Do gender and year of study affect the ability of the theory of planned behaviour to predict binge-drinking intentions and episodes?

Background: The present study tested the utility of the theory of planned behaviour (TPB), augmented with anticipated regret, as a model to predict binge-drinking intentions and episodes among female and male undergraduates and undergraduates in different years of study. Method: Undergraduate students (N = 180, 54 males, 126 females, 60 per year of study) completed baseline measures of demographic variables, binge-drinking episodes (BDE), TPB constructs and anticipated regret. BDE were assessed one-week later. Results: The TPB accounted for 60% of the variance in female undergraduates' intentions and 54% of the variance in male undergraduates' intentions. The TPB accounted for 57% of the variance in intentions in first-year undergraduates, 63% of the variance in intentions in second-year undergraduates and 68% of the variance in intentions in final-year undergraduates. Follow-up BDE was predicted by intentions and baseline BDE for female undergraduates as well as second- and final-year undergraduates. Baseline BDE predicted male undergraduates’ follow-up BDE and first-year undergraduates’ follow-up BDE. Conclusion: Results show that while the TPB constructs predict undergraduates’ binge-drinking intentions, intentions only predict BDE in female undergraduates, second- and final-year undergraduates. Implications of these findings for interventions to reduce binge drinking are outlined.

What purpose does the MPharm research project serve?

In 2004, the Royal Pharmaceutical Society of Great Britain (RPSGB) funded research on teaching, learning and assessment within the UK undergraduate pharmacy degree (MPharm), including the compulsory final year project. Documentary analysis showed that all schools met the project requirement, although there were wide variations in the relative contribution of the project to the final year mark and the degree classification. Interviews with staff revealed that organisation of research projects was complex and time consuming and exacerbated by increasing student numbers and the impact of research ethics. 61% of students, surveyed via a self-completion questionnaire (response rate 50.6%) perceived the research project to be very or fairly important. Whilst 47% considered that they had enough choice of topic and 37% said that their training in research methods provided a good foundation for their project, this suggests scope for improvement. In the UK, there are legislative changes impending which may provide an opportunity to review the future purpose and feasibility of a "significant" final year project within the MPharm.

Mapping teaching, learning and assessment in the MPharm in UK schools of pharmacy

Aim To undertake a national study of teaching, learning and assessment in UK schools of pharmacy. Design Triangulation of course documentation, 24 semi-structured interviews undertaken with 29 representatives from the schools and a survey of all final year students (n=1,847) in the 15 schools within the UK during 2003–04. Subjects and setting All established UK pharmacy schools and final year MPharm students. Outcome measures Data were combined and analysed under the topics of curriculum, teaching and learning, assessment, multi-professional teaching and learning, placement education and research projects. Results Professional accreditation was the main driver for curriculum design but links to preregistration training were poor. Curricula were consistent but offered little student choice. On average half the curriculum was science-based. Staff supported the science content but students less so. Courses were didactic but schools were experimenting with new methods of learning. Examinations were the principal form of assessment but the contribution of practice to the final degree ranged considerably (21–63%). Most students considered the assessment load to be about right but with too much emphasis upon knowledge. Assessment of professional competence was focused upon dispensing and pharmacy law. All schools undertook placement teaching in hospitals but there was little in community/primary care. There was little inter-professional education. Resources and logistics were the major limiters. Conclusions There is a need for an integrated review of the accreditation process for the MPharm and preregistration training and redefinition of professional competence at an undergraduate level.

Do pharmacy graduates possess the necessary professional skills?

Background - Expansion of the pharmacists' role within the United Kingdom has raised the question as to whether pharmacy graduates are equipped with the professional skills and attributes they will need to fulfil such roles. Aim - To describe the professional skills and attributes pre-registration recruiters perceive pharmacy graduates should exhibit and to establish whether final year students perceive they possess these skills and attributes. Method - Five individuals were interviewed from a variety of pre-registration employers; 90 final year students completed a questionnaire (response 69.2%). Results - The recruiters thought that whilst graduates possess sufficient knowledge, they show weaknesses such as inability to apply theoretical knowledge into practice and the lack of good communication and interpersonal skills. Conversely, a majority of students felt that they did possess the necessary skills to enter pre-registration training. Conclusion - Schools of pharmacy need to ensure that students have an opportunity to develop key professional skills to assist students in securing pre-registration positions. © 2010 FIP.

Learning with other health professions in the United Kingdom MPharm degree:Multidisciplinary and placement education

This paper reviews the approach to multidisciplinary and placement education in UK schools of pharmacy. The methodology involved triangulation of course documentation, staff interviews and a final year student survey. Staff members were supportive of multidisciplinary learning. The advantages were development of a wider appreciation of the students? future professional role and better understanding of the roles of other professional groups. The barriers were logistics (student numbers; multiple sites; different timetables), the achievement of balanced numbers between disciplines and engagement of students from all participating disciplines. Placement education was offered by all schools, predominantly in hospital settings. Key problems were funding and the lack of staff resources. Currently, multidisciplinary learning within the UK for pharmacy students is inadequate and is coupled with relatively low levels of placement education. In order for things to change, there should be a review of funding and support from government and the private sector employers.

Professionalisation and ophthalmic optics

This thesis is a sociological study of the ophthalmic optical profession in Britain. It includes a survey of the development of ophthalmic optics as an occupation and three questionnaire, surveys, one each of first and final year ophthalmic optics students, and one of practising opticians. The developmental survey showed that four themes have been important in the occupation's process of professionalisation - the actions of the opticians' leaders, the gradual unification of the bodies, representing segments of the profession, the struggle with medicine and the involvement of ophthalmic opticians in state-organised optical welfare schemes. The student surveys showed that the profession is now recruiting largely from middle class, state educated groups, and increasingly from women, who hold significantly different attitudes to income, independence and career commitment. In general, both first and final year students considered service to be rather more important than furthering knowledge. Practising opticians have been recruited increasingly, from middle class backgrounds, mostly from state selective secondary schools, but with a large minority from non-state schools. The self-recruitment rate of the profession (18.9%) is very similar to that for British medical students. Significant differences in concepts of professionalism were found among ophthalmic opticians of different ages, sexes and types of practice but few among those in different areas of practice. In general, ophthalmic opticians seemed to stress service more·than furthering knowledge. It is suggested that the leaders of the profession have 'negotiated' considerable autonomy for its members and that the possibilities for commercialism within the ophthalmic optician's professional role are intrinsically no greater than those in more 'established' professions.

The experiences of South Asian university students in the British education system and in their search for work

This research aimed to provide a comparative analysis of South Asian and White British students in their academic attainment at school and university and in their search for employment. Data were gathered by using a variety of methodological techniques. Completed postal questionnaires were received from 301 South Asian and White British undergraduates from 12 British universities, who were in their final year of study in 1985. In depth interviews were also conducted with 49 graduates who were a self selected group from the original sample. Additional information was also collected by using diary report forms and by administering a second postal questionnaire to selected South Asian and White British participants. It was found that while the pre-university qualifications of the White British and South Asian undergraduates did not differ considerably, many members in the latter group had travelled a more arduous path to academic success. For some South Asians, school experiences included the confrontation of racist attitudes and behaviour, both from teachers and peers. The South Asian respondents in this study were more likely than their White British counterparts, to have attempted some C.S.E. examinations, obtained some of their `O' levels in the Sixth Form and retaken their `A' levels. As a result the South Asians were on average older than their White British peers when entering university. A small sample of South Asians also found that the effects of racism were perpetuated in higher education where they faced difficulty both academically and socially. Overall, however, since going to university most South Asians felt further drawn towards their `cultural background', this often being their own unique view of `Asianess'. Regarding their plans after graduation, it was found that South Asians were more likely to opt for further study, believing that they needed to be better qualified than their White British counterparts. For those South Asians who were searching for work, it was noted that they were better qualified, willing to accept a lower minimum salary, had made more job applications and had started searching for work earlier than the comparable White British participants. Also, although generally they were not having difficulty in obtaining interviews, South Asian applicants were less likely to receive an offer of employment. In the final analysis examining their future plans, it was found that a large proportion of South Asian graduates were aspiring towards self employment.

Problem solving in architectural design

This thesis is presented in two parts. The first part is an attempt to set out a framework of factors influencing the problem solving stage of the architectural design process. The discussion covers the nature of architectural problems and some of the main ways in which they differ from other types of design problems. The structure of constraints that both the problem and the architect impose upon solutions are seen as of great importance in defining the type of design problem solving situation. The problem solver, or architect, is then studied. The literature of the psychology of thinking is surveyed for relevant work . All of the traditional schools of psychology are found wanting in terms of providing a comprehensive theory of thinking. Various types of thinking are examined, particularly structural and productive thought, for their relevance to design problem solving. Finally some reported common traits of architects are briefly reviewed. The second section is a report of u~o main experiments which model some aspects of architectural design problem solving. The first experiment examines the way in which architects come to understand the structure of their problems. The performances of first and final year architectural students are compared with those of postgraduate science students and sixth form pupils. On the whole these groups show significantly different results and also different cognitive strategies. The second experiment poses design problems which involve both subjective and objective criteria, and examines the way in which final year architectural students are able to relate the different types of constraint produced. In the final section the significance of all the results is suggested. Some educational and methodological implications are discussed and some further experiments and investigations are proposed.