European Law and New Health Technologies ESRC End of Award Report, RES-451-26-0764

End of award report for the funded research seminar series of the same name.

How standardised patients award global scores in OSCEs: a qualitative study

Standardized patients (SPs) are often asked to award global scores on the humanistic aspects of a candidate’s performance in an OSCE. However, little is known about the process by which SPs arrive at their mark.
Five focus groups of SPs, using a convenience sample, were used to collect data until saturation. Thematic analysis was carried out independently by three researchers using a grounded theory approach.

Four major themes contributed to their decision-making process: environment, relationships within the exam, preparedness for the task and expectations of the student’s performance. Environmental factors included the station itself, the rating scale and examiner fatigue. Relationship factors included first impressions, the sense of purpose derived from examining and a tendency to mirror the examiner’s reaction. Factors relating to preparedness for task involved experience as an SP and technical aspects, such as the need for calibration. Lastly, expectations of performance were related to preconceptions about what makes a ‘good’ student, including their level of studies, appearance and technical performance.

In assessing students, SPs drew on their wider attitudes and experiences. SPs did not limit their assessment to humanistic traits but often included technical performance. Thus, SPs to some extent assessed a similar construct to examiners and this may help to explain the increased reliability associated with using SP scores. SP global scores are a useful adjunct but the process by which SPs award marks is complex and provides a challenge for training and standardisation.

House in Bogwest, Steve Larkin Architects:Award

2012 AAI Awards Publication by Gandon Editions. Award winning House in Bogwest by Steve Larkin Architects. Includes text by Steve Larkin Architects, Peer Review text by AAI awards 2012 international jury of Architects including Joseph Rykwert, Keith Williams, Noel Brady, Michael McGarry and Ruairí Ó Cuív, Drawings by Steve Larkin and Photographs by Alice Clancy.

A lesson in business: cost-effectiveness analysis of a novel financial incentive intervention for increasing physical activity in the workplace

Background: Recently both the UK and US governments have advocated the use of financial incentives to encourage healthier lifestyle choices but evidence for the cost-effectiveness of such interventions is lacking. Our aim was to perform a cost-effectiveness analysis (CEA) of a quasi-experimental trial, exploring the use of financial incentives to increase employee physical activity levels, from a healthcare and employer’s perspective.

Methods: Employees used a ‘loyalty card’ to objectively monitor their physical activity at work over 12 weeks. The Incentive Group (n=199) collected points and received rewards for minutes of physical activity completed. The No Incentive Group (n=207) self-monitored their physical activity only. Quality of life (QOL) and absenteeism were assessed at baseline and 6 months follow-up. QOL scores were also converted into productivity estimates using a validated algorithm. The additional costs of the Incentive Group were divided by the additional quality adjusted life years (QALYs) or productivity gained to calculate incremental cost effectiveness ratios (ICERs). Cost-effectiveness acceptability curves (CEACs) and population expected value of perfect information (EVPI) was used to characterize and value the uncertainty in our estimates.

Results: The Incentive Group performed more physical activity over 12 weeks and by 6 months had achieved greater gains in QOL and productivity, although these mean differences were not statistically significant. The ICERs were £2,900/QALY and £2,700 per percentage increase in overall employee productivity. Whilst the confidence intervals surrounding these ICERs were wide, CEACs showed a high chance of the intervention being cost-effective at low willingness-to-pay (WTP) thresholds.

Conclusions: The Physical Activity Loyalty card (PAL) scheme is potentially cost-effective from both a healthcare and employer’s perspective but further research is warranted to reduce uncertainty in our results. It is based on a sustainable “business model” which should become more cost-effective as it is delivered to more participants and can be adapted to suit other health behaviors and settings. This comes at a time when both UK and US governments are encouraging business involvement in tackling public health challenges.