To what extent does the Health Professions Admission Test-Ireland predict performance in early undergraduate tests of communication and clinical skills? – An observational cohort study

Background: Internationally, tests of general mental ability are used in the selection of medical students. Examples include the Medical College Admission Test, Undergraduate Medicine and Health Sciences Admission Test and the UK Clinical Aptitude Test. The most widely used measure of their efficacy is predictive validity.A new tool, the Health Professions Admission Test- Ireland (HPAT-Ireland), was introduced in 2009. Traditionally, selection to Irish undergraduate medical schools relied on academic achievement. Since 2009, Irish and EU applicants are selected on a combination of their secondary school academic record (measured predominately by the Leaving Certificate Examination) and HPAT-Ireland score. This is the first study to report on the predictive validity of the HPAT-Ireland for early undergraduate assessments of communication and clinical skills. Method. Students enrolled at two Irish medical schools in 2009 were followed up for two years. Data collected were gender, HPAT-Ireland total and subsection scores; Leaving Certificate Examination plus HPAT-Ireland combined score, Year 1 Objective Structured Clinical Examination (OSCE) scores (Total score, communication and clinical subtest scores), Year 1 Multiple Choice Questions and Year 2 OSCE and subset scores. We report descriptive statistics, Pearson correlation coefficients and Multiple linear regression models. Results: Data were available for 312 students. In Year 1 none of the selection criteria were significantly related to student OSCE performance. The Leaving Certificate Examination and Leaving Certificate plus HPAT-Ireland combined scores correlated with MCQ marks.In Year 2 a series of significant correlations emerged between the HPAT-Ireland and subsections thereof with OSCE Communication Z-scores; OSCE Clinical Z-scores; and Total OSCE Z-scores. However on multiple regression only the relationship between Total OSCE Score and the Total HPAT-Ireland score remained significant; albeit the predictive power was modest. Conclusion: We found that none of our selection criteria strongly predict clinical and communication skills. The HPAT- Ireland appears to measures ability in domains different to those assessed by the Leaving Certificate Examination. While some significant associations did emerge in Year 2 between HPAT Ireland and total OSCE scores further evaluation is required to establish if this pattern continues during the senior years of the medical course.

Economic evaluations of clinical pharmacy services in Ireland, 2007-2015

Introduction The concept of this thesis was driven by stagnation within the Irish healthcare system. Multiple reports from pharmacy organisations had outlined possible future directions for the profession but progress was minimal, especially in comparison with other countries. The author’s directive was to evaluate the economic impact of a series of clinical pharmacy services (CPS) in hospital and community settings. Methods A systematic review of economic evaluations of clinical pharmacy services in hospital patients was undertaken to gain insight into recent research in the field. Eligible studies were evaluated using the Consolidated Health Economic Evaluation Reporting Standards (CHEERS), to establish the quality, consistency and transparency of relevant research. A retrospective analysis of an internal hospital pharmacy interventions database was conducted. A method first described by Nesbit et al. was implemented to estimate the level of cost avoidance achieved. A cost-effectiveness analysis based on data from a randomised controlled trial of a pharmacist-supervised patient self-testing (PST) of warfarin therapy is presented. Outcome measure was the incremental cost associated with six months of intervention management. A similar cost-effectiveness analysis based on previously published RCT data was used to evaluate a novel structured pharmacist review of medication in older hospitalised patients. Cost-effectiveness analysis was presented in the form of an incremental cost-effectiveness ratio (ICER). An ICER is an additional cost per unit effect, in the case of this study, the cost of preventing an additional non-trivial ADR in hospital. A method described by Preaud et al. was adapted to estimate the clinical and economic benefit gained from vaccination of patients by a community pharmacist in Ireland in 2013/14. Sample demographic data was obtained from a national chain of community pharmacies and applied to overall national vaccination data. Results Systematic review identified twenty studies which were eligible for inclusion. Overall, pharmacist interventions had a positive impact on hospital budgets. Only three studies (15%) were deemed to be “good-quality” studies. No ‘novel’ clinical pharmacist intervention was identified during the course of this review. Analysis of internal hospital database identified 4,257 interventions documented on 2,147 individual patients over a 12 month period. Substantial cost avoidance of €710,000 was generated over a 1 year period from the perspective of the health care provider. Mean cost avoidance of €166 per intervention was generated. The cost of providing these interventions was €82,000. Substantial net cost-benefits of €626,279 and a cost-benefit ratio of 8.64 : 1 were generated based on this evaluation of pharmacist interventions. Results from an evaluation of a novel pharmacist-led form of warfarin management indicated indicated that on a per patient basis, PST was slightly more expensive than established anticoagulant management. On a per patient basis over a six month period, PST resulted in an incremental cost of €59.08 in comparison with routine care. Overall cost of managing a patient through pharmacist-supervised PST for a six month period is €226.45. However, for this increase in cost a clinically significant improvement in care was provided. Patients achieved a significantly higher time in therapeutic range during the PST arm in comparison with routine care, (72 ± 19.7% vs 59 ± 13.5%). Difference in overall cost was minimal and PST was the dominant strategy in some scenarios examined during sensitivity analysis. Structured pharmacist review of medication was determined to be dominant in comparison to usual pharmaceutical care. Even if the healthcare payer was unwilling to pay any money for the prevention of an ADR, the intervention strategy is still likely to be cost-effective (probability of being determined cost-effective = 0.707). Implementation of pharmacist-led influenza vaccination has resulted in substantial clinical and economic benefits to the healthcare system. The majority of patients (64.9%) who availed of this service had identifiable influenza-related risk factors. Of patients with influenza-related risk factors, age ≥65 year was the most commonly cited risk factor. Pharmacist vaccination services averted a total of 848 influenza cases across all age groups during the 2013/2014 influenza season. Due to receipt of vaccination in a pharmacy setting, 444 influenza-related GP visits were prevented. In terms of more serious influenza-associated events, 11 hospitalisations and five influenza-related deaths were averted. Costs averted were approximately €305,000. These were principally wider societal-related costs associated with lost productivity. Conclusion Overall, clinical pharmacy services are adding value to the Irish healthcare system in both hospital and community settings, but provision of additional funding for new services would enable them to offer a great deal more.