To what extent does the Health Professions Admission Test-Ireland predict performance in early undergraduate tests of communication and clinical skills? – An observational cohort study

Background: Internationally, tests of general mental ability are used in the selection of medical students. Examples include the Medical College Admission Test, Undergraduate Medicine and Health Sciences Admission Test and the UK Clinical Aptitude Test. The most widely used measure of their efficacy is predictive validity.A new tool, the Health Professions Admission Test- Ireland (HPAT-Ireland), was introduced in 2009. Traditionally, selection to Irish undergraduate medical schools relied on academic achievement. Since 2009, Irish and EU applicants are selected on a combination of their secondary school academic record (measured predominately by the Leaving Certificate Examination) and HPAT-Ireland score. This is the first study to report on the predictive validity of the HPAT-Ireland for early undergraduate assessments of communication and clinical skills. Method. Students enrolled at two Irish medical schools in 2009 were followed up for two years. Data collected were gender, HPAT-Ireland total and subsection scores; Leaving Certificate Examination plus HPAT-Ireland combined score, Year 1 Objective Structured Clinical Examination (OSCE) scores (Total score, communication and clinical subtest scores), Year 1 Multiple Choice Questions and Year 2 OSCE and subset scores. We report descriptive statistics, Pearson correlation coefficients and Multiple linear regression models. Results: Data were available for 312 students. In Year 1 none of the selection criteria were significantly related to student OSCE performance. The Leaving Certificate Examination and Leaving Certificate plus HPAT-Ireland combined scores correlated with MCQ marks.In Year 2 a series of significant correlations emerged between the HPAT-Ireland and subsections thereof with OSCE Communication Z-scores; OSCE Clinical Z-scores; and Total OSCE Z-scores. However on multiple regression only the relationship between Total OSCE Score and the Total HPAT-Ireland score remained significant; albeit the predictive power was modest. Conclusion: We found that none of our selection criteria strongly predict clinical and communication skills. The HPAT- Ireland appears to measures ability in domains different to those assessed by the Leaving Certificate Examination. While some significant associations did emerge in Year 2 between HPAT Ireland and total OSCE scores further evaluation is required to establish if this pattern continues during the senior years of the medical course.

Using parent report to assess bilingual vocabulary acquisition: a model from Irish

This chapter describes the adaptation of a parent report instrument on early language development to a bilingual context. Beginning with general issues of adapting tests to any language, particular attention is placed on the issue of using parents as evaluators of child language acquisition of a minority language in a bilingual context. In Ireland, Irish is the first official language and is spoken by about 65,000 people on a daily basis. However all Irish speakers are bilingual, and children are exposed to the dominant English language at an early age. Using an adaptation of a parent report instrument, 21 typically developing children between 16 and 40 months were assessed repeatedly over two years to monitor their language development. The form allowed parents to document their children’s vocabulary development in both languages. Results showed that when knowledge of both languages was accounted for, the children acquired vocabulary at rates similar to those of monolingual speakers and used translational equivalents relatively early in language development. The study also showed that parents of bilingual children could accurately identify and differentiate language development in both of the child’s languages. Recommendations for adapting and using parent report instruments in bilingual language acquisition contexts are outlined.