Establishing the validity of English GP Patient Survey items evaluating out-of-hours care

Background A 2014 national audit used the English General Practice Patient Survey (GPPS) to compare service users’ experience of out-of-hours general practitioner (GP) services, yet there is no published evidence on the validity of these GPPS items. Objectives Establish the construct and concurrent validity of GPPS items evaluating service users’ experience of GP out-of-hours care. Methods Cross-sectional postal survey of service users (n=1396) of six English out-of-hours providers. Participants reported on four GPPS items evaluating out-of-hours care (three items modified following cognitive interviews with service users), and 14 evaluative items from the Out-of-hours Patient Questionnaire (OPQ). Construct validity was assessed through correlations between any reliable (Cochran's α>0.7) scales, as suggested by a principal component analysis of the modified GPPS items, with the ‘entry access’ (four items) and ‘consultation satisfaction’ (10 items) OPQ subscales. Concurrent validity was determined by investigating whether each modified GPPS item was associated with thematically related items from the OPQ using linear regressions. Results The modified GPPS item-set formed a single scale (α=0.77), which summarised the two-component structure of the OPQ moderately well; explaining 39.7% of variation in the ‘entry access’ scores (r=0.63) and 44.0% of variation in the ‘consultation satisfaction’ scores (r=0.66), demonstrating acceptable construct validity. Concurrent validity was verified as each modified GPPS item was highly associated with a distinct set of related items from the OPQ. Conclusions Minor modifications are required for the English GPPS items evaluating out-of-hours care to improve comprehension by service users. A modified question set was demonstrated to comprise a valid measure of service users’ overall satisfaction with out-of-hours care received. This demonstrates the potential for the use of as few as four items in benchmarking providers and assisting services in identifying, implementing and assessing quality improvement initiatives.

The use of patient experience survey data by out-of-hours primary care services: a qualitative interview study

Background English National Quality Requirements mandate out-of-hours primary care services to routinely audit patient experience, but do not state how it should be done.

Objectives We explored how providers collect patient feedback data and use it to inform service provision. We also explored staff views on the utility of out-of-hours questions from the English General Practice Patient Survey (GPPS).

Methods A qualitative study was conducted with 31 staff (comprising service managers, general practitioners and administrators) from 11 out-of-hours primary care providers in England, UK. Staff responsible for patient experience audits within their service were sampled and data collected via face-to-face semistructured interviews.

Results Although most providers regularly audited their patients’ experiences by using patient surveys, many participants expressed a strong preference for additional qualitative feedback. Staff provided examples of small changes to service delivery resulting from patient feedback, but service-wide changes were not instigated. Perceptions that patients lacked sufficient understanding of the urgent care system in which out-of-hours primary care services operate were common and a barrier to using feedback to enable change. Participants recognised the value of using patient experience feedback to benchmark services, but perceived weaknesses in the out-of-hours items from the GPPS led them to question the validity of using these data for benchmarking in its current form.

Conclusions The lack of clarity around how out-of-hours providers should audit patient experience hinders the utility of the National Quality Requirements. Although surveys were common, patient feedback data had only a limited role in service change. Data derived from the GPPS may be used to benchmark service providers, but refinement of the out-of-hours items is needed.

Pre-Radiotherapy Dental Assessment of Head and Neck Oncology Patients: An Audit.

Objectives: Approximately 300 people are diagnosed with Head and Neck cancer annually in Northern Ireland. The management may include treatment by surgery or by chemotherapy and radiotherapy,
or a combination of modalities. Patients whose oral cavity, teeth, salivary glands and jaws that
will be affected by treatment, particularly radiotherapy should have a pre-treatment assessment. This should be done as early as possible to maximise the time available for dental management. However, this can be challenging owing to the complexities of cancer diagnosis, treatment planning and multidisciplinary management. At the Belfast Dental Hospital, a number of patients were referred post- radiotherapy with complications after not having received a pre-treatment assessment. The referrals for pre- treatment dental assessment were also late in patients’ multidisciplinary journey, limiting the time period
for dental input. The purpose of this audit was to examine the time period between dental assessment and commencement of radiotherapy and whether this was an adequate time frame for dental management. This audit will also examine the dental diseases present and the treatments required pre-radiotherapy. Methods: Data for this audit was collected over 4 months in 2012
by analysing the dental charts and referrals of new patients who were referred to and attended the dental head and neck oncology clinic. A standardised referral pro-forma was introduced from September 2013 to improve the referral process.
A re-audit was conducted over 4 months in 2014. Data was collected similarly as previous. The time period between dental assessment and commencement of radiotherapy was examined. The presence of dental disease and subsequent treatments required were also noted.
Results: 63 new patients were examined in the dental head and neck oncology clinic over 4 months in 2012. 48 (76.2%) were examined pre-radiotherapy. The average length of time between dental assessment and radiotherapy commencement was 11 days. A new standardised referral pro-forma was introduced in 2013. In the re-audit, 65 new patients were seen over 4 months in 2014.
60 (92.3%) patients were examined pre-radiotherapy. The average length of time between dental assessment and radiotherapy commencement was 18 days.
Conclusion: Given the high prevalence of pre-existing dental disease amongst head and neck cancer patients, prompt dental assessment and treatment is vital. Efforts aimed at improving the care pathway are on-going through the implementation of a mandatory referral pro-forma and a dedicated assessment clinic.

Tooth replacement for partially dentate elders: a willingness-to-pay analysis

Objectives: The primary aim of this study was to investigate partially dentate elders’ willingness-to-pay (WTP) for two different tooth replacement strategies: using Removable Partial Dentures (RPDs) and, functionally orientated treatment (SDA). The secondary aim was to measure the same patient group’s WTP for dental implants. Methods: Patients who had completed a previous RCT comparing two tooth replacement strategies (RPDs and SDA) were recruited. 59 patients were asked to indicate their WTP for treatment to replace missing teeth in a number of hypothetical scenarios using the payment card method of contingency evaluation coupled to different costs. Data were collected on patients’ social class, longest held occupation, income levels and social circumstances. Results: The median age for the patient sample was 72.0 years (IQR: 71-75 years). Patients who had previously been provided with RPDs indicated that their WTP for this treatment strategy was significantly higher than those patients who had received SDA treatment (Mann-Whitney U Test: p<0.001). This group were also WTP a higher price for SDA treatment than those patients who had previously been treated according to this modality (Mann-Whitney U Test: p=0.005). The results indicated that patients’ age was not correlated with WTP but both social class and current income levels were significantly correlated (Spearman’s rank correlation: p<0.05). Patients in both treatment groups exhibited llittle WTP for dental implant treatment with a median price recorded which was lower than either RPD or SDA treatment. Conclusions: Amongst this patient cohort previous treatment experience had a strong influence on WTP as did social class and current income levels. The patients’ WTP indicated that they did not value dental implants over simpler forms of tooth replacement such as RPDs or a SDA approach.

Managing patient deterioration: evaluation of what works.

Background: Rapid Response Systems (RRS) have been implemented nationally and internationally to improve patient safety in hospital. However, to date the majority of the RRS research evidence has focused on measuring the effectiveness of the intervention on patient outcomes. To evaluate RRS it has been recommended that a multimodal approach is required to address the broad range of process and outcome measures required to determine the effectiveness of the RRS concept. Aim: The aim of this paper is to evaluate the official RRS programme theoretical assumptions regarding how the programme is meant to work against actual practice in order to determine what works. Methods: The research design was a multiple case study approach of four wards in two hospitals in Northern Ireland. It followed the principles of realist evaluation research which allowed empirical data to be gathered to test and refine RRS programme theory [1]. This approach used a variety of mixed methods to test the programme theories including individual and focus group interviews with a purposive sample of 75 nurses and doctors, observation of ward practices and documentary analysis. The findings from the case studies were analysed and compared within and across cases to identify what works for whom and in what circumstances. Results: The RRS programme theories were critically evaluated and compared with study findings to develop a mid-range theory to explain what works, for whom in what circumstances. The findings of what works suggests that clinical experience, established working relationships, flexible implementation of protocols, ongoing experiential learning, empowerment and pre-emptive management are key to the success of RRS implementation.  Conclusion:These findings highlight the combination of factors that can improve the implementation of RRS and in light of this evidence several recommendations are made to provide policymakers with guidance and direction for their success and sustainability.References: 1.Pawson R and Tilley N. (1997) Realistic Evaluation. Sage Publications; LondonType of submission: Concurrent session Source of funding: Sandra Ryan Fellowship funded by the School of Nursing & Midwifery, Queen’s University of Belfast

Comparison of Composite Placement Techniques by Recently Qualified Dental Practitioners.

Objectives: To evaluate the placement of composite materials by new graduates using three alternative placement techniques.Methods: A cohort of 34 recently qualified graduates were asked to restore class II interproximal cavities in plastic teeth using three different techniques.

(i) A conventional incremental filling technique (Herculite XRV) using increments no larger than 2-mm with an initial layer on the cervical floor of the box of 1-mm.
(ii) Flowable bulk fill technique (Dentsply SDR) bulk fill placement in a 3-mm layer followed by an incremental fill of a microhybrid resin
(iii) Bulk fill (Kerr Sonicfill) which involved restorations placed in a 5-mm layer.

The operators were instructed in each technique, didactically and with a hands-on demonstration, prior to restoration placement.
All restorations were cured according to manufacturer’s recommendations. Each participant restored 3 teeth, 1 tooth per treatment technique.
The restorations were evaluated using modified USPHS criteria to assess both the marginal adaptation and the surface texture of the restorations. Blind evaluations were carried out independently by two examiners with the aid of magnification (loupes X2.5). Examiners were standardized prior to evaluation.
Results: Gaps between the tooth margins and the restoration or between the layers of the restoration were found in 13 of Group (i), 3 of Group (ii), and 4 of Group (iii)
Statistical analysis revealed a significant difference between the incrementally filled group (i) and the flowable bulk-fill group (ii) (p=0.0043) and between the incrementally filled (i) and the bulk fill groups (iii) (p=0.012) and no statistical difference (p=0.69) between the bulk filled groups Conclusions: Bulk fill techniques may result in a more satisfactory seal of the cavity margins when restoring with composite.

Delivering a Research-Enabled Multistakeholder Partnership for Enhanced Patient Care at a Population Level: The Northern Ireland Comprehensive Cancer Program

The last 20 years have seen significant advances in cancer care in Northern Ireland, leading to measureable improvements in patient outcomes. Crucial to this transformation has been an ethos that recognizes the primacy role of research in effecting heath care change. The authors' model of a cross-sectoral partnership that unites patients, scientists, health care professionals, hospital trusts, bioindustry, and government agencies can be truly transformative, empowering tripartite clinical-academic-industry efforts that have already yielded significant benefit and will continue to inform strategy and its implementation going forward.

Impact of Referral Protocols on the Dental Management of Patients Undergoing Treatment for Head and Neck Oncology in Northern Ireland

Objective: To evaluate the handling, by a group of practice-based researchers, of a recently introduced bulk fill resin-based composite restorative material, Filtek Bulk Fill Restorative (3M ESPE).

Methods: The twelve selected evaluators were sent explanatory letters, a pack of the material under investigation to use for 8 weeks, and a questionnaire.

Results: The evaluators rated the ease of use of the bulk fill restorative the same as the previously used posterior composite material. The provision of one shade only for evaluation may have compromised the score for aesthetic quality. No post-operative sensitivity was reported.

Conclusions: The bulk fill material was well received as indicated by the high number of evaluators who would both purchase the material and recommend it to colleagues.

Clinical relevance: A recently introduced bulk fill restorative material achieved a rating for handling which was similar to the evaluators’ previously used resin composite, although there were some concerns regarding the translucency of the material.

Oral Health Status of Patients Undergoing Treatment for Head and Neck Oncology in Northern Ireland

This study aimed to collect data on the oral health status of patients undergoing treatment for head and neck oncology across Northern Ireland. Data were collected on all patients referred to the Northern Ireland Multidisciplinary Head and Neck Oncology Team for discussion and treatment planning. Each patient underwent pre-treatment dental assessment in the Centre for Dentistry, Queen’s University Belfast, between June 2013 and November 2014. Data were collected from clinical oral examinations supplemented with intra-oral radiographs. During the course of the study 96 patients were assessed and the levels of dental disease observed in this cohort were high. On clinical examination
43% were diagnosed with caries and 46% with periodontal disease. Ten patients were completely edentate. The disease profile of this patient group presents significant challenges to dental services tasked with rendering patients dentally fit prior to undergoing oncology treatment.