Establishing the validity of English GP Patient Survey items evaluating out-of-hours care

Background A 2014 national audit used the English General Practice Patient Survey (GPPS) to compare service users’ experience of out-of-hours general practitioner (GP) services, yet there is no published evidence on the validity of these GPPS items. Objectives Establish the construct and concurrent validity of GPPS items evaluating service users’ experience of GP out-of-hours care. Methods Cross-sectional postal survey of service users (n=1396) of six English out-of-hours providers. Participants reported on four GPPS items evaluating out-of-hours care (three items modified following cognitive interviews with service users), and 14 evaluative items from the Out-of-hours Patient Questionnaire (OPQ). Construct validity was assessed through correlations between any reliable (Cochran's α>0.7) scales, as suggested by a principal component analysis of the modified GPPS items, with the ‘entry access’ (four items) and ‘consultation satisfaction’ (10 items) OPQ subscales. Concurrent validity was determined by investigating whether each modified GPPS item was associated with thematically related items from the OPQ using linear regressions. Results The modified GPPS item-set formed a single scale (α=0.77), which summarised the two-component structure of the OPQ moderately well; explaining 39.7% of variation in the ‘entry access’ scores (r=0.63) and 44.0% of variation in the ‘consultation satisfaction’ scores (r=0.66), demonstrating acceptable construct validity. Concurrent validity was verified as each modified GPPS item was highly associated with a distinct set of related items from the OPQ. Conclusions Minor modifications are required for the English GPPS items evaluating out-of-hours care to improve comprehension by service users. A modified question set was demonstrated to comprise a valid measure of service users’ overall satisfaction with out-of-hours care received. This demonstrates the potential for the use of as few as four items in benchmarking providers and assisting services in identifying, implementing and assessing quality improvement initiatives.

The use of patient experience survey data by out-of-hours primary care services: a qualitative interview study

Background English National Quality Requirements mandate out-of-hours primary care services to routinely audit patient experience, but do not state how it should be done.

Objectives We explored how providers collect patient feedback data and use it to inform service provision. We also explored staff views on the utility of out-of-hours questions from the English General Practice Patient Survey (GPPS).

Methods A qualitative study was conducted with 31 staff (comprising service managers, general practitioners and administrators) from 11 out-of-hours primary care providers in England, UK. Staff responsible for patient experience audits within their service were sampled and data collected via face-to-face semistructured interviews.

Results Although most providers regularly audited their patients’ experiences by using patient surveys, many participants expressed a strong preference for additional qualitative feedback. Staff provided examples of small changes to service delivery resulting from patient feedback, but service-wide changes were not instigated. Perceptions that patients lacked sufficient understanding of the urgent care system in which out-of-hours primary care services operate were common and a barrier to using feedback to enable change. Participants recognised the value of using patient experience feedback to benchmark services, but perceived weaknesses in the out-of-hours items from the GPPS led them to question the validity of using these data for benchmarking in its current form.

Conclusions The lack of clarity around how out-of-hours providers should audit patient experience hinders the utility of the National Quality Requirements. Although surveys were common, patient feedback data had only a limited role in service change. Data derived from the GPPS may be used to benchmark service providers, but refinement of the out-of-hours items is needed.

Managing patient deterioration: evaluation of what works.

Background: Rapid Response Systems (RRS) have been implemented nationally and internationally to improve patient safety in hospital. However, to date the majority of the RRS research evidence has focused on measuring the effectiveness of the intervention on patient outcomes. To evaluate RRS it has been recommended that a multimodal approach is required to address the broad range of process and outcome measures required to determine the effectiveness of the RRS concept. Aim: The aim of this paper is to evaluate the official RRS programme theoretical assumptions regarding how the programme is meant to work against actual practice in order to determine what works. Methods: The research design was a multiple case study approach of four wards in two hospitals in Northern Ireland. It followed the principles of realist evaluation research which allowed empirical data to be gathered to test and refine RRS programme theory [1]. This approach used a variety of mixed methods to test the programme theories including individual and focus group interviews with a purposive sample of 75 nurses and doctors, observation of ward practices and documentary analysis. The findings from the case studies were analysed and compared within and across cases to identify what works for whom and in what circumstances. Results: The RRS programme theories were critically evaluated and compared with study findings to develop a mid-range theory to explain what works, for whom in what circumstances. The findings of what works suggests that clinical experience, established working relationships, flexible implementation of protocols, ongoing experiential learning, empowerment and pre-emptive management are key to the success of RRS implementation.  Conclusion:These findings highlight the combination of factors that can improve the implementation of RRS and in light of this evidence several recommendations are made to provide policymakers with guidance and direction for their success and sustainability.References: 1.Pawson R and Tilley N. (1997) Realistic Evaluation. Sage Publications; LondonType of submission: Concurrent session Source of funding: Sandra Ryan Fellowship funded by the School of Nursing & Midwifery, Queen’s University of Belfast

Identification of novel Factor XI mutations in a patient requiring dental extractions

Factor XI is a serine protease that participates in the intrinsic pathway of blood coagulation. Patients deficient in factor XI exhibit varying degrees of post operative bleeding following invasive surgical procedures such as dental extractions. Objectives: The aim of the study was to identify the specific mutations in a patient from a family with known factor XI deficiency. Methods: Samples were obtained from the patient, his mother and his father and subjected to DNA sequencing. Each protein coding exon 2-15 of the factor XI gene was amplified by polymerase chain reaction (PCR) followed by bidirectional sequencing utilizing di-deoxy chain termination chemistry. Results: The patient had a factor XI level of 20% of normal. Initial sequencing of factor XI from the patient identified a point mutation (646G>A) and a putative splice site mutation (1567+4A>T) in intron 13. These are novel previously unreported mutations. DNA sequence analysis of the mother revealed the 1567+4A>T mutation and the father exhibited the 646G>A mutation. As a consequence the treatment proceeded without serious bleeding complication and required administration only of transexamic acid though factor XI was available as haemostatic cover. Conclusion: The two mutations identified in this family are novel; further laboratory investigation of the functional consequences of those mutations is currently underway. Although factor XI deficiency is rare in the Northern Irish population this study highlights the techniques available to sequence and analyse this and similar haematological disorders.

Learning from the QUEST multicentre feasibility randomization trials in breast reconstruction after mastectomy

BACKGROUND: Breast reconstruction aims to improve health-related quality of life after mastectomy. However, evidence guiding patients and surgeons in shared decision-making concerning the optimal type or timing of surgery is lacking.

METHODS: QUEST comprised two parallel feasibility phase III randomized multicentre trials to assess the impact of the type and timing of latissimus dorsi breast reconstruction on health-related quality of life when postmastectomy radiotherapy is unlikely (QUEST A) or highly probable (QUEST B). The primary endpoint for the feasibility phase was the proportion of women who accepted randomization, and it would be considered feasible if patient acceptability rates exceeded 25 per cent of women approached. A companion QUEST Perspectives Study (QPS) of patients (both accepting and declining trial participation) and healthcare professionals assessed trial acceptability.

RESULTS: The QUEST trials opened in 15 UK centres. After 18 months of recruitment, 17 patients were randomized to QUEST A and eight to QUEST B, with overall acceptance rates of 19 per cent (17 of 88) and 22 per cent (8 of 36) respectively. The QPS recruited 56 patients and 51 healthcare professionals. Patient preference was the predominant reason for declining trial entry, given by 47 (53 per cent) of the 88 patients approached for QUEST A and 22 (61 per cent) of the 36 approached for QUEST B. Both trials closed to recruitment in December 2012, acknowledging the challenges of achieving satisfactory patient accrual.

CONCLUSION: Despite extensive efforts to overcome recruitment barriers, it was not feasible to reach timely recruitment targets within a feasibility study. Patient preferences for breast reconstruction types and timings were common, rendering patients unwilling to enter the trial.

Delivering a Research-Enabled Multistakeholder Partnership for Enhanced Patient Care at a Population Level: The Northern Ireland Comprehensive Cancer Program

The last 20 years have seen significant advances in cancer care in Northern Ireland, leading to measureable improvements in patient outcomes. Crucial to this transformation has been an ethos that recognizes the primacy role of research in effecting heath care change. The authors' model of a cross-sectoral partnership that unites patients, scientists, health care professionals, hospital trusts, bioindustry, and government agencies can be truly transformative, empowering tripartite clinical-academic-industry efforts that have already yielded significant benefit and will continue to inform strategy and its implementation going forward.

Cognition, metacognition and patient safety

This article explores the factors that contribute to patient safety incidents. It highlights the importance of human factors in influencing the clinician's performance. Rather than focusing on clinical skills, the article explores the range of non-technical skills which are seen to each contribute to patient safety, including: communication, teamworking, leadership, active followership, situational awareness, decision-making, assertiveness, and workload management. It asks how cognitive processes can influence safe decision-making.