Establishing the validity of English GP Patient Survey items evaluating out-of-hours care

Background A 2014 national audit used the English General Practice Patient Survey (GPPS) to compare service users’ experience of out-of-hours general practitioner (GP) services, yet there is no published evidence on the validity of these GPPS items. Objectives Establish the construct and concurrent validity of GPPS items evaluating service users’ experience of GP out-of-hours care. Methods Cross-sectional postal survey of service users (n=1396) of six English out-of-hours providers. Participants reported on four GPPS items evaluating out-of-hours care (three items modified following cognitive interviews with service users), and 14 evaluative items from the Out-of-hours Patient Questionnaire (OPQ). Construct validity was assessed through correlations between any reliable (Cochran's α>0.7) scales, as suggested by a principal component analysis of the modified GPPS items, with the ‘entry access’ (four items) and ‘consultation satisfaction’ (10 items) OPQ subscales. Concurrent validity was determined by investigating whether each modified GPPS item was associated with thematically related items from the OPQ using linear regressions. Results The modified GPPS item-set formed a single scale (α=0.77), which summarised the two-component structure of the OPQ moderately well; explaining 39.7% of variation in the ‘entry access’ scores (r=0.63) and 44.0% of variation in the ‘consultation satisfaction’ scores (r=0.66), demonstrating acceptable construct validity. Concurrent validity was verified as each modified GPPS item was highly associated with a distinct set of related items from the OPQ. Conclusions Minor modifications are required for the English GPPS items evaluating out-of-hours care to improve comprehension by service users. A modified question set was demonstrated to comprise a valid measure of service users’ overall satisfaction with out-of-hours care received. This demonstrates the potential for the use of as few as four items in benchmarking providers and assisting services in identifying, implementing and assessing quality improvement initiatives.

The use of patient experience survey data by out-of-hours primary care services: a qualitative interview study

Background English National Quality Requirements mandate out-of-hours primary care services to routinely audit patient experience, but do not state how it should be done.

Objectives We explored how providers collect patient feedback data and use it to inform service provision. We also explored staff views on the utility of out-of-hours questions from the English General Practice Patient Survey (GPPS).

Methods A qualitative study was conducted with 31 staff (comprising service managers, general practitioners and administrators) from 11 out-of-hours primary care providers in England, UK. Staff responsible for patient experience audits within their service were sampled and data collected via face-to-face semistructured interviews.

Results Although most providers regularly audited their patients’ experiences by using patient surveys, many participants expressed a strong preference for additional qualitative feedback. Staff provided examples of small changes to service delivery resulting from patient feedback, but service-wide changes were not instigated. Perceptions that patients lacked sufficient understanding of the urgent care system in which out-of-hours primary care services operate were common and a barrier to using feedback to enable change. Participants recognised the value of using patient experience feedback to benchmark services, but perceived weaknesses in the out-of-hours items from the GPPS led them to question the validity of using these data for benchmarking in its current form.

Conclusions The lack of clarity around how out-of-hours providers should audit patient experience hinders the utility of the National Quality Requirements. Although surveys were common, patient feedback data had only a limited role in service change. Data derived from the GPPS may be used to benchmark service providers, but refinement of the out-of-hours items is needed.

Oral rehabilitation for partially dentate elders: a qualitative analysis

Aims: This study aimed to gain insight into patient’s perceptions of natural tooth loss and explored their experiences of oral rehabilitation according to a functionally orientated approach (SDA) and Removable Partial Dentures (RPD).
Study Design: For this qualitative study, a purposive sample of 15 partially dentate older patients
were recruited from Cork Dental School and Hospital. These patients had previously participated in a randomised controlled clinical trial (RCT) where they were provided with either SDA treatment using adhesive bridgework or provided with Cobalt Chromium framework RPDs. In- depth interviews were undertaken and thematic analysis was utilised to interpret the data.
Results: The findings of this study indicated strong satisfaction with SDA treatment. Patients referred to the ease in which they adapted to the adhesive prostheses as they were “lightweight”, “neat” and “fixed”. Irrespective of treatment option, patients indicated that they felt
their new prostheses were durable and an improvement on previous treatments. Most patients indicated that, previous to the RCT, they had not attended a general dentist for a number of years and only then for acute issues. They had concerns that treatment which was provided to them as part of the RCT would not be available to them in primary care. Interestingly, although they do not want their condition to dis-improve, if their prostheses failed they stated that they would not seek alternative treatment but would revert back
to adopting previous coping mechanisms.
Conclusion: This study illustrates that partially dentate older patients were very satisfied with oral rehabilitation according to a functionally orientated approach. Unfortunately they did not believe that this treatment would currently be made available to them in a primary care setting.

Physical rehabilitation interventions for adult intensive care patients across the continuum of recovery (i.e. within the intensive care unit (ICU) and following ICU and hospital discharge): an overview of systematic reviews

Background
Patients admitted to the intensive care unit with critical illness often experience significant physical impairments, which typically persist for many years following resolution of the original illness. Physical rehabilitation interventions that enhance restoration of physical function have been evaluated across the continuum of recovery following critical illness including within the intensive care unit, following discharge to the ward and beyond hospital discharge. Multiple systematic reviews have been published appraising the expanding evidence investigating these physical rehabilitation interventions, although there appears to be variability in review methodology and quality. We aim to conduct an overview of existing systematic reviews of physical rehabilitation interventions for adult intensive care patients across the continuum of recovery.

Methods/design
This protocol has been developed according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses Protocol (PRISMA-P) guidelines. We will search the Cochrane Systematic Review Database, Database of Abstracts of Reviews of Effectiveness, Cochrane Central Register of Controlled Trials, MEDLINE, Excerpta Medica Database and Cumulative Index to Nursing and Allied Health Literature databases. We will include systematic reviews of randomised controlled trials of adult patients, admitted to the intensive care unit and who have received physical rehabilitation interventions at any time point during their recovery. Data extraction will include systematic review aims and rationale, study types, populations, interventions, comparators, outcomes and quality appraisal method. Primary outcomes of interest will focus on findings reflecting recovery of physical function. Quality of reporting and methodological quality will be appraised using the PRISMA checklist and the Assessment of Multiple Systematic Reviews tool.

Discussion
We anticipate the findings from this novel overview of systematic reviews will contribute to the synthesis and interpretation of existing evidence regarding physical rehabilitation interventions and physical recovery in post-critical illness patients across the continuum of recovery.

Managing patient deterioration: evaluation of what works.

Background: Rapid Response Systems (RRS) have been implemented nationally and internationally to improve patient safety in hospital. However, to date the majority of the RRS research evidence has focused on measuring the effectiveness of the intervention on patient outcomes. To evaluate RRS it has been recommended that a multimodal approach is required to address the broad range of process and outcome measures required to determine the effectiveness of the RRS concept. Aim: The aim of this paper is to evaluate the official RRS programme theoretical assumptions regarding how the programme is meant to work against actual practice in order to determine what works. Methods: The research design was a multiple case study approach of four wards in two hospitals in Northern Ireland. It followed the principles of realist evaluation research which allowed empirical data to be gathered to test and refine RRS programme theory [1]. This approach used a variety of mixed methods to test the programme theories including individual and focus group interviews with a purposive sample of 75 nurses and doctors, observation of ward practices and documentary analysis. The findings from the case studies were analysed and compared within and across cases to identify what works for whom and in what circumstances. Results: The RRS programme theories were critically evaluated and compared with study findings to develop a mid-range theory to explain what works, for whom in what circumstances. The findings of what works suggests that clinical experience, established working relationships, flexible implementation of protocols, ongoing experiential learning, empowerment and pre-emptive management are key to the success of RRS implementation.  Conclusion:These findings highlight the combination of factors that can improve the implementation of RRS and in light of this evidence several recommendations are made to provide policymakers with guidance and direction for their success and sustainability.References: 1.Pawson R and Tilley N. (1997) Realistic Evaluation. Sage Publications; LondonType of submission: Concurrent session Source of funding: Sandra Ryan Fellowship funded by the School of Nursing & Midwifery, Queen’s University of Belfast

Technological aids for the rehabilitation of memory and executive functioning in children and adolescents with acquired brain injury (Review).

Background The use of technology in healthcare settings is on the increase and may represent a cost-effective means of delivering rehabilitation. Reductions in treatment time, and delivery in the home, are also thought to be benefits of this approach. Children and adolescents with brain injury often experience deficits in memory and executive functioning that can negatively affect their school work, social lives, and future occupations. Effective interventions that can be delivered at home, without the need for high-cost clinical involvement, could provide a means to address a current lack of provision. We have systematically reviewed studies examining the effects of technology-based interventions for the rehabilitation of deficits in memory and executive functioning in children and adolescents with acquired brain injury. Objectives To assess the effects of technology-based interventions compared to placebo intervention, no treatment, or other types of intervention, on the executive functioning and memory of children and adolescents with acquired brain injury. Search methods We ran the search on the 30 September 2015. We searched the Cochrane Injuries Group Specialised Register, the Cochrane Central Register of Controlled Trials (CENTRAL), Ovid MEDLINE(R), Ovid MEDLINE(R) In-Process & Other Non-Indexed Citations, Ovid MEDLINE(R) Daily and Ovid OLDMEDLINE(R), EMBASE Classic + EMBASE (OvidSP), ISI Web of Science (SCI-EXPANDED, SSCI, CPCI-S, and CPSI-SSH), CINAHL Plus (EBSCO), two other databases, and clinical trials registers. We also searched the internet, screened reference lists, and contacted authors of included studies. Selection criteria Randomised controlled trials comparing the use of a technological aid for the rehabilitation of children and adolescents with memory or executive-functioning deficits with placebo, no treatment, or another intervention. Data collection and analysis Two review authors independently reviewed titles and abstracts identified by the search strategy. Following retrieval of full-text manuscripts, two review authors independently performed data extraction and assessed the risk of bias. Main results Four studies (involving 206 participants) met the inclusion criteria for this review. Three studies, involving 194 participants, assessed the effects of online interventions to target executive functioning (that is monitoring and changing behaviour, problem solving, planning, etc.). These studies, which were all conducted by the same research team, compared online interventions against a 'placebo' (participants were given internet resources on brain injury). The interventions were delivered in the family home with additional support or training, or both, from a psychologist or doctoral student. The fourth study investigated the use of a computer program to target memory in addition to components of executive functioning (that is attention, organisation, and problem solving). No information on the study setting was provided, however a speech-language pathologist, teacher, or occupational therapist accompanied participants. Two studies assessed adolescents and young adults with mild to severe traumatic brain injury (TBI), while the remaining two studies assessed children and adolescents with moderate to severe TBI. Risk of bias We assessed the risk of selection bias as low for three studies and unclear for one study. Allocation bias was high in two studies, unclear in one study, and low in one study. Only one study (n = 120) was able to conceal allocation from participants, therefore overall selection bias was assessed as high. One study took steps to conceal assessors from allocation (low risk of detection bias), while the other three did not do so (high risk of detection bias). Primary outcome 1: Executive functioning: Technology-based intervention versus placebo Results from meta-analysis of three studies (n = 194) comparing online interventions with a placebo for children and adolescents with TBI, favoured the intervention immediately post-treatment (standardised mean difference (SMD) -0.37, 95% confidence interval (CI) -0.66 to -0.09; P = 0.62; I2 = 0%). (As there is no 'gold standard' measure in the field, we have not translated the SMD back to any particular scale.) This result is thought to represent only a small to medium effect size (using Cohen’s rule of thumb, where 0.2 is a small effect, 0.5 a medium one, and 0.8 or above is a large effect); this is unlikely to have a clinically important effect on the participant. The fourth study (n = 12) reported differences between the intervention and control groups on problem solving (an important component of executive functioning). No means or standard deviations were presented for this outcome, therefore an effect size could not be calculated. The quality of evidence for this outcome according to GRADE was very low. This means future research is highly likely to change the estimate of effect. Primary outcome 2: Memory One small study (n = 12) reported a statistically significant difference in improvement in sentence recall between the intervention and control group following an eight-week remediation programme. No means or standard deviations were presented for this outcome, therefore an effect size could not be calculated. Secondary outcomes Two studies (n = 158) reported on anxiety/depression as measured by the Child Behavior Checklist (CBCL) and were included in a meta-analysis. We found no evidence of an effect with the intervention (mean difference -5.59, 95% CI -11.46 to 0.28; I2 = 53%). The GRADE quality of evidence for this outcome was very low, meaning future research is likely to change the estimate of effect. A single study sought to record adverse events and reported none. Two studies reported on use of the intervention (range 0 to 13 and 1 to 24 sessions). One study reported on social functioning/social competence and found no effect. The included studies reported no data for other secondary outcomes (that is quality of life and academic achievement). Authors' conclusions This review provides low-quality evidence for the use of technology-based interventions in the rehabilitation of executive functions and memory for children and adolescents with TBI. As all of the included studies contained relatively small numbers of participants (12 to 120), our findings should be interpreted with caution. The involvement of a clinician or therapist, rather than use of the technology, may have led to the success of these interventions. Future research should seek to replicate these findings with larger samples, in other regions, using ecologically valid outcome measures, and reduced clinician involvement.

Identification of novel Factor XI mutations in a patient requiring dental extractions

Factor XI is a serine protease that participates in the intrinsic pathway of blood coagulation. Patients deficient in factor XI exhibit varying degrees of post operative bleeding following invasive surgical procedures such as dental extractions. Objectives: The aim of the study was to identify the specific mutations in a patient from a family with known factor XI deficiency. Methods: Samples were obtained from the patient, his mother and his father and subjected to DNA sequencing. Each protein coding exon 2-15 of the factor XI gene was amplified by polymerase chain reaction (PCR) followed by bidirectional sequencing utilizing di-deoxy chain termination chemistry. Results: The patient had a factor XI level of 20% of normal. Initial sequencing of factor XI from the patient identified a point mutation (646G>A) and a putative splice site mutation (1567+4A>T) in intron 13. These are novel previously unreported mutations. DNA sequence analysis of the mother revealed the 1567+4A>T mutation and the father exhibited the 646G>A mutation. As a consequence the treatment proceeded without serious bleeding complication and required administration only of transexamic acid though factor XI was available as haemostatic cover. Conclusion: The two mutations identified in this family are novel; further laboratory investigation of the functional consequences of those mutations is currently underway. Although factor XI deficiency is rare in the Northern Irish population this study highlights the techniques available to sequence and analyse this and similar haematological disorders.