Perceptions of the usefulness of external support to immunization coverage in Guinea-Bissau: a Delphi analysis of the GAVI-Alliance cash-based support

INTRODUCTION: Although many countries have improved vaccination coverage in recent years, some, including Guinea-Bissau, failed to meet expected targets. This paper tries to understand the main barriers to better vaccination coverage in the context of the GAVI-Alliance (The Global Alliance for Vaccines and Immunisation) cash-based support provided to Guinea-Bissau. METHODS: The analysis is based on a document analysis and a three round Delphi study with a final consensus meeting. RESULTS: Consensus attributed about 25% of the failure to perform better to implementation problems; and about 10% to governance and also 10% to scarce resources. The qualitative analysis validates the importance of implementation issues and upgraded the relevance of the human resources crisis as an important drawback. The recommendations were balanced in their upstream-downstream focus but were blind to health information issues and logistical difficulties. CONCLUSIONS: It is commendable that such a fragile state, with all sorts of barriers, manages to sustain a slow steady growth of its vaccination coverage. Not reaching the targets set reflects the inappropriateness of those targets rather than a lack of commitment of the health workforce. In the unstable context of countries such as Guinea-Bissau, the predictability of the funds from global health initiatives like the GAVI-Alliance seem to make all the difference in achieving small consistent health gains even in the presence of other major bottlenecks.

The dermatologists' role in managing psoriatic arthritis: results of a swiss delphi exercise intended to improve collaboration with rheumatologists.

BACKGROUND: Psoriatic arthritis (PsA) substantially impacts the management of psoriatic disease. OBJECTIVE: This study aimed to generate an interdisciplinary national consensus on recommendations of how PsA should be managed. METHODS: Based on a systematic literature search, an interdisciplinary expert group identified important domains and went through 3 rounds of a Delphi exercise, followed by a nominal group discussion to generate specific recommendations. RESULTS: A strong consensus was reached on numerous central messages regarding the impact of PsA, screening procedures, organization of the interaction between dermatologists and rheumatologists, and treatment goals. CONCLUSION: These recommendations can serve as a template for similar initiatives in other countries. At the same time, they highlight the need to take into account the impact of the respective national health care system. © 2015 S. Karger AG, Basel.

A delphi study to detect deficiencies and propose actions in real life treatment of neovascular age-related macular degeneration.

Purpose. Spanish retina specialists were surveyed in order to propose actions to decrease deficiencies in real-life neovascular age macular degeneration treatment (nv-AMD). Methods. One hundred experts, members of the Spanish Vitreoretinal Society (SERV), were invited to complete an online survey of 52 statements about nv-AMD management with a modified Delphi methodology. Four rounds were performed using a 5-point Linkert scale. Recommendations were developed after analyzing the differences between the results and the SERV guidelines recommendations. Results. Eighty-seven specialists completed all the Delphi rounds. Once major potential deficiencies in real-life nv-AMD treatment were identified, 15 recommendations were developed with a high level of agreement. Consensus statements to reduce the burden of the disease included the use of treat and extend regimen and to reduce the amount of diagnostic tests during the loading phase and training technical staff to perform these tests and reduce the time between relapse detection and reinjection, as well as establishing patient referral protocols to outside general ophthalmology clinics. Conclusion. The level of agreement with the final recommendations for nv-AMD treatment among Spanish retinal specialist was high indicating that some actions could be applied in order to reduce the deficiencies in real-life nv-AMD treatment.

Protocol of the COSMIN study: consensus-based standards for the selection of health measurement instruments

Background: Choosing an adequate measurement instrument depends on the proposed use of the instrument, the concept to be measured, the measurement properties (e.g. internal consistency, reproducibility, content and construct validity, responsiveness, and interpretability), the requirements, the burden for subjects, and costs of the available instruments. As far as measurement properties are concerned, there are no sufficiently specific standards for the evaluation of measurement properties of instruments to measure health status, and also no explicit criteria for what constitutes good measurement properties. In this paper we describe the protocol for the COSMIN study, the objective of which is to develop a checklist that contains COnsensus-based Standards for the selection of health Measurement INstruments, including explicit criteria for satisfying these standards. We will focus on evaluative health related patient-reported outcomes (HR-PROs), i.e. patient-reported health measurement instruments used in a longitudinal design as an outcome measure, excluding health care related PROs, such as satisfaction with care or adherence. The COSMIN standards will be made available in the form of an easily applicable checklist.Method: An international Delphi study will be performed to reach consensus on which and how measurement properties should be assessed, and on criteria for good measurement properties. Two sources of input will be used for the Delphi study: (1) a systematic review of properties, standards and criteria of measurement properties found in systematic reviews of measurement instruments, and (2) an additional literature search of methodological articles presenting a comprehensive checklist of standards and criteria. The Delphi study will consist of four (written) Delphi rounds, with approximately 30 expert panel members with different backgrounds in clinical medicine, biostatistics, psychology, and epidemiology. The final checklist will subsequently be field-tested by assessing the inter-rater reproducibility of the checklist.Discussion: Since the study will mainly be anonymous, problems that are commonly encountered in face-to-face group meetings, such as the dominance of certain persons in the communication process, will be avoided. By performing a Delphi study and involving many experts, the likelihood that the checklist will have sufficient credibility to be accepted and implemented will increase.

Indicateurs sécurité en obstétrique : une étude Delphi [Patient safety indicators for obstetrics: a Delphi based study]

OBJECTIVE: Clinical indicators are increasingly used to assess safety of patient care. In obstetrics, only a few indicators have been validated to date and none is used across specialties. The purpose of this study was to identify and assess for face and content validity a group of safety indicators that could be used by anaesthetists, obstetricians and neonatologists involved in labour and delivery units. MATERIALS AND METHODS: We first conducted a systematic review of the literature to identify potential measures. Indicators were then validated by a panel of 30 experts representing all specialties working in labour and delivery units. We used the Delphi method, an iterative questionnaire-based consensus seeking technique. Experts determined on a 7-point Likert scale (1=most representative/7=less representative) the soundness of each indicator as a measure of safety and their possible association with errors and complications caused by medical management. RESULTS: We identified 44 potential clinical indicators from the literature. Following the Delphi process, 13 indicators were considered as highly representative of safety during obstetrical care (mean score</=2.3). Experts ranked 6 of these indicators as being strongly associated to potential errors and complications. CONCLUSIONS: We identified and validated for face and content, a group of six clinical indicators to measure potentially preventable iatrogenic complications in labour and delivery units.

The International Universities Walking Project: Development of a Framework for Workplace Intervention Using the Delphi Technique

Background: This paper aimed to use the Delphi technique to develop a consensus framework for a multinational, workplace walking intervention. Methods: Ideas were gathered and ranked from eight recognized and emerging experts in the fields of physical activity and health, from universities in Australia, Canada, England, the Netherlands, Northern Ireland, and Spain. Members of the panel were asked to consider the key characteristics of a successful campus walking intervention. Consensus was reached by an inductive, content analytic approach, conducted through an anonymous, three-round, e-mail process. Results: The resulting framework consisted of three interlinking themes defined as “design, implementation, and evaluation.” Top-ranked subitems in these themes included the need to generate research capacity (design), to respond to group needs through different walking approaches (implementation), and to undertake physical activity assessment (evaluation). Themes were set within an underpinning domain, referred to as the “institution” and sites are currently engaging with subitems in this domain, to provide sustainable interventions that reflect the practicalities of local contexts and needs. Conclusions: Findings provide a unique framework for designing, implementing, and evaluating walking projects in universities and highlight the value of adopting the Delphi technique for planning international, multisite health initiatives.

The diagnosis of chronic inflammatory demyelinating polyneuropathy: a Delphi-method approach.

The diagnosis of chronic inflammatory demyelinating polyneuropathy (CIDP) is based on a set of clinical and neurophysiological parameters. However, in clinical practice, CIDP remains difficult to diagnose in atypical cases. In the present study, 32 experts from 22 centers (the French CIDP study group) were asked individually to score four typical, and seven atypical, CIDP observations (TOs and AOs, respectively) reported by other physicians, according to the Delphi method. The diagnoses of CIDP were confirmed by the group in 96.9 % of the TO and 60.1 % of the AO (p < 0.0001). There was a positive correlation between the consensus of CIDP diagnosis and the demyelinating features (r = 0.82, p < 0.004). The European CIDP classification was used in 28.3 % of the TOs and 18.2 % of the AOs (p < 0.002). The French CIDP study group diagnostic strategy was used in 90 % of the TOs and 61 % of the AOs (p < 0.0001). In 3 % of the TOs and 21.6 % of the AOs, the experts had difficulty determining a final diagnosis due to a lack of information. This study shows that a set of criteria and a diagnostic strategy are not sufficient to reach a consensus for the diagnosis of atypical CIDP in clinical practice.

Malaria chemoprophylaxis recommendations for immigrants to Europe, visiting relatives and friends--a Delphi method study.

BACKGROUND: Numbers of travellers visiting friends and relatives (VFRs) from Europe to malaria endemic countries are increasing and include long-term and second generation immigrants, who represent the major burden of malaria cases imported back into Europe. Most recommendations for malaria chemoprophylaxis lack a solid evidence base, and often fail to address the cultural, social and economic needs of VFRs. METHODS: European travel medicine experts, who are members of TropNetEurop, completed a sequential series of questionnaires according to the Delphi method. This technique aims at evaluating and developing a consensus through repeated iterations of questionnaires. The questionnaires in this study included questions about professional experience with VFRs, controversial issues in malaria prophylaxis, and 16 scenarios exploring indications for prescribing and choice of chemoprophylaxis. RESULTS: The experience of participants was rather diverse as was their selection of chemoprophylaxis regimen. A significant consensus was observed in only seven of 16 scenarios. The analysis revealed a wide variation in prescribing choices with preferences grouped by region of practice and increased prescribing seen in Northern Europe compared to Central Europe. CONCLUSIONS: Improving the evidence base on efficacy, adherence to chemoprophylaxis and risk of malaria and encouraging discussion among experts, using techniques such as the Delphi method, may reduce the variability in prescription in European travel clinics.

The REporting of Studies Conducted Using Observational Routinely-Collected Health Data (RECORD) Statement: Methods for Arriving at Consensus and Developing Reporting Guidelines.

OBJECTIVE: Routinely collected health data, collected for administrative and clinical purposes, without specific a priori research questions, are increasingly used for observational, comparative effectiveness, health services research, and clinical trials. The rapid evolution and availability of routinely collected data for research has brought to light specific issues not addressed by existing reporting guidelines. The aim of the present project was to determine the priorities of stakeholders in order to guide the development of the REporting of studies Conducted using Observational Routinely-collected health Data (RECORD) statement. METHODS: Two modified electronic Delphi surveys were sent to stakeholders. The first determined themes deemed important to include in the RECORD statement, and was analyzed using qualitative methods. The second determined quantitative prioritization of the themes based on categorization of manuscript headings. The surveys were followed by a meeting of RECORD working committee, and re-engagement with stakeholders via an online commentary period. RESULTS: The qualitative survey (76 responses of 123 surveys sent) generated 10 overarching themes and 13 themes derived from existing STROBE categories. Highest-rated overall items for inclusion were: Disease/exposure identification algorithms; Characteristics of the population included in databases; and Characteristics of the data. In the quantitative survey (71 responses of 135 sent), the importance assigned to each of the compiled themes varied depending on the manuscript section to which they were assigned. Following the working committee meeting, online ranking by stakeholders provided feedback and resulted in revision of the final checklist. CONCLUSIONS: The RECORD statement incorporated the suggestions provided by a large, diverse group of stakeholders to create a reporting checklist specific to observational research using routinely collected health data. Our findings point to unique aspects of studies conducted with routinely collected health data and the perceived need for better reporting of methodological issues.

Key elements for, and indicators of, a successful transition: an international Delphi study.

PURPOSE: The purpose of this study was to reach an international consensus to determine what key elements should be part of a transition program and what indicators could be used to assess its success. METHODS: For this purpose, a Delphi study including an international panel of 37 experts was carried out. The study consisted of three rounds, with response rates ranging from 86.5% to 95%. At each round, experts were asked to assess key elements (defined as the most important elements for the task) and indicators (defined as quantifiable characteristics). At each round, panelists were contacted via e-mail explaining them the tasks to be done and giving them the Web link where to complete the questionnaire. At Round 3, each key element and indicator was assessed as essential, very important, important, accessory, or unnecessary. A 70% agreement was used as cutoff. RESULTS: At Round 3, more than 70% of panelists agreed on six key elements being essential, with one of them (Assuring a good coordination between pediatric and adult professionals) reaching an almost complete consensus (97%). Additionally, 11 more obtained more than 70% agreement when combined with the Very important category. Among indicators, only one (Patient not lost to follow-up) was considered almost unanimously (91%) as essential by the panelists and seven others also reached consensus when the Very important category was included. CONCLUSIONS: Using these results as a framework to develop guidelines at local, national, and international levels would allow better assessing and comparing transition programs.

Establishing the Stages and Processes of Change for Weight Loss by Consensus of Experts

The present study aimed to establish, by a consensus of experts, the stages and processes of change for weight management in overweight and obese people. The first step involved developing two questionnaires aimed at assessing stages and processes of change for weight loss in overweight and obese people. The processes-ofchange questionnaire consisted of 12 subscales, and contained 107 items. A three-round Delphi study was carried out through a website, where participants were asked to give their opinion about the representativeness and clarity of the scale items. The stages-of-change questionnaire consisted of five items and was presented in the final round of the study. A team of 66 experts in the obesity field from 29 countries participated in the study. They were selected either because they belonged to the organizing committee of international associations related to obesity, or because of their research career. The required changes in the questionnaire were made according to the opinions of the participants. Some of these were the result of the group statistical response, whereas others were due to the suggestions made by the participants. A final version of the questionnaire consisting of 63 items was eventually obtained. The present study produced two questionnaires to assess stages and processes of change for weight management. The strength of the study lies in the consensus reached by the panel of experts in order to establish the required content of the questionnaires. The two measures provide useful tools for practitioners who wish to tailor weight-management interventions according to transtheoretical model constructs.

Eosinophilic granulomatosis with polyangiitis (Churg-Strauss) (EGPA) Consensus Task Force recommendations for evaluation and management.

OBJECTIVE: To develop disease-specific recommendations for the diagnosis and management of eosinophilic granulomatosis with polyangiitis (Churg-Strauss syndrome) (EGPA). METHODS: The EGPA Consensus Task Force experts comprised 8 pulmonologists, 6 internists, 4 rheumatologists, 3 nephrologists, 1 pathologist and 1 allergist from 5 European countries and the USA. Using a modified Delphi process, a list of 40 questions was elaborated by 2 members and sent to all participants prior to the meeting. Concurrently, an extensive literature search was undertaken with publications assigned with a level of evidence according to accepted criteria. Drafts of the recommendations were circulated for review to all members until final consensus was reached. RESULTS: Twenty-two recommendations concerning the diagnosis, initial evaluation, treatment and monitoring of EGPA patients were established. The relevant published information on EGPA, antineutrophil-cytoplasm antibody-associated vasculitides, hypereosinophilic syndromes and eosinophilic asthma supporting these recommendations was also reviewed. DISCUSSION: These recommendations aim to give physicians tools for effective and individual management of EGPA patients, and to provide guidance for further targeted research.

The Acute Care Undergraduate TEaching (ACUTE) initiative: consensus development of core competencies in acute care for undergraduates in the United Kingdom

Background: The care of the acutely ill patient in hospital is often sub-optimal. Poor recognition of critical illness combined with a lack of knowledge, failure to appreciate the clinical urgency of a situation, a lack of supervision, failure to seek advice and poor communication have been identified as contributory factors. At present the training of medical students in these important skills is fragmented. The aim of this study was to use consensus techniques to identify the core competencies in the care of acutely ill or arrested adult patients that medical students should possess at the point of graduation. Design: Healthcare professionals were invited to contribute suggestions for competencies to a website as part of a modified Delphi survey. The competency proposals were grouped into themes and rated by a nominal group comprised of physicians, nurses and students from the UK. The nominal group rated the importance of each competency using a 5-point Likert scale. Results: A total of 359 healthcare professionals contributed 2,629 competency suggestions during the Delphi survey. These were reduced to 88 representative themes covering: airway and oxygenation; breathing and ventilation; circulation; confusion and coma; drugs, therapeutics and protocols; clinical examination; monitoring and investigations; team-working, organisation and communication; patient and societal needs; trauma; equipment; pre-hospital care; infection and inflammation. The nominal group identified 71 essential and 16 optional competencies which students should possess at the point of graduation. Conclusions: We propose these competencies form a core set for undergraduate training in resuscitation and acute care.

Developing consensus on hospital prescribing indicators of potential harms amenable to decision support

Aim: To develop a list of prescribing indicators specific for the hospital setting that would facilitate the prospective collection of high severity and/or high frequency prescribing errors, which are also amenable to electronic clinical decision support (CDS). Method: A three-stage consensus technique (electronic Delphi) was carried out with 20 expert pharmacists and physicians across England. Participants were asked to score prescribing errors using a 5-point Likert scale for their likelihood of occurrence and the severity of the most likely outcome. These were combined to produce risk scores, from which median scores were calculated for each indicator across the participants in the study. The degree of consensus between the participants was defined as the proportion that gave a risk score in the same category as the median. Indicators were included if a consensus of 80% or more was achieved. Results: A total of 80 prescribing errors were identified by consensus as being high or extreme risk. The most common drug classes named within the indicators were antibiotics (n=13), antidepressants (n=8), nonsteroidal anti-inflammatory drugs (n=6), and opioid analgesics (n=6).The most frequent error type identified as high or extreme risk were those classified as clinical contraindications (n=29/80). Conclusion: 80 high risk prescribing errors in the hospital setting have been identified by an expert panel. These indicators can serve as the basis for a standardised, validated tool for the collection of data in both paperbased and electronic prescribing processes, as well as to assess the impact of electronic decision support implementation or development.

Content validation for level of use of feature rich systems: a Delphi study of electronic medical records systems

Introduction. Feature usage is a pre-requisite to realising the benefits of investments in feature rich systems. We propose that conceptualising the dependent variable 'system use' as 'level of use' and specifying it as a formative construct has greater value for measuring the post-adoption use of feature rich systems. We then validate the content of the construct as a first step in developing a research instrument to measure it. The context of our study is the post-adoption use of electronic medical records (EMR) by primary care physicians. Method. Initially, a literature review of the empirical context defines the scope based on prior studies. Having identified core features from the literature, they are further refined with the help of experts in a consensus seeking process that follows the Delphi technique. Results.The methodology was successfully applied to EMRs, which were selected as an example of feature rich systems. A review of EMR usage and regulatory standards provided the feature input for the first round of the Delphi process. A panel of experts then reached consensus after four rounds, identifying ten task-based features that would be indicators of level of use. Conclusions. To study why some users deploy more advanced features than others, theories of post-adoption require a rich formative dependent variable that measures level of use. We have demonstrated that a context sensitive literature review followed by refinement through a consensus seeking process is a suitable methodology to validate the content of this dependent variable. This is the first step of instrument development prior to statistical confirmation with a larger sample.