A Thematic Comparison of Eight Frameworks of Quality Criteria in Qualitative Health Research

Background: Despite the increasing incidences of the publication of assessment frameworks intending to establish the "standards" of the quality of qualitative research, the research conducted using such empirical methods are still facing difficulties in being published or recognised by funding agencies. Methods: We conducted a thematic content analysis of eight frameworks from psychology/psychiatry and general medicine. The frameworks and their criteria are then compared against each other. Findings: The results illustrated the difficulties in reaching consensus on the definition of quality criteria. This showed the differences between the frameworks from the point of views of the underlying epistemology and the criteria suggested. Discussion: The aforementioned differences reflect the diversity of paradigms implicitly referred to by the authors of the frameworks, although rarely explicitly mentioned in text. We conclude that the increase in qualitative research and publications has failed to overcome the difficulties in establishing shared criteria and the great heterogeneity of concepts raises methodological and epistemological problems.

Drug assessment by a Pharmacy and Therapeutics committee: from drug selection criteria to use in clinical practice.

BACKGROUND In Spain, hospital medicines are assessed and selected by local Pharmacy and Therapeutics committees (PTCs). Of all the drugs assessed, cancer drugs are particularly important because of their budgetary impact and the sometimes arguable added value with respect to existing alternatives. This study analyzed the PTC drug selection process and the main objective was to evaluate the degree of compliance of prescriptions for oncology drugs with their criteria for use. METHODS This was a retrospective observational study (May 2007 to April 2010) of PTC-assessed drugs. The variables measured to describe the committee's activity were number of drugs assessed per year and number of drugs included in any of these settings: without restrictions, with criteria for use, and not included in formulary. These drugs were also analyzed by therapeutic group. To assess the degree of compliance of prescriptions, a score was calculated to determine whether prescriptions for bevacizumab, cetuximab, trastuzumab, and bortezomib were issued in accordance with PTC drug use criteria. RESULTS The PTC received requests for inclusion of 40 drugs, of which 32 were included in the hospital formulary (80.0%). Criteria for use were established for 28 (87.5%) of the drugs included. In total, 293 patients were treated with the four cancer drugs in eight different therapeutic indications. The average prescription compliance scores were as follows: bevacizumab, 83% for metastatic colorectal cancer, 100% for metastatic breast cancer, and 82.3% for non-small-cell lung cancer; cetuximab, 62.0% for colorectal cancer and 50% for head and neck cancer; trastuzumab, 95.1% for early breast cancer and 82.4% for metastatic breast cancer; and bortezomib, 63.7% for multiple myeloma. CONCLUSION The degree of compliance with criteria for use of cancer drugs was reasonably high. PTC functions need to be changed so that they can carry out more innovative tasks, such as monitoring conditions for drug use.

New delay-dependent stability criteria for uncertain neutral systems with mixed time-varying delays and nonlinear perturbations

The problem of stability analysis for a class of neutral systems with mixed time-varying neutral, discrete and distributed delays and nonlinear parameter perturbations is addressed. By introducing a novel Lyapunov-Krasovskii functional and combining the descriptor model transformation, the Leibniz-Newton formula, some free-weighting matrices, and a suitable change of variables, new sufficient conditions are established for the stability of the considered system, which are neutral-delay-dependent, discrete-delay-range dependent, and distributeddelay-dependent. The conditions are presented in terms of linear matrix inequalities (LMIs) and can be efficiently solved using convex programming techniques. Two numerical examples are given to illustrate the efficiency of the proposed method

New electrocardiographic criteria for discriminating between Brugada types 2 and 3 patterns and incomplete right bundle branch block.

OBJECTIVES: The aim of this study was to evaluate new electrocardiographic (ECG) criteria for discriminating between incomplete right bundle branch block (RBBB) and the Brugada types 2 and 3 ECG patterns. BACKGROUND: Brugada syndrome can manifest as either type 2 or type 3 pattern. The latter should be distinguished from incomplete RBBB, present in 3% of the population. METHODS: Thirty-eight patients with either type 2 or type 3 Brugada pattern that were referred for an antiarrhythmic drug challenge (AAD) were included. Before AAD, 2 angles were measured from ECG leads V(1) and/or V(2) showing incomplete RBBB: 1) α, the angle between a vertical line and the downslope of the r'-wave, and 2) β, the angle between the upslope of the S-wave and the downslope of the r'-wave. Baseline angle values, alone or combined with QRS duration, were compared between patients with negative and positive results on AAD. Receiver-operating characteristic curves were constructed to identify optimal discriminative cutoff values. RESULTS: The mean β angle was significantly smaller in the 14 patients with negative results on AAD compared to the 24 patients with positive results on AAD (36 ± 20° vs. 62 ± 20°, p < 0.01). Its optimal cutoff value was 58°, which yielded a positive predictive value of 73% and a negative predictive value of 87% for conversion to type 1 pattern on AAD; α was slightly less sensitive and specific compared with β. When the angles were combined with QRS duration, it tended to improve discrimination. CONCLUSIONS: In patients with suspected Brugada syndrome, simple ECG criteria can enable discrimination between incomplete RBBB and types 2 and 3 Brugada patterns.

Performance of classic electrocardiographic criteria for left ventricular hypertrophy in an African population.

ECG criteria for left ventricular hypertrophy (LVH) have been almost exclusively elaborated and calibrated in white populations. Because several interethnic differences in ECG characteristics have been found, the applicability of these criteria to African individuals remains to be demonstrated. We therefore investigated the performance of classic ECG criteria for LVH detection in an African population. Digitized 12-lead ECG tracings were obtained from 334 African individuals randomly selected from the general population of the Republic of Seychelles (Indian Ocean). Left ventricular mass was calculated with M-mode echocardiography and indexed to body height. LVH was defined by taking the 95th percentile of body height-indexed LVM values in a reference subgroup. In the entire study sample, 16 men and 15 women (prevalence 9.3%) were finally declared to have LVH, of whom 9 were of the reference subgroup. Sensitivity, specificity, accuracy, and positive and negative predictive values for LVH were calculated for 9 classic ECG criteria, and receiver operating characteristic curves were computed. We also generated a new composite time-voltage criterion with stepwise multiple linear regression: weighted time-voltage criterion=(0.2366R(aVL)+0.0551R(V5)+0.0785S(V3)+ 0.2993T(V1))xQRS duration. The Sokolow-Lyon criterion reached the highest sensitivity (61%) and the R(aVL) voltage criterion reached the highest specificity (97%) when evaluated at their traditional partition value. However, at a fixed specificity of 95%, the sensitivity of these 10 criteria ranged from 16% to 32%. Best accuracy was obtained with the R(aVL) voltage criterion and the new composite time-voltage criterion (89% for both). Positive and negative predictive values varied considerably depending on the concomitant presence of 3 clinical risk factors for LVH (hypertension, age >/=50 years, overweight). Median positive and negative predictive values of the 10 ECG criteria were 15% and 95%, respectively, for subjects with none or 1 of these risk factors compared with 63% and 76% for subjects with all of them. In conclusion, the performance of classic ECG criteria for LVH detection was largely disparate and appeared to be lower in this population of East African origin than in white subjects. A newly generated composite time-voltage criterion might provide improved performance. The predictive value of ECG criteria for LVH was considerably enhanced with the integration of information on concomitant clinical risk factors for LVH.

Defining responses to therapy and study outcomes in clinical trials of invasive fungal diseases: Mycoses Study Group and European Organization for Research and Treatment of Cancer consensus criteria.

Invasive fungal diseases (IFDs) have become major causes of morbidity and mortality among highly immunocompromised patients. Authoritative consensus criteria to diagnose IFD have been useful in establishing eligibility criteria for antifungal trials. There is an important need for generation of consensus definitions of outcomes of IFD that will form a standard for evaluating treatment success and failure in clinical trials. Therefore, an expert international panel consisting of the Mycoses Study Group and the European Organization for Research and Treatment of Cancer was convened to propose guidelines for assessing treatment responses in clinical trials of IFDs and for defining study outcomes. Major fungal diseases that are discussed include invasive disease due to Candida species, Aspergillus species and other molds, Cryptococcus neoformans, Histoplasma capsulatum, and Coccidioides immitis. We also discuss potential pitfalls in assessing outcome, such as conflicting clinical, radiological, and/or mycological data and gaps in knowledge.

Paved Shoulders on Primary Highways in Iowa: An Analysis of Shoulder Surfacing Criteria, Costs, and Benefits, 2001

The value of providing paved shoulders adjacent to many higher volume roadways has been accepted in many states across the country. Iowa’s paved shoulder policy is considerably more conservative than neighboring states, particularly on rural four-lane and high-volume two-lane highways. The objectives of this research are to examine current design criteria for shoulders employed in Iowa and surrounding states, compare benefits and costs of alternative surface types and widths, and make recommendations based on this analysis for consideration in future design policies for primary highway in Iowa. The report finds that many safety and maintenance benefits would result from enhancing Iowa’s paved shoulder and rumble strip design practices for freeways, expressways, and Super 2 highway corridors. The benefits of paved shoulders include reduced numbers of certain crashes, higher capacity potentials, reduced maintenance, enhanced opportunities for other users such as bicyclists, and even possible increased longevity of pavements. Alternative paved shoulder policies and programming strategies are also offered, with detailed assessments of the benefits, costs, and budget impacts.

Quality Assessment of Cardiac Magnetic Resonance Images at 1.5/3.0 T: Description and Validation of Standardized Criteria

PURPOSE: Cardiovascular magnetic resonance (CMR) has become a robust and important diagnostic imaging modality in cardiovascular medicine. However,insufficient image quality may compromise its diagnostic accuracy. No standardized criteria are available to assess the quality of CMR studies. We aimed todescribe and validate standardized criteria to evaluate the quality of CMR studies including: a) cine steady-state free precession, b) delayed gadoliniumenhancement, and c) adenosine stress first-pass perfusion. These criteria will serve for the assessment of the image quality in the setting of the Euro-CMR registry.METHOD AND MATERIALS: First, a total of 45 quality criteria were defined (35 qualitative criteria with a score from 0-3, and 10 quantitative criteria). Thequalitative score ranged from 0 to 105. The lower the qualitative score, the better the quality. The quantitative criteria were based on the absolute signal intensity (delayed enhancement) and on the signal increase (perfusion) of the anterior/posterior left ventricular wall after gadolinium injection. These criteria were then applied in 30 patients scanned with a 1.5T system and in 15 patients scanned with a 3.0T system. The examinations were jointly interpreted by 3 CMR experts and 1 study nurse. In these 45 patients the correlation between the results of the quality assessment obtained by the different readers was calculated.RESULTS: On the 1.5T machine, the mean quality score was 3.5. The mean difference between each pair of observers was 0.2 (5.7%) with a mean standarddeviation of 1.4. On the 3.0T machine, the mean quality score was 4.4. The mean difference between each pair of onservers was 0.3 (6.4%) with a meanstandard deviation of 1.6. The quantitative quality assessments between observers were well correlated for the 1.5T machine: R was between 0.78 and 0.99 (pCONCLUSION: The described criteria for the assessment of CMR image quality are robust and have a low inter-observer variability, especially on 1.5T systems.CLINICAL RELEVANCE/APPLICATION: These criteria will allow the standardization of CMR examinations. They will help to improve the overall quality ofexaminations and the comparison between clinical studies.

Validation of diagnosis criteria for acquired sensory neuronopathy. a francophone multicenter study

Recently published criteria using clinical (ataxia or asymmetrical distribution at onset or full development, and sensory loss not restricted to the lower limbs) and electrophysiological items (less than two abnormal lower limb motor nerves and at least an abolished SAP or three SAP below 30% of lower limit of normal in the upper limbs) were sensitive and specific for the diagnosis of sensory neuronopathy (SNN) (Camdessanche et al., Brain, 2009). However, these criteria need to be validated on a large multicenter population. For this, a database collecting cases from fifteen Reference Centers for Neuromuscular diseases in France and Switzerland is currently developed. So far, data from 120 patients with clinically pure sensory neuropathy have been collected. Cases were classified independently from the evaluated criteria as SNN (53), non-SNN (46) or suspected SNN (21) according to the expert's diagnosis. Using the criteria, SNN was possible in 83% (44/53), 23.9% (11/46) and 71.4% (15/21) of cases, respectively. In the non-SSN group, half of the patients with a diagnosis of possible SSN had an ataxic form of inflammatory demyelinating neuropathy. In the SNN group, half of those not retained as possible SNN had CANOMAD, paraneoplasia, or B12 deficiency. In a second step, after application of the items necessary to reach the level of probable SNN (no biological or electrophysiological abnormalities excluding SNN; presence of onconeural antibody, cisplatin treatment, Sj ¨ ogren's syndrome or spinal cord MRI high signal in the posterior column), a final diagnosis of possible or probable SNN was obtained in, respectively, 90.6% (48/53), 8.8% (4/45), and 71.4% (15/21) of patients in the three groups. Among the 5 patients with a final non-SNN but initial SNN diagnosis, 3 had motor conduction abnormalities (one with CANOMAD) and among the 4 patients with a final SNN but initial non-SSN diagnosis, one had anti-Hu antibody and one was discussed as a possible ataxic CIDP. These preliminary results confirm the sensitivity and specificity of the proposed criteria for the diagnosis of SNN.

Metabolically healthy obesity: different prevalences using different criteria.

To estimate the prevalence of metabolically healthy obesity (MHO) according to different definitions. Population-based sample of 2803 women and 2557 men participated in the study. Metabolic abnormalities were defined using six sets of criteria, which included different combinations of the following: waist; blood pressure; total, high-density lipoprotein or low-density lipoprotein-cholesterol; triglycerides; fasting glucose; homeostasis model assessment; high-sensitivity C-reactive protein; personal history of cardiovascular, respiratory or metabolic diseases. For each set, prevalence of MHO was assessed for body mass index (BMI); waist or percent body fat. Among obese (BMI 30 kg/m(2)) participants, prevalence of MHO ranged between 3.3 and 32.1% in men and between 11.4 and 43.3% in women according to the criteria used. Using abdominal obesity, prevalence of MHO ranged between 5.7 and 36.7% (men) and 12.2 and 57.5% (women). Using percent body fat led to a prevalence of MHO ranging between 6.4 and 43.1% (men) and 12.0 and 55.5% (women). MHO participants had a lower odd of presenting a family history of type 2 diabetes. After multivariate adjustment, the odds of presenting with MHO decreased with increasing age, whereas no relationship was found with gender, alcohol consumption or tobacco smoking using most sets of criteria. Physical activity was positively related, whereas increased waist was negatively related with BMI-defined MHO. MHO prevalence varies considerably according to the criteria used, underscoring the need for a standard definition of this metabolic entity. Physical activity increases the likelihood of presenting with MHO, and MHO is associated with a lower prevalence of family history of type 2 diabetes.

Absence of progression as assessed by response evaluation criteria in solid tumors predicts survival in advanced GI stromal tumors treated with imatinib mesylate: the intergroup EORTC-ISG-AGITG phase III trial.

PURPOSE: From February 2001 to February 2002, 946 patients with advanced GI stromal tumors (GISTs) treated with imatinib were included in a controlled EORTC/ISG/AGITG (European Organisation for Research and Treatment of Cancer/Italian Sarcoma Group/Australasian Gastro-Intestinal Trials Group) trial. This analysis investigates whether the response classification assessed by RECIST (Response Evaluation Criteria in Solid Tumors), predicts for time to progression (TTP) and overall survival (OS). PATIENTS AND METHODS: Per protocol, the first three disease assessments were done at 2, 4, and 6 months. For the purpose of the analysis (landmark method), disease response was subclassified in six categories: partial response (PR; > 30% size reduction), minor response (MR; 10% to 30% reduction), no change (NC) as either NC- (0% to 10% reduction) or NC+ (0% to 20% size increase), progressive disease (PD; > 20% increase/new lesions), and subjective PD (clinical progression). RESULTS: A total of 906 patients had measurable disease at entry. At all measurement time points, complete response (CR), PR, and MR resulted in similar TTP and OS; this was also true for NC- and NC+, and for PD and subjective PD. Patients were subsequently classified as responders (CR/PR/MR), NC (NC+/NC-), or PD. This three-class response categorization was found to be highly predictive of further progression or survival for the first two measurement points. After 6 months of imatinib, responders (CR/PR/MR) had the same survival prognosis as patients classified as NC. CONCLUSION: RECIST perfectly enables early discrimination between patients who benefited long term from imatinib and those who did not. After 6 months of imatinib, if the patient is not experiencing PD, the pattern of radiologic response by tumor size criteria has no prognostic value for further outcome. Imatinib needs to be continued as long as there is no progression according to RECIST.

The Paediatric Rheumatology International Trials Organisation provisional criteria for the evaluation of response to therapy in juvenile dermatomyositis.

OBJECTIVE: To develop a provisional definition for the evaluation of response to therapy in juvenile dermatomyositis (DM) based on the Paediatric Rheumatology International Trials Organisation juvenile DM core set of variables. METHODS: Thirty-seven experienced pediatric rheumatologists from 27 countries achieved consensus on 128 difficult patient profiles as clinically improved or not improved using a stepwise approach (patient's rating, statistical analysis, definition selection). Using the physicians' consensus ratings as the "gold standard measure," chi-square, sensitivity, specificity, false-positive and-negative rates, area under the receiver operating characteristic curve, and kappa agreement for candidate definitions of improvement were calculated. Definitions with kappa values >0.8 were multiplied by the face validity score to select the top definitions. RESULTS: The top definition of improvement was at least 20% improvement from baseline in 3 of 6 core set variables with no more than 1 of the remaining worsening by more than 30%, which cannot be muscle strength. The second-highest scoring definition was at least 20% improvement from baseline in 3 of 6 core set variables with no more than 2 of the remaining worsening by more than 25%, which cannot be muscle strength (definition P1 selected by the International Myositis Assessment and Clinical Studies group). The third is similar to the second with the maximum amount of worsening set to 30%. This indicates convergent validity of the process. CONCLUSION: We propose a provisional data-driven definition of improvement that reflects well the consensus rating of experienced clinicians, which incorporates clinically meaningful change in core set variables in a composite end point for the evaluation of global response to therapy in juvenile DM.