Variation in performance across Swiss mammography screening programmes: the influence of reading strategy and experience.

[Abstract] Reading volume and mammography screening performance appear positively correlated. Performance was compared across organised Swiss screening programmes, which target relatively small populations. Except for accreditation of 2nd readers radiologists (restrictive vs non-restrictive strategy), Swiss programmes have similar screening regimen/procedures and duration, which maximises comparability. Variation in performance was explored in order to improve mammography practice and optimise screening performance. Indicators of quality and effectiveness were evaluated for about 200,000 screens performed over 4 screening rounds in the 3 longest-standing Swiss cantonal programmes (of Vaud, Geneva and Valais). Interval cancers were identified by linkage with cancer registries records. Most European standards of performance were met with a favourable cancer stage shift. Several performance indicators showed substantial variation across programmes. In subsequent rounds, compared with programmes (Vaud and Geneva) which accredited few 2nd readers to increase their individual reading volume, proportions of in situ lesions and of small cancers (? 1cm) were one third lower and halved, respectively, and the proportion of advanced lesions (stage II+) nearly 50% higher in the programme without a restrictive selection strategy. Discrepancy in second-year proportional incidence of interval cancers appears to be multicausal. Differences in performance could partly be explained by a selective strategy for 2nd readers and a prior experience in service screening, but not by the levels of opportunistic screening and programme attendance. This study provides clues for enhancing mammography screening performance in low-volume Swiss programmes.

Disagreements in meta-analyses using outcomes measured on continuous or rating scales: observer agreement study

OBJECTIVE: To study the inter-observer variation related to extraction of continuous and numerical rating scale data from trial reports for use in meta-analyses. DESIGN: Observer agreement study. DATA SOURCES: A random sample of 10 Cochrane reviews that presented a result as a standardised mean difference (SMD), the protocols for the reviews and the trial reports (n=45) were retrieved. DATA EXTRACTION: Five experienced methodologists and five PhD students independently extracted data from the trial reports for calculation of the first SMD result in each review. The observers did not have access to the reviews but to the protocols, where the relevant outcome was highlighted. The agreement was analysed at both trial and meta-analysis level, pairing the observers in all possible ways (45 pairs, yielding 2025 pairs of trials and 450 pairs of meta-analyses). Agreement was defined as SMDs that differed less than 0.1 in their point estimates or confidence intervals. RESULTS: The agreement was 53% at trial level and 31% at meta-analysis level. Including all pairs, the median disagreement was SMD=0.22 (interquartile range 0.07-0.61). The experts agreed somewhat more than the PhD students at trial level (61% v 46%), but not at meta-analysis level. Important reasons for disagreement were differences in selection of time points, scales, control groups, and type of calculations; whether to include a trial in the meta-analysis; and data extraction errors made by the observers. In 14 out of the 100 SMDs calculated at the meta-analysis level, individual observers reached different conclusions than the originally published review. CONCLUSIONS: Disagreements were common and often larger than the effect of commonly used treatments. Meta-analyses using SMDs are prone to observer variation and should be interpreted with caution. The reliability of meta-analyses might be improved by having more detailed review protocols, more than one observer, and statistical expertise.

Variation in pre-PCR processing of FFPE samples leads to discrepancies in BRAF and EGFR mutation detection: a diagnostic RING trial.

AIMS: Mutation detection accuracy has been described extensively; however, it is surprising that pre-PCR processing of formalin-fixed paraffin-embedded (FFPE) samples has not been systematically assessed in clinical context. We designed a RING trial to (i) investigate pre-PCR variability, (ii) correlate pre-PCR variation with EGFR/BRAF mutation testing accuracy and (iii) investigate causes for observed variation. METHODS: 13 molecular pathology laboratories were recruited. 104 blinded FFPE curls including engineered FFPE curls, cell-negative FFPE curls and control FFPE tissue samples were distributed to participants for pre-PCR processing and mutation detection. Follow-up analysis was performed to assess sample purity, DNA integrity and DNA quantitation. RESULTS: Rate of mutation detection failure was 11.9%. Of these failures, 80% were attributed to pre-PCR error. Significant differences in DNA yields across all samples were seen using analysis of variance (p

Inter- and intra-tester reliability of clinical measurement to determine medio-lateral patellar position using a pachymeter or visual assessment

The aim was to investigate inter-tester and intra-tester reliability and parallel reliability between a visual assessment method and a method using a pachymeter for locating the mid-point of the patella in determining the medial/lateral patella orientation. Fifteen asymptomatic subjects were assessed and the mid-point of the patella was determined by both methods on two separate occasions two weeks apart. Inter-tester reliability was obtained by ANOVA and by intraclass correlation coefficient (ICC); intra-tester reliability was obtained by a paired t-test and ICC; and parallel reliability was obtained by Pearson`s Correlation and ICC, for the measurement on the first and second evaluations. There was acceptable inter-tester agreement (p = 0.490) and reliability for the visual inspection (ICC = 0.747) and for the pachymeter (ICC = 0.716) at the second evaluation. The inter-tester reliability in the first evaluation was unacceptable (visual ICC = 0.604; pachymeter ICC = 0.612). Although there was statistical similarity between measurements for the first and second evaluations for all testers, intra-tester reliability was not acceptable for both methods: visual (examiner 1 ICC = 0.175; examiner 2 ICC = 0.189; examiner 3 ICC = 0.155) and pachymeter (examiner 1 ICC = 0.214; examiner 2 ICC = 0.246; examiner 3 ICC = 0.069). Parallel reliability gave a perfect correlation at the first evaluation (r=0.828; p<0.001) and at the second (r=0.756; p<0.001) and reliability was between acceptable and very good (ICC = [0.748-0.813]). Both visual and pachymeter methods provide reliable and similar medial/lateral patella orientation and are reliable between different examiners, but the results between the two assessments at 2 weeks` interval demonstrated an unacceptable reliability. (C) 2009 Elsevier B.V. All rights reserved.

Reliability of the interpretation of coronary angiography by the simple visual method

OBJECTIVE: Evaluation of inter and intraobserver reproducibility of by the visual method interpretation of cineangiogram in a clinically based context. METHODS: Five interventional cardiologists analyzed 11 segments of 8 coronary cineangiograms at a two month apart sessions. The percent luminal reduction by the lesions were analyzed by two different classifications: in one (A) the lesions were graded in 0% = absent, 1-50% = mild, 51 - 69 = moderate, and > or = 70% = severe; the other classification (B) was a dichotomic one : <70% = nonsignificant and > or = 70%=significant lesions. The agreement were measured by the kappa (k) index. RESULTS: Interobserver agreement was moderate for classification A (1st measurement, k = 0.36 -- 0.63, k m = 0.49; 2nd measurement, k = 0.39-0.68, k m = 0.52) and good for classification B (1st measurement, k = 0.55-0.73, k m = 0.63; 2nd measurement, k = 0.37-0.82, k m = 0.61). Intraobserver levels of agreement were k = 0.57-0.95 for classification A and 0.62-1.0 for classification B. CONCLUSION: The higher level of reproducibility obtained by adopting the dichotomous criteria usually considered for ischemic limits demonstrates that in the present clinical context, the reliability of the simple visual method is adequate for the identification of patients with clinically significant lesions and candidates for myocardial revascularization procedures.

Seven years of gamma-ray spectrometry interlaboratory comparisons in Switzerland.

Since the 1990s, regular comparisons of gamma-ray spectrometry in Switzerland were organized to improve laboratory abilities to measure the radioactivity in the environment and food stuffs at typical routine levels. The activity concentration of the test samples and the evaluation of the associated uncertainties remained each year the main required test result. Over the years, the comparisons used certified reference solutions as well as environmental samples. The aim of this study is to research the effect of the comparisons on measurement quality. An analysis of the seven last interlaboratory comparisons revealed that the Swiss measurement capability is up to date. In addition, the results showed that the participants now have an improved evaluation of the uncertainties associated with their measurement.

The reasons for discrepancies in target volume delineation : a SASRO study on head-and-neck and prostate cancers.

PURPOSE: To understand the reasons for differences in the delineation of target volumes between physicians. MATERIAL AND METHODS: 18 Swiss radiooncology centers were invited to delineate volumes for one prostate and one head-and-neck case. In addition, a questionnaire was sent to evaluate the differences in the volume definition (GTV [gross tumor volume], CTV [clinical target volume], PTV [planning target volume]), the various estimated margins, and the nodes at risk. Coherence between drawn and stated margins by centers was calculated. The questionnaire also included a nonspecific series of questions regarding planning methods in each institution. RESULTS: Fairly large differences in the drawn volumes were seen between the centers in both cases and also in the definition of volumes. Correlation between drawn and stated margins was fair in the prostate case and poor in the head-and-neck case. The questionnaire revealed important differences in the planning methods between centers. CONCLUSION: These large differences could be explained by (1) a variable knowledge/interpretation of ICRU definitions, (2) variable interpretations of the potential microscopic extent, (3) difficulties in GTV identification, (4) differences in the concept, and (5) incoherence between theory (i.e., stated margins) and practice (i.e., drawn margins).

Renal perfusion evaluation with contrast-enhanced ultrasonography.

BACKGROUND: Contrast-enhanced ultrasonography (CEUS) is a novel imaging technique that is safe and applicable on the bedside. Recent developments seem to enable CEUS to quantify organ perfusion. We performed an exploratory study to determine the ability of CEUS to detect changes in renal perfusion and to correlate them with effective renal plasma flow. METHODS: CEUS with destruction-refilling sequences was studied in 10 healthy subjects, at baseline and during infusion of angiotensin II (AngII) at low (1 ng/kg/min) and high dose (3 ng/kg/min) and 1 h after oral captopril (50 mg). Perfusion index (PI) was obtained and compared with the effective renal plasma flow (ERPF) obtained by parallel para-aminohippurate (PAH) clearance. RESULTS: Median PI decreased from 188.6 (baseline) to 100.4 with low-dose AngII (-47%; P < 0.02) and to 66.1 with high-dose AngII (-65%; P < 0.01) but increased to 254.7 with captopril (+35%; P > 0.2). These changes parallelled those observed with ERPF, which changed from a median of 672.1 mL/min (baseline) to 572.3 (low-dose AngII, -15%, P < 0.05) and to 427.2 (high-dose AngII, -36%, P < 0.001) and finally 697.1 (captopril, +4%, P < 0.02). CONCLUSIONS: This study demonstrates that CEUS is able to detect changes in human renal cortical microcirculation as induced by AngII infusion and/or captopril administration. The changes in perfusion indices parallel those in ERPF as obtained by PAH clearance.

Estimation of sex and age of "virtual skeletons"--a feasibility study.

This article presents a feasibility study with the objective of investigating the potential of multi-detector computed tomography (MDCT) to estimate the bone age and sex of deceased persons. To obtain virtual skeletons, the bodies of 22 deceased persons with known age at death were scanned by MDCT using a special protocol that consisted of high-resolution imaging of the skull, shoulder girdle (including the upper half of the humeri), the symphysis pubis and the upper halves of the femora. Bone and soft-tissue reconstructions were performed in two and three dimensions. The resulting data were investigated by three anthropologists with different professional experience. Sex was determined by investigating three-dimensional models of the skull and pelvis. As a basic orientation for the age estimation, the complex method according to Nemeskéri and co-workers was applied. The final estimation was effected using additional parameters like the state of dentition, degeneration of the spine, etc., which where chosen individually by the three observers according to their experience. The results of the study show that the estimation of sex and age is possible by the use of MDCT. Virtual skeletons present an ideal collection for anthropological studies, because they are obtained in a non-invasive way and can be investigated ad infinitum.

Appropriate treatment for Crohn's disease: methodology and summary results of a multidisciplinary international expert panel approach--EPACT.

BACKGROUND/AIMS: For many therapeutic decisions in Crohn's disease (CD), high-grade evidence is lacking. To assist clinical decision-making, explicit panel-based appropriateness criteria were developed by an international, multidisciplinary expert panel. METHODS: 10 gastroenterologists, 3 surgeons and 2 general practitioners from 12 European countries assessed the appropriateness of therapy for CD using the RAND Appropriateness Method. Their assessment was based on the study of a recent literature review of the subject, combined with their own expert clinical judgment. Panelists rated clinical indications and treatment options using a 9-point scale (1 = extremely inappropriate; 9 = extremely appropriate). These scenarios were then discussed in detail at the panel meeting and re-rated. Median ratings and disagreement were used to aggregate ratings into three assessment categories: appropriate (A), uncertain (U) and inappropriate (I). RESULTS: 569 specific indications were rated, dealing with 9 clinical presentations: mild/moderate luminal CD (n = 104), severe CD (n = 126), steroid-dependent CD (n = 25), steroid-refractory CD (n = 37), fistulizing CD (n = 49), fibrostenotic CD (n = 35), maintenance of medical remission of CD (n = 84), maintenance of surgical remission (n = 78), drug safety in pregnancy (n = 24) and use of infliximab (n = 7). Overall, 146 indications (26%) were judged appropriate, 129 (23%) uncertain and 294 (52%) inappropriate. Frank disagreement was low (14% overall) with the greatest disagreement (54% of scenarios) being observed for treatment of steroid-refractory disease. CONCLUSIONS: Detailed explicit appropriateness criteria for the appropriate use of therapy for CD were developed for the first time by a European expert panel. Disease location, severity and previous treatments were the main factors taken into account. User-friendly access to EPACT criteria is available via an Internet site, www.epact.ch, allowing prospective evaluation and improvement of appropriateness of current CD therapy.

Diagnostic interview for genetic studies (DIGS): inter-rater and test-retest reliability of the French version.

The National Institute of Mental Health developed the semi-structured Diagnostic Interview for Genetic Studies (DIGS) for the assessment of major mood and psychotic disorders and their spectrum conditions. The DIGS was translated into French in a collaborative effort of investigators from sites in France and Switzerland. Inter-rater and test-retest reliability of the French version have been established in a clinical sample in Lausanne. Excellent inter-rater reliability was found for schizophrenia, bipolar disorder, major depression, and unipolar schizoaffective disorder while fair inter-rater reliability was demonstrated for bipolar schizoaffective disorder. Using a six-week test-retest interval, reliability for all diagnoses was found to be fair to good with the exception of bipolar schizoaffective disorder. The lower test-retest reliability was the result of a relatively long test-retest interval that favored incomplete symptom recall. In order to increase reliability for lifetime diagnoses in persons not currently affected, best-estimate procedures using additional sources of diagnostic information such as medical records and reports from relatives should supplement DIGS information in family-genetic studies. Within such a procedure, the DIGS appears to be a useful part of data collection for genetic studies on major mood disorders and schizophrenia in French-speaking populations.

French version of the addiction severity index (5th Edition): validity and reliability among Swiss opiate-dependent patients. French validation of the Addiction Severity Index.

OBJECTIVE: The aim of the study was to validate a French adaptation of the 5th version of the Addiction Severity Index (ASI) instrument in a Swiss sample of illicit drug users. PARTICIPANTS AND SETTING: The participants in the study were 54 French-speaking dependent patients, most of them with opiates as the drug of first choice. Procedure: Analyses of internal consistency (convergent and discriminant validity) and reliability, including measures of test-retest and inter-observer correlations, were conducted. RESULTS: Besides good applicability of the test, the results on composite scores (CSs) indicate comparable results to those obtained in a sample of American opiate-dependent patients. Across the seven dimensions of the ASI, Cronbach's alpha ranged from 0.42 to 0.76, test-retest correlations coefficients ranged from 0.48 to 0.98, while for CSs, inter-observer correlations ranged from 0.76 to 0.99. CONCLUSIONS: Despite several limitations, the French version of the ASI presents acceptable criteria of applicability, validity and reliability in a sample of drug-dependent patients.

Multilevel oblique corpectomy for cervical spondylotic myelopathy preserves segmental motion.

PURPOSE: To document the neurological outcome, spinal alignment and segmental range of movement after oblique cervical corpectomy (OCC) for cervical compressive myelopathy. METHODS: This retrospective study included 109 patients--93 with cervical spondylotic myelopathy and 16 with ossified posterior longitudinal ligament in whom spinal curvature and range of segmental movements were assessed on neutral and dynamic cervical radiographs. Neurological function was measured by Nurick's grade and modified Japanese Orthopedic Association (JOA) scores. Eighty-eight patients (81%) underwent either a single- or two-level corpectomy; the remaining (19%) undergoing three- or four-level corpectomies. The average duration of follow-up was 30.52 months. RESULTS: The Nurick's grade and the JOA scores showed statistically significant improvements after surgery (p < 0.001). The mean postoperative segmental angle in the neutral position straightened by 4.7 ± 6.5°. The residual segmental range of movement for a single-level corpectomy was 16.7° (59.7% of the preoperative value), for two-level corpectomy it was 20.0° (67.2%) and for three-level corpectomies it was 22.9° (74.3%). 63% of patients with lordotic spines continued to have lordosis postoperatively while only one became kyphotic without clinical worsening. Four patients with preoperative kyphotic spines showed no change in spine curvature. None developed spinal instability. CONCLUSIONS: The OCC preserves segmental motion in the short-term, however, the tendency towards straightening of the spine, albeit without clinical worsening, warrants serial follow-up imaging to determine whether this motion preservation is long lasting.

Beyond the insiders' circle: disseminating the results of adolescent health surveys.

Adolescent health surveys, like those for other segments of the population, tend to remain in the hands of researchers, where they can have no real impact on the way critical health issues are dealt with by policy makers or other professionals directly connected to young people in their everyday work. This paper reviews important issues concerning the dissemination of survey results among professionals from various fields. The content, length and wording of the messages should be tailored to the audience one wants to reach as well as the type of channels used for their diffusion. Survey data sets can be used to select priorities for interventions: ad hoc presentations, attractive summaries and brochures, or even films expressing young peoples' opinions have been used by European public health professionals to make data sets usable in various local, regional and national contexts. CONCLUSION: The impact of these diffusion strategies is, however, difficult to assess and needs to be refined. The adequate delivery of survey findings as well as advocacy and lobbying activities require specific skills which can be endorsed by specialized professionals. Ultimately, it is the researchers' responsibility to ensure that such tasks are effectively performed.

Variability of indication criteria in knee and hip replacement: an observational study

BACKGROUND. Total knee (TKR) and hip (THR) replacement (arthroplasty) are effective surgical procedures that relieve pain, improve patients' quality of life and increase functional capacity. Studies on variations in medical practice usually place the indications for performing these procedures to be highly variable, because surgeons appear to follow different criteria when recommending surgery in patients with different severity levels. We therefore proposed a study to evaluate inter-hospital variability in arthroplasty indication. METHODS. The pre-surgical condition of 1603 patients included was compared by their personal characteristics, clinical situation and self-perceived health status. Patients were asked to complete two health-related quality of life questionnaires: the generic SF-12 (Short Form) and the specific WOMAC (Western Ontario and Mcmaster Universities) scale. The type of patient undergoing primary arthroplasty was similar in the 15 different hospitals evaluated.The variability in baseline WOMAC score between hospitals in THR and TKR indication was described by range, mean and standard deviation (SD), mean and standard deviation weighted by the number of procedures at each hospital, high/low ratio or extremal quotient (EQ5-95), variation coefficient (CV5-95) and weighted variation coefficient (WCV5-95) for 5-95 percentile range. The variability in subjective and objective signs was evaluated using median, range and WCV5-95. The appropriateness of the procedures performed was calculated using a specific threshold proposed by Quintana et al for assessing pain and functional capacity. RESULTS. The variability expressed as WCV5-95 was very low, between 0.05 and 0.11 for all three dimensions on WOMAC scale for both types of procedure in all participating hospitals. The variability in the physical and mental SF-12 components was very low for both types of procedure (0.08 and 0.07 for hip and 0.03 and 0.07 for knee surgery patients). However, a moderate-high variability was detected in subjective-objective signs. Among all the surgeries performed, approximately a quarter of them could be considered to be inappropriate. CONCLUSIONS. A greater inter-hospital variability was observed for objective than for subjective signs for both procedures, suggesting that the differences in clinical criteria followed by surgeons when indicating arthroplasty are the main responsible factors for the variation in surgery rates.