Study design for technology assessment: critical issues.

The epidemiological methods have become useful tools for the assessment of the effectiveness and safety of health care technologies. The experimental methods, namely the randomized controlled trials (RCT), give the best evidence of the effect of a technology. However, the ethical issues and the very nature of the intervention under study sometimes make it difficult to carry out an RCT. Therefore, quasi-experimental and non-experimental study designs are also applied. The critical issues concerning these designs are discussed. The results of evaluative studies are of importance for decision-makers in health policy. The measurements of the impact of a medical technology should go beyond a statement of its effectiveness, because the essential outcome of an intervention or programme is the health status and quality of life of the individuals and populations concerned.

Coronary heart disease in primary care: accuracy of medical history and physical findings in patients with chest pain - a study protocol for a systematic review with individual patient data.

BACKGROUND: Chest pain is a common complaint in primary care, with coronary heart disease (CHD) being the most concerning of many potential causes. Systematic reviews on the sensitivity and specificity of symptoms and signs summarize the evidence about which of them are most useful in making a diagnosis. Previous meta-analyses are dominated by studies of patients referred to specialists. Moreover, as the analysis is typically based on study-level data, the statistical analyses in these reviews are limited while meta-analyses based on individual patient data can provide additional information. Our patient-level meta-analysis has three unique aims. First, we strive to determine the diagnostic accuracy of symptoms and signs for myocardial ischemia in primary care. Second, we investigate associations between study- or patient-level characteristics and measures of diagnostic accuracy. Third, we aim to validate existing clinical prediction rules for diagnosing myocardial ischemia in primary care. This article describes the methods of our study and six prospective studies of primary care patients with chest pain. Later articles will describe the main results. METHODS/DESIGN: We will conduct a systematic review and IPD meta-analysis of studies evaluating the diagnostic accuracy of symptoms and signs for diagnosing coronary heart disease in primary care. We will perform bivariate analyses to determine the sensitivity, specificity and likelihood ratios of individual symptoms and signs and multivariate analyses to explore the diagnostic value of an optimal combination of all symptoms and signs based on all data of all studies. We will validate existing clinical prediction rules from each of the included studies by calculating measures of diagnostic accuracy separately by study. DISCUSSION: Our study will face several methodological challenges. First, the number of studies will be limited. Second, the investigators of original studies defined some outcomes and predictors differently. Third, the studies did not collect the same standard clinical data set. Fourth, missing data, varying from partly missing to fully missing, will have to be dealt with.Despite these limitations, we aim to summarize the available evidence regarding the diagnostic accuracy of symptoms and signs for diagnosing CHD in patients presenting with chest pain in primary care. REVIEW REGISTRATION: Centre for Reviews and Dissemination (University of York): CRD42011001170.

Format of medical order sheet improves security of antibiotics prescription: The experience of an intensive care unit.

OBJECTIVE: To assess whether formatting the medical order sheet has an effect on the accuracy and security of antibiotics prescription. DESIGN: Prospective assessment of antibiotics prescription over time, before and after the intervention, in comparison with a control ward. SETTING: The medical and surgical intensive care unit (ICU) of a university hospital. PATIENTS: All patients hospitalized in the medical or surgical ICU between February 1 and April 30, 1997, and July 1 and August 31, 2000, for whom antibiotics were prescribed. INTERVENTION: Formatting of the medical order sheet in the surgical ICU in 1998. MEASUREMENTS AND MAIN RESULTS: Compliance with the American Society of Hospital Pharmacists' criteria for prescription safety was measured. The proportion of safe orders increased in both units, but the increase was 4.6 times greater in the surgical ICU (66% vs. 74% in the medical ICU and 48% vs. 74% in the surgical ICU). For unsafe orders, the proportion of ambiguous orders decreased by half in the medical ICU (9% vs. 17%) and nearly disappeared in the surgical ICU (1% vs. 30%). The only missing criterion remaining in the surgical ICU was the drug dose unit, which could not be preformatted. The aim of antibiotics prescription (either prophylactic or therapeutic) was indicated only in 51% of the order sheets. CONCLUSIONS: Formatting of the order sheet markedly increased security of antibiotics prescription. These findings must be confirmed in other settings and with different drug classes. Formatting the medical order sheet decreases the potential for prescribing errors before full computerized prescription is available.

Age-related differences in the use of guideline-recommended medical and interventional therapies for acute coronary syndromes: a cohort study.

OBJECTIVES: To compare the use of guideline-recommended medical and interventional therapies in older and younger patients with acute coronary syndromes (ACSs). DESIGN: Prospective cohort study. SETTING: Fifty-five hospitals in Switzerland. PARTICIPANTS: Eleven thousand nine hundred thirty-two patients with ACS enrolled between March 1, 2001, and June 30, 2006. ACS definition included ST-segment elevation myocardial infarction (STEMI), non-ST-segment elevation myocardial infarction (NSTEMI), and unstable angina pectoris (UA). MEASUREMENTS: Use of medical and interventional therapies was determined after exclusion of patients with contraindications and after adjustment for comorbidities. Multivariate logistic regression models were used to calculate odds ratios (ORs) per year increase in age. RESULTS: Elderly patients were less likely to receive acetylsalicylic acid (OR=0.976, 95% confidence interval (CI)=0.969-0.980) or beta-blockers (OR=0.985, 95% CI=0.981-0.989). No age-dependent difference was found for heparin use. Elderly patients with STEMI were less likely to receive percutaneous coronary intervention (PCI) or thrombolysis (OR=0.955, 95% CI=0.949-0.961). Elderly patients with NSTEMI or UA less often underwent PCI (OR=0.943, 95% CI=0.937-0.949). CONCLUSION: Elderly patients across the whole spectrum of ACS were less likely to receive guideline-recommended therapies, even after adequate adjustment for comorbidities. Prognosis of elderly patients with ACS may be improved by increasing adherence to guideline-recommended medical and interventional therapies.

Continuous electroencephalography in the medical intensive care unit.

OBJECTIVES: To examine predictors and the prognostic value of electrographic seizures (ESZs) and periodic epileptiform discharges (PEDs) in medical intensive care unit (MICU) patients without a primary acute neurologic condition. DESIGN: Retrospective study. SETTING: MICU in a university hospital. PATIENTS: A total of 201 consecutive patients admitted to the MICU between July 2004 and January 2007 without known acute neurologic injury and who underwent continuous electroencephalography monitoring (cEEG) for investigation of possible seizures or changes in mental status. INTERVENTION: None. MEASUREMENTS AND MAIN RESULTS: Median time from intensive care unit (ICU) admission to cEEG was 1 day (interquartile range 1-4). The majority of patients (60%) had sepsis as the primary admission diagnosis and 48% were comatose at the time of cEEG. Ten percent (n = 21) of patients had ESZs, 17% (n = 34) had PEDs, 5% (n = 10) had both, and 22% (n = 45) had either ESZs or PEDs. Seizures during cEEG were purely electrographic (no detectable clinical correlate) in the majority (67%) of patients. Patients with sepsis had a higher rate of ESZs or PEDs than those without sepsis (32% vs. 9%, p < 0.001). On multivariable analysis, sepsis at ICU admission was the only significant predictor of ESZs or PEDs (odds ratio 4.6, 95% confidence interval 1.9-12.7, p = 0.002). After controlling for age, coma, and organ dysfunction, the presence of ESZs or PEDs was associated with death or severe disability at hospital discharge (89% with ESZs or PEDs, vs. 39% if not; odds ratio 19.1, 95% confidence interval 6.3-74.6, p < 0.001). CONCLUSION: In this retrospective study of MICU patients monitored with cEEG, ESZs and PEDs were frequent, predominantly in patients with sepsis. Seizures were mainly nonconvulsive. Both seizures and periodic discharges were associated with poor outcome. Prospective studies are warranted to determine more precisely the frequency and clinical impact of nonconvulsive seizures and periodic discharges, particularly in septic patients.

Medical appropriateness of hospital utilization: an overview of the Swiss experience.

We present here the principal results of four concurrent hospital utilization reviews conducted in Switzerland in 1990 and 1991, based on an adapted Appropriateness Evaluation Protocol. The studies were performed on all the hospital days from a sample of patients admitted over a 6 month period. The level of inappropriate use ranged between 8 and 15% in terms of days and was consistently higher in medicine than in surgery. In comparison with other published studies, the low proportion of observed inappropriate days is probably due, at least partly, to differences in study design.

Virtual autopsy with multiphase postmortem computed tomographic angiography versus traditional medical autopsy to investigate unexpected deaths of hospitalized patients: a cohort study.

BACKGROUND: "Virtual" autopsy by postmortem computed tomography (PMCT) can replace medical autopsy to a certain extent but has limitations for cardiovascular diseases. These limitations might be overcome by adding multiphase PMCT angiography. OBJECTIVE: To compare virtual autopsy by multiphase PMCT angiography with medical autopsy. DESIGN: Prospective cohort study. (ClinicalTrials.gov: NCT01541995) SETTING: Single-center study at the University Medical Center Hamburg-Eppendorf, Hamburg, Germany, between 1 April 2012 and 31 March 2013. PATIENTS: Hospitalized patients who died unexpectedly or within 48 hours of an event necessitating cardiopulmonary resuscitation. MEASUREMENTS: Diagnoses from clinical records were compared with findings from both types of autopsy. New diagnoses identified by autopsy were classified as major or minor, depending on whether they would have altered clinical management. RESULTS: Of 143 eligible patients, 50 (35%) had virtual and medical autopsy. Virtual autopsy confirmed 93% of all 336 diagnoses identified from antemortem medical records, and medical autopsy confirmed 80%. In addition, virtual and medical autopsy identified 16 new major and 238 new minor diagnoses. Seventy-three of the virtual autopsy diagnoses, including 32 cases of coronary artery stenosis, were identified solely by multiphase PMCT angiography. Of the 114 clinical diagnoses classified as cardiovascular, 110 were confirmed by virtual autopsy and 107 by medical autopsy. In 11 cases, multiphase PMCT angiography showed "unspecific filling defects," which were not reported by medical autopsy. LIMITATION: These results come from a single center with concerted interest and expertise in postmortem imaging; further studies are thus needed for generalization. CONCLUSION: In cases of unexpected death, the addition of multiphase PMCT angiography increases the value of virtual autopsy, making it a feasible alternative for quality control and identification of diagnoses traditionally made by medical autopsy. PRIMARY FUNDING SOURCE: University Medical Center Hamburg-Eppendorf.

The effect of non-medical factors on variations in the performance of colonoscopy among different health care settings

BACKGROUND: Previous published studies have shown significant variations in colonoscopy performance, even when medical factors are taken into account. This study aimed to examine the role of nonmedical factors (ie, embodied in health care system design) as possible contributors to variations in colonoscopy performance. METHODS: Patient data from a multicenter observational study conducted between 2000 and 2002 in 21 centers in 11 western countries were used. Variability was captured through 2 performance outcomes (diagnostic yield and colonoscopy withdrawal time), jointly studied as dependent variables, using a multilevel 2-equation system. RESULTS: Results showed that open-access systems and high-volume colonoscopy centers were independently associated with a higher likelihood of detecting significant lesions and longer withdrawal durations. Fee for service (FFS) payment was associated with shorter withdrawal durations, and so had an indirect negative impact on the diagnostic yield. Teaching centers exhibited lower detection rates and longer withdrawal times. CONCLUSIONS: Our results suggest that gatekeeping colonoscopy is likely to miss patients with significant lesions and that developing specialized colonoscopy units is important to improve performance. Results also suggest that FFS may result in a lower quality of care in colonoscopy practice and highlight the fact that longer withdrawal times do not necessarily indicate higher quality in teaching centers.

Healthcare utilization of elderly persons hospitalized after a noninjurious fall in a Swiss academic medical center.

OBJECTIVES: To determine the risk of hospital readmission, nursing home admission, and death, as well as health services utilization over a 6-month follow-up, in community-dwelling elderly persons hospitalized after a noninjurious fall. DESIGN: Prospective cohort study with 6-month follow-up. SETTING: Swiss academic medical center. PARTICIPANTS: Six hundred ninety persons aged 75 and older hospitalized through the emergency department. MEASUREMENTS: Data on demographics and medical, physical, social, and mental status were collected upon admission. Follow-up data were collected from the state centralized billing system (hospital and nursing home admission) and proxies (death). RESULTS: Seventy patients (10%) were hospitalized after a noninjurious fall. Fallers had shorter hospital stays (median 4 vs 8 days, P<.001) and were more frequently discharged to rehabilitation or respite care than nonfallers. During follow-up, fallers were more likely to be institutionalized (adjusted hazard ratio=1.82, 95% confidence interval=1.03-3.19, P=.04) independent of comorbidity and functional and mental status. Overall institutional costs (averaged per day of follow-up) were similar for both groups ($138.5 vs $148.7, P=.66), but fallers had lower hospital costs and significantly higher rehabilitation and long-term care costs ($55.5 vs $24.1, P<.001), even after adjustment for comorbidity, living situation, and functional and cognitive status. CONCLUSION: Elderly patients hospitalized after a noninjurious fall were twice as likely to be institutionalized as those admitted for other medical conditions and had higher intermediate and long-term care services utilization during follow-up, independent of functional and health status. These results provide direction for interventions needed to delay or prevent institutionalization and reduce subsequent costs.

Impact of medical practice guidelines on the assessment of patients with acute coronary syndrome without persistent ST segment elevation.

OBJECTIVE: To assess the impact of introducing clinical practice guidelines on acute coronary syndrome without persistent ST segment elevation (ACS) on patient initial assessment. DESIGN: Prospective before-after evaluation over a 3-month period. SETTING: The emergency ward of a tertiary teaching hospital. PATIENTS: All consecutive patients with ACS evaluated in the emergency ward over the two 3-month periods. INTERVENTION: Implementation of the practice guidelines, and the addition of a cardiology consultant to the emergency team. MAIN OUTCOME MEASURES: Diagnosis, electrocardiogram interpretation, and risk stratification after the initial evaluation. RESULTS: The clinical characteristics of the 328 and 364 patients evaluated in the emergency ward for suspicion of ACS before and after guideline implementation were similar. Significantly more patients were classified as suffering from atypical chest pain (39.6% versus 47.0%; P = 0.006) after guideline implementation. Guidelines availability was associated with significantly more formal diagnoses (79.9% versus 92.9%; P < 0.0001) and risk stratification (53.7% versus 65.4%, P < 0.0001) at the end of initial assessment. CONCLUSION: Guidelines implementation, along with availability of a cardiology consultant in the emergency room had a positive impact on initial assessment of patients evaluated for suspicion of ACS. It led to increased confidence in diagnosis and stratification by risk, which are the first steps in initiating effective treatment for this common condition.

Test result-based sampling: an efficient design for estimating the accuracy of patient safety indicators.

OBJECTIVE: Accuracy studies of Patient Safety Indicators (PSIs) are critical but limited by the large samples required due to low occurrence of most events. We tested a sampling design based on test results (verification-biased sampling [VBS]) that minimizes the number of subjects to be verified. METHODS: We considered 3 real PSIs, whose rates were calculated using 3 years of discharge data from a university hospital and a hypothetical screen of very rare events. Sample size estimates, based on the expected sensitivity and precision, were compared across 4 study designs: random and VBS, with and without constraints on the size of the population to be screened. RESULTS: Over sensitivities ranging from 0.3 to 0.7 and PSI prevalence levels ranging from 0.02 to 0.2, the optimal VBS strategy makes it possible to reduce sample size by up to 60% in comparison with simple random sampling. For PSI prevalence levels below 1%, the minimal sample size required was still over 5000. CONCLUSIONS: Verification-biased sampling permits substantial savings in the required sample size for PSI validation studies. However, sample sizes still need to be very large for many of the rarer PSIs.

Learning from failure - rationale and design for a study about discontinuation of randomized trials (DISCO study).

BACKGROUND: Randomized controlled trials (RCTs) may be discontinued because of apparent harm, benefit, or futility. Other RCTs are discontinued early because of insufficient recruitment. Trial discontinuation has ethical implications, because participants consent on the premise of contributing to new medical knowledge, Research Ethics Committees (RECs) spend considerable effort reviewing study protocols, and limited resources for conducting research are wasted. Currently, little is known regarding the frequency and characteristics of discontinued RCTs. METHODS/DESIGN: Our aims are, first, to determine the prevalence of RCT discontinuation for specific reasons; second, to determine whether the risk of RCT discontinuation for specific reasons differs between investigator- and industry-initiated RCTs; third, to identify risk factors for RCT discontinuation due to insufficient recruitment; fourth, to determine at what stage RCTs are discontinued; and fifth, to examine the publication history of discontinued RCTs.We are currently assembling a multicenter cohort of RCTs based on protocols approved between 2000 and 2002/3 by 6 RECs in Switzerland, Germany, and Canada. We are extracting data on RCT characteristics and planned recruitment for all included protocols. Completion and publication status is determined using information from correspondence between investigators and RECs, publications identified through literature searches, or by contacting the investigators. We will use multivariable regression models to identify risk factors for trial discontinuation due to insufficient recruitment. We aim to include over 1000 RCTs of which an anticipated 150 will have been discontinued due to insufficient recruitment. DISCUSSION: Our study will provide insights into the prevalence and characteristics of RCTs that were discontinued. Effective recruitment strategies and the anticipation of problems are key issues in the planning and evaluation of trials by investigators, Clinical Trial Units, RECs and funding agencies. Identification and modification of barriers to successful study completion at an early stage could help to reduce the risk of trial discontinuation, save limited resources, and enable RCTs to better meet their ethical requirements.

A systematic review of glomerular hyperfiltration assessment and definition in the medical literature.

BACKGROUND AND OBJECTIVES: Evaluation of glomerular hyperfiltration (GH) is difficult; the variable reported definitions impede comparisons between studies. A clear and universal definition of GH would help in comparing results of trials aimed at reducing GH. This study assessed how GH is measured and defined in the literature. DESIGN, SETTING, PARTICIPANTS, & MEASUREMENTS: Three databases (Embase, MEDLINE, CINAHL) were systematically searched using the terms "hyperfiltration" or "glomerular hyperfiltration". All studies reporting a GH threshold or studying the effect of a high GFR in a continuous manner against another outcome of interest were included. RESULTS: The literature search was performed from November 2012 to February 2013 and updated in August 2014. From 2013 retrieved studies, 405 studies were included. Threshold use to define GH was reported in 55.6% of studies. Of these, 88.4% used a single threshold and 11.6% used numerous thresholds adapted to participant sex or age. In 29.8% of the studies, the choice of a GH threshold was not based on a control group or literature references. After 2004, the use of GH threshold use increased (P<0.001), but the use of a control group to precisely define that GH threshold decreased significantly (P<0.001); the threshold did not differ among pediatric, adult, or mixed-age studies. The GH threshold ranged from 90.7 to 175 ml/min per 1.73 m(2) (median, 135 ml/min per 1.73 m(2)). CONCLUSION: Thirty percent of studies did not justify the choice of threshold values. The decrease of GFR in the elderly was rarely considered in defining GH. From a methodologic point of view, an age- and sex-matched control group should be used to define a GH threshold.

Improving breast cancer education: the case of an evolving multidisciplinary module for undergraduate medical students (lausanne medical school, 1993-2008).

Breast cancer is a public health issue in numerous countries. Multidisciplinary collaboration is required for patient care, research, and also education of future physicians. This paper uses Kern's framework for curriculum design to demonstrate how a breast diseases module for undergraduate medical students created in 1993 evolved over 15 years. The main outcomes of program refinements were better integrated course content, the development of electronic course documents, and implementation of computer-aided small group learning. A main future challenge is to further develop efficient instructional strategies in line with well-defined learning needs for undergraduate students.

Medical and pharmacological direct costs of a 9-week smoking cessation programme.

Background: Medical and pharmacological direct costs of cigarette smoking cessation programmes are not covered by health insurance in several countries despite documented cost-effectiveness. Design: prospective cost identification study of a 9-week programme in Switzerland. Methods: A total of 481 smokers were followed-up for 9 weeks. Socio-demographic characteristics, number of outpatient visits, dosage and frequency of use of nicotine replacement therapy (NRT) as well as date of relapse were prospectively collected. Individual cost of care until relapse or programme end as well as cost per week of follow-up were computed. Comparisons were carried out between the groups with or without relapse at the end of the programme. Results: Of the 209 men and 272 women included, 347 patients (72%) finished the programme. Among them, 240 patients (70%) succeeded in quitting and 107 patients (30%) relapsed. As compared with the group relapsing by the end of the programme, the group succeeding in quitting was more often living in a couple (68% vs. 55%, p = 0.029). Their mean weekly costs of visits were higher (CHF 81.2 ± 6.1 vs. 78.4 ± 7.6, p = 0.001), while their mean weekly costs for NRT were similar (CHF 24.2 ± 12.6 vs. 25.4 ± 15.9, p = 0.711). Mean total costs per week were similar (CHF 105.4 ± 15.4 vs. 103.8 ± 19.4, p = 0.252). More intensive NRT at week 4 increased the probability not to relapse at the end of the programme. Conclusions: Over 9 weeks, medical and pharmacological costs of stopping smoking are low. Good medical and social support as well as adequate NRT seem to play a role in successful quitting.