Quantifying data quality for clinical trials using electronic data capture.

BACKGROUND: Historically, only partial assessments of data quality have been performed in clinical trials, for which the most common method of measuring database error rates has been to compare the case report form (CRF) to database entries and count discrepancies. Importantly, errors arising from medical record abstraction and transcription are rarely evaluated as part of such quality assessments. Electronic Data Capture (EDC) technology has had a further impact, as paper CRFs typically leveraged for quality measurement are not used in EDC processes. METHODS AND PRINCIPAL FINDINGS: The National Institute on Drug Abuse Treatment Clinical Trials Network has developed, implemented, and evaluated methodology for holistically assessing data quality on EDC trials. We characterize the average source-to-database error rate (14.3 errors per 10,000 fields) for the first year of use of the new evaluation method. This error rate was significantly lower than the average of published error rates for source-to-database audits, and was similar to CRF-to-database error rates reported in the published literature. We attribute this largely to an absence of medical record abstraction on the trials we examined, and to an outpatient setting characterized by less acute patient conditions. CONCLUSIONS: Historically, medical record abstraction is the most significant source of error by an order of magnitude, and should be measured and managed during the course of clinical trials. Source-to-database error rates are highly dependent on the amount of structured data collection in the clinical setting and on the complexity of the medical record, dependencies that should be considered when developing data quality benchmarks.

Expert assessments of retrofitting coal-fired power plants with carbon dioxide capture technologies

A set of 13 US based experts in post-combustion and oxy-fuel combustion CO2 capture systems responded to an extensive questionnaire asking their views on the present status and future expected performance and costs for amine-based, chilled ammonia, and oxy-combustion retrofits of coal-fired power plants. This paper presents the experts' responses for technology maturity, ideal plant characteristics for early adopters, and the extent to which R&D and deployment incentives will impact costs. It also presents the best estimates and 95% confidence limits of the energy penalties associated with amine-based systems. The results show a general consensus that amine-based systems are closer to commercial application, but potential for improving performance and lowering costs is limited; chilled ammonia and oxy-combustion offer greater potential for cost reductions, but not without greater uncertainty regarding scale and technical feasibility. © 2011 Elsevier Ltd.

STAR 3 randomized controlled trial to compare sensor-augmented insulin pump therapy with multiple daily injections in the treatment of type 1 diabetes: research design, methods, and baseline characteristics of enrolled subjects.

BACKGROUND: Sensor-augmented pump therapy (SAPT) integrates real-time continuous glucose monitoring (RT-CGM) with continuous subcutaneous insulin infusion (CSII) and offers an alternative to multiple daily injections (MDI). Previous studies provide evidence that SAPT may improve clinical outcomes among people with type 1 diabetes. Sensor-Augmented Pump Therapy for A1c Reduction (STAR) 3 is a multicenter randomized controlled trial comparing the efficacy of SAPT to that of MDI in subjects with type 1 diabetes. METHODS: Subjects were randomized to either continue with MDI or transition to SAPT for 1 year. Subjects in the MDI cohort were allowed to transition to SAPT for 6 months after completion of the study. SAPT subjects who completed the study were also allowed to continue for 6 months. The primary end point was the difference between treatment groups in change in hemoglobin A1c (HbA1c) percentage from baseline to 1 year of treatment. Secondary end points included percentage of subjects with HbA1c < or =7% and without severe hypoglycemia, as well as area under the curve of time spent in normal glycemic ranges. Tertiary end points include percentage of subjects with HbA1c < or =7%, key safety end points, user satisfaction, and responses on standardized assessments. RESULTS: A total of 495 subjects were enrolled, and the baseline characteristics similar between the SAPT and MDI groups. Study completion is anticipated in June 2010. CONCLUSIONS: Results of this randomized controlled trial should help establish whether an integrated RT-CGM and CSII system benefits patients with type 1 diabetes more than MDI.

Clinical practice guidelines for the management of cryptococcal disease: 2010 update by the infectious diseases society of america.

Cryptococcosis is a global invasive mycosis associated with significant morbidity and mortality. These guidelines for its management have been built on the previous Infectious Diseases Society of America guidelines from 2000 and include new sections. There is a discussion of the management of cryptococcal meningoencephalitis in 3 risk groups: (1) human immunodeficiency virus (HIV)-infected individuals, (2) organ transplant recipients, and (3) non-HIV-infected and nontransplant hosts. There are specific recommendations for other unique risk populations, such as children, pregnant women, persons in resource-limited environments, and those with Cryptococcus gattii infection. Recommendations for management also include other sites of infection, including strategies for pulmonary cryptococcosis. Emphasis has been placed on potential complications in management of cryptococcal infection, including increased intracranial pressure, immune reconstitution inflammatory syndrome (IRIS), drug resistance, and cryptococcomas. Three key management principles have been articulated: (1) induction therapy for meningoencephalitis using fungicidal regimens, such as a polyene and flucytosine, followed by suppressive regimens using fluconazole; (2) importance of early recognition and treatment of increased intracranial pressure and/or IRIS; and (3) the use of lipid formulations of amphotericin B regimens in patients with renal impairment. Cryptococcosis remains a challenging management issue, with little new drug development or recent definitive studies. However, if the diagnosis is made early, if clinicians adhere to the basic principles of these guidelines, and if the underlying disease is controlled, then cryptococcosis can be managed successfully in the vast majority of patients.

Safety, tolerability, and mechanisms of antiretroviral activity of pegylated interferon Alfa-2a in HIV-1-monoinfected participants: a phase II clinical trial.

BACKGROUND: To our knowledge, the antiviral activity of pegylated interferon alfa-2a has not been studied in participants with untreated human immunodeficiency virus type 1 (HIV-1) infection but without chronic hepatitis C virus (HCV) infection. METHODS: Untreated HIV-1-infected volunteers without HCV infection received 180 microg of pegylated interferon alfa-2a weekly for 12 weeks. Changes in plasma HIV-1 RNA load, CD4(+) T cell counts, pharmacokinetics, pharmacodynamic measurements of 2',5'-oligoadenylate synthetase (OAS) activity, and induction levels of interferon-inducible genes (IFIGs) were measured. Nonparametric statistical analysis was performed. RESULTS: Eleven participants completed 12 weeks of therapy. The median plasma viral load decrease and change in CD4(+) T cell counts at week 12 were 0.61 log(10) copies/mL (90% confidence interval [CI], 0.20-1.18 log(10) copies/mL) and -44 cells/microL (90% CI, -95 to 85 cells/microL), respectively. There was no correlation between plasma viral load decreases and concurrent pegylated interferon plasma concentrations. However, participants with larger increases in OAS level exhibited greater decreases in plasma viral load at weeks 1 and 2 (r = -0.75 [90% CI, -0.93 to -0.28] and r = -0.61 [90% CI, -0.87 to -0.09], respectively; estimated Spearman rank correlation). Participants with higher baseline IFIG levels had smaller week 12 decreases in plasma viral load (0.66 log(10) copies/mL [90% CI, 0.06-0.91 log(10) copies/mL]), whereas those with larger IFIG induction levels exhibited larger decreases in plasma viral load (-0.74 log(10) copies/mL [90% CI, -0.93 to -0.21 log(10) copies/mL]). CONCLUSION: Pegylated interferon alfa-2a was well tolerated and exhibited statistically significant anti-HIV-1 activity in HIV-1-monoinfected patients. The anti-HIV-1 effect correlated with OAS protein levels (weeks 1 and 2) and IFIG induction levels (week 12) but not with pegylated interferon concentrations.

3D refraction correction and extraction of clinical parameters from spectral domain optical coherence tomography of the cornea.

Capable of three-dimensional imaging of the cornea with micrometer-scale resolution, spectral domain-optical coherence tomography (SDOCT) offers potential advantages over Placido ring and Scheimpflug photography based systems for accurate extraction of quantitative keratometric parameters. In this work, an SDOCT scanning protocol and motion correction algorithm were implemented to minimize the effects of patient motion during data acquisition. Procedures are described for correction of image data artifacts resulting from 3D refraction of SDOCT light in the cornea and from non-idealities of the scanning system geometry performed as a pre-requisite for accurate parameter extraction. Zernike polynomial 3D reconstruction and a recursive half searching algorithm (RHSA) were implemented to extract clinical keratometric parameters including anterior and posterior radii of curvature, central cornea optical power, central corneal thickness, and thickness maps of the cornea. Accuracy and repeatability of the extracted parameters obtained using a commercial 859nm SDOCT retinal imaging system with a corneal adapter were assessed using a rigid gas permeable (RGP) contact lens as a phantom target. Extraction of these parameters was performed in vivo in 3 patients and compared to commercial Placido topography and Scheimpflug photography systems. The repeatability of SDOCT central corneal power measured in vivo was 0.18 Diopters, and the difference observed between the systems averaged 0.1 Diopters between SDOCT and Scheimpflug photography, and 0.6 Diopters between SDOCT and Placido topography.

The lung cancer exercise training study: a randomized trial of aerobic training, resistance training, or both in postsurgical lung cancer patients: rationale and design.

BACKGROUND: The Lung Cancer Exercise Training Study (LUNGEVITY) is a randomized trial to investigate the efficacy of different types of exercise training on cardiorespiratory fitness (VO2peak), patient-reported outcomes, and the organ components that govern VO2peak in post-operative non-small cell lung cancer (NSCLC) patients. METHODS/DESIGN: Using a single-center, randomized design, 160 subjects (40 patients/study arm) with histologically confirmed stage I-IIIA NSCLC following curative-intent complete surgical resection at Duke University Medical Center (DUMC) will be potentially eligible for this trial. Following baseline assessments, eligible participants will be randomly assigned to one of four conditions: (1) aerobic training alone, (2) resistance training alone, (3) the combination of aerobic and resistance training, or (4) attention-control (progressive stretching). The ultimate goal for all exercise training groups will be 3 supervised exercise sessions per week an intensity above 70% of the individually determined VO2peak for aerobic training and an intensity between 60 and 80% of one-repetition maximum for resistance training, for 30-45 minutes/session. Progressive stretching will be matched to the exercise groups in terms of program length (i.e., 16 weeks), social interaction (participants will receive one-on-one instruction), and duration (30-45 mins/session). The primary study endpoint is VO2peak. Secondary endpoints include: patient-reported outcomes (PROs) (e.g., quality of life, fatigue, depression, etc.) and organ components of the oxygen cascade (i.e., pulmonary function, cardiac function, skeletal muscle function). All endpoints will be assessed at baseline and postintervention (16 weeks). Substudies will include genetic studies regarding individual responses to an exercise stimulus, theoretical determinants of exercise adherence, examination of the psychological mediators of the exercise - PRO relationship, and exercise-induced changes in gene expression. DISCUSSION: VO2peak is becoming increasingly recognized as an outcome of major importance in NSCLC. LUNGEVITY will identify the optimal form of exercise training for NSCLC survivors as well as provide insight into the physiological mechanisms underlying this effect. Overall, this study will contribute to the establishment of clinical exercise therapy rehabilitation guidelines for patients across the entire NSCLC continuum. TRIAL REGISTRATION: NCT00018255.

Risk communication in clinical trials: a cognitive experiment and a survey.

BACKGROUND: A Royal Statistical Society Working Party recently recommended that "Greater use should be made of numerical, as opposed to verbal, descriptions of risk" in first-in-man clinical trials. This echoed the view of many clinicians and psychologists about risk communication. As the clinical trial industry expands rapidly across the globe, it is important to understand risk communication in Asian countries. METHODS: We conducted a cognitive experiment about participation in a hypothetical clinical trial of a pain relief medication and a survey in cancer and arthritis patients in Singapore. In part 1 of the experiment, the patients received information about the risk of side effects in one of three formats (frequency, percentage and verbal descriptor) and in one of two sequences (from least to most severe and from most to least severe), and were asked about their willingness to participate. In part 2, the patients received information about the risk in all three formats, in the same sequence, and were again asked about their willingness to participate. A survey of preference for risk presentation methods and usage of verbal descriptors immediately followed. RESULTS: Willingness to participate and the likelihood of changing one's decision were not affected by the risk presentation methods. Most patients indicated a preference for the frequency format, but patients with primary school or no formal education were indifferent. While the patients used the verbal descriptors "very common", "common" and "very rare" in ways similar to the European Commission's Guidelines, their usage of the descriptors "uncommon" and "rare" was substantially different from the EU's. CONCLUSION: In this sample of Asian cancer and arthritis patients, risk presentation format had no impact on willingness to participate in a clinical trial. However, there is a clear preference for the frequency format. The lay use of verbal descriptors was substantially different from the EU's.

Study protocol: home-based telehealth stroke care: a randomized trial for veterans.

BACKGROUND: Stroke is one of the most disabling and costly impairments of adulthood in the United States. Stroke patients clearly benefit from intensive inpatient care, but due to the high cost, there is considerable interest in implementing interventions to reduce hospital lengths of stay. Early discharge rehabilitation programs require coordinated, well-organized home-based rehabilitation, yet lack of sufficient information about the home setting impedes successful rehabilitation. This trial examines a multifaceted telerehabilitation (TR) intervention that uses telehealth technology to simultaneously evaluate the home environment, assess the patient's mobility skills, initiate rehabilitative treatment, prescribe exercises tailored for stroke patients and provide periodic goal oriented reassessment, feedback and encouragement. METHODS: We describe an ongoing Phase II, 2-arm, 3-site randomized controlled trial (RCT) that determines primarily the effect of TR on physical function and secondarily the effect on disability, falls-related self-efficacy, and patient satisfaction. Fifty participants with a diagnosis of ischemic or hemorrhagic stroke will be randomly assigned to one of two groups: (a) TR; or (b) Usual Care. The TR intervention uses a combination of three videotaped visits and five telephone calls, an in-home messaging device, and additional telephonic contact as needed over a 3-month study period, to provide a progressive rehabilitative intervention with a treatment goal of safe functional mobility of the individual within an accessible home environment. Dependent variables will be measured at baseline, 3-, and 6-months and analyzed with a linear mixed-effects model across all time points. DISCUSSION: For patients recovering from stroke, the use of TR to provide home assessments and follow-up training in prescribed equipment has the potential to effectively supplement existing home health services, assist transition to home and increase efficiency. This may be particularly relevant when patients live in remote locations, as is the case for many veterans. TRIAL REGISTRATION: Clinical Trials.gov Identifier: NCT00384748.

Missing data in randomized clinical trials for weight loss: scope of the problem, state of the field, and performance of statistical methods.

BACKGROUND: Dropouts and missing data are nearly-ubiquitous in obesity randomized controlled trails, threatening validity and generalizability of conclusions. Herein, we meta-analytically evaluate the extent of missing data, the frequency with which various analytic methods are employed to accommodate dropouts, and the performance of multiple statistical methods. METHODOLOGY/PRINCIPAL FINDINGS: We searched PubMed and Cochrane databases (2000-2006) for articles published in English and manually searched bibliographic references. Articles of pharmaceutical randomized controlled trials with weight loss or weight gain prevention as major endpoints were included. Two authors independently reviewed each publication for inclusion. 121 articles met the inclusion criteria. Two authors independently extracted treatment, sample size, drop-out rates, study duration, and statistical method used to handle missing data from all articles and resolved disagreements by consensus. In the meta-analysis, drop-out rates were substantial with the survival (non-dropout) rates being approximated by an exponential decay curve (e(-lambdat)) where lambda was estimated to be .0088 (95% bootstrap confidence interval: .0076 to .0100) and t represents time in weeks. The estimated drop-out rate at 1 year was 37%. Most studies used last observation carried forward as the primary analytic method to handle missing data. We also obtained 12 raw obesity randomized controlled trial datasets for empirical analyses. Analyses of raw randomized controlled trial data suggested that both mixed models and multiple imputation performed well, but that multiple imputation may be more robust when missing data are extensive. CONCLUSION/SIGNIFICANCE: Our analysis offers an equation for predictions of dropout rates useful for future study planning. Our raw data analyses suggests that multiple imputation is better than other methods for handling missing data in obesity randomized controlled trials, followed closely by mixed models. We suggest these methods supplant last observation carried forward as the primary method of analysis.

Application description and policy model in collaborative environment for sharing of information on epidemiological and clinical research data sets.

BACKGROUND: Sharing of epidemiological and clinical data sets among researchers is poor at best, in detriment of science and community at large. The purpose of this paper is therefore to (1) describe a novel Web application designed to share information on study data sets focusing on epidemiological clinical research in a collaborative environment and (2) create a policy model placing this collaborative environment into the current scientific social context. METHODOLOGY: The Database of Databases application was developed based on feedback from epidemiologists and clinical researchers requiring a Web-based platform that would allow for sharing of information about epidemiological and clinical study data sets in a collaborative environment. This platform should ensure that researchers can modify the information. A Model-based predictions of number of publications and funding resulting from combinations of different policy implementation strategies (for metadata and data sharing) were generated using System Dynamics modeling. PRINCIPAL FINDINGS: The application allows researchers to easily upload information about clinical study data sets, which is searchable and modifiable by other users in a wiki environment. All modifications are filtered by the database principal investigator in order to maintain quality control. The application has been extensively tested and currently contains 130 clinical study data sets from the United States, Australia, China and Singapore. Model results indicated that any policy implementation would be better than the current strategy, that metadata sharing is better than data-sharing, and that combined policies achieve the best results in terms of publications. CONCLUSIONS: Based on our empirical observations and resulting model, the social network environment surrounding the application can assist epidemiologists and clinical researchers contribute and search for metadata in a collaborative environment, thus potentially facilitating collaboration efforts among research communities distributed around the globe.

Qualitative analysis of the interdisciplinary interaction between data analysis specialists and novice clinical researchers.

BACKGROUND: The inherent complexity of statistical methods and clinical phenomena compel researchers with diverse domains of expertise to work in interdisciplinary teams, where none of them have a complete knowledge in their counterpart's field. As a result, knowledge exchange may often be characterized by miscommunication leading to misinterpretation, ultimately resulting in errors in research and even clinical practice. Though communication has a central role in interdisciplinary collaboration and since miscommunication can have a negative impact on research processes, to the best of our knowledge, no study has yet explored how data analysis specialists and clinical researchers communicate over time. METHODS/PRINCIPAL FINDINGS: We conducted qualitative analysis of encounters between clinical researchers and data analysis specialists (epidemiologist, clinical epidemiologist, and data mining specialist). These encounters were recorded and systematically analyzed using a grounded theory methodology for extraction of emerging themes, followed by data triangulation and analysis of negative cases for validation. A policy analysis was then performed using a system dynamics methodology looking for potential interventions to improve this process. Four major emerging themes were found. Definitions using lay language were frequently employed as a way to bridge the language gap between the specialties. Thought experiments presented a series of "what if" situations that helped clarify how the method or information from the other field would behave, if exposed to alternative situations, ultimately aiding in explaining their main objective. Metaphors and analogies were used to translate concepts across fields, from the unfamiliar to the familiar. Prolepsis was used to anticipate study outcomes, thus helping specialists understand the current context based on an understanding of their final goal. CONCLUSION/SIGNIFICANCE: The communication between clinical researchers and data analysis specialists presents multiple challenges that can lead to errors.

What leads Indians to participate in clinical trials? A meta-analysis of qualitative studies.

BACKGROUND: With the globalization of clinical trials, large developing nations have substantially increased their participation in multi-site studies. This participation has raised ethical concerns, among them the fear that local customs, habits and culture are not respected while asking potential participants to take part in study. This knowledge gap is particularly noticeable among Indian subjects, since despite the large number of participants, little is known regarding what factors affect their willingness to participate in clinical trials. METHODS: We conducted a meta-analysis of all studies evaluating the factors and barriers, from the perspective of potential Indian participants, contributing to their participation in clinical trials. We searched both international as well as Indian-specific bibliographic databases, including Pubmed, Cochrane, Openjgate, MedInd, Scirus and Medknow, also performing hand searches and communicating with authors to obtain additional references. We enrolled studies dealing exclusively with the participation of Indians in clinical trials. Data extraction was conducted by three researchers, with disagreement being resolved by consensus. RESULTS: Six qualitative studies and one survey were found evaluating the main themes affecting the participation of Indian subjects. Themes included Personal health benefits, Altruism, Trust in physicians, Source of extra income, Detailed knowledge, Methods for motivating participants as factors favoring, while Mistrust on trial organizations, Concerns about efficacy and safety of trials, Psychological reasons, Trial burden, Loss of confidentiality, Dependency issues, Language as the barriers. CONCLUSION: We identified factors that facilitated and barriers that have negative implications on trial participation decisions in Indian subjects. Due consideration and weightage should be assigned to these factors while planning future trials in India.

Immunization with cocktail of HIV-derived peptides in montanide ISA-51 is immunogenic, but causes sterile abscesses and unacceptable reactogenicity.

BACKGROUND: A peptide vaccine was produced containing B and T cell epitopes from the V3 and C4 Envelope domains of 4 subtype B HIV-1 isolates (MN, RF, CanO, & Ev91). The peptide mixture was formulated as an emulsion in incomplete Freund's adjuvant (IFA). METHODS: Low-risk, healthy adult subjects were enrolled in a randomized, placebo-controlled dose-escalation study, and selected using criteria specifying that 50% in each study group would be HLA-B7+. Immunizations were scheduled at 0, 1, and 6 months using a total peptide dose of 1 or 4 mg. Adaptive immune responses in16 vaccine recipients and two placebo recipients after the 2nd immunization were evaluated using neutralization assays of sera, as well as ELISpot and ICS assays of cryopreserved PBMCs to assess CD4 and CD8 T-cell responses. In addition, (51)Cr release assays were performed on fresh PBMCs following 14-day stimulation with individual vaccine peptide antigens. RESULTS: 24 subjects were enrolled; 18 completed 2 injections. The study was prematurely terminated because 4 vaccinees developed prolonged pain and sterile abscess formation at the injection site-2 after dose 1, and 2 after dose 2. Two other subjects experienced severe systemic reactions consisting of headache, chills, nausea, and myalgia. Both reactions occurred after the second 4 mg dose. The immunogenicity assessments showed that 6/8 vaccinees at each dose level had detectable MN-specific neutralizing (NT) activity, and 2/7 HLA-B7+ vaccinees had classical CD8 CTL activity detected. However, using both ELISpot and ICS, 8/16 vaccinees (5/7 HLA-B7+) and 0/2 controls had detectable vaccine-specific CD8 T-cell responses. Subjects with moderate or severe systemic or local reactions tended to have more frequent T cell responses and higher antibody responses than those with mild or no reactions. CONCLUSIONS: The severity of local responses related to the formulation of these four peptides in IFA is clinically unacceptable for continued development. Both HIV-specific antibody and T cell responses were induced and the magnitude of response correlated with the severity of local and systemic reactions. If potent adjuvants are necessary for subunit vaccines to induce broad and durable immune responses, careful, incremental clinical evaluation is warranted to minimize the risk of adverse events. TRIAL REGISTRATION: ClinicalTrials.gov NCT00000886.

Safety and immunogenicity of a replication-defective adenovirus type 5 HIV vaccine in Ad5-seronegative persons: a randomized clinical trial (HVTN 054).

BACKGROUND: Individuals without prior immunity to a vaccine vector may be more sensitive to reactions following injection, but may also show optimal immune responses to vaccine antigens. To assess safety and maximal tolerated dose of an adenoviral vaccine vector in volunteers without prior immunity, we evaluated a recombinant replication-defective adenovirus type 5 (rAd5) vaccine expressing HIV-1 Gag, Pol, and multiclade Env proteins, VRC-HIVADV014-00-VP, in a randomized, double-blind, dose-escalation, multicenter trial (HVTN study 054) in HIV-1-seronegative participants without detectable neutralizing antibodies (nAb) to the vector. As secondary outcomes, we also assessed T-cell and antibody responses. METHODOLOGY/PRINCIPAL FINDINGS: Volunteers received one dose of vaccine at either 10(10) or 10(11) adenovector particle units, or placebo. T-cell responses were measured against pools of global potential T-cell epitope peptides. HIV-1 binding and neutralizing antibodies were assessed. Systemic reactogenicity was greater at the higher dose, but the vaccine was well tolerated at both doses. Although no HIV infections occurred, commercial diagnostic assays were positive in 87% of vaccinees one year after vaccination. More than 85% of vaccinees developed HIV-1-specific T-cell responses detected by IFN-γ ELISpot and ICS assays at day 28. T-cell responses were: CD8-biased; evenly distributed across the three HIV-1 antigens; not substantially increased at the higher dose; and detected at similar frequencies one year following injection. The vaccine induced binding antibodies against at least one HIV-1 Env antigen in all recipients. CONCLUSIONS/SIGNIFICANCE: This vaccine appeared safe and was highly immunogenic following a single dose in human volunteers without prior nAb against the vector. TRIAL REGISTRATION: ClinicalTrials.gov NCT00119873.