Computer-based summative assessment of clinical reasoning in clerkships: A mixed-method comparison of key feature problems with case-based multiple choice questions

Background: It is yet unclear if there are differences between using electronic key feature problems (KFPs) or electronic case-based multiple choice questions (cbMCQ) for the assessment of clinical decision making. Summary of Work: Fifth year medical students were exposed to clerkships which ended with a summative exam. Assessment of knowledge per exam was done by 6-9 KFPs, 9-20 cbMCQ and 9-28 MC questions. Each KFP consisted of a case vignette and three key features (KF) using “long menu” as question format. We sought students’ perceptions of the KFPs and cbMCQs in focus groups (n of students=39). Furthermore statistical data of 11 exams (n of students=377) concerning the KFPs and (cb)MCQs were compared. Summary of Results: The analysis of the focus groups resulted in four themes reflecting students’ perceptions of KFPs and their comparison with (cb)MCQ: KFPs were perceived as (i) more realistic, (ii) more difficult, (iii) more motivating for the intense study of clinical reasoning than (cb)MCQ and (iv) showed an overall good acceptance when some preconditions are taken into account. The statistical analysis revealed that there was no difference in difficulty; however KFP showed a higher discrimination and reliability (G-coefficient) even when corrected for testing times. Correlation of the different exam parts was intermediate. Conclusions: Students perceived the KFPs as more motivating for the study of clinical reasoning. Statistically KFPs showed a higher discrimination and higher reliability than cbMCQs. Take-home messages: Including KFPs with long menu questions into summative clerkship exams seems to offer positive educational effects.

Interim analysis of clinical trials: Simulation studies of fractional Brownian motion

Interim clinical trial monitoring procedures were motivated by ethical and economic considerations. Classical Brownian motion (Bm) techniques for statistical monitoring of clinical trials were widely used. Conditional power argument and α-spending function based boundary crossing probabilities are popular statistical hypothesis testing procedures under the assumption of Brownian motion. However, it is not rare that the assumptions of Brownian motion are only partially met for trial data. Therefore, I used a more generalized form of stochastic process, called fractional Brownian motion (fBm), to model the test statistics. Fractional Brownian motion does not hold Markov property and future observations depend not only on the present observations but also on the past ones. In this dissertation, we simulated a wide range of fBm data, e.g., H = 0.5 (that is, classical Bm) vs. 0.5< H <1, with treatment effects vs. without treatment effects. Then the performance of conditional power and boundary-crossing based interim analyses were compared by assuming that the data follow Bm or fBm. Our simulation study suggested that the conditional power or boundaries under fBm assumptions are generally higher than those under Bm assumptions when H > 0.5 and also matches better with the empirical results. ^

Genetic Predictors of Clinical Outcomes in Non-Small Cell Lung Cancer Patients

Lung cancer is the leading cause of cancer-related mortality in the US. Emerging evidence has shown that host genetic factors can interact with environmental exposures to influence patient susceptibility to the diseases as well as clinical outcomes, such as survival and recurrence. We aimed to identify genetic prognostic markers for non-small cell lung cancer (NSCLC), a major (85%) subtype of lung cancer, and also in other subgroups. With the fast evolution of genotyping technology, genetic association studies have went through candidate gene approach, to pathway-based approach, to the genome wide association study (GWAS). Even in the era of GWAS, pathway-based approach has its own advantages on studying cancer clinical outcomes: it is cost-effective, requiring a smaller sample size than GWAS easier to identify a validation population and explore gene-gene interactions. In the current study, we adopted pathway-based approach focusing on two critical pathways - miRNA and inflammation pathways. MicroRNAs (miRNA) post-transcriptionally regulate around 30% of human genes. Polymorphisms within miRNA processing pathways and binding sites may influence patients’ prognosis through altered gene regulation. Inflammation plays an important role in cancer initiation and progression, and also has shown to impact patients’ clinical outcomes. We first evaluated 240 single nucleotide polymorphisms (SNPs) in miRNA biogenesis genes and predicted binding sites in NSCLC patients to determine associations with clinical outcomes in early-stage (stage I and II) and late-stage (stage III and IV) lung cancer patients, respectively. First, in 535 early-stage patients, after correcting multiple comparisons, FZD4:rs713065 (hazard ratio [HR]:0.46, 95% confidence interval [CI]:0.32-0.65) showed a significant inverse association with survival in early stage surgery-only patients. SP1:rs17695156 (HR:2.22, 95% CI:1.44-3.41) and DROSHA:rs6886834 (HR:6.38, 95% CI:2.49-16.31) conferred increased risk of progression in the all patients and surgery-only populations, respectively. FAS:rs2234978 was significantly associated with improved survival in all patients (HR:0.59, 95% CI:0.44-0.77) and in the surgery plus chemotherapy populations (HR:0.19, 95% CI:0.07-0.46).. Functional genomics analysis demonstrated that this variant creates a miR-651 binding site resulting in altered miRNA regulation of FAS, providing biological plausibility for the observed association. We then analyzed these associations in 598 late-stage patients. After multiple comparison corrections, no SNPs remained significant in the late stage group, while the top SNP NAT1:rs15561 (HR=1.98, 96%CI=1.32-2.94) conferred a significantly increased risk of death in the chemotherapy subgroup. To test the hypothesis that genetic variants in the inflammation-related pathways may be associated with survival in NSCLC patients, we first conducted a three-stage study. In the discovery phase, we investigated a comprehensive panel of 11,930 inflammation-related SNPs in three independent lung cancer populations. A missense SNP (rs2071554) in HLA-DOB was significantly associated with poor survival in the discovery population (HR: 1.46, 95% CI: 1.02-2.09), internal validation population (HR: 1.51, 95% CI: 1.02-2.25), and external validation (HR: 1.52, 95% CI: 1.01-2.29) population. Rs2900420 in KLRK1 was significantly associated with a reduced risk for death in the discovery (HR: 0.76, 95% CI: 0.60-0.96) and internal validation (HR: 0.77, 95% CI: 0.61-0.99) populations, and the association reached borderline significance in the external validation population (HR: 0.80, 95% CI: 0.63-1.02). We also evaluated these inflammation-related SNPs in NSCLC patients in never smokers. Lung cancer in never smokers has been increasingly recognized as distinct disease from that in ever-smokers. A two-stage study was performed using a discovery population from MD Anderson (411 patients) and a validation population from Mayo Clinic (311 patients). Three SNPs (IL17RA:rs879576, BMP8A:rs698141, and STK:rs290229) that were significantly associated with survival were validated (pCD74:rs1056400 and CD38:rs10805347) were borderline significant (p=0.08) in the Mayo Clinic population. In the combined analysis, IL17RA:rs879576 resulted in a 40% reduction in the risk for death (p=4.1 × 10-5 [p=0.61, heterogeneity test]). We also validated a survival tree created in MD Anderson population in the Mayo Clinic population. In conclusion, our results provided strong evidence that genetic variations in specific pathways that examined (miRNA and inflammation pathways) influenced clinical outcomes in NSCLC patients, and with further functional studies, the novel loci have potential to be translated into clinical use.

A simulation study using the hybrid statistic and the meta-analysis t-test for data with matched and unmatched subjects in the interim analysis of clinical trials

An interim analysis is usually applied in later phase II or phase III trials to find convincing evidence of a significant treatment difference that may lead to trial termination at an earlier point than planned at the beginning. This can result in the saving of patient resources and shortening of drug development and approval time. In addition, ethics and economics are also the reasons to stop a trial earlier. In clinical trials of eyes, ears, knees, arms, kidneys, lungs, and other clustered treatments, data may include distribution-free random variables with matched and unmatched subjects in one study. It is important to properly include both subjects in the interim and the final analyses so that the maximum efficiency of statistical and clinical inferences can be obtained at different stages of the trials. So far, no publication has applied a statistical method for distribution-free data with matched and unmatched subjects in the interim analysis of clinical trials. In this simulation study, the hybrid statistic was used to estimate the empirical powers and the empirical type I errors among the simulated datasets with different sample sizes, different effect sizes, different correlation coefficients for matched pairs, and different data distributions, respectively, in the interim and final analysis with 4 different group sequential methods. Empirical powers and empirical type I errors were also compared to those estimated by using the meta-analysis t-test among the same simulated datasets. Results from this simulation study show that, compared to the meta-analysis t-test commonly used for data with normally distributed observations, the hybrid statistic has a greater power for data observed from normally, log-normally, and multinomially distributed random variables with matched and unmatched subjects and with outliers. Powers rose with the increase in sample size, effect size, and correlation coefficient for the matched pairs. In addition, lower type I errors were observed estimated by using the hybrid statistic, which indicates that this test is also conservative for data with outliers in the interim analysis of clinical trials.^

Childhood cancer survivor satisfaction with characteristics of clinical care

This study investigated the characteristics of a clinic that affect how satisfied survivors of childhood cancer are with their medical care. Questionnaire and interview data from the Passport for Care: Texas Implementation project collected between January 2011 to April 2012 were analyzed. Eleven clinics in Texas participated. Questionnaire respondents were childhood cancer survivor patients who had been off therapy for at least 2 years, or their parents. Interview respondents were clinical providers or research staff at the participating clinics. The outcomes evaluated were answers to a single question on satisfaction with care and a composite Percent Satisfaction Score created from seven other questionnaire items that were correlated (Spearman Rho >0.3) with the question on satisfaction. The following characteristics were also evaluated: sex, age, race, education, and type of cancer. The following clinic indicators were evaluated: type of clinic (general vs. dedicated cancer survivor clinics), number of providers, number of survivors, ratio of survivors/providers, distribution of handouts, distribution of treatment summaries, and use of Children's Oncology Group (COG) guidelines. ^ The only demographic characteristic that affected satisfaction was race. A Kruskal-Wallis test showed a statistically significant difference (Chi-square 6.129, 2 d.f., p = 0.0467). To analyze this further, Wilcoxon Rank Sum test of pairings of the three groups were performed. A Bonferroni correction for multiple testing was applied, with p = 0.017 indicating significance at alpha = 0.05. There was no significant difference between the White and Hispanic groups or between the Hispanic and "Other" groups. For the White and "Other" groups there was a significant difference for the satisfaction item (p = 0.0123) but not for the Percent Satisfaction Score (p = 0.0289). These results suggest that race may influence satisfaction and should be evaluated further in future studies. ^ None of the clinic indicators affected the Percent Satisfaction Score. Going to a clinic that distributed patient information handouts (Wilcoxon Rank Sum p = 0.048) and going to a clinic with >=100 survivors (Wilcoxon Rank Sum p = 0.021) were associated with increased satisfaction. The population of childhood cancer survivors is a growing group of individuals with special health needs. In the future survivors will likely seek medical care in a variety of clinical settings, so it is important to investigate features to improve patient satisfaction with clinical care.^

Evaluating the Utility of Clinical Criteria for the Identification of Lynch Syndrome among Endometrial Cancer Patients

Background: Lynch Syndrome (LS) is a familial cancer syndrome with a high prevalence of colorectal and endometrial carcinomas among affected family members. Clinical criteria, developed from information obtained from familial colorectal cancer registries, have been generated to identify individuals at elevated risk for having LS. In 2007, the Society of Gynecologic Oncology (SGO) codified criteria to assist in identifying women presenting with gynecologic cancers at elevated risk for having LS. These criteria have not been validated in a population-based setting. Materials and Methods: We retrospectively identified 412, unselected endometrial cancer cases. Clinical and pathologic information were obtained from the electronic medical record, and all tumors were tested for expression of the DNA mismatch repair proteins through immunohistochemistry. Tumors exhibiting loss of MSH2, MSH6 and PMS2 were designated as probable Lynch Syndrome (PLS). For tumors exhibiting immunohistochemical loss of MLH1, we used the PCR-based MLH1 methylation assay to delineate PLS tumors from sporadic tumors. Samples lacking methylation of the MLH1 promoter were also designated as PLS. The sensitivity and specificity for SGO criteria for detecting PLS tumors was calculated. We compared clinical and pathologic features of sporadic tumors and PLS tumors. A simplified cost-effectiveness analysis was also performed comparing the direct costs of utilizing SGO criteria vs. universal tumor testing. Results: In our cohort, 43/408 (10.5%) of endometrial carcinomas were designated as PLS. The sensitivity and specificity of SGO criteria to identify PLS cases were 32.7 and 77%, respectively. Multivariate analysis of clinical and pathologic parameters failed to identify statistically significant differences between sporadic and PLS tumors with the exception of tumors arising from the lower uterine segment. These tumors were more likely to occur in PLS tumors. Cost-effectiveness analysis showed clinical criteria and universal testing strategies cost $6,235.27/PLS case identified and $5,970.38/PLS case identified, respectively. Conclusions: SGO 5-10% criteria successfully identify PLS cases among women who are young or have significant family history of LS related tumors. However, a larger proportion of PLS cases occurring at older ages with less significant family history are not detected by this screening strategy. Compared to SGO clinical criteria, universal tumor testing is a cost effective strategy to identify women presenting with endometrial cancer who are at elevated risk for having LS.

Attitudes and other barriers to the utilization of clinical research findings by American physicians: A systematic review

Background: The Institute of Medicine estimates that only a maximum of 25% of clinical research findings are incorporated into practice by physicians. To improve clinical practice, efforts have been made to promote evidence-based medicine and the use of clinical guidelines. Despite these efforts, the gap between research and clinical practice remains wide.^ Objective: To systematically review the literature describing the factors which influence the use of clinical research recommendations by American physicians.^ Hypothesis: Barriers exist in the application of clinical research into clinical practice, and are multifactorial. The establishment of the Clinical and Translational Awards (CTSA; special federal grants awarded to selected institutions to support clinical and translational research) has reduced the effect of these barriers and improved the process of clinical research translation into practice among American physicians.^ Aims: Identify barriers and facilitators of the use of research findings in clinical practice by American physicians. Contrast studies published six years before and after the creation of the CTSA.^ Methods: The sources of data include published literature from Medline, PubMed and PsycINFO. Selected studies must be qualitative, a survey of American clinicians, based on evidence-based medicine practice, clinical guidelines or treatment pathways. Systematic reviews and reports were excluded, as well as studies with less than 100 respondents.^ Results: In total, 1036 abstracts were reviewed; 115 full text potential articles were identified and reviewed, and a total of 31 studies met all criteria for inclusion in the final review.^ Conclusions: The barriers against the application of clinical research findings, in the forms of clinical guidelines, evidence-based medicine guides and clinical pathways, can be divided broadly into physician barriers, practice/system barriers and patient barriers. Physician barriers are the most common barriers, especially the lack of familiarity with guidelines and the lack of time. Of the factors which improve the use of research based guidelines, physician factors such as younger age, lower duration of clinical practice, specialty training, and practice in large group Health Maintenance Organization (HMO) settings with fewer patients seen were the most commonly cited.^

Comparison of clinical and economic outcomes between high-intensity care and hospice care for the end-of-life melanoma patients

The intensity of care for patients at the end-of-life is increasing in recent years. Publications have focused on intensity of care for many cancers, but none on melanoma patients. Substantial gaps exist in knowledge about intensive care and its alternative, hospice care, among the advanced melanoma patients at the end of life. End-of-life care may be used in quite different patterns and induce both intended and unintended clinical and economic consequences. We used the Surveillance, Epidemiology, and End Results (SEER)-Medicare linked databases to identify patients aged 65 years or older with metastatic melanoma who died between 2000 and 2007. We evaluated trends and associations between sociodemographic and health services characteristics and the use of hospice care, chemotherapy, surgery, and radiation therapy and costs. Survival, end-of-life costs, and incremental cost-effectiveness ratio were evaluated using propensity score methods. Costs were analyzed from the perspective of Medicare in 2009 dollars. In the first journal Article we found increasing use of surgery for patients with metastatic melanoma from 13% in 2000 to 30% in 2007 (P=0.03 for trend), no significant fluctuation in use of chemotherapy (P=0.43) or radiation therapy (P=0.46). Older patients were less likely to receive radiation therapy or chemotherapy. The use of hospice care increased from 61% in 2000 to 79% in 2007 (P =0.07 for trend). Enrollment in short-term (1-3 days) hospice care use increased, while long-term hospice care (≥ 4 days) remained stable. Patients living in the SEER Northeast and South regions were less likely to undergo surgery. Patients enrolled in long-term hospice care used significantly less chemotherapy, surgery and radiation therapy. In the second journal article, of 611 patients identified for this study, 358 (59%) received no hospice care after their diagnosis, 168 (27%) received 1 to 3 days of hospice care, and 85 (14%) received 4 or more days of hospice care. The median survival time was 181 days for patients with no hospice care, 196 days for patients enrolled in hospice for 1 to 3 days, and 300 days for patients enrolled for 4 or more days (log-rank test, P < 0.001). The estimated hazard ratios (HR) between 4 or more days hospice use and survival were similar within the original cohort Cox proportional hazard model (HR, 0.62; 95% CI, 0.49-0.78, P < 0.0001) and the propensity score-matched model (HR, 0.61; 95% CI, 0.47-0.78, P = 0.0001). Patients with ≥ 4 days of hospice care incurred lower end-of-life costs than the other two groups ($14,298 versus $19,380 for the 1- to 3-days hospice care, and $24,351 for patients with no hospice care; p < 0.0001). In conclusion, Surgery and hospice care use increased over the years of this study while the use of chemotherapy and radiation therapy remained consistent for patients diagnosed with metastatic melanoma. Patients diagnosed with advanced melanoma who enrolled in ≥ 4 days of hospice care experienced longer survival than those who had 1-3 days of hospice or no hospice care, and this longer overall survival was accompanied by lower end-of-life costs.^

A portable NIR device for the optical supervision of milk coagulation process

The coagulation of milk is the fundamental process in cheese-making, based on a gel formation as consequence of physicochemical changes taking place in the casein micelles, the monitoring the whole process of milk curd formation is a constant preoccupation for dairy researchers and cheese companies (Lagaude et al., 2004). In addition to advances in composition-based applications of near infrared spectroscopy (NIRS), innovative uses of this technology are pursuing dynamic applications that show promise, especially in regard to tracking a sample in situ during food processing (Bock and Connelly, 2008). In this way the literature describes cheese making process applications of NIRS for curd cutting time determination, which conclude that NIRS would be a suitable method of monitoring milk coagulation, as shown i.e. the works published by Fagan et al. (Fagan et al., 2008; Fagan et al., 2007), based in the use of the commercial CoAguLite probe (with a LED at 880nm and a photodetector for light reflectance detection).

Identifying the semantics of eligibility criteria of clinical trials based on relevant medical ontologies

An important objective of the INTEGRATE project1 is to build tools that support the efficient execution of post-genomic multi-centric clinical trials in breast cancer, which includes the automatic assessment of the eligibility of patients for available trials. The population suited to be enrolled in a trial is described by a set of free-text eligibility criteria that are both syntactically and semantically complex. At the same time, the assessment of the eligibility of a patient for a trial requires the (machineprocessable) understanding of the semantics of the eligibility criteria in order to further evaluate if the patient data available for example in the hospital EHR satisfies these criteria. This paper presents an analysis of the semantics of the clinical trial eligibility criteria based on relevant medical ontologies in the clinical research domain: SNOMED-CT, LOINC, MedDRA. We detect subsets of these widely-adopted ontologies that characterize the semantics of the eligibility criteria of trials in various clinical domains and compare these sets. Next, we evaluate the occurrence frequency of the concepts in the concrete case of breast cancer (which is our first application domain) in order to provide meaningful priorities for the task of binding/mapping these ontology concepts to the actual patient data. We further assess the effort required to extend our approach to new domains in terms of additional semantic mappings that need to be developed.

Iterative determination of clinical beam phase space from dose measurements

Monte Carlo (MC) method can accurately compute the dose produced by medical linear accelerators. However, these calculations require a reliable description of the electron and/or photon beams delivering the dose, the phase space (PHSP), which is not usually available. A method to derive a phase space model from reference measurements that does not heavily rely on a detailed model of the accelerator head is presented. The iterative optimization process extracts the characteristics of the particle beams which best explains the reference dose measurements in water and air, given a set of constrains

A review of clinical trial designs used to detect a disease-modifying effect of drug therapy in Alzheimer's disease and Parkinson's disease

Acknowledgements This article presents independent research funded by the National Institute for Health Research (NIHR) under its Programme Grants for Applied Research Programme (Grant Reference Number RP-PG-0707-10124). The views expressed in this article are those of the authors and not necessarily those of the NHS, the NIHR or the Department of Health. The funders had no role in study design, data collection, data analysis, data interpretation, writing of the report or for the decision to submit for publication.

Point of care testing: randomised controlled trial of clinical outcome

Objectives: To describe the proportion of patients attending an accident and emergency department for whom blood analysis at the point of care brought about a change in management; to measure the extent to which point of care testing resulted in differences in clinical outcome for these patients when compared with patients whose samples were tested by the hospital laboratory.