Biased ART: A Neural Architecture that Shifts Attention Toward Previously Disregarded Features Following an Incorrect Prediction

Memories in Adaptive Resonance Theory (ART) networks are based on matched patterns that focus attention on those portions of bottom-up inputs that match active top-down expectations. While this learning strategy has proved successful for both brain models and applications, computational examples show that attention to early critical features may later distort memory representations during online fast learning. For supervised learning, biased ARTMAP (bARTMAP) solves the problem of over-emphasis on early critical features by directing attention away from previously attended features after the system makes a predictive error. Small-scale, hand-computed analog and binary examples illustrate key model dynamics. Twodimensional simulation examples demonstrate the evolution of bARTMAP memories as they are learned online. Benchmark simulations show that featural biasing also improves performance on large-scale examples. One example, which predicts movie genres and is based, in part, on the Netflix Prize database, was developed for this project. Both first principles and consistent performance improvements on all simulation studies suggest that featural biasing should be incorporated by default in all ARTMAP systems. Benchmark datasets and bARTMAP code are available from the CNS Technology Lab Website: http://techlab.bu.edu/bART/.

Integrating Symbolic and Neural Processing in a Self-Organizing Architechture for Pattern Recognition and Prediction

British Petroleum (89A-1204); Defense Advanced Research Projects Agency (N00014-92-J-4015); National Science Foundation (IRI-90-00530); Office of Naval Research (N00014-91-J-4100); Air Force Office of Scientific Research (F49620-92-J-0225)

ART-EMAP: A Neural Network Architecture for Learning and Prediction by Evidence Accumulation

This paper introduces ART-EMAP, a neural architecture that uses spatial and temporal evidence accumulation to extend the capabilities of fuzzy ARTMAP. ART-EMAP combines supervised and unsupervised learning and a medium-term memory process to accomplish stable pattern category recognition in a noisy input environment. The ART-EMAP system features (i) distributed pattern registration at a view category field; (ii) a decision criterion for mapping between view and object categories which can delay categorization of ambiguous objects and trigger an evidence accumulation process when faced with a low confidence prediction; (iii) a process that accumulates evidence at a medium-term memory (MTM) field; and (iv) an unsupervised learning algorithm to fine-tune performance after a limited initial period of supervised network training. ART-EMAP dynamics are illustrated with a benchmark simulation example. Applications include 3-D object recognition from a series of ambiguous 2-D views.

A Neural Network Architecture for Autonomous Learning, Recognition, and Prediction in a Nonstationary World

In a constantly changing world, humans are adapted to alternate routinely between attending to familiar objects and testing hypotheses about novel ones. We can rapidly learn to recognize and narne novel objects without unselectively disrupting our memories of familiar ones. We can notice fine details that differentiate nearly identical objects and generalize across broad classes of dissimilar objects. This chapter describes a class of self-organizing neural network architectures--called ARTMAP-- that are capable of fast, yet stable, on-line recognition learning, hypothesis testing, and naming in response to an arbitrary stream of input patterns (Carpenter, Grossberg, Markuzon, Reynolds, and Rosen, 1992; Carpenter, Grossberg, and Reynolds, 1991). The intrinsic stability of ARTMAP allows the system to learn incrementally for an unlimited period of time. System stability properties can be traced to the structure of its learned memories, which encode clusters of attended features into its recognition categories, rather than slow averages of category inputs. The level of detail in the learned attentional focus is determined moment-by-moment, depending on predictive success: an error due to over-generalization automatically focuses attention on additional input details enough of which are learned in a new recognition category so that the predictive error will not be repeated. An ARTMAP system creates an evolving map between a variable number of learned categories that compress one feature space (e.g., visual features) to learned categories of another feature space (e.g., auditory features). Input vectors can be either binary or analog. Computational properties of the networks enable them to perform significantly better in benchmark studies than alternative machine learning, genetic algorithm, or neural network models. Some of the critical problems that challenge and constrain any such autonomous learning system will next be illustrated. Design principles that work together to solve these problems are then outlined. These principles are realized in the ARTMAP architecture, which is specified as an algorithm. Finally, ARTMAP dynamics are illustrated by means of a series of benchmark simulations.

Prediction and prevention of venous thrombosis in pregnancy

Venous thromboembolism (VTE) remains the leading cause of maternal mortality. Reports identified further research is required in obese and women post caesarean section (CS). Risk factors for VTE during pregnancy are periodically absent indicating the need for a simple and effective screening tool for pregnancy. Perturbation of the uteroplacental haemostasis has been implicated in placenta mediated pregnancy complications. This thesis had 4 main aims: 1) To investigate anticoagulant effects following a fixed thromboprophylaxis dose in healthy women post elective CS. 2) To evaluate the calibrated automated thrombogram (CAT) assay as a potential predictive tool for thrombosis in pregnancy. 3) To compare the anticoagulant effects of fixed versus weight adjusted thromboprophylaxis dose in morbidly obese pregnant women. 4) To investigate the LMWH effects on human haemostatic gene and antigen expression in placentae and plasma from the uteroplacental , maternal and fetal circulation. Tissue factor pathway inhibitor (TFPI), thrombin antithrombin (TAT), CAT and anti-Xa levels were analysed. Real-time PCR and ELISA were used to quantify mRNA and protein expression of TFPI and TF in placental tissue. In women post CS, anti-Xa levels do not reflect the full anticoagulant effects of LMWH. LMWH thromboprophylaxis in this healthy cohort of patients appears to have a sustained effect in reducing excess thrombin production post elective CS. The results of this study suggest that predicting VTE in pregnant women using CAT assay is not possible at present time. The prothrombotic state in pregnant morbidly obese women was substantially attenuated by weight adjusted but not at fixed LMWH doses. LMWH may be effective in reducing in- vivo thrombin production in the uteroplacental circulation of thrombophilic women. All these results collectively suggest that at appropriate dosage, LMWH is effective in attenuating excess thrombin generation, in low risk pregnant women post caesarean section or moderate to high risk pregnant women who are morbidly obese or tested positive for thrombophilia. The results of the studies provided data to inform evidence-based practice to improve the outcome for pregnant women at risk of thrombosis.

Characterising novel anti-biofilm targets for the treatment of chronic Pseudomonas aeruginosa infection in the cystic fibrosis lung

The global rise in antibiotic resistance is a significant problem facing healthcare professionals. In particular within the cystic fibrosis (CF) lung, bacteria can establish chronic infection and resistance to a wide array of antibiotic therapies. One of the principle pathogens associated with chronic infection in the CF lung is Pseudomonas aeruginosa. P. aeruginosa can establish chronic infection in the CF lung partly through the use of the biofilm mode of growth. This biofilm mode of growth offers a considerable degree of protection from a wide variety of challenges such as the host immune system or antibiotic therapy. The threat posed by the emergence of chronic pathogens is prompting the development of next generation antimicrobials. The biofilm mode of growth is often central to the establishment of chronic infection and the development of antibiotic resistance. Thus, targeting biofilm formation has emerged as one of the principle strategies for the development of next generation antimicrobials. In this thesis two separate approaches were used to identify potential anti - biofilm targets. The first strategy focused on the identification of novel genes with a role in a biofilm formation. High throughput screening identified almost 300 genes which had a role in biofilm formation. A number of these genes were characterised at a phenotypic and a molecular level. The second strategy focused on the identification of compounds capable of inhibiting biofilm formation. A collection of marine sponge isolated bacteria were screened for the ability to inhibit the central pathway regulating biofilm formation, quorum sensing. A number of distinct isolates were identified that had quorum sensing inhibition activity from which, a Pseudomonas isolate was selected for further characterisation. A specific compound capable of inhibiting quorum sensing was identified using chemical analytical technologies in the supernatant of this marine isolate.

The role of bacterial interspecies communication in polymicrobial infection of the cystic fibrosis lung

There is an increasing appreciation of the polymicrobial nature of bacterial infections associated with Cystic Fibrosis (CF) and of the important role for interactions in influencing bacterial virulence and response to therapy. Patients with CF are co-infected with Pseudomonas aeruginosa, Burkholderia cenocepacia and Stenotrophomonas maltophilia. These latter bacteria produce signal molecules of the diffusible signal factor (DSF) family, which are cis-2-unsaturated fatty acids. Previous studies showed that DSF from S. maltophilia leads to altered biofilm formation and increased tolerance to antibiotics in P. aeruginosa and that these responses require the P. aeruginosa sensor kinase PA1396. The work in this thesis aims of further elucidate the influence and mechanism of DSF signalling on P. aeruginosa and examine the role that such interspecies signalling play in infection of the CF airway. Next generation sequencing technologies targeting the 16S ribosomal RNA gene were applied to DNA and RNA isolated from sputum taken from cohorts of CF and non-CF subjects to characterise the bacterial community. In parallel, metabolomics analysis of sputum provided insight into the environment of the CF airway. This analysis revealed a number of observations including; that differences in metabolites occur in sputum taken from clinically stable CF patients and those with exacerbation and DNA- and RNA-based methods suggested that a strong relationship existed between the abundance of specific strict anaerobes and fluctuations in the level of metabolites during exacerbation. DSF family signals were also detected in the sputum and a correlation with the presence of DSFproducing organisms was observed. To examine the signal transduction mechanisms used by P. aeruginosa, bioinformatics with site directed mutagenesis were employed to identify signalling partners for PA1396. A pathway suggesting a role for a number of proteins in the regulation of several factors following DSF recognition by PA1396 were observed.

Paradoxical worsening of tuberculosis in a heart-lung transplant recipient.

We report on a heart-lung transplant recipient who presented with pulmonary tuberculosis (TB) 2.5 months after transplantation and then developed a paradoxical reaction after 4 months of adequate anti-TB treatment. She eventually recovered with anti-TB and high-dose steroid treatments. METHODS: Using sequential bronchoalveolar lavages, we assessed the inflammatory response in the lung and investigated the alveolar immune response against a Mycobacterium tuberculosis antigen. RESULTS: The paradoxical reaction was characterized by a massive infiltration of the alveolar space by M. tuberculosis antigen-specific CD4(+) T cells and by the presence of a CD4(-)CD8(-) T lymphocyte subpopulation bearing phenotypic markers (CD16(+)/56(+)) classically associated with NK cells. CONCLUSION: This case report illustrates that even solid organ transplant recipients receiving intense triple-drug immune suppression may be able to develop a paradoxical reaction during TB treatment. Transplant physicians should be aware of this phenomenon in order to differentiate it from treatment failure.

Characterization of the morphonuclear features and DNA ploidy of typical and atypical carcinoids and small cell carcinomas of the lung

The authors analyzed several cytomorphonuclear parameters related to chromatin distribution and DNA ploidy in typical and atypical carcinoids and in small cell lung cancers. Nuclear measurements and analysis were performed with a SAMBA 200 (TITN, Grenoble, France) cell image processor with software allowing the discrimination of parameters computed on cytospin preparations of Feulgen-stained nuclei extracted from deparaffinized tumor tissues. The authors' results indicate a significant increase in DNA content--assessed by integrated optical density (IOD)--from typical carcinoids to small cell lung carcinomas, with atypical carcinoids showing an intermediate value. Parameters related to hyperchromatism (short and long run length and variance of optical density) also characterize the atypical carcinoids as being intermediate between typical carcinoids and small cell lung cancers. The systematic measurement of these cytomorphonuclear parameters seems to define an objective, reproducible "scale" of differentiation that helps to define the atypical carcinoid and may be of value in establishing cytologic criteria for differential diagnosis.

Prediction in dynamic models with time-dependent conditional variances

This paper considers forecasting the conditional mean and variance from a single-equation dynamic model with autocorrelated disturbances following an ARMA process, and innovations with time-dependent conditional heteroskedasticity as represented by a linear GARCH process. Expressions for the minimum MSE predictor and the conditional MSE are presented. We also derive the formula for all the theoretical moments of the prediction error distribution from a general dynamic model with GARCH(1, 1) innovations. These results are then used in the construction of ex ante prediction confidence intervals by means of the Cornish-Fisher asymptotic expansion. An empirical example relating to the uncertainty of the expected depreciation of foreign exchange rates illustrates the usefulness of the results. © 1992.

The lung cancer exercise training study: a randomized trial of aerobic training, resistance training, or both in postsurgical lung cancer patients: rationale and design.

BACKGROUND: The Lung Cancer Exercise Training Study (LUNGEVITY) is a randomized trial to investigate the efficacy of different types of exercise training on cardiorespiratory fitness (VO2peak), patient-reported outcomes, and the organ components that govern VO2peak in post-operative non-small cell lung cancer (NSCLC) patients. METHODS/DESIGN: Using a single-center, randomized design, 160 subjects (40 patients/study arm) with histologically confirmed stage I-IIIA NSCLC following curative-intent complete surgical resection at Duke University Medical Center (DUMC) will be potentially eligible for this trial. Following baseline assessments, eligible participants will be randomly assigned to one of four conditions: (1) aerobic training alone, (2) resistance training alone, (3) the combination of aerobic and resistance training, or (4) attention-control (progressive stretching). The ultimate goal for all exercise training groups will be 3 supervised exercise sessions per week an intensity above 70% of the individually determined VO2peak for aerobic training and an intensity between 60 and 80% of one-repetition maximum for resistance training, for 30-45 minutes/session. Progressive stretching will be matched to the exercise groups in terms of program length (i.e., 16 weeks), social interaction (participants will receive one-on-one instruction), and duration (30-45 mins/session). The primary study endpoint is VO2peak. Secondary endpoints include: patient-reported outcomes (PROs) (e.g., quality of life, fatigue, depression, etc.) and organ components of the oxygen cascade (i.e., pulmonary function, cardiac function, skeletal muscle function). All endpoints will be assessed at baseline and postintervention (16 weeks). Substudies will include genetic studies regarding individual responses to an exercise stimulus, theoretical determinants of exercise adherence, examination of the psychological mediators of the exercise - PRO relationship, and exercise-induced changes in gene expression. DISCUSSION: VO2peak is becoming increasingly recognized as an outcome of major importance in NSCLC. LUNGEVITY will identify the optimal form of exercise training for NSCLC survivors as well as provide insight into the physiological mechanisms underlying this effect. Overall, this study will contribute to the establishment of clinical exercise therapy rehabilitation guidelines for patients across the entire NSCLC continuum. TRIAL REGISTRATION: NCT00018255.

An integrated approach to the prediction of chemotherapeutic response in patients with breast cancer.

BACKGROUND: A major challenge in oncology is the selection of the most effective chemotherapeutic agents for individual patients, while the administration of ineffective chemotherapy increases mortality and decreases quality of life in cancer patients. This emphasizes the need to evaluate every patient's probability of responding to each chemotherapeutic agent and limiting the agents used to those most likely to be effective. METHODS AND RESULTS: Using gene expression data on the NCI-60 and corresponding drug sensitivity, mRNA and microRNA profiles were developed representing sensitivity to individual chemotherapeutic agents. The mRNA signatures were tested in an independent cohort of 133 breast cancer patients treated with the TFAC (paclitaxel, 5-fluorouracil, adriamycin, and cyclophosphamide) chemotherapy regimen. To further dissect the biology of resistance, we applied signatures of oncogenic pathway activation and performed hierarchical clustering. We then used mRNA signatures of chemotherapy sensitivity to identify alternative therapeutics for patients resistant to TFAC. Profiles from mRNA and microRNA expression data represent distinct biologic mechanisms of resistance to common cytotoxic agents. The individual mRNA signatures were validated in an independent dataset of breast tumors (P = 0.002, NPV = 82%). When the accuracy of the signatures was analyzed based on molecular variables, the predictive ability was found to be greater in basal-like than non basal-like patients (P = 0.03 and P = 0.06). Samples from patients with co-activated Myc and E2F represented the cohort with the lowest percentage (8%) of responders. Using mRNA signatures of sensitivity to other cytotoxic agents, we predict that TFAC non-responders are more likely to be sensitive to docetaxel (P = 0.04), representing a viable alternative therapy. CONCLUSIONS: Our results suggest that the optimal strategy for chemotherapy sensitivity prediction integrates molecular variables such as ER and HER2 status with corresponding microRNA and mRNA expression profiles. Importantly, we also present evidence to support the concept that analysis of molecular variables can present a rational strategy to identifying alternative therapeutic opportunities.

Evidence that SOX2 overexpression is oncogenic in the lung.

BACKGROUND: SOX2 (Sry-box 2) is required to maintain a variety of stem cells, is overexpressed in some solid tumors, and is expressed in epithelial cells of the lung. METHODOLOGY/PRINCIPAL FINDINGS: We show that SOX2 is overexpressed in human squamous cell lung tumors and some adenocarcinomas. We have generated mouse models in which Sox2 is upregulated in epithelial cells of the lung during development and in the adult. In both cases, overexpression leads to extensive hyperplasia. In the terminal bronchioles, a trachea-like pseudostratified epithelium develops with p63-positive cells underlying columnar cells. Over 12-34 weeks, about half of the mice expressing the highest levels of Sox2 develop carcinoma. These tumors resemble adenocarcinoma but express the squamous marker, Trp63 (p63). CONCLUSIONS: These findings demonstrate that Sox2 overexpression both induces a proximal phenotype in the distal airways/alveoli and leads to cancer.

Adaptive stereotactic body radiation therapy planning for lung cancer.

PURPOSE: To investigate the dosimetric effects of adaptive planning on lung stereotactic body radiation therapy (SBRT). METHODS AND MATERIALS: Forty of 66 consecutive lung SBRT patients were selected for a retrospective adaptive planning study. CBCT images acquired at each fraction were used for treatment planning. Adaptive plans were created using the same planning parameters as the original CT-based plan, with the goal to achieve comparable comformality index (CI). For each patient, 2 cumulative plans, nonadaptive plan (PNON) and adaptive plan (PADP), were generated and compared for the following organs-at-risks (OARs): cord, esophagus, chest wall, and the lungs. Dosimetric comparison was performed between PNON and PADP for all 40 patients. Correlations were evaluated between changes in dosimetric metrics induced by adaptive planning and potential impacting factors, including tumor-to-OAR distances (dT-OAR), initial internal target volume (ITV1), ITV change (ΔITV), and effective ITV diameter change (ΔdITV). RESULTS: 34 (85%) patients showed ITV decrease and 6 (15%) patients showed ITV increase throughout the course of lung SBRT. Percentage ITV change ranged from -59.6% to 13.0%, with a mean (±SD) of -21.0% (±21.4%). On average of all patients, PADP resulted in significantly (P=0 to .045) lower values for all dosimetric metrics. ΔdITV/dT-OAR was found to correlate with changes in dose to 5 cc (ΔD5cc) of esophagus (r=0.61) and dose to 30 cc (ΔD30cc) of chest wall (r=0.81). Stronger correlations between ΔdITV/dT-OAR and ΔD30cc of chest wall were discovered for peripheral (r=0.81) and central (r=0.84) tumors, respectively. CONCLUSIONS: Dosimetric effects of adaptive lung SBRT planning depend upon target volume changes and tumor-to-OAR distances. Adaptive lung SBRT can potentially reduce dose to adjacent OARs if patients present large tumor volume shrinkage during the treatment.

Evaluation of Altered Kras Codon Bias and NOS Inhibition During Lung Tumorigenesis

The small GTPases HRAS, NRAS and KRAS are mutated in approximately one-third of all human cancers, rendering the proteins constitutively active and oncogenic. Lung cancer is the leading cause of cancer deaths worldwide, and more than 20% of human lung cancers harbor mutations in RAS, with 98% of those occurring in the KRAS isoform. While there have been many advances in the understanding of KRAS–driven lung tumorigenesis, it remains a therapeutic challenge. To further this understanding and assess novel approaches for treatment, I have investigated two aspects of Kras–driven tumorigenesis in the lung:

(I) Despite nearly identical protein sequences, the three RAS proto-oncogenes exhibit divergent codon usage. Of the three isoforms, KRAS contains the most rare codons resulting in lower levels of KRAS protein expression relative to HRAS and NRAS. To determine the consequences of rare codon bias during de novo tumorigenesis, we created a knock-in Krasex3op mouse in which synonymous mutations in exon 3 converted codons from rare to common. These mice had reduced tumor burden and fewer oncogenic mutations in the Krasex3op allele following carcinogen exposure. The reduction in tumorigenesis appeared to be a product of rare codons affecting both the oncogenic and non–oncogenic alleles. Converting rare codons to common codons yielded a more potent oncogenic allele that promoted growth arrest and enhanced tumor suppression by the non-oncogenic allele. Thus, rare codons play an integral role in Kras tumorigenesis.

(II) Lung cancer patients exhale higher levels of NO and iNOS-/- mice are resistant to chemically induced lung tumorigenesis. I hypothesize that NO promotes Kras–driven lung adenocarcinoma, and NOS inhibition may decrease Kras–driven lung tumorigenesis. To test this hypothesis, I assessed efficacy of the NOS inhibitor L–NAME in a genetically engineered mouse model of Kras-driven lung adenocarcinoma. Adenoviral Cre recombinase was delivered into the lungs intranasally, resulting in expression of oncogenic KrasG12D and dominant-negative Trp53R172H in lung epithelial cells. L–NAME treatment was provided in the water and continued until survival endpoints. In this model, L–NAME treatment decreased tumor growth and prolonged survival. These data establish a potential clinical role for NOS inhibition in lung cancer treatment.