Fuzzy ART: Fast Stable Learning and Categorization of Analog Patterns by an Adaptive Resonance System

A Fuzzy ART model capable of rapid stable learning of recognition categories in response to arbitrary sequences of analog or binary input patterns is described. Fuzzy ART incorporates computations from fuzzy set theory into the ART 1 neural network, which learns to categorize only binary input patterns. The generalization to learning both analog and binary input patterns is achieved by replacing appearances of the intersection operator (n) in AHT 1 by the MIN operator (Λ) of fuzzy set theory. The MIN operator reduces to the intersection operator in the binary case. Category proliferation is prevented by normalizing input vectors at a preprocessing stage. A normalization procedure called complement coding leads to a symmetric theory in which the MIN operator (Λ) and the MAX operator (v) of fuzzy set theory play complementary roles. Complement coding uses on-cells and off-cells to represent the input pattern, and preserves individual feature amplitudes while normalizing the total on-cell/off-cell vector. Learning is stable because all adaptive weights can only decrease in time. Decreasing weights correspond to increasing sizes of category "boxes". Smaller vigilance values lead to larger category boxes. Learning stops when the input space is covered by boxes. With fast learning and a finite input set of arbitrary size and composition, learning stabilizes after just one presentation of each input pattern. A fast-commit slow-recode option combines fast learning with a forgetting rule that buffers system memory against noise. Using this option, rare events can be rapidly learned, yet previously learned memories are not rapidly erased in response to statistically unreliable input fluctuations.

The Construction of Arbitrary Stable Dynamics in Non-Linear Neural Networks

In this paper, two methods for constructing systems of ordinary differential equations realizing any fixed finite set of equilibria in any fixed finite dimension are introduced; no spurious equilibria are possible for either method. By using the first method, one can construct a system with the fewest number of equilibria, given a fixed set of attractors. Using a strict Lyapunov function for each of these differential equations, a large class of systems with the same set of equilibria is constructed. A method of fitting these nonlinear systems to trajectories is proposed. In addition, a general method which will produce an arbitrary number of periodic orbits of shapes of arbitrary complexity is also discussed. A more general second method is given to construct a differential equation which converges to a fixed given finite set of equilibria. This technique is much more general in that it allows this set of equilibria to have any of a large class of indices which are consistent with the Morse Inequalities. It is clear that this class is not universal, because there is a large class of additional vector fields with convergent dynamics which cannot be constructed by the above method. The easiest way to see this is to enumerate the set of Morse indices which can be obtained by the above method and compare this class with the class of Morse indices of arbitrary differential equations with convergent dynamics. The former set of indices are a proper subclass of the latter, therefore, the above construction cannot be universal. In general, it is a difficult open problem to construct a specific example of a differential equation with a given fixed set of equilibria, permissible Morse indices, and permissible connections between stable and unstable manifolds. A strict Lyapunov function is given for this second case as well. This strict Lyapunov function as above enables construction of a large class of examples consistent with these more complicated dynamics and indices. The determination of all the basins of attraction in the general case for these systems is also difficult and open.

Testing common nonlinear features in vector nonlinear autoregressive models

This paper studies a special class of vector smooth-transition autoregressive (VSTAR) models that contains common nonlinear features (CNFs), for which we proposed a triangular representation and developed a procedure of testing CNFs in a VSTAR model. We first test a unit root against a stable STAR process for each individual time series and then examine whether CNFs exist in the system by Lagrange Multiplier (LM) test if unit root is rejected in the first step. The LM test has standard Chi-squared asymptotic distribution. The critical values of our unit root tests and small-sample properties of the F form of our LM test are studied by Monte Carlo simulations. We illustrate how to test and model CNFs using the monthly growth of consumption and income data of United States (1985:1 to 2011:11).

Optimal lag-length choice in stable and unstable VAR models under situations of homoscedasticity and ARCH

The performance of different information criteria - namely Akaike, corrected Akaike (AICC), Schwarz-Bayesian (SBC), and Hannan-Quinn - is investigated so as to choose the optimal lag length in stable and unstable vector autoregressive (VAR) models both when autoregressive conditional heteroscedasticity (ARCH) is present and when it is not. The investigation covers both large and small sample sizes. The Monte Carlo simulation results show that SBC has relatively better performance in lag-choice accuracy in many situations. It is also generally the least sensitive to ARCH regardless of stability or instability of the VAR model, especially in large sample sizes. These appealing properties of SBC make it the optimal criterion for choosing lag length in many situations, especially in the case of financial data, which are usually characterized by occasional periods of high volatility. SBC also has the best forecasting abilities in the majority of situations in which we vary sample size, stability, variance structure (ARCH or not), and forecast horizon (one period or five). frequently, AICC also has good lag-choosing and forecasting properties. However, when ARCH is present, the five-period forecast performance of all criteria in all situations worsens.

Stable feature selection for clinical prediction: Exploiting ICD tree structure using Tree-Lasso

Modern healthcare is getting reshaped by growing Electronic Medical Records (EMR). Recently, these records have been shown of great value towards building clinical prediction models. In EMR data, patients' diseases and hospital interventions are captured through a set of diagnoses and procedures codes. These codes are usually represented in a tree form (e.g. ICD-10 tree) and the codes within a tree branch may be highly correlated. These codes can be used as features to build a prediction model and an appropriate feature selection can inform a clinician about important risk factors for a disease. Traditional feature selection methods (e.g. Information Gain, T-test, etc.) consider each variable independently and usually end up having a long feature list. Recently, Lasso and related l1-penalty based feature selection methods have become popular due to their joint feature selection property. However, Lasso is known to have problems of selecting one feature of many correlated features randomly. This hinders the clinicians to arrive at a stable feature set, which is crucial for clinical decision making process. In this paper, we solve this problem by using a recently proposed Tree-Lasso model. Since, the stability behavior of Tree-Lasso is not well understood, we study the stability behavior of Tree-Lasso and compare it with other feature selection methods. Using a synthetic and two real-world datasets (Cancer and Acute Myocardial Infarction), we show that Tree-Lasso based feature selection is significantly more stable than Lasso and comparable to other methods e.g. Information Gain, ReliefF and T-test. We further show that, using different types of classifiers such as logistic regression, naive Bayes, support vector machines, decision trees and Random Forest, the classification performance of Tree-Lasso is comparable to Lasso and better than other methods. Our result has implications in identifying stable risk factors for many healthcare problems and therefore can potentially assist clinical decision making for accurate medical prognosis.

Periodic perturbations of quadratic planar polynomial vector fields

Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES)

Seasonal population dynamics and the genetic structure of the mosquito vector Aedes aegypti in São Paulo, Brazil

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)

NORDSIECK FORMS OF STIFFLY-STABLE ADAMS-TYPE CYCLIC METHODS THAT ARE INSENSITIVE TO STEP-SIZE CHANGES

In this paper we determine a matrix S and a vector l for stiffly-stable Adams-type cyclic methods that are insensitive to step size changes by using the definition of equivalent methods, (see, e.g. [l]), in the Nordsieck notation. The elements S and l, written in a parametric form, permit us to represent in Nordsieck form the methods that were constructed in [7] and the new methods that satisfy the above properties.

Semliki Forest Virus as a Vector: Pros and Cons for Its Use in Biopharmaceuticals Production

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)

Sliding vector fields for non-smooth dynamical systems having intersecting switching manifolds

Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES)

Stable expression of Escherichia coli beta-glucuronidase A (GusA) in Giardia lamblia: application to high-throughput drug susceptibility testing

OBJECTIVES: In order to create a suitable model for high-throughput drug screening, a Giardia lamblia WB C6 strain expressing Escherichia coli glucuronidase A (GusA) was created and tested with respect to susceptibility to the anti-giardial drugs nitazoxanide and metronidazole. METHODS: GusA, a well-established reporter gene in other systems, was cloned into the vector pPacVInteg allowing stable expression in G. lamblia under control of the promoter from the glutamate dehydrogenase (gdh) gene. The resulting transgenic strain was compared with the wild-type strain in a vitality assay, characterized with respect to susceptibility to nitazoxanide, metronidazole and -- as assessed in a 96-well plate format -- to a panel of 15 other compounds to be tested for anti-giardial activity. RESULTS: GusA was stably expressed in G. lamblia. Using a simple glucuronidase assay protocol, drug efficacy tests yielded results similar to those from cell counting. CONCLUSIONS: G. lamblia WB C6 GusA is a suitable tool for high-throughput anti-giardial drug screening.

The lepidopteran transposon vector, piggyBac, mediates germ-line transformation in the Mediterranean fruit fly

The piggyBac (IFP2) short inverted terminal repeat transposable element from the cabbage looper Trichoplusia ni was tested for gene transfer vector function as part of a bipartite vector–helper system in the Mediterranean fruit fly Ceratitis capitata. A piggyBac vector marked with the medfly white gene was tested with a normally regulated piggyBac transposase helper at two different concentrations in a white eye host strain. Both experiments yielded transformants at an approximate frequency of 3–5%, with a total of six lines isolated having pigmented eyes with various levels of coloration. G1 transformant siblings from each line shared at least one common integration, with several sublines having an additional second integration. For the first transformant line isolated, two integrations were determined to be stable for 15 generations. For five of the lines, a piggyBac-mediated transposition was verified by sequencing the insertion site junctions isolated by inverse PCR that identified a characteristic piggyBac TTAA target site duplication. The efficient and stable transformation of the medfly with a lepidopteran vector represents transposon function over a relatively large evolutionary distance and suggests that the piggyBac system will be functional in a broad range of insects.

Cleavage Furrows Formed between Centrosomes Lacking an Intervening Spindle and Chromosomes Contain Microtubule Bundles, INCENP, and CHO1 but Not CENP-E

PtK1 cells containing two independent mitotic spindles can cleave between neighboring centrosomes, in the absence of an intervening spindle, as well as at the spindle equators. We used same-cell video, immunofluorescence, and electron microscopy to compare the structure and composition of normal equatorial furrows with that of ectopic furrows formed between spindles. As in controls, ectopic furrows contained midbodies composed of microtubule bundles and an electron-opaque matrix. Despite the absence of an intervening spindle and chromosomes, the midbodies associated with ectopic furrows also contained the microtubule-bundling protein CHO1 and the chromosomal passenger protein INCENP. However, CENP-E, another passenger protein, was not found in ectopic furrows but was always present in controls. We also examined cells in which the ectopic furrow initiated but relaxed. Although relaxing furrows contained overlapping microtubules from opposing centrosomes, they lacked microtubule bundles as well as INCENP and CHO1. Together these data suggest that the mechanism defining the site of furrow formation during mitosis in vertebrates does not depend on the presence of underlying microtubule bundles and chromosomes or on the stable association of INCENP or CHO1. The data also suggest that the completion of cytokinesis requires the presence of microtubule bundles and specific proteins (e.g., INCENP, CHO1, etc.) that do not include CENP-E.

Characterization of an In Vitro Model of Elastic Fiber Assembly

Elastic fibers consist of two morphologically distinct components: elastin and 10-nm fibrillin-containing microfibrils. During development, the microfibrils form bundles that appear to act as a scaffold for the deposition, orientation, and assembly of tropoelastin monomers into an insoluble elastic fiber. Although microfibrils can assemble independent of elastin, tropoelastin monomers do not assemble without the presence of microfibrils. In the present study, immortalized ciliary body pigmented epithelial (PE) cells were investigated for their potential to serve as a cell culture model for elastic fiber assembly. Northern analysis showed that the PE cells express microfibril proteins but do not express tropoelastin. Immunofluorescence staining and electron microscopy confirmed that the microfibril proteins produced by the PE cells assemble into intact microfibrils. When the PE cells were transfected with a mammalian expression vector containing a bovine tropoelastin cDNA, the cells were found to express and secrete tropoelastin. Immunofluorescence and electron microscopic examination of the transfected PE cells showed the presence of elastic fibers in the matrix. Biochemical analysis of this matrix showed the presence of cross-links that are unique to mature insoluble elastin. Together, these results indicate that the PE cells provide a unique, stable in vitro system in which to study elastic fiber assembly.

Cytochrome c′ folding triggered by electron transfer: Fast and slow formation of four-helix bundles

Reduced (FeII) Rhodopseudomonas palustris cytochrome c′ (Cyt c′) is more stable toward unfolding ([GuHCl]1/2 = 2.9(1) M) than the oxidized (FeIII) protein ([GuHCl]1/2 = 1.9(1) M). The difference in folding free energies (ΔΔGf° = 70 meV) is less than half of the difference in reduction potentials of the folded protein (100 mV vs. NHE) and a free heme in aqueous solution (≈−150 mV). The spectroscopic features of unfolded FeII–Cyt c′ indicate a low-spin heme that is axially coordinated to methionine sulfur (Met-15 or Met-25). Time-resolved absorption measurements after CO photodissociation from unfolded FeII(CO)–Cyt c′ confirm that methionine can bind to the ferroheme on the microsecond time scale [kobs = 5(2) × 104 s−1]. Protein folding was initiated by photoreduction (two-photon laser excitation of NADH) of unfolded FeIII–Cyt c′ ([GuHCl] = 2.02–2.54 M). Folding kinetics monitored by heme absorption span a wide time range and are highly heterogeneous; there are fast-folding (≈103 s−1), intermediate-folding (102–101 s−1), and slow-folding (10−1 s−1) populations, with the last two likely containing methionine-ligated (Met-15 or Met-25) ferrohemes. Kinetics after photoreduction of unfolded FeIII–Cyt c′ in the presence of CO are attributable to CO binding [1.4(6) × 103 s−1] and FeII(CO)–Cyt c′ folding [2.8(9) s−1] processes; stopped-flow triggered folding of FeIII–Cyt c′ (which does not contain a protein-derived sixth ligand) is adequately described by a single kinetics phase with an estimated folding time constant of ≈4 ms [ΔGf° = −33(3) kJ mol−1] at zero denaturant.