Modeling Financial Time Series with Artificial Neural Networks

Financial time series convey the decisions and actions of a population of human actors over time. Econometric and regressive models have been developed in the past decades for analyzing these time series. More recently, biologically inspired artificial neural network models have been shown to overcome some of the main challenges of traditional techniques by better exploiting the non-linear, non-stationary, and oscillatory nature of noisy, chaotic human interactions. This review paper explores the options, benefits, and weaknesses of the various forms of artificial neural networks as compared with regression techniques in the field of financial time series analysis.

Searching the Sky with CONFIGR-STARS

SyNAPSE program of the Defense Advanced Projects Research Agency (HRL Laboratories LLC, subcontract #801881-BS under DARPA prime contract HR0011-09-C-0001); CELEST, a National Science Foundation Science of Learning Center (SBE-0354378)

Characterization of basal pseudopod-like processes in ileal and colonic PYY cells.

The peptide tyrosine tyrosine (PYY) is produced and secreted from L cells of the gastrointestinal mucosa. To study the anatomy and function of PYY-secreting L cells, we developed a transgenic PYY-green fluorescent protein mouse model. PYY-containing cells exhibited green fluorescence under UV light and were immunoreactive to antibodies against PYY and GLP-1 (glucagon-like peptide-1, an incretin hormone also secreted by L cells). PYY-GFP cells from 15 μm thick sections were imaged using confocal laser scanning microscopy and three-dimensionally (3D) reconstructed. Results revealed unique details of the anatomical differences between ileal and colonic PYY-GFP cells. In ileal villi, the apical portion of PYY cells makes minimal contact with the lumen of the gut. Long pseudopod-like basal processes extend from these cells and form an interface between the mucosal epithelium and the lamina propria. Some basal processes are up to 50 μm in length. Multiple processes can be seen protruding from one cell and these often have a terminus resembling a synapse that appears to interact with neighboring cells. In colonic crypts, PYY-GFP cells adopt a spindle-like shape and weave in between epithelial cells, while maintaining contact with the lumen and lamina propria. In both tissues, cytoplasmic granules containing the hormones PYY and GLP-1 are confined to the base of the cell, often filling the basal process. The anatomical arrangement of these structures suggests a dual function as a dock for receptors to survey absorbed nutrients and as a launching platform for hormone secretion in a paracrine fashion.

The DLK-1 kinase promotes mRNA stability and local translation in C. elegans synapses and axon regeneration.

Growth cone guidance and synaptic plasticity involve dynamic local changes in proteins at axons and dendrites. The Dual-Leucine zipper Kinase MAPKKK (DLK) has been previously implicated in synaptogenesis and axon outgrowth in C. elegans and other animals. Here we show that in C. elegans DLK-1 regulates not only proper synapse formation and axon morphology but also axon regeneration by influencing mRNA stability. DLK-1 kinase signals via a MAPKAP kinase, MAK-2, to stabilize the mRNA encoding CEBP-1, a bZip protein related to CCAAT/enhancer-binding proteins, via its 3'UTR. Inappropriate upregulation of cebp-1 in adult neurons disrupts synapses and axon morphology. CEBP-1 and the DLK-1 pathway are essential for axon regeneration after laser axotomy in adult neurons, and axotomy induces translation of CEBP-1 in axons. Our findings identify the DLK-1 pathway as a regulator of mRNA stability in synapse formation and maintenance and also in adult axon regeneration.

A heterosynaptic learning rule for neural networks

In this article we intoduce a novel stochastic Hebb-like learning rule for neural networks that is neurobiologically motivated. This learning rule combines features of unsupervised (Hebbian) and supervised (reinforcement) learning and is stochastic with respect to the selection of the time points when a synapse is modified. Moreover, the learning rule does not only affect the synapse between pre- and postsynaptic neuron, which is called homosynaptic plasticity, but effects also further remote synapses of the pre-and postsynaptic neuron. This more complex form of synaptic plasticity has recently come under investigations in neurobiology and is called heterosynaptic plasticity. We demonstrate that this learning rule is useful in training neural networks by learning parity functions including the exclusive-or (XOR) mapping in a multilayer feed-forward network. We find, that our stochastic learning rule works well, even in the presence of noise. Importantly, the mean leaxning time increases with the number of patterns to be learned polynomially, indicating efficient learning.

mGluR5 Positive Allosteric Modulators Facilitate both Hippocampal LTP and LTD and Enhance Spatial Learning

Highly selective positive allosteric modulators (PAMs) of metabotropic glutamate receptor subtype 5 (mGluR5) have emerged as a potential approach to treat positive symptoms associated with schizophrenia. mGluR5 plays an important role in both long-term potentiation (LTP) and long-term depression (LTD), suggesting that mGluR5 PAMs may also have utility in improving impaired cognitive function. However, if mGluR5 PAMs shift the balance of LTP and LTD or induce a state in which afferent activity induces lasting changes in synaptic function that are not appropriate for a given pattern of activity, this could disrupt rather than enhance cognitive function. We determined the effect of selective mGluR5 PAMs on the induction of LTP and LTD at the Schaffer collateral-CA1 synapse in the hippocampus. mGluR5-selective PAMs significantly enhanced threshold theta-burst stimulation (TBS)-induced LTP. In addition, mGluR5 PAMs enhanced both DHPG-induced LTD and LTD induced by the delivery of paired-pulse low-frequency stimulation. Selective potentiation of mGluR5 had no effect on LTP induced by suprathreshold TBS or saturated LTP. The finding that potentiation of mGluR5-mediated responses to stimulation of glutamatergic afferents enhances both LTP and LTD and supports the hypothesis that the activation of mGluR5 by endogenous glutamate contributes to both forms of plasticity. Furthermore, two systemically active mGluR5 PAMs enhanced performance in the Morris water maze, a measure of hippocampus-dependent spatial learning. Discovery of small molecules that enhance both LTP and LTD in an activity-appropriate manner shows a unique action on synaptic plasticity that may provide a novel approach for the treatment of impaired cognitive function. Neuropsychopharmacology (2009) 34, 2057-2071; doi:10.1038/npp.2009.30; published online 18 March 2009

Context-Dependent Pharmacology Exhibited by Negative Allosteric Modulators of Metabotropic Glutamate Receptor 7

Phenotypic studies of mice lacking metabotropic glutamate receptor subtype 7 (mGluR7) suggest that antagonists of this receptor may be promising for the treatment of central nervous system disorders such as anxiety and depression. Suzuki et al. (J Pharmacol Exp Ther 323: 147-156, 2007) recently reported the in vitro characterization of a novel mGluR7 antagonist called 6-(4-methoxyphenyl)-5-methyl-3-(4-pyridinyl)-isoxazolo[4,5-c]pyridin-4(5H)-one (MMPIP), which noncompetitively inhibited the activity of orthosteric and allosteric agonists at mGluR7. We describe that MMPIP acts as a noncompetitive antagonist in calcium mobilization assays in cells coexpressing mGluR7 and the promiscuous G protein G alpha(15). Assessment of the activity of a small library of MMPIP-derived compounds using this assay reveals that, despite similar potencies, compounds exhibit differences in negative co-operativity for agonist-mediated calcium mobilization. Examination of the inhibitory activity of MMPIP and analogs using endogenous G(i/o)-coupled assay readouts indicates that the pharmacology of these ligands seems to be context-dependent, and MMPIP exhibits differences in negative cooperativity in certain cellular backgrounds. Electrophysiological studies reveal that, in contrast to the orthosteric antagonist (2S)-2-amino-2-[(1S,2S)-2-carboxyclycloprop-1-yl]-3-(xanth-9-yl) propanoic acid (LY341495), MMPIP is unable to block agonist-mediated responses at the Schaffer collateral-CA1 synapse, a location at which neurotransmission has been shown to be modulated by mGluR7 activity. Thus, MMPIP and related compounds differentially inhibit coupling of mGluR7 in different cellular backgrounds and may not antagonize the coupling of this receptor to native G(i/o) signaling pathways in all cellular contexts. The pharmacology of this compound represents a striking example of the potential for context-dependent blockade of receptor responses by negative allosteric modulators.

An inherited duplication at the gene p21 Protein-Activated Kinase 7 (PAK7) is a risk factor for psychosis

Identifying rare, highly penetrant risk mutations may be an important step in dissecting the molecular etiology of schizophrenia. We conducted a gene-based analysis of large (>100kb), rare copy number variants (CNVs) in the Wellcome Trust Case Control Consortium 2 (WTCCC2) schizophrenia sample of 1,564 cases and 1,748 controls all from Ireland, and further extended the analysis to include an additional 5,196 UK controls. We found association with duplications at chr20p12.2 (P=0.007) and evidence of replication in large independent European schizophrenia (P=0.052) and UK bipolar disorder case-control cohorts (P=0.047). A combined analysis of Irish/UK subjects including additional psychosis cases (schizophrenia and bipolar disorder) identified 22 carriers in 11,707 cases and 10 carriers in 21,204 controls (meta-analysis CMH P value=2x10(-4) (odds ratio (OR)=11.3, 95% CI=3.7, ∞)). Nineteen of the 22 cases and 8 of the 10 controls carried duplications starting at 9.68Mb with similar breakpoints across samples. By haplotype analysis and sequencing we identified a tandem ∼149kb duplication overlapping the gene p21 Protein-Activated Kinase 7 (PAK7, also called PAK5) which was in linkage disequilibrium with local haplotypes (P=2.5x10(-21)), indicative of a single ancestral duplication event. We confirmed the breakpoints in 8/8 carriers tested and found co-segregation of the duplication with illness in two additional family members of one of the affected probands. We demonstrate that PAK7 is developmentally co-expressed with another known psychosis risk gene (DISC1) suggesting a potential molecular mechanism involving aberrant synapse development and plasticity.

Solitary and repetitive binding motifs for the AP2 complex alpha-appendage in amphiphysin and other accessory proteins

Adaptor protein (AP) complexes bind to transmembrane proteins destined for internalization and to membrane lipids, so linking cargo to the accessory internalization machinery. This machinery interacts with the appendage domains of APs, which have platform and beta-sandwich subdomains, forming the binding surfaces for interacting proteins. Proteins that interact with the subdomains do so via short motifs, usually found in regions of low structural complexity of the interacting proteins. So far, up to four motifs have been identified that bind to and partially compete for at least two sites on each of the appendage domains of the AP2 complex. Motifs in individual accessory proteins, their sequential arrangement into motif domains, and partial competition for binding sites on the appendage domains coordinate the formation of endocytic complexes in a temporal and spatial manner. In this work, we examine the dominant interaction sequence in amphiphysin, a synapse-enriched accessory protein, which generates membrane curvature and recruits the scission protein dynamin to the necks of coated pits, for the platform subdomain of the alpha-appendage. The motif domain of amphiphysin1 contains one copy of each of a DX(F/W) and FXDXF motif. We find that the FXDXF motif is the main determinant for the high affinity interaction with the alpha-adaptin appendage. We describe the optimal sequence of the FXDXF motif using thermodynamic and structural data and show how sequence variation controls the affinities of these motifs for the alpha-appendage.

Differential efficiency of the endocytic machinery in tonic and phasic synapses

Efficient synaptic vesicle membrane recycling is one of the key factors required to sustain neurotransmission. We investigated potential differences in the compensatory endocytic machineries in two glutamatergic synapses with phasic and tonic patterns of activity in the lamprey spinal cord. Post-embedding immunocytochemistry demonstrated that proteins involved in synaptic vesicle recycling, including dynamin, intersectin, and synapsin, occur at higher levels (labeling per vesicle) in tonic dorsal column synapses than in phasic reticulospinal synapses. Synaptic vesicle protein 2 occurred at similar levels in the two types of synapse. After challenging the synapses with high potassium stimulation for 30 min the vesicle pool in the tonic synapse was maintained at a normal level, while that in the phasic synapse was partly depleted along with expansion of the plasma membrane and accumulation of clathrin-coated intermediates at the periactive zone. Thus, our results indicate that an increased efficiency of the endocytic machinery in a synapse may be one of the factors underlying the ability to sustain neurotransmission at high rates.

A pre-embedding immunogold approach for detection of synaptic endocytic proteins in situ

During the past decade, many molecular components of clathrin-mediated endocytosis have been identified and proposed to play various hypothetical roles in the process [Nat. Rev. Neurosci. 1 (2000) 161; Nature 422 (2003) 37]. One limitation to the evaluation of these hypotheses is the efficiency and resolution of immunolocalization protocols currently in use. In order to facilitate the evaluation of these hypotheses and to understand more fully the molecular mechanisms of clathrin-mediated endocytosis, we have developed a protocol allowing enhanced and reliable subcellular immunolocalization of proteins in synaptic endocytic zones in situ. Synapses established by giant reticulospinal axons in lamprey are used as a model system for these experiments. These axons are unbranched and reach up to 80-100 microm in diameter. Synaptic active zones and surrounding endocytic zones are established on the surface of the axonal cylinder. To provide access for antibodies to the sites of synaptic vesicle recycling, axons are lightly fixed and cut along their longitudinal axis. To preserve the ultrastructure of the synaptic endocytic zone, antibodies are applied without the addition of detergents. Opened axons are incubated with primary antibodies, which are detected with secondary antibodies conjugated to gold particles. Specimens are then post-fixed and processed for electron microscopy. This approach allows preservation of the ultrastructure of the endocytic sites during immunolabeling procedures, while simultaneously achieving reliable immunogold detection of proteins on endocytic intermediates. To explore the utility of this approach, we have investigated the localization of a GTPase, dynamin, on clathrin-coated intermediates in the endocytic zone of the lamprey giant synapse. Using the present immunogold protocol, we confirm the presence of dynamin on late stage coated pits [Nature 422 (2003) 37] and also demonstrate that dynamin is recruited to the coat of endocytic intermediates from the very early stages of the clathrin coat formation. Thus, our experiments show that the current pre-embedding immunogold method is a useful experimental tool to study the molecular mechanisms of synaptic vesicle recycling.

Colocalization of synapsin and actin during synaptic vesicle recycling

It has been hypothesized that in the mature nerve terminal, interactions between synapsin and actin regulate the clustering of synaptic vesicles and the availability of vesicles for release during synaptic activity. Here, we have used immunogold electron microscopy to examine the subcellular localization of actin and synapsin in the giant synapse in lamprey at different states of synaptic activity. In agreement with earlier observations, in synapses at rest, synapsin immunoreactivity was preferentially localized to a portion of the vesicle cluster distal to the active zone. During synaptic activity, however, synapsin was detected in the pool of vesicles proximal to the active zone. In addition, actin and synapsin were found colocalized in a dynamic filamentous cytomatrix at the sites of synaptic vesicle recycling, endocytic zones. Synapsin immunolabeling was not associated with clathrin-coated intermediates but was found on vesicles that appeared to be recycling back to the cluster. Disruption of synapsin function by microinjection of antisynapsin antibodies resulted in a prominent reduction of the cytomatrix at endocytic zones of active synapses. Our data suggest that in addition to its known function in clustering of vesicles in the reserve pool, synapsin migrates from the synaptic vesicle cluster and participates in the organization of the actin-rich cytomatrix in the endocytic zone during synaptic activity.

Schizophrenia risk from complex variation of complement component 4

Schizophrenia is a heritable brain illness with unknown pathogenic mechanisms. Schizophrenia's strongest genetic association at a population level involves variation in the major histocompatibility complex (MHC) locus, but the genes and molecular mechanisms accounting for this have been challenging to identify. Here we show that this association arises in part from many structurally diverse alleles of the complement component 4 (C4) genes. We found that these alleles generated widely varying levels of C4A and C4B expression in the brain, with each common C4 allele associating with schizophrenia in proportion to its tendency to generate greater expression of C4A. Human C4 protein localized to neuronal synapses, dendrites, axons, and cell bodies. In mice, C4 mediated synapse elimination during postnatal development. These results implicate excessive complement activity in the development of schizophrenia and may help explain the reduced numbers of synapses in the brains of individuals with schizophrenia.

Molecular features of glycine-mediated neurotransmission in rat brain

Tese de doutoramento, Ciências Biomédicas (Neurociências), Universidade de Lisboa, Faculdade de Medicina, 2015

Synaptic dysfunction in early encephalopathies : from genes to function

Tese de doutoramento, Medicina (Neurologia), Universidade de Lisboa, Faculdade de Medicina, 2015