Modeling High-Dimensional Audio Sequences with Recurrent Neural Networks

Cette thèse étudie des modèles de séquences de haute dimension basés sur des réseaux de neurones récurrents (RNN) et leur application à la musique et à la parole. Bien qu'en principe les RNN puissent représenter les dépendances à long terme et la dynamique temporelle complexe propres aux séquences d'intérêt comme la vidéo, l'audio et la langue naturelle, ceux-ci n'ont pas été utilisés à leur plein potentiel depuis leur introduction par Rumelhart et al. (1986a) en raison de la difficulté de les entraîner efficacement par descente de gradient. Récemment, l'application fructueuse de l'optimisation Hessian-free et d'autres techniques d'entraînement avancées ont entraîné la recrudescence de leur utilisation dans plusieurs systèmes de l'état de l'art. Le travail de cette thèse prend part à ce développement. L'idée centrale consiste à exploiter la flexibilité des RNN pour apprendre une description probabiliste de séquences de symboles, c'est-à-dire une information de haut niveau associée aux signaux observés, qui en retour pourra servir d'à priori pour améliorer la précision de la recherche d'information. Par exemple, en modélisant l'évolution de groupes de notes dans la musique polyphonique, d'accords dans une progression harmonique, de phonèmes dans un énoncé oral ou encore de sources individuelles dans un mélange audio, nous pouvons améliorer significativement les méthodes de transcription polyphonique, de reconnaissance d'accords, de reconnaissance de la parole et de séparation de sources audio respectivement. L'application pratique de nos modèles à ces tâches est détaillée dans les quatre derniers articles présentés dans cette thèse. Dans le premier article, nous remplaçons la couche de sortie d'un RNN par des machines de Boltzmann restreintes conditionnelles pour décrire des distributions de sortie multimodales beaucoup plus riches. Dans le deuxième article, nous évaluons et proposons des méthodes avancées pour entraîner les RNN. Dans les quatre derniers articles, nous examinons différentes façons de combiner nos modèles symboliques à des réseaux profonds et à la factorisation matricielle non-négative, notamment par des produits d'experts, des architectures entrée/sortie et des cadres génératifs généralisant les modèles de Markov cachés. Nous proposons et analysons également des méthodes d'inférence efficaces pour ces modèles, telles la recherche vorace chronologique, la recherche en faisceau à haute dimension, la recherche en faisceau élagué et la descente de gradient. Finalement, nous abordons les questions de l'étiquette biaisée, du maître imposant, du lissage temporel, de la régularisation et du pré-entraînement.

A Monte Carlo method for accelerating the computation of animated radiosity sequences

Realistic rendering animation is known to be an expensive processing task when physically-based global illumination methods are used in order to improve illumination details. This paper presents an acceleration technique to compute animations in radiosity environments. The technique is based on an interpolated approach that exploits temporal coherence in radiosity. A fast global Monte Carlo pre-processing step is introduced to the whole computation of the animated sequence to select important frames. These are fully computed and used as a base for the interpolation of all the sequence. The approach is completely view-independent. Once the illumination is computed, it can be visualized by any animated camera. Results present significant high speed-ups showing that the technique could be an interesting alternative to deterministic methods for computing non-interactive radiosity animations for moderately complex scenarios

Temporal genetic variation of the red fox, Vulpes vulpes, across western Europe and the British Isles

Quaternary climatic fluctuations have had profound effects on the phylogeographic structure of many species. Classically, species were thought to have become isolated in peninsular refugia, but there is limited evidence that large, non-polar species survived outside traditional refugial areas. We examined the phylogeographic structure of the red fox (Vulpes vulpes), a species that shows high ecological adaptability in the western Palaearctic region. We compared mitochondrial DNA sequences (cytochrome b and control region) from 399 modern and 31 ancient individuals from across Europe. Our objective was to test whether red foxes colonised the British Isles from mainland Europe in the late Pleistocene, or whether there is evidence that they persisted in the region through the Last Glacial Maximum. We found red foxes to show a high degree of phylogeographic structuring across Europe and, consistent with palaeontological and ancient DNA evidence, confirmed via phylogenetic indicators that red foxes were persistent in areas outside peninsular refugia during the last ice age. Bayesian analyses and tests of neutrality indicated population expansion. We conclude that there is evidence that red foxes from the British Isles derived from central European populations that became isolated after the closure of the landbridge with Europe.

An investigation of Hebbian phase sequences as assembly graphs

Hebb proposed that synapses between neurons that fire synchronously are strengthened, forming cell assemblies and phase sequences. The former, on a shorter scale, are ensembles of synchronized cells that function transiently as a closed processing system; the latter, on a larger scale, correspond to the sequential activation of cell assemblies able to represent percepts and behaviors. Nowadays, the recording of large neuronal populations allows for the detection of multiple cell assemblies. Within Hebb's theory, the next logical step is the analysis of phase sequences. Here we detected phase sequences as consecutive assembly activation patterns, and then analyzed their graph attributes in relation to behavior. We investigated action potentials recorded from the adult rat hippocampus and neocortex before, during and after novel object exploration (experimental periods). Within assembly graphs, each assembly corresponded to a node, and each edge corresponded to the temporal sequence of consecutive node activations. The sum of all assembly activations was proportional to firing rates, but the activity of individual assemblies was not. Assembly repertoire was stable across experimental periods, suggesting that novel experience does not create new assemblies in the adult rat. Assembly graph attributes, on the other hand, varied significantly across behavioral states and experimental periods, and were separable enough to correctly classify experimental periods (Naïve Bayes classifier; maximum AUROCs ranging from 0.55 to 0.99) and behavioral states (waking, slow wave sleep, and rapid eye movement sleep; maximum AUROCs ranging from 0.64 to 0.98). Our findings agree with Hebb's view that assemblies correspond to primitive building blocks of representation, nearly unchanged in the adult, while phase sequences are labile across behavioral states and change after novel experience. The results are compatible with a role for phase sequences in behavior and cognition.

Phyllosticta citricarpa: diversidade genética temporal em pomares de citrus sinensis e sensibilidade a fungicidas

Pós-graduação em Agronomia (Genética e Melhoramento de Plantas) - FCAV

Spatio-temporal dynamics of alpha brain electric fields, and cognitive modes

Brian electric activity is viewed as sequences of momentary maps of potential distribution. Frequency-domain source modeling, estimation of the complexity of the trajectory of the mapped brain field distributions in state space, and microstate parsing were used as analysis tools. Input-presentation as well as task-free (spontaneous thought) data collection paradigms were employed. We found: Alpha EEG field strength is more affected by visualizing mentation than by abstract mentation, both input-driven as well as self-generated. There are different neuronal populations and brain locations of the electric generators for different temporal frequencies of the brain field. Different alpha frequencies execute different brain functions as revealed by canonical correlations with mentation profiles. Different modes of mentation engage the same temporal frequencies at different brain locations. The basic structure of alpha electric fields implies inhomogeneity over time — alpha consists of concatenated global microstates in the sub-second range, characterized by quasi-stable field topographies, and rapid transitions between the microstates. In general, brain activity is strongly discontinuous, indicating that parsing into field landscape-defined microstates is appropriate. Different modes of spontaneous and induced mentation are associated with different brain electric microstates; these are proposed as candidates for psychophysiological ``atoms of thought''.

DNA alignment and Bayesian trees of partial sequences of COI, COIII and the haemocyanin functional unit f-g of 28 octopod species

Background: Octopods have successfully colonised the world's oceans from the tropics to the poles. Yet, successful persistence in these habitats has required adaptations of their advanced physiological apparatus to compensate impaired oxygen supply. Their oxygen transporter haemocyanin plays a major role in cold tolerance and accordingly has undergone functional modifications to sustain oxygen release at sub-zero temperatures. However, it remains unknown how molecular properties evolved to explain the observed functional adaptations. We thus aimed to assess whether natural selection affected molecular and structural properties of haemocyanin that explains temperature adaptation in octopods. Results: Analysis of 239 partial sequences of the haemocyanin functional units (FU) f and g of 28 octopod species of polar, temperate, subtropical and tropical origin revealed natural selection was acting primarily on charge properties of surface residues. Polar octopods contained haemocyanins with higher net surface charge due to decreased glutamic acid content and higher numbers of basic amino acids. Within the analysed partial sequences, positive selection was present at site 2545, positioned between the active copper binding centre and the FU g surface. At this site, methionine was the dominant amino acid in polar octopods and leucine was dominant in tropical octopods. Sites directly involved in oxygen binding or quaternary interactions were highly conserved within the analysed sequence. Conclusions: This study has provided the first insight into molecular and structural mechanisms that have enabled octopods to sustain oxygen supply from polar to tropical conditions. Our findings imply modulation of oxygen binding via charge-charge interaction at the protein surface, which stabilize quaternary interactions among functional units to reduce detrimental effects of high pH on venous oxygen release. Of the observed partial haemocyanin sequence, residue 2545 formed a close link between the FU g surface and the active centre, suggesting a role as allosteric binding site. The prevalence of methionine at this site in polar octopods, implies regulation of oxygen affinity via increased sensitivity to allosteric metal binding. High sequence conservation of sites directly involved in oxygen binding indicates that functional modifications of octopod haemocyanin rather occur via more subtle mechanisms, as observed in this study.

Perceived Video Quality Estimation from Spatial and Temporal Information Contents and Network Performance Parameters in IPTV

The paper proposes a model for estimation of perceived video quality in IPTV, taking as input both video coding and network Quality of Service parameters. It includes some fitting parameters that depend mainly on the information contents of the video sequences. A method to derive them from the Spatial and Temporal Information contents of the sequences is proposed. The model may be used for near real-time monitoring of IPTV video quality.

Effects of temporal association on recognition memory

The influence of temporal association on the representation and recognition of objects was investigated. Observers were shown sequences of novel faces in which the identity of the face changed as the head rotated. As a result, observers showed a tendency to treat the views as if they were of the same person. Additional experiments revealed that this was only true if the training sequences depicted head rotations rather than jumbled views; in other words, the sequence had to be spatially as well as temporally smooth. Results suggest that we are continuously associating views of objects to support later recognition, and that we do so not only on the basis of the physical similarity, but also the correlated appearance in time of the objects.

Strand specificity in the transcriptional targeting of recombination at immunoglobulin switch sequences.

B-lymphocyte-specific class switch recombination is known to occur between pairs of 2- to 10-kb switch regions located immediately upstream of the immunoglobulin constant heavy-chain genes. Others have shown that the recombination is temporally correlated with the induction of transcription at the targeted switch regions. To determine whether this temporal correlation is due to a mechanistic linkage, we have developed an extrachromosomal recombination assay that closely recapitulates DNA deletional class switch recombination. In this assay, the rate of recombination is measured between 24 and 48 hr posttransfection. We find that recombinants are generated in a switch sequence-dependent manner. Recombination occurs with a predominance within B-cell lines representative of the mature B-cell stage and within a subset of pre-B-cell lines. Transcription stimulates the switch sequence-dependent recombination. Importantly, transcription activates recombination only when directed in the physiologic orientation but has no effect when directed in the nonphysiologic orientation.

Deformable templates for tracking and analysis of intravascular ultrasound sequences

Deformable Template models are first applied to track the inner wall of coronary arteries in intravascular ultrasound sequences, mainly in the assistance to angioplasty surgery. A circular template is used for initializing an elliptical deformable model to track wall deformation when inflating a balloon placed at the tip of the catheter. We define a new energy function for driving the behavior of the template and we test its robustness both in real and synthetic images. Finally we introduce a framework for learning and recognizing spatio-temporal geometric constraints based on Principal Component Analysis (eigenconstraints).

Spatio-temporal scanning and statistical test of the accelerating moment release (AMR) model using Australian earthquake data

The Accelerating Moment Release (AMR) preceding earthquakes with magnitude above 5 in Australia that occurred during the last 20 years was analyzed to test the Critical Point Hypothesis. Twelve earthquakes in the catalog were chosen based on a criterion for the number of nearby events. Results show that seven sequences with numerous events recorded leading up to the main earthquake exhibited accelerating moment release. Two occurred near in time and space to other earthquakes preceded by AM R. The remaining three sequences had very few events in the catalog so the lack of AMR detected in the analysis may be related to catalog incompleteness. Spatio-temporal scanning of AMR parameters shows that 80% of the areas in which AMR occurred experienced large events. In areas of similar background seismicity with no large events, 10 out of 12 cases exhibit no AMR, and two others are false alarms where AMR was observed but no large event followed. The relationship between AMR and Load-Unload Response Ratio (LURR) was studied. Both methods predict similar critical region sizes, however, the critical point time using AMR is slightly earlier than the time of the critical point LURR anomaly.

Auditory stream segregation in cochlear implant listeners:measures based on temporal discrimination and interleaved melody recognition

The evidence that cochlear implant listeners routinely experience stream segregation is limited and equivocal. Streaming in these listeners was explored using tone sequences matched to the center frequencies of the implant’s 22 electrodes. Experiment 1 measured temporal discrimination for short (ABA triplet) and longer (12 AB cycles) sequences (tone/silence durations = 60/40 ms). Tone A stimulated electrode 11; tone B stimulated one of 14 electrodes. On each trial, one sequence remained isochronous, and tone B was delayed in the other; listeners had to identify the anisochronous interval. The delay was introduced in the second half of the longer sequences. Prior build-up of streaming should cause thresholds to rise more steeply with increasing electrode separation, but no interaction with sequence length was found. Experiment 2 required listeners to identify which of two target sequences was present when interleaved with distractors (tone/silence durations = 120/80 ms). Accuracy was high for isolated targets, but most listeners performed near chance when loudness-matched distractors were added, even when remote from the target. Only a substantial reduction in distractor level improved performance, and this effect did not interact with target-distractor separation. These results indicate that implantees often do not achieve stream segregation, even in relatively unchallenging tasks.

Ammonite biostratigraphy, lithofacies variations, and paleoceanographic implications for Barremian-Aptian sequences of northeastern Mexico

Two Barremian-Aptian sequences studied in Durango and Nuevo Leon States, northeastern Mexico include three lithic units which have been described as the Cupido Formation of Barremian-early Early Aptian age, its lateral equivalent, the Lower Tamaulipas Formation, and the La Peña Formation extending through the early Albian. ^ The present work improves the existing ammonite Aptian biozonation by considering constraints associated with a discontinuous spatial and temporal record of the different taxa within the La Peña Formation. ^ Four ammonite biozones are established: (1) The Dufrenoyia justinae Zone for the late Early Aptian, (2) The Burckhardtites nazasensis/Rhytidoplites robertsi Zone for the middle Aptian, (3) The Cheloniceras inconstans Zone for the early Late Aptian, and (4) The Hypacanthoplites cf. leanzae Zone for the late late Aptian. ^ Also, a detailed sedimentological analysis of the sections shed further light on the possible causes that controlled intermittent occurrences of the ammonites in relation to the prevailing paleoceanographic and paleoecologic conditions in northeastern Mexico during the late Barremian-Aptian. ^ Microfacies analyses show that the upper part of the Cupido facies are represented by biocalcirudite with rudists, biocalcarenites with oolites and algae, and rich benthonic foraminifera assemblages with ostracods. These facies are related to paleoceanographic conditions of sedimentation within a shallow-marine carbonate platform. Its lateral equivalent, deep-water facies extended to the southeast and it is represented by the Lower Tamaulipas Formation, which includes planktonic foraminifera, ostracods, and mollusk and echinoid fragments. The beginning of deposition of the La Peña Formation in the late Early Aptian is characterized by an increase in terrigenous materials and significant decrease in the abundance of benthic fauna. The La Peña Formation is recognized by an alternation of marls and shale limestones containing ammonites, planktonic foraminifera, ostracods, and radiolaria toward the top. Accumulation of the La Peña continued throughout the end of the Aptian and records changes in conditions of sedimentation and productivity in the water column, which abruptly terminated the carbonate deposition in the Cupido Platform. ^ Results of carbon/carbonate content analyses show that changes from the Cupido to the La Peña facies are also characterized by an increase of organic carbon, which indicate the onset of enhanced dysoxic/anoxic conditions in the lower water column. ^

Ammonite biostratigraphy, lithofacies variations, and paleoceanographic implications for barremian-aptian sequences of northeastern Mexico

Two Barremian-Aptian sequences studied in Durango and Nuevo Leon States, northeastern Mexico include three lithic units which have been described as the Cupido Formation of Barremian-early Early Aptian age, its lateral equivalent, the Lower Tamaulipas Formation, and the La Pena Formation extending through the early Albian. The present work improves the existing ammonite Aptian biozonation by considering constraints associated with a discontinuous spatial and temporal record of the different taxa within the La Pena Formation. Four ammonite biozones are established: 1) The Dufrenoyia justinae Zone for the late Early Aptian, 2) The Burckhardtites nazasensis/Rhytidoplites robertsi Zone for the middle Aptian, 3) The Cheloniceras inconstans Zone for the early Late Aptian, and 4) The Hypacanthoplites cf. leanzae Zone for the late late Aptian. Also, a detailed sedimentological analysis of the sections shed further light on the possible causes that controlled intermittent occurrences of the ammonites in relation to the prevailing paleoceanographic and paleoecologic conditions in northeastern Mexico during the late Barremian-Aptian. Microfacies analyses show that the upper part of the Cupido facies are represented by biocalcirudite with rudists, biocalcarenites with oolites and algae, and rich benthonic foraminifera assemblages with ostracods. These facies are related to paleoceanographic conditions of sedimentation within a shallow-marine carbonate platform. Its lateral equivalent, deep-water facies extended to the southeast and it is represented by the Lower Tamaulipas Formation, which includes planktonic foraminifera, ostracods, and mollusk and echinoid fragments. The beginning of deposition of the La Pena Formation in the late Early Aptian is characterized by an increase in terrigenous materials and significant decrease in the abundance of benthic fauna. The La Pena Formation is recognized by an alternation of marls and shale limestones containing ammonites, planktonic foraminifera, ostracods, and radiolaria toward the top. Accumulation of the La Pena continued throughout the end of the Aptian and records changes in conditions of sedimentation and productivity in the water column, which abruptly terminated the carbonate deposition in the Cupido Platform. Results of carbon/carbonate content analyses show that changes from the Cupido to the La Pena facies are also characterized by an increase of organic carbon, which indicate the onset of enhanced dysoxic/anoxic conditions in the lower water column.