Simple approximate MAP inference for Dirichlet processes mixtures

The Dirichlet process mixture model (DPMM) is a ubiquitous, flexible Bayesian nonparametric statistical model. However, full probabilistic inference in this model is analytically intractable, so that computationally intensive techniques such as Gibbs sampling are required. As a result, DPMM-based methods, which have considerable potential, are restricted to applications in which computational resources and time for inference is plentiful. For example, they would not be practical for digital signal processing on embedded hardware, where computational resources are at a serious premium. Here, we develop a simplified yet statistically rigorous approximate maximum a-posteriori (MAP) inference algorithm for DPMMs. This algorithm is as simple as DP-means clustering, solves the MAP problem as well as Gibbs sampling, while requiring only a fraction of the computational effort. (For freely available code that implements the MAP-DP algorithm for Gaussian mixtures see http://www.maxlittle.net/.) Unlike related small variance asymptotics (SVA), our method is non-degenerate and so inherits the “rich get richer” property of the Dirichlet process. It also retains a non-degenerate closed-form likelihood which enables out-of-sample calculations and the use of standard tools such as cross-validation. We illustrate the benefits of our algorithm on a range of examples and contrast it to variational, SVA and sampling approaches from both a computational complexity perspective as well as in terms of clustering performance. We demonstrate the wide applicabiity of our approach by presenting an approximate MAP inference method for the infinite hidden Markov model whose performance contrasts favorably with a recently proposed hybrid SVA approach. Similarly, we show how our algorithm can applied to a semiparametric mixed-effects regression model where the random effects distribution is modelled using an infinite mixture model, as used in longitudinal progression modelling in population health science. Finally, we propose directions for future research on approximate MAP inference in Bayesian nonparametrics.

Improved inference in the evaluation of mutual fund performance using bootstrap methods

Two new methodologies are introduced to improve inference in the evaluation of mutual fund performance against benchmarks. First, the benchmark models are estimated using panel methods with both fund and time effects. Second, the non-normality of individual mutual fund returns is accounted for by using panel bootstrap methods. We also augment the standard benchmark factors with fund-specific characteristics, such as fund size. Using a dataset of UK equity mutual fund returns, we find that fund size has a negative effect on the average fund manager’s benchmark-adjusted performance. Further, when we allow for time effects and the non-normality of fund returns, we find that there is no evidence that even the best performing fund managers can significantly out-perform the augmented benchmarks after fund management charges are taken into account.

Preference inference based on Pareto models

In this paper, we consider Preference Inference based on a generalised form of Pareto order. Preference Inference aims at reasoning over an incomplete specification of user preferences. We focus on two problems. The Preference Deduction Problem (PDP) asks if another preference statement can be deduced (with certainty) from a set of given preference statements. The Preference Consistency Problem (PCP) asks if a set of given preference statements is consistent, i.e., the statements are not contradicting each other. Here, preference statements are direct comparisons between alternatives (strict and non-strict). It is assumed that a set of evaluation functions is known by which all alternatives can be rated. We consider Pareto models which induce order relations on the set of alternatives in a Pareto manner, i.e., one alternative is preferred to another only if it is preferred on every component of the model. We describe characterisations for deduction and consistency based on an analysis of the set of evaluation functions, and present algorithmic solutions and complexity results for PDP and PCP, based on Pareto models in general and for a special case. Furthermore, a comparison shows that the inference based on Pareto models is less cautious than some other types of well-known preference model.

Evaluation of two methods for computational HLA haplotypes inference using a real dataset

info:eu-repo/semantics/publishedVersion

Evaluation of two methods for computational HLA haplotypes inference using a real dataset

info:eu-repo/semantics/publishedVersion

ANALYSE THE VULNERABILITY IN THE MARANHÃO ILHA, BRAZIL, USING GIS TECHNIQUES AND GEOSPATIAL INFERENCE

Vulnerability and sustainability studies of an area help to assess both its level of exposure and capacity to support possible environmental impacts, and it is of primordial importance for proposals of the Legislation on Zoning, Allotment, Land Use/land cover, aiming to stimulate those areas indicated for urban growth, to discourage growth of overcrowded areas, to detect sections with restrictive use, as well as districts for permanent protection. This paper aims to analyze the vulnerability in the Maranhão Ilha, using GIS techniques, geospatial inference intersected with relevant social-environmental indicators.Estudos de vulnerabilidade e de sustentabilidade de uma área ajudam a avaliar o seu grau de exposição e sua capacidade de suporte a possíveis impactos ambientais, sendo fundamental para propostas de Lei de Zoneamento, Parcelamento, Uso e Ocupação do Solo, tendo por finalidade orientar as áreas onde deverá haver estímulo para o crescimento urbano; contenção da malha urbana; detecção de locais com possibilidade de uso restritivo, bem como locais de proteção permanente. Este trabalho propõe analisar o índice de vulnerabilidade a perda de solo da Ilha do Maranhão com base na metodologia proposta por (CREPANI, et al. 2001) e em técnicas de inferência espacial com apoio na AHP (Análise Hierárquica de Processo).

Tecniche di machine learning per type inference di linguaggi tipati dinamicamente

In questa tesi vengono discusse le principali tecniche di machine learning riguardanti l'inferenza di tipo nei linguaggi tipati dinamicamente come Python. In aggiunta è stato creato un dataset di progetti Python per l'addestramento di modelli capaci di analizzare il codice

New perspectives in statistical mechanics and high-dimensional inference

The main purpose of this thesis is to go beyond two usual assumptions that accompany theoretical analysis in spin-glasses and inference: the i.i.d. (independently and identically distributed) hypothesis on the noise elements and the finite rank regime. The first one appears since the early birth of spin-glasses. The second one instead concerns the inference viewpoint. Disordered systems and Bayesian inference have a well-established relation, evidenced by their continuous cross-fertilization. The thesis makes use of techniques coming both from the rigorous mathematical machinery of spin-glasses, such as the interpolation scheme, and from Statistical Physics, such as the replica method. The first chapter contains an introduction to the Sherrington-Kirkpatrick and spiked Wigner models. The first is a mean field spin-glass where the couplings are i.i.d. Gaussian random variables. The second instead amounts to establish the information theoretical limits in the reconstruction of a fixed low rank matrix, the “spike”, blurred by additive Gaussian noise. In chapters 2 and 3 the i.i.d. hypothesis on the noise is broken by assuming a noise with inhomogeneous variance profile. In spin-glasses this leads to multi-species models. The inferential counterpart is called spatial coupling. All the previous models are usually studied in the Bayes-optimal setting, where everything is known about the generating process of the data. In chapter 4 instead we study the spiked Wigner model where the prior on the signal to reconstruct is ignored. In chapter 5 we analyze the statistical limits of a spiked Wigner model where the noise is no longer Gaussian, but drawn from a random matrix ensemble, which makes its elements dependent. The thesis ends with chapter 6, where the challenging problem of high-rank probabilistic matrix factorization is tackled. Here we introduce a new procedure called "decimation" and we show that it is theoretically to perform matrix factorization through it.

Hierarchical active inference for cognitive architectures

This thesis explores the methods based on the free energy principle and active inference for modelling cognition. Active inference is an emerging framework for designing intelligent agents where psychological processes are cast in terms of Bayesian inference. Here, I appeal to it to test the design of a set of cognitive architectures, via simulation. These architectures are defined in terms of generative models where an agent executes a task under the assumption that all cognitive processes aspire to the same objective: the minimization of variational free energy. Chapter 1 introduces the free energy principle and its assumptions about self-organizing systems. Chapter 2 describes how from the mechanics of self-organization can emerge a minimal form of cognition able to achieve autopoiesis. In chapter 3 I present the method of how I formalize generative models for action and perception. The architectures proposed allow providing a more biologically plausible account of more complex cognitive processing that entails deep temporal features. I then present three simulation studies that aim to show different aspects of cognition, their associated behavior and the underlying neural dynamics. In chapter 4, the first study proposes an architecture that represents the visuomotor system for the encoding of actions during action observation, understanding and imitation. In chapter 5, the generative model is extended and is lesioned to simulate brain damage and neuropsychological patterns observed in apraxic patients. In chapter 6, the third study proposes an architecture for cognitive control and the modulation of attention for action selection. At last, I argue how active inference can provide a formal account of information processing in the brain and how the adaptive capabilities of the simulated agents are a mere consequence of the architecture of the generative models. Cognitive processing, then, becomes an emergent property of the minimization of variational free energy.

Molecular And Morphological Evidence Reveals A New Species In The Phyllomedusa Hypochondrialis Group (hylidae, Phyllomedusinae) From The Atlantic Forest Of The Highlands Of Southern Brazil.

The taxonomic status of a disjunctive population of Phyllomedusa from southern Brazil was diagnosed using molecular, chromosomal, and morphological approaches, which resulted in the recognition of a new species of the P. hypochondrialis group. Here, we describe P. rustica sp. n. from the Atlantic Forest biome, found in natural highland grassland formations on a plateau in the south of Brazil. Phylogenetic inferences placed P. rustica sp. n. in a subclade that includes P. rhodei + all the highland species of the clade. Chromosomal morphology is conservative, supporting the inference of homologies among the karyotypes of the species of this genus. Phyllomedusa rustica is apparently restricted to its type-locality, and we discuss the potential impact on the strategies applied to the conservation of the natural grassland formations found within the Brazilian Atlantic Forest biome in southern Brazil. We suggest that conservation strategies should be modified to guarantee the preservation of this species.

[consensus Of The Brazilian Society Of Rheumatology For The Diagnosis, Management And Treatment Of Lupus Nephritis].

To develop recommendations for the diagnosis, management and treatment of lupus nephritis in Brazil. Extensive literature review with a selection of papers based on the strength of scientific evidence and opinion of the Commission on Systemic Lupus Erythematosus members, Brazilian Society of Rheumatology. 1) Renal biopsy should be performed whenever possible and if this procedure is indicated; and, when the procedure is not possible, the treatment should be guided with the inference of histologic class. 2) Ideally, measures and precautions should be implemented before starting treatment, with emphasis on attention to the risk of infection. 3) Risks and benefits of treatment should be shared with the patient and his/her family. 4) The use of hydroxychloroquine (preferably) or chloroquine diphosphate is recommended for all patients (unless contraindicated) during induction and maintenance phases. 5) The evaluation of the effectiveness of treatment should be made with objective criteria of response (complete remission/partial remission/refractoriness). 6) ACE inhibitors and/or ARBs are recommended as antiproteinuric agents for all patients (unless contraindicated). 7) The identification of clinical and/or laboratory signs suggestive of proliferative or membranous glomerulonephritis should indicate an immediate implementation of specific therapy, including steroids and an immunosuppressive agent, even though histological confirmation is not possible. 8) Immunosuppressives must be used during at least 36 months, but these medications can be kept for longer periods. Its discontinuation should only be done when the patient achieve and maintain a sustained and complete remission. 9) Lupus nephritis should be considered as refractory when a full or partial remission is not achieved after 12 months of an appropriate treatment, when a new renal biopsy should be considered to assist in identifying the cause of refractoriness and in the therapeutic decision.

Sulfetos volatilizáveis por acidificação e metais extraídos simultaneamente na avaliação de sedimentos de água doce

This paper discusses the historical and methodological fundaments of the dynamics and quantification of acid volatile sulfides (AVS) and simultaneously extracted metals (SEM) in aquatic sediments. It also discusses the SEM/AVS relationship, which involves several controversial aspects such as sulfide stability, sulfide-organic matter interaction, and the inability to predict the toxicity of organic compounds in the environment. This relationship is an important tool for the inference of metal bioavailability. The use of ecotoxicological tests with target organisms regulated by international standards is also a relevant aspect.

Análise bayesiana do modelo de herança monogênica no melhoramento vegetal: um exemplo com abobrinha

A common breeding strategy is to carry out basic studies to investigate the hypothesis of a single gene controlling the trait (major gene) with or without polygenes of minor effect. In this study we used Bayesian inference to fit genetic additive-dominance models of inheritance to plant breeding experiments with multiple generations. Normal densities with different means, according to the major gene genotype, were considered in a linear model in which the design matrix of the genetic effects had unknown coefficients (which were estimated in individual basis). An actual data set from an inheritance study of partenocarpy in zucchini (Cucurbita pepo L.) was used for illustration. Model fitting included posterior probabilities for all individual genotypes. Analysis agrees with results in the literature but this approach was far more efficient than previous alternatives assuming that design matrix was known for the generations. Partenocarpy in zucchini is controlled by a major gene with important additive effect and partial dominance.

First cases of exclusive paternal care in stink bugs (Hemiptera: Pentatomidae)

We describe paternal care in two pentatomid bugs, Lopadusa (Lopadusa) augur Stål, 1860 and Edessa nigropunctata Berg, 1884. Field and laboratory observations showed that males remain with their eggs and early hatched nymphs, while females abandon the eggs after oviposition. Guarding males defensive behaviors towards their clutches were similar to those described for guarding females of pentatomids. Since there is no detailed information on the internal phylogeny of Pentatomidae, it is not possible to make a robust inference on whether paternal care in L. augur and E. nigropunctata has arisen independently or not. If the latter, the two new cases of paternal care we describe here represent the fifth event of independent evolution of this rare behavioral trait in Heteroptera.