Variational studies and replica symmetry breaking in the generalization problem of the binary perceptron

We analyze the average performance of a general class of learning algorithms for the nondeterministic polynomial time complete problem of rule extraction by a binary perceptron. The examples are generated by a rule implemented by a teacher network of similar architecture. A variational approach is used in trying to identify the potential energy that leads to the largest generalization in the thermodynamic limit. We restrict our search to algorithms that always satisfy the binary constraints. A replica symmetric ansatz leads to a learning algorithm which presents a phase transition in violation of an information theoretical bound. Stability analysis shows that this is due to a failure of the replica symmetric ansatz and the first step of replica symmetry breaking (RSB) is studied. The variational method does not determine a unique potential but it allows construction of a class with a unique minimum within each first order valley. Members of this class improve on the performance of Gibbs algorithm but fail to reach the Bayesian limit in the low generalization phase. They even fail to reach the performance of the best binary, an optimal clipping of the barycenter of version space. We find a trade-off between a good low performance and early onset of perfect generalization. Although the RSB may be locally stable we discuss the possibility that it fails to be the correct saddle point globally. ©2000 The American Physical Society.

Synthesis and crystal phase evaluation of hydroxylapatite using the rietveld-maximum entropy method

Bioceramic systems based on hydroxylapatite (HAP) are an important class of bioactive materials that may promote bone regeneration. The aim of this research was to evaluate how the stoichiometry of HAP influences its microstructural properties when diagnosed using the combined Rietveld method and Maximum entropy method (MEM). The Rietveld Method (RM) is recognizably a powerful tool used to obtain structural and microstructural information of polycrystalline samples analyzed by x-ray diffraction. Latterly have combined the RM with the maximum entropy method (MEM), with the goal of improve structural refinement results. The MEM provides high resolution maps of electron density and their analysis leave the accurate localization of atoms inside of unit cell. Like that, cycles Rietveld-MEM allow an excellent structural refinement In this work, a hydroxylapatite sample obtained by emulsion method had its structure refined using one cycle Rietveld-MEM with x-ray diffraction data. The indices obtained in initial refinement was Rwp = 7.50%, Re = 6.56%, S - 1.14% e RB = 1.03%. After MEM refinement and electron densities maps analysis to correction of atomics positions, the news indicators of Rietveld refinement quality was Rwp = 7.35%, Re = 6.56%, S = 1.12% and RB = 0.75%. The excellent result obtained to RB shows the efficiency of MEM as auxiliary in the refinement of structure of hydroxylapatite by RM.

Born-infeld corrections to the entropy function of heterotic black holes

We use the black hole entropy function to study the effect of Born-Infeld terms on the entropy of extremal black holes in heterotic string theory in four dimensions. We find, that after adding a set of higher curvature terms to the effective action, attractor mechanism, works and Born-Infeld terms contribute to the stretching of near horizon geometry. In the α′ → 0 limit, the solutions of attractor equations for moduli, fields and the resulting entropy, are in conformity with the ones for standard two charge black holes.

Entropy variation in isothermal fluid flow considering real gas effects

The present paper concerns on the estimative of the pressure loss and entropy variation in an isothermal fluid flow, considering real gas effects. The 1D formulation is based on the isothermal compressibility module and on the thermal expansion coefficient in order to be applicable for both gas and liquid as pure substances. It is emphasized on the simple methodology description, which establishes a relationship between the formulation adopted for ideal gas and another considering real gas effects. A computational procedure has been developed, which can be used to determine the flow properties in duct with a variable area, where real gas behavior is significant. In order to obtain quantitative results, three virial coefficients for Helium equation of state are employed to determine the percentage difference in pressure and entropy obtained from different formulations. Results are presented graphically in the form of real gas correction factors, which can be applied to perfect gas calculations.

Quantum entanglement and information: The effect of entropy revisited

In non-extensive statistical mechanics [14], it is a nonsense statement to say that the entropy of a system is extensive (or not), without mentioning a law of composition of its elements. In this theory quantum correlations might be perceived through quantum information process. This article, that is an extension of recent work [4], is a comparative study between the entropies of Von Neumann and of Tsallis, with some implementations of the effect of entropy in quantum entanglement, important as a process for transmission of quantum information. We consider two factorized (Fock number) states, which interact through a beam splitter bilinear Hamiltonian with two entries. This comparison showed us that the entropies of Tsallis and Von Neumann behave differently depending on the reflectance of the beam splitter. © 2011 Academic Publications.

Preprocessing data for short-term load forecasting with a general regression neural network and a moving average filter

This paper proposes a filter based on a general regression neural network and a moving average filter, for preprocessing half-hourly load data for short-term multinodal load forecasting, discussed in another paper. Tests made with half-hourly load data from nine New Zealand electrical substations demonstrate that this filter is able to handle noise, missing data and abnormal data. © 2011 IEEE.

Fractal dimension and Shannon's entropy analyses of the architectural complexity caused by the inflammatory reactions induced by highly crystalline polyvinyl alcohol) microspheres implanted in subcutaneous tissues of the Wistar rats

The results of the histopathological analyses after the implantation of highly crystalline PVA microspheres in subcutaneous tissues of Wistar rats are here in reported. Three different groups of PVA microparticles were systematically studied: highly crystalline, amorphous, and commercial ones. In addition to these experiments, complementary analyses of architectural complexity were performed using fractal dimension (FD), and Shannon's entropy (SE) concepts. The highly crystalline microspheres induced inflammatory reactions similar to the ones observed for the commercial ones, while the inflammatory reactions caused by the amorphous ones were less intense. Statistical analyses of the subcutaneous tissues of Wistar rats implanted with the highly crystalline microspheres resulted in FD and SE values significantly higher than the statistical parameters observed for the amorphous ones. The FD and SE parameters obtained for the subcutaneous tissues of Wistar rats implanted with crystalline and commercial microparticles were statistically similar. Briefly, the results indicated that the new highly crystalline microspheres had biocompatible behavior comparable to the commercial ones. In addition, statistical tools such as FD and SE analyses when combined with histopathological analyses can be useful tools to investigate the architectural complexity tissues caused by complex inflammatory reactions. © 2012 WILEY PERIODICALS, INC.

Genetic associations among average annual productivity, growth traits, and stayability: A parallel between Nelore and composite beef cattle

This study was conducted to examine the relationship among average annual productivity of the cow (PRODAM), yearling weight (YW), postweaning BW gain (PWG), scrotal circumference (SC), and stayability in the herd for at least 6 yr (STAY) of Nelore and composite beef cattle. Measurements were taken on animals born between 1980 and 2010 on 70 farms located in 7 Brazilian states. Estimates of heritability and genetic and environmental correlations were obtained by Bayesian approach with 5-trait animal models. Genetic trends were estimated by regressing means of estimated breeding values by year of birth. The heritability estimates were between 0.14 and 0.47. Estimates of genetic correlation among female traits (PRODAM and STAY) and growth traits ranged from-0.02 to 0.30. Estimates of genetic correlations ranged from 0.23 to 0.94 among growth traits indicating that selection for these traits could be successful in tropical breeding programs. Genetic correlations among all traits were favorable and simultaneous selection for growth, productivity, and stayability is therefore possible. Genetic correlation between PRODAM and STAY was 0.99 and 0.85 for Nelore and composite cattle, respectively. Therefore, PRODAM and STAY might be influenced by many of the same genes. The inclusion of PRODAM instead of STAY as a selection criterion seems to be more advantageous for tropical breeding programs because the generation interval required to obtain accurate estimates of genetic merit for PRODAM is shorter. Average annual genetic changes were greater in Nelore than in composite cattle. This was not unexpected because the breeding program of composite cattle included a large number of farms, different production environments, and genetic level of the herds and breeds. Thus, the selection process has become more difficult in this population. © 2013 American Society of Animal Science. All rights reserved.

Unsupervised segmentation method for cuboidal cell nuclei in histological prostate images based on minimum cross entropy

This paper presents a novel segmentation method for cuboidal cell nuclei in images of prostate tissue stained with hematoxylin and eosin. The proposed method allows segmenting normal, hyperplastic and cancerous prostate images in three steps: pre-processing, segmentation of cuboidal cell nuclei and post-processing. The pre-processing step consists of applying contrast stretching to the red (R) channel to highlight the contrast of cuboidal cell nuclei. The aim of the second step is to apply global thresholding based on minimum cross entropy to generate a binary image with candidate regions for cuboidal cell nuclei. In the post-processing step, false positives are removed using the connected component method. The proposed segmentation method was applied to an image bank with 105 samples and measures of sensitivity, specificity and accuracy were compared with those provided by other segmentation approaches available in the specialized literature. The results are promising and demonstrate that the proposed method allows the segmentation of cuboidal cell nuclei with a mean accuracy of 97%. © 2013 Elsevier Ltd. All rights reserved.

Triplet entropy analysis of hemagglutinin and neuraminidase sequences measures influenza virus phylodynamics

The influenza virus has been a challenge to science due to its ability to withstand new environmental conditions. Taking into account the development of virus sequence databases, computational approaches can be helpful to understand virus behavior over time. Furthermore, they can suggest new directions to deal with influenza. This work presents triplet entropy analysis as a potential phylodynamic tool to quantify nucleotide organization of viral sequences. The application of this measure to segments of hemagglutinin (HA) and neuraminidase (NA) of H1N1 and H3N2 virus subtypes has shown some variability effects along timeline, inferring about virus evolution. Sequences were divided by year and compared for virus subtype (H1N1 and H3N2). The nonparametric Mann-Whitney test was used for comparison between groups. Results show that differentiation in entropy precedes differentiation in GC content for both groups. Considering the HA fragment, both triplet entropy as well as GC concentration show intersection in 2009, year of the recent pandemic. Some conclusions about possible flu evolutionary lines were drawn. © 2013 Elsevier B.V.

Can entanglement explain black hole entropy?

Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq)

Modelo arquitetônico de ninhos, biologia e divisão de trabalho de Pachycondyla striata Fr. Smith, 1858 (Hymenoptera : Formicidae : Ponerinae)

Pós-graduação em Ciências Biológicas (Zoologia) - IBRC

Obtenção de materiais magnéticos para o estudo da propriedade magnetocalórica

Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES)

Genome-wide association study for feedlot average daily gain in Nellore cattle (Bos indicus)

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)

Inbreeding, Average Relatedness Coefficient and Effective Population Size In Jaffarabadi Buffaloes Raised In Brazil

The major aim of this study was to evaluate the inbreeding (F), average relatedness coefficient (AR) and effective population size (Ne) in the Jaffarabadi buffalo breed from Brazil. Pedigree information of 1,272 animals born from 1966 was used. The effective population size was calculated in two ways: first, computed via individual increase in inbreeding and second estimated by individual increase in coancestry. The known generation numbers were 1.24, 1.76 and 2.64 for complete, equivalent and maximum generation, respectively. The effective size computed via individual increase in coancestry was small with a value of 10.82 +/- 1.29. The effective size computed by individual increase in inbreeding (10.40 +/- 3.69) was very similar but a little smaller than the previous reported value. The average values of F and AR for the population reference (1,059) were 4.22 and 12.5 percent. The mean of F for inbred animals (319) was 14.0%. The F and AR means were 5.7 and 13.3% for animals with at least 1.5 known equivalent generation and 9.3 and 15.97% for individuals having at least 2.5 equivalent generations known. It was found 78 matings between half sibs (6.14%) and 67 matings (5.27%) between parent-offspring. The estimated inbreeding increase per generation by considering maximum generation, complete generation and equivalent generation were 1.21%, 5.18% and 3.57%, respectively. Considering the uncompleted pedigree, the estimated inbreeding for the reference population could be underestimated.