Boosting the margin: A new explanation for the effectiveness of voting methods

One of the surprising recurring phenomena observed in experiments with boosting is that the test error of the generated classifier usually does not increase as its size becomes very large, and often is observed to decrease even after the training error reaches zero. In this paper, we show that this phenomenon is related to the distribution of margins of the training examples with respect to the generated voting classification rule, where the margin of an example is simply the difference between the number of correct votes and the maximum number of votes received by any incorrect label. We show that techniques used in the analysis of Vapnik's support vector classifiers and of neural networks with small weights can be applied to voting methods to relate the margin distribution to the test error. We also show theoretically and experimentally that boosting is especially effective at increasing the margins of the training examples. Finally, we compare our explanation to those based on the bias-variance decomposition.

'The war of Canudos: a Euclidean interpretation.' [Guerra de Canudos: uma leitura euclidiana]

The publication of the book The interior, in 1902, would change the course of thinking about the War of Canudos, who for many years, had been known simply as' the history of Euclid. President Getulio Vargas became interested in the backwoods bloodbath after reading the book avenger-Euclidean. Liked the work he visited the place of occurrence of war promising enjoy the river poured-Barris with the construction of the weir Cocorobo. Euclides da Cunha lived and produced his work in a time of great change in thought, politics and technology. Despite having worked in the press throughout his life, was best known as an engineer, for having exercised the office during the reconstruction of the bridge, in Sao Jose do Rio Pardo. This article aims to illuminate the event of war in light of the Euclidean work. We will examine the trajectory of Euclides da Cunha in journalism. Your learning process to execute the office newsreader and war correspondent, the newspaper O Estado de S. Paul, as well as their reports and work-monument the hinterlands. Resumo: A publicação da obra Os sertões, em 1902, mudaria os rumos do pensamento sobre a Guerra de Canudos, que, por muitos anos, ficara conhecida, simplesmente, como ‘história de Euclides’. O presidente Getúlio Vargas interessou-se pela hecatombe sertaneja após ter lido o livro-vingador euclidiano. Gostou tanto da obra que visitou o lugar de acontecimento da guerra prometendo aproveitar as águas do rio Vaza-Barris com a construção do açude de Cocorobó. Euclides da Cunha viveu e produziu a sua obra em um momento de grandes transformações no pensamento, na política e na tecnologia. Apesar de ter atuado na imprensa ao longo de toda a sua vida, ficou mais conhecido como engenheiro, por ter exercido o ofício, durante a reconstrução da ponte, em São José do Rio Pardo. O presente artigo visa iluminar o acontecimento da guerra à luz da obra euclidiana. Examinaremos a trajetória de Euclides da Cunha no jornalismo. O seu processo de aprendizagem para exercer o ofício de noticiarista e correspondente de guerra, pelo jornal O Estado de S. Paulo, bem como, as suas reportagens e obra-monumento Os sertões.

Recursive pathways to marginal likelihood estimation with prior-sensitivity analysis

We investigate the utility to computational Bayesian analyses of a particular family of recursive marginal likelihood estimators characterized by the (equivalent) algorithms known as "biased sampling" or "reverse logistic regression" in the statistics literature and "the density of states" in physics. Through a pair of numerical examples (including mixture modeling of the well-known galaxy dataset) we highlight the remarkable diversity of sampling schemes amenable to such recursive normalization, as well as the notable efficiency of the resulting pseudo-mixture distributions for gauging prior-sensitivity in the Bayesian model selection context. Our key theoretical contributions are to introduce a novel heuristic ("thermodynamic integration via importance sampling") for qualifying the role of the bridging sequence in this procedure, and to reveal various connections between these recursive estimators and the nested sampling technique.

Some remarks on the symplectic pairing on the moduli space of representations of the fundamental group of surfaces

This work grew out of an attempt to understand a conjectural remark made by Professor Kyoji Saito to the author about a possible link between the Fox-calculus description of the symplectic structure on the moduli space of representations of the fundamental group of surfaces into a Lie group and pairs of mutually dual sets of generators of the fundamental group. In fact in his paper [3] , Prof. Kyoji Saito gives an explicit description of the system of dual generators of the fundamental group.

Unitary Processes with Independent Increments and Representations of Hilbert Tensor Algebras

The aim of this article is to characterize unitary increment process by a quantum stochastic integral representation on symmetric Fock space. Under certain assumptions we have proved its unitary equivalence to a Hudson-Parthasarathy flow.

Optimal multicommodity flow through the complete graph with random edge capacities

We consider a multicommodity flow problem on a complete graph whose edges have random, independent, and identically distributed capacities. We show that, as the number of nodes tends to infinity, the maximumutility, given by the average of a concave function of each commodity How, has an almost-sure limit. Furthermore, the asymptotically optimal flow uses only direct and two-hop paths, and can be obtained in a distributed manner.

Existence and approximations of solutions to some fractional order functional integral equations

In this paper we shall study a fractional order functional integral equation. In the first part of the paper, we proved the existence and uniqueness of mile and global solutions in a Banach space. In the second part of the paper, we used the analytic semigroups theory oflinear operators and the fixed point method to establish the existence, uniqueness and convergence of approximate solutions of the given problem in a separable Hilbert space. We also proved the existence and convergence of Faedo-Galerkin approximate solution to the given problem. Finally, we give an example.

Random matrices: Universality of ESDs and the circular law

Given an n x n complex matrix A, let mu(A)(x, y) := 1/n vertical bar{1 <= i <= n, Re lambda(i) <= x, Im lambda(i) <= y}vertical bar be the empirical spectral distribution (ESD) of its eigenvalues lambda(i) is an element of C, i = l, ... , n. We consider the limiting distribution (both in probability and in the almost sure convergence sense) of the normalized ESD mu(1/root n An) of a random matrix A(n) = (a(ij))(1 <= i, j <= n), where the random variables a(ij) - E(a(ij)) are i.i.d. copies of a fixed random variable x with unit variance. We prove a universality principle for such ensembles, namely, that the limit distribution in question is independent of the actual choice of x. In particular, in order to compute this distribution, one can assume that x is real or complex Gaussian. As a related result, we show how laws for this ESD follow from laws for the singular value distribution of 1/root n A(n) - zI for complex z. As a corollary, we establish the circular law conjecture (both almost surely and in probability), which asserts that mu(1/root n An) converges to the uniform measure on the unit disc when the a(ij) have zero mean.

Criticality of the exponential rate of decay for the largest nearest-neighbor link in random geometric graphs

Let n points be placed independently in d-dimensional space according to the density f(x) = A(d)e(-lambda parallel to x parallel to alpha), lambda, alpha > 0, x is an element of R-d, d >= 2. Let d(n) be the longest edge length of the nearest-neighbor graph on these points. We show that (lambda(-1) log n)(1-1/alpha) d(n) - b(n) converges weakly to the Gumbel distribution, where b(n) similar to ((d - 1)/lambda alpha) log log n. We also prove the following strong law for the normalized nearest-neighbor distance (d) over tilde (n) = (lambda(-1) log n)(1-1/alpha) d(n)/log log n: (d - 1)/alpha lambda <= lim inf(n ->infinity) (d) over tilde (n) <= lim sup(n ->infinity) (d) over tilde (n) <= d/alpha lambda almost surely. Thus, the exponential rate of decay alpha = 1 is critical, in the sense that, for alpha > 1, d(n) -> 0, whereas, for alpha <= 1, d(n) -> infinity almost surely as n -> infinity.

Characterization of unitary processes with independent and stationary increments

This is a continuation of the earlier work (Publ. Res. Inst. Math. Sci. 45 (2009) 745-785) to characterize unitary stationary independent increment Gaussian processes. The earlier assumption of uniform continuity is replaced by weak continuity and with technical assumptions on the domain of the generator, unitary equivalence of the process to the solution of an appropriate Hudson-Parthasarathy equation is proved.

Supercritical age-dependent branching Markov processes and their scaling limits

This paper studies the long-time behavior of the empirical distribution of age and normalized position of an age-dependent supercritical branching Markov process. The motion of each individual during its life is a random function of its age. It is shown that the empirical distribution of the age and the normalized position of all individuals alive at time t converges as t -> infinity to a deterministic product measure.

T. E. Harris and branching processes

T. E. Harris was a pioneer par excellence in many fields of probability theory. In this paper, we give a brief survey of the many fundamental contributions of Harris to the theory of branching processes, starting with his doctoral work at Princeton in the late forties and culminating in his fundamental book ``The Theory of Branching Processes,'' published in 1963.

Flat connections, geometric invariants and the symplectic nature of the fundamental group of surfaces

In this paper we associate a new geometric invariant to the space of fiat connections on a G (= SU(2))-bundle on a compact Riemann surface M and relate it tcr the symplectic structure on the space Hom(pi(1)(M), G)/G consisting of representations of the fundamental group pi(1)(M) Of M into G module the conjugate action of G on representations.

Percolation and connectivity in AB random geometric graphs

Given two independent Poisson point processes Phi((1)), Phi((2)) in R-d, the AB Poisson Boolean model is the graph with the points of Phi((1)) as vertices and with edges between any pair of points for which the intersection of balls of radius 2r centered at these points contains at least one point of Phi((2)). This is a generalization of the AB percolation model on discrete lattices. We show the existence of percolation for all d >= 2 and derive bounds fora critical intensity. We also provide a characterization for this critical intensity when d = 2. To study the connectivity problem, we consider independent Poisson point processes of intensities n and tau n in the unit cube. The AB random geometric graph is defined as above but with balls of radius r. We derive a weak law result for the largest nearest-neighbor distance and almost-sure asymptotic bounds for the connectivity threshold.