Probability density estimation with tunable kernels using orthogonal forward regression

A generalized or tunable-kernel model is proposed for probability density function estimation based on an orthogonal forward regression procedure. Each stage of the density estimation process determines a tunable kernel, namely, its center vector and diagonal covariance matrix, by minimizing a leave-one-out test criterion. The kernel mixing weights of the constructed sparse density estimate are finally updated using the multiplicative nonnegative quadratic programming algorithm to ensure the nonnegative and unity constraints, and this weight-updating process additionally has the desired ability to further reduce the model size. The proposed tunable-kernel model has advantages, in terms of model generalization capability and model sparsity, over the standard fixed-kernel model that restricts kernel centers to the training data points and employs a single common kernel variance for every kernel. On the other hand, it does not optimize all the model parameters together and thus avoids the problems of high-dimensional ill-conditioned nonlinear optimization associated with the conventional finite mixture model. Several examples are included to demonstrate the ability of the proposed novel tunable-kernel model to effectively construct a very compact density estimate accurately.

Variational approach in weighted Sobolev spaces to scattering by unbounded rough surfaces

We consider the problem of scattering of time harmonic acoustic waves by an unbounded sound soft surface which is assumed to lie within a finite distance of some plane. The paper is concerned with the study of an equivalent variational formulation of this problem set in a scale of weighted Sobolev spaces. We prove well-posedness of this variational formulation in an energy space with weights which extends previous results in the unweighted setting [S. Chandler-Wilde and P. Monk, SIAM J. Math. Anal., 37 (2005), pp. 598–618] to more general inhomogeneous terms in the Helmholtz equation. In particular, in the two-dimensional case, our approach covers the problem of plane wave incidence, whereas in the three-dimensional case, incident spherical and cylindrical waves can be treated. As a further application of our results, we analyze a finite section type approximation, whereby the variational problem posed on an infinite layer is approximated by a variational problem on a bounded region.

A time-domain probe method for three-dimensional rough surface reconstructions

The task of this paper is to develop a Time-Domain Probe Method for the reconstruction of impenetrable scatterers. The basic idea of the method is to use pulses in the time domain and the time-dependent response of the scatterer to reconstruct its location and shape. The method is based on the basic causality principle of timedependent scattering. The method is independent of the boundary condition and is applicable for limited aperture scattering data. In particular, we discuss the reconstruction of the shape of a rough surface in three dimensions from time-domain measurements of the scattered field. In practise, measurement data is collected where the incident field is given by a pulse. We formulate the time-domain fieeld reconstruction problem equivalently via frequency-domain integral equations or via a retarded boundary integral equation based on results of Bamberger, Ha-Duong, Lubich. In contrast to pure frequency domain methods here we use a time-domain characterization of the unknown shape for its reconstruction. Our paper will describe the Time-Domain Probe Method and relate it to previous frequency-domain approaches on sampling and probe methods by Colton, Kirsch, Ikehata, Potthast, Luke, Sylvester et al. The approach significantly extends recent work of Chandler-Wilde and Lines (2005) and Luke and Potthast (2006) on the timedomain point source method. We provide a complete convergence analysis for the method for the rough surface scattering case and provide numerical simulations and examples.

The domain derivative in rough-surface scattering and rigorous estimates for first-order perturbation theory

We investigate Fréchet differentiability of the scattered field with respect to variation in the boundary in the case of time–harmonic acoustic scattering by an unbounded, sound–soft, one–dimensional rough surface. We rigorously prove the differentiability of the scattered field and derive a characterization of the Fréchet derivative as the solution to a Dirichlet boundary value problem. As an application of these results we give rigorous error estimates for first–order perturbation theory, justifying small perturbation methods that have a long history in the engineering literature. As an application of our rigorous estimates we show that a plane acoustic wave incident on a sound–soft rough surface can produce an unbounded scattered field.

On the stability and convergence of the finite section method for integral equation formulations of rough surface scattering

We consider the Dirichlet and Robin boundary value problems for the Helmholtz equation in a non-locally perturbed half-plane, modelling time harmonic acoustic scattering of an incident field by, respectively, sound-soft and impedance infinite rough surfaces.Recently proposed novel boundary integral equation formulations of these problems are discussed. It is usual in practical computations to truncate the infinite rough surface, solving a boundary integral equation on a finite section of the boundary, of length 2A, say. In the case of surfaces of small amplitude and slope we prove the stability and convergence as A→∞ of this approximation procedure. For surfaces of arbitrarily large amplitude and/or surface slope we prove stability and convergence of a modified finite section procedure in which the truncated boundary is ‘flattened’ in finite neighbourhoods of its two endpoints. Copyright © 2001 John Wiley & Sons, Ltd.

A Nyström method for a class of integral equations on the real line with applications to scattering by diffraction gratings and rough surfaces

We propose a Nystr¨om/product integration method for a class of second kind integral equations on the real line which arise in problems of two-dimensional scalar and elastic wave scattering by unbounded surfaces. Stability and convergence of the method is established with convergence rates dependent on the smoothness of components of the kernel. The method is applied to the problem of acoustic scattering by a sound soft one-dimensional surface which is the graph of a function f, and superalgebraic convergence is established in the case when f is infinitely smooth. Numerical results are presented illustrating this behavior for the case when f is periodic (the diffraction grating case). The Nystr¨om method for this problem is stable and convergent uniformly with respect to the period of the grating, in contrast to standard integral equation methods for diffraction gratings which fail at a countable set of grating periods.

On the solvability of second kind integral equations on the real line

This paper considers general second kind integral equations of the form(in operator form φ − kφ = ψ), where the functions k and ψ are assumed known, with ψ ∈ Y, the space of bounded continuous functions on R, and k such that the mapping s → k(s, · ), from R to L1(R), is bounded and continuous. The function φ ∈ Y is the solution to be determined. Conditions on a set W ⊂ BC(R, L1(R)) are obtained such that a generalised Fredholm alternative holds: If W satisfies these conditions and I − k is injective for all k ∈ W then I − k is also surjective for all k ∈ W and, moreover, the inverse operators (I − k) − 1 on Y are uniformly bounded for k ∈ W. The approximation of the kernel in the integral equation by a sequence (kn) converging in a weak sense to k is also considered and results on stability and convergence are obtained. These general theorems are used to establish results for two special classes of kernels: k(s, t) = κ(s − t)z(t) and k(s, t) = κ(s − t)λ(s − t, t), where κ ∈ L1(R), z ∈ L∞(R), and λ ∈ BC((R\{0}) × R). Kernels of both classes arise in problems of time harmonic wave scattering by unbounded surfaces. The general integral equation results are here applied to prove the existence of a solution for a boundary integral equation formulation of scattering by an infinite rough surface and to consider the stability and convergence of approximation of the rough surface problem by a sequence of diffraction grating problems of increasingly large period.

Scattering by infinite one-dimensional rough surfaces

We consider the Dirichlet boundary-value problem for the Helmholtz equation in a non-locally perturbed half-plane. This problem models time-harmonic electromagnetic scattering by a one-dimensional, infinite, rough, perfectly conducting surface; the same problem arises in acoustic scattering by a sound-soft surface. ChandlerWilde & Zhang have suggested a radiation condition for this problem, a generalization of the Rayleigh expansion condition for diffraction gratings, and uniqueness of solution has been established. Recently, an integral equation formulation of the problem has also been proposed and, in the special case when the whole boundary is both Lyapunov and a small perturbation of a flat boundary, the unique solvability of this integral equation has been shown by Chandler-Wilde & Ross by operator perturbation arguments. In this paper we study the general case, with no limit on surface amplitudes or slopes, and show that the same integral equation has exactly one solution in the space of bounded and continuous functions for all wavenumbers. As an important corollary we prove that, for a variety of incident fields including the incident plane wave, the Dirichlet boundary-value problem for the scattered field has a unique solution.

Scattering of electromagnetic waves by rough interfaces and inhomogeneous layers

We consider a two-dimensional problem of scattering of a time-harmonic electromagnetic plane wave by an infinite inhomogeneous conducting or dielectric layer at the interface between semi-infinite homogeneous dielectric half-spaces. The magnetic permeability is assumed to be a fixed positive constant. The material properties of the media are characterized completely by an index of refraction, which is a bounded measurable function in the layer and takes positive constant values above and below the layer, corresponding to the homogeneous dielectric media. In this paper, we examine only the transverse magnetic (TM) polarization case. A radiation condition appropriate for scattering by infinite rough surfaces is introduced, a generalization of the Rayleigh expansion condition for diffraction gratings. With the help of the radiation condition the problem is reformulated as an equivalent mixed system of boundary and domain integral equations, consisting of second-kind integral equations over the layer and interfaces within the layer. Assumptions on the variation of the index of refraction in the layer are then imposed which prove to be sufficient, together with the radiation condition, to prove uniqueness of solution and nonexistence of guided wave modes. Recent, general results on the solvability of systems of second kind integral equations on unbounded domains establish existence of solution and continuous dependence in a weighted norm of the solution on the given data. The results obtained apply to the case of scattering by a rough interface between two dielectric media and to many other practical configurations.

A uniqueness result for scattering by infinite rough surfaces

Consider the Dirichlet boundary value problem for the Helmholtz equation in a non-locally perturbed half-plane with an unbounded, piecewise Lyapunov boundary. This problem models time-harmonic electromagnetic scattering in transverse magnetic polarization by one-dimensional rough, perfectly conducting surfaces. A radiation condition is introduced for the problem, which is a generalization of the usual one used in the study of diffraction by gratings when the solution is quasi-periodic, and allows a variety of incident fields including an incident plane wave to be included in the results obtained. We show in this paper that the boundary value problem for the scattered field has at most one solution. For the case when the whole boundary is Lyapunov and is a small perturbation of a flat boundary we also prove existence of solution and show a limiting absorption principle.

Scattering by rough surfaces: the Dirichlet problem for the Helmholtz equation in a non-locally perturbed half-plane

We consider the Dirichlet boundary value problem for the Helmholtz equation in a non-locally perturbed half-plane, this problem arising in electromagnetic scattering by one-dimensional rough, perfectly conducting surfaces. We propose a new boundary integral equation formulation for this problem, utilizing the Green's function for an impedance half-plane in place of the standard fundamental solution. We show, at least for surfaces not differing too much from the flat boundary, that the integral equation is uniquely solvable in the space of bounded and continuous functions, and hence that, for a variety of incident fields including an incident plane wave, the boundary value problem for the scattered field has a unique solution satisfying the limiting absorption principle. Finally, a result of continuous dependence of the solution on the boundary shape is obtained.

Noisy Monte Carlo: convergence of Markov chains with approximate transition kernels

Monte Carlo algorithms often aim to draw from a distribution π by simulating a Markov chain with transition kernel P such that π is invariant under P. However, there are many situations for which it is impractical or impossible to draw from the transition kernel P. For instance, this is the case with massive datasets, where is it prohibitively expensive to calculate the likelihood and is also the case for intractable likelihood models arising from, for example, Gibbs random fields, such as those found in spatial statistics and network analysis. A natural approach in these cases is to replace P by an approximation Pˆ. Using theory from the stability of Markov chains we explore a variety of situations where it is possible to quantify how ’close’ the chain given by the transition kernel Pˆ is to the chain given by P . We apply these results to several examples from spatial statistics and network analysis.

The rough guide to the Moon and Mars

Space is a dangerous place for humans, once we step beyond the rotection of Earth’s atmosphere and magnetic field. Galactic cosmic rays and bursts of charged particles from the Sun damaging to health happen with alarming frequency – the Apollo astronauts were very lucky. Understanding the physics of radiation from distinct sources in space will be useful to help future space voyagers plan journeys in greater safety, and produce effective shields for these unavoidable events on journeys to Mars or beyond.

Uniform factorial decay estimate for the remainder of rough Taylor expansion

We establish an uniform factorial decay estimate for the Taylor approximation of solutions to controlled differential equations. Its proof requires a factorial decay estimate for controlled paths which is interesting in its own right.