New directions in sparse sampling and estimation for underdetermined systems

A central objective in signal processing is to infer meaningful information from a set of measurements or data. While most signal models have an overdetermined structure (the number of unknowns less than the number of equations), traditionally very few statistical estimation problems have considered a data model which is underdetermined (number of unknowns more than the number of equations). However, in recent times, an explosion of theoretical and computational methods have been developed primarily to study underdetermined systems by imposing sparsity on the unknown variables. This is motivated by the observation that inspite of the huge volume of data that arises in sensor networks, genomics, imaging, particle physics, web search etc., their information content is often much smaller compared to the number of raw measurements. This has given rise to the possibility of reducing the number of measurements by down sampling the data, which automatically gives rise to underdetermined systems.

In this thesis, we provide new directions for estimation in an underdetermined system, both for a class of parameter estimation problems and also for the problem of sparse recovery in compressive sensing. There are two main contributions of the thesis: design of new sampling and statistical estimation algorithms for array processing, and development of improved guarantees for sparse reconstruction by introducing a statistical framework to the recovery problem.

We consider underdetermined observation models in array processing where the number of unknown sources simultaneously received by the array can be considerably larger than the number of physical sensors. We study new sparse spatial sampling schemes (array geometries) as well as propose new recovery algorithms that can exploit priors on the unknown signals and unambiguously identify all the sources. The proposed sampling structure is generic enough to be extended to multiple dimensions as well as to exploit different kinds of priors in the model such as correlation, higher order moments, etc.

Recognizing the role of correlation priors and suitable sampling schemes for underdetermined estimation in array processing, we introduce a correlation aware framework for recovering sparse support in compressive sensing. We show that it is possible to strictly increase the size of the recoverable sparse support using this framework provided the measurement matrix is suitably designed. The proposed nested and coprime arrays are shown to be appropriate candidates in this regard. We also provide new guarantees for convex and greedy formulations of the support recovery problem and demonstrate that it is possible to strictly improve upon existing guarantees.

This new paradigm of underdetermined estimation that explicitly establishes the fundamental interplay between sampling, statistical priors and the underlying sparsity, leads to exciting future research directions in a variety of application areas, and also gives rise to new questions that can lead to stand-alone theoretical results in their own right.

Flexible microimplants for in vivo sensing

The work in this thesis develops two types of microimplants for the application of cardiovascular in vivo biomedical sensing, one for short-term diagnosis and the other for long-term monitoring.

Despite advances in diagnosis and therapy, atherosclerotic cardiovascular disease remains the leading cause of morbidity and mortality in the Western world. Predicting metabolically active atherosclerotic plaques has remained an unmet clinical need. A stretchable impedance sensor manifested as a pair of quasi-concentric microelectrodes was developed to detect unstable intravascular. By integrating the impedance sensor with a cardiac catheter, high-resolution Electrochemical Impedance Spectroscopy (EIS) measurements can be conducted during cardiac catheterization. An inflatable silicone balloon is added to the sensor to secure a well-controlled contact with the plaque under test in vivo. By deploying the device to the explants of NZW rabbit aorta and live animals, distinct EIS measurements were observed for unstable atherosclerotic plaques that harbored active lipids and inflammatory cells.

On the other hand, zebrafish (Danio rerio) is an emerging genetic model for heart regenerative medicine. In humans, myocardial infarction results in the irreversible loss of cardiomyocytes. Zebrafish hearts can fully regenerate after two months with 20% ventricular resection. Long-term electrocardiogram (ECG) recording can characterize the heart regeneration in a functional dimension. A flexible microelectrode membrane was developed to be percutaneously implanted onto a zebrafish heart and record epicardial ECG signals from specific regions on it. Region-specific aberrant cardiac signals were obtained from injured and regenerated hearts. Following that, in order to achieve continuous and wireless recording from non-sedated and non-restricted small animal models, a wireless ECG recording system was designed for the microelectrode membrane, prototyped on a printed circuit board and demonstrated on a one-day-old neonatal mouse. Furthermore, a flexible and compact parylene C printed circuit membrane was used as the integration platform for the wireless ECG recording electronics. A substantially miniature wireless ECG recording system was achieved.

Geometric integration applied to moving mesh methods and degenerate Lagrangians

Moving mesh methods (also called r-adaptive methods) are space-adaptive strategies used for the numerical simulation of time-dependent partial differential equations. These methods keep the total number of mesh points fixed during the simulation, but redistribute them over time to follow the areas where a higher mesh point density is required. There are a very limited number of moving mesh methods designed for solving field-theoretic partial differential equations, and the numerical analysis of the resulting schemes is challenging. In this thesis we present two ways to construct r-adaptive variational and multisymplectic integrators for (1+1)-dimensional Lagrangian field theories. The first method uses a variational discretization of the physical equations and the mesh equations are then coupled in a way typical of the existing r-adaptive schemes. The second method treats the mesh points as pseudo-particles and incorporates their dynamics directly into the variational principle. A user-specified adaptation strategy is then enforced through Lagrange multipliers as a constraint on the dynamics of both the physical field and the mesh points. We discuss the advantages and limitations of our methods. The proposed methods are readily applicable to (weakly) non-degenerate field theories---numerical results for the Sine-Gordon equation are presented.

In an attempt to extend our approach to degenerate field theories, in the last part of this thesis we construct higher-order variational integrators for a class of degenerate systems described by Lagrangians that are linear in velocities. We analyze the geometry underlying such systems and develop the appropriate theory for variational integration. Our main observation is that the evolution takes place on the primary constraint and the 'Hamiltonian' equations of motion can be formulated as an index 1 differential-algebraic system. We then proceed to construct variational Runge-Kutta methods and analyze their properties. The general properties of Runge-Kutta methods depend on the 'velocity' part of the Lagrangian. If the 'velocity' part is also linear in the position coordinate, then we show that non-partitioned variational Runge-Kutta methods are equivalent to integration of the corresponding first-order Euler-Lagrange equations, which have the form of a Poisson system with a constant structure matrix, and the classical properties of the Runge-Kutta method are retained. If the 'velocity' part is nonlinear in the position coordinate, we observe a reduction of the order of convergence, which is typical of numerical integration of DAEs. We also apply our methods to several models and present the results of our numerical experiments.

Extraction of CP Properties of the H(125) Boson Discovered in Proton-Proton Collisions at sqrt(s) = 7 and 8 TeV with the CMS Detector at the LHC

In this thesis we build a novel analysis framework to perform the direct extraction of all possible effective Higgs boson couplings to the neutral electroweak gauge bosons in the H → ZZ^(*) → 4l channel also referred to as the golden channel. We use analytic expressions of the full decay differential cross sections for the H → VV' → 4l process, and the dominant irreducible standard model qq ̄ → 4l background where 4l = 2e2μ,4e,4μ. Detector effects are included through an explicit convolution of these analytic expressions with transfer functions that model the detector responses as well as acceptance and efficiency effects. Using the full set of decay observables, we construct an unbinned 8-dimensional detector level likelihood function which is con- tinuous in the effective couplings, and includes systematics. All potential anomalous couplings of HVV' where V = Z,γ are considered, allowing for general CP even/odd admixtures and any possible phases. We measure the CP-odd mixing between the tree-level HZZ coupling and higher order CP-odd couplings to be compatible with zero, and in the range [−0.40, 0.43], and the mixing between HZZ tree-level coupling and higher order CP -even coupling to be in the ranges [−0.66, −0.57] ∪ [−0.15, 1.00]; namely compatible with a standard model Higgs. We discuss the expected precision in determining the various HVV' couplings in future LHC runs. A powerful and at first glance surprising prediction of the analysis is that with 100-400 fb^-1, the golden channel will be able to start probing the couplings of the Higgs boson to diphotons in the 4l channel. We discuss the implications and further optimization of the methods for the next LHC runs.

Reconstructing Past Depositional and Diagenetic Processes through Quantitative Stratigraphic Analysis of the Martian Sedimentary Rock Record

High-resolution orbital and in situ observations acquired of the Martian surface during the past two decades provide the opportunity to study the rock record of Mars at an unprecedented level of detail. This dissertation consists of four studies whose common goal is to establish new standards for the quantitative analysis of visible and near-infrared data from the surface of Mars. Through the compilation of global image inventories, application of stratigraphic and sedimentologic statistical methods, and use of laboratory analogs, this dissertation provides insight into the history of past depositional and diagenetic processes on Mars. The first study presents a global inventory of stratified deposits observed in images from the High Resolution Image Science Experiment (HiRISE) camera on-board the Mars Reconnaissance Orbiter. This work uses the widespread coverage of high-resolution orbital images to make global-scale observations about the processes controlling sediment transport and deposition on Mars. The next chapter presents a study of bed thickness distributions in Martian sedimentary deposits, showing how statistical methods can be used to establish quantitative criteria for evaluating the depositional history of stratified deposits observed in orbital images. The third study tests the ability of spectral mixing models to obtain quantitative mineral abundances from near-infrared reflectance spectra of clay and sulfate mixtures in the laboratory for application to the analysis of orbital spectra of sedimentary deposits on Mars. The final study employs a statistical analysis of the size, shape, and distribution of nodules observed by the Mars Science Laboratory Curiosity rover team in the Sheepbed mudstone at Yellowknife Bay in Gale crater. This analysis is used to evaluate hypotheses for nodule formation and to gain insight into the diagenetic history of an ancient habitable environment on Mars.

General-domain compressible Navier-Stokes solvers exhibiting quasi-unconditional stability and high-order accuracy in space and time

This thesis presents a new class of solvers for the subsonic compressible Navier-Stokes equations in general two- and three-dimensional spatial domains. The proposed methodology incorporates: 1) A novel linear-cost implicit solver based on use of higher-order backward differentiation formulae (BDF) and the alternating direction implicit approach (ADI); 2) A fast explicit solver; 3) Dispersionless spectral spatial discretizations; and 4) A domain decomposition strategy that negotiates the interactions between the implicit and explicit domains. In particular, the implicit methodology is quasi-unconditionally stable (it does not suffer from CFL constraints for adequately resolved flows), and it can deliver orders of time accuracy between two and six in the presence of general boundary conditions. In fact this thesis presents, for the first time in the literature, high-order time-convergence curves for Navier-Stokes solvers based on the ADI strategy---previous ADI solvers for the Navier-Stokes equations have not demonstrated orders of temporal accuracy higher than one. An extended discussion is presented in this thesis which places on a solid theoretical basis the observed quasi-unconditional stability of the methods of orders two through six. The performance of the proposed solvers is favorable. For example, a two-dimensional rough-surface configuration including boundary layer effects at Reynolds number equal to one million and Mach number 0.85 (with a well-resolved boundary layer, run up to a sufficiently long time that single vortices travel the entire spatial extent of the domain, and with spatial mesh sizes near the wall of the order of one hundred-thousandth the length of the domain) was successfully tackled in a relatively short (approximately thirty-hour) single-core run; for such discretizations an explicit solver would require truly prohibitive computing times. As demonstrated via a variety of numerical experiments in two- and three-dimensions, further, the proposed multi-domain parallel implicit-explicit implementations exhibit high-order convergence in space and time, useful stability properties, limited dispersion, and high parallel efficiency.

Spin wave resonance in ferromagnetic films

The objective of this investigation has been a theoretical and experimental understanding of ferromagnetic resonance phenomena in ferromagnetic thin films, and a consequent understanding of several important physical properties of these films. Significant results have been obtained by ferromagnetic resonance, hysteresis, torque magnetometer, He ion backscattering, and X-ray fluorescence measurements for nickel-iron alloy films.

Taking into account all relevant magnetic fields, including the applied, demagnetizing, effective anisotropy and exchange fields, the spin wave resonance condition applicable to the thin film geometry is presented. On the basis of the simple exchange interaction model it is concluded that the normal resonance modes of an ideal film are expected to be unpinned. The possibility of nonideality near the surface of a real film was considered by means of surface anisotropy field, inhomogeneity in demagnetizing field and inhomogeneity of magnetization models. Numerical results obtained for reasonable parameters in all cases show that they negligibly perturb the resonance fields and the higher order mode shapes from those of the unpinned modes of ideal films for thicknesses greater than 1000 Å. On the other hand for films thinner than 1000 Å the resonance field deviations can be significant even though the modes are very nearly unpinned. A previously unnoticed but important feature of all three models is that the interpretation of the first resonance mode as the uniform mode of an ideal film allows an accurate measurement of the average effective demagnetizing field over the film volume. Furthermore, it is demonstrated that it is possible to choose parameters which give indistinguishable predictions for all three models, making it difficult to uniquely ascertain the source of spin pinning in real films from resonance measurements alone.

Spin wave resonance measurements of 81% Ni-19% Fe coevaporated films 30 to 9000 Å thick, at frequencies from 1 to 8 GHz, at room temperature, and with the static magnetic field parallel and perpendicular to the film plane have been performed. A self-consistent analysis of the results for films thicker than 1000 Å, in which multiple excitations can be observed, shows for the first time that a unique value of exchange constant A can only be obtained by the use of unpinned mode assignments. This evidence and the resonance behavior of films thinner than 1000 Å strongly imply that the magnetization at the surfaces of permalloy films is very weakly pinned. However, resonance measurements alone cannot determine whether this pinning is due to a surface anisotropy, an inhomogeneous demagnetizing field or an inhomogeneous magnetization. The above analysis yields a value of 4πM=10,100 Oe and A = (1.03 ± .05) x 10^-6 erg/cm for this alloy. The ability to obtain a unique value of A suggests that spin wave resonance can be used to accurately characterize the exchange interaction in a ferromagnet.

In an effort to resolve the ambiguity of the source of pinning of the magnetization, a correlation of the ratio of magnetic moment and X-ray film thickness with the value of effective demagnetizing field 4πNM as determined from resonance, for films 45 to 300 Å has been performed. The remarkable agreement of both quantities and a comparison with the predictions of five distinct models, strongly imply that the thickness dependence of both quantities is related to a thickness dependent average saturation magnetization, which is far below 10,100 Oe for very thin films. However, a series of complementary experiments shows that this large decrease of average saturation magnetization cannot be simply explained by either oxidation or interdiffusion processes. It can only be satisfactorily explained by an intrinsic decrease of the average saturation magnetization for very thin films, an effect which cannot be justified by any simple physical considerations.

Recognizing that this decrease of average saturation magnetization could be due to an oxidation process, a correlation of resonance measurements, He ion backscattering, X-ray fluorescence and torque magnetometer measurements, for films 40 to 3500 Å thick has been performed. On basis of these measurements it is unambiguously established that the oxide layer on the surface of purposefully oxidized 81% Ni-19% Fe evaporated films is predominantly Fe-oxide, and that in the oxidation process Fe atoms are removed from the bulk of the film to depths of thousands of angstroms. Extrapolation of results for pure Fe films indicates that the oxide is most likely α-Fe₂O₃. These conclusions are in agreement with results from old metallurgical studies of high temperature oxidation of bulk Fe and Ni-Fe alloys. However, X-ray fluorescence results for films oxidized at room temperature, show that although the preferential oxidation of Fe also takes place in these films, the extent of this process is by far too small to explain the large variation of their average saturation magnetization with film thickness.