Simultaneous Learning of Nonlinear Manifold and Dynamical Models for High-dimensional Time Series

The goal of this work is to learn a parsimonious and informative representation for high-dimensional time series. Conceptually, this comprises two distinct yet tightly coupled tasks: learning a low-dimensional manifold and modeling the dynamical process. These two tasks have a complementary relationship as the temporal constraints provide valuable neighborhood information for dimensionality reduction and conversely, the low-dimensional space allows dynamics to be learnt efficiently. Solving these two tasks simultaneously allows important information to be exchanged mutually. If nonlinear models are required to capture the rich complexity of time series, then the learning problem becomes harder as the nonlinearities in both tasks are coupled. The proposed solution approximates the nonlinear manifold and dynamics using piecewise linear models. The interactions among the linear models are captured in a graphical model. By exploiting the model structure, efficient inference and learning algorithms are obtained without oversimplifying the model of the underlying dynamical process. Evaluation of the proposed framework with competing approaches is conducted in three sets of experiments: dimensionality reduction and reconstruction using synthetic time series, video synthesis using a dynamic texture database, and human motion synthesis, classification and tracking on a benchmark data set. In all experiments, the proposed approach provides superior performance.

Simultaneous Learning of Non-Linear Manifold and Dynamical Models for High-Dimensional Time Series

The goal of this work is to learn a parsimonious and informative representation for high-dimensional time series. Conceptually, this comprises two distinct yet tightly coupled tasks: learning a low-dimensional manifold and modeling the dynamical process. These two tasks have a complementary relationship as the temporal constraints provide valuable neighborhood information for dimensionality reduction and conversely, the low-dimensional space allows dynamics to be learnt efficiently. Solving these two tasks simultaneously allows important information to be exchanged mutually. If nonlinear models are required to capture the rich complexity of time series, then the learning problem becomes harder as the nonlinearities in both tasks are coupled. The proposed solution approximates the nonlinear manifold and dynamics using piecewise linear models. The interactions among the linear models are captured in a graphical model. The model structure setup and parameter learning are done using a variational Bayesian approach, which enables automatic Bayesian model structure selection, hence solving the problem of over-fitting. By exploiting the model structure, efficient inference and learning algorithms are obtained without oversimplifying the model of the underlying dynamical process. Evaluation of the proposed framework with competing approaches is conducted in three sets of experiments: dimensionality reduction and reconstruction using synthetic time series, video synthesis using a dynamic texture database, and human motion synthesis, classification and tracking on a benchmark data set. In all experiments, the proposed approach provides superior performance.

Chondrogenesis and mineralization during in vitro culture of human mesenchymal stem cells on three-dimensional woven scaffolds.

Human mesenchymal stem cells (hMSCs) and three-dimensional (3D) woven poly(ɛ-caprolactone) (PCL) scaffolds are promising tools for skeletal tissue engineering. We hypothesized that in vitro culture duration and medium additives can individually and interactively influence the structure, composition, mechanical, and molecular properties of engineered tissues based on hMSCs and 3D poly(ɛ-caprolactone). Bone marrow hMSCs were suspended in collagen gel, seeded on scaffolds, and cultured for 1, 21, or 45 days under chondrogenic and/or osteogenic conditions. Structure, composition, biomechanics, and gene expression were analyzed. In chondrogenic medium, cartilaginous tissue formed by day 21, and hypertrophic mineralization was observed in the newly formed extracellular matrix at the interface with underlying scaffold by day 45. Glycosaminoglycan, hydroxyproline, and calcium contents, and alkaline phosphatase activity depended on culture duration and medium additives, with significant interactive effects (all p < 0.0001). The 45-day constructs exhibited mechanical properties on the order of magnitude of native articular cartilage (aggregate, Young's, and shear moduli of 0.15, 0.12, and 0.033 MPa, respectively). Gene expression was characteristic of chondrogenesis and endochondral bone formation, with sequential regulation of Sox-9, collagen type II, aggrecan, core binding factor alpha 1 (Cbfα1)/Runx2, bone sialoprotein, bone morphogenetic protein-2, and osteocalcin. In contrast, osteogenic medium produced limited osteogenesis. Long-term culture of hMSC on 3D scaffolds resulted in chondrogenesis and regional mineralization at the interface between soft, newly formed engineered cartilage, and stiffer underlying scaffold. These findings merit consideration when developing grafts for osteochondral defect repair.

Fiber-optic interferometric two-dimensional scattering-measurement system.

We present a fiber-optic interferometric system for measuring depth-resolved scattering in two angular dimensions using Fourier-domain low-coherence interferometry. The system is a unique hybrid of the Michelson and Sagnac interferometer topologies. The collection arm of the interferometer is scanned in two dimensions to detect angular scattering from the sample, which can then be analyzed to determine the structure of the scatterers. A key feature of the system is the full control of polarization of both the illumination and the collection fields, allowing for polarization-sensitive detection, which is essential for two-dimensional angular measurements. System performance is demonstrated using a double-layer microsphere phantom. Experimental data from samples with different sizes and acquired with different polarizations show excellent agreement with Mie theory, producing structural measurements with subwavelength accuracy.

Three-dimensional dispersive metallic photonic crystals with a bandgap and a high cutoff frequency.

The goal of this work is to analyze three-dimensional dispersive metallic photonic crystals (PCs) and to find a structure that can provide a bandgap and a high cutoff frequency. The determination of the band structure of a PC with dispersive materials is an expensive nonlinear eigenvalue problem; in this work we propose a rational-polynomial method to convert such a nonlinear eigenvalue problem into a linear eigenvalue problem. The spectral element method is extended to rapidly calculate the band structure of three-dimensional PCs consisting of realistic dispersive materials modeled by Drude and Drude-Lorentz models. Exponential convergence is observed in the numerical experiments. Numerical results show that, at the low frequency limit, metallic materials are similar to a perfect electric conductor, where the simulation results tend to be the same as perfect electric conductor PCs. Band structures of the scaffold structure and semi-woodpile structure metallic PCs are investigated. It is found that band structures of semi-woodpile PCs have a very high cutoff frequency as well as a bandgap between the lowest two bands and the higher bands.

Bayesian variable selection in structured high-dimensional covariate spaces with applications in genomics

We consider the problem of variable selection in regression modeling in high-dimensional spaces where there is known structure among the covariates. This is an unconventional variable selection problem for two reasons: (1) The dimension of the covariate space is comparable, and often much larger, than the number of subjects in the study, and (2) the covariate space is highly structured, and in some cases it is desirable to incorporate this structural information in to the model building process. We approach this problem through the Bayesian variable selection framework, where we assume that the covariates lie on an undirected graph and formulate an Ising prior on the model space for incorporating structural information. Certain computational and statistical problems arise that are unique to such high-dimensional, structured settings, the most interesting being the phenomenon of phase transitions. We propose theoretical and computational schemes to mitigate these problems. We illustrate our methods on two different graph structures: the linear chain and the regular graph of degree k. Finally, we use our methods to study a specific application in genomics: the modeling of transcription factor binding sites in DNA sequences. © 2010 American Statistical Association.

Computational Methods for RNA Structure Validation and Improvement.

With increasing recognition of the roles RNA molecules and RNA/protein complexes play in an unexpected variety of biological processes, understanding of RNA structure-function relationships is of high current importance. To make clean biological interpretations from three-dimensional structures, it is imperative to have high-quality, accurate RNA crystal structures available, and the community has thoroughly embraced that goal. However, due to the many degrees of freedom inherent in RNA structure (especially for the backbone), it is a significant challenge to succeed in building accurate experimental models for RNA structures. This chapter describes the tools and techniques our research group and our collaborators have developed over the years to help RNA structural biologists both evaluate and achieve better accuracy. Expert analysis of large, high-resolution, quality-conscious RNA datasets provides the fundamental information that enables automated methods for robust and efficient error diagnosis in validating RNA structures at all resolutions. The even more crucial goal of correcting the diagnosed outliers has steadily developed toward highly effective, computationally based techniques. Automation enables solving complex issues in large RNA structures, but cannot circumvent the need for thoughtful examination of local details, and so we also provide some guidance for interpreting and acting on the results of current structure validation for RNA.

The second round of Critical Assessment of Automated Structure Determination of Proteins by NMR: CASD-NMR-2013

The second round of the community-wide initiative Critical Assessment of automated Structure Determination of Proteins by NMR (CASD-NMR-2013) comprised ten blind target datasets, consisting of unprocessed spectral data, assigned chemical shift lists and unassigned NOESY peak and RDC lists, that were made available in both curated (i.e. manually refined) or un-curated (i.e. automatically generated) form. Ten structure calculation programs, using fully automated protocols only, generated a total of 164 three-dimensional structures (entries) for the ten targets, sometimes using both curated and un-curated lists to generate multiple entries for a single target. The accuracy of the entries could be established by comparing them to the corresponding manually solved structure of each target, which was not available at the time the data were provided. Across the entire data set, 71 % of all entries submitted achieved an accuracy relative to the reference NMR structure better than 1.5 Å. Methods based on NOESY peak lists achieved even better results with up to 100 % of the entries within the 1.5 Å threshold for some programs. However, some methods did not converge for some targets using un-curated NOESY peak lists. Over 90 % of the entries achieved an accuracy better than the more relaxed threshold of 2.5 Å that was used in the previous CASD-NMR-2010 round. Comparisons between entries generated with un-curated versus curated peaks show only marginal improvements for the latter in those cases where both calculations converged.

Species diversity structure analysis at two sites in the tropical rain forest of Sumatra

Data from a hilly forest study site at Batang Ule, Sumatra, are organized into 30 100-m × 10-m subplots lying perpendicular to the line of maximal topographic gradient, from the valley to the plateau/ridge. The following methodological question is addressed: what species diversity measures are best used in order to reveal the ecologically distinct regions in the site. The main tool used to answer this question is the α-diversity curve (Hα). Graphical examination of tree and species densities, and α-diversity curves identifies an anomalous species diversity behaviour of the ‘ridge above the slope’ subplots which may have implications on land-facet class definitions. Factor analysis of the α-diversity curves indicates that the diversity space is two-dimensional: i.e. two diversity measures are sufficient to characterize the site; the species density (H0), and the Berger-Parker index (H[infty infinity]). In the two-dimensional diversity-space three distinct species diversity groups are found which relate to the topographic gradient at the Batang Ule site. The results are compared with those for a flat homogeneous site at Pasirmayang, Sumatra. The implications of the results on land-classifications in species-diversity mapping and conservation strategy are discussed.

Dynamic fluid-structure interactions using finite volume unstructured mesh procedures

A three-dimensional finite volume, unstructured mesh (FV-UM) method for dynamic fluid–structure interaction (DFSI) is described. Fluid structure interaction, as applied to flexible structures, has wide application in diverse areas such as flutter in aircraft, wind response of buildings, flows in elastic pipes and blood vessels. It involves the coupling of fluid flow and structural mechanics, two fields that are conventionally modelled using two dissimilar methods, thus a single comprehensive computational model of both phenomena is a considerable challenge. Until recently work in this area focused on one phenomenon and represented the behaviour of the other more simply. More recently, strategies for solving the full coupling between the fluid and solid mechanics behaviour have been developed. A key contribution has been made by Farhat et al. [Int. J. Numer. Meth. Fluids 21 (1995) 807] employing FV-UM methods for solving the Euler flow equations and a conventional finite element method for the elastic solid mechanics and the spring based mesh procedure of Batina [AIAA paper 0115, 1989] for mesh movement. In this paper, we describe an approach which broadly exploits the three field strategy described by Farhat for fluid flow, structural dynamics and mesh movement but, in the context of DFSI, contains a number of novel features: a single mesh covering the entire domain, a Navier–Stokes flow, a single FV-UM discretisation approach for both the flow and solid mechanics procedures, an implicit predictor–corrector version of the Newmark algorithm, a single code embedding the whole strategy.

Dynamic fluid-structure interaction using finite volume unstructured mesh procedures

A three dimensional finite volume, unstructured mesh method for dynamic fluid-structure interation is described. The broad approach is conventional in that the fluid and structure are solved sequentially. The pressure and viscous stresses from the flow algorithm provide load conditions for the solid algorithm, whilst at the fluid structure interface the deformed structure provides boundary condition from the structure to the fluid. The structure algorithm also provides the necessary mesh adaptation for the flow field, the effect of which is accounted for in the flow algorithm. The procedures described in this work have several novel features, namely: * a single mesh covering the entire domain. * a Navier Stokes flow. * a single FV-UM discretisation approach for both the flow and solid mechanics procedures. * an implicit predictor-corrector version of the Newmark algorithm. * a single code embedding the whole strategy. The procedure is illustrated for a three dimensional loaded cantilever in fluid flow.

A generic time and space accurate numerical approach to closely coupled fluid-structure interaction problems

Fluid structure interaction, as applied to flexible structures, has wide application in diverse areas such as flutter in aircraft, flow in elastic pipes and blood vessels and extrusion of metals through dies. However a comprehensive computational model of these multi-physics phenomena is a considerable challenge. Until recently work in this area focused on one phenomenon and represented the behaviour of the other more simply even to the extent in metal forming, for example, that the deformation of the die is totally ignored. More recently, strategies for solving the full coupling between the fluid and soild mechanics behaviour have developed. Conventionally, the computational modelling of fluid structure interaction is problematical since computational fluid dynamics (CFD) is solved using finite volume (FV) methods and computational structural mechanics (CSM) is based entirely on finite element (FE) methods. In the past the concurrent, but rather disparate, development paths for the finite element and finite volume methods have resulted in numerical software tools for CFD and CSM that are different in almost every respect. Hence, progress is frustrated in modelling the emerging multi-physics problem of fluid structure interaction in a consistent manner. Unless the fluid-structure coupling is either one way, very weak or both, transferring and filtering data from one mesh and solution procedure to another may lead to significant problems in computational convergence. Using a novel three phase technique the full interaction between the fluid and the dynamic structural response are represented. The procedure is demonstrated on some challenging applications in complex three dimensional geometries involving aircraft flutter, metal forming and blood flow in arteries.

The extreme-ultraviolet structure and properties of a newly emerged active region

The structure and properties of a newly emerged solar active region (NOAA Active Region 7985) are discussed using the Coronal Diagnostic Spectrometer (CDS) and the Extreme- Ultraviolet Imaging Telescope (EIT) on board the Solar and Heliospheric Observatory. CDS obtained high-resolution EUV spectra in the 308-381 Angstrom and 513-633 Angstrom wavelength ranges, while EIT recorded full-disk EUV images in the He II (304 Angstrom), Fe IX/X (171 Angstrom), Fe xii (195 Angstrom), and Fe XV (284 Angstrom) bandpasses. Electron density measurements from Si rx, Si X, Fe xii, Fe XIII, and Fe xiv line ratios indicate that the region consists of a central high- density core with peak densities of the order of 1.2 x 10(10) cm(-3), which decrease monotonically to similar to5.0 X 10(8) cm(-3) at the active region boundary. The derived electron densities also vary systematically with temperature. Electron pressures as a function of both active region position and temperature were estimated using the derived electron densities and ion formation temperatures, and the constant pressure assumption was found to be an unrealistic simplification. Indeed, the active region is found to have a high-pressure core (1.3 x 10(16) cm(-3) K) that falls to 6.0 x 10(14) cm(-3) K just outside the region. CDS line ratios from different ionization stages of iron, specifically Fe xvi (335.4 Angstrom) and Fe xiv (334.4 Angstrom), were used to diagnose plasma temperatures within the active region. Using this method, peak temperatures of 2.1 x 10(6) K were identified. This is in good agreement with electron temperatures derived using EIT filter ratios and the two-temperature model of Zhang et al. The high- temperature emission is confined to the active region core, while emission from cooler (1-1.6) x 10(6) K lines originates in a system of loops visible in EIT 171 and 195 X images. Finally, the three-dimensional geometry of the active region is investigated using potential field extrapolations from a Kitt Peak magnetogram. The combination of EUV and magnetic field extrapolations extends the "core-halo" picture of active region structure to one in which the core is composed of a number of compact coronal loops that confine the hot, dense, high- pressure core plasma while the halo emission emerges from a system of cooler and more extended loops.

Path-integral study of a two-dimensional Lennard-Jones glass

The glass transition in a quantum Lennard-Jones mixture is investigated by constant-volume path-integral simulations. Particles are assumed to be distinguishable, and the strength of quantum effects is varied by changing h from zero (the classical case) to one (corresponding to a highly quantum-mechanical regime). Quantum delocalization and zero point energy drastically reduce the sensitivity of structural and thermodynamic properties to the glass transition. Nevertheless, the glass transition temperature T-g can be determined by analyzing the phase space mobility of path-integral centroids. At constant volume, the T-g of the simulated model increases monotonically with increasing h. Low temperature tunneling centers are identified, and the quantum versus thermal character of each center is analyzed. The relation between these centers and soft quasilocalized harmonic vibrations is investigated. Periodic minimizations of the potential energy with respect to the positions of the particles are performed to determine the inherent structure of classical and quantum glassy samples. The geometries corresponding to these energy minima are found to be qualitatively similar in all cases. Systematic comparisons for ordered and disordered structures, harmonic and anharmonic dynamics, classical and quantum systems show that disorder, anharmonicity, and quantum effects are closely interlinked.

Three-dimensional photonic crystals based on macroporous silicon with modulated pore diameter

We report on the fabrication and optical characterization of a three-dimensional (3D) photonic crystal on the basis of macroporous silicon. The structure consists of a 2D array of air pores in silicon whose diameter is varied (modulated) periodically with depth. The bandstructure of the resulting 3D hexagonal photonic crystal is calculated and compared with transmission measurements. The described structure allows to adjust the dispersion relation along the pore axis almost independently from the dispersion relation in the plane perpendicular to the pore axis.