Trajectory Guided Tracking and Recognition of Actions

A combined 2D, 3D approach is presented that allows for robust tracking of moving people and recognition of actions. It is assumed that the system observes multiple moving objects via a single, uncalibrated video camera. Low-level features are often insufficient for detection, segmentation, and tracking of non-rigid moving objects. Therefore, an improved mechanism is proposed that integrates low-level (image processing), mid-level (recursive 3D trajectory estimation), and high-level (action recognition) processes. A novel extended Kalman filter formulation is used in estimating the relative 3D motion trajectories up to a scale factor. The recursive estimation process provides a prediction and error measure that is exploited in higher-level stages of action recognition. Conversely, higher-level mechanisms provide feedback that allows the system to reliably segment and maintain the tracking of moving objects before, during, and after occlusion. The 3D trajectory, occlusion, and segmentation information are utilized in extracting stabilized views of the moving object that are then used as input to action recognition modules. Trajectory-guided recognition (TGR) is proposed as a new and efficient method for adaptive classification of action. The TGR approach is demonstrated using "motion history images" that are then recognized via a mixture-of-Gaussians classifier. The system was tested in recognizing various dynamic human outdoor activities: running, walking, roller blading, and cycling. Experiments with real and synthetic data sets are used to evaluate stability of the trajectory estimator with respect to noise.

MosaicShape: Stochastic Region Grouping with Shape Prior

A novel method that combines shape-based object recognition and image segmentation is proposed for shape retrieval from images. Given a shape prior represented in a multi-scale curvature form, the proposed method identifies the target objects in images by grouping oversegmented image regions. The problem is formulated in a unified probabilistic framework and solved by a stochastic Markov Chain Monte Carlo (MCMC) mechanism. By this means, object segmentation and recognition are accomplished simultaneously. Within each sampling move during the simulation process,probabilistic region grouping operations are influenced by both the image information and the shape similarity constraint. The latter constraint is measured by a partial shape matching process. A generalized parallel algorithm by Barbu and Zhu,combined with a large sampling jump and other implementation improvements, greatly speeds up the overall stochastic process. The proposed method supports the segmentation and recognition of multiple occluded objects in images. Experimental results are provided for both synthetic and real images.

A Laminar Cortical Model for 3D Perception of Slanted and Curved Surfaces and of 2D Images: Developement, attention, and Bistability

A model of laminar visual cortical dynamics proposes how 3D boundary and surface representations of slated and curved 3D objects and 2D images arise. The 3D boundary representations emerge from interactions between non-classical horizontal receptive field interactions with intracorticcal and intercortical feedback circuits. Such non-classical interactions contextually disambiguate classical receptive field responses to ambiguous visual cues using cells that are sensitive to angles and disparity gradients with cortical areas V1 and V2. These cells are all variants of bipole grouping cells. Model simulations show how horizontal connections can develop selectively to angles, how slanted surfaces can activate 3D boundary representations that are sensitive to angles and disparity gradients, how 3D filling-in occurs across slanted surfaces, how a 2D Necker cube image can be represented in 3D, and how bistable Necker cuber percepts occur. The model also explains data about slant aftereffects and 3D neon color spreading. It shows how habituative transmitters that help to control developement also help to trigger bistable 3D percepts and slant aftereffects, and how attention can influence which of these percepts is perceived by propogating along some object boundaries.

A Neuromorphic Model for Achromatic and Chromatic Surface Representation of Natural Images

This study develops a neuromorphic model of human lightness perception that is inspired by how the mammalian visual system is designed for this function. It is known that biological visual representations can adapt to a billion-fold change in luminance. How such a system determines absolute lightness under varying illumination conditions to generate a consistent interpretation of surface lightness remains an unsolved problem. Such a process, called "anchoring" of lightness, has properties including articulation, insulation, configuration, and area effects. The model quantitatively simulates such psychophysical lightness data, as well as other data such as discounting the illuminant, the double brilliant illusion, and lightness constancy and contrast effects. The model retina embodies gain control at retinal photoreceptors, and spatial contrast adaptation at the negative feedback circuit between mechanisms that model the inner segment of photoreceptors and interacting horizontal cells. The model can thereby adjust its sensitivity to input intensities ranging from dim moonlight to dazzling sunlight. A new anchoring mechanism, called the Blurred-Highest-Luminance-As-White (BHLAW) rule, helps simulate how surface lightness becomes sensitive to the spatial scale of objects in a scene. The model is also able to process natural color images under variable lighting conditions, and is compared with the popular RETINEX model.

Synthetic and mechanistic aspects of the reactions of α-diazosulfoxides

The research described in this thesis focuses, principally, on synthesis of stable α-diazosulfoxides and investigation of their reactivity under various reaction conditions (transition-metal catalysed, photochemical, thermal and microwave) with a particular emphasis on the reactive intermediates and mechanistic aspects of the reaction pathways involved. In agreement with previous studies carried out on these compounds, the key reaction pathway of α-diazosulfoxides was found to be hetero-Wolff rearrangement to give α-oxosulfine intermediates. However, a competing reaction pathway involving oxygen migration from sulfur to oxygen was also observed. Critically, isomerisation of α-oxosulfine stereoisomers was observed directly by 1H NMR spectroscopy in this work and this observation accounts for the stereochemical outcomes of the various cycloaddition reactions, whether carried out with in situ trapping or with preformed solutions of sulfines. Furthermore, matrix isolation experiments have shown that electrocyclisation of α-oxosulfines to oxathiiranes takes place and this verifies the proposed mechanisms for enol and disulfide formation. The introductory chapter includes a brief literature review of the synthesis and reactivity of α-diazosulfoxides prior to the commencement of research in this field by the Maguire group. The Wolff rearrangement is also discussed and the characteristic reactions of a number of reactive intermediates (sulfines, sulfenes and oxathiiranes) are outlined. The use of microwave-assisted organic synthesis is also examined, specifically, in the context of α-diazocarbonyl compounds as substrates. The second chapter describes the synthesis of stable monocyclic and bicyclic lactone derivatives of α-diazosulfoxides from sulfide precursors according to established experimental procedures. Approaches to precursors of ketone and sulfimide derivatives of α-diazosulfoxides are also described. The third chapter examines the reactivity of α-diazosulfoxides under thermal, microwave, rhodium(II)-catalysed and photochemical conditions. Comparison of the results obtained under thermal and microwave conditions indicates that there was no evidence for any effect, other than thermal, induced by microwave irradiation. The results of catalyst studies involving several rhodium(II) carboxylate and rhodium(II) carboxamidate catalysts are outlined. Under photochemical conditions, sulfur extrusion is a significant reaction pathway while under thermal or transition metal catalysed conditions, oxygen extrusion is observed. One of the most important observations in this work was the direct spectroscopic observation (by 1H NMR) of interconversion of the E and Z-oxosulfines. Trapping of the α-oxosulfine intermediates as cycloadducts by reaction with 2,3-dimethyl-1,3-butadiene proved useful both synthetically and mechanistically. As the stereochemistry of the α-oxosulfine is retained in the cycloadducts, this provided an ideal method for characterisation of this key feature. In the case of one α-oxosulfine, a novel [2+2] cycloaddition was observed. Preliminary experiments to investigate the reactivity of an α-diazosulfone under rhodium(II) catalysis and microwave irradiation are also described. The fourth chapter describes matrix isolation experiments which were carried out in Rühr Universität, Bochum in collaboration with Prof. Wolfram Sander. These experiments provide direct spectroscopic evidence of an α-oxosulfine intermediate formed by hetero-Wolff rearrangement of an α-diazosulfoxide and subsequent cyclisation of the sulfine to an oxathiirane was also observed. Furthermore, it was possible to identify which stereoisomer of the α-oxosulfine was present in the matrix. A preliminary laser flash photolysis experiment is also discussed. The experimental details, including all spectral and analytical data, are reported at the end of each chapter. The structural interpretation of 1H NMR spectra of the cycloadducts, described in Chapter 3, is discussed in Appendix I.

Synthetic and stereochemical aspects of intramolecular reactions of α-diazoketones catalysed by rhodium(II) carboxylates

Chapter 1 of this thesis is a brief introduction to the preparation and reactions of α-diazocarbonyl compounds, with particular emphasis on the areas relating to the research undertaken: C-H insertion, addition to aromatics, and oxonium ylide generation and rearrangement. A short summary of catalyst development illustrates the importance of rhodium(II)carboxylates for α-diazocarbonyl decomposition. Chapter 2 describes intramolecular C-H insertion reactions of α-diazo-β-keto sulphones to form substituted cyclopentanones. Rhodium(II) carboxylates derived from homochiral carboxylic acids were used as catalysts in these reactions and enantioselection achieved through their use is discussed. Chapter 3 describes intramolecular Buchner cyclisation of aryl diazoketones with emphasis on the stereochemical aspects of the cyclisation and subsequent reaction of the bicyclo[5.3.0]decatrienones produced. The partial asymmetric synthesis achieved through use of chiral rhodium(II) carboxylates as catalysts is discussed. The application of the intramolecular Buchner reaction to the synthesis of hydroazulene lactones is illustrated. Chapter 4 demonstrates oxonium ylide formation and rearrangement in the decomposition of an α-diazoketone. The consequences of the use of chiral rhodium(II) carboxylates as catalysts are described. Particularly significant was the discovery that rhodium(II) (S)-mandelate acts as a very efficient catalyst for α-diazoketone decompositions, in general. Moderate asymmetric induction was possible in the decomposition of α-diazoketones with chiral rhodium(II) carboxylates, with rhodium(II) (S)-mandelate being one of the more enantioselective catalysts investigated. However, the asymmetric induction obtained was very dependent on the exact structure of the α-diazoketone, the catalyst, and the nature of the reaction. Chapter 5 contains the experimental details, and the spectral and analytical data for all new compounds reported.

An investigation of post-primary students' images of mathematics

This research study investigates the image of mathematics held by 5th-year post-primary students in Ireland. For this study, “image of mathematics” is conceptualized as a mental representation or view of mathematics, presumably constructed as a result of past experiences, mediated through school, parents, peers or society. It is also understood to include attitudes, beliefs, emotions, self-concept and motivation in relation to mathematics. This study explores the image of mathematics held by a sample of 356 5th-year students studying ordinary level mathematics. Students were aged between 15 and 18 years. In addition, this study examines the factors influencing students‟ images of mathematics and the possible reasons for students choosing not to study higher level mathematics for the Leaving Certificate. The design for this study is chiefly explorative. A questionnaire survey was created containing both quantitative and qualitative methods to investigate the research interest. The quantitative aspect incorporated eight pre-established scales to examine students‟ attitudes, beliefs, emotions, self-concept and motivation regarding mathematics. The qualitative element explored students‟ past experiences of mathematics, their causal attributions for success or failure in mathematics and their influences in mathematics. The quantitative and qualitative data was analysed for all students and also for students grouped by gender, prior achievement, type of post-primary school attending, co-educational status of the post-primary school and the attendance of a Project Maths pilot school. Students‟ images of mathematics were seen to be strongly indicated by their attitudes (enjoyment and value), beliefs, motivation, self-concept and anxiety, with each of these elements strongly correlated with each other, particularly self-concept and anxiety. Students‟ current images of mathematics were found to be influenced by their past experiences of mathematics, by their mathematics teachers, parents and peers, and by their prior mathematical achievement. Gender differences occur for students in their images of mathematics, with males having more positive images of mathematics than females and this is most noticeable with regards to anxiety about mathematics. Mathematics anxiety was identified as a possible reason for the low number of students continuing with higher level mathematics for the Leaving Certificate. Some students also expressed low mathematical self-concept with regards to higher level mathematics specifically. Students with low prior achievement in mathematics tended to believe that mathematics requires a natural ability which they do not possess. Rote-learning was found to be common among many students in the sample. The most positive image of mathematics held by students was the “problem-solving image”, with resulting implications for the new Project Maths syllabus in post-primary education. Findings from this research study provide important insights into the image of mathematics held by the sample of Irish post-primary students and make an innovative contribution to mathematics education research. In particular, findings contribute to the current national interest in Ireland in post-primary mathematics education, highlighting issues regarding the low uptake of higher level mathematics for the Leaving Certificate and also making a preliminary comparison between students who took part in the piloting of Project Maths and students who were more recently introduced to the new syllabus. This research study also holds implications for mathematics teachers, parents and the mathematics education community in Ireland, with some suggestions made on improving students‟ images of mathematics.

Synthesis and reactivity of α-diazo-β-keto sulfoxides: scope and synthetic potential

The research described in this thesis focuses on the design and synthesis of stable α-diazosulfoxides and investigation of their reactivity under a variety of conditions (transition-metal catalysis, thermal, photochemical and microwave) with a particular emphasis on the synthesis of novel heterocyclic compounds with potential biological activity. The exclusive reaction pathway for these α-diazosulfoxides was found to be hetero-Wolff rearrangement to give α-oxosulfine intermediates. In the first chapter, a literature review of sulfines is presented, including a discussion of naturally occurring sulfines, and an overview of the synthesis and reactivity of sulfines. The potential of sulfines in organic synthesis and recent developments in particular are highlighted. The second chapter discusses the synthesis and reactivity of α-diazosulfoxides, building on earlier results in this research group. The synthesis of lactone-based α-diazosulfoxides and, for the first time, ketone-based benzofused and monocyclic α-diazosulfoxides is described. The reactivity of these α-diazosulfoxides is then explored under a variety of conditions, such as transition-metal catalysis, photochemical and microwave, generating labile α-oxosulfine intermediates, which are trapped using amines and dienes, in addition to the spontaneous reaction pathways which occur with α-oxosulfines in the absence of a trap. A new reaction pathway was explored with the lactone based α-oxosulfines, involving reaction with amines to generate novel 3-aminofuran-2(5H)-ones via carbophilic attack, in very good yields. The reactivity of ketone-based α-diazosulfoxides was explored for the first time, and once again, pseudo-Wolff rearrangement to the α-oxosulfines was the exclusive reaction pathway observed. The intermediacy of the α-oxosulfines was confirmed by trapping as cycloadducts, with the stereochemical features dependant on the reaction conditions. In the absence of a diene trap, a number of reaction fates from the α-oxosulfines were observed, including complete sulfinyl extrusion to give indanones, sulfur extrusion to give indanediones, and, to a lesser extent, dimerisation. The indanediones were characterised by trapping as quinoxalines, to enable full characterisation. One of the overriding outcomes of this thesis was the provision of new insights into the behaviour of α-oxosulfines with different transition metal catalysts, and under thermal, microwave and photolysis conditions. A series of 3-aminofuran-2(5H)-ones and benzofused dihydro-2H-thiopyran S-oxides were submitted for anticancer screening at the U.S. National Cancer Institute. A number of these derivatives were identified as hit compounds, with excellent cell growth inhibition. One 3-aminofuran-2(5H)-one derivative has been chosen for further screening. The third chapter details the full experimental procedures, including spectroscopic and analytical data for the compounds prepared during this research. The data for the crystal structures are contained in the attached CD.

Coordinated analysis of delayed sprites with high-speed images and remote electromagnetic fields

Simultaneous measurements of high-altitude optical emissions and magnetic fields produced by sprite-associated lightning discharges enable a close examination of the link between low-altitude lightning processes and high-altitude sprite processes. We report results of the coordinated analysis of high-speed sprite video and wideband magnetic field measurements recorded simultaneously at Yucca Ridge Field Station and Duke University. From June to August 2005, sprites were detected following 67 lightning strokes, all of which had positive polarity. Our data showed that 46% of the 83 discrete sprite events in these sequences initiated more than 10 ms after the lightning return stroke, and we focus on these delayed sprites in this work. All delayed sprites were preceded by continuing current moments that averaged at least 11 kA km between the return stroke and sprites. The total lightning charge moment change at sprite initiation varied from 600 to 18,600 C km, and the minimum value to initiate long-delayed sprites ranged from 600 for 15 ms delay to 2000 C km for more than 120 ms delay. We numerically simulated electric fields at altitudes above these lightning discharges and found that the maximum normalized electric fields are essentially the same as fields that produce short-delayed sprites. Both estimated and simulation-predicted sprite initiation altitudes indicate that long-delayed sprites generally initiate around 5 km lower than short-delayed sprites. The simulation results also reveal that slow (5-20 ms) intensifications in continuing current can play a major role in initiating delayed sprites. Copyright 2008 by the American Geophysical Union.

A mathematical theory of stochastic microlensing. II. Random images, shear, and the Kac-Rice formula

Continuing our development of a mathematical theory of stochastic microlensing, we study the random shear and expected number of random lensed images of different types. In particular, we characterize the first three leading terms in the asymptotic expression of the joint probability density function (pdf) of the random shear tensor due to point masses in the limit of an infinite number of stars. Up to this order, the pdf depends on the magnitude of the shear tensor, the optical depth, and the mean number of stars through a combination of radial position and the star's mass. As a consequence, the pdf's of the shear components are seen to converge, in the limit of an infinite number of stars, to shifted Cauchy distributions, which shows that the shear components have heavy tails in that limit. The asymptotic pdf of the shear magnitude in the limit of an infinite number of stars is also presented. All the results on the random microlensing shear are given for a general point in the lens plane. Extending to the general random distributions (not necessarily uniform) of the lenses, we employ the Kac-Rice formula and Morse theory to deduce general formulas for the expected total number of images and the expected number of saddle images. We further generalize these results by considering random sources defined on a countable compact covering of the light source plane. This is done to introduce the notion of global expected number of positive parity images due to a general lensing map. Applying the result to microlensing, we calculate the asymptotic global expected number of minimum images in the limit of an infinite number of stars, where the stars are uniformly distributed. This global expectation is bounded, while the global expected number of images and the global expected number of saddle images diverge as the order of the number of stars. © 2009 American Institute of Physics.

Automatic segmentation of seven retinal layers in SDOCT images congruent with expert manual segmentation.

Segmentation of anatomical and pathological structures in ophthalmic images is crucial for the diagnosis and study of ocular diseases. However, manual segmentation is often a time-consuming and subjective process. This paper presents an automatic approach for segmenting retinal layers in Spectral Domain Optical Coherence Tomography images using graph theory and dynamic programming. Results show that this method accurately segments eight retinal layer boundaries in normal adult eyes more closely to an expert grader as compared to a second expert grader.

Rare variants create synthetic genome-wide associations.

Genome-wide association studies (GWAS) have now identified at least 2,000 common variants that appear associated with common diseases or related traits (http://www.genome.gov/gwastudies), hundreds of which have been convincingly replicated. It is generally thought that the associated markers reflect the effect of a nearby common (minor allele frequency >0.05) causal site, which is associated with the marker, leading to extensive resequencing efforts to find causal sites. We propose as an alternative explanation that variants much less common than the associated one may create "synthetic associations" by occurring, stochastically, more often in association with one of the alleles at the common site versus the other allele. Although synthetic associations are an obvious theoretical possibility, they have never been systematically explored as a possible explanation for GWAS findings. Here, we use simple computer simulations to show the conditions under which such synthetic associations will arise and how they may be recognized. We show that they are not only possible, but inevitable, and that under simple but reasonable genetic models, they are likely to account for or contribute to many of the recently identified signals reported in genome-wide association studies. We also illustrate the behavior of synthetic associations in real datasets by showing that rare causal mutations responsible for both hearing loss and sickle cell anemia create genome-wide significant synthetic associations, in the latter case extending over a 2.5-Mb interval encompassing scores of "blocks" of associated variants. In conclusion, uncommon or rare genetic variants can easily create synthetic associations that are credited to common variants, and this possibility requires careful consideration in the interpretation and follow up of GWAS signals.

Nurturing Change: Lilly Martin Spencer's Images of Children

This dissertation is the first full-length study to concentrate on American genre painter Lilly Martin Spencer's images of children, which constituted nearly one half of her saleable production during the height of her artistic career from 1848 to 1869. At this time, many young parents received advice regarding child rearing through books and other publications, having moved away from their families of origin in search of employment. These literatures, which gained in popularity from the 1830s onward, focused on spiritual, emotional, and disciplinary matters. My study considers four major themes from the period's writing on child nurture that changed over time, including depravity and innocence, parent/child bonding, standards of behavior and moral rectitude, and children's influence on adults. It demonstrates how Spencer's paintings, prints, and drawings featuring children supported and challenged these evolving ideologies, helping to shed light not only on the artist's reception of child-rearing advice, but also on its possible impact on her middle-class audience, to whom she closely catered. In four chapters, I investigate Spencer's images of sleeping children as visual equivalents of contemporary consolation literature during a time of high infant and child mortality rates; her paintings of parent/child interaction as promoting separation from mothers and emotional bonding with fathers; her prints of mischievous children as both considering changing ideals about children's behavior and comforting Anglo-American citizens afraid of what they saw as threatening minority groups; and her pictures with Civil War and Reconstruction subject matter as contending with the popular concept of the moral utility of children. By framing my interpretations of Spencer's output around key issues in the period's dynamic child-nurture literature, I advance new comprehensive readings of many of her most well-known paintings, including Domestic Happiness, Fi, Fo, Fum!, and The Pic Nic or the Fourth of July. I also consider work often overlooked by other art historians, but which received acclaim in Spencer's own time, including the lithographs of children made after her designs, and the allegorical painting Truth Unveiling Falsehood. Significantly, I provide the first in-depth analysis of a newly rediscovered Reconstruction-era painting, The Home of the Red, White, and Blue.

Characterization of Image Quality for 3D Scatter Corrected Breast CT Images.

The goal of this study was to characterize the image quality of our dedicated, quasi-monochromatic spectrum, cone beam breast imaging system under scatter corrected and non-scatter corrected conditions for a variety of breast compositions. CT projections were acquired of a breast phantom containing two concentric sets of acrylic spheres that varied in size (1-8mm) based on their polar position. The breast phantom was filled with 3 different concentrations of methanol and water, simulating a range of breast densities (0.79-1.0g/cc); acrylic yarn was sometimes included to simulate connective tissue of a breast. For each phantom condition, 2D scatter was measured for all projection angles. Scatter-corrected and uncorrected projections were then reconstructed with an iterative ordered subsets convex algorithm. Reconstructed image quality was characterized using SNR and contrast analysis, and followed by a human observer detection task for the spheres in the different concentric rings. Results show that scatter correction effectively reduces the cupping artifact and improves image contrast and SNR. Results from the observer study indicate that there was no statistical difference in the number or sizes of lesions observed in the scatter versus non-scatter corrected images for all densities. Nonetheless, applying scatter correction for differing breast conditions improves overall image quality.

Task-driven adaptive statistical compressive sensing of gaussian mixture models

A framework for adaptive and non-adaptive statistical compressive sensing is developed, where a statistical model replaces the standard sparsity model of classical compressive sensing. We propose within this framework optimal task-specific sensing protocols specifically and jointly designed for classification and reconstruction. A two-step adaptive sensing paradigm is developed, where online sensing is applied to detect the signal class in the first step, followed by a reconstruction step adapted to the detected class and the observed samples. The approach is based on information theory, here tailored for Gaussian mixture models (GMMs), where an information-theoretic objective relationship between the sensed signals and a representation of the specific task of interest is maximized. Experimental results using synthetic signals, Landsat satellite attributes, and natural images of different sizes and with different noise levels show the improvements achieved using the proposed framework when compared to more standard sensing protocols. The underlying formulation can be applied beyond GMMs, at the price of higher mathematical and computational complexity. © 1991-2012 IEEE.