Adaptive spatio-temporal filter for low-cost camera depth maps

In this paper we present an adaptive spatio-temporal filter that aims to improve low-cost depth camera accuracy and stability over time. The proposed system is composed by three blocks that are used to build a reliable depth map of static scenes. An adaptive joint-bilateral filter is used to obtain consistent depth maps by jointly considering depth and video information and by adapting its parameters to different levels of estimated noise. Kalman filters are used to reduce the temporal random fluctuations of the measurements. Finally an interpolation algorithm is used to obtain consistent depth maps in the regions where the depth information is not available. Results show that this approach allows to considerably improve the depth maps quality by considering spatio-temporal information and by adapting its parameters to different levels of noise.

Efficient spatio-temporal hole filling strategy for Kinect depth maps

In this paper we present an efficient hole filling strategy that improves the quality of the depth maps obtained with the Microsoft Kinect device. The proposed approach is based on a joint-bilateral filtering framework that includes spatial and temporal information. The missing depth values are obtained applying iteratively a joint-bilateral filter to their neighbor pixels. The filter weights are selected considering three different factors: visual data, depth information and a temporal-consistency map. Video and depth data are combined to improve depth map quality in presence of edges and homogeneous regions. Finally, the temporal-consistency map is generated in order to track the reliability of the depth measurements near the hole regions. The obtained depth values are included iteratively in the filtering process of the successive frames and the accuracy of the hole regions depth values increases while new samples are acquired and filtered

Complex Patterns of Alternative Splicing Mediate the Spatial and Temporal Distribution of Perlecan/UNC-52 in Caenorhabditis elegans

The unc-52 gene encodes the nematode homologue of mammalian perlecan, the major heparan sulfate proteoglycan of the extracellular matrix. This is a large complex protein with regions similar to low-density lipoprotein receptors, laminin, and neural cell adhesion molecules (NCAMs). In this study, we extend our earlier work and demonstrate that a number of complex isoforms of this protein are expressed through alternative splicing. We identified three major classes of perlecan isoforms: a short form lacking the NCAM region and the C-terminal agrin-like region; a medium form containing the NCAM region, but still lacking the agrin-like region; and a newly identified long form that contains all five domains present in mammalian perlecan.  Using region-specific antibodies and unc-52 mutants, we reveal a complex spatial and temporal expression pattern for these UNC-52 isoforms. As well, using a series of mutations affecting different regions and thus different isoforms of UNC-52, we demonstrate that the medium NCAM-containing isoforms are sufficient for myofilament lattice assembly in developing nematode body-wall muscle. Neither short isoforms nor isoforms containing the C-terminal agrin-like region are essential for sarcomere assembly or muscle cell attachment, and their role in development remains unclear.

Temporal distribution of the ganglion cell volleys in the normal rat optic nerve

We describe experiments on behaving rats with electrodes implanted on the cornea, in the optic chiasm, and on the visual cortex; in addition, two red light-emitting diodes (LED) are permanently attached to the skull over the left eye. Recordings timelocked to the LED flashes reveal both the local events at each electrode site and the orderly transfer of visual information from retina to cortex. The major finding is that every stimulus, regardless of its luminance, duration, or the state of retinal light adaptation, elicits an optic nerve volley with a latency of about 10 ms and a duration of about 300 ms. This phenomenon has not been reported previously, so far as we are aware. We conclude that the retina, which originates from the forebrain of the developing embryo, behaves like a typical brain structure: it translates, within a few hundred milliseconds, the chemical information in each pattern of bleached photoreceptors into a corresponding pattern of ganglion cell neuronal information that leaves via the optic nerve. The attributes of each rat ganglion cell appear to include whether the retinal neuropile calls on it to leave after a stimulus and, if so when, within a 300-ms poststimulus epoch. The resulting retinal analysis of the scene, on arrival at the cortical level, is presumed to participate importantly in the creation of visual perceptual experiences.

Evaluation of the potential of InSAR time series to study the spatio-temporal evolution of piezometric levels in the Madrid aquifer

The Tertiary detritic aquifer of Madrid (TDAM), with an average thickness of 1500 m and a heterogeneous, anisotropic structure, supplies water to Madrid, the most populated city of Spain (3.2 million inhabitants in the metropolitan area). Besides its complex structure, a previous work focused in the north-northwest of Madrid city showed that the aquifer behaves quasi elastically trough extraction/recovery cycles and ground uplifting during recovery periods compensates most of the ground subsidence measured during previous extraction periods (Ezquerro et al., 2014). Therefore, the relationship between ground deformation and groundwater level through time can be simulated using simple elastic models. In this work, we model the temporal evolution of the piezometric level in 19 wells of the TDAM in the period 1997–2010. Using InSAR and piezometric time series spanning the studied period, we first estimate the elastic storage coefficient (Ske) for every well. Both, the Ske of each well and the average Ske of all wells, are used to predict hydraulic heads at the different well locations during the study period and compared against the measured hydraulic heads, leading to very similar errors when using the Ske of each well and the average Ske of all wells: 14 and 16 % on average respectively. This result suggests that an average Ske can be used to estimate piezometric level variations in all the points where ground deformation has been measured by InSAR, thus allowing production of piezometric level maps for the different extraction/recovery cycles in the TDAM.

Spatio-temporal evaluation of neck muscle activation during postural perturbations in healthy subjects

The purpose of this study was to examine the spatio-temporal activation of the sternocleidomastoid (SCM) and cervical extensor (CE) muscles with respect to the deltoid muscle onset during rapid voluntary upper limb movement in healthy volunteers. The repeatability and reliability of the spatio-temporal aspects of the myoelectric signals were also examined. Ten subjects performed bilateral and unilateral rapid upper limb flexion, abduction and extension in response to a visual stimulus. EMG onsets and normalised root mean square (nRMS) values were calculated for the SCM and CE muscles. Subjects attended three testing sessions over non-consecutive days allowing the repeatability and reliability of these measures to be assessed. The SCM and CE muscles demonstrated feed-forward activation (activation within 50 ms of deltoid onset) during rapid arm movements in all directions. The sequence and magnitude of neck muscle activation displayed directional specificity, however, the neck flexor and extensor muscles displayed co-activation during all perturbations. EMG onsets demonstrated high repeatability in terms of repeated measure precision (nSEM in the range 1.9-5.7%). This was less evident for the repeatability of nRMS values. The results of this study provide a greater understanding of cervical neuromotor control strategies. During bilateral and unilateral upper limb perturbations, the SCM and CE muscles demonstrate feed-forward co-activation. It seems apparent that feed-forward activation of neck muscles is a mechanism necessary to achieve stability for the visual and vestibular systems, whilst ensuring stabilisation and protection of the cervical spine. (C) 2004 Elsevier Ltd. All rights reserved.

Spatio-temporal scanning and statistical test of the accelerating moment release (AMR) model using Australian earthquake data

The Accelerating Moment Release (AMR) preceding earthquakes with magnitude above 5 in Australia that occurred during the last 20 years was analyzed to test the Critical Point Hypothesis. Twelve earthquakes in the catalog were chosen based on a criterion for the number of nearby events. Results show that seven sequences with numerous events recorded leading up to the main earthquake exhibited accelerating moment release. Two occurred near in time and space to other earthquakes preceded by AM R. The remaining three sequences had very few events in the catalog so the lack of AMR detected in the analysis may be related to catalog incompleteness. Spatio-temporal scanning of AMR parameters shows that 80% of the areas in which AMR occurred experienced large events. In areas of similar background seismicity with no large events, 10 out of 12 cases exhibit no AMR, and two others are false alarms where AMR was observed but no large event followed. The relationship between AMR and Load-Unload Response Ratio (LURR) was studied. Both methods predict similar critical region sizes, however, the critical point time using AMR is slightly earlier than the time of the critical point LURR anomaly.

Dissociating the spatio-temporal characteristics of cortical neuronal activity associated with human volitional swallowing in the healthy adult brain

Human swallowing represents a complex highly coordinated sensorimotor function whose functional neuroanatomy remains incompletely understood. Specifically, previous studies have failed to delineate the temporo-spatial sequence of those cerebral loci active during the differing phases of swallowing. We therefore sought to define the temporal characteristics of cortical activity associated with human swallowing behaviour using a novel application of magnetoencephalography (MEG). In healthy volunteers (n = 8, aged 28-45), 151-channel whole cortex MEG was recorded during the conditions of oral water infusion, volitional wet swallowing (5 ml bolus), tongue thrust or rest. Each condition lasted for 5 s and was repeated 20 times. Synthetic aperture magnetometry (SAM) analysis was performed on each active epoch and compared to rest. Temporal sequencing of brain activations utilised time-frequency wavelet plots of regions selected using virtual electrodes. Following SAM analysis, water infusion preferentially activated the caudolateral sensorimotor cortex, whereas during volitional swallowing and tongue movement, the superior sensorimotor cortex was more strongly active. Time-frequency wavelet analysis indicated that sensory input from the tongue simultaneously activated caudolateral sensorimotor and primary gustatory cortex, which appeared to prime the superior sensory and motor cortical areas, involved in the volitional phase of swallowing. Our data support the existence of a temporal synchrony across the whole cortical swallowing network, with sensory input from the tongue being critical. Thus, the ability to non-invasively image this network, with intra-individual and high temporal resolution, provides new insights into the brain processing of human swallowing. © 2004 Elsevier Inc. All rights reserved.

Spatio-temporal imaging of corticaldesynchronization in migraine visual aura:a magnetoencephalography case study

Objective.-To determine cortical oscillatory changes involved in migraine visual aura using magnetoencephalography (MEG). Background.-Visual aura in the form of scintillating scotoma precedes migraine in many cases. The involvement of cortical spreading depression within striate and extra-striate cortical areas is implicated in the generation of the disturbance, but the details of its progression, the effects on cortical oscillations, and the mechanisms of aura generation are unclear. Methods.-We used MEG to directly image changes in cortical oscillatory power during an episode of scintillating scotoma in a patient who experiences aura without subsequent migraine headache. Using the synthetic aperture magnetometry method of MEG source imaging, focal changes in cortical oscillatory power were observed over a 20-minute period and visualized in coregistration with the patient's magnetic resonance image. Results.-Alpha band desynchronization in both the left extra-striate and temporal cortex persisted for the duration of reported visual disturbance, terminating abruptly upon disappearance of scintillations. Gamma frequency desynchronization in the left temporal lobe continued for 8 to 10 minutes following the reported end of aura. Conclusions.-Observations implicate the extra-striate and temporal cortex in migraine visual aura and suggest involvement of alpha desynchronization in generation of phosphenes and gamma desynchronization in sustained inhibition of visual function.

A reevaluation of achromatic spatio-temporal vision: nonoriented filters are monocular, they adapt, and can be used for decision making at high flicker speeds

Masking, adaptation, and summation paradigms have been used to investigate the characteristics of early spatio-temporal vision. Each has been taken to provide evidence for (i) oriented and (ii) nonoriented spatial-filtering mechanisms. However, subsequent findings suggest that the evidence for nonoriented mechanisms has been misinterpreted: those experiments might have revealed the characteristics of suppression (eg, gain control), not excitation, or merely the isotropic subunits of the oriented detecting mechanisms. To shed light on this, we used all three paradigms to focus on the ‘high-speed’ corner of spatio-temporal vision (low spatial frequency, high temporal frequency), where cross-oriented achromatic effects are greatest. We used flickering Gabor patches as targets and a 2IFC procedure for monocular, binocular, and dichoptic stimulus presentations. To account for our results, we devised a simple model involving an isotropic monocular filter-stage feeding orientation-tuned binocular filters. Both filter stages are adaptable, and their outputs are available to the decision stage following nonlinear contrast transduction. However, the monocular isotropic filters (i) adapt only to high-speed stimuli—consistent with a magnocellular subcortical substrate—and (ii) benefit decision making only for high-speed stimuli (ie, isotropic monocular outputs are available only for high-speed stimuli). According to this model, the visual processes revealed by masking, adaptation, and summation are related but not identical.

Interocular suppression in normal and amblyopic vision:spatio-temporal properties

We measured the properties of interocular suppression in strabismic amblyopes and compared these to dichoptic masking in binocularly normal observers. We used a dichoptic version of the well-established probed-sinewave paradigm that measured sensitivity to a brief target stimulus (one of four letters to be discriminated) in the amblyopic eye at different times relative to a suppression-inducing mask in the fixing eye. This was done using both sinusoidal steady state and transient approaches. The suppression-inducing masks were either modulations of luminance or contrast (full field, just overlaying the target, or just surrounding the target). Our results were interpreted using a descriptive model that included contrast gain control and spatio-temporal filtering prior to excitatory binocular combination. The suppression we measured, other than in magnitude, was not fundamentally different from normal dichoptic masking: lowpass spatio-temporal properties with similar contributions from both surround and overlay suppression.

Spatio-temporal analyses of West Nile virus transmission in Culex mosquitoes in northern Illinois, USA, 2004

After a severe outbreak of West Nile virus (WNV) in Cook County, Illinois, in 2002, detections of WNV in mosquitoes were frequent across the state in the following years despite small numbers of human cases. We conducted a spatio-temporal analysis of Culex (subgenus Culex) mosquitoes collected in 2004 in three mosquito abatement districts (MAD) in Cook County by calculating monthly estimates of mosquito density, prevalence of infected mosquitoes, and exposure intensity, which in turn is a product of mosquito density and infection rates. Mosquito infections were detected early at three sites in late May and were widely detected throughout the three MADs in the summer with infection rates as high as 13 per 1000 in August. Exposure intensities were higher at sites adjacent to the Des Plaines River, especially in August and September. The aggregated pattern of WNV transmission along the river might be related to the existence of substantial forest preserves and wetlands that might produce ecological conditions favorable for mosquito proliferation and interactions between mosquitoes and birds.