Knowledge-based spatiotemporal linear abstraction

We present a theoretical framework and a case study for reusing the same conceptual and computational methodology for both temporal abstraction and linear (unidimensional) space abstraction, in a domain (evaluation of traffic-control actions) significantly different from the one (clinical medicine) in which the method was originally used. The method, known as knowledge-based temporal abstraction, abstracts high-level concepts and patterns from time-stamped raw data using a formal theory of domain-specific temporal-abstraction knowledge. We applied this method, originally used to interpret time-oriented clinical data, to the domain of traffic control, in which the monitoring task requires linear pattern matching along both space and time. First, we reused the method for creation of unidimensional spatial abstractions over highways, given sensor measurements along each highway measured at the same time point. Second, we reused the method to create temporal abstractions of the traffic behavior, for the same space segments, but during consecutive time points. We defined the corresponding temporal-abstraction and spatial-abstraction domain-specific knowledge. Our results suggest that (1) the knowledge-based temporal-abstraction method is reusable over time and unidimensional space as well as over significantly different domains; (2) the method can be generalized into a knowledge-based linear-abstraction method, which solves tasks requiring abstraction of data along any linear distance measure; and (3) a spatiotemporal-abstraction method can be assembled from two copies of the generalized method and a spatial-decomposition mechanism, and is applicable to tasks requiring abstraction of time-oriented data into meaningful spatiotemporal patterns over a linear, decomposable space, such as traffic over a set of highways.

Spatiotemporal characteristics of the Huangtupo landslide in the Three Gorges region (China) constrained by radar interferometry

The Huangtupo landslide is one of the largest in the Three Gorges region, China. The county-seat town of Badong, located on the south shore between the Xiling and Wu gorges of the Yangtze River, was moved to this unstable slope prior to the construction of the Three Gorges Project, since the new Three Gorges reservoir completely submerged the location of the old city. The instability of the slope is affecting the new town by causing residential safety problems. The Huangtupo landslide provides scientists an opportunity to understand landslide response to fluctuating river water level and heavy rainfall episodes, which is essential to decide upon appropriate remediation measures. Interferometric Synthetic Aperture Radar (InSAR) techniques provide a very useful tool for the study of superficial and spatially variable displacement phenomena. In this paper, three sets of radar data have been processed to investigate the Huangtupo landslide. Results show that maximum displacements are affecting the northwest zone of the slope corresponding to Riverside slumping mass I#. The other main landslide bodies (i.e. Riverside slumping mass II#, Substation landslide and Garden Spot landslide) exhibit a stable behaviour in agreement with in situ data, although some active areas have been recognized in the foot of the Substation landslide and Garden Spot landslide. InSAR has allowed us to study the kinematic behaviour of the landslide and to identify its active boundaries. Furthermore, the analysis of the InSAR displacement time-series has helped recognize the different displacement patterns on the slope and their relationships with various triggering factors. For those persistent scatterers, which exhibit long-term displacements, they can be decomposed into a creep model (controlled by geological conditions) and a superimposed recoverable term (dependent on external factors), which appears closely correlated with reservoir water level changes close to the river's edge. These results, combined with in situ data, provide a comprehensive analysis of the Huangtupo landslide, which is essential for its management.

Motion, flash, and flicker:A unified spatiotemporal model of perceived edge sharpening

Blurred edges appear sharper in motion than when they are stationary. We proposed a model of this motion sharpening that invokes a local, nonlinear contrast transducer function (Hammett et al, 1998 Vision Research 38 2099-2108). Response saturation in the transducer compresses or 'clips' the input spatial waveform, rendering the edges as sharper. To explain the increasing distortion of drifting edges at higher speeds, the degree of nonlinearity must increase with speed or temporal frequency. A dynamic contrast gain control before the transducer can account for both the speed dependence and approximate contrast invariance of motion sharpening (Hammett et al, 2003 Vision Research, in press). We show here that this model also predicts perceived sharpening of briefly flashed and flickering edges, and we show that the model can account fairly well for experimental data from all three modes of presentation (motion, flash, and flicker). At moderate durations and lower temporal frequencies the gain control attenuates the input signal, thus protecting it from later compression by the transducer. The gain control is somewhat sluggish, and so it suffers both a slow onset, and loss of power at high temporal frequencies. Consequently, brief presentations and high temporal frequencies of drift and flicker are less protected from distortion, and show greater perceptual sharpening.

Advanced data driven visualisation for geo-spatial data

Most current 3D landscape visualisation systems either use bespoke hardware solutions, or offer a limited amount of interaction and detail when used in realtime mode. We are developing a modular, data driven 3D visualisation system that can be readily customised to specific requirements. By utilising the latest software engineering methods and bringing a dynamic data driven approach to geo-spatial data visualisation we will deliver an unparalleled level of customisation in near-photo realistic, realtime 3D landscape visualisation. In this paper we show the system framework and describe how this employs data driven techniques. In particular we discuss how data driven approaches are applied to the spatiotemporal management aspect of the application framework, and describe the advantages these convey.

Combining data driven programming with component based software development:with applications in geovisualisation and dynamic data driven application systems

Software development methodologies are becoming increasingly abstract, progressing from low level assembly and implementation languages such as C and Ada, to component based approaches that can be used to assemble applications using technologies such as JavaBeans and the .NET framework. Meanwhile, model driven approaches emphasise the role of higher level models and notations, and embody a process of automatically deriving lower level representations and concrete software implementations. The relationship between data and software is also evolving. Modern data formats are becoming increasingly standardised, open and empowered in order to support a growing need to share data in both academia and industry. Many contemporary data formats, most notably those based on XML, are self-describing, able to specify valid data structure and content, and can also describe data manipulations and transformations. Furthermore, while applications of the past have made extensive use of data, the runtime behaviour of future applications may be driven by data, as demonstrated by the field of dynamic data driven application systems. The combination of empowered data formats and high level software development methodologies forms the basis of modern game development technologies, which drive software capabilities and runtime behaviour using empowered data formats describing game content. While low level libraries provide optimised runtime execution, content data is used to drive a wide variety of interactive and immersive experiences. This thesis describes the Fluid project, which combines component based software development and game development technologies in order to define novel component technologies for the description of data driven component based applications. The thesis makes explicit contributions to the fields of component based software development and visualisation of spatiotemporal scenes, and also describes potential implications for game development technologies. The thesis also proposes a number of developments in dynamic data driven application systems in order to further empower the role of data in this field.

Understanding U.S. regional linguistic variation with Twitter data analysis

We analyze a Big Data set of geo-tagged tweets for a year (Oct. 2013–Oct. 2014) to understand the regional linguistic variation in the U.S. Prior work on regional linguistic variations usually took a long time to collect data and focused on either rural or urban areas. Geo-tagged Twitter data offers an unprecedented database with rich linguistic representation of fine spatiotemporal resolution and continuity. From the one-year Twitter corpus, we extract lexical characteristics for twitter users by summarizing the frequencies of a set of lexical alternations that each user has used. We spatially aggregate and smooth each lexical characteristic to derive county-based linguistic variables, from which orthogonal dimensions are extracted using the principal component analysis (PCA). Finally a regionalization method is used to discover hierarchical dialect regions using the PCA components. The regionalization results reveal interesting linguistic regional variations in the U.S. The discovered regions not only confirm past research findings in the literature but also provide new insights and a more detailed understanding of very recent linguistic patterns in the U.S.

The slope of the psychometric function and non-stationarity of thresholds in spatiotemporal contrast vision

The slope of the two-interval, forced-choice psychometric function (e.g. the Weibull parameter, ß) provides valuable information about the relationship between contrast sensitivity and signal strength. However, little is known about how or whether ß varies with stimulus parameters such as spatiotemporal frequency and stimulus size and shape. A second unresolved issue concerns the best way to estimate the slope of the psychometric function. For example, if an observer is non-stationary (e.g. their threshold drifts between experimental sessions), ß will be underestimated if curve fitting is performed after collapsing the data across experimental sessions. We measured psychometric functions for 2 experienced observers for 14 different spatiotemporal configurations of pulsed or flickering grating patches and bars on each of 8 days. We found ß ˜ 3 to be fairly constant across almost all conditions, consistent with a fixed nonlinear contrast transducer and/or a constant level of intrinsic stimulus uncertainty (e.g. a square law transducer and a low level of intrinsic uncertainty). Our analysis showed that estimating a single ß from results averaged over several experimental sessions was slightly more accurate than averaging multiple estimates from several experimental sessions. However, the small levels of non-stationarity (SD ˜ 0.8 dB) meant that the difference between the estimates was, in practice, negligible.

Advanced data driven visualisation for geo-spatial data

Most current 3D landscape visualisation systems either use bespoke hardware solutions, or offer a limited amount of interaction and detail when used in realtime mode. We are developing a modular, data driven 3D visualisation system that can be readily customised to specific requirements. By utilising the latest software engineering methods and bringing a dynamic data driven approach to geo-spatial data visualisation we will deliver an unparalleled level of customisation in near-photo realistic, realtime 3D landscape visualisation. In this paper we show the system framework and describe how this employs data driven techniques. In particular we discuss how data driven approaches are applied to the spatiotemporal management aspect of the application framework, and describe the advantages these convey. © Springer-Verlag Berlin Heidelberg 2006.

Spatiotemporal variation of the abundance of calcareous green macroalgae in the Florida Keys: A study of synchrony within a macroalgal functional-form group

The abundance of calcareous green algae was recorded quarterly at 28 sites within the Florida Keys National Marine Sanctuary (FKNMS) for a period of 7 years as part of a sea grass monitoring program. To evaluate the validity of using the functional-form group approach, we designed a sampling method that included the functional-form group and the component genera. This strategy enabled us to analyze the spatiotemporal patterns in the abundance of calcareous green algae as a group and to describe synchronous behavior among its genera through the application of a nonlinear regression model to both categories of data. Spatial analyses revealed that, in general, all genera displayed long-term trends of increasing abundance at most sites; however, at some sites the long-term trends for genera opposed one another. Strong synchrony in the timing of seasonal changes was found among all genera, possibly reflecting similar reproductive and seasonal growth pattern, but the variability in the magnitude of seasonal changes was very high among genera and sites. No spatial patterns were found in long-term or seasonal changes; the only significant relation detected was for slope, with sites closer to land showing higher values, suggesting that some factors associated with land proximity are affecting this increase. We conclude that the abundances of genera behaved differently from the functional-form group, indicating that the use of the functionalform group approach may be unsuitable to detect changes in sea grass community structure in the FKNMS at the existing temporal and spatial scale of the monitoring program.

Spatiotemporal Dynamics of CaMKI During Structural Plasticity of Single Dendritic Spines

Multifunctional calcium/calmodulin dependent protein kinases (CaMKs) are key regulators of spine structural plasticity and long-term potentiation (LTP) in neurons. CaMKs have promiscuous and overlapping substrate recognition motifs, and are distinguished in their regulatory role based on differences in the spatiotemporal dynamics of activity. While the function and activity of CaMKII in synaptic plasticity has been extensively studied, that of CaMKI, another major class of CaMK required for LTP, still remain elusive.

Here, we develop a Förster’s Resonance Energy Transfer (FRET) based sensor to measure the spatiotemporal activity dynamics of CaMK1. We monitored CaMKI activity using 2-photon fluorescence lifetime imaging, while inducing LTP in single dendritic spines of rat (Rattus Norvegicus, strain Sprague Dawley) hippocampal CA1 pyramidal neurons using 2-photon glutamate uncaging. Using RNA-interference and pharmacological means, we also characterize the role of CaMKI during spine structural plasticity.

We found that CaMKI was rapidly and transiently activated with a rise time of ~0.3 s and decay time of ~1 s in response to each uncaging pulse. Activity of CaMKI spread out of the spine. Phosphorylation of CaMKI by CaMKK was required for this spreading and for the initial phase of structural LTP. Combined with previous data showing that CaMKII is restricted to the stimulated spine and required for long-term maintenance of structural LTP, these results suggest that CaMK diversity allows the same incoming signal – calcium – to independently regulate distinct phases of LTP by activating different CaMKs with distinct spatiotemporal dynamics.