The use of temporal speech and lip information for multi-modal speaker identification via multi-stream HMMs

Investigates the use of temporal lip information, in conjunction with speech information, for robust, text-dependent speaker identification. We propose that significant speaker-dependent information can be obtained from moving lips, enabling speaker recognition systems to be highly robust in the presence of noise. The fusion structure for the audio and visual information is based around the use of multi-stream hidden Markov models (MSHMM), with audio and visual features forming two independent data streams. Recent work with multi-modal MSHMMs has been performed successfully for the task of speech recognition. The use of temporal lip information for speaker identification has been performed previously (T.J. Wark et al., 1998), however this has been restricted to output fusion via single-stream HMMs. We present an extension to this previous work, and show that a MSHMM is a valid structure for multi-modal speaker identification

Sparse temporal representations for facial expression recognition

In automatic facial expression recognition, an increasing number of techniques had been proposed for in the literature that exploits the temporal nature of facial expressions. As all facial expressions are known to evolve over time, it is crucially important for a classifier to be capable of modelling their dynamics. We establish that the method of sparse representation (SR) classifiers proves to be a suitable candidate for this purpose, and subsequently propose a framework for expression dynamics to be efficiently incorporated into its current formulation. We additionally show that for the SR method to be applied effectively, then a certain threshold on image dimensionality must be enforced (unlike in facial recognition problems). Thirdly, we determined that recognition rates may be significantly influenced by the size of the projection matrix \Phi. To demonstrate these, a battery of experiments had been conducted on the CK+ dataset for the recognition of the seven prototypic expressions - anger, contempt, disgust, fear, happiness, sadness and surprise - and comparisons have been made between the proposed temporal-SR against the static-SR framework and state-of-the-art support vector machine.

Unusual Event Detection in Crowded Scenes Using Bag of LBPs in spatio-temporal patches

Modelling events in densely crowded environments remains challenging, due to the diversity of events and the noise in the scene. We propose a novel approach for anomalous event detection in crowded scenes using dynamic textures described by the Local Binary Patterns from Three Orthogonal Planes (LBP-TOP) descriptor. The scene is divided into spatio-temporal patches where LBP-TOP based dynamic textures are extracted. We apply hierarchical Bayesian models to detect the patches containing unusual events. Our method is an unsupervised approach, and it does not rely on object tracking or background subtraction. We show that our approach outperforms existing state of the art algorithms for anomalous event detection in UCSD dataset.

Temporal tracking of mineralization and transcriptional developments of shell formation during the early life history of pearl oyster Pinctada maxima

Molluscan larval ontogeny is a highly conserved process comprising three principal developmental stages. A characteristic unique to each of these stages is shell design, termed prodissoconch I, prodissoconch II and dissoconch. These shells vary in morphology, mineralogy and microstructure. The discrete temporal transitions in shell biomineralization between these larval stages are utilized in this study to investigate transcriptional involvement in several distinct biomineralization events. Scanning electron microscopy and X-ray diffraction analysis of P. maxima larvae and juveniles collected throughout post-embryonic ontogenesis, document the mineralogy and microstructure of each shelled stage as well as establishing a timeline for transitions in biomineralization. P. maxima larval samples most representative of these biomineralization distinctions and transitions were analyzed for differential gene expression on the microarray platform PmaxArray 1.0. A number of transcripts are reported as differentially expressed in correlation to the mineralization events of P. maxima larval ontogeny. Some of those isolated are known shell matrix genes while others are novel; these are discussed in relation to potential shell formation roles. This interdisciplinary investigation has linked the shell developments of P. maxima larval ontogeny with corresponding gene expression profiles, furthering the elucidation of shell biomineralization.

A temporal comparison of AltaVista Web searching

Major Web search engines, such as AltaVista, are essential tools in the quest to locate online information. This article reports research that used transaction log analysis to examine the characteristics and changes in AltaVista Web searching that occurred from 1998 to 2002. The research questions we examined are (1) What are the changes in AltaVista Web searching from 1998 to 2002? (2) What are the current characteristics of AltaVista searching, including the duration and frequency of search sessions? (3) What changes in the information needs of AltaVista users occurred between 1998 and 2002? The results of our research show (1) a move toward more interactivity with increases in session and query length, (2) with 70% of session durations at 5 minutes or less, the frequency of interaction is increasing, but it is happening very quickly, and (3) a broadening range of Web searchers' information needs, with the most frequent terms accounting for less than 1% of total term usage. We discuss the implications of these findings for the development of Web search engines. © 2005 Wiley Periodicals, Inc.

Charting the system : the integrated master schedule as a multi-level and poly-temporal boundary object in complex projects

This paper investigates the use of visual artifacts to represent a complex adaptive system (CAS). The integrated master schedule (IMS) is one of those visuals widely used in complex projects for scheduling, budgeting, and project management. In this paper, we discuss how the IMS outperforms the traditional timelines and acts as a ‘multi-level and poly-temporal boundary object’ that visually represents the CAS. We report the findings of a case study project on the way the IMS mapped interactions, interdependencies, constraints and fractal patterns in a complex project. Finally, we discuss how the IMS was utilised as a complex boundary object by eliciting commitment and development of shared mental models, and facilitating negotiation through the layers of multiple interpretations from stakeholders.

Limestone and speleothem trace element geochemistry as tools for palaeoclimatic reconstruction, Mount Etna region, central-coastal Queensland

This study investigated potential palaeoclimate proxies provided by rare earth element (REE) geochemistry in speleothems and in clay mineralogy of cave sediments. Speleothem and sediment samples were collected from a series of cave fill deposits that occurred with rich vertebrate fossil assemblages in and around Mount Etna National Park, Rockhampton (central coastal Queensland). The fossil deposits range from Plio- Pleistocene to Holocene in age (based on uranium/thorium dating) and appear to represent depositional environments ranging from enclosed rainforest to semi-arid grasslands. Therefore, the Mount Etna cave deposits offer the perfect opportunity to test new palaeoclimate tools as they include deposits that span a known significant climate shift on the basis of independent faunal data. The first section of this study investigates the REE distribution of the host limestone to provide baseline geochemistry for subsequent speleothem investigations. The Devonian Mount Etna Beds were found to be more complex than previous literature had documented. The studied limestone massif is overturned, highly recrystallised in parts and consists of numerous allochthonous blocks with different spatial orientations. Despite the complex geologic history of the Mount Etna Beds, Devonian seawater-like REE patterns were recovered in some parts of the limestone and baseline geochemistry was determined for the bulk limestone for comparison with speleothem REE patterns. The second part of the study focused on REE distribution in the karst system and the palaeoclimatic implications of such records. It was found that REEs have a high affinity for calcite surfaces and that REE distributions in speleothems vary between growth bands much more than along growth bands, thus providing a temporal record that may relate to environmental changes. The morphology of different speleothems (i.e., stalactites, stalagmites, and flowstones) has little bearing on REE distributions provided they are not contaminated with particulate fines. Thus, baseline knowledge developed in the study suggested that speleothems were basically comparable for assessing palaeoclimatically controlled variations in REE distributions. Speleothems from rainforest and semi-arid phases were compared and it was found that there are definable differences in REE distribution that can be attributed to climate. In particular during semiarid phases, total REE concentration decreased, LREE became more depleted, Y/Ho increased, La anomalies were more positive and Ce anomalies were more negative. This may reflect more soil development during rainforest phases and more organic particles and colloids, which are known to transport REEs, in karst waters. However, on a finer temporal scale (i.e. growth bands) within speleothems from the same climate regime, no difference was seen. It is suggested that this may be due to inadequate time for soil development changes on the time frames represented by differences in growth band density. The third part of the study was a reconnaissance investigation focused on mineralogy of clay cave sediments, illite/kaolinite ratios in particular, and the potential palaeoclimatic implications of such records. Although the sample distribution was not optimal, the preliminary results suggest that the illite/kaolinite ratio increased during cold and dry intervals, consistent with decreased chemical weathering during those times. The study provides a basic framework for future studies at differing latitudes to further constrain the parameters of the proxy. The identification of such a proxy recorded in cave sediment has broad implications as clay ratios could potentially provide a basic local climate proxy in the absence of fossil faunas and speleothem material. This study suggests that REEs distributed in speleothems may provide information about water throughput and soil formation, thus providing a potential palaeoclimate proxy. It highlights the importance of understanding the host limestone geochemistry and broadens the distribution and potential number of cave field sites as palaeoclimate information no longer relies solely on the presence of fossil faunas and or speleothems. However, additional research is required to better understand the temporal scales required for the proxies to be recognised.

Sourdough & other stories : a story told in parts (a mosaic novel and exegesis)

The mosaic novel - with its independent 'story-tiles' linking together to form a complete narrative - has the potential to act as a reflection on the periodic resurfacing of unconscious memories in the conscious lives of fictional characters. This project is an exploration of the mosaic text as a fictional analogue of involuntary memory. These concepts are investigated as they appear in traditional fairy tales and engaged with in this thesis's creative component, Sourdough and Other Stories (approximately 80,000 words), a mosaic novel comprising sixteen interconnected 'story-tiles'. Traditional fairy tales are non-reflective and conducive to forgetting (i.e. anti-memory); fairy tale characters are frequently portrayed as psychologically two-dimensional, in that there is no examination of the mental and emotional distress caused when children are stolen/ abandoned/ lost and when adults are exiled. Sourdough and Other Stories is a creative examination of, and attempted to remedy, this lack of psychological depth. This creative work is at once something more than a short story collection, and something that is not a traditional novel, but instead a culmination of two modes of writing. It employs the fairy tale form to explore James' 'thorns in the spirit' (1898, p.199) in fiction; the anxiety caused by separation from familial and community groups. The exegesis, A Story Told in Parts - Sourdough and Other Stories is a critical essay (approximately 20,000 words in length), a companion piece to the mosaic novel, which analyses how my research question proceeded from my creative work, and considers the theoretical underpinnings of the creative work and how it enacts the research question: 'Can a writer use the structural possibilities of the mosaic text to create a fictional work that is an analogue of an involuntary memory?' The cumulative effect of the creative and exegetical works should be that of a dialogue between the two components - each text informing the other and providing alternate but complementary lenses with which to view the research question.

Benign Epilepsy with Centro-temporal Spikes: Spike Triggered fMRI Shows Somato-sensory Cortex Activity

Summary:  Objective: We performed spike triggered functional MRI (fMRI) in a 12 year old girl with Benign Epilepsy with Centro-temporal Spikes (BECTS) and left-sided spikes. Our aim was to demonstrate the cerebral origin of her interictal spikes. Methods: EEG was recorded within the 3 Tesla MRI. Whole brain fMRI images were acquired, beginning 2–3 seconds after spikes. Baseline fMRI images were acquired when there were no spikes for 20 seconds. Image sets were compared with the Student's t-test. Results: Ten spike and 20 baseline brain volumes were analysed. Focal activiation was seen in the inferior left sensorimotor cortex near the face area. The anterior cingulate was more active during baseline than spikes. Conclusions: Left sided epileptiform activity in this patient with BECTS is associated with fMRI activation in the left face region of the somatosensory cortex, which would be consistent with the facial sensorimotor involvement in BECT seizures. The presence of BOLD signal change in other regions raises the possibility that the scalp recorded field of this patient with BECTs may reflect electrical change in more than one brain region.

Myoinositol Abnormalities in Temporal Lobe Epilepsy

Purpose: This study used magnetic resonance spectroscopy (MRS) to examine metabolite abnormalities in the temporal and frontal lobe of patients with temporal lobe epilepsy (TLE) of differing severity. Methods: We investigated myoinositol in TLE by using short-echo MRS in 34 TLE patients [26 late onset (LO-TLE), eight hippocampal sclerosis (HS-TLE)], and 16 controls. Single-voxel short-echo (35 ms) MR spectra of temporal and frontal lobes were acquired at 1.5 T and analyzed by using LCModel. Results: The temporal lobe ipsilateral to seizure origin in HS-TLE, but not LO-TLE, had reduced N-acetylaspartate (NA) and elevated myoinositol (MI; HS-TLE NA, 7.8 ± 1.9 mM, control NA, 9.2 ± 1.3 mM; p < 0.05; HS-TLE MI, 6.1 ± 1.6 mM, control mI 4.9 ± 0.8 mM, p< 0.05). Frontal lobe MI was low in both patient groups (LO-TLE, 4.3 ± 0.8 mM; p < 0.05; HS-TLE, 3.6 ±.05 mM; p < 0.001; controls, 4.8 ± 0.5 mM). Ipsilateral frontal lobes had lower MI (3.8 ± 0.7 mM; p < 0.01) than contralateral frontal lobes (4.3 ± 0.8 mM; p < 0.05). Conclusions: MI changes may distinguish between the seizure focus, where MI is increased, and areas of seizure spread where MI is decreased.