The use of temporal speech and lip information for multi-modal speaker identification via multi-stream HMMs

Investigates the use of temporal lip information, in conjunction with speech information, for robust, text-dependent speaker identification. We propose that significant speaker-dependent information can be obtained from moving lips, enabling speaker recognition systems to be highly robust in the presence of noise. The fusion structure for the audio and visual information is based around the use of multi-stream hidden Markov models (MSHMM), with audio and visual features forming two independent data streams. Recent work with multi-modal MSHMMs has been performed successfully for the task of speech recognition. The use of temporal lip information for speaker identification has been performed previously (T.J. Wark et al., 1998), however this has been restricted to output fusion via single-stream HMMs. We present an extension to this previous work, and show that a MSHMM is a valid structure for multi-modal speaker identification

Can audio-visual speech recognition outperform acoustically enhanced speech recognition in automotive environment?

The use of visual features in the form of lip movements to improve the performance of acoustic speech recognition has been shown to work well, particularly in noisy acoustic conditions. However, whether this technique can outperform speech recognition incorporating well-known acoustic enhancement techniques, such as spectral subtraction, or multi-channel beamforming is not known. This is an important question to be answered especially in an automotive environment, for the design of an efficient human-vehicle computer interface. We perform a variety of speech recognition experiments on a challenging automotive speech dataset and results show that synchronous HMM-based audio-visual fusion can outperform traditional single as well as multi-channel acoustic speech enhancement techniques. We also show that further improvement in recognition performance can be obtained by fusing speech-enhanced audio with the visual modality, demonstrating the complementary nature of the two robust speech recognition approaches.

Towards the biofortification of banana fruit for enhanced micronutrient content

In Uganda, vitamin A deficiency (VAD) and iron deficiency anaemia (IDA) are major public health problems with between 15-32% of children under 5 years of age showing VAD and 73% being anaemic. This is largely due to the fact that the staple food crop of the country, banana, is low in pro-vitamin A and iron, therefore leading to dietary deficiencies. Although worldwide progress has been made to control VAD and IDA through supplementation, food fortification and diet diversification, their long term sustainability and impact in developing countries such as Uganda is limited. The approach taken by researchers at Queensland University of Technology (QUT), Australia, in collaboration with the National Agricultural Research Organization (NARO), Uganda, to address this problem, is to generate consumer acceptable banana varieties with significantly increased levels of pro-vitamin A and iron in the fruit using genetic engineering techniques. Such an approach requires the use of suitable, well characterised genes and promoters for targeted transgene expression. Recently, a new banana phytoene synthase gene (APsy2a) involved in the synthesis of pro-vitamin A (pVA) carotenoids was isolated from a high â-carotene banana (F’ei cv Asupina). In addition, sequences of banana ferritin, an iron storage protein, have been isolated from Cavendish banana. The aim of the research described in this thesis was to evaluate the function of these genes to assess their suitability for the biofortification of banana fruit. In addition, a range of banana-derived promoters were characterised to determine their suitability for controlling the expression of transgenes in banana fruit. Due to the time constraints involved with generating transgenic banana fruit, rice was used as the model crop to investigate the functionality of the banana-derived APsy2a and ferritin genes. Using Agrobacterium-mediated transformation, rice callus was transformed with APsy2a +/- the bacterial-derived carotene desaturase gene (CrtI) each under the control of the constitutive maize poly-ubiquitin promoter (ZmUbi) or seed-specific rice glutelin1 (Gt1) promoter. The maize phytoene synthase (ZmPsy1) gene was included as a control. On selective media, with the exception of ZmUbi-CrtI-transgenic callus, all antibiotic resistant callus displayed a yellow-orange colour from which the presence of â-carotene was demonstrated using Raman spectroscopy. Although the regeneration of plants from yellow-orange callus was difficult, 16 transgenic plants were obtained and characterised from callus transformed with ZmUbi-APys2a alone. At least 50% of the T1 seeds developed a yellow-orange coloured callus which was found to contain levels of â-carotene ranging from 4.6-fold to 72-fold higher than that in non-transgenic rice callus. Using the seed-specific Gt1 promoter, 38 transgenic rice plants were generated from APsy2a-CrtI-transformed callus while 32 plants were regenerated from ZmPsy1-CrtI-transformed callus. However, when analysed for presence of transgene by PCR, all transgenic plants contained the APsy2a, ZmPsy1 or CrtI transgene, with none of the plants found to be co-transformed. Using Raman spectroscopy, no â-carotene was detected in-situ in representative T1 seeds. To investigate the potential of the banana-derived ferritin gene (BanFer1) to enhance iron content, rice callus was transformed with constitutively expressed BanFer1 using the soybean ferritin gene (SoyFer) as a control. A total of 12 and 11 callus lines independently transformed with BanFer1 and SoyFer, respectively, were multiplied and transgene expression was verified by RT-PCR. Pearl’s Prussian blue staining for in-situ detection of ferric iron showed a stronger blue colour in rice callus transformed with BanFer1 compared to SoyFer. Using flame atomic absorption spectrometry, the highest mean amount of iron quantified in callus transformed with BanFer1 was 30-fold while that obtained using the SoyFer was 14-fold higher than the controls. In addition, ~78% of BanFer1-transgenic callus lines and ~27% of SoyFer-transgenic callus lines had significantly higher iron content than the non-transformed controls. Since the genes used for enhancing micronutrient content need to be expressed in banana fruit, the activity of a range of banana-derived, potentially fruit-active promoters in banana was investigated. Using uidA (GUS) as a reporter gene, the function of the Expansin1 (MaExp1), Expansin1 containing the rice actin intron (MaExp1a), Expansin4 (MaExp4), Extensin (MaExt), ACS (MaACS), ACO (MaACO), Metallothionein (MaMT2a) and phytoene synthase (APsy2a) promoters were transiently analysed in intact banana fruit using two transformation methods, particle bombardment and Agrobacterium-mediated infiltration (agro-infiltration). Although a considerable amount of variation in promoter activity was observed both within and between experiments, similar trends were obtained using both transformation methods. The MaExp1 and MaExp1a directed high levels of GUS expression in banana fruit which were comparable to those observed from the ZmUbi and Banana bunchy top virus-derived BT4 promoters that were included as positive controls. Lower levels of promoter activity were obtained in both methods using the MaACO and MaExt promoters while the MaExp4, MaACS, and APsy2a promoters directed the lowest GUS activity in banana fruit. An attempt was subsequently made to use agro-infiltration to assess the expression of pVA biosynthesis genes in banana fruit by infiltrating fruit with constructs in which the ZmUbi promoter controlled the expression of APsy2a +/- CrtI, and with the maize phytoene synthase gene (ZmPsy1) included as a control. Unfortunately, the large amount of variation and inconsistency observed within and between experiments precluded any meaningful conclusions to be drawn. The final component of this research was to assess the level of promoter activity and specificity in non-target tissue. These analyses were done on leaves obtained from glasshouse-grown banana plants stably transformed with MaExp1, MaACO, APsy2a, BT4 and ZmUbi promoters driving the expression of the GUS gene in addition to leaves from a selection of the same transgenic plants which were growing in a field trial in North Queensland. The results from both histochemical and fluorometric GUS assays showed that the MaExp1 and MaACO promoters directed very low GUS activities in leaves of stably transformed banana plants compared to the constitutive ZmUbi and BT4 promoters. In summary, the results from this research provide evidence that the banana phytoene synthase gene (APsy2a) and the banana ferritin gene (BanFer1) are functional, since the constitutive over-expression of each of these transgenes led to increased levels of pVA carotenoids (for APsy2a) and iron content (for BanFer1) in transgenic rice callus. Further work is now required to determine the functionality of these genes in stably-transformed banana fruit. This research also demonstrated that the MaExp1 and MaACO promoters are fruit-active but have low activity in non-target tissue (leaves), characteristics that make them potentially useful for the biofortification of banana fruit. Ultimately, however, analysis of fruit from field-grown transgenic plants will be required to fully evaluate the suitability of pVA biosynthesis genes and the fruit-active promoters for fruit biofortification.

Sparse temporal representations for facial expression recognition

In automatic facial expression recognition, an increasing number of techniques had been proposed for in the literature that exploits the temporal nature of facial expressions. As all facial expressions are known to evolve over time, it is crucially important for a classifier to be capable of modelling their dynamics. We establish that the method of sparse representation (SR) classifiers proves to be a suitable candidate for this purpose, and subsequently propose a framework for expression dynamics to be efficiently incorporated into its current formulation. We additionally show that for the SR method to be applied effectively, then a certain threshold on image dimensionality must be enforced (unlike in facial recognition problems). Thirdly, we determined that recognition rates may be significantly influenced by the size of the projection matrix \Phi. To demonstrate these, a battery of experiments had been conducted on the CK+ dataset for the recognition of the seven prototypic expressions - anger, contempt, disgust, fear, happiness, sadness and surprise - and comparisons have been made between the proposed temporal-SR against the static-SR framework and state-of-the-art support vector machine.

Unusual Event Detection in Crowded Scenes Using Bag of LBPs in spatio-temporal patches

Modelling events in densely crowded environments remains challenging, due to the diversity of events and the noise in the scene. We propose a novel approach for anomalous event detection in crowded scenes using dynamic textures described by the Local Binary Patterns from Three Orthogonal Planes (LBP-TOP) descriptor. The scene is divided into spatio-temporal patches where LBP-TOP based dynamic textures are extracted. We apply hierarchical Bayesian models to detect the patches containing unusual events. Our method is an unsupervised approach, and it does not rely on object tracking or background subtraction. We show that our approach outperforms existing state of the art algorithms for anomalous event detection in UCSD dataset.

Quantification of particle emission characteristics and development of an emission model for use in transport microenvironments affected by traffic emissions

Vehicle emitted particles are of significant concern based on their potential to influence local air quality and human health. Transport microenvironments usually contain higher vehicle emission concentrations compared to other environments, and people spend a substantial amount of time in these microenvironments when commuting. Currently there is limited scientific knowledge on particle concentration, passenger exposure and the distribution of vehicle emissions in transport microenvironments, partially due to the fact that the instrumentation required to conduct such measurements is not available in many research centres. Information on passenger waiting time and location in such microenvironments has also not been investigated, which makes it difficult to evaluate a passenger’s spatial-temporal exposure to vehicle emissions. Furthermore, current emission models are incapable of rapidly predicting emission distribution, given the complexity of variations in emission rates that result from changes in driving conditions, as well as the time spent in driving condition within the transport microenvironment. In order to address these scientific gaps in knowledge, this work conducted, for the first time, a comprehensive statistical analysis of experimental data, along with multi-parameter assessment, exposure evaluation and comparison, and emission model development and application, in relation to traffic interrupted transport microenvironments. The work aimed to quantify and characterise particle emissions and human exposure in the transport microenvironments, with bus stations and a pedestrian crossing identified as suitable research locations representing a typical transport microenvironment. Firstly, two bus stations in Brisbane, Australia, with different designs, were selected to conduct measurements of particle number size distributions, particle number and PM2.5 concentrations during two different seasons. Simultaneous traffic and meteorological parameters were also monitored, aiming to quantify particle characteristics and investigate the impact of bus flow rate, station design and meteorological conditions on particle characteristics at stations. The results showed higher concentrations of PN20-30 at the station situated in an open area (open station), which is likely to be attributed to the lower average daily temperature compared to the station with a canyon structure (canyon station). During precipitation events, it was found that particle number concentration in the size range 25-250 nm decreased greatly, and that the average daily reduction in PM2.5 concentration on rainy days compared to fine days was 44.2 % and 22.6 % at the open and canyon station, respectively. The effect of ambient wind speeds on particle number concentrations was also examined, and no relationship was found between particle number concentration and wind speed for the entire measurement period. In addition, 33 pairs of average half-hourly PN7-3000 concentrations were calculated and identified at the two stations, during the same time of a day, and with the same ambient wind speeds and precipitation conditions. The results of a paired t-test showed that the average half-hourly PN7-3000 concentrations at the two stations were not significantly different at the 5% confidence level (t = 0.06, p = 0.96), which indicates that the different station designs were not a crucial factor for influencing PN7-3000 concentrations. A further assessment of passenger exposure to bus emissions on a platform was evaluated at another bus station in Brisbane, Australia. The sampling was conducted over seven weekdays to investigate spatial-temporal variations in size-fractionated particle number and PM2.5 concentrations, as well as human exposure on the platform. For the whole day, the average PN13-800 concentration was 1.3 x 104 and 1.0 x 104 particle/cm3 at the centre and end of the platform, respectively, of which PN50-100 accounted for the largest proportion to the total count. Furthermore, the contribution of exposure at the bus station to the overall daily exposure was assessed using two assumed scenarios of a school student and an office worker. It was found that, although the daily time fraction (the percentage of time spend at a location in a whole day) at the station was only 0.8 %, the daily exposure fractions (the percentage of exposures at a location accounting for the daily exposure) at the station were 2.7% and 2.8 % for exposure to PN13-800 and 2.7% and 3.5% for exposure to PM2.5 for the school student and the office worker, respectively. A new parameter, “exposure intensity” (the ratio of daily exposure fraction and the daily time fraction) was also defined and calculated at the station, with values of 3.3 and 3.4 for exposure to PN13-880, and 3.3 and 4.2 for exposure to PM2.5, for the school student and the office worker, respectively. In order to quantify the enhanced emissions at critical locations and define the emission distribution in further dispersion models for traffic interrupted transport microenvironments, a composite line source emission (CLSE) model was developed to specifically quantify exposure levels and describe the spatial variability of vehicle emissions in traffic interrupted microenvironments. This model took into account the complexity of vehicle movements in the queue, as well as different emission rates relevant to various driving conditions (cruise, decelerate, idle and accelerate), and it utilised multi-representative segments to capture the accurate emission distribution for real vehicle flow. This model does not only helped to quantify the enhanced emissions at critical locations, but it also helped to define the emission source distribution of the disrupted steady flow for further dispersion modelling. The model then was applied to estimate particle number emissions at a bidirectional bus station used by diesel and compressed natural gas fuelled buses. It was found that the acceleration distance was of critical importance when estimating particle number emission, since the highest emissions occurred in sections where most of the buses were accelerating and no significant increases were observed at locations where they idled. It was also shown that emissions at the front end of the platform were 43 times greater than at the rear of the platform. The CLSE model was also applied at a signalled pedestrian crossing, in order to assess increased particle number emissions from motor vehicles when forced to stop and accelerate from rest. The CLSE model was used to calculate the total emissions produced by a specific number and mix of light petrol cars and diesel passenger buses including 1 car travelling in 1 direction (/1 direction), 14 cars / 1 direction, 1 bus / 1 direction, 28 cars / 2 directions, 24 cars and 2 buses / 2 directions, and 20 cars and 4 buses / 2 directions. It was found that the total emissions produced during stopping on a red signal were significantly higher than when the traffic moved at a steady speed. Overall, total emissions due to the interruption of the traffic increased by a factor of 13, 11, 45, 11, 41, and 43 for the above 6 cases, respectively. In summary, this PhD thesis presents the results of a comprehensive study on particle number and mass concentration, together with particle size distribution, in a bus station transport microenvironment, influenced by bus flow rates, meteorological conditions and station design. Passenger spatial-temporal exposure to bus emitted particles was also assessed according to waiting time and location along the platform, as well as the contribution of exposure at the bus station to overall daily exposure. Due to the complexity of the interrupted traffic flow within the transport microenvironments, a unique CLSE model was also developed, which is capable of quantifying emission levels at critical locations within the transport microenvironment, for the purpose of evaluating passenger exposure and conducting simulations of vehicle emission dispersion. The application of the CLSE model at a pedestrian crossing also proved its applicability and simplicity for use in a real-world transport microenvironment.

An architecture for enhanced assurance in e-health systems

Notwithstanding the obvious potential advantages of information and communications technology (ICT) in the enhanced provision of healthcare services, there are some concerns associated with integration of and access to electronic health records. A security violation in health records, such as an unauthorised disclosure or unauthorised alteration of an individual's health information, can significantly undermine both healthcare providers' and consumers' confidence and trust in e-health systems. A crisis in confidence in any national level e-health system could seriously degrade the realisation of the system's potential benefits. In response to the privacy and security requirements for the protection of health information, this research project investigated national and international e-health development activities to identify the necessary requirements for the creation of a trusted health information system architecture consistent with legislative and regulatory requirements and relevant health informatics standards. The research examined the appropriateness and sustainability of the current approaches for the protection of health information. It then proposed an architecture to facilitate the viable and sustainable enforcement of privacy and security in health information systems under the project title "Open and Trusted Health Information Systems (OTHIS)". OTHIS addresses necessary security controls to protect sensitive health information when such data is at rest, during processing and in transit with three separate and achievable security function-based concepts and modules: a) Health Informatics Application Security (HIAS); b) Health Informatics Access Control (HIAC); and c) Health Informatics Network Security (HINS). The outcome of this research is a roadmap for a viable and sustainable architecture for providing robust protection and security of health information including elucidations of three achievable security control subsystem requirements within the proposed architecture. The successful completion of two proof-of-concept prototypes demonstrated the comprehensibility, feasibility and practicality of the HIAC and HIAS models for the development and assessment of trusted health systems. Meanwhile, the OTHIS architecture has provided guidance for technical and security design appropriate to the development and implementation of trusted health information systems whilst simultaneously offering guidance for ongoing research projects. The socio-economic implications of this research can be summarised in the fact that this research embraces the need for low cost security strategies against economic realities by using open-source technologies for overall test implementation. This allows the proposed architecture to be publicly accessible, providing a platform for interoperability to meet real-world application security demands. On the whole, the OTHIS architecture sets a high level of security standard for the establishment and maintenance of both current and future health information systems. This thereby increases healthcare providers‘ and consumers‘ trust in the adoption of electronic health records to realise the associated benefits.

Temporal tracking of mineralization and transcriptional developments of shell formation during the early life history of pearl oyster Pinctada maxima

Molluscan larval ontogeny is a highly conserved process comprising three principal developmental stages. A characteristic unique to each of these stages is shell design, termed prodissoconch I, prodissoconch II and dissoconch. These shells vary in morphology, mineralogy and microstructure. The discrete temporal transitions in shell biomineralization between these larval stages are utilized in this study to investigate transcriptional involvement in several distinct biomineralization events. Scanning electron microscopy and X-ray diffraction analysis of P. maxima larvae and juveniles collected throughout post-embryonic ontogenesis, document the mineralogy and microstructure of each shelled stage as well as establishing a timeline for transitions in biomineralization. P. maxima larval samples most representative of these biomineralization distinctions and transitions were analyzed for differential gene expression on the microarray platform PmaxArray 1.0. A number of transcripts are reported as differentially expressed in correlation to the mineralization events of P. maxima larval ontogeny. Some of those isolated are known shell matrix genes while others are novel; these are discussed in relation to potential shell formation roles. This interdisciplinary investigation has linked the shell developments of P. maxima larval ontogeny with corresponding gene expression profiles, furthering the elucidation of shell biomineralization.

A temporal comparison of AltaVista Web searching

Major Web search engines, such as AltaVista, are essential tools in the quest to locate online information. This article reports research that used transaction log analysis to examine the characteristics and changes in AltaVista Web searching that occurred from 1998 to 2002. The research questions we examined are (1) What are the changes in AltaVista Web searching from 1998 to 2002? (2) What are the current characteristics of AltaVista searching, including the duration and frequency of search sessions? (3) What changes in the information needs of AltaVista users occurred between 1998 and 2002? The results of our research show (1) a move toward more interactivity with increases in session and query length, (2) with 70% of session durations at 5 minutes or less, the frequency of interaction is increasing, but it is happening very quickly, and (3) a broadening range of Web searchers' information needs, with the most frequent terms accounting for less than 1% of total term usage. We discuss the implications of these findings for the development of Web search engines. © 2005 Wiley Periodicals, Inc.