The use of temporal speech and lip information for multi-modal speaker identification via multi-stream HMMs

Investigates the use of temporal lip information, in conjunction with speech information, for robust, text-dependent speaker identification. We propose that significant speaker-dependent information can be obtained from moving lips, enabling speaker recognition systems to be highly robust in the presence of noise. The fusion structure for the audio and visual information is based around the use of multi-stream hidden Markov models (MSHMM), with audio and visual features forming two independent data streams. Recent work with multi-modal MSHMMs has been performed successfully for the task of speech recognition. The use of temporal lip information for speaker identification has been performed previously (T.J. Wark et al., 1998), however this has been restricted to output fusion via single-stream HMMs. We present an extension to this previous work, and show that a MSHMM is a valid structure for multi-modal speaker identification

Factors influencing health promotion activities in midlife and older Australian women with a chronic disease

Background: Chronic diseases including type 2 diabetes are a leading cause of morbidity and mortality in midlife and older Australian women. There are a number of modifiable risk factors for type 2 diabetes and other chronic diseases including smoking, nutrition, physical activity and overweight and obesity. Little research has been conducted in the Australian context to explore the perceived barriers to health promotion activities in midlife and older Australian women with a chronic disease. Aims: The primary aim of this study was to explore women’s perceived barriers to health promotion activities to reduce modifiable risk factors, and the relationship of perceived barriers to smoking behaviour, fruit and vegetable intake, physical activity and body mass index. A secondary aim of this study was to investigate nurses’ perceptions of the barriers to action for women with a chronic disease, and to compare those perceptions with those of the women. Methods: The study was divided into two phases where Phase 1 was a cross sectional survey of women, aged over 45 years with type 2 diabetes who were attending Diabetes clinics in the Primary and Community Health Service of the Metro North Health Service District of Queensland Health (N = 22). The women were a subsample of women participating in a multi-model lifestyle intervention, the ‘Reducing Chronic Disease among Adult Australian Women’ project. Phase 2 of the study was a cross sectional online survey of nurses working in Primary and Community Health Service in the Metro North Health Service District of Queensland Health (N = 46). Pender’s health promotion model was used as the theoretical framework for this study. Results: Women in this study had an average total barriers score of 32.18 (SD = 9.52) which was similar to average scores reported in the literature for women with a range of physical disabilities and illnesses. The leading five barriers for this group of women were: concern about safety; too tired; not interested; lack of information about what to do; with lack of time and feeling I can’t do things correctly the equal fifth ranked barriers. In this study there was no statistically significant difference in average total barriers scores between women in the intervention group and those is the usual care group of the parent study. There was also no significant relationship between the women’s socio-demographic variables and lifestyle risk factors and their level of perceived barriers. Nurses in the study had an average total barriers score of 44.48 (SD = 6.24) which was higher than all other average scores reported in the literature. The leading five barriers that nurses perceived were an issue for women with a chronic disease were: lack of time and interferes with other responsibilities the leading barriers; embarrassment about appearance; lack of money; too tired and lack of support from family and friends. There was no significant relationship between the nurses’ sociodemographic and nursing variables and the level of perceived barriers. When comparing the results of women and nurses in the study there was a statistically significant difference in the median total barriers score between the groups (p < 0.001), where the nurses perceived the barriers to be higher (Md = 43) than the women (Md = 33). There was also a significant difference in the responses to the individual barriers items in fifteen of the eighteen items (p < 0.002). Conclusion: Although this study is limited by a small sample size, it contributes to understanding the perception of midlife and older women with a chronic disease and also the perception of nurses, about the barriers to healthy lifestyle activities that women face. The study provides some evidence that the perceptions of women and nurses may differ and argues that these differences may have significant implications for clinical practice. The study recommends a greater emphasis on assessing and managing perceived barriers to health promotion activities in health education and policy development and proposes a conceptual model for understanding perceived barriers to action.

Determining operational measures from multi-camera surveillance systems using soft biometrics

CCTV and surveillance networks are increasingly being used for operational as well as security tasks. One emerging area of technology that lends itself to operational analytics is soft biometrics. Soft biometrics can be used to describe a person and detect them throughout a sparse multi-camera network. This enables them to be used to perform tasks such as determining the time taken to get from point to point, and the paths taken through an environment by detecting and matching people across disjoint views. However, in a busy environment where there are 100's if not 1000's of people such as an airport, attempting to monitor everyone is highly unrealistic. In this paper we propose an average soft biometric, that can be used to identity people who look distinct, and are thus suitable for monitoring through a large, sparse camera network. We demonstrate how an average soft biometric can be used to identify unique people to calculate operational measures such as the time taken to travel from point to point.

Aircraft emission reduction through multi-disciplinary flight path optimisation

There is worldwide interest in reducing aircraft emissions. The difficulty of reducing emissions including water vapour, carbon dioxide (CO2) and oxides of nitrogen (NOx) is mainly due from the fact that a commercial aircraft is usually designed for a particular optimal cruise altitude but may be requested or required to operate and deviate at different altitude and speeds to archive a desired or commanded flight plan, resulting in increased emissions. This is a multi- disciplinary problem with multiple trade-offs such as optimising engine efficiency, minimising fuel burnt, minimise emissions while maintaining aircraft separation and air safety. This project presents the coupling of an advanced optimisation technique with mathematical models and algorithms for aircraft emission reduction through flight optimisation. Numerical results show that the method is able to capture a set of useful trade-offs between aircraft range and NOx, and mission fuel consumption and NOx. In addition, alternative cruise operating conditions including Mach and altitude that produce minimum NOx and CO2 (minimum mission fuel weight) are suggested.

A study on acoustic emission signal propagation of a small size multi-cylinder diesel engine

Acoustic emission has been found effective in offering earlier fault detection and improving identification capabilities of faults. However, the sensors are inherently uncalibrated. This paper presents a source to sensor paths calibration technique which can lead to diagnosis of faults in a small size multi-cylinder diesel engine. Preliminary analysis of the acoustic emission (AE) signals is outlined, including time domain, time-frequency domain, and the root mean square (RMS) energy. The results reveal how the RMS energy of a source propagates to the adjacent sensors. The findings lead to allocate the source and estimate its inferences to the adjacent sensor, and finally help to diagnose the small size diesel engines by minimising the crosstalk from multiple cylinders.

An FPGA-based approach to multi-objective evolutionary algorithm for multi-disciplinary design optimisation

This paper investigates the field programmable gate array (FPGA) approach for multi-objective and multi-disciplinary design optimisation (MDO) problems. One class of optimisation method that has been well-studied and established for large and complex problems, such as those inherited in MDO, is multi-objective evolutionary algorithms (MOEAs). The MOEA, nondominated sorting genetic algorithm II (NSGA-II), is hardware implemented on an FPGA chip. The NSGA-II on FPGA application to multi-objective test problem suites has verified the designed implementation effectiveness. Results show that NSGA-II on FPGA is three orders of magnitude better than the PC based counterpart.

Analysis of rural activity spaces and transport disadvantage using a multi-method approach

Current knowledge about the relationship between transport disadvantage and activity space size is limited to urban areas, and as a result, very little is known about this link in a rural context. In addition, although research has identified transport disadvantaged groups based on their size of activity space, these studies have, however, not empirically explained such differences and the result is often a poor identification of the problems facing disadvantaged groups. Research has shown that transport disadvantage varies over time. The static nature of analysis using the activity space concept in previous research studies has lacked the ability to identify transport disadvantage in time. Activity space is a dynamic concept; and therefore possesses a great potential in capturing temporal variations in behaviour and access opportunities. This research derives measures of the size and fullness of activity spaces for 157 individuals for weekdays, weekends, and for a week using weekly activity-travel diary data from three case study areas located in rural Northern Ireland. Four focus groups were also conducted in order to triangulate quantitative findings and to explain the differences between different socio-spatial groups. The findings of this research show that despite having a smaller sized activity space, individuals were not disadvantaged because they were able to access their required activities locally. Car-ownership was found to be an important life line in rural areas. Temporal disaggregation of the data reveals that this is true only on weekends due to a lack of public transport services. In addition, despite activity spaces being at a similar size, the fullness of activity spaces of low-income individuals was found to be significantly lower compared to their high-income counterparts. Focus group data shows that financial constraint, poor connections both between public transport services and between transport routes and opportunities forced individuals to participate in activities located along the main transport corridors.

Coupling hybrid-game strategies with particle swarm optimisation for multi-objective high lift systems design optimisation

This paper investigates the High Lift System (HLS) application of complex aerodynamic design problem using Particle Swarm Optimisation (PSO) coupled to Game strategies. Two types of optimization methods are used; the first method is a standard PSO based on Pareto dominance and the second method hybridises PSO with a well-known Nash Game strategies named Hybrid-PSO. These optimization techniques are coupled to a pre/post processor GiD providing unstructured meshes during the optimisation procedure and a transonic analysis software PUMI. The computational efficiency and quality design obtained by PSO and Hybrid-PSO are compared. The numerical results for the multi-objective HLS design optimisation clearly shows the benefits of hybridising a PSO with the Nash game and makes promising the above methodology for solving other more complex multi-physics optimisation problems in Aeronautics.

3D ellipsoid fitting for multi-view gait recognition

Gait recognition approaches continue to struggle with challenges including view-invariance, low-resolution data, robustness to unconstrained environments, and fluctuating gait patterns due to subjects carrying goods or wearing different clothes. Although computationally expensive, model based techniques offer promise over appearance based techniques for these challenges as they gather gait features and interpret gait dynamics in skeleton form. In this paper, we propose a fast 3D ellipsoidal-based gait recognition algorithm using a 3D voxel model derived from multi-view silhouette images. This approach directly solves the limitations of view dependency and self-occlusion in existing ellipse fitting model-based approaches. Voxel models are segmented into four components (left and right legs, above and below the knee), and ellipsoids are fitted to each region using eigenvalue decomposition. Features derived from the ellipsoid parameters are modeled using a Fourier representation to retain the temporal dynamic pattern for classification. We demonstrate the proposed approach using the CMU MoBo database and show that an improvement of 15-20% can be achieved over a 2D ellipse fitting baseline.

Vibrational spectroscopy of the multi anion mineral zykaite Fe4(AsO4)(SO4)(OH)•15H2O – implications for arsenate removal

Some minerals are colloidal and are poorly diffracting . Vibrational spectroscopy offers one of the few methods for the assessment of the structure of these types of minerals. Among this group of minerals is zykaite with formula Fe4(AsO4)(SO4)(OH)•15H2O. The objective of this research is to determine the molecular structure of the mineral zykaite using vibrational spectroscopy. Raman and infrared bands are attributed to the AsO43-, SO42- and water stretching vibrations. The sharp band at 3515 cm-1 is assigned to the stretching vibration of the OH units. This mineral offers a mechanism for the formation of more crystalline minerals such as scorodite and bukovskyite. Arsenate ions can be removed from aqueous systems through the addition of ferric compounds such as ferric chloride. This results in the formation of minerals such as zykaite and pitticite (Fe3+,AsO4,SO4,H2O).

Raman spectroscopy of the multi anion mineral arsentsumebite Pb2Cu(AsO4)(SO4)(OH) and in comparison with tsumebite Pb2Cu(PO4)(SO4)(OH)

The mineral arsentsumebite Pb2Cu(AsO4)(SO4)(OH), a copper arsenate-sulfate hydroxide of the brackebuschite group has been characterised by Raman spectroscopy. The brackebuschite mineral group are a series of monoclinic arsenates, phosphates and vanadates of the general formula A2B(XO4)(OH,H2O), where A may be Ba, Ca, Pb, Sr, while B may be Al, Cu2+,Fe2+, Fe3+, Mn2+, Mn3+, Zn and XO4 may be AsO4, PO4, SO4,VO4. Bands are assigned to the stretching and bending modes of SO42- AsO43- and HOAsO3 units. Raman spectroscopy readily distinguishes between the two minerals arsentsumebite and tsumebite. Raman bands attributed to arsenate are not observed in the Raman spectrum of tsumebite. Phosphate bands found in the Raman spectrum of tsumebite are not found in the Raman spectrum of arsentsumebite. Raman spectroscopy readily distinguishes the two minerals tsumebite and arsentsumebite.

Raman spectroscopy of the multi-anion mineral mallestigite Pb3Sb5+(SO4)(AsO4)(OH)6•3H2O – a mineral of archaeological significance

Some minerals are formed which show poorly defined X-ray diffraction patterns. Vibrational spectroscopy offers one of the few methods for the assessment of the structure of the oxyanions in such minerals. Among this group of minerals is mallestigite with formula Pb3Sb5+(SO4)(AsO4)(OH)6•3H2O. The objective of this research is to determine the molecular structure of the mineral mallestigite using vibrational spectroscopy. Raman and infrared bands are attributed to the AsO43- , SO42- and water stretching vibrations. Mallestigite is a mineral formed in ancient waste dumps such as occurs at Mallestiger, Carinthia, Austria and as such is a mineral of archaeological significance.

A multi-resolution image alignment technique based on direct methods for pose estimation of aerial vehicles

In this paper, we seek to expand the use of direct methods in real-time applications by proposing a vision-based strategy for pose estimation of aerial vehicles. The vast majority of approaches make use of features to estimate motion. Conversely, the strategy we propose is based on a MR (Multi- Resolution) implementation of an image registration technique (Inverse Compositional Image Alignment ICIA) using direct methods. An on-board camera in a downwards-looking configuration, and the assumption of planar scenes, are the bases of the algorithm. The motion between frames (rotation and translation) is recovered by decomposing the frame-to-frame homography obtained by the ICIA algorithm applied to a patch that covers around the 80% of the image. When the visual estimation is required (e.g. GPS drop-out), this motion is integrated with the previous known estimation of the vehicles’ state, obtained from the on-board sensors (GPS/IMU), and the subsequent estimations are based only on the vision-based motion estimations. The proposed strategy is tested with real flight data in representative stages of a flight: cruise, landing, and take-off, being two of those stages considered critical: take-off and landing. The performance of the pose estimation strategy is analyzed by comparing it with the GPS/IMU estimations. Results show correlation between the visual estimation obtained with the MR-ICIA and the GPS/IMU data, that demonstrate that the visual estimation can be used to provide a good approximation of the vehicle’s state when it is required (e.g. GPS drop-outs). In terms of performance, the proposed strategy is able to maintain an estimation of the vehicle’s state for more than one minute, at real-time frame rates based, only on visual information.

Content-based video indexing for sports applications using integrated multi-modal approach

To sustain an ongoing rapid growth of video information, there is an emerging demand for a sophisticated content-based video indexing system. However, current video indexing solutions are still immature and lack of any standard. This doctoral consists of a research work based on an integrated multi-modal approach for sports video indexing and retrieval. By combining specific features extractable from multiple audio-visual modalities, generic structure and specific events can be detected and classified. During browsing and retrieval, users will benefit from the integration of high-level semantic and some descriptive mid-level features such as whistle and close-up view of player(s).