Improving visual noise insensitivity in small vocabulary audio visual speech recognition applications

Visual noise insensitivity is important to audio visual speech recognition (AVSR). Visual noise can take on a number of forms such as varying frame rate, occlusion, lighting or speaker variabilities. The use of a high dimensional secondary classifier on the word likelihood scores from both the audio and video modalities is investigated for the purposes of adaptive fusion. Preliminary results are presented demonstrating performance above the catastrophic fusion boundary for our confidence measure irrespective of the type of visual noise presented to it. Our experiments were restricted to small vocabulary applications.

Speech recognition in adverse environments using lip information

The performance of automatic speech recognition systems deteriorates in the presence of noise. One known solution is to incorporate video information with an existing acoustic speech recognition system. We investigate the performance of the individual acoustic and visual sub-systems and then examine different ways in which the integration of the two systems may be performed. The system is to be implemented in real time on a Texas Instruments' TMS320C80 DSP.

Robust speaker verification via fusion of speech and lip modalities

This paper investigates the use of lip information, in conjunction with speech information, for robust speaker verification in the presence of background noise. It has been previously shown in our own work, and in the work of others, that features extracted from a speaker's moving lips hold speaker dependencies which are complementary with speech features. We demonstrate that the fusion of lip and speech information allows for a highly robust speaker verification system which outperforms the performance of either sub-system. We present a new technique for determining the weighting to be applied to each modality so as to optimize the performance of the fused system. Given a correct weighting, lip information is shown to be highly effective for reducing the false acceptance and false rejection error rates in the presence of background noise

The use of temporal speech and lip information for multi-modal speaker identification via multi-stream HMMs

Investigates the use of temporal lip information, in conjunction with speech information, for robust, text-dependent speaker identification. We propose that significant speaker-dependent information can be obtained from moving lips, enabling speaker recognition systems to be highly robust in the presence of noise. The fusion structure for the audio and visual information is based around the use of multi-stream hidden Markov models (MSHMM), with audio and visual features forming two independent data streams. Recent work with multi-modal MSHMMs has been performed successfully for the task of speech recognition. The use of temporal lip information for speaker identification has been performed previously (T.J. Wark et al., 1998), however this has been restricted to output fusion via single-stream HMMs. We present an extension to this previous work, and show that a MSHMM is a valid structure for multi-modal speaker identification

The use of speech and lip modalities for robust speaker verification under adverse conditions

Investigates the use of lip information, in conjunction with speech information, for robust speaker verification in the presence of background noise. We have previously shown (Int. Conf. on Acoustics, Speech and Signal Proc., vol. 6, pp. 3693-3696, May 1998) that features extracted from a speaker's moving lips hold speaker dependencies which are complementary with speech features. We demonstrate that the fusion of lip and speech information allows for a highly robust speaker verification system which outperforms either subsystem individually. We present a new technique for determining the weighting to be applied to each modality so as to optimize the performance of the fused system. Given a correct weighting, lip information is shown to be highly effective for reducing the false acceptance and false rejection error rates in the presence of background noise

Can audio-visual speech recognition outperform acoustically enhanced speech recognition in automotive environment?

The use of visual features in the form of lip movements to improve the performance of acoustic speech recognition has been shown to work well, particularly in noisy acoustic conditions. However, whether this technique can outperform speech recognition incorporating well-known acoustic enhancement techniques, such as spectral subtraction, or multi-channel beamforming is not known. This is an important question to be answered especially in an automotive environment, for the design of an efficient human-vehicle computer interface. We perform a variety of speech recognition experiments on a challenging automotive speech dataset and results show that synchronous HMM-based audio-visual fusion can outperform traditional single as well as multi-channel acoustic speech enhancement techniques. We also show that further improvement in recognition performance can be obtained by fusing speech-enhanced audio with the visual modality, demonstrating the complementary nature of the two robust speech recognition approaches.

Profluorescent nitroxides as sensitive probes of oxidative change and free radical reactions

This paper presents a review on the use of tethered nitroxide–fluorophore molecules as probes of oxidative change and free radical generation and reaction. The proximity of the nitroxide free radical to the fluorophore suppresses the normal fluorescence emission process. Nitroxide free radical scavenging, metabolism or redox chemistry return the system to its natural fluorescent state and so these tethered nitroxide–fluorophore molecules are described as being profluorescent. A survey of profluorescent nitroxides found in the literature is provided as well as background on the mechanism of action and applications of these compounds as fluorometric probes within the fields of biological, materials and environmental sciences.

Living characteristics of the free-radical ring-closing polymerization of diallyldimethylammonium chloride

In this communication we provide the most recent results on RAFT-mediated ring-closing polymerization of diallyldimethylammonium chloride (DADMAC). The polymerization was carried out in aqueous solution employing 2,2′-azobis(2-methylpropionamidine)-dihydrochloride as the free radical initiator and trithiocarbonate RAFT agent (2-{[(dodecylsulfanyl)carbonothioyl sulfanyl]}propanoic acid, DoPAT) as the controlling RAFT agent. The results show that – while the system is not as completely controlled as previously described – it is nevertheless possible to mediate the polymerization of DADMAC and impart some living characteristics onto the system. The initial study on the RAFT-mediated polymerization of DADMAC may have overestimated the degree of livingness within this reaction. However, it is possible – at low conversions – for some living characteristics to be observed, as the evolution of molecular weight with conversion is linear. In addition, polymers with a reasonably narrow polydispersity can be isolated.

Bending and bundling of metal-free vertically aligned ZnO nanowires due to electrostatic interaction

Bending and bundling was observed from vertically aligned arrays of ZnO nanowires with flat (0001) top surfaces, which were synthesized using a vapor-phase method without metal catalysts. Sufficient evidence was found to exclude electron-beam bombardment during scanning electron microscopy as a cause for bending and bundling. We attribute the bending and bundling to electrostatic interactions due to charged (0001) polar surfaces, and also discussed the threshold surface charge densities for the bending and bundling based on a simple cantilever-bending model. Some growth features were indicative of the operation of electrostatic interactions during the growth.

Catalyst-free growth and optical properties of vertically aligned ZnO Nanorod Arrays on Si substrates covered with thin buffer layers

Vertically aligned ZnO nanorods have been grown on silicon substrates pre-coated with thin, less than 10 nm, textured ZnO seeding layers via a vapor-solid mechanism. The ZnO seeding layers, which were essential for vertical alignment of ZnO nanorods without using any metal catalyst, were prepared by decomposing zinc acetate. The structure and the luminescence properties of the ZnO nanorods synthesized onto ZnO seeding layers were investigated and their morphologies were compared with those of single-crystalline GaN substrates and silicon substrates covered with sputtered ZnO flms. Patterning of ZnO seed layers using photolithography allowed the fabrication of patterned ZnO-nanorod arrays.

Body composition and appetite : fat-free mass (but not fat mass or BMI) is positively associated with self-determined meal size and daily energy intake in humans

The idea of body weight regulation implies that a biological mechanism exerts control over energy expenditure and food intake. This is a central tenet of energy homeostasis. However, the source and identity of the controlling mechanism have not been identified, although it is often presumed to be some long-acting signal related to body fat, such as leptin. Using a comprehensive experimental platform, we have investigated the relationship between biological and behavioural variables in two separate studies over a 12-week intervention period in obese adults (total n 92). All variables have been measured objectively and with a similar degree of scientific control and precision, including anthropometric factors, body composition, RMR and accumulative energy consumed at individual meals across the whole day. Results showed that meal size and daily energy intake (EI) were significantly correlated with fat-free mass (FFM, P values ,0·02–0·05) but not with fat mass (FM) or BMI (P values 0·11–0·45) (study 1, n 58). In study 2 (n 34), FFM (but not FM or BMI) predicted meal size and daily EI under two distinct dietary conditions (high-fat and low-fat). These data appear to indicate that, under these circumstances, some signal associated with lean mass (but not FM) exerts a determining effect over self-selected food consumption. This signal may be postulated to interact with a separate class of signals generated by FM. This finding may have implications for investigations of the molecular control of food intake and body weight and for the management of obesity.

Free convection in a triangular enclosure with fluid-saturated porous medium and internal heat generation

Unsteady natural convection inside a triangular cavity has been studied in this study. The cavity is filled with a saturated porous medium with non-isothermal left inclined wall while the bottom surface is isothermally heated and the right inclined surface is isothermally cold. An internal heat generation is also considered which is dependent of the fluid temperature. The governing equations are solved numerically by finite element method. The Prandtl number of the fluid is considered as 0.7 (air) while the aspect ratio and the Rayleigh number are considered as 0.5 and 105 respectively. The effect of the porosity of the medium and heat generation on the fluid flow and heat transfer have been presented as a form of streamlines and isotherms. The rate of heat transfer through three surfaces of the enclosure is also presented.