Multiple cameras for audio-visual speech recognition in an automotive environment

Audio-visualspeechrecognition, or the combination of visual lip-reading with traditional acoustic speechrecognition, has been previously shown to provide a considerable improvement over acoustic-only approaches in noisy environments, such as that present in an automotive cabin. The research presented in this paper will extend upon the established audio-visualspeechrecognition literature to show that further improvements in speechrecognition accuracy can be obtained when multiple frontal or near-frontal views of a speaker's face are available. A series of visualspeechrecognition experiments using a four-stream visual synchronous hidden Markov model (SHMM) are conducted on the four-camera AVICAR automotiveaudio-visualspeech database. We study the relative contribution between the side and central orientated cameras in improving visualspeechrecognition accuracy. Finally combination of the four visual streams with a single audio stream in a five-stream SHMM demonstrates a relative improvement of over 56% in word recognition accuracy when compared to the acoustic-only approach in the noisiest conditions of the AVICAR database.

Bi-objective bundle adjustment: towards large-scale visual sea-floor mapping with a minimal sensor suite

Visual sea-floor mapping is a rapidly growing application for Autonomous Underwater Vehicles (AUVs). AUVs are well-suited to the task as they remove humans from a potentially dangerous environment, can reach depths human divers cannot, and are capable of long-term operation in adverse conditions. The output of sea-floor maps generated by AUVs has a number of applications in scientific monitoring: from classifying coral in high biological value sites to surveying sea sponges to evaluate marine environment health.

Strategic aesthetics in advertising campaigns : implications for art direction education

For over half a century art directors within the advertising industry have been adapting to the changes occurring in media, culture and the corporate sector, toward enhancing professional performance and competitiveness. These professionals seldom offer explicit justification about the role images play in effective communication. It is uncertain how this situation affects advertising performance, because advertising has, nevertheless, evolved in parallel to this as an industry able to fabricate new opportunities for itself. However, uncertainties in the formalization of art direction knowledge restrict the possibilities of knowledge transfer in higher education. The theoretical knowledge supporting advertising art direction has been adapted spontaneously from disciplines that rarely focus on specific aspects related to the production of advertising content, like, for example: marketing communication, design, visual communication, or visual art. Meanwhile, in scholarly research, vast empirical knowledge has been generated about advertising images, but often with limited insight into production expertise. Because art direction is understood as an industry practice and not as an academic discipline, an art direction perspective in scholarly contributions is rare. Scholarly research that is relevant to art direction seldom offers viewpoints to help understand how it is that research outputs may specifically contribute to art direction practices. This thesis is dedicated to formally understanding the knowledge underlying art direction and using it to explore models for visual analysis and knowledge transfer in higher education. The first three chapters of this thesis offer, firstly, a review of practical and contextual aspects that help define art direction, as a profession and as a component in higher education; secondly, a discussion about visual knowledge; and thirdly, a literature review of theoretical and analytic aspects relevant to art direction knowledge. Drawing on these three chapters, this thesis establishes explicit structures to help in the development of an art direction curriculum in higher education programs. Following these chapters, this thesis explores a theoretical combination of the terms ‘aesthetics’ and ‘strategy’ as foundational notions for the study of art direction. The theoretical exploration of the term ‘strategic aesthetics’ unveils the potential for furthering knowledge in visual commercial practices in general. The empirical part of this research explores ways in which strategic aesthetics notions can extend to methodologies of visual analysis. Using a combination of content analysis and of structures of interpretive analysis offered in visual anthropology, this research discusses issues of methodological appropriation as it shifts aspects of conventional methodologies to take into consideration paradigms of research that are producer-centred. Sampled out of 2759 still ads from the online databases of Cannes Lions Festival, this study uses an instrumental case study of love-related advertising to facilitate the analysis of content. This part of the research helps understand the limitations and functionality of the theoretical and methodological framework explored in the thesis. In light of the findings and discussions produced throughout the thesis, this project aims to provide directions for higher education in relation to art direction and highlights potential pathways for further investigation of strategic aesthetics.

Global flash multifocal electroretinogram : early detection of local functional changes and its correlations with optical coherence tomography and visual field loss in diabetic eyes

Purpose: To investigate the correlations of the global flash multifocal electroretinogram (MOFO mfERG) with common clinical visual assessments – Humphrey perimetry and Stratus circumpapillary retinal nerve fiber layer (RNFL) thickness measurement in type II diabetic patients. Methods: Forty-two diabetic patients participated in the study: ten were free from diabetic retinopathy (DR) while the remainder suffered from mild to moderate non-proliferative diabetic retinopathy (NPDR). Fourteen age-matched controls were recruited for comparison. MOFO mfERG measurements were made under high and low contrast conditions. Humphrey central 30-2 perimetry and Stratus OCT circumpapillary RNFL thickness measurements were also performed. Correlations between local values of implicit time and amplitude of the mfERG components (direct component (DC) and induced component (IC)), and perimetric sensitivity and RNFL thickness were evaluated by mapping the localized responses for the three subject groups. Results: MOFO mfERG was superior to perimetry and RNFL assessments in showing differences between the diabetic groups (with and without DR) and the controls. All the MOFO mfERG amplitudes (except IC amplitude at high contrast) correlated better with perimetry findings (Pearson’s r ranged from 0.23 to 0.36, p<0.01) than did the mfERG implicit time at both high and low contrasts across all subject groups. No consistent correlation was found between the mfERG and RNFL assessments for any group or contrast conditions. The responses of the local MOFO mfERG correlated with local perimetric sensitivity but not with RNFL thickness. Conclusion: Early functional changes in the diabetic retina seem to occur before morphological changes in the RNFL.

Visual sensitivity loss in the central thirty degrees of visual field is associated with diabetic peripheral neuropathy

Aims/hypothesis: Impaired central vision has been shown to predict diabetic peripheral neuropathy (DPN). Several studies have demonstrated diffuse retinal neurodegenerative changes in diabetic patients prior to retinopathy development, raising the prospect that non-central vision may also be compromised by primary neural damage. We hypothesise that type 2 diabetic patients with DPN exhibit visual sensitivity loss in a distinctive pattern across the visual field, compared with a control group of type 2 diabetic patients without DPN. Methods: Increment light sensitivity was measured by standard perimetry in the central 30 degree of visual field for two age-matched groups of type 2 diabetic patients, with and without neuropathy (n=40/30). Neuropathy status was assigned using the neuropathy disability score. Mean visual sensitivity values were calculated globally, for each quadrant and for three eccentricities (0-10 degree , 11-20 degree and 21-30 degree ). Data were analysed using a generalised additive mixed model (GAMM). Results: Global and quadrant between-group visual sensitivity mean differences were marginally but consistently lower (by about 1 dB) in the neuropathy cohort compared with controls. Between-group mean differences increased from 0.36 to 1.81 dB with increasing eccentricity. GAMM analysis, after adjustment for age, showed these differences to be significant beyond 15 degree eccentricity and monotonically increasing. Retinopathy levels and disease duration were not significant factors within the model (p=0.90). Conclusions/interpretation: Visual sensitivity reduces disproportionately with increasing eccentricity in type 2 diabetic patients with peripheral neuropathy. This sensitivity reduction within the central 30 degree of visual field may be indicative of more consequential loss in the far periphery.

Visual servoing approach to collision avoidance for aircraft

This paper presents a reactive Sense and Avoid approach using spherical image-based visual servoing. Avoidance of point targets in the lateral or vertical plane is achieved without requiring an estimate of range. Simulated results for static and dynamic targets are provided using a realistic model of a small fixed wing unmanned aircraft.

Rotorcraft collision avoidance using spherical image-based visual servoing and single point features

This paper presents a reactive collision avoidance method for small unmanned rotorcraft using spherical image-based visual servoing. Only a single point feature is used to guide the aircraft in a safe spiral like trajectory around the target, whilst a spherical camera model ensures the target always remains visible. A decision strategy to stop the avoidance control is derived based on the properties of spiral like motion, and the effect of accurate range measurements on the control scheme is discussed. We show that using a poor range estimate does not significantly degrade the collision avoidance performance, thus relaxing the need for accurate range measurements. We present simulated and experimental results using a small quad rotor to validate the approach.

GABAergic modification of myopic and hyperopic ocular tissue effects on scleral fibroblast growth

Purpose: Myopia is a common eye disorder affecting up to 90% of children in South East Asia and 30% of the population worldwide. Myopia of high severity is a leading cause of blindness around the world (4th to 5th most common). Changes and remodelling of the sclera i.e. increase cellular proliferation & increase protein synthesis within scleral cells (↑ scleral DNA) and thinning and lose of extracellular matrix of sclera (↓ scleral GAG synthesis) have been linked to myopic eye growth in animal models. Signals acting on the sclera are thought to originate in the retina, and are modulated by the retinal pigment epithelium (RPE) with limited evidence suggesting that the RPE can modify scleral cell growth in culture. However, the mechanism of retinal signal transmission and the role of posterior eye cup tissue, including the RPE, in mediating changes in scleral fibroblast growth during myopia development are unclear. Retinal transmitter systems are critically involved in pathways regulating eye growth, which ultimately lead to alterations in the sclera if eye size is to change. A dopaminergic agonist and muscarinic antagonists decrease the proliferation of scleral chondrocytes when co-cultured with chick’s retinal pigment epithelium (RPE). GABA receptors have recently been localised to chick sclera. We therefore hypothesised that posterior eye cup tissue from myopic eyes would stimulate and from hyperopic eyes would inhibit growth of scleral fibroblasts in vitro and that GABAergic agents could directly interact with scleral cells or indirectly modify the effects of myopic and hyperopic posterior eye cup tissue on scleral fibroblast growth. Method: Fibroblastic cells obtained from 8-day-old chick sclera were used to establish cell banks. Two major experiments were performed. Experiment 1: To determine if posterior eye cup tissues from myopic eye stimulates and hyperopic eye inhibits scleral cell proliferation, when co-cultured with scleral cells in vitro. This study comprised two linked experiments, i) monocular visual treatments of FDM (form-deprivation myopia), LIM (lens-induced myopia) and LIH (lens-induced hyperopia) with assessment of the effect of full punch eye cup tissue on DNA and GAG synthesis by cultured chick scleral fibroblasts, and ii) binocular visual treatments comprising LIM and LIH with assessment of the effect of individual layers of eye cup tissues (neural retina, RPE and choroid) on cultured chick scleral fibroblasts. Visual treatment was applied for 3 days. Experiment 2: To determine the direct interaction of GABA agents on scleral cell growth and to establish whether GABA agents modify the stimulatory/inhibitory effect of myopic and hyperopic posterior eye cup tissues on cultured scleral cell growth in vitro. Two linked experiments were performed. i) GABA agonists (muscimol and baclofen) and GABA antagonists (bicuculine (-), CGP46381 and TPMPA) were added to scleral cell culture medium to determine their direct effect on scleral cells. ii) GABAergic agents (agonists and antagonists) were administered to scleral fibroblasts co-cultured with posterior eye cup tissue (retina, RPE, retina/RPE, RPE/choroid). Ocular tissues were obtained from chick eyes wearing +15D (LIH) or -15D lenses (LIM) for 3 days. In both experiments, tissues were added to hanging cell culture insert (pore size 1.0ìm) placed over each well of 24 well plates while scleral cells were cultured in DMEM/F12, Glutamax (Gibco) plus 10% FBS and penicillin/streptomycin (50U/ml)) and fungizone (1.25ug/ml) (Gibco), at seeding density of 30,000 cells/well at the bottom of the well and allowed to grow for 3 days. Scleral cells proliferation rate throughout the study was evaluated by determining GAG and DNA content of scleral cells using Dimethylmethylene blue (DMMB) dye and Quant-iTTm Pico Green® dsDNA reagent respectively. Results and analysis: Based on DNA and GAG content, there was no significant difference in tissue effect of LIM and LIH eyes on scleral fibroblast growth (DNA: 8.4 ± 1.1μg versus 9.3 ± 2.3 μg, p=0.23; GAG: 10.13 ± 1.4 μg versus 12.67 ± 1.2 μg, F2,23=6.16, p=0.0005) when tissues were obtained from monocularly treated chick eyes (FDM or +15D lens or -15D lens over right eyes with left eyes untreated) and co-cultured as full punch. When chick eyes were treated binocularly with -15D lens (LIM) right eye and +15D lens (LIH) left eyes and tissue layers were separated, the retina from LIM eyes did not stimulate scleral cell proliferation compared to LIH eyes (DNA: 27.2 ± 6.7 μg versus 23.2 ± 1.5 μg, p=0.23; GAG: 28.1 ±3.7 μg versus 28.7 ± 4.2 μg, p=0.21). Similarly, the LIH and LIM choroid did not produce a differential effect based on DNA (LIM 46.9 ± 6.4 μg versus LIH 53.5 ± 4.7 μg, p=0.18), however the choroid from LIH eyes induced higher scleral GAG content than from LIM eyes (32.5 ± 6.7 μg versus 18.9 ± 1.2 μg, p=0.023). In contrast, the RPE from LIM eyes caused a significant increase in fibroblast proliferation whereas the RPE from LIH eyes was relatively inhibitory (72.4 ± 6.3 μg versus 27.9 ± 2.3 μg, F1, 6=69.99, p=0.0005). GAG data were opposite to DNA data e.g. the RPE from LIH eyes increased (33.7 ± 7.9 μg) while the RPE from LIM eyes decreased (28.2 ± 3.0 μg) scleral cell growth (F1, 6=13.99, p=0.010). Based on DNA content, GABA agents had a small direct effect on scleral cell growth; GABA agonists increased (21.4 ± 1.0% and 18.3 ± 1.0% with muscimol and baclofen, p=0.0021), whereas GABA antagonists decreased fibroblast proliferation (-23.7 ± 0.9% with bicuculine & CGP46381 and -28.1 ± 0.5% with TPMPA, p=0.0004). GABA agents also modified the effect of LIM and LIH tissues (p=0.0005).The increase in proliferation rate of scleral fibroblasts co-cultured with tissues (RPE, retina, RPE/retina and RPE/choroid) from LIM treated eyes was enhanced by GABA agonists (muscimol: 27.4 ± 1.2%, 35.8 ± 1.6%, 8.4 ± 0.3% and 11.9 ± 0.6%; baclofen: 27.0 ± 1.0%, 15.8 ± 1.5%, 16.8 ± 1.2% and 15.4 ± 0.4%, p=0.014) whereas GABA antagonists further reduced scleral fibroblasts growth (bicuculine: -52.5 ± 2.5%, -36.9 ± 1.4%, -37.5 ± 0.6% and -53.7 ± 0.9%; TPMPA: 57.3 ± 1.3%, -15.7 ± 1.2%, -33.5 ± 0.4% and -45.9 ± 1.5%; CGP46381: -51.9 ± 1.6%, -28.5 ± 1.5%, -25.4 ± 2.0% and -45.5 ± 1.9% respectively, p=0.0034). GAG data were opposite to DNA data throughout the experiment e.g. GABA agonists further inhibited while antagonists relatively enhanced scleral fibroblasts growth for both LIM and LIH tissue co-culture. The effect of GABA agents was relatively lower (p=0.0004) for tissue from LIH versus LIM eyes but was in a similar direction. There was a significant drug effect on all four tissue types e.g. RPE, retina, RPE/retina and RPE/choroid for both LIM and LIH tissue co-culture (F20,92=3.928, p=0.0005). However, the effect of GABA agents was greatest in co-culture with RPE tissue (F18,36=4.865, p=0.0005). Summary and Conclusion: 1) Retinal defocus signals are transferred to RPE and choroid which then exert their modifying effect on scleral GAG and DNA synthesis either through growth stimulating factors or directly interacting with scleral cells in process of scleral remodeling during LIM and LIH visual conditions. 2) GABAergic agents affect the proliferation of scleral fibroblasts both directly and when co-cultured with ocular tissues in vitro.

Visual motion perception predicts driving hazard perception ability

PURPOSE: To examine the basis of previous findings of an association between indices of driving safety and visual motion sensitivity and to examine whether this association could be explained by low-level changes in visual function. METHODS: 36 visually normal participants (aged 19 – 80 years), completed a battery of standard vision tests including visual acuity, contrast sensitivity and automated visual fields. and two tests of motion perception including sensitivity for movement of a drifting Gabor stimulus, and sensitivity for displacement in a random-dot kinematogram (Dmin). Participants also completed a hazard perception test (HPT) which measured participants’ response times to hazards embedded in video recordings of real world driving which has been shown to be linked to crash risk. RESULTS: Dmin for the random-dot stimulus ranged from -0.88 to -0.12 log minutes of arc, and the minimum drift rate for the Gabor stimulus ranged from 0.01 to 0.35 cycles per second. Both measures of motion sensitivity significantly predicted response times on the HPT. In addition, while the relationship involving the HPT and motion sensitivity for the random-dot kinematogram was partially explained by the other visual function measures, the relationship with sensitivity for detection of the drifting Gabor stimulus remained significant even after controlling for these variables. CONCLUSION: These findings suggest that motion perception plays an important role in the visual perception of driving-relevant hazards independent of other areas of visual function and should be further explored as a predictive test of driving safety. Future research should explore the causes of reduced motion perception in order to develop better interventions to improve road safety.

Expression of PTRF in PC3 cells modulates cholesterol dynamics and the actin cytoskeleton impacting secretion pathways

Expression of caveolin-1 is up-regulated in prostate cancer metastasis and is associated with aggressive recurrence of the disease. Intriguingly, caveolin-1 is also secreted from prostate cancer cell lines and has been identified in secreted prostasomes. Caveolin-1 is the major structural component of the plasma membrane invaginations called caveolae. Co-expression of the coat protein Polymerase I and transcript release factor (PTRF) is required for caveolae formation. We recently found that expression of caveolin-1 in the aggressive prostate cancer cell line PC-3 is not accompanied by PTRF, leading to noncaveolar caveolin-1 lipid rafts. Moreover, ectopic expression of PTRF in PC-3 cells sequesters caveolin-1 into caveolae. Here we quantitatively analyzed the effect of PTRF expression on the PC-3 proteome using stable isotope labeling by amino acids in culture and subcellular proteomics. We show that PTRF reduced the secretion of a subset of proteins including secreted proteases, cytokines, and growth regulatory proteins, partly via a reduction in prostasome secretion. To determine the cellular mechanism accounting for the observed reduction in secreted proteins we analyzed total membrane and the detergent-resistant membrane fractions. Our data show that PTRF expression selectively impaired the recruitment of actin cytoskeletal proteins to the detergent-resistant membrane, which correlated with altered cholesterol distribution in PC-3 cells expressing PTRF. Consistent with this, modulating cellular cholesterol altered the actin cytoskeleton and protein secretion in PC-3 cells. Intriguingly, several proteins that function in ER to Golgi trafficking were reduced by PTRF expression. Taken together, these results suggest that the noncaveolar caveolin-1 found in prostate cancer cells generates a lipid raft microenvironment that accentuates secretion pathways, possibly at the step of ER sorting/exit. Importantly, these effects could be modulated by PTRF expression.

The effect of silicate ions on proliferation, osteogenic differentiation and cell signalling pathways (WNT and SHH) of bone marrow stromal cells

Silicon (Si) is a trace element, which plays an important role in human bone growth. Si has been incorporated into biomaterials for bone regeneration in order to improve their osteogenic potential, both in vitro and in vivo. Little is known, however, as to how Si ions elicit their biological response on bone-forming cells. The aim of this study was to investigate the effect of Si ions on the proliferation, differentiation, bone-related gene expression and cell signalling pathways of bone marrow stromal cells (BMSCs) by comparing the BMSC responses to different concentrations of NaCl and Na2SiO3, while taking into account and excluding the effect of Na ions. Our study showed that Si ions at a concentration of 0.625 mM significantly enhanced the proliferation, mineralization nodule formation, bone-related gene expression (OCN, OPN and ALP) and bone matrix proteins (ALP and OPN) of BMSCs. Furthermore, Si ions at 0.625 mM could counteract the effect of the WNT inhibitor (W.I.) cardamonin on the osteogenic genes expression, (OPN, OCN and ALP), WNT and SHH signalling pathway-related genes in BMSCs. These results suggest that Si ions by themselves play an important role in regulating the proliferation and osteogenic differentiation of BMSCs, with the involvement of WNT and SHH signalling pathways. Our study provides evidence to explain possible molecular mechanisms whereby Si ions released from Si-containing biomaterials can acquire enhanced bioactivity at desired concentration.

S-allylmercaptocysteine reduces carbon tetrachloride-induced hepatic oxidative stress and necroinflammation via nuclear factor kappa B-dependent pathways in mice.

Purpose To study the protective effects and underlying molecular mechanisms of SAMC on carbon tetrachloride (CCl4)-induced acute hepatotoxicity in the mouse model. Methods Mice were intraperitoneally injected with CCl4 (50 μl/kg; single dose) to induce acute hepatotoxicity with or without a 2-h pre-treatment of SAMC intraperitoneal injection (200 mg/kg; single dose). After 8 h, the blood serum and liver samples of mice were collected and subjected to measurements of histological and molecular parameters of hepatotoxicity. Results SAMC reduced CCl4-triggered cellular necrosis and inflammation in the liver under histological analysis. Since co-treatment of SAMC and CCl4 enhanced the expressions of antioxidant enzymes, reduced the nitric oxide (NO)-dependent oxidative stress, and inhibited lipid peroxidation induced by CCl4. SAMC played an essential antioxidative role during CCl4-induced hepatotoxicity. Administration of SAMC also ameliorated hepatic inflammation induced by CCl4 via inhibiting the activity of NF-κB subunits p50 and p65, thus reducing the expressions of pro-inflammatory cytokines, mediators, and chemokines, as well as promoting pro-regenerative factors at both transcriptional and translational levels. Conclusions Our results indicate that SAMC mitigates cellular damage, oxidative stress, and inflammation in CCl4-induced acute hepatotoxicity mouse model through regulation of NF-κB. Garlic or garlic derivatives may therefore be a potential food supplement in the prevention of liver damage.

A visual language for the collaborative visualization of integrated conceptual models in product development scenarios

In various industrial and scientific fields, conceptual models are derived from real world problem spaces to understand and communicate containing entities and coherencies. Abstracted models mirror the common understanding and information demand of engineers, who apply conceptual models for performing their daily tasks. However, most standardized models in Process Management, Product Lifecycle Management and Enterprise Resource Planning lack of a scientific foundation for their notation. In collaboration scenarios with stakeholders from several disciplines, tailored conceptual models complicate communication processes, as a common understanding is not shared or implemented in specific models. To support direct communication between experts from several disciplines, a visual language is developed which allows a common visualization of discipline-specific conceptual models. For visual discrimination and to overcome visual complexity issues, conceptual models are arranged in a three-dimensional space. The visual language introduced here follows and extends established principles of Visual Language science.

Visual sea-floor mapping from low overlap imagery using bi-objective bundle adjustment and constrained motion

In most visual mapping applications suited to Autonomous Underwater Vehicles (AUVs), stereo visual odometry (VO) is rarely utilised as a pose estimator as imagery is typically of very low framerate due to energy conservation and data storage requirements. This adversely affects the robustness of a vision-based pose estimator and its ability to generate a smooth trajectory. This paper presents a novel VO pipeline for low-overlap imagery from an AUV that utilises constrained motion and integrates magnetometer data in a bi-objective bundle adjustment stage to achieve low-drift pose estimates over large trajectories. We analyse the performance of a standard stereo VO algorithm and compare the results to the modified vo algorithm. Results are demonstrated in a virtual environment in addition to low-overlap imagery gathered from an AUV. The modified VO algorithm shows significantly improved pose accuracy and performance over trajectories of more than 300m. In addition, dense 3D meshes generated from the visual odometry pipeline are presented as a qualitative output of the solution.