Multiple cameras for audio-visual speech recognition in an automotive environment

Audio-visualspeechrecognition, or the combination of visual lip-reading with traditional acoustic speechrecognition, has been previously shown to provide a considerable improvement over acoustic-only approaches in noisy environments, such as that present in an automotive cabin. The research presented in this paper will extend upon the established audio-visualspeechrecognition literature to show that further improvements in speechrecognition accuracy can be obtained when multiple frontal or near-frontal views of a speaker's face are available. A series of visualspeechrecognition experiments using a four-stream visual synchronous hidden Markov model (SHMM) are conducted on the four-camera AVICAR automotiveaudio-visualspeech database. We study the relative contribution between the side and central orientated cameras in improving visualspeechrecognition accuracy. Finally combination of the four visual streams with a single audio stream in a five-stream SHMM demonstrates a relative improvement of over 56% in word recognition accuracy when compared to the acoustic-only approach in the noisiest conditions of the AVICAR database.

Publishing, postage, and prizes : classic Australian children’s literature in the public eye

2012 saw the publication of competing and complementary lines of Australian “classics”: “A&R Australian Classics” (HarperCollins) and “Text Classics” (Text Publishing). While Angus and Robertson were key in establishing a canon of Australian children’s classics in the twentieth century, it was the Text Classics line which included a selection of young people’s titles in their 2013. In turn, Penguin Australia launched a selection of “Australian Children’s Classics”. In so doing, these publishers were drawing on particular literary and visual cultural traditions in Australian children’s literature. Public assertions of a particular selection of children’s books reveals not only contemporary assumptions about desirable childhood experiences but about the operation of nostalgia therein. In encouraging Australian adults to judge books by their covers, such gestures imply that Australian children may be similarly understood. Importantly, the illusion of unity, sameness, and legibility which is promised by circumscribed canons of “classic” children’s literature may well imply a desire for similarly illusory, unified, legible, “classic” childhood. This paper attends to public attempts to materialise (and legitimise) a canon of classic Australian children’s literature. In particular, it considers the ways in which publishing, postage stamps, and book awards make visible a range of children’s books, but do so in order to either fix or efface the content or meaning of the books themselves. Moving between assertions of the best books for children from the 1980s to today, and of the social values circulated within those books, this paper considers the possibilities and problematics of an Australian children’s canon.

Automatic inference of driving task demand from visual cues of emotion and attention

Sensing the mental, physical and emotional demand of a driving task is of primary importance in road safety research and for effectively designing in-vehicle information systems (IVIS). Particularly, the need of cars capable of sensing and reacting to the emotional state of the driver has been repeatedly advocated in the literature. Algorithms and sensors to identify patterns of human behavior, such as gestures, speech, eye gaze and facial expression, are becoming available by using low cost hardware: This paper presents a new system which uses surrogate measures such as facial expression (emotion) and head pose and movements (intention) to infer task difficulty in a driving situation. 11 drivers were recruited and observed in a simulated driving task that involved several pre-programmed events aimed at eliciting emotive reactions, such as being stuck behind slower vehicles, intersections and roundabouts, and potentially dangerous situations. The resulting system, combining face expressions and head pose classification, is capable of recognizing dangerous events (such as crashes and near misses) and stressful situations (e.g. intersections and way giving) that occur during the simulated drive.

Molecular Tuning of Rhodopsins for High Visual Sensitivity in Different Light Environments : Variation in Absorbance Spectrum and Opsin Sequence within and between Species

Visual pigments of different animal species must have evolved at some stage to match the prevailing light environments, since all visual functions depend on their ability to absorb available photons and transduce the event into a reliable neural signal. There is a large literature on correlation between the light environment and spectral sensitivity between different fish species. However, little work has been done on evolutionary adaptation between separated populations within species. More generally, little is known about the rate of evolutionary adaptation to changing spectral environments. The objective of this thesis is to illuminate the constraints under which the evolutionary tuning of visual pigments works as evident in: scope, tempo, available molecular routes, and signal/noise trade-offs. Aquatic environments offer Nature s own laboratories for research on visual pigment properties, as naturally occurring light environments offer an enormous range of variation in both spectral composition and intensity. The present thesis focuses on the visual pigments that serve dim-light vision in two groups of model species, teleost fishes and mysid crustaceans. The geographical emphasis is in the brackish Baltic Sea area with its well-known postglacial isolation history and its aquatic fauna of both marine and fresh-water origin. The absorbance spectrum of the (single) dim-light visual pigment were recorded by microspectrophotometry (MSP) in single rods of 26 fish species and single rhabdoms of 8 opossum shrimp populations of the genus Mysis inhabiting marine, brackish or freshwater environments. Additionally, spectral sensitivity was determined from six Mysis populations by electroretinogram (ERG) recording. The rod opsin gene was sequenced in individuals of four allopatric populations of the sand goby (Pomatoschistus minutus). Rod opsins of two other goby species were investigated as outgroups for comparison. Rod absorbance spectra of the Baltic subspecies or populations of the primarily marine species herring (Clupea harengus membras), sand goby (P. minutus), and flounder (Platichthys flesus) were long-wavelength-shifted compared to their marine populations. The spectral shifts are consistent with adaptation for improved quantum catch (QC) as well as improved signal-to-noise ratio (SNR) of vision in the Baltic light environment. Since the chromophore of the pigment was pure A1 in all cases, this has apparently been achieved by evolutionary tuning of the opsin visual pigment. By contrast, no opsin-based differences were evident between lake and sea populations of species of fresh-water origin, which can tune their pigment by varying chromophore ratios. A more detailed analysis of differences in absorbance spectra and opsin sequence between and within populations was conducted using the sand goby as model species. Four allopatric populations from the Baltic Sea (B), Swedish west coast (S), English Channel (E), and Adriatic Sea (A) were examined. Rod absorbance spectra, characterized by the wavelength of maximum absorbance (λmax), differed between populations and correlated with differences in the spectral light transmission of the respective water bodies. The greatest λmax shift as well as the greatest opsin sequence difference was between the Baltic and the Adriatic populations. The significant within-population variation of the Baltic λmax values (506-511 nm) was analyzed on the level of individuals and was shown to correlate well with opsin sequence substitutions. The sequences of individuals with λmax at shorter wavelengths were identical to that of the Swedish population, whereas those with λmax at longer wavelengths additionally had substitution F261F/Y in the sixth transmembrane helix of the protein. This substitution (Y261) was also present in the Baltic common gobies and is known to redshift spectra. The tuning mechanism of the long-wavelength type Baltic sand gobies is assumed to be the co-expression of F261 and Y261 in all rods to produce ≈ 5 nm redshift. The polymorphism of the Baltic sand goby population possibly indicates ambiguous selection pressures in the Baltic Sea. The visual pigments of all lake populations of the opossum shrimp (Mysis relicta) were red-shifted by 25 nm compared with all Baltic Sea populations. This is calculated to confer a significant advantage in both QC and SNR in many humus-rich lakes with reddish water. Since only A2 chromophore was present, the differences obviously reflect evolutionary tuning of the visual protein, the opsin. The changes have occurred within the ca. 9000 years that the lakes have been isolated from the Sea after the most recent glaciation. At present, it seems that the mechanism explaining the spectral differences between lake and sea populations is not an amino acid substitution at any other conventional tuning site, but the mechanism is yet to be found.

VISUAL OBJECT TRACKING VIA RANDOM FERNS BASED CLASSIFICATION

Designing a robust algorithm for visual object tracking has been a challenging task since many years. There are trackers in the literature that are reasonably accurate for many tracking scenarios but most of them are computationally expensive. This narrows down their applicability as many tracking applications demand real time response. In this paper, we present a tracker based on random ferns. Tracking is posed as a classification problem and classification is done using ferns. We used ferns as they rely on binary features and are extremely fast at both training and classification as compared to other classification algorithms. Our experiments show that the proposed tracker performs well on some of the most challenging tracking datasets and executes much faster than one of the state-of-the-art trackers, without much difference in tracking accuracy.

Skeleton based visual pattern recognition. Applications to tabletop interaction

211 p. :il.

Visual memory loss and autobiographical amnesia: a case study.

Amnesia typically results from trauma to the medial temporal regions that coordinate activation among the disparate areas of cortex that represent the information that make up autobiographical memories. We proposed that amnesia should also result from damage to these regions, particularly regions that subserve long-term visual memory [Rubin, D. C., & Greenberg, D. L. (1998). Visual memory-deficit amnesia: A distinct amnesic presentation and etiology. Proceedings of the National Academy of Sciences of the USA, 95, 5413-5416]. We previously found 11 such cases in the literature, and all 11 had amnesia. We now present a detailed investigation of one of these patients. M.S. suffers from long-term visual memory loss along with some semantic deficits; he also manifests a severe retrograde amnesia and moderate anterograde amnesia. The presentation of his amnesia differs from that of the typical medial-temporal or lateral-temporal amnesic; we suggest that his visual deficits may be contributing to his autobiographical amnesia.

Visual memory-deficit amnesia: a distinct amnesic presentation and etiology.

We describe a form of amnesia, which we have called visual memory-deficit amnesia, that is caused by damage to areas of the visual system that store visual information. Because it is caused by a deficit in access to stored visual material and not by an impaired ability to encode or retrieve new material, it has the otherwise infrequent properties of a more severe retrograde than anterograde amnesia with no temporal gradient in the retrograde amnesia. Of the 11 cases of long-term visual memory loss found in the literature, all had amnesia extending beyond a loss of visual memory, often including a near total loss of pretraumatic episodic memory. Of the 6 cases in which both the severity of retrograde and anterograde amnesia and the temporal gradient of the retrograde amnesia were noted, 4 had a more severe retrograde amnesia with no temporal gradient and 2 had a less severe retrograde amnesia with a temporal gradient.

Artistic proposals of visual arts of Ecuador since the second half of the twentieth century to the present

This article is the result of a research that analyzes the most important artistic proposals of Visual Arts in Ecuador, since the second half of the twentieth century to the present. Through literature review and data collection held in the city of Guayaquil, we could determine their influence and impact on the circuit of contemporary art. The instruments used for data collection were depth interviews that were done to experts in the field. Like surveys of attendees at different artistic events (exhibitions, permanent exhibitions, seminars), allowed to establish the social interests of those proposals. The methodology was mixed approach, quantitative and qualitative data were used.

Visual function and dysfunction in early and late age-related maculopathy

Late age-related maculopathy (ARM) is responsible for the majority of blind registrations in the Western world among persons over 50 years of age. It has devastating effects on quality of life and independence and is becoming a major public health concern. Current treatment options are limited and most aim to slow progression rather than restore vision; therefore, early detection to identify those patients most suitable for these interventions is essential. In this work, we review the literature encompassing the investigation of visual function in ARM in order to highlight those visual function parameters which are affected very early in the disease process. We pay particular attention to measures of acuity, contrast sensitivity (CS), cone function, electrophysiology, visual adaptation, central visual field sensitivity and metamorphopsia. We also consider the impact of bilateral late ARM on visual function as well as the relationship between measures of vision function and self-reported visual functioning. Much interest has centred on the identification of functional changes which may predict progression to neovascular disease; therefore, we outline the longitudinal studies, which to date have reported dark-adaptation time, short-wavelength cone sensitivity, colour-match area effect, dark-adapted foveal sensitivity, foveal flicker sensitivity, slow recovery from glare and slower foveal electroretinogram implicit time as functional risk factors for the development of neovascular disease. Despite progress in this area, we emphasise the need for longitudinal studies designed in light of developments in disease classification and retinal imaging, which would ensure the correct classification of cases and controls, and provide increased understanding of the natural course and progression of the disease and further elucidate the structure-function relationships in this devastating disorder.

Robust Audio-Visual Speech Recognition under Noisy Audio-Video Conditions

This paper presents the maximum weighted stream posterior (MWSP) model as a robust and efficient stream integration method for audio-visual speech recognition in environments, where the audio or video streams may be subjected to unknown and time-varying corruption. A significant advantage of MWSP is that it does not require any specific measurements of the signal in either stream to calculate appropriate stream weights during recognition, and as such it is modality-independent. This also means that MWSP complements and can be used alongside many of the other approaches that have been proposed in the literature for this problem. For evaluation we used the large XM2VTS database for speaker-independent audio-visual speech recognition. The extensive tests include both clean and corrupted utterances with corruption added in either/both the video and audio streams using a variety of types (e.g., MPEG-4 video compression) and levels of noise. The experiments show that this approach gives excellent performance in comparison to another well-known dynamic stream weighting approach and also compared to any fixed-weighted integration approach in both clean conditions or when noise is added to either stream. Furthermore, our experiments show that the MWSP approach dynamically selects suitable integration weights on a frame-by-frame basis according to the level of noise in the streams and also according to the naturally fluctuating relative reliability of the modalities even in clean conditions. The MWSP approach is shown to maintain robust recognition performance in all tested conditions, while requiring no prior knowledge about the type or level of noise.

A systematic literature review of surgical interventions for limbal stem cell deficiency in humans

PURPOSE: To evaluate the relative benefits and to identify any adverse effects of surgical interventions for limbal stem cell deficiency (LSCD).

DESIGN: Systematic literature review.

METHODS: We searched the following electronic databases from January 1, 1989 through September 30, 2006: MEDLINE, EMBASE, Science citation index, BIOSIS, and the Cochrane Library. In addition, reference lists were scanned to identify any additional reports. The quality of published reports was assessed using standard methods. The main outcome measure was improvement in vision of at least two Snellen lines of best-corrected visual acuity (BCVA). Data on adverse outcomes also were collected.

RESULTS: Twenty-six studies met the inclusion criteria. There were no randomized controlled studies. All 26 studies were either prospective or retrospective case series. For bilateral severe LSCD, keratolimbal allograft was the most common intervention with systemic immunosuppression. Other interventions included eccentric penetrating keratolimbal allografts and cultivated autologous oral mucosal epithelial grafts. An improvement in BCVA of two lines or more was reported in 31% to 67% of eyes. For unilateral severe LSCD, the most common surgical intervention was contralateral conjunctival limbal autograft, with 35% to 88% of eyes gaining an improvement in BCVA of two lines or more. The only study evaluating partial LSCD showed an improvement in BCVA of two lines or more in 39% of eyes.

CONCLUSIONS: Studies to date have not provided strong evidence to guide clinical practice on which surgery is most beneficial to treat various types of LSCD. Standardized data collection in a multicenter LSCD register is suggested.

Sample size in studies on diagnostic accuracy in ophthalmology:A literature survey

Aim: To assess the sample sizes used in studies on diagnostic accuracy in ophthalmology. Design and sources: A survey literature published in 2005. Methods: The frequency of reporting calculations of sample sizes and the samples' sizes were extracted from the published literature. A manual search of five leading clinical journals in ophthalmology with the highest impact (Investigative Ophthalmology and Visual Science, Ophthalmology, Archives of Ophthalmology, American Journal of Ophthalmology and British Journal of Ophthalmology) was conducted by two independent investigators. Results: A total of 1698 articles were identified, of which 40 studies were on diagnostic accuracy. One study reported that sample size was calculated before initiating the study. Another study reported consideration of sample size without calculation. The mean (SD) sample size of all diagnostic studies was 172.6 (218.9). The median prevalence of the target condition was 50.5%. Conclusion: Only a few studies consider sample size in their methods. Inadequate sample sizes in diagnostic accuracy studies may result in misleading estimates of test accuracy. An improvement over the current standards on the design and reporting of diagnostic studies is warranted.

The role of semantic interference in limiting memory for the details of visual scenes

Many studies suggest a large capacity memory for briefly presented pictures of whole scenes. At the same time, visual working memory (WM) of scene elements is limited to only a few items. We examined the role of retroactive interference in limiting memory for visual details. Participants viewed a scene for 5?s and then, after a short delay containing either a blank screen or 10 distracter scenes, answered questions about the location, color, and identity of objects in the scene. We found that the influence of the distracters depended on whether they were from a similar semantic domain, such as "kitchen" or "airport." Increasing the number of similar scenes reduced, and eventually eliminated, memory for scene details. Although scene memory was firmly established over the initial study period, this memory was fragile and susceptible to interference. This may help to explain the discrepancy in the literature between studies showing limited visual WM and those showing a large capacity memory for scenes.

Uniformity of visual acuity measures in published studies

PURPOSE. To investigate the methods used in contemporary ophthalmic literature to designate visual acuity (VA). METHODS. Papers in all 2005 editions of five ophthalmic journals were considered. Papers were included if (1) VA, vision, or visual function was mentioned in the abstract and (2) if the study involved age-related macular degeneration, cataract, or refractive surgery. If a paper was selected on the basis of its abstract, the full text of the paper was examined for information on the method of refractive correction during VA testing, type of chart used to measure VA, specifics concerning chart features, testing protocols, and data analysis and means of expressing VA in results. RESULTS. One hundred twenty-eight papers were included. The most common type of charts used were described as logMAR-based. Although most (89.8%) of the studies reported on the method of refractive correction during VA testing, only 58.6% gave the chart design, and less than 12% gave any information whatsoever on chart features or measurement procedures used. CONCLUSIONS. The methods used and the approach to analysis were rarely described in sufficient detail to allow others to replicate the study being reported. Sufficient detail should be given on VA measurement to enable others to duplicate the research. The authors suggest that charts adhering to Bailey-Lovie design principles always be used to measure vision in prospective studies and their use encouraged in clinical settings. The distinction between the terms logMAR, an acuity notation, and Bailey-Lovie or ETDRS as chart types should be adhered to more strictly. Copyright © Association for Research in Vision and Ophthalmology.