Audiovisual citation: a project update

Existing referencing systems frequently prove inadequate for the citation of moving image and sound media such as vidcasts, streaming television, sound files, un-catalogued archive footage, amateur content hosted online or
non-broadcast radio recordings. Back in 2009 and 2010 a British working group funded by Higher Education Funding Council for England (HEFCE) and co-ordinated by the British Universities Film and Video Council investigated this problem. This report documents the early stages of the project.

Robust bimodal person identification using face and speech with limited training data and corruption of both modalities

This paper presents a novel method of audio-visual fusion for person identification where both the speech and facial modalities may be corrupted, and there is a lack of prior knowledge about the corruption. Furthermore, we assume there is a limited amount of training data for each modality (e.g., a short training speech segment and a single training facial image for each person). A new representation and a modified cosine similarity are introduced for combining and comparing bimodal features with limited training data as well as vastly differing data rates and feature sizes. Optimal feature selection and multicondition training are used to reduce the mismatch between training and testing, thereby making the system robust to unknown bimodal corruption. Experiments have been carried out on a bimodal data set created from the SPIDRE and AR databases with variable noise corruption of speech and occlusion in the face images. The new method has demonstrated improved recognition accuracy.

Cidade Museu

Through the concept of sonic resonance, the project Cidade Museu – Museum City explores five derelict or transitional spaces in the city of Viseu. The activation and capture of these spaces develops an audio- visual memory that reflects architectures, stories and experiences, while creating a sense of place through sounds and images.

The project brings together musicians with a background in contemporary music, electroacoustic music and improvisation and a visual artist focusing on photography and video.

Each member of the collective explores the selected spaces in order to activate them with the help of their respective instruments and through sound projection in an iterative process in which the source of activation gradually gives way to the characteristics of each space, their resonances and acoustic characteristics. The museum city (a nickname for the city of Viseu), in this performance, exposes the contrast between the grandeur and multi-faceted architecture of Viseu’s Cathedral with spaces that spread throughout the city waiting for a new future.

The performance in the Cathedral (Sé) is characterised by a trio ensemble, an eight channel sound system and video projecting audio recordings and images made in each of the five spaces. The audience is invited to explore the relations between the various buildings and their stories while being immersed in their resonances and visual projections.

The performance explores the following spaces in Viseu: the old Orfeão (music hall), an old wine cellar, a mansion home to the national road services, a house with its grounds in Rua Silva Gaio and an old slaughterhouse.

Visual outcomes in the subfoveal radiotherapy study:A randomized controlled trial of teletherapy for age-related macular degeneration

Objective: To determine whether teletherapy with 6-mV photons can reduce visual loss in patients with subfoveal choroidal neovascularization in age-related macular degeneration. Design: A multicenter, single-masked, randomized controlled trial of 12 Gy of external beam radiation therapy delivered to the macula of an affected eye vs observation only. Setting: Three United Kingdom-based hospital units. Participants: Patients with age-related macular degeneration, aged 60 years and older, who had subfoveal choroidal neovascularization and a visual acuity of 20/200 (logMAR 1.0) or better. Methods: Two hundred three patients were randomly assigned to radiotherapy or observation. Treatment was undertaken at designated radiotherapy centers, and patients assigned to the treatment group received a total dosage of 12 Gy of 6-mV photons in 6 fractions. Follow-up was scheduled at 3, 6, 12, and 24 months. After excluding protocol violators, the data from 199 patients were analyzed. Main Outcome Measures: The primary outcome measure was mean loss of distance visual acuity in the study eye at 12 and 24 months. Other outcome variables analyzed were near visual acuity and contrast sensitivity. The proportions of patients losing 3 or more or 6 or more lines of distance and near acuity and 0.3 or more or 0.6 or more log units of contrast sensitivity at each follow-up were also analyzed. Results: At all time points, mean distance visual acuity was better in the radiotherapy-treated group than in the control group, but the differences did not reach statistical significance. At 24 months, analysis of the proportions of patients with loss of 3 or more (moderate) (P=.08) or 6 or more (severe) (P=.29) lines of distance vision showed that fewer treated patients had severe losses, but there was no statistically significant difference between groups. For near visual acuity, although there was no evidence of treatment benefit at 12 and 24 months, a significant difference in favor of treatment was present at 6 months (P=.048). When analyzed by the proportions of patients losing 3 lines of contrast sensitivity, there was a significant difference in favor of treatment at 24 months (P=.02). No adverse retinal effects were observed during the study, but transient disturbance of the precorneal tear film was noted in treated patients. Conclusion: The results of the present trial do not support the routine clinical use of external beam radiation therapy in subjects with subfoveal choroidal neovascularization in age-related macular degeneration.

Processing of short auditory stimuli:The rapid audio sequential presentation paradigm (RASP)

Human listeners seem to be remarkably able to recognise acoustic sound sources based on timbre cues. Here we describe a psychophysical paradigm to estimate the time it takes to recognise a set of complex sounds differing only in timbre cues: both in terms of the minimum duration of the sounds and the inferred neural processing time. Listeners had to respond to the human voice while ignoring a set of distractors. All sounds were recorded from natural sources over the same pitch range and equalised to the same duration and power. In a first experiment, stimuli were gated in time with a raised-cosine window of variable duration and random onset time. A voice/non-voice (yes/no) task was used. Performance, as measured by d', remained above chance for the shortest sounds tested (2 ms); d's above 1 were observed for durations longer than or equal to 8 ms. Then, we constructed sequences of short sounds presented in rapid succession. Listeners were asked to report the presence of a single voice token that could occur at a random position within the sequence. This method is analogous to the "rapid sequential visual presentation" paradigm (RSVP), which has been used to evaluate neural processing time for images. For 500-ms sequences made of 32-ms and 16-ms sounds, d' remained above chance for presentation rates of up to 30 sounds per second. There was no effect of the pitch relation between successive sounds: identical for all sounds in the sequence or random for each sound. This implies that the task was not determined by streaming or forward masking, as both phenomena would predict better performance for the random pitch condition. Overall, the recognition of familiar sound categories such as the voice seems to be surprisingly fast, both in terms of the acoustic duration required and of the underlying neural time constants.

Impact of age, various forms of cataract, and visual acuity on whole-field scotopic sensitivity screening for glaucoma in rural Taiwan.

OBJECTIVE: To evaluate the impact of age, various forms of cataract, and visual acuity on whole-field scotopic sensitivity screening for glaucoma in a rural population. DESIGN: Clinic-based study with population-based recruitment. SETTING: Jin Shan Township near Taipei, Taiwan. SUBJECTS: Three hundred forty-six residents (ages, > or = 40 years) of Jin Shan Township. INTERVENTIONS: Whole-field scotopic testing, ophthalmoscopy with dilation of the pupils, cataract grading against photographic standards, and screening visual field testing in a random one-third subsample. MAIN OUTCOME MEASURES: Whole-field scotopic sensitivity (in decibels) and diagnostic status as a case of glaucoma, glaucoma suspect, or normal. RESULTS: Participants in Jin Shan Township did not differ significantly in the rate of blindness, low visual acuity, or family history of glaucoma from a random sample of nonrespondents. Scotopic sensitivity testing detected 100% (6/6) of subjects with open-angle glaucoma at a specificity of 80.2%. The mean +/- SE scotopic sensitivity for six subjects with open-angle glaucoma (32.78 +/- 1.51 dB) differed significantly from that of 315 normal individuals (38.51 +/- 0.22 dB), when adjusted for age and visual acuity (P = .05, t test). With linear regression modeling, factors that correlated significantly with scotopic sensitivity were intraocular pressure, screening visual field, best corrected visual acuity, presence of cortical cataract, and increasing age. CONCLUSIONS: Although cataract affects the whole-field scotopic threshold, it appears that scotopic testing may be of value in field-based screening for glaucoma.

Methodological variations in estimating apparent progressive visual field loss in clinical trials of glaucoma treatment.

OBJECTIVES:

To compare methods to estimate the incidence of visual field progression used by 3 large randomized trials of glaucoma treatment by applying these methods to a common data set of annually obtained visual field measurements of patients with glaucoma followed up for an average of 6 years.

METHODS:

The methods used by the Advanced Glaucoma Intervention Study (AGIS), the Collaborative Initial Glaucoma Treatment Study (CIGTS), and the Early Manifest Glaucoma Treatment study (EMGT) were applied to 67 eyes of 56 patients with glaucoma enrolled in a 10-year natural history study of glaucoma using Program 30-2 of the Humphrey Field Analyzer (Humphrey Instruments, San Leandro, Calif). The incidence of apparent visual field progression was estimated for each method. Extent of agreement between the methods was calculated, and time to apparent progression was compared.

RESULTS:

The proportion of patients progressing was 11%, 22%, and 23% with AGIS, CIGTS, and EMGT methods, respectively. Clinical assessment identified 23% of patients who progressed, but only half of these were also identified by CIGTS or EMGT methods. The CIGTS and the EMGT had comparable incidence rates, but only half of those identified by 1 method were also identified by the other.

CONCLUSIONS:

The EMGT and CIGTS methods produced rates of apparent progression that were twice those of the AGIS method. Although EMGT, CIGTS, and clinical assessment rates were comparable, they did not identify the same patients as having had field progression.

Causes and prevalence of visual impairment among adults in the United States.

OBJECTIVES: To estimate the cause-specific prevalence and distribution of blindness and low vision in the United States by age, race/ethnicity, and gender, and to estimate the change in these prevalence figures over the next 20 years. METHODS: Summary prevalence estimates of blindness (both according to the US definition of < or =6/60 [< or =20/200] best-corrected visual acuity in the better-seeing eye and the World Health Organization standard of < 6/120 [< 20/400]) and low vision (< 6/12 [< 20/40] best-corrected vision in the better-seeing eye) were prepared separately for black, Hispanic, and white persons in 5-year age intervals starting at 40 years. The estimated prevalences were based on recent population-based studies in the United States, Australia, and Europe. These estimates were applied to 2000 US Census data, and to projected US population figures for 2020, to estimate the number of Americans with visual impairment. Cause-specific prevalences of blindness and low vision were also estimated for the different racial/ethnic groups. RESULTS: Based on demographics from the 2000 US Census, an estimated 937 000 (0.78%) Americans older than 40 years were blind (US definition). An additional 2.4 million Americans (1.98%) had low vision. The leading cause of blindness among white persons was age-related macular degeneration (54.4% of the cases), while among black persons, cataract and glaucoma accounted for more than 60% of blindness. Cataract was the leading cause of low vision, responsible for approximately 50% of bilateral vision worse than 6/12 (20/40) among white, black, and Hispanic persons. The number of blind persons in the US is projected to increase by 70% to 1.6 million by 2020, with a similar rise projected for low vision. CONCLUSIONS: Blindness or low vision affects approximately 1 in 28 Americans older than 40 years. The specific causes of visual impairment, and especially blindness, vary greatly by race/ethnicity. The prevalence of visual disabilities will increase markedly during the next 20 years, owing largely to the aging of the US population.

Visual outcomes and astigmatism after sutureless, manual cataract extraction in rural China: study of cataract outcomes and up-take of services (SCOUTS) in the caring is hip project, report 1.

OBJECTIVE: To study the visual acuity and astigmatism of persons undergoing cataract extraction by local surgeons in rural China. METHODS: Visual acuity, keratometry, and refraction were measured 10 to 14 months postoperatively for all cataract cases during 4 months in Sanrao, China. RESULTS: Among 313 eligible subjects, 242 (77%) could be contacted, of whom 176 (73%) were examined. Of those who were examined, mean +/- SD age was 69.3 +/- 10.5 years, 66.5% were female, 35 had been operated on bilaterally at Sanrao, and 85.2% had a preoperative presenting visual acuity of 6/60 or worse. Presenting and best-corrected postoperative acuity in the eye that was operated on were 6/18 or better in 83.4% and 95.7%, respectively. Among 27 fellow eyes operated on elsewhere, 40.7% had a presenting acuity of 6/18 or better and 40.7% were blind (P < .001). Mean +/- SD postoperative astigmatism did not differ between 211 eyes that were operated on (-1.13 +/- 0.84 diopters) and 109 eyes that were not (-1.13 +/- 1.17 diopters; P = .27). Presence of operative complications (8.5%) and older age were associated with worse vision; bilateral surgery was associated with better vision. CONCLUSIONS: These results confirm the effectiveness of skill transfer in this setting, with superior outcomes to most studies in rural Asia and to eyes in this cohort operated on at other facilities.

Visual function and postoperative care after cataract surgery in rural China: study of cataract outcomes and up-take of services (SCOUTS) in the caring is hip project, report 2.

OBJECTIVE:

To study the postoperative visual function and uptake of refraction and second-eye surgery among persons undergoing cataract surgery in rural China.

METHODS:

Self-reported visual function was measured 10 to 14 months after surgery. Subjects with improvement of 2 or more lines with refraction were offered glasses, and those with significant cataract were offered second-eye surgery.

RESULTS:

Among 313 eligible subjects, 242 (77%) could be contacted; 176 (73%) of those contacted were examined. Interviewed subjects had a mean +/- SD age of 69.9 +/- 10.2 years, and 63.6% were female. The mean +/- SD visual function score was 88.4 +/- 12.3, higher than previously reported for cataract programs in rural China and significantly (P = .03) correlated with presenting vision. Forty-two percent of subjects had spectacles, more than half being reading glasses. Though 87% of subjects' vision improved with refraction, only 35% accepted prescriptions, the most common reason for refusal being lack of perceived need. Second-eye surgery was accepted by a total of 48% (85 of 176) of patients, cost being the biggest reason for refusal.

CONCLUSIONS:

Visual function was high in this cohort. Potential benefit of refraction and second-eye surgery was substantial, but uptake of services was modest. Programs to improve service uptake should focus on reading glasses and cost-reduction strategies such as tiered pricing.