Design of an automated book reader as an assistive technology tool for blind persons

This dissertation introduces a novel automated book reader as an assistive technology tool for persons with blindness. The literature shows extensive work in the area of optical character recognition, but the current methodologies available for the automated reading of books or bound volumes remain inadequate and are severely constrained during document scanning or image acquisition processes. The goal of the book reader design is to automate and simplify the task of reading a book while providing a user-friendly environment with a realistic but affordable system design. This design responds to the main concerns of (a) providing a method of image acquisition that maintains the integrity of the source (b) overcoming optical character recognition errors created by inherent imaging issues such as curvature effects and barrel distortion, and (c) determining a suitable method for accurate recognition of characters that yields an interface with the ability to read from any open book with a high reading accuracy nearing 98%. This research endeavor focuses in its initial aim on the development of an assistive technology tool to help persons with blindness in the reading of books and other bound volumes. But its secondary and broader aim is to also find in this design the perfect platform for the digitization process of bound documentation in line with the mission of the Open Content Alliance (OCA), a nonprofit Alliance at making reading materials available in digital form. The theoretical perspective of this research relates to the mathematical developments that are made in order to resolve both the inherent distortions due to the properties of the camera lens and the anticipated distortions of the changing page curvature as one leafs through the book. This is evidenced by the significant increase of the recognition rate of characters and a high accuracy read-out through text to speech processing. This reasonably priced interface with its high performance results and its compatibility to any computer or laptop through universal serial bus connectors extends greatly the prospects for universal accessibility to documentation.

Distribution of light in the human retina under natural viewing conditions

Age-related macular degeneration (AMD) is the leading cause of blindness inAmerica. The fact that AMD wreaks most of the damage in the center of the retina raises the question of whether light, integrated over long periods, is more concentrated in the macula. A method, based on eye-tracking, was developed to measure the distribution of light in the retina under natural viewing conditions. The hypothesis was that integrated over time, retinal illumination peaked in the macula. Additionally a possible relationship between age and retinal illumination was investigated. The eye tracker superimposed the subject's gaze position on a video recorded by a scene camera. Five informed subjects were employed in feasibility tests, and 58 naïve subjects participated in 5 phases. In phase 1 the subjects viewed a gray-scale image. In phase 2, they observed a sequence of photographic images. In phase 3 they viewed a video. In phase 4, they worked on a computer; in phase 5, the subjects walked around freely. The informed subjects were instructed to gaze at bright objects in the field of view and then at dark objects. Naïve subjects were allowed to gaze freely for all phases. Using the subject's gaze coordinates, and the video provided by the scene camera, the cumulative light distribution on the retina was calculated for ∼15° around the fovea. As expected for control subjects, cumulative retinal light distributions peaked and dipped in the fovea when they gazed at bright or dark objects respectively. The light distribution maps obtained from the naïve subjects presented a tendency to peak in the macula for phases 1, 2, and 3, a consistent tendency in phase 4 and a variable tendency in phase 5. The feasibility of using an eye-tracker system to measure the distribution of light in the retina was demonstrated, thus helping to understand the role played by light exposure in the etiology of AMD. Results showed that a tendency for light to peak in the macula is a characteristic of some individuals and of certain tasks. In these situations, risk of AMD could be increased. No significant difference was observed based on age.

Using sonic enhancement to augment non-visual tabular navigation

More information is now readily available to computer users than at any time in human history; however, much of this information is often inaccessible to people with blindness or low-vision, for whom information must be presented non-visually. Currently, screen readers are able to verbalize on-screen text using text-to-speech (TTS) synthesis; however, much of this vocalization is inadequate for browsing the Internet. An auditory interface that incorporates auditory-spatial orientation was created and tested. For information that can be structured as a two-dimensional table, links can be semantically grouped as cells in a row within an auditory table, which provides a consistent structure for auditory navigation. An auditory display prototype was tested.^ Sixteen legally blind subjects participated in this research study. Results demonstrated that stereo panning was an effective technique for audio-spatially orienting non-visual navigation in a five-row, six-column HTML table as compared to a centered, stationary synthesized voice. These results were based on measuring the time- to-target (TTT), or the amount of time elapsed from the first prompting to the selection of each tabular link. Preliminary analysis of the TTT values recorded during the experiment showed that the populations did not conform to the ANOVA requirements of normality and equality of variances. Therefore, the data were transformed using the natural logarithm. The repeated-measures two-factor ANOVA results show that the logarithmically-transformed TTTs were significantly affected by the tonal variation method, F(1,15) = 6.194, p= 0.025. Similarly, the results show that the logarithmically transformed TTTs were marginally affected by the stereo spatialization method, F(1,15) = 4.240, p=0.057. The results show that the logarithmically transformed TTTs were not significantly affected by the interaction of both methods, F(1,15) = 1.381, p=0.258. These results suggest that some confusion may be caused in the subject when employing both of these methods simultaneously. The significant effect of tonal variation indicates that the effect is actually increasing the average TTT. In other words, the presence of preceding tones increases task completion time on average. The marginally-significant effect of stereo spatialization decreases the average log(TTT) from 2.405 to 2.264.^

PROTEOMIC ANALYSIS OF WOLBACHIA SYMBIOSIS WITHIN THE DROSOPHILA OVARY

Wolbachia pipientis are bacterial endosymbionts carried by millions of invertebrate species, including ~40% of insect species and some filarial nematodes. In insects, basic Wolbachia research has potential applications in controlling vector borne disease. Conversely, Wolbachia of filarial nematodes are causative agents of neglected tropical diseases such as lymphatic filariasis and African river blindness. However, remarkably little is known about how Wolbachia interact with their hosts at the molecular level. Understanding this is important to inform the basis for symbiosis and help prevent human disease. I used a high-throughput proteomics approach to study how Drosophila host cells are modified by Wolbachia infection. This analysis identified 23 Drosophila proteins that significantly changed in amount as a result of Wolbachia infection. A subset of differentially abundant host proteins were consistent with Wolbachia-associated phenotypes reported previously. This study also provides the first ever discovery-based evidence for a Wolbachia-associated change in maternal germline histone loads, which has possible implications in Rescue of a common Wolbachia-induced reproductive manipulation known as Cytoplasmic Incompatibility.

Proteomic Analysis of Wolbachia Symbiosis within the Drosophila

Wolbachia pipientis are bacterial endosymbionts of arthropods and in some filarial nematodes. Wolbachia are of particular interest because nematodeWolbachia have been shown to cause the diseases African river blindness and Lymphatic Filariasis. Doxycycline can be used to eliminate nematode Wolbachia, however, more efficient treatments are needed. Ideally, we would like to repurpose another FDA approved drug that helps to shorten treatment duration. Vitamins are one of the best classes of FDA approved compounds, generally recognized as safe. Interestingly, prior work by Serbus and colleagues found that dietary yeast, which is highly enriched in vitamins, dramatically reducesWolbachia titer in Drosophila melanogaster ovarian tissue. Imaging data indicated that the Wolbachia nucleoids were disrupted in response to yeast. This raised the possibility that yeast cells contain a bio-reactive, anti-Wolbachiacompound. Our close examination of yeast nutritional information identified which vitamins are most highly enriched in yeast. We then administered several of these to D. melanogaster, and saw that two of these led to reduced ovarianWolbachia titers, analogous to yeast-fed flies. This was especially interesting, as both vitamins are critical for functioning of the same biochemical pathway. We used retested effect of one of these vitamins in oogenesis by performing a dilution series, and achieved positive correlation from this dilution series. This opens up the avenue for clarifying the mechanism of how vitamins suppressWolbachia titer, and for testing enhancement of Doxycycline, to hopefully provide faster, more affordable treatment for millions of patients.

Proteomic Analysis of Wolbachia Symbiosis within the Drosophila

Wolbachia pipientis are bacterial endosymbionts of arthropods and in some filarial nematodes. Wolbachia are of particular interest because nematodeWolbachia have been shown to cause the diseases African river blindness and Lymphatic Filariasis. Doxycycline can be used to eliminate nematode Wolbachia, however, more efficient treatments are needed. Ideally, we would like to repurpose another FDA approved drug that helps to shorten treatment duration. Vitamins are one of the best classes of FDA approved compounds, generally recognized as safe. Interestingly, prior work by Serbus and colleagues found that dietary yeast, which is highly enriched in vitamins, dramatically reducesWolbachia titer in Drosophila melanogaster ovarian tissue. Imaging data indicated that the Wolbachia nucleoids were disrupted in response to yeast. This raised the possibility that yeast cells contain a bio-reactive, anti-Wolbachiacompound. Our close examination of yeast nutritional information identified which vitamins are most highly enriched in yeast. We then administered several of these to D. melanogaster, and saw that two of these led to reduced ovarianWolbachia titers, analogous to yeast-fed flies. This was especially interesting, as both vitamins are critical for functioning of the same biochemical pathway. We used retested effect of one of these vitamins in oogenesis by performing a dilution series, and achieved positive correlation from this dilution series. This opens up the avenue for clarifying the mechanism of how vitamins suppressWolbachia titer, and for testing enhancement of Doxycycline, to hopefully provide faster, more affordable treatment for millions of patients.

Distribution of Light in the Human Retina under Natural Viewing Conditions

Age-related macular degeneration (AMD) is the leading cause of blindness inAmerica. The fact that AMD wreaks most of the damage in the center of the retina raises the question of whether light, integrated over long periods, is more concentrated in the macula. A method, based on eye-tracking, was developed to measure the distribution of light in the retina under natural viewing conditions. The hypothesis was that integrated over time, retinal illumination peaked in the macula. Additionally a possible relationship between age and retinal illumination was investigated. The eye tracker superimposed the subject’s gaze position on a video recorded by a scene camera. Five informed subjects were employed in feasibility tests, and 58 naïve subjects participated in 5 phases. In phase 1 the subjects viewed a gray-scale image. In phase 2, they observed a sequence of photographic images. In phase 3 they viewed a video. In phase 4, they worked on a computer; in phase 5, the subjects walked around freely. The informed subjects were instructed to gaze at bright objects in the field of view and then at dark objects. Naïve subjects were allowed to gaze freely for all phases. Using the subject’s gaze coordinates, and the video provided by the scene camera, the cumulative light distribution on the retina was calculated for ~15° around the fovea. As expected for control subjects, cumulative retinal light distributions peaked and dipped in the fovea when they gazed at bright or dark objects respectively. The light distribution maps obtained from the naïve subjects presented a tendency to peak in the macula for phases 1, 2, and 3, a consistent tendency in phase 4 and a variable tendency in phase 5. The feasibility of using an eye-tracker system to measure the distribution of light in the retina was demonstrated, thus helping to understand the role played by light exposure in the etiology of AMD. Results showed that a tendency for light to peak in the macula is a characteristic of some individuals and of certain tasks. In these situations, risk of AMD could be increased. No significant difference was observed based on age.