Learning Nonlinear Visual Processing from Natural Images

The paradigm of computational vision hypothesizes that any visual function -- such as the recognition of your grandparent -- can be replicated by computational processing of the visual input. What are these computations that the brain performs? What should or could they be? Working on the latter question, this dissertation takes the statistical approach, where the suitable computations are attempted to be learned from the natural visual data itself. In particular, we empirically study the computational processing that emerges from the statistical properties of the visual world and the constraints and objectives specified for the learning process. This thesis consists of an introduction and 7 peer-reviewed publications, where the purpose of the introduction is to illustrate the area of study to a reader who is not familiar with computational vision research. In the scope of the introduction, we will briefly overview the primary challenges to visual processing, as well as recall some of the current opinions on visual processing in the early visual systems of animals. Next, we describe the methodology we have used in our research, and discuss the presented results. We have included some additional remarks, speculations and conclusions to this discussion that were not featured in the original publications. We present the following results in the publications of this thesis. First, we empirically demonstrate that luminance and contrast are strongly dependent in natural images, contradicting previous theories suggesting that luminance and contrast were processed separately in natural systems due to their independence in the visual data. Second, we show that simple cell -like receptive fields of the primary visual cortex can be learned in the nonlinear contrast domain by maximization of independence. Further, we provide first-time reports of the emergence of conjunctive (corner-detecting) and subtractive (opponent orientation) processing due to nonlinear projection pursuit with simple objective functions related to sparseness and response energy optimization. Then, we show that attempting to extract independent components of nonlinear histogram statistics of a biologically plausible representation leads to projection directions that appear to differentiate between visual contexts. Such processing might be applicable for priming, \ie the selection and tuning of later visual processing. We continue by showing that a different kind of thresholded low-frequency priming can be learned and used to make object detection faster with little loss in accuracy. Finally, we show that in a computational object detection setting, nonlinearly gain-controlled visual features of medium complexity can be acquired sequentially as images are encountered and discarded. We present two online algorithms to perform this feature selection, and propose the idea that for artificial systems, some processing mechanisms could be selectable from the environment without optimizing the mechanisms themselves. In summary, this thesis explores learning visual processing on several levels. The learning can be understood as interplay of input data, model structures, learning objectives, and estimation algorithms. The presented work adds to the growing body of evidence showing that statistical methods can be used to acquire intuitively meaningful visual processing mechanisms. The work also presents some predictions and ideas regarding biological visual processing.

Microarrays in the Diagnosis of Human Herpesvirus infections

Currently, there are nine known human herpesviruses and these viruses appear to have been a very common companion of humans throughout the millenia. Of human herpesviruses, herpes simplex viruses 1 and 2 (HSV-1, HSV-2), causative agents of herpes labialis and genital herpes, and varicella-zoster virus (VZV), causative agent of chicken pox, are also common causes of central nervous system (CNS) infections. In addition, human cytomegalovirus (CMV), Epstein-Barr virus (EBV) and human herpesviruses 6A, 6B, and 7 (HHV-6A, HHV-6B, HHV-7), all members of the herpesvirus family, can also be associated with encephalitis and meningitis. Accurate diagnostics and fast treatment are essential for patient recovery in CNS infections and therefore sensitive and effective diagnostic methods are needed. The aim of this thesis was to develop new potential detection methods for diagnosing of human herpesvirus infections, especially in immunocompetent patients, using the microarray technique. Therefore, methods based on microarrays were developed for simultaneous detection of HSV-1, HSV-2, VZV, CMV, EBV, HHV-6A, HHV-6B, and HHV-7 nucleic acids, and for HSV-1, HSV-2, VZV, and CMV antibodies from various clinical samples. The microarray methods developed showed potential for efficiently and accurately detecting human herpesvirus DNAs, especially in CNS infections, and for simultaneous detection of DNAs or antibodies for multiple different human herpesviruses from clinical samples. In fact, the microarray method revealed several previously unrecognized co-infections. The microarray methods developed were sensitive and provided rapid detection of human herpesvirus DNA, and therefore the method could be applied to routine diagnostics. The microarrays might also be considered as an economical tool for diagnosing human herpesvirus infections.

The visual preferences for forest regeneration and field afforestation - four case studies in Finland

The overall aim of this dissertation was to study the public's preferences for forest regeneration fellings and field afforestations, as well as to find out the relations of these preferences to landscape management instructions, to ecological healthiness, and to the contemporary theories for predicting landscape preferences. This dissertation includes four case studies in Finland, each based on the visualization of management options and surveys. Guidelines for improving the visual quality of forest regeneration and field afforestation are given based on the case studies. The results show that forest regeneration can be connected to positive images and memories when the regeneration area is small and some time has passed since the felling. Preferences may not depend only on the management alternative itself but also on the viewing distance, viewing point, and the scene in which the management options are implemented. The current Finnish forest landscape management guidelines as well as the ecological healthiness of the studied options are to a large extent compatible with the public's preferences. However, there are some discrepancies. For example, the landscape management instructions as well as ecological hypotheses suggest that the retention trees need to be left in groups, whereas people usually prefer individually located retention trees to those trees in groups. Information and psycho-evolutionary theories provide some possible explanations for people's preferences for forest regeneration and field afforestation, but the results cannot be consistently explained by these theories. The preferences of the different stakeholder groups were very similar. However, the preference ratings of the groups that make their living from forest - forest owners and forest professionals - slightly differed from those of the others. These results provide support for the assumptions that preferences are largely consistent at least within one nation, but that knowledge and a reference group may also influence preferences.

Spectral Tuning and Adaptation to Different Light Environments of Mysid Visual Pigments

In the present thesis, questions of spectral tuning, the relation of spectral and thermal properties of visual pigments, and evolutionary adaptation to different light environments were addressed using a group of small crustaceans of the genus Mysis as a model. The study was based on microspectrophotometric measurements of visual pigment absorbance spectra, electrophysiological measurements of spectral sensitivities of dark-adapted eyes, and sequencing of the opsin gene retrieved through PCR. The spectral properties were related to the spectral transmission of the respective light environments, as well as to the phylogentic histories of the species. The photoactivation energy (Ea) was estimated from temperature effects on spectral sensitivity in the long-wavelength range, and calculations were made for optimal quantum catch and optimal signal-to-noise ratio in the different light environments. The opsin amino acid sequences of spectrally characterized individuals were compared to find candidate residues for spectral tuning. The general purpose was to clarify to what extent and on what time scale adaptive evolution has driven the functional properties of (mysid) visual pigments towards optimal performance in different light environments. An ultimate goal was to find the molecular mechanisms underlying the spectral tuning and to understand the balance between evolutionary adaptation and molecular constraints. The totally consistent segregation of absorption maxima (λmax) into (shorter-wavelength) marine and (longer-wavelength) freshwater populations suggests that truly adaptive evolution is involved in tuning the visual pigment for optimal performance, driven by selection for high absolute visual sensitivity. On the other hand, the similarity in λmax and opsin sequence between several populations of freshwater M. relicta in spectrally different lakes highlights the limits to adaptation set by evolutionary history and time. A strong inverse correlation between Ea and λmax was found among all visual pigments studied in these respects, including those of M. relicta and 10 species of vertebrate pigments, and this was used to infer thermal noise. The conceptual signal-to-noise ratios thus calculated for pigments with different λmax in the Baltic Sea and Lake Pääjärvi light environments supported the notion that spectral adaptation works towards maximizing the signal-to-noise ratio rather than quantum catch as such. Judged by the shape of absorbance spectra, the visual pigments of all populations of M. relicta and M. salemaai used exclusively the A2 chromophore (3, 4-dehydroretinal). A comparison of amino acid substitutions between M. relicta and M. salemaai indicated that mysid shrimps have a small number of readily available tuning sites to shift between a shorter - and a longer -wavelength opsin. However, phylogenetic history seems to have prevented marine M. relicta from converting back to the (presumably) ancestral opsin form, and thus the more recent reinvention of marine spectral sensitivity has been accomplished by some other novel mechanism, yet to be found

Molecular Tuning of Rhodopsins for High Visual Sensitivity in Different Light Environments : Variation in Absorbance Spectrum and Opsin Sequence within and between Species

Visual pigments of different animal species must have evolved at some stage to match the prevailing light environments, since all visual functions depend on their ability to absorb available photons and transduce the event into a reliable neural signal. There is a large literature on correlation between the light environment and spectral sensitivity between different fish species. However, little work has been done on evolutionary adaptation between separated populations within species. More generally, little is known about the rate of evolutionary adaptation to changing spectral environments. The objective of this thesis is to illuminate the constraints under which the evolutionary tuning of visual pigments works as evident in: scope, tempo, available molecular routes, and signal/noise trade-offs. Aquatic environments offer Nature s own laboratories for research on visual pigment properties, as naturally occurring light environments offer an enormous range of variation in both spectral composition and intensity. The present thesis focuses on the visual pigments that serve dim-light vision in two groups of model species, teleost fishes and mysid crustaceans. The geographical emphasis is in the brackish Baltic Sea area with its well-known postglacial isolation history and its aquatic fauna of both marine and fresh-water origin. The absorbance spectrum of the (single) dim-light visual pigment were recorded by microspectrophotometry (MSP) in single rods of 26 fish species and single rhabdoms of 8 opossum shrimp populations of the genus Mysis inhabiting marine, brackish or freshwater environments. Additionally, spectral sensitivity was determined from six Mysis populations by electroretinogram (ERG) recording. The rod opsin gene was sequenced in individuals of four allopatric populations of the sand goby (Pomatoschistus minutus). Rod opsins of two other goby species were investigated as outgroups for comparison. Rod absorbance spectra of the Baltic subspecies or populations of the primarily marine species herring (Clupea harengus membras), sand goby (P. minutus), and flounder (Platichthys flesus) were long-wavelength-shifted compared to their marine populations. The spectral shifts are consistent with adaptation for improved quantum catch (QC) as well as improved signal-to-noise ratio (SNR) of vision in the Baltic light environment. Since the chromophore of the pigment was pure A1 in all cases, this has apparently been achieved by evolutionary tuning of the opsin visual pigment. By contrast, no opsin-based differences were evident between lake and sea populations of species of fresh-water origin, which can tune their pigment by varying chromophore ratios. A more detailed analysis of differences in absorbance spectra and opsin sequence between and within populations was conducted using the sand goby as model species. Four allopatric populations from the Baltic Sea (B), Swedish west coast (S), English Channel (E), and Adriatic Sea (A) were examined. Rod absorbance spectra, characterized by the wavelength of maximum absorbance (λmax), differed between populations and correlated with differences in the spectral light transmission of the respective water bodies. The greatest λmax shift as well as the greatest opsin sequence difference was between the Baltic and the Adriatic populations. The significant within-population variation of the Baltic λmax values (506-511 nm) was analyzed on the level of individuals and was shown to correlate well with opsin sequence substitutions. The sequences of individuals with λmax at shorter wavelengths were identical to that of the Swedish population, whereas those with λmax at longer wavelengths additionally had substitution F261F/Y in the sixth transmembrane helix of the protein. This substitution (Y261) was also present in the Baltic common gobies and is known to redshift spectra. The tuning mechanism of the long-wavelength type Baltic sand gobies is assumed to be the co-expression of F261 and Y261 in all rods to produce ≈ 5 nm redshift. The polymorphism of the Baltic sand goby population possibly indicates ambiguous selection pressures in the Baltic Sea. The visual pigments of all lake populations of the opossum shrimp (Mysis relicta) were red-shifted by 25 nm compared with all Baltic Sea populations. This is calculated to confer a significant advantage in both QC and SNR in many humus-rich lakes with reddish water. Since only A2 chromophore was present, the differences obviously reflect evolutionary tuning of the visual protein, the opsin. The changes have occurred within the ca. 9000 years that the lakes have been isolated from the Sea after the most recent glaciation. At present, it seems that the mechanism explaining the spectral differences between lake and sea populations is not an amino acid substitution at any other conventional tuning site, but the mechanism is yet to be found.

Risk factors for open angle glaucoma; a clinical and molecular genetic study

Glaucoma, optic neuropathy with excavation in the optic nerve head and corresponding visual field defect, is one of the leading causes for blindness worldwide. However, visual disability can often be avoided or delayed if the disease is diagnosed at an early stage. Therefore, recognising the risk factors for development and progression of glaucoma may prevent further damage. The purpose of the present study was to evaluate factors associated with visual disability caused by glaucoma and the genetic features of two risk factors, exfoliation syndrome (ES) and a positive family history of glaucoma. The present study material consisted of three study groups 1) deceased glaucoma patients from the Ekenäs practice 2) glaucoma families from the Ekenäs region and 3) population based families with and without exfoliation syndrome from Kökar Island. For the retrospective study, 106 patients with open angle glaucoma (OAG) were identified. At the last visit, 17 patients were visually impaired. Blindness induced by glaucoma was found in one or both eyes in 16 patients and in both eyes in six patients. The cumulative incidence of glaucoma caused blindness for one eye was 6% at 5 years, 9% at 10 years, and 15% at 15 years from initialising the treatment. The factors associated with blindness caused by glaucoma were an advanced stage of glaucoma at diagnosis, fluctuation in intraocular pressure during treatment, the presence of exfoliation syndrome, and poor patient compliance. A cross-sectional population based study performed in 1960-1962 on Kökar Island and the same population was followed until 2002. In total 965 subjects (530 over 50 years) have been examined at least once. The prevalence of exfoliation syndrome (ES) was 18% among subjects older than 50 years. Seventy-five of all 78 ES-positives belonged to the same extended pedigree. According to the segregation and family analysis, exfoliation syndrome seemed to be inherited as an autosomal dominant trait with reduced penetrance. The penetrance was more reduced for males, but the risk for glaucoma was higher in males than in females. To find the gene or genes associated with exfoliation syndrome, a genome wide scan was performed for 64 members (28 ES affected and 36 controls) of the Kökar pedigree. A promising result was found: the highest two-point LOD score of 3.45 (θ=0.04) in chromosome18q12.1-21.33. The presence of mutations in glaucoma genes TIGR/MYOC (myocilin) and OPTN (optineurin) was analysed in eight glaucoma families from the Ekenäs region. An inheritance pattern resembling autosomal dominant mode was detected in all these families. Primary open angle glaucoma or exfoliation glaucoma was found in 35% of 136 family members and 28% were suspected to have glaucoma. No mutations were detected in these families.

Refractive surgery for iatrogenic and congenital anisometropia and mild visual impairment

In anisometropia, the two eyes have unequal refractive power. Anisometropia is a risk factor for amblyopia. The visual deficiencies are thought to be irreversible after the first decade of life. There is, however, accumulating evidence that neural plasticity exists also in adult brains. The aim of this study was to investigate functional outcome of excimer laser refractive surgery in adult anisometropic and visually impaired patients. Additional goal was to examine changes in the primary visual cortex (V1) using multifocal functional magnetic resonance imaging (mffMRI) after laser refractive surgery. Study I comprised of 57 anisometropic patients (anisometropia of ≥3.25 diopters) and 174 isometropic myopic subjects formed the control group. A significant improvement in best-spectacle-corrected visual acuity (BSCVA) among myopic control subjects was evident 3 months postoperatively. The improvement in BSCVA was significantly slower for anisometropic patients and the improvement appeared to persist to the end of the follow-up (24 months). In study II we found that refractive surgery may be also successfully used for iathrogenic anisometropia. In Study III we evaluated mildly visually impaired adult patients after refractive surgery. There was a statistically significant improvement in BSCVA among visually impaired patients and the difference in the mean BSCVA between visually impaired patients and isometropic myopic control subjects diminished during follow-up. Study IV was a prospective follow-up trial examining the changes in the primary visual cortex after refractive surgery. Two anisometropic patients and two isometropic myopic patients were examined with a 61-region mffMRI before refractive surgery and at three, six, nine and twelve months postoperatively. In this study, a dramatic decrease in the number of active voxels in the fovea was found among anisometropic patients. The results presented in this thesis revealed that refractive surgery may be successfully used for the treatment of anisometropic adults with both congenital and iatrogenic anisometropia and for mildly visually impaired adults. The findings in conclusion strengthen our hypothesis of plastic changes in the visual cortex of adult anisometropic and mildly visually impaired patients after refractive surgery.

Essential Thrombocythaemia : Diagnosis, Prognostic Aspects, and the Outcome of Finnish patients

Essential thrombocythaemia (ET) is a myeloproliferative disease (MPD) characterized by thrombocytosis, i.e. a constant elevation of platelet count. Thrombocytosis may appear in MPDs (ET, polycythaemia vera, chronic myeloid leukaemia, myelofibrosis) and as a reactive phenomenon. The differential diagnosis of thrombocytosis is important, because the clinical course, need of therapy, and prognosis are different in patients with MPDs and in those with reactive thrombocytosis. ET patients may remain asymptomatic for years, but serious thrombohaemorrhagic and pregnancy-related complications may occur. The complications are difficult to predict. The aims of the present study were to evaluate the diagnostic findings, clinical course, and prognostic factors of ET. The present retrospective study consists of 170 ET patients. Two thirds had a platelet count < 1000 x 109/l. The diagnosis was supported by an increased number of megakaryocytes with an abnormal morphology in a bone marrow aspirate, aggregation defects in platelet function studies, and the presence of spontaneous erythroid and/or megakaryocytic colony formation in in vitro cultures of haematopoietic progenitors. About 70 % of the patients had spontaneous colony formation, while about 30 % had a normal growth pattern. Only a fifth of the patients remained asymptomatic. Half had a major thrombohaemorrhagic complication. The proportion of the patients suffering from thrombosis was as high as 45 %. About a fifth had major bleedings. Half of the patients had microvascular symptoms. Age over 60 years increased the risk of major bleedings, but the occurrence of thrombotic complications was similar in all age groups. Male gender, smoking in female patients, the presence of any spontaneous colony formation, and the presence of spontaneous megakaryocytic colony formation in younger patients were identified as risk factors for thrombosis. Pregnant ET patients had an increased risk of complications. Forty-five per cent of the pregnancies were complicated and 38 % of them ended in stillbirth. Treatment with acetylsalicylic acid alone or in combination with platelet lowering drugs improved the outcome of the pregnancy. The present findings about risk factors in ET as well as treatment outcome in the pregnancies of ET patients should be taken into account when planning treatment strategies for Finnish patients.

Preoperative visual acuity of cataract patients. Repeatability of visual acuity and refractive error measurements in clinical settings

Visual acuities at the time of referral and on the day before surgery were compared in 124 patients operated on for cataract in Vaasa Central Hospital, Finland. Preoperative visual acuity and the occurrence of ocular and general disease were compared in samples of consecutive cataract extractions performed in 1982, 1985, 1990, 1995 and 2000 in two hospitals in the Vaasa region in Finland. The repeatability and standard deviation of random measurement error in visual acuity and refractive error determination in a clinical environment in cataractous, pseudophakic and healthy eyes were estimated by re-examining visual acuity and refractive error of patients referred to cataract surgery or consultation by ophthalmic professionals. Altogether 99 eyes of 99 persons (41 cataractous, 36 pseudophakic and 22 healthy eyes) with a visual acuity range of Snellen 0.3 to 1.3 (0.52 to -0.11 logMAR) were examined. During an average waiting time of 13 months, visual acuity in the study eye decreased from 0.68 logMAR to 0.96 logMAR (from 0.2 to 0.1 in Snellen decimal values). The average decrease in vision was 0.27 logMAR per year. In the fastest quartile, visual acuity change per year was 0.75 logMAR, and in the second fastest 0.29 logMAR, the third and fourth quartiles were virtually unaffected. From 1982 to 2000, the incidence of cataract surgery increased from 1.0 to 7.2 operations per 1000 inhabitants per year in the Vaasa region. The average preoperative visual acuity in the operated eye increased by 0.85 logMAR (in decimal values from 0.03to 0.2) and in the better eye 0.27 logMAR (in decimal values from 0.23 to 0.43) over this period. The proportion of patients profoundly visually handicapped (VA in the better eye <0.1) before the operation fell from 15% to 4%, and that of patients less profoundly visually handicapped (VA in the better eye 0.1 to <0.3) from 47% to 15%. The repeatability visual acuity measurement estimated as a coefficient of repeatability for all 99 eyes was ±0.18 logMAR, and the standard deviation of measurement error was 0.06 logMAR. Eyes with the lowest visual acuity (0.3-0.45) had the largest variability, the coefficient of repeatability values being ±0.24 logMAR and eyes with a visual acuity of 0.7 or better had the smallest, ±0.12 logMAR. The repeatability of refractive error measurement was studied in the same patient material as the repeatability of visual acuity. Differences between measurements 1 and 2 were calculated as three-dimensional vector values and spherical equivalents and expressed by coefficients of repeatability. Coefficients of repeatability for all eyes for vertical, torsional and horisontal vectors were ±0.74D, ±0.34D and ±0.93D, respectively, and for spherical equivalent for all eyes ±0.74D. Eyes with lower visual acuity (0.3-0.45) had larger variability in vector and spherical equivalent values (±1.14), but the difference between visual acuity groups was not statistically significant. The difference in the mean defocus equivalent between measurements 1 and 2 was, however, significantly greater in the lower visual acuity group. If a change of ±0.5D (measured in defocus equivalents) is accepted as a basis for change of spectacles for eyes with good vision, the basis for eyes in the visual acuity range of 0.3 - 0.65 would be ±1D. Differences in repeated visual acuity measurements are partly explained by errors in refractive error measurements.