Learning Nonlinear Visual Processing from Natural Images

The paradigm of computational vision hypothesizes that any visual function -- such as the recognition of your grandparent -- can be replicated by computational processing of the visual input. What are these computations that the brain performs? What should or could they be? Working on the latter question, this dissertation takes the statistical approach, where the suitable computations are attempted to be learned from the natural visual data itself. In particular, we empirically study the computational processing that emerges from the statistical properties of the visual world and the constraints and objectives specified for the learning process. This thesis consists of an introduction and 7 peer-reviewed publications, where the purpose of the introduction is to illustrate the area of study to a reader who is not familiar with computational vision research. In the scope of the introduction, we will briefly overview the primary challenges to visual processing, as well as recall some of the current opinions on visual processing in the early visual systems of animals. Next, we describe the methodology we have used in our research, and discuss the presented results. We have included some additional remarks, speculations and conclusions to this discussion that were not featured in the original publications. We present the following results in the publications of this thesis. First, we empirically demonstrate that luminance and contrast are strongly dependent in natural images, contradicting previous theories suggesting that luminance and contrast were processed separately in natural systems due to their independence in the visual data. Second, we show that simple cell -like receptive fields of the primary visual cortex can be learned in the nonlinear contrast domain by maximization of independence. Further, we provide first-time reports of the emergence of conjunctive (corner-detecting) and subtractive (opponent orientation) processing due to nonlinear projection pursuit with simple objective functions related to sparseness and response energy optimization. Then, we show that attempting to extract independent components of nonlinear histogram statistics of a biologically plausible representation leads to projection directions that appear to differentiate between visual contexts. Such processing might be applicable for priming, \ie the selection and tuning of later visual processing. We continue by showing that a different kind of thresholded low-frequency priming can be learned and used to make object detection faster with little loss in accuracy. Finally, we show that in a computational object detection setting, nonlinearly gain-controlled visual features of medium complexity can be acquired sequentially as images are encountered and discarded. We present two online algorithms to perform this feature selection, and propose the idea that for artificial systems, some processing mechanisms could be selectable from the environment without optimizing the mechanisms themselves. In summary, this thesis explores learning visual processing on several levels. The learning can be understood as interplay of input data, model structures, learning objectives, and estimation algorithms. The presented work adds to the growing body of evidence showing that statistical methods can be used to acquire intuitively meaningful visual processing mechanisms. The work also presents some predictions and ideas regarding biological visual processing.

Free/Open Source Software Development : Results and Research Methods

Free and open source software development is an alternative to traditional software engineering as an approach to the development of complex software systems. It is a way of developing software based on geographically distributed teams of volunteers without apparent central plan or traditional mechanisms of coordination. The purpose of this thesis is to summarize the current knowledge about free and open source software development and explore the ways on which further understanding on it could be gained. The results of research on the field as well as the research methods are introduced and discussed. Also adapting software process metrics to the context of free and open source software development is illustrated and the possibilities to utilize them as tools to validate other research are discussed.

Evaluation of methods and applications for behavioural profiling of transgenic mice

During the last 10-15 years interest in mouse behavioural analysis has evolved considerably. The driving force is development in molecular biological techniques that allow manipulation of the mouse genome by changing the expression of genes. Therefore, with some limitations it is possible to study how genes participate in regulation of physiological functions and to create models explaining genetic contribution to various pathological conditions. The first aim of our study was to establish a framework for behavioural phenotyping of genetically modified mice. We established comprehensive battery of tests for the initial screening of mutant mice. These included tests for exploratory and locomotor activity, emotional behaviour, sensory functions, and cognitive performance. Our interest was in the behavioural patterns of common background strains used for genetic manipulations in mice. Additionally we studied the behavioural effect of sex differences, test history, and individual housing. Our findings highlight the importance of careful consideration of genetic background for analysis of mutant mice. It was evident that some backgrounds may mask or modify the behavioural phenotype of mutants and thereby lead to false positive or negative findings. Moreover, there is no universal strain that is equally suitable for all tests, and using different backgrounds allows one to address possible phenotype modifying factors. We discovered that previous experience affected performance in several tasks. The most sensitive traits were the exploratory and emotional behaviour, as well as motor and nociceptive functions. Therefore, it may be essential to repeat some of the tests in naïve animals for assuring the phenotype. Social isolation for a long time period had strong effects on exploratory behaviour, but also on learning and memory. All experiments revealed significant interactions between strain and environmental factors (test history or housing condition) indicating genotype-dependent effects of environmental manipulations. Several mutant line analyses utilize this information. For example, we studied mice overexpressing as well as those lacking extracellular matrix protein heparin-binding growth-associated molecule (HB-GAM), and mice lacking N-syndecan (a receptor for HB-GAM). All mutant mice appeared to be fertile and healthy, without any apparent neurological or sensory defects. The lack of HB-GAM and N-syndecan, however, significantly reduced the learning capacity of the mice. On the other hand, overexpression of HB-GAM resulted in facilitated learning. Moreover, HB-GAM knockout mice displayed higher anxiety-like behaviour, whereas anxiety was reduced in HB-GAM overexpressing mice. Changes in hippocampal plasticity accompanied the behavioural phenotypes. We conclude that HB-GAM and N-syndecan are involved in the modulation of synaptic plasticity in hippocampus and play a role in regulation of anxiety- and learning-related behaviour.

Synthesis of neoglycoconjugates and oligosaccharides with potential anti-Helicobacter pylori activity

The significance of carbohydrate-protein interactions in many biological phenomena is now widely acknowledged and carbohydrate based pharmaceuticals are under intensive development. The interactions between monomeric carbohydrate ligands and their receptors are usually of low affinity. To overcome this limitation natural carbohydrate ligands are often organized as multivalent structures. Therefore, artificial carbohydrate pharmaceuticals should be constructed on the same concept, as multivalent carbohydrates or glycoclusters. Infections of specific host tissues by bacteria, viruses, and fungi are among the unfavorable disease processes for which suitably designed carbohydrate inhibitors represent worthy targets. The bacterium Helicobacter pylori colonizes more than half of all people worldwide, causing gastritis, gastric ulcer, and conferring a greater risk of stomach cancer. The present medication therapy for H. pylori includes the use of antibiotics, which is associated with increasing incidence of bacterial resistance to traditional antibiotics. Therefore, the need for an alternative treatment method is urgent. In this study, four novel synthesis procedures of multivalent glycoconjugates were created. Three different scaffolds representing linear (chondroitin oligomer), cyclic (γ-cyclodextrin), and globular (dendrimer) molecules were used. Multivalent conjugates were produced using the human milk type oligosaccharides LNDFH I (Lewis-b hexasaccharide), LNnT (Galβ1-4GlcNAcβ1-3Galβ1-4Glc), and GlcNAcβ1-3Galβ1-4GlcNAcβ1-3Galβ1-4Glc all representing analogues of the tissue binding epitopes for H. pylori. The first synthetic method included the reductive amination of scaffold molecules modified to express primary amine groups, and in the case of dendrimer direct amination to scaffold molecule presenting 64 primary amine groups. The second method described a direct procedure for amidation of glycosylamine modified oligosaccharides to scaffold molecules presenting carboxyl groups. The final two methods that were created both included an oxime-linkage on linkers of different length. All the new synthetic procedures synthesized had the advantage of using unmodified reducing sugars as starting material making it easy to synthesize glycoconjugates of different specificity. In addition, the binding activity of an array of neoglycolipids to H. pylori was studied. Consequently, two new neolacto-based structures, Glcβ1-3Galβ1-4GlcNAcβ1-3Galβ1-4Glcβ1-Cer and GlcAβ1-3Galβ1-4GlcNAcβ1-3Galβ1-4Glcβ1-Cer, with binding activity toward H. pylori were discovered. Interestingly, N-methyl and N-ethyl amide modification of the GlcAβ1-3Galβ1-4GlcNAcβ1-3Galβ1-4Glcβ1-Cer glucuronic acid residue resulted in more effective H. pylori binding epitopes than the parent molecule.

Microbial activities in boreal soils: Biodegradation of organic contaminants at low temperature and ammonia oxidation

This thesis deals with the response of biodegradation of selected anthropogenic organic contaminants and natural autochthonous organic matter to low temperature in boreal surface soils. Furthermore, the thesis describes activity, diversity and population size of autotrophic ammonia-oxidizing bacteria (AOB) in a boreal soil used for landfarming of oil-refinery wastes, and presents a new approach, in which the particular AOB were enriched and cultivated in situ from the landfarming soil onto cation exchange membranes. This thesis demonstrates that rhizosphere fraction of natural forest humus soil and agricultural clay loam soil from Helsinki Metropolitan area were capable of degrading of low to moderate concentrations (0.2 50 µg cm-3) of PCP, phenanthrene and 2,4,5-TCP at temperatures realistic to boreal climate (-2.5 to +15 °C). At the low temperatures, the biodegradation of PCP, phenanthrene and 2,4,5-TCP was more effective (Q10-values from 1.6 to 7.6) in the rhizosphere fraction of the forest soil than in the agricultural soil. Q10-values of endogenous soil respiration (carbon dioxide evolution) and selected hydrolytic enzyme activities (acetate-esterase, butyrate-esterase and β-glucosidase) in acid coniferous forest soil were 1.6 to 2.8 at temperatures from -3 to +30 °C. The results indicated that the temperature dependence of decomposition of natural autochthonous soil organic matter in the studied coniferous forest was only moderate. The numbers of AOB in the landfarming (sandy clay loam) soil were determined with quantitative polymerase chain reaction (real-time PCR) and with Most Probable Number (MPN) methods, and potential ammonium oxidation activity was measured with the chlorate inhibition technique. The results indicated presence of large and active AOB populations in the heavily oil-contaminated and urea-fertilised landfarming soil. Assessment of the populations of AOB with denaturing gradient gel electrophoresis (DGGE) profiling and sequence analysis of PCR-amplified 16S rRNA genes showed that Nitrosospira-like AOB in clusters 2 and 3 were predominant in the oily landfarming soil. This observation was supported by fluorescence in situ hybridization (FISH) analysis of the AOB grown on the soil-incubated cation-exchange membranes. The results of this thesis expand the suggested importance of Nitrosospira-like AOB in terrestrial environments to include chronically oil-contaminated soils.

Microbial diversity in the municipal composting process and development of detection methods

Composting refers to aerobic degradation of organic material and is one of the main waste treatment methods used in Finland for treating separated organic waste. The composting process allows converting organic waste to a humus-like end product which can be used to increase the organic matter in agricultural soils, in gardening, or in landscaping. Microbes play a key role as degraders during the composting-process, and the microbiology of composting has been studied for decades, but there are still open questions regarding the microbiota in industrial composting processes. It is known that with the traditional, culturing-based methods only a small fraction, below 1%, of the species in a sample is normally detected. In recent years an immense diversity of bacteria, fungi and archaea has been found to occupy many different environments. Therefore the methods of characterising microbes constantly need to be developed further. In this thesis the presence of fungi and bacteria in full-scale and pilot-scale composting processes was characterised with cloning and sequencing. Several clone libraries were constructed and altogether nearly 6000 clones were sequenced. The microbial communities detected in this study were found to differ from the compost microbes observed in previous research with cultivation based methods or with molecular methods from processes of smaller scale, although there were similarities as well. The bacterial diversity was high. Based on the non-parametric coverage estimations, the number of bacterial operational taxonomic units (OTU) in certain stages of composting was over 500. Sequences similar to Lactobacillus and Acetobacteria were frequently detected in the early stages of drum composting. In tunnel stages of composting the bacterial community comprised of Bacillus, Thermoactinomyces, Actinobacteria and Lactobacillus. The fungal diversity was found to be high and phylotypes similar to yeasts were abundantly found in the full-scale drum and tunnel processes. In addition to phylotypes similar to Candida, Pichia and Geotrichum moulds from genus Thermomyces and Penicillium were observed in tunnel stages of composting. Zygomycetes were detected in the pilot-scale composting processes and in the compost piles. In some of the samples there were a few abundant phylotypes present in the clone libraries that masked the rare ones. The rare phylotypes were of interest and a method for collecting them from clone libraries for sequencing was developed. With negative selection of the abundant phylotyps the rare ones were picked from the clone libraries. Thus 41% of the clones in the studied clone libraries were sequenced. Since microbes play a central role in composting and in many other biotechnological processes, rapid methods for characterization of microbial diversity would be of value, both scientifically and commercially. Current methods, however, lack sensitivity and specificity and are therefore under development. Microarrays have been used in microbial ecology for a decade to study the presence or absence of certain microbes of interest in a multiplex manner. The sequence database collected in this thesis was used as basis for probe design and microarray development. The enzyme assisted detection method, ligation-detection-reaction (LDR) based microarray, was adapted for species-level detection of microbes characteristic of each stage of the composting process. With the use of a specially designed control probe it was established that a species specific probe can detect target DNA representing as little as 0.04% of total DNA in a sample. The developed microarray can be used to monitor composting processes or the hygienisation of the compost end product. A large compost microbe sequence dataset was collected and analysed in this thesis. The results provide valuable information on microbial community composition during industrial scale composting processes. The microarray method was developed based on the sequence database collected in this study. The method can be utilised in following the fate of interesting microbes during composting process in an extremely sensitive and specific manner. The platform for the microarray is universal and the method can easily be adapted for studying microbes from environments other than compost.

Postoperative soft tissue defects in the ankle area : The etiology and methods of reconstruction

The risk is obvious for soft tissue complications after operative treatment of the Achilles tendon, calcaneal bone or after ankle arthroplasty. Such complications after malleolar fractures are, however, seldom seen. The reason behind these complications is that the soft tissue in this region is tight and does not allow much tension to the wound area after surgery. Furthermore the area of operation may be damaged by swelling after the injury, or can be affected by peripheral vascular disease. While complications in this area are unavoidable, they can be diminished. This study attempts to highlight the possible predisposing factors leading to complications in these operations and on the other hand, to determine the solutions to solve soft tissue problems in this region. The study consists of five papers. The first article is a reprint on the soft tissue reconstruction of 25 patients after their complicated Achilles tendon surgeries were analysed. The second study reviews a series of 126 patients after having undergone an operative treatment of calcaneal bone fractures and analyses the complications and possible reasons behind them. The third part analyses a series of corrections of 35 soft tissue complications after calcaneal fracture operations. The fourth part reviews a series of 7 patients who had undergone complicated ankle arthroplasties. The last article presents a series of post operative lateral defects of the ankle treated with a less frequently used distally based peroneus brevis muscle flap and analyses the results. What can be conducted from these studies is that in general, the results after the correction of even severe soft tissue complications in the ankle region are good. For the small defects around the Achilles tendon, the local flaps are useful, but the larger defects are best treated with a free flap. We found that a long delay from trauma to surgery and a long operating time were predisposing factors that lead to soft tissue complications after operatively treated calcaneal bone fractures. The more severe the injury, the greater the risk for wound complication. Surprisingly, the long-term results after infected calcaneal osteosyntheses were acceptable and the calcaneal bone seems to tolerate chronic infections very well if the soft tissue is reconstructed successfully. Behind the complicated ankle arthroplasties, unexpectedly high number of cases experiencing arteriosclerosis of the lower extremity was found. These complications lead to ankle fusion but can be solved with a free flap if the vascularity is intact or can be reconstructed. For this reason a vascular examination of the lower extremity arteries of the patients going to ankle arthroplasty is strongly recommended. Moreover postoperative lateral malleolar wound infections which typically create lateral ankle defects can successfully be treated with a peroneus brevis muscle flap covered with a free skin graft.