Learning Nonlinear Visual Processing from Natural Images

The paradigm of computational vision hypothesizes that any visual function -- such as the recognition of your grandparent -- can be replicated by computational processing of the visual input. What are these computations that the brain performs? What should or could they be? Working on the latter question, this dissertation takes the statistical approach, where the suitable computations are attempted to be learned from the natural visual data itself. In particular, we empirically study the computational processing that emerges from the statistical properties of the visual world and the constraints and objectives specified for the learning process. This thesis consists of an introduction and 7 peer-reviewed publications, where the purpose of the introduction is to illustrate the area of study to a reader who is not familiar with computational vision research. In the scope of the introduction, we will briefly overview the primary challenges to visual processing, as well as recall some of the current opinions on visual processing in the early visual systems of animals. Next, we describe the methodology we have used in our research, and discuss the presented results. We have included some additional remarks, speculations and conclusions to this discussion that were not featured in the original publications. We present the following results in the publications of this thesis. First, we empirically demonstrate that luminance and contrast are strongly dependent in natural images, contradicting previous theories suggesting that luminance and contrast were processed separately in natural systems due to their independence in the visual data. Second, we show that simple cell -like receptive fields of the primary visual cortex can be learned in the nonlinear contrast domain by maximization of independence. Further, we provide first-time reports of the emergence of conjunctive (corner-detecting) and subtractive (opponent orientation) processing due to nonlinear projection pursuit with simple objective functions related to sparseness and response energy optimization. Then, we show that attempting to extract independent components of nonlinear histogram statistics of a biologically plausible representation leads to projection directions that appear to differentiate between visual contexts. Such processing might be applicable for priming, \ie the selection and tuning of later visual processing. We continue by showing that a different kind of thresholded low-frequency priming can be learned and used to make object detection faster with little loss in accuracy. Finally, we show that in a computational object detection setting, nonlinearly gain-controlled visual features of medium complexity can be acquired sequentially as images are encountered and discarded. We present two online algorithms to perform this feature selection, and propose the idea that for artificial systems, some processing mechanisms could be selectable from the environment without optimizing the mechanisms themselves. In summary, this thesis explores learning visual processing on several levels. The learning can be understood as interplay of input data, model structures, learning objectives, and estimation algorithms. The presented work adds to the growing body of evidence showing that statistical methods can be used to acquire intuitively meaningful visual processing mechanisms. The work also presents some predictions and ideas regarding biological visual processing.

Environmental effects of thermal and radioactive discharges from nuclear power plants in the boreal brackish-water conditions of the northern Baltic Sea

During recent decades, thermal and radioactive discharges from nuclear power plants into the aquatic environment have become the subject of lively debate as an ecological concern. The target of this thesis was to summarize the large quantity of results obtained in extensive monitoring programmes and studies carried out in recipient sea areas off the Finnish nuclear power plants at Loviisa and Olkiluoto during more than four decades. The Loviisa NPP is located on the coast of the Gulf of Finland and Olkiluoto NPP on that of the Bothnian Sea. The state of the Gulf of Finland is clearly more eutrophic; the nutrient concentrations in the surface water are about 1½ 2 times higher at Loviisa than at Olkiluoto, and the total phosphorus concentrations still increased in both areas (even doubled at Loviisa) between the early 1970s and 2000. Thus, it is a challenge to distinguish the local effects of thermal discharges from the general eutrophication process of the Gulf of Finland. The salinity is generally low in the brackish-water conditions of the northern Baltic Sea, being however about 1 higher at Olkiluoto than at Loviisa (the salinity of surface water varying at the latter from near to 0 in early spring to 4 6 in late autumn). Thus, many marine and fresh-water organisms live in the Loviisa area close to their limit of existence, which makes the biota sensitive to any additional stress. The characteristics of the discharge areas of the two sites differ from each other in many respects: the discharge area at Loviisa is a semi-enclosed bay in the inner archipelago, where the exchange of water is limited, while the discharge area at Olkiluoto is more open, and the exchange of water with the open Bothnian Sea is more effective. The effects of the cooling water discharged from the power plants on the temperatures in the sea were most obvious in winter. The formation of a permanent ice cover in the discharge areas has been delayed in early winter, and the break-up of the ice occurs earlier in spring. The prolonging of the growing season and the disturbance of the overwintering time, in conditions where the biota has adjusted to a distinct rest period in winter, have been the most significant biological effects of the thermal pollution. The soft-bottom macrofauna at Loviisa has deteriorated to the point of almost total extinction at many sampling stations during the past 40 years. A similar decline has been reported for the whole eastern Gulf of Finland. However, the local eutrophication process seems to have contributed into the decline of the zoobenthos in the discharge area at Loviisa. Thermal discharges have increased the production of organic matter, which again has led to more organic bottom deposits. These have in turn increased the tendency of the isolated deeps to a depletion of oxygen, and this has further caused strong remobilization of phosphorus from the bottom sediments. Phytoplankton primary production and primary production capacity doubled in the whole area between the late 1960s and the late 1990s, but started to decrease a little at the beginning of this century. The focus of the production shifted from spring to mid- and late summer. The general rise in the level of primary production was mainly due to the increase in nutrient concentrations over the whole Gulf of Finland, but the thermal discharge contributed to a stronger increase of production in the discharge area compared to that in the intake area. The eutrophication of littoral vegetation in the discharge area has been the most obvious, unambiguous and significant biological effect of the heated water. Myriophyllum spicatum, Potamogeton perfoliatus and Potamogeton pectinatus, and vigorous growths of numerous filamentous algae as their epiphytes have strongly increased in the vicinity of the cooling water outlet, where they have formed dense populations in the littoral zone in late summer. However, the strongest increase of phytobenthos has extended only to a distance of about 1 km from the outlet, i.e., the changes in vegetation have been largest in those areas that remain ice-free in winter. Similar trends were also discernible at Olkiluoto, but to a clearly smaller extent, which was due to the definitely weaker level of background eutrophy and nutrient concentrations in the Bothnian Sea, and the differing local hydrographical and biological factors prevailing in the Olkiluoto area. The level of primary production has also increased at Olkiluoto, but has remained at a clearly lower level than at Loviisa. In spite of the analogous changes observed in the macrozoobenthos, the benthic fauna has remained strong and diversified in the Olkiluoto area. Small amounts of local discharge nuclides were regularly detected in environmental samples taken from the discharge areas: tritium in seawater samples, and activation products, such as 60Co, 58Co, 54Mn, 110mAg, 51Cr, in suspended particulate matter, bottom sediments and in several indicator organisms (e.g., periphyton and Fucus vesiculosus) that effectively accumulate radioactive substances from the medium. The tritium discharges and the consequent detection frequency and concentrations of tritium in seawater were higher at Loviisa, but the concentrations of the activation products were higher at Olkiluoto, where traces of local discharge nuclides were also observed over a clearly wider area, due to the better exchange of water than at Loviisa, where local discharge nuclides were only detected outside Hästholmsfjärden Bay quite rarely and in smaller amounts. At the farthest, an insignificant trace amount (0.2 Bq kg-1 d.w.) of 60Co originating from Olkiluoto was detected in Fucus at a distance of 137 km from the power plant. Discharge nuclides from the local nuclear power plants were almost exclusively detected at the lower trophic levels of the ecosystems. Traces of local discharge nuclides were very seldom detected in fish, and even then only in very low quantities. As a consequence of the reduced discharges, the concentrations of local discharge nuclides in the environment have decreased noticeably in recent years at both Loviisa and Olkiluoto. Although the concentrations in environmental samples, and above all, the discharge data, are presented as seemingly large numbers, the radiation doses caused by them to the population and to the biota are very low, practically insignificant. The effects of the thermal discharges have been more significant, at least to the wildlife in the discharge areas of the cooling water, although the area of impact has been relatively small. The results show that the nutrient level and the exchange of water in the discharge area of a nuclear power plant are of crucial importance.

Mechanisms for alphavirus nonstructural polyprotein processing

Replication and transcription of the RNA genome of alphaviruses relies on a set of virus-encoded nonstructural proteins. They are synthesized as a long polyprotein precursor, P1234, which is cleaved at three processing sites to yield nonstructural proteins nsP1, nsP2, nsP3 and nsP4. All the four proteins function as constitutive components of the membrane-associated viral replicase. Proteolytic processing of P1234 polyprotein is precisely orchestrated and coordinates the replicase assembly and maturation. The specificity of the replicase is also controlled by proteolytic cleavages. The early replicase is composed of P123 polyprotein intermediate and nsP4. It copies the positive sense RNA genome to complementary minus-strand. Production of new plus-strands requires complete processing of the replicase. The papain-like protease residing in nsP2 is responsible for all three cleavages in P1234. This study addressed the mechanisms of proteolytic processing of the replicase polyprotein in two alphaviruses Semliki Forest virus (SFV) and Sindbis virus (SIN) representing different branches of the genus. The survey highlighted the functional relation of the alphavirus nsP2 protease to the papain-like enzymes. A new structural motif the Cys-His catalytic dyad accompanied with an aromatic residue following the catalytic His was described for nsP2 and a subset of other thiol proteases. Such an architecture of the catalytic center was named the glycine specificity motif since it was implicated in recognition of a specific Gly residue in the substrate. In particular, the presence of the motif in nsP2 makes the appearance of this amino acid at the second position upstream of the scissile bond a necessary condition for the cleavage. On top of that, there were four distinct mechanisms identified, which provide affinity for the protease and specifically direct the enzyme to different sites in the P1234 polyprotein. Three factors RNA, the central domain of nsP3 and the N-terminus of nsP2 were demonstrated to be external modulators of the nsP2 protease. Here I suggest that the basal nsP2 protease specificity is inherited from the ancestral papain-like enzyme and employs the recognition of the upstream amino acid signature in the immediate vicinity of the scissile bond. This mechanism is responsible for the efficient processing of the SFV nsP3/nsP4 junction. I propose that the same mechanism is involved in the cleavage of the nsP1/nsP2 junction of both viruses as well. However, in this case it rather serves to position the substrate, whereas the efficiency of the processing is ensured by the capability of nsP2 to cut its own N-terminus in cis. Both types of cleavages are demonstrated here to be inhibited by RNA, which is interpreted as impairing the basal papain-like recognition of the substrate. In contrast, processing of the SIN nsP3/nsP4 junction was found to be activated by RNA and additionally potentiated by the presence of the central region of nsP3 in the protease. The processing of the nsP2/nsP3 junction in both viruses occurred via another mechanism, requiring the exactly processed N-terminus of nsP2 in the protease and insensitive to RNA addition. Therefore, the three processing events in the replicase polyprotein maturation are performed via three distinct mechanisms in each of two studied alphaviruses. Distinct sets of conditions required for each cleavage ensure sequential maturation of P1234 polyprotein: nsP4 is released first, then the nsP1/nsP2 site is cut in cis, and liberation of the nsP2 N-terminus activates the cleavage of the nsP2/nsP3 junction at last. The first processing event occurs differently in SFV and SIN, whereas the subsequent cleavages are found to be similar in the two viruses and therefore, their mechanisms are suggested to be conserved in the genus. The RNA modulation of the alphavirus nonstructural protease activity, discovered here, implies bidirectional functional interplay between the alphavirus RNA metabolism and protease regulation. The nsP2 protease emerges as a signal transmitting moiety, which senses the replication stage and responds with proteolytic cleavages. A detailed hypothetical model of the alphavirus replicase core was inferred from the data obtained in the study. Similar principles in replicase organization and protease functioning are expected to be employed by other RNA viruses.

Tactile processing in human somatosensory and auditory cortices

Tactile sensation plays an important role in everyday life. While the somatosensory system has been studied extensively, the majority of information has come from studies using animal models. Recent development of high-resolution anatomical and functional imaging techniques has enabled the non-invasive study of human somatosensory cortex and thalamus. This thesis provides new insights into the functional organization of the human brain areas involved in tactile processing using magnetoencephalography (MEG) and functional magnetic resonance imaging (fMRI). The thesis also demonstrates certain optimizations of MEG and fMRI methods. Tactile digit stimulation elicited stimulus-specific responses in a number of brain areas. Contralateral activation was observed in somatosensory thalamus (Study II), primary somatosensory cortex (SI; I, III, IV), and post-auditory belt area (III). Bilateral activation was observed in secondary somatosensory cortex (SII; II, III, IV). Ipsilateral activation was found in the post-central gyrus (area 2 of SI cortex; IV). In addition, phasic deactivation was observed within ipsilateral SI cortex and bilateral primary motor cortex (IV). Detailed investigation of the tactile responses demonstrated that the arrangement of distal-proximal finger representations in area 3b of SI in humans is similar to that found in monkeys (I). An optimized MEG approach was sufficient to resolve such fine detail in functional organization. The SII region appeared to contain double representations for fingers and toes (II). The detection of activations in the SII region and thalamus improved at the individual and group levels when cardiac-gated fMRI was used (II). Better detection of body part representations at the individual level is an important improvement, because identification of individual representations is crucial for studying brain plasticity in somatosensory areas. The posterior auditory belt area demonstrated responses to both auditory and tactile stimuli (III), implicating this area as a physiological substrate for the auditory-tactile interaction observed in earlier psychophysical studies. Comparison of different smoothing parameters (III) demonstrated that proper evaluation of co-activation should be based on individual subject analysis with minimal or no smoothing. Tactile input consistently influenced area 3b of the human ipsilateral SI cortex (IV). The observed phasic negative fMRI response is proposed to result from interhemispheric inhibition via trans-callosal connections. This thesis contributes to a growing body of human data suggesting that processing of tactile stimuli involves multiple brain areas, with different spatial patterns of cortical activation for different stimuli.

Non-enzymatic Degradation of (1→3)(1→4)-β-D-glucan in Aqueous Processing of Oats

Cereal water-soluble β-glucan [(1→3)(1→4)-β-D-glucan] has well-evidenced health benefits and it contributes to the texture properties of foods. These functions are characteristically dependent on the excellent viscosity forming ability of this cell wall polysaccharide. The viscosity is affected by the molar mass, solubility and conformation of β-glucan molecule, which are further known to be altered during food processing. This study focused on demonstrating the degradation of β-glucan in water solutions following the addition of ascorbic acid, during heat treatments or high pressure homogenisation. Furthermore, the motivation of this study was in the non-enzymatic degradation mechanisms, particularly in oxidative cleavage via hydroxyl radicals. The addition of ascorbic acid at food-related concentrations (2-50 mM), autoclaving (120°C) treatments, and high pressure homogenisation (300-1000 bar) considerably cleaved the β-glucan chains, determined as a steep decrease in the viscosity of β-glucan solutions and decrease in the molar mass of β-glucan. The cleavage was more intense in a solution of native β-glucan with co-extracted compounds than in a solution of highly purified β-glucan. Despite the clear and immediate process-related degradation, β-glucan was less sensitive to these treatments compared to other water-soluble polysaccharides previously reported in the literature. In particular, the highly purified β-glucan was relatively resistant to the autoclaving treatments without the addition of ferrous ions. The formation of highly oxidative free radicals was detected at the elevated temperatures, and the formation was considerably accelerated by added ferrous ions. Also ascorbic acid pronounced the formation of these oxidative radicals, and oxygen was simultaneously consumed by ascorbic acid addition and by heating the β-glucan solutions. These results demonstrated the occurrence of oxidative reactions, most likely the metal catalysed Fenton-like reactions, in the β-glucan solutions during these processes. Furthermore, oxidized functional groups (carbonyls) were formed along the β-glucan chain by the treatments, including high pressure homogenisation, evidencing the oxidation of β-glucan by these treatments. The degradative forces acting on the particles in the high pressure homogenisation are generally considered to be the mechanical shear, but as shown here, carbohydrates are also easily degraded during the process, and oxidation may have a role in the modification of polysaccharides by this technique. In the present study, oat β-glucan was demonstrated to be susceptible to degradation during aqueous processing by non-enzymatic degradation mechanisms. Oxidation was for the first time shown to be a highly relevant degradation mechanism of β-glucan in food processing.

Local systems, global impacts : Using life cycle assessment to analyse the potential and constraints of industrial symbioses

Human activities extract and displace different substances and materials from the earth s crust, thus causing various environmental problems, such as climate change, acidification and eutrophication. As problems have become more complicated, more holistic measures that consider the origins and sources of pollutants have been called for. Industrial ecology is a field of science that forms a comprehensive framework for studying the interactions between the modern technological society and the environment. Industrial ecology considers humans and their technologies to be part of the natural environment, not separate from it. Industrial operations form natural systems that must also function as such within the constraints set by the biosphere. Industrial symbiosis (IS) is a central concept of industrial ecology. Industrial symbiosis studies look at the physical flows of materials and energy in local industrial systems. In an ideal IS, waste material and energy are exchanged by the actors of the system, thereby reducing the consumption of virgin material and energy inputs and the generation of waste and emissions. Companies are seen as part of the chains of suppliers and consumers that resemble those of natural ecosystems. The aim of this study was to analyse the environmental performance of an industrial symbiosis based on pulp and paper production, taking into account life cycle impacts as well. Life Cycle Assessment (LCA) is a tool for quantitatively and systematically evaluating the environmental aspects of a product, technology or service throughout its whole life cycle. Moreover, the Natural Step Sustainability Principles formed a conceptual framework for assessing the environmental performance of the case study symbiosis (Paper I). The environmental performance of the case study symbiosis was compared to four counterfactual reference scenarios in which the actors of the symbiosis operated on their own. The research methods used were process-based life cycle assessment (LCA) (Papers II and III) and hybrid LCA, which combines both process and input-output LCA (Paper IV). The results showed that the environmental impacts caused by the extraction and processing of the materials and the energy used by the symbiosis were considerable. If only the direct emissions and resource use of the symbiosis had been considered, less than half of the total environmental impacts of the system would have been taken into account. When the results were compared with the counterfactual reference scenarios, the net environmental impacts of the symbiosis were smaller than those of the reference scenarios. The reduction in environmental impacts was mainly due to changes in the way energy was produced. However, the results are sensitive to the way the reference scenarios are defined. LCA is a useful tool for assessing the overall environmental performance of industrial symbioses. It is recommended that in addition to the direct effects, the upstream impacts should be taken into account as well when assessing the environmental performance of industrial symbioses. Industrial symbiosis should be seen as part of the process of improving the environmental performance of a system. In some cases, it may be more efficient, from an environmental point of view, to focus on supply chain management instead.  

Toxicant distributions and impact models in environmental risk analysis of waste sites

Myrkyllisten aineiden jakaumat ja vaikutusmallit jätealueiden ympäristöriskien analyysissä.

Interfacial Phenomena in Pharmaceutical Low Moisture Content Powder Processing

Powders are essential materials in the pharmaceutical industry, being involved in majority of all drug manufacturing. Powder flow and particle size are central particle properties addressed by means of particle engineering. The aim of the thesis was to gain knowledge on powder processing with restricted liquid addition, with a primary focus on particle coating and early granule growth. Furthermore, characterisation of this kind of processes was performed. A thin coating layer of hydroxypropyl methylcellulose was applied on individual particles of ibuprofen in a fluidised bed top-spray process. The polymeric coating improved the flow properties of the powder. The improvement was strongly related to relative humidity, which can be seen as an indicator of a change in surface hydrophilicity caused by the coating. The ibuprofen used in the present study had a d50 of 40 μm and thus belongs to the Geldart group C powders, which can be considered as challenging materials in top-spray coating processes. Ibuprofen was similarly coated using a novel ultrasound-assisted coating method. The results were in line with those obtained from powders coated in the fluidised bed process mentioned above. It was found that the ultrasound-assisted method was capable of coating single particles with a simple and robust setup. Granule growth in a fluidised bed process was inhibited by feeding the liquid in pulses. The results showed that the length of the pulsing cycles is of importance, and can be used to adjust granule growth. Moreover, pulsed liquid feed was found to be of greater significance to granule growth in high inlet air relative humidity. Liquid feed pulsing can thus be used as a tool in particle size targeting in fluidised bed processes and in compensating for changes in relative humidity of the inlet air. The nozzle function of a two-fluid external mixing pneumatic nozzle, typical for small scale pharmaceutical fluidised bed processes, was studied in situ in an ongoing fluidised bed process with particle tracking velocimetry. It was found that the liquid droplets undergo coalescence as they proceed away from the nozzle head. The coalescence was expected to increase droplet speed, which was confirmed in the study. The spray turbulence was studied, and the results showed turbulence caused by the event of atomisation and by the oppositely directed fluidising air. It was concluded that particle tracking velocimetry is a suitable tool for in situ spray characterisation. The light transmission through dense particulate systems was found to carry information on particle size and packing density as expected based on the theory of light scattering by solids. It was possible to differentiate binary blends consisting of components with differences in optical properties. Light transmission showed potential as a rapid, simple and inexpensive tool in characterisation of particulate systems giving information on changes in particle systems, which could be utilised in basic process diagnostics.

Neurocognitive processing of inflected and derived words

The representation of morphologically complex words in the mental lexicon and their neurocognitive processing has been a vigorously debated topic in psycholinguistics and the cognitive neuroscience of language. This thesis investigates the effect of stimulus modality on morphological processing, the spatiotemporal dynamics of the neural processing of inflected (e.g., work+ed ) and derived (e.g., work+er ) words and their interaction, using the Finnish language. Overall, the results suggest that the constituent morphemes of isolated written and spoken inflected words are accessed separately, whereas spoken derived words activate both their full form and the constituent morphemes. The processing of both spoken and written inflected words elicited larger N400 responses than monomorphemic words (Study I), whereas the responses to spoken derived words did not differ from those to monomorphemic words (Study IV). Spoken inflected words elicited a larger left-lateralized negativity and greater source strengths in the left temporal cortices than derived words (Study IV). Thus, the results suggest different cortical processing for derived and inflected words. Moreover, the neural mechanisms underlying inflection and derivation seem to be not only different, but also independent as indexed by the linear summation of the responses to derived and inflected stimuli in a combined (derivation+inflection) condition (Study III). Furthermore, the processing of meaningless, spoken derived pseudowords was more difficult than for existing derived words, indexed by a larger N400-type effect for the pseudowords. However, no differences were observed between meaningful derived pseudowords and existing derived words (Study II). The results of Study II suggest that semantic compatibility between morphemes seems to have a crucial role in a successful morphological analysis. As a methodological note, time-locking the auditory event-related potentials/fields (ERP/ERF) to the suffix onset revealed the processes related to morphological analysis more precisely (Studies II and IV), which also enables comparison of the neural processes in different modalities (Study I).