Learning Nonlinear Visual Processing from Natural Images

The paradigm of computational vision hypothesizes that any visual function -- such as the recognition of your grandparent -- can be replicated by computational processing of the visual input. What are these computations that the brain performs? What should or could they be? Working on the latter question, this dissertation takes the statistical approach, where the suitable computations are attempted to be learned from the natural visual data itself. In particular, we empirically study the computational processing that emerges from the statistical properties of the visual world and the constraints and objectives specified for the learning process. This thesis consists of an introduction and 7 peer-reviewed publications, where the purpose of the introduction is to illustrate the area of study to a reader who is not familiar with computational vision research. In the scope of the introduction, we will briefly overview the primary challenges to visual processing, as well as recall some of the current opinions on visual processing in the early visual systems of animals. Next, we describe the methodology we have used in our research, and discuss the presented results. We have included some additional remarks, speculations and conclusions to this discussion that were not featured in the original publications. We present the following results in the publications of this thesis. First, we empirically demonstrate that luminance and contrast are strongly dependent in natural images, contradicting previous theories suggesting that luminance and contrast were processed separately in natural systems due to their independence in the visual data. Second, we show that simple cell -like receptive fields of the primary visual cortex can be learned in the nonlinear contrast domain by maximization of independence. Further, we provide first-time reports of the emergence of conjunctive (corner-detecting) and subtractive (opponent orientation) processing due to nonlinear projection pursuit with simple objective functions related to sparseness and response energy optimization. Then, we show that attempting to extract independent components of nonlinear histogram statistics of a biologically plausible representation leads to projection directions that appear to differentiate between visual contexts. Such processing might be applicable for priming, \ie the selection and tuning of later visual processing. We continue by showing that a different kind of thresholded low-frequency priming can be learned and used to make object detection faster with little loss in accuracy. Finally, we show that in a computational object detection setting, nonlinearly gain-controlled visual features of medium complexity can be acquired sequentially as images are encountered and discarded. We present two online algorithms to perform this feature selection, and propose the idea that for artificial systems, some processing mechanisms could be selectable from the environment without optimizing the mechanisms themselves. In summary, this thesis explores learning visual processing on several levels. The learning can be understood as interplay of input data, model structures, learning objectives, and estimation algorithms. The presented work adds to the growing body of evidence showing that statistical methods can be used to acquire intuitively meaningful visual processing mechanisms. The work also presents some predictions and ideas regarding biological visual processing.

Small State Cultures of Consensus : State Traditions and Consensus-Seeking in the Neo-Corporatist and Neutrality Policies in Post-1945 Austria and Finland

Austria and Finland are persistently referred to as the “success stories” of post-1945 European history. Notwithstanding their different points of departure, in the course of the Cold War both countries portrayed themselves as small and neutral border-states in the world dictated by superpower politics. By the 1970s, both countries frequently ranked at the top end in various international classifications regarding economic development and well-being in society. This trend continues today. The study takes under scrutiny the concept of consensus which figures centrally in the two national narratives of post-1945 success. Given that the two domestic contexts as such only share few direct links with one another and are more obviously different than similar in terms of their geographical location, historical experiences and politico-cultural traditions, the analogies and variations in the anatomies of the post-1945 “cultures of consensus” provide an interesting topic for a historical comparative and cross-national examination. The main research question concerns the identification and analysis of the conceptual and procedural convergence points of the concepts of the state and consensus. The thesis is divided into six main chapters. After the introduction, the second chapter presents the theoretical framework in more detail by focusing on the key concepts of the study – the state and consensus. Chapter two also introduces the comparative historical and cross-national research angles. Chapter three grounds the key concepts of the state and consensus in the historical contexts of Austria and Finland by discussing the state, the nation and democracy in a longer term comparative perspective. The fourth and fifth chapter present case studies on the two policy fields, the “pillars”, upon which the post-1945 Austrian and Finnish cultures of consensus are argued to have rested. Chapter four deals with neo-corporatist features in the economic policy making and chapter five discusses the building up of domestic consensus regarding the key concepts of neutrality policies in the 1950s and 1960s. The study concludes that it was not consensus as such but the strikingly intense preoccupation with the theme of domestic consensus that cross-cut, in a curiously analogous manner, the policy-making processes studied. The main challenge for the post-1945 architects of Austrian and Finnish cultures of consensus was to find strategies and concepts for consensus-building which would be compatible with the principles of democracy. Discussed at the level of procedures, the most important finding of the study concerns the triangular mechanism of coordination, consultation and cooperation that set into motion and facilitated a new type of search for consensus in both post-war societies. In this triangle, the agency of the state was central, though in varying ways. The new conceptions concerning a small state’s position in the Cold War world also prompted cross-nationally perceivable willingness to reconsider inherited concepts and procedures of the state and the nation. At the same time, the ways of understanding the role of the state and its relation to society remained profoundly different in Austria and Finland and this basic difference was in many ways reflected in the concepts and procedures deployed in the search for consensus and management of domestic conflicts. For more detailed information, please consult the author.

Elite Bargaining and the Evolution of Centre-Periphery Relations in Post-Soviet Russia : A Comparative Analysis

This work is concerned with presenting a modified theoretical approach to the study of centre-periphery relations in the Russian Federation. In the widely accepted scientific discourse, the Russian federal system under the Yeltsin Administration (1991-2000) was asymmetrical; largely owing to the varying amount of structural autonomy distributed among the federation s 89 constituent units. While providing an improved understanding as to which political and socio-economic structures contributed to federal asymmetry, it is felt that associated large N-studies have underemphasised the role played by actor agency in re-shaping Russian federal institutions. It is the main task of this thesis to reintroduce /re-emphasise the importance of actor agency as a major contributing element of institutional change in the Russian federal system. By focusing on the strategic agency of regional elites simultaneously within regional and federal contexts, the thesis adopts the position that political, ethnic and socio-economic structural factors alone cannot fully determine the extent to which regional leaders were successful in their pursuit of economic and political pay-offs from the institutionally weakened federal centre. Furthermore, this work hypothesises that under conditions of federal institutional uncertainty, it is the ability of regional leaders to simultaneously interpret various mutable structural conditions then translate them into plausible strategies which accounts for the regions ability to extract variable amounts of economic and political pay-offs from the Russian federal system. The thesis finds that while the hypothesis is accurate in its theoretical assumptions, several key conclusions provide paths for further inquiry posed by the initial research question. First, without reliable information or stable institutions to guide their actions, both regional and federal elites were forced into ad-hoc decision-making in order to maintain their core strategic focus: political survival. Second, instead of attributing asymmetry to either actor agency or structural factors exclusively, the empirical data shows that both agency and structures interact symbiotically in the strategic formulation process, thus accounting for the sub-optimal nature of several of the actions taken in the adopted cases. Third, as actor agency and structural factors mutate over time, so, too do the perceived payoffs from elite competition. In the case of the Russian federal system, the stronger the federal centre became, the less likely it was that regional leaders could extract the high degree of economic and political pay-offs that they clamoured for earlier in the Yeltsin period. Finally, traditional approaches to the study of federal systems which focus on institutions as measures of federalism are not fully applicable in the Russian case precisely because the institutions themselves were a secondary point of contention between competing elites. Institutional equilibriums between the regions and Moscow were struck only when highly personalised elite preferences were satisfied. Therefore the Russian federal system is the product of short-term, institutional solutions suited to elite survival strategies developed under conditions of economic, political and social uncertainty.

Pre- and post-copulatory sexual selection in the least killifish, Heterandria formosa

It has been only recently realized that sexual selection does not end at copulation but that post-copulatory processes are often important in determining the fitness of individuals. In this thesis, I experimentally studied both pre- and post-copulatory sexual selection in the least killifish, Heterandria formosa. I found that this species suffers from severe inbreeding depression in male reproductive behaviour, offspring viability and offspring maturation times. Neither sex showed pre-copulatory inbreeding avoidance but when females mated with their brothers, less sperm were retrieved from their reproductive system compared to the situation when females mated with unrelated males. Whether the difference in sperm numbers is due to female or male effect could not be resolved. Based on theory, females should be more eager to avoid inbreeding than males in this species, because females invest more in their offspring than males do. Inbreeding seems to be an important part of this species biology and the severe inbreeding depression has most likely selected for the evolution of the post-copulatory inbreeding avoidance mechanism that I found. In addition, I studied the effects of polyandry on female reproductive success. When females mated with more than one male, they were more likely to get pregnant. However, I also found a cost of polyandry. The offspring of females mated to four males took longer to reach sexual maturity compared to the offspring of monandrous females. This cost may be explained by parent-offspring conflict over maternal resource allocation. In another experiment, in which within-brood relatedness was manipulated, offspring sizes decreased over time when within-brood relatedness was low. This result is partly in accordance with the kinship theory of genomic imprinting. When relatedness decreases, offspring are expected to be less co-operative and demand fewer resources from their mother, which leads to impaired development. In the last chapter of my thesis, I show that H. formosa males do not prefer large females as in other Poeciliidae species. I suggest that males view smaller females as more profitable mates because those are more likely virgin. In conclusion, I found both pre- and post-copulatory sexual selection to be important factors in determining reproductive success in H. formosa.

Mechanisms for alphavirus nonstructural polyprotein processing

Replication and transcription of the RNA genome of alphaviruses relies on a set of virus-encoded nonstructural proteins. They are synthesized as a long polyprotein precursor, P1234, which is cleaved at three processing sites to yield nonstructural proteins nsP1, nsP2, nsP3 and nsP4. All the four proteins function as constitutive components of the membrane-associated viral replicase. Proteolytic processing of P1234 polyprotein is precisely orchestrated and coordinates the replicase assembly and maturation. The specificity of the replicase is also controlled by proteolytic cleavages. The early replicase is composed of P123 polyprotein intermediate and nsP4. It copies the positive sense RNA genome to complementary minus-strand. Production of new plus-strands requires complete processing of the replicase. The papain-like protease residing in nsP2 is responsible for all three cleavages in P1234. This study addressed the mechanisms of proteolytic processing of the replicase polyprotein in two alphaviruses Semliki Forest virus (SFV) and Sindbis virus (SIN) representing different branches of the genus. The survey highlighted the functional relation of the alphavirus nsP2 protease to the papain-like enzymes. A new structural motif the Cys-His catalytic dyad accompanied with an aromatic residue following the catalytic His was described for nsP2 and a subset of other thiol proteases. Such an architecture of the catalytic center was named the glycine specificity motif since it was implicated in recognition of a specific Gly residue in the substrate. In particular, the presence of the motif in nsP2 makes the appearance of this amino acid at the second position upstream of the scissile bond a necessary condition for the cleavage. On top of that, there were four distinct mechanisms identified, which provide affinity for the protease and specifically direct the enzyme to different sites in the P1234 polyprotein. Three factors RNA, the central domain of nsP3 and the N-terminus of nsP2 were demonstrated to be external modulators of the nsP2 protease. Here I suggest that the basal nsP2 protease specificity is inherited from the ancestral papain-like enzyme and employs the recognition of the upstream amino acid signature in the immediate vicinity of the scissile bond. This mechanism is responsible for the efficient processing of the SFV nsP3/nsP4 junction. I propose that the same mechanism is involved in the cleavage of the nsP1/nsP2 junction of both viruses as well. However, in this case it rather serves to position the substrate, whereas the efficiency of the processing is ensured by the capability of nsP2 to cut its own N-terminus in cis. Both types of cleavages are demonstrated here to be inhibited by RNA, which is interpreted as impairing the basal papain-like recognition of the substrate. In contrast, processing of the SIN nsP3/nsP4 junction was found to be activated by RNA and additionally potentiated by the presence of the central region of nsP3 in the protease. The processing of the nsP2/nsP3 junction in both viruses occurred via another mechanism, requiring the exactly processed N-terminus of nsP2 in the protease and insensitive to RNA addition. Therefore, the three processing events in the replicase polyprotein maturation are performed via three distinct mechanisms in each of two studied alphaviruses. Distinct sets of conditions required for each cleavage ensure sequential maturation of P1234 polyprotein: nsP4 is released first, then the nsP1/nsP2 site is cut in cis, and liberation of the nsP2 N-terminus activates the cleavage of the nsP2/nsP3 junction at last. The first processing event occurs differently in SFV and SIN, whereas the subsequent cleavages are found to be similar in the two viruses and therefore, their mechanisms are suggested to be conserved in the genus. The RNA modulation of the alphavirus nonstructural protease activity, discovered here, implies bidirectional functional interplay between the alphavirus RNA metabolism and protease regulation. The nsP2 protease emerges as a signal transmitting moiety, which senses the replication stage and responds with proteolytic cleavages. A detailed hypothetical model of the alphavirus replicase core was inferred from the data obtained in the study. Similar principles in replicase organization and protease functioning are expected to be employed by other RNA viruses.

Music in the recovering brain

Listening to music involves a widely distributed bilateral network of brain regions that controls many auditory perceptual, cognitive, emotional, and motor functions. Exposure to music can also temporarily improve mood, reduce stress, and enhance cognitive performance as well as promote neural plasticity. However, very little is currently known about the relationship between music perception and auditory and cognitive processes or about the potential therapeutic effects of listening to music after neural damage. This thesis explores the interplay of auditory, cognitive, and emotional factors related to music processing after a middle cerebral artery (MCA) stroke. In the acute recovery phase, 60 MCA stroke patients were randomly assigned to a music listening group, an audio book listening group, or a control group. All patients underwent neuropsychological assessments, magnetoencephalography (MEG) measurements, and magnetic resonance imaging (MRI) scans repeatedly during a six-month post-stroke period. The results revealed that amusia, a deficit of music perception, is a common and persistent deficit after a stroke, especially if the stroke affects the frontal and temporal brain areas in the right hemisphere. Amusia is clearly associated with deficits in both auditory encoding, as indicated by the magnetic mismatch negativity (MMNm) response, and domain-general cognitive processes, such as attention, working memory, and executive functions. Furthermore, both music and audio book listening increased the MMNm, whereas only music listening improved the recovery of verbal memory and focused attention as well as prevented a depressed and confused mood during the first post-stroke months. These findings indicate a close link between musical, auditory, and cognitive processes in the brain. Importantly, they also encourage the use of listening to music as a rehabilitative leisure activity after a stroke and suggest that the auditory environment can induce long-term plastic changes in the recovering brain.