Learning Nonlinear Visual Processing from Natural Images

The paradigm of computational vision hypothesizes that any visual function -- such as the recognition of your grandparent -- can be replicated by computational processing of the visual input. What are these computations that the brain performs? What should or could they be? Working on the latter question, this dissertation takes the statistical approach, where the suitable computations are attempted to be learned from the natural visual data itself. In particular, we empirically study the computational processing that emerges from the statistical properties of the visual world and the constraints and objectives specified for the learning process. This thesis consists of an introduction and 7 peer-reviewed publications, where the purpose of the introduction is to illustrate the area of study to a reader who is not familiar with computational vision research. In the scope of the introduction, we will briefly overview the primary challenges to visual processing, as well as recall some of the current opinions on visual processing in the early visual systems of animals. Next, we describe the methodology we have used in our research, and discuss the presented results. We have included some additional remarks, speculations and conclusions to this discussion that were not featured in the original publications. We present the following results in the publications of this thesis. First, we empirically demonstrate that luminance and contrast are strongly dependent in natural images, contradicting previous theories suggesting that luminance and contrast were processed separately in natural systems due to their independence in the visual data. Second, we show that simple cell -like receptive fields of the primary visual cortex can be learned in the nonlinear contrast domain by maximization of independence. Further, we provide first-time reports of the emergence of conjunctive (corner-detecting) and subtractive (opponent orientation) processing due to nonlinear projection pursuit with simple objective functions related to sparseness and response energy optimization. Then, we show that attempting to extract independent components of nonlinear histogram statistics of a biologically plausible representation leads to projection directions that appear to differentiate between visual contexts. Such processing might be applicable for priming, \ie the selection and tuning of later visual processing. We continue by showing that a different kind of thresholded low-frequency priming can be learned and used to make object detection faster with little loss in accuracy. Finally, we show that in a computational object detection setting, nonlinearly gain-controlled visual features of medium complexity can be acquired sequentially as images are encountered and discarded. We present two online algorithms to perform this feature selection, and propose the idea that for artificial systems, some processing mechanisms could be selectable from the environment without optimizing the mechanisms themselves. In summary, this thesis explores learning visual processing on several levels. The learning can be understood as interplay of input data, model structures, learning objectives, and estimation algorithms. The presented work adds to the growing body of evidence showing that statistical methods can be used to acquire intuitively meaningful visual processing mechanisms. The work also presents some predictions and ideas regarding biological visual processing.

Ammatti, ihminen ja maailmankuva murroksessa : Tutkimus yliopistokirjastoista ja kirjastonhoitajista tietoyhteiskuntakaudella 1970-2005

PROFESSION, PERSON AND WORLDVIEW AT A TURNING POINT A Study of University Libraries and Library Staff in the Information Age 1970 - 2005 The incongruity between commonly held ideas of libraries and librarians and the changes that have occurred in libraries since 2000 provided the impulse for this work. The object is to find out if the changes of the last few decades have penetrated to a deeper level, that is, if they have caused changes in the values and world views of library staff and management. The study focuses on Finnish university libraries and the people who work in them. The theoretical framework is provided by the concepts of world view (values, the concept of time, man and self, the experience of the supernatural and the holy, community and leadership). The viewpoint, framework and methods of the study place it in the area of Comparative Religion by applying the world view framework. The time frame is the information age, which has deeply affected Finnish society and scholarly communication from 1970 to 2005. The source material of the study comprises 30 life stories; somewhat more than half of the stories come from the University of Helsinki, and the rest from the other eight universities. Written sources include library journals, planning documents and historical accounts of libraries. The experiences and research diaries of the research worker are also used as source material. The world view questions are discussed on different levels: 1) recognition of the differences and similarities in the values of the library sphere and the university sphere, 2) examination of the world view elements, community and leadership based on the life stories, and 3) the three phases of the effects of information technology on the university libraries and those who work in them. In comparing the values of the library sphere and the university sphere, the appreciation of creative work and culture as well as the founding principles of science and research are jointly held values. The main difference between the values in the university and library spheres concerns competition and service. Competition is part of the university as an institution of research work. The core value of the library sphere is service, which creates the essential ethos of library work. The ethical principles of the library sphere also include the values of democracy and equality as well as the value of intellectual freedom. There is also a difference between an essential value in the university sphere, the value of autonomy and academic freedom on the one hand, and the global value of the library sphere - organizing operations in a practical and efficient way on the other hand. Implementing this value can also create tension between the research community and the library. Based on the life stories, similarities can be found in the values of the library staff members. The value of service seems to be of primary importance for all who are committed to library work and who find it interesting and rewarding. The service role of the library staff can be extended from information services provider to include the roles of teacher, listener and even therapist, all needed in a competitive research community. The values of democracy and equality also emerge fairly strongly. The information age development has progressed in three phases in the libraries from the 1960s onward. In the third phase beginning in the mid 1990s, the increased usage of electronic resources has set fundamental changes in motion. The changes have affected basic values and the concept of time as well as the hierarchies and valuations within the library community. In addition to and as a replacement for the library possessing a local identity and operational model, a networked, global library is emerging. The changes have brought tension both to the library communities and to the relationship between the university community and the library. Future orientation can be said to be the key concept for change; it affects where the ideals and models for operations are taken from. Future orientation manifests itself as changes in metaphors, changes in the model of a good librarian and as communal valuations. Tension between the libraries and research communities can arise if the research community pictures the library primarily as a traditional library building with a local identity, whereas the 21st century library staff and directors are affected by future orientation and membership in a networked library sphere, working proactively to develop their libraries.

Ethics and Aesthetics : Intersections in Iris Murdoch's Philosophy

The study addresses the question concerning the relationship between ethics and aesthetics in the philosophy of Iris Murdoch. The main argument is that Murdoch s philosophy cannot be accurately understood without an understanding of the relationship she sees between the aesthetic experience and morality. Reading Murdoch s philosophy with this relationship in mind shows that it must be considered as a relevant alternative to the main forms of aesthetic-ethical theories. The study consists of seven previously published articles and a summary. It shows that Murdoch belongs to a tradition of philosophers who seek to broaden the scope of ethics by reference to aesthetic value and aesthetic experience. She sees an attitude responsible for aesthetic experiences as relevant for morality. However, she does not collapse morality into aesthetic experience. The two meet on the level of the subject s attitude towards its object, but there is a distinction between the experiences that accompany the attitudes. Aesthetic experiences can function as a clue to morals in that they present in a pleasing manner moral truths which otherwise might be psychologically too difficult to face. Murdoch equates the aesthetic attitude with virtuous love characterized by unselfish attention to its object. The primary object of such love is in Murdoch s account another human individual in her particularity. She compares the recognition of the other person as a particular existence to the experience of the Kantian sublime and offers her own version of the true sublime which is the experience of awe in the face of the infinity of the task of understanding others. One of the most central claims in Murdoch s philosophy is that human consciousness is evaluatively structured. This claim challenges the distinction between facts and values which has had an immense influence on modern moral philosophy. One argument with which Murdoch supports her claim is the nature of great literature. According to her, the standard of greatness in literature is the authors awareness of the independent existence of individuals in the particularity of their evaluative consciousnesses. The analysis of the standard of greatness in literature is also Murdoch s only argument for the claim that the primary object of the loving unselfish attention is the other particular individual. She is convinced that great literature reveals a deep truth about the human condition with its capacity to capture the particular. Abstract philo¬sophical discourse cannot compete with this capacity but it should take truths revealed by literature seriously in its theorising. Recognising this as Murdoch s stand on the question of the relation between philosophy and literature as forms of human discourse settles whether she is part of what has been called philosophy s turn to literature. The answer is yes.

Recognition, comorbidity, and outcome of DSM-IV bipolar I and II disorders in psychiatric care

This study is part of an ongoing collaborative bipolar research project, the Jorvi Bipolar Study (JoBS). The JoBS is run by the Department of Mental Health and Alcohol Research of the National Public Health Institute, Helsinki, and the Department of Psychiatry, Jorvi Hospital, Helsinki University Central Hospital (HUCH), Espoo, Finland. It is a prospective, naturalistic cohort study of secondary level care psychiatric in- and outpatients with a new episode of bipolar disorder (BD). The second report also included 269 major depressive disorder (MDD) patients from the Vantaa Depression Study (VDS). The VDS was carried out in collaboration with the Department of Psychiatry of the Peijas Medical Care District. Using the Mood Disorder Questionnaire (MDQ), all in- and outpatients at the Department of Psychiatry at Jorvi Hospital who currently had a possible new phase of DSM-IV BD were sought. Altogether, 1630 psychiatric patients were screened, and 490 were interviewed using a semistructured interview (SCID-I/P). The patients included in the cohort (n=191) had at intake a current phase of BD. The patients were evaluated at intake and at 6- and 18-month interviews. Based on this study, BD is poorly recognized even in psychiatric settings. Of the BD patients with acute worsening of illness, 39% had never been correctly diagnosed. The classic presentations of BD with hospitalizations, manic episodes, and psychotic symptoms lead clinicians to correct diagnosis of BD I in psychiatric care. Time of follow-up elapsed in psychiatric care, but none of the clinical features, seemed to explain correct diagnosis of BD II, suggesting reliance on cross- sectional presentation of illness. Even though BD II was clearly less often correctly diagnosed than BD I, few other differences between the two types of BD were detected. BD I and II patients appeared to differ little in terms of clinical picture or comorbidity, and the prevalence of psychiatric comorbidity was strongly related to the current illness phase in both types. At the same time, the difference in outcome was clear. BD II patients spent about 40% more time depressed than BD I patients. Patterns of psychiatric comorbidity of BD and MDD differed somewhat qualitatively. Overall, MDD patients were likely to have more anxiety disorders and cluster A personality disorders, and bipolar patients to have more cluster B personality disorders. The adverse consequences of missing or delayed diagnosis are potentially serious. Thus, these findings strongly support the value of screening for BD in psychiatric settings, especially among the major depressive patients. Nevertheless, the diagnosis must be based on a clinical interview and follow-up of mood. Comorbidity, present in 59% of bipolar patients in a current phase, needs concomitant evaluation, follow-up, and treatment. To improve outcome in BD, treatment of bipolar depression is a major challenge for clinicians.

On the Benefits and Problems of the Object-Oriented Paradigm including a Finnish Study

Several researchers are of the opinion that there are many benefits in using the object-oriented paradigm in information systems development. If the object-oriented paradigm is used, the development of information systems may, for example, be faster and more efficient. On the other hand, there are also several problems with the paradigm. For example, it is often considered complex, it is often difficult to make use of the reuse concept and it is still immature in some areas. Although there are several interesting features in the object-oriented paradigm, there is still little comprehensive knowledge of the benefits and problems associated with it. The objective of the following study was to investigate and to gain more understanding of the benefits and problems of the object-oriented paradigm. A review of previous studies was made and twelve benefits and twelve problems were established. These benefits and problems were then analysed, studied and discussed. Further a survey and some case studies were made in order to get some knowledge on what benefits and problems with the object-oriented paradigm Finnish software companies had experienced. One hundred and four companies answered the survey that was sent to all Finnish software companies with five or more employees. The case studies were made with six large Finnish software companies. The major finding was that Finnish software companies were exceptionally positive towards the object-oriented information systems development and had experienced very few of the proposed problems. Finally two models for further research were developed. The first model presents connections between benefits and the second between problems.

Eläimen tuttuus ja vieraus : Fenomenologisen empatiateorian uudelleentulkinta ja sen sovellus vieraslajisia eläimiä koskevaan kokemukseen

Within the field of philosophy, animals have traditionally been studied from two perspectives: that of self-knowledge and that of ethics. The analysis of the differences between humans and animals has served our desire to understand our own specificity, whereas ethical discussions have ultimately aimed at finding the right way to treat animals. This dissertation proposes a different way of looking at non-human animals: it investigates the question of how non-human animals appear to us humans in our perceptual experience. The analysis focuses on the empathetic, embodied understanding of animals diverse movements and other expressions. The theoretical point of departure for the research is phenomenological philosophy, in particular Maurice Merleau-Ponty s phenomenology of the body. Edmund Husserl s and Edith Stein s analyses of empathy and embodiment are also crucial to the work. In this tradition, empathy means understanding the other s experience through her bodily expressions and seeing the other body as living, as well as motivated and directed towards the surrounding world. The dissertation both explicates and criticizes the earlier phenomenological notions of empathy and human specificity. In order to elucidate the fundamental structures of our experience of non-human animals, it also applies the phenomenological method, which consists of a phenomenological reduction and a free variation of the different aspects of experience. It is shown that our experiences of non-human animals involve a recognition of both similarities and differences. This recognition, however, is not primarily based on intellectual comparisons but is lived as an embodied relationship to another body, and its manifestations vary from one instant to the next. The analysis also reveals that the object of empathy is not the other s experience as such, not even as it is manifested by the other s movements, but rather the other s embodied situation, enriched by elements that remain outside the scope of the other s experience. The dissertation shows that human existence is intertwined with the existence of non-human animals on four levels: those of empathetic sensations, reciprocal communication, experience of the surrounding world and self-definitions. The animals different modes of perception prove to expand our understanding of what is perceivable and how things can be perceived. The presence of non-human animals in our perceptual world is revealed as something that both shows us the limits of our own embodiment and enables us to overcome these limits in empathetic acts. Finally, it is demonstrated that the life of non-human animals is intertwined with ours in a far more complex way than has been presupposed in traditional descriptions of human-animal differences.

DNA damage recognition in the normal epithelium of human prostate and seminal vesicles

Prostate cancer is one of the most prevalent cancer types in men. The development of prostate tumors is known to require androgen exposure, and several pathways governing cell growth are deregulated in prostate tumorigenesis. Recent genetic studies have revealed that complex gene fusions and copy - number alterations are frequent in prostate cancer, a unique feature among solid tumors. These chromosomal aberrations are though to arise as a consequence of faulty repair of DNA double strand breaks (DSB). Most repair mechanisms have been studied in detail in cancer cell lines, but how DNA damage is detected and repaired in normal differentiated human cells has not been widely addressed. The events leading to the gene fusions in prostate cancer are under rigorous studies, as they not only shed light on the basic pathobiologic mechanisms but may also produce molecular targets for prostate cancer treatment and prevention. Prostate and seminal vesicles are part of the male reproductive system. They share similar structure and function but differ dramatically in their cancer incidence. Approximately fifty primary seminal vesicle carcinomas have been reported worldwide. Surprisingly, only little is known on why seminal vesicles are resistant to neoplastic changes. As both tissues are androgen dependent, it is a mystery that androgen signaling would only lead to tumors in prostate tissue. In this work, we set up novel ex vivo human tissue culture models of prostate and seminal vesicles, and used them to study how DNA damage is recognized in normal epithelium. One of the major DNA - damage inducible pathways, mediated by the ATM kinase, was robustly activated in all main cell types of both tissues. Interestingly, we discovered that secretory epithelial cells had less histone variant H2A.X and after DNA damage lower levels of H2AX were phosphorylated on serine 139 (γH2AX) than in basal or stromal cells. γH2AX has been considered essential for efficient DSB repair, but as there were no significant differences in the γH2AX levels between the two tissues, it seems more likely that the role of γH2AX is less important in postmitotic cells. We also gained insight into the regulation of p53, an important transcription factor that protects genomic integrity via multiple mechanisms, in human tissues. DSBs did not lead to a pronounced activation of p53, but treatments causing transcriptional stress, on the other hand, were able to launch a notable p53 response in both tissue types. In general, ex vivo culturing of human tissues provided unique means to study differentiated cells in their relevant tissue context, and is suited for testing novel therapeutic drugs before clinical trials. In order to study how prostate and seminal vesicle epithelial cells are able to activate DNA damage induced cell cycle checkpoints, we used primary cultures of prostate and seminal vesicle epithelial cells. To our knowledge, we are the first to report isolation of human primary seminal vesicle cells. Surprisingly, human prostate epithelial cells did not activate cell cycle checkpoints after DSBs in part due to low levels of Wee1A, a kinase regulating CDK activity, while primary seminal vesicle epithelial cells possessed proficient cell cycle checkpoints and expressed high levels of Wee1A. Similarly, seminal vesicle cells showed a distinct activation of the p53 - pathway after DSBs that did not occur in prostate epithelial cells. This indicates that p53 protein function is under different control mechanisms in the two cell types, which together with proficient cell cycle checkpoints may be crucial in protecting seminal vesicles from endogenous and exogenous DNA damaging factors and, as a consequence, from carcinogenesis. These data indicate that two very similar organs of male reproductive system do not respond to DNA damage similarly. The differentiated, non - replicating cells of both tissues were able to recognize DSBs, but under proliferation human prostate epithelial cells had deficient activation of the DNA damage response. This suggests that prostate epithelium is most vulnerable to accumulating genomic aberrations under conditions where it needs to proliferate, for example after inflammatory cellular damage.