Learning Nonlinear Visual Processing from Natural Images

The paradigm of computational vision hypothesizes that any visual function -- such as the recognition of your grandparent -- can be replicated by computational processing of the visual input. What are these computations that the brain performs? What should or could they be? Working on the latter question, this dissertation takes the statistical approach, where the suitable computations are attempted to be learned from the natural visual data itself. In particular, we empirically study the computational processing that emerges from the statistical properties of the visual world and the constraints and objectives specified for the learning process. This thesis consists of an introduction and 7 peer-reviewed publications, where the purpose of the introduction is to illustrate the area of study to a reader who is not familiar with computational vision research. In the scope of the introduction, we will briefly overview the primary challenges to visual processing, as well as recall some of the current opinions on visual processing in the early visual systems of animals. Next, we describe the methodology we have used in our research, and discuss the presented results. We have included some additional remarks, speculations and conclusions to this discussion that were not featured in the original publications. We present the following results in the publications of this thesis. First, we empirically demonstrate that luminance and contrast are strongly dependent in natural images, contradicting previous theories suggesting that luminance and contrast were processed separately in natural systems due to their independence in the visual data. Second, we show that simple cell -like receptive fields of the primary visual cortex can be learned in the nonlinear contrast domain by maximization of independence. Further, we provide first-time reports of the emergence of conjunctive (corner-detecting) and subtractive (opponent orientation) processing due to nonlinear projection pursuit with simple objective functions related to sparseness and response energy optimization. Then, we show that attempting to extract independent components of nonlinear histogram statistics of a biologically plausible representation leads to projection directions that appear to differentiate between visual contexts. Such processing might be applicable for priming, \ie the selection and tuning of later visual processing. We continue by showing that a different kind of thresholded low-frequency priming can be learned and used to make object detection faster with little loss in accuracy. Finally, we show that in a computational object detection setting, nonlinearly gain-controlled visual features of medium complexity can be acquired sequentially as images are encountered and discarded. We present two online algorithms to perform this feature selection, and propose the idea that for artificial systems, some processing mechanisms could be selectable from the environment without optimizing the mechanisms themselves. In summary, this thesis explores learning visual processing on several levels. The learning can be understood as interplay of input data, model structures, learning objectives, and estimation algorithms. The presented work adds to the growing body of evidence showing that statistical methods can be used to acquire intuitively meaningful visual processing mechanisms. The work also presents some predictions and ideas regarding biological visual processing.

Iterative solution of a class of linear equations with application to reconstruction of three-dimensional object arrays

An iterative algorithm baaed on probabilistic estimation is described for obtaining the minimum-norm solution of a very large, consistent, linear system of equations AX = g where A is an (m times n) matrix with non-negative elements, x and g are respectively (n times 1) and (m times 1) vectors with positive components.

Ammatti, ihminen ja maailmankuva murroksessa : Tutkimus yliopistokirjastoista ja kirjastonhoitajista tietoyhteiskuntakaudella 1970-2005

PROFESSION, PERSON AND WORLDVIEW AT A TURNING POINT A Study of University Libraries and Library Staff in the Information Age 1970 - 2005 The incongruity between commonly held ideas of libraries and librarians and the changes that have occurred in libraries since 2000 provided the impulse for this work. The object is to find out if the changes of the last few decades have penetrated to a deeper level, that is, if they have caused changes in the values and world views of library staff and management. The study focuses on Finnish university libraries and the people who work in them. The theoretical framework is provided by the concepts of world view (values, the concept of time, man and self, the experience of the supernatural and the holy, community and leadership). The viewpoint, framework and methods of the study place it in the area of Comparative Religion by applying the world view framework. The time frame is the information age, which has deeply affected Finnish society and scholarly communication from 1970 to 2005. The source material of the study comprises 30 life stories; somewhat more than half of the stories come from the University of Helsinki, and the rest from the other eight universities. Written sources include library journals, planning documents and historical accounts of libraries. The experiences and research diaries of the research worker are also used as source material. The world view questions are discussed on different levels: 1) recognition of the differences and similarities in the values of the library sphere and the university sphere, 2) examination of the world view elements, community and leadership based on the life stories, and 3) the three phases of the effects of information technology on the university libraries and those who work in them. In comparing the values of the library sphere and the university sphere, the appreciation of creative work and culture as well as the founding principles of science and research are jointly held values. The main difference between the values in the university and library spheres concerns competition and service. Competition is part of the university as an institution of research work. The core value of the library sphere is service, which creates the essential ethos of library work. The ethical principles of the library sphere also include the values of democracy and equality as well as the value of intellectual freedom. There is also a difference between an essential value in the university sphere, the value of autonomy and academic freedom on the one hand, and the global value of the library sphere - organizing operations in a practical and efficient way on the other hand. Implementing this value can also create tension between the research community and the library. Based on the life stories, similarities can be found in the values of the library staff members. The value of service seems to be of primary importance for all who are committed to library work and who find it interesting and rewarding. The service role of the library staff can be extended from information services provider to include the roles of teacher, listener and even therapist, all needed in a competitive research community. The values of democracy and equality also emerge fairly strongly. The information age development has progressed in three phases in the libraries from the 1960s onward. In the third phase beginning in the mid 1990s, the increased usage of electronic resources has set fundamental changes in motion. The changes have affected basic values and the concept of time as well as the hierarchies and valuations within the library community. In addition to and as a replacement for the library possessing a local identity and operational model, a networked, global library is emerging. The changes have brought tension both to the library communities and to the relationship between the university community and the library. Future orientation can be said to be the key concept for change; it affects where the ideals and models for operations are taken from. Future orientation manifests itself as changes in metaphors, changes in the model of a good librarian and as communal valuations. Tension between the libraries and research communities can arise if the research community pictures the library primarily as a traditional library building with a local identity, whereas the 21st century library staff and directors are affected by future orientation and membership in a networked library sphere, working proactively to develop their libraries.

On the Specificity of Carbohydrate-Lectin Recognition The Interaction of a Lectin from Ricinus communis Beans with Simple Saccharides and Concanavalin A

A galactose-specific protein (RC1) isolated from Ricinus communis beans was found to give a precipitin reaction with concanavalin A. Its carbohydrate content amounted to 8–9% of the total protein and was found to be rich in mannose. The interaction of RC1 with galactose and lactose was measured in 0.05 M phosphate buffer containing 0.2 M NaCl (pH 6.8) by the method of conventional equilibrium dialysis. From the analysis of the binding data according to Scatchard method the association constant (Ka) at 5°C was calculated as 3.8 mM−1 and 1.2 mM−1 for lactose and galactose, respectively. In both cases the number of binding sites per molecule of RC1 with molecular weight of 120000 was found to be 2. From the temperature-dependent Ka values for the binding of lactose, the values of –5.7 kcal/mol and –4.3 cal × mol−1× K−1 were calculated for ΔH and ΔS, respectively. The addition of concanavalin A to RC1 or vice versa led to the formation of the insoluble complex RC1· ConA4 containing one molecule of RC1 and one molecule of tetrameric concanavalin A (ConA4) which could be dissociated upon addition of concanavalin A-specific sugars. The complex formation results in a time-dependent appearance of turbidity in the time range from 10s to 10 min. From the measurement of the time-dependent appearance and disappearance of the turbidity the formation (kf) and dissociation (kd) rate constants were calculated as 3 mM−1× s−1 and 0.07 ks−1 respectively. The ratio kf/kd (43μM −1), that corresponds to the association constant of complex RC1· ConA4, is higher than that of mannoside · ConA4 and thereby suggests that protein-protein interaction contributes significantly in stabilising glycoprotein · lectin complexes. The relevance of this finding to the understanding of the chemical specificities that are involved in a model cell-lectin interaction is discussed.

Going bush: Preparing pre-service teachers to teach in regional Western Australia

This paper reports on outcomes of Phases One and Two of the ALTC Competitive Research and Development Project "Developing Strategies at the Pre-Service Level to Address Critical Teacher Attraction and Retention Issues in Australian Rural, Regional and Remote Schools." This project funded over two years aims to strengthen the capacity and credibility of universities to prepare rural, regional and remote educators, similar to the capacity and credibility that has been created in preparing Australia's rural, regional and remote health workers. There is a strong recognition of the fundamental importance of quality teaching experiences rural, regional and remote schools and throughout this project over 200 pre-service teachers have participated in a curriculum module/object and completed a survey that encourages them to consider teaching in regional Western Australia. The project has mapped current Western Australian rural, regional and remote pre-service teacher education curriculum and field experience model. This mapping completed a comparison of national information with the identification of rural, regional and remote education curriculum and/or field experience models used nationally and internationally. In particular results from Phase One and Two will be presented reporting on the findings of the first year of the project.

Identification of key DNA elements involved in promoter recognition by Mxr1p, a master regulator of methanol utilization pathway in Pichia pastoris

Mxr1p (methanol expression regulator 1) functions as a key regulator of methanol metabolism in the methylotrophic yeast Pichia pastoris. In this study, a recombinant Mxr1p protein containing the N-terminal zinc finger DNA binding domain was overexpressed and purified from E coli cells and its ability to bind to promoter sequences of AOXI encoding alcohol oxidase was examined. In the AOXI promoter, Mxr1p binds at six different regions. Deletions encompassing these regions result in a significant decrease in AOXI promoter activity in vivo. Based on the analysis of AOXI promoter sequences, a consensus sequence for Mxr1p binding consisting of a core 5' CYCC 3' motif was identified. When the core CYCC sequence is mutated to CYCA, CYCT or CYCM (M = 5-methylcytosine), Mxr1p binding is abolished. Though Mxr1p is the homologue of Saccharomyces cerevisiae Adr1p transcription factor, it does not bind to Adr1p binding site of S. cerevisiae alcohol dehydrogenase promoter (ADH2UAS1). However, two point mutations convert ADH2UAS1 into an Mxr1p binding site. The identification of key DNA elements involved in promoter recognition by Mxr1p is an important step in understanding its function as a master regulator of the methanol utilization pathway in P. pastoris.

An object-centred approach to encourage online participation in the context of behaviour change

Online groups rely on contributions from their members to flourish, but in the context of behaviour change individuals are typically reluctant to participate actively before they have changed successfully. We took inspiration from CSCW research on objects to address this problem by shifting the focus of online participation from the exchange of personal experiences to more incidental interactions mediated by objects that offer support for change. In this article we describe how we designed, deployed and studied a smartphone application that uses different objects, called distractions and tips, to facilitate social interaction amongst people trying to quit smoking. A field study with 18 smokers revealed different forms of interaction: purely instrumental interactions with the objects, subtle engagement with other users through receptive and covert interactions, as well as explicit interaction with other users through disclosure and mutual support. The distraction objects offered a stepping-stone into interaction, whereas the tips encouraged interaction with the people behind the objects. This understanding of interaction through objects complements existing frameworks of online participation and adds to the current discourse on object-centred sociality. Furthermore, it provides an alternative approach to the design of online support groups, which offers the users enhanced control about the information they share with other users. We conclude by discussing how researchers and practitioners can apply the ideas of interaction around objects to other domains where individuals may have a simultaneous desire and reluctance to interact.

Ethics and Aesthetics : Intersections in Iris Murdoch's Philosophy

The study addresses the question concerning the relationship between ethics and aesthetics in the philosophy of Iris Murdoch. The main argument is that Murdoch s philosophy cannot be accurately understood without an understanding of the relationship she sees between the aesthetic experience and morality. Reading Murdoch s philosophy with this relationship in mind shows that it must be considered as a relevant alternative to the main forms of aesthetic-ethical theories. The study consists of seven previously published articles and a summary. It shows that Murdoch belongs to a tradition of philosophers who seek to broaden the scope of ethics by reference to aesthetic value and aesthetic experience. She sees an attitude responsible for aesthetic experiences as relevant for morality. However, she does not collapse morality into aesthetic experience. The two meet on the level of the subject s attitude towards its object, but there is a distinction between the experiences that accompany the attitudes. Aesthetic experiences can function as a clue to morals in that they present in a pleasing manner moral truths which otherwise might be psychologically too difficult to face. Murdoch equates the aesthetic attitude with virtuous love characterized by unselfish attention to its object. The primary object of such love is in Murdoch s account another human individual in her particularity. She compares the recognition of the other person as a particular existence to the experience of the Kantian sublime and offers her own version of the true sublime which is the experience of awe in the face of the infinity of the task of understanding others. One of the most central claims in Murdoch s philosophy is that human consciousness is evaluatively structured. This claim challenges the distinction between facts and values which has had an immense influence on modern moral philosophy. One argument with which Murdoch supports her claim is the nature of great literature. According to her, the standard of greatness in literature is the authors awareness of the independent existence of individuals in the particularity of their evaluative consciousnesses. The analysis of the standard of greatness in literature is also Murdoch s only argument for the claim that the primary object of the loving unselfish attention is the other particular individual. She is convinced that great literature reveals a deep truth about the human condition with its capacity to capture the particular. Abstract philo¬sophical discourse cannot compete with this capacity but it should take truths revealed by literature seriously in its theorising. Recognising this as Murdoch s stand on the question of the relation between philosophy and literature as forms of human discourse settles whether she is part of what has been called philosophy s turn to literature. The answer is yes.

Human action recognition from video sequences

This PhD research has proposed new machine learning techniques to improve human action recognition based on local features. Several novel video representation and classification techniques have been proposed to increase the performance with lower computational complexity. The major contributions are the construction of new feature representation techniques, based on advanced machine learning techniques such as multiple instance dictionary learning, Latent Dirichlet Allocation (LDA) and Sparse coding. A Binary-tree based classification technique was also proposed to deal with large amounts of action categories. These techniques are not only improving the classification accuracy with constrained computational resources but are also robust to challenging environmental conditions. These developed techniques can be easily extended to a wide range of video applications to provide near real-time performance.

Joint evaluation of multiple speech patterns for speech recognition and training

We are addressing the novel problem of jointly evaluating multiple speech patterns for automatic speech recognition and training. We propose solutions based on both the non-parametric dynamic time warping (DTW) algorithm, and the parametric hidden Markov model (HMM). We show that a hybrid approach is quite effective for the application of noisy speech recognition. We extend the concept to HMM training wherein some patterns may be noisy or distorted. Utilizing the concept of ``virtual pattern'' developed for joint evaluation, we propose selective iterative training of HMMs. Evaluating these algorithms for burst/transient noisy speech and isolated word recognition, significant improvement in recognition accuracy is obtained using the new algorithms over those which do not utilize the joint evaluation strategy.

Recognition of nonstructural protein-peptides by cytotoxic t-lymphocytes raised against japanese encephalitis-virus

We have previously reported that Lyt(2+) cytotoxic T lymphocytes (CTL) can be raised against Japanese encephalitis virus (JEV) in BALB/c mice. In order to confirm the presence of H-2K(d)-restricted CTL and to examine their cross-recognition of West Wile virus (WNV), we tested the capacity of anti-JEV CTL to lyse uninfected syngeneic target cells that were pulsed with synthetic peptides. The sequence of the synthetic peptides was predicted based upon the H-2K(d) binding consensus motif. We show here that preincubation of uninfected syngeneic targets (P388D1) with JEV NS1- and NS3-derived peptides [NS1 (891-899) and NS3 (1804-1812)], but not with JEV NS5-derived peptide [NS5 (3370-3378)], partially sensitized them for lysis by polyclonal anti-JEV CTL. These results indicate the CTL recognition of NS1- and NS3-derived peptides of JEV.

Elliptical summary randomisation for sensor-based human activity recognition

Many conventional statistical machine learning al- gorithms generalise poorly if distribution bias ex- ists in the datasets. For example, distribution bias arises in the context of domain generalisation, where knowledge acquired from multiple source domains need to be used in a previously unseen target domains. We propose Elliptical Summary Randomisation (ESRand), an efficient domain generalisation approach that comprises of a randomised kernel and elliptical data summarisation. ESRand learns a domain interdependent projection to a la- tent subspace that minimises the existing biases to the data while maintaining the functional relationship between domains. In the latent subspace, ellipsoidal summaries replace the samples to enhance the generalisation by further removing bias and noise in the data. Moreover, the summarisation enables large-scale data processing by significantly reducing the size of the data. Through comprehensive analysis, we show that our subspace-based approach outperforms state-of-the-art results on several activity recognition benchmark datasets, while keeping the computational complexity significantly low.

Recognition of Interaction Interface Residues in Low-Resolution Structures of Protein Assemblies Solely from the Positions of C alpha Atoms

Background: The number of available structures of large multi-protein assemblies is quite small. Such structures provide phenomenal insights on the organization, mechanism of formation and functional properties of the assembly. Hence detailed analysis of such structures is highly rewarding. However, the common problem in such analyses is the low resolution of these structures. In the recent times a number of attempts that combine low resolution cryo-EM data with higher resolution structures determined using X-ray analysis or NMR or generated using comparative modeling have been reported. Even in such attempts the best result one arrives at is the very course idea about the assembly structure in terms of trace of the C alpha atoms which are modeled with modest accuracy. Methodology/Principal Findings: In this paper first we present an objective approach to identify potentially solvent exposed and buried residues solely from the position of C alpha atoms and amino acid sequence using residue type-dependent thresholds for accessible surface areas of C alpha. We extend the method further to recognize potential protein-protein interface residues. Conclusion/Significance: Our approach to identify buried and exposed residues solely from the positions of C alpha atoms resulted in an accuracy of 84%, sensitivity of 83-89% and specificity of 67-94% while recognition of interfacial residues corresponded to an accuracy of 94%, sensitivity of 70-96% and specificity of 58-94%. Interestingly, detailed analysis of cases of mismatch between recognition of interface residues from C alpha positions and all-atom models suggested that, recognition of interfacial residues using C alpha atoms only correspond better with intuitive notion of what is an interfacial residue. Our method should be useful in the objective analysis of structures of protein assemblies when positions of only C alpha positions are available as, for example, in the cases of integration of cryo-EM data and high resolution structures of the components of the assembly.

Recognition and alignment of homologous DNA sequences between minichromosomes and single-stranded DNA promoted by RecA protein

The incorporation of DNA into nucleosomes and higher-order forms of chromatin in vivo creates difficulties with respect to its accessibility for cellular functions such as transcription, replication, repair and recombination. To understand the role of chromatin structure in the process of homologous recombination, we have studied the interaction of nucleoprotein filaments, comprised of RecA protein and ssDNA, with minichromosomes. Using this paradigm, we have addressed how chromatin structure affects the search for homologous DNA sequences, and attempted to distinguish between two mutually exclusive models of DNA-DNA pairing mechanisms. Paradoxically, we found that the search for homologous sequences, as monitored by unwinding of homologous or heterologous duplex DNA, was facilitated by nucleosomes, with no discernible effect on homologous pairing. More importantly, unwinding of minichromosomes required the interaction of nucleoprotein filaments and led to the accumulation of circular duplex DNA sensitive to nuclease P1. Competition experiments indicated that chromatin templates and naked DNA served as equally efficient targets for homologous pairing. These and other findings suggest that nucleosomes do not impede but rather facilitate the search for homologous sequences and establish, in accordance with one proposed model, that unwinding of duplex DNA precedes alignment of homologous sequences at the level of chromatin. The potential application of this model to investigate the role of chromosomal proteins in the alignment of homologous sequences in the context of cellular recombination is considered.

CD4+ alpha beta T cell and gamma delta T cell responses to Mycobacterium tuberculosis. Similarities and differences in Ag recognition, cytotoxic effector function, and cytokine production.

CD4+ and gamma delta T cells are activated readily by Mycobacterium tuberculosis. To examine their role in the human immune response to M. tuberculosis, CD4+ and gamma delta T cells from healthy tuberculin-positive donor were studied for patterns of Ag recognition, cytotoxicity, and cytokine production in response to M. tuberculosis-infected mononuclear phagocytes. Both T cell subsets responded to intact M. tuberculosis and its cytosolic Ags. However, CD4+ and gamma delta T cells differed in the range of cytosolic Ags recognized: reactivity to a wide m.w. range of Ags for CD4+ T cells, and a restricted pattern for gamma delta T cells, with dominance of Ags of 10 to 15 kDa. Both T cell subsets were equally cytotoxic for M. tuberculosis-infected monocytes. Furthermore, both CD4+ and gamma delta T cells produced large amounts of IFN-gamma: mean pg/ml of IFN-gamma in supernatants was 2458 +/- 213 for CD4+ and 2349 +/- 245 for gamma delta T cells. By filter-spot ELISA (ELISPOT), the frequency of IFN-gamma-secreting gamma delta T cells was one-half of that of CD4+ T cells in response to M. tuberculosis, suggesting that gamma delta T cells on a per cell basis were more efficient producers of IFN-gamma than CD4+ T cells. In contrast, CD4+ T cells produced more IL-2 than gamma delta T cells, which correlated with diminished T cell proliferation of gamma delta T cells compared with CD4+ T cells. These results indicate that CD4+ and gamma delta T cell subsets have similar effector functions (cytotoxicity, IFN-gamma production) in response to M. tuberculosis-infected macrophages, despite differences in the Ags recognized, IL-2 production, and efficiency of IFN-gamma production.