Pretraining Convolutional Neural Networks for Visual Recognition

Convolutional Neural Networks (CNN) have become the state-of-the-art methods on many large scale visual recognition tasks. For a lot of practical applications, CNN architectures have a restrictive requirement: A huge amount of labeled data are needed for training. The idea of generative pretraining is to obtain initial weights of the network by training the network in a completely unsupervised way and then fine-tune the weights for the task at hand using supervised learning. In this thesis, a general introduction to Deep Neural Networks and algorithms are given and these methods are applied to classification tasks of handwritten digits and natural images for developing unsupervised feature learning. The goal of this thesis is to find out if the effect of pretraining is damped by recent practical advances in optimization and regularization of CNN. The experimental results show that pretraining is still a substantial regularizer, however, not a necessary step in training Convolutional Neural Networks with rectified activations. On handwritten digits, the proposed pretraining model achieved a classification accuracy comparable to the state-of-the-art methods.

Innovations of ageing and societal transition : Dynamics of change of the socio-technical regime of ageing

The purpose of this dissertation is to examine the dynamics of the socio-technical system in the field of ageing. The study stems from the notion that the ageing of the population as a powerful megatrend has wide societal effects, and is not just a matter for the social and health sector. The central topic in the study is change: not only the age structures and structures of society are changing, but also at the same time there is constant development, for instance, in technologies, infrastructures and cultural perceptions. The changing concept of innovation has widened the understanding of innovations related to ageing from medical and assistive technological innovations to service and social innovations, as well as systemic innovations at different levels, which means the intertwined and co-evolutionary change in technologies, structures, services and thinking models. By the same token, the perceptions of older people and old age are becoming more multi-faceted: old age is no longer equated to illnesses and decline, but visions of active ageing and a third age have emerged, which are framed by choices, opportunities, resources and consumption in later life. The research task in this study is to open up the processes and mechanisms of change in the field of ageing, which are studied as a complex, multi-level and interrelated socio-technical system. The question is about co-effective elements consisting of macro-level landscape changes, the existing socio-technical regime (the rule system, practices and structures) and bottom-up niche-innovations. Societal transitions do not account for the things inside the regime alone, or for the long-term changes in the landscape, nor for the radical innovations, but for the interplay between all these levels. The research problem is studied through five research articles, which offer micro-level case studies to macro-level phenomenon. Each of the articles focus on different aspects related to ageing and change, and utilise various datasets. The framework of this study leans on the studies of socio-technical systems and multi-level perspective on transitions mainly developed by Frank Geels. Essential factors in transition from one socio-technological regime to another are the co-evolutionary processes between landscape changes, regime level and experimental niches. Landscape level changes, like the ageing of the population, destabilise the regime in the forms of coming pressures. This destabilization offers windows for opportunity to niche-innovations outside or at fringe of the regime, which, through their breakthrough, accelerate the transition process. However, the change is not easy because of various kinds of lock-ins and inertia, which tend to maintain the stability of the regime. In this dissertation, a constructionist approach of society is applied leaning mainly to the ideas of Anthony Giddens’ theory of structuration, with the dual nature of structures. The change is taking place in the interplay between actors and structures: structures shape people’s practices, but at the same time these practices constitute and reproduce social systems. Technology and other material aspects, as part of socio-technical systems, and the use of them, also take part in the structuration process. The findings of the study point out that co-evolutionary and co-effective relationships between economic, cultural, technological and institutional fields, as well as relationships between landscape changes, changes in the local and regime-level practices and rule systems, are a very complex and multi-level dynamic socio-technical phenomenon. At the landscape level of ageing, which creates the pressures and triggers to the regime change, there are three remarkable megatrends: demographic change, changes in the global economy and the development of technologies. These exert pressures to the socio-technical regime, which as a rule system is experiencing changes in the form of new markets and consumer habits, new ways of perceiving ageing, new models of organising the health care and other services and as new ways of considering innovation and innovativeness. There are also inner dynamics in the relationships between these aspects within the regime. These are interrelated and coconstructed: the prevailing perceptions of ageing and innovation, for instance, reflect the ageing policies, innovation policies, societal structures, organising models, technology and scientific discussion, and vice versa. Technology is part of the inner dynamics of the sociotechnological regime. Physical properties of the artefacts set limitations and opportunities with regard to their functions and uses. The use of and discussion about technology, contributes producing and reproducing the perceptions of old age. For societal transition, micro-level changes are also needed, in form of niche-innovations, for instance new services, organisational models or new technologies, Regimes, as stabilitystriven systems, tend to generate incremental innovations, but radically new innovations are generated in experimental niches protected from ‘normal’ market selection. The windows of opportunity for radical novelties may be opened if the circumstances are favourable for instance by tensions in the socio-technical regime affected by landscape level changes. This dissertation indicates that a change is taking place, firstly, in the dynamic interactionbetween levels, as a result of purposive action and governance to some extent. Breaking the inertia and using the window of opportunity for change and innovation offered by dynamics between levels, presupposes the actors’ special capabilities and actions such as dynamic capabilities and distance management. Secondly, the change is taking place the socio-technological negotiations inside the regime: interaction between technological and social, which is embodied in the use of technology. The use of technology includes small-level contextual scripts that also participate in forming broader societal scripts (for instance defining old age at the society level), which in their turn affect the formation of policies for innovation and ageing. Thirdly, the change is taking place by the means of active formation of the multi-actor innovation networks, where the role of distance management is crucial to facilitate the communication between actors coming from different backgrounds as well as to help the niches born outside the regime to utilise the window of opportunity offered by regime destabilisation. This dissertation has both theoretical and practical contributions. This study participates in the discussion of action-oriented view on transition by opening up of the socio-technological, coevolutionary processes of the multi-faceted phenomenon of ageing, which has lacked systematic analyses. The focus of this study, however, is not on the large-scale coordination and governance, but rather on opening up the incremental elements and structuration processes, which contribute to the transition little by little, and which can be affected to. This increases the practical importance of this dissertation, by highlighting the importance of very tiny, everyday elements in the change processes in the long run.

Rural Food System Change in Tanzania during the Post-Ujamaa Era. A Case Study from Western Bagamoyo District

Food systems in Sub-Saharan Africa have been rapidly transforming during the recent decades with diverse outcomes on human development and environment. This study explores the food system change in rural villages in eastern Tanzania where subsistence agriculture has traditionally been the main source of livelihood. The focus is on the salient changes in the spatial dimensions and structural composition of the food system in the context of economic liberalization that has taken place after the end of the socialist ujamaa era in the mid-1980s. In addition, the linkages of the changes are examined in relation to food security, socio-economic situation, livelihoods, and local environment. The approach of the study is geographical, but also involves various multi-disciplinary elements, particularly from development studies. The research methods included thematic and questionnaire interviews, participatory tools, and the analysis of land use/ cover data and official documents. Several earlier studies that were made in the area during the late 1970s and 1980s provided an important reference base. The study shows that subsistence farming has lost its dominant role in food provisioning due to the declining productivity of land, livestock losses, and the increasing shift of labour to non-farm sectors. Also rapid population growth has added to the pressure on land and other natural resources. Despite the increasing need for money for buying marketed foods and other necessities, the nutritional situation shows improvement and severe malnutrition has diminished. However, the long-term sustainability of this transformation raises concerns. Firstly, the food security situation continues to be fragile and prone to shocks such as adverse climatic conditions, crop failures and price hikes. Secondly, the commodification of the food system and livelihoods in general is linked to rapid environmental degradation in the area, particularly the loss of soil fertility and deforestation. The situation calls for efforts that take more determined and holistic approaches towards sustainable development of the rural food system with particular focus on the role and viability of small-scale farming.

Recognition of nucleic acids by metal ion complexes

Metal-ion-mediated base-pairing of nucleic acids has attracted considerable attention during the past decade, since it offers means to expand the genetic code by artificial base-pairs, to create predesigned molecular architecture by metal-ion-mediated inter- or intra-strand cross-links, or to convert double stranded DNA to a nano-scale wire. Such applications largely depend on the presence of a modified nucleobase in both strands engaged in the duplex formation. Hybridization of metal-ion-binding oligonucleotide analogs with natural nucleic acid sequences has received much less attention in spite of obvious applications. While the natural oligonucleotides hybridize with high selectivity, their affinity for complementary sequences is inadequate for a number of applications. In the case of DNA, for example, more than 10 consecutive Watson-Crick base pairs are required for a stable duplex at room temperature, making targeting of sequences shorter than this challenging. For example, many types of cancer exhibit distinctive profiles of oncogenic miRNA, the diagnostics of which is, however, difficult owing to the presence of only short single stranded loop structures. Metallo-oligonucleotides, with their superior affinity towards their natural complements, would offer a way to overcome the low stability of short duplexes. In this study a number of metal-ion-binding surrogate nucleosides were prepared and their interaction with nucleoside 5´-monophosphates (NMPs) has been investigated by 1H NMR spectroscopy. To find metal ion complexes that could discriminate between natural nucleobases upon double helix formation, glycol nucleic acid (GNA) sequences carrying a PdII ion with vacant coordination sites at a predetermined position were synthesized and their affinity to complementary as well as mismatched counterparts quantified by UV-melting measurements.