Kernel-Based Ranking. Methods for Learning and Performance Estimation

Machine learning provides tools for automated construction of predictive models in data intensive areas of engineering and science. The family of regularized kernel methods have in the recent years become one of the mainstream approaches to machine learning, due to a number of advantages the methods share. The approach provides theoretically well-founded solutions to the problems of under- and overfitting, allows learning from structured data, and has been empirically demonstrated to yield high predictive performance on a wide range of application domains. Historically, the problems of classification and regression have gained the majority of attention in the field. In this thesis we focus on another type of learning problem, that of learning to rank. In learning to rank, the aim is from a set of past observations to learn a ranking function that can order new objects according to how well they match some underlying criterion of goodness. As an important special case of the setting, we can recover the bipartite ranking problem, corresponding to maximizing the area under the ROC curve (AUC) in binary classification. Ranking applications appear in a large variety of settings, examples encountered in this thesis include document retrieval in web search, recommender systems, information extraction and automated parsing of natural language. We consider the pairwise approach to learning to rank, where ranking models are learned by minimizing the expected probability of ranking any two randomly drawn test examples incorrectly. The development of computationally efficient kernel methods, based on this approach, has in the past proven to be challenging. Moreover, it is not clear what techniques for estimating the predictive performance of learned models are the most reliable in the ranking setting, and how the techniques can be implemented efficiently. The contributions of this thesis are as follows. First, we develop RankRLS, a computationally efficient kernel method for learning to rank, that is based on minimizing a regularized pairwise least-squares loss. In addition to training methods, we introduce a variety of algorithms for tasks such as model selection, multi-output learning, and cross-validation, based on computational shortcuts from matrix algebra. Second, we improve the fastest known training method for the linear version of the RankSVM algorithm, which is one of the most well established methods for learning to rank. Third, we study the combination of the empirical kernel map and reduced set approximation, which allows the large-scale training of kernel machines using linear solvers, and propose computationally efficient solutions to cross-validation when using the approach. Next, we explore the problem of reliable cross-validation when using AUC as a performance criterion, through an extensive simulation study. We demonstrate that the proposed leave-pair-out cross-validation approach leads to more reliable performance estimation than commonly used alternative approaches. Finally, we present a case study on applying machine learning to information extraction from biomedical literature, which combines several of the approaches considered in the thesis. The thesis is divided into two parts. Part I provides the background for the research work and summarizes the most central results, Part II consists of the five original research articles that are the main contribution of this thesis.

Organisational learning and knowledge acquisition. A case study of internationalising manufacturers of wood-based prefabricated buildings

The study investigates organisational learning and knowledge acquisition of wood-based prefabricated building manufacturers. This certain group of case companies was chosen, because their management and their employees generally have a strong manufacturing and engineering background, while the housing sector is characterised by national norms, regulations, as well as local building styles. Considering this setting, it was investigated, how the case companies develop organisational learning capabilities, acquire and transfer knowledge for their internationalisation. The theoretical framework of this study constitutes the knowledge-based conceptualisation of internationalisation, which combines the traditional internationalisation process, as well as the international new venture perspective based on their commonalities in the knowledge-based view of the firm. Different theories of internationalisation, including the network-perspective, were outlined and a framework on organisational learning and knowledge acquisition was established. The empirical research followed a qualitative approach, deploying a multiple-case study with five case companies from Austria, Finland and Germany. In the study, the development of the wood-based prefabricated building industry and of the case companies are described, and the motives, facilitators and challenges for foreign expansion, as well as the companies’ internationalisation approaches are compared. Different methods of how companies facilitate the knowledge-exchange or learn about new markets are also outlined. Experience, market knowledge and personal contacts are considered essential for the internationalisation process. The major finding of the study is that it is not necessary to acquire the market knowledge internally in a slow process as proposed by the Uppsala model. In four cases companies engaged knowledge in symbiotic relations with local business partners. Thereby, the building manufacturers contribute their design and production capabilities, and in return, their local partners provide them with knowledge about the market and local regulations; while they manage the sales and construction operations. Thus, the study provides strong evidence for the propositions of network perspective. One case company developed the knowledge internally in a gradual process: it entered the market sequentially with several business lines, showing an increasing level of complexity. In both of the observed strategies, single-loop and double-loop learning processes occurred.

The nature of communication structures of university students in an international web-based computer-supported collaborative learning (CSCL) course

Communication, the flow of ideas and information between individuals in a social context, is the heart of educational experience. Constructivism and constructivist theories form the foundation for the collaborative learning processes of creating and sharing meaning in online educational contexts. The Learning and Collaboration in Technology-enhanced Contexts (LeCoTec) course comprised of 66 participants drawn from four European universities (Oulu, Turku, Ghent and Ramon Llull). These participants were split into 15 groups with the express aim of learning about computer-supported collaborative learning (CSCL). The Community of Inquiry model (social, cognitive and teaching presences) provided the content and tools for learning and researching the collaborative interactions in this environment. The sampled comments from the collaborative phase were collected and analyzed at chain-level and group-level, with the aim of identifying the various message types that sustained high learning outcomes. Furthermore, the Social Network Analysis helped to view the density of whole group interactions, as well as the popular and active members within the highly collaborating groups. It was observed that long chains occur in groups having high quality outcomes. These chains were also characterized by Social, Interactivity, Administrative and Content comment-types. In addition, high outcomes were realized from the high interactive cases and high-density groups. In low interactive groups, commenting patterned around the one or two central group members. In conclusion, future online environments should support high-order learning and develop greater metacognition and self-regulation. Moreover, such an environment, with a wide variety of problem solving tools, would enhance interactivity.