Sentence Compression with Supervised Machine Learning

The subject of the thesis is automatic sentence compression with machine learning, so that the compressed sentences remain both grammatical and retain their essential meaning. There are multiple possible uses for the compression of natural language sentences. In this thesis the focus is generation of television program subtitles, which often are compressed version of the original script of the program. The main part of the thesis consists of machine learning experiments for automatic sentence compression using different approaches to the problem. The machine learning methods used for this work are linear-chain conditional random fields and support vector machines. Also we take a look which automatic text analysis methods provide useful features for the task. The data used for machine learning is supplied by Lingsoft Inc. and consists of subtitles in both compressed an uncompressed form. The models are compared to a baseline system and comparisons are made both automatically and also using human evaluation, because of the potentially subjective nature of the output. The best result is achieved using a CRF - sequence classification using a rich feature set. All text analysis methods help classification and most useful method is morphological analysis. Tutkielman aihe on suomenkielisten lauseiden automaattinen tiivistäminen koneellisesti, niin että lyhennetyt lauseet säilyttävät olennaisen informaationsa ja pysyvät kieliopillisina. Luonnollisen kielen lauseiden tiivistämiselle on monta käyttötarkoitusta, mutta tässä tutkielmassa aihetta lähestytään television ohjelmien tekstittämisen kautta, johon käytännössä kuuluu alkuperäisen tekstin lyhentäminen televisioruudulle paremmin sopivaksi. Tutkielmassa kokeillaan erilaisia koneoppimismenetelmiä tekstin automaatiseen lyhentämiseen ja tarkastellaan miten hyvin erilaiset luonnollisen kielen analyysimenetelmät tuottavat informaatiota, joka auttaa näitä menetelmiä lyhentämään lauseita. Lisäksi tarkastellaan minkälainen lähestymistapa tuottaa parhaan lopputuloksen. Käytetyt koneoppimismenetelmät ovat tukivektorikone ja lineaarisen sekvenssin mallinen CRF. Koneoppimisen tukena käytetään tekstityksiä niiden eri käsittelyvaiheissa, jotka on saatu Lingsoft OY:ltä. Luotuja malleja vertaillaan Lopulta mallien lopputuloksia evaluoidaan automaattisesti ja koska teksti lopputuksena on jossain määrin subjektiivinen myös ihmisarviointiin perustuen. Vertailukohtana toimii kirjallisuudesta poimittu menetelmä. Tutkielman tuloksena paras lopputulos saadaan aikaan käyttäen CRF sekvenssi-luokittelijaa laajalla piirrejoukolla. Kaikki kokeillut teksin analyysimenetelmät auttavat luokittelussa, joista tärkeimmän panoksen antaa morfologinen analyysi.

Formal modelling for digital media distribution

Human beings have always strived to preserve their memories and spread their ideas. In the beginning this was always done through human interpretations, such as telling stories and creating sculptures. Later, technological progress made it possible to create a recording of a phenomenon; first as an analogue recording onto a physical object, and later digitally, as a sequence of bits to be interpreted by a computer. By the end of the 20th century technological advances had made it feasible to distribute media content over a computer network instead of on physical objects, thus enabling the concept of digital media distribution. Many digital media distribution systems already exist, and their continued, and in many cases increasing, usage is an indicator for the high interest in their future enhancements and enriching. By looking at these digital media distribution systems, we have identified three main areas of possible improvement: network structure and coordination, transport of content over the network, and the encoding used for the content. In this thesis, our aim is to show that improvements in performance, efficiency and availability can be done in conjunction with improvements in software quality and reliability through the use of formal methods: mathematical approaches to reasoning about software so that we can prove its correctness, together with the desirable properties. We envision a complete media distribution system based on a distributed architecture, such as peer-to-peer networking, in which different parts of the system have been formally modelled and verified. Starting with the network itself, we show how it can be formally constructed and modularised in the Event-B formalism, such that we can separate the modelling of one node from the modelling of the network itself. We also show how the piece selection algorithm in the BitTorrent peer-to-peer transfer protocol can be adapted for on-demand media streaming, and how this can be modelled in Event-B. Furthermore, we show how modelling one peer in Event-B can give results similar to simulating an entire network of peers. Going further, we introduce a formal specification language for content transfer algorithms, and show that having such a language can make these algorithms easier to understand. We also show how generating Event-B code from this language can result in less complexity compared to creating the models from written specifications. We also consider the decoding part of a media distribution system by showing how video decoding can be done in parallel. This is based on formally defined dependencies between frames and blocks in a video sequence; we have shown that also this step can be performed in a way that is mathematically proven correct. Our modelling and proving in this thesis is, in its majority, tool-based. This provides a demonstration of the advance of formal methods as well as their increased reliability, and thus, advocates for their more wide-spread usage in the future.

Catching up with competitiveness in emerging markets – An analysis of the role of the firm’s technology management strategies

Emerging markets have experienced rapid economic growth, and manufacturing firms have had to face the effects of globalisation. Some of the major emerging economies have been able to create a supportive business environment that fosters innovation, and China is a good example of a country that has been able to increase value-added investments. Conversely, when we look at Russia, another big emerging market, we witness a situation in which domestic firms struggle more with global competitiveness. Innovation has proven to be one of the most essential ingredients for firms aiming to grow and become more competitive. In emerging markets, the business environment sets many constraints for innovation. However, open strategic choices in new product development enable companies in emerging markets to expand their resource base and capability building. Networking and close inter-firm cooperation are essential in this regard. In this dissertation, I argue that technology transfer is one of the key tools for these companies to become internationally networked and to improve their competitiveness. It forces companies to reach outside the company and national borders, which in many cases, is a major challenge for firms in emerging markets. This dissertation focuses on how companies can catch up with competitiveness in emerging markets. The empirical studies included in the dissertation are based on analyses of survey data mainly of firms and their strategies in the Russian manufacturing industry. The dissertation contributes to the current strategic management literature by further investigating technology management strategies in manufacturing firms in emerging markets and the benefits of more open approaches to new product development and innovation.

Organisational purchasing of service design – Agency and client perspectives

There has been an increase in the interest in service design, as companies have become more customer-centric and their focus has shifted to customer experiences. The actual organisational purchasing of service design has been given little attention, until recent years. The purpose of this study is to explore the purchasing of service design from the perspectives of sellers (service design agencies) and buying clients (business organisations). In order to understand the phenomenon, also agencies and clients’ approaches to service design discipline, purchasing processes, challenges related to purchasing and ways of facilitating the purchasing are explored. The research follows qualitative research method and utilises abductive reasoning. A proposition framework was formed by combining services marketing, design and organisational buying behaviour literatures, and was tested against real-life business cases. Empirical data was gathered by interviewing eight service design agency representatives and five client representatives in Finland. The results of semi-structural interviews were analysed by finding repetitive themes. The proposition framework was updated according to interview findings. There were both similarities and differences in service design agencies and clients’ approaches to service design. Service design represents a strategic activity to both parties, and it helps in clients’ business development and in discovering opportunities. It is an ideology; a way of thinking and working. The driving force for purchasing service design seemed to be something else than service design itself. Projects have been bought for 1) change and innovation related development, 2) channel related development or for 3) customer experience related development. Seven purchasing challenge themes were recognised: 1) poor or differing service design understanding, 2) selling of service design, 3) varying expectations, 4) difficulty of pre-evaluation, 5) buyers and buying companies, 6) project process and nature and 7) unclear project results. These all can be considered to cause challenges in organisational service design purchasing. Challenges can be caused by either participant, the agency or the client, and take place at any point of the purchasing process. Some of the challenges could be considered as barriers to purchasing or they play a role in an unsuccessful service project – and therefore, result in an unsuccessful organisational purchase. Purchasing could be facilitated in various ways by either participant; some ways are more attitude based, others actionable improvements. Thesis’s theoretical and managerial findings can be utilised to both improve the selling and purchasing of service design services.

Dynamic ecosystems under anthropogenic stress : how does macrotidal sandy fauna respond to green tides?

Highly dynamic systems, often considered as resilient systems, are characterised by abiotic and biotic processes under continuous and strong changes in space and time. Because of this variability, the detection of overlapping anthropogenic stress is challenging. Coastal areas harbour dynamic ecosystems in the form of open sandy beaches, which cover the vast majority of the world’s ice-free coastline. These ecosystems are currently threatened by increasing human-induced pressure, among which mass-development of opportunistic macroalgae (mainly composed of Chlorophyta, so called green tides), resulting from the eutrophication of coastal waters. The ecological impact of opportunistic macroalgal blooms (green tides, and blooms formed by other opportunistic taxa), has long been evaluated within sheltered and non-tidal ecosystems. Little is known, however, on how more dynamic ecosystems, such as open macrotidal sandy beaches, respond to such stress. This thesis assesses the effects of anthropogenic stress on the structure and the functioning of highly dynamic ecosystems using sandy beaches impacted by green tides as a study case. The thesis is based on four field studies, which analyse natural sandy sediment benthic community dynamics over several temporal (from month to multi-year) and spatial (from local to regional) scales. In this thesis, I report long-lasting responses of sandy beach benthic invertebrate communities to green tides, across thousands of kilometres and over seven years; and highlight more pronounced responses of zoobenthos living in exposed sandy beaches compared to semi-exposed sands. Within exposed sandy sediments, and across a vertical scale (from inshore to nearshore sandy habitats), I also demonstrate that the effects of the presence of algal mats on intertidal benthic invertebrate communities is more pronounced than that on subtidal benthic invertebrate assemblages, but also than on flatfish communities. Focussing on small-scale variations in the most affected faunal group (i.e. benthic invertebrates living at low shore), this thesis reveals a decrease in overall beta-diversity along a eutrophication-gradient manifested in the form of green tides, as well as the increasing importance of biological variables in explaining ecological variability of sandy beach macrobenthic assemblages along the same gradient. To illustrate the processes associated with the structural shifts observed where green tides occurred, I investigated the effects of high biomasses of opportunistic macroalgae (Ulva spp.) on the trophic structure and functioning of sandy beaches. This work reveals a progressive simplification of sandy beach food web structure and a modification of energy pathways over time, through direct and indirect effects of Ulva mats on several trophic levels. Through this thesis I demonstrate that highly dynamic systems respond differently (e.g. shift in δ13C, not in δ15N) and more subtly (e.g. no mass-mortality in benthos was found) to anthropogenic stress compared to what has been previously shown within more sheltered and non-tidal systems. Obtaining these results would not have been possible without the approach used through this work; I thus present a framework coupling field investigations with analytical approaches to describe shifts in highly variable ecosystems under human-induced stress.