Contributions to the Theory of Finite-State Based Grammars

This dissertation is a theoretical study of finite-state based grammars used in natural language processing. The study is concerned with certain varieties of finite-state intersection grammars (FSIG) whose parsers define regular relations between surface strings and annotated surface strings. The study focuses on the following three aspects of FSIGs: (i) Computational complexity of grammars under limiting parameters In the study, the computational complexity in practical natural language processing is approached through performance-motivated parameters on structural complexity. Each parameter splits some grammars in the Chomsky hierarchy into an infinite set of subset approximations. When the approximations are regular, they seem to fall into the logarithmic-time hierarchyand the dot-depth hierarchy of star-free regular languages. This theoretical result is important and possibly relevant to grammar induction. (ii) Linguistically applicable structural representations Related to the linguistically applicable representations of syntactic entities, the study contains new bracketing schemes that cope with dependency links, left- and right branching, crossing dependencies and spurious ambiguity. New grammar representations that resemble the Chomsky-Schützenberger representation of context-free languages are presented in the study, and they include, in particular, representations for mildly context-sensitive non-projective dependency grammars whose performance-motivated approximations are linear time parseable. (iii) Compilation and simplification of linguistic constraints Efficient compilation methods for certain regular operations such as generalized restriction are presented. These include an elegant algorithm that has already been adopted as the approach in a proprietary finite-state tool. In addition to the compilation methods, an approach to on-the-fly simplifications of finite-state representations for parse forests is sketched. These findings are tightly coupled with each other under the theme of locality. I argue that the findings help us to develop better, linguistically oriented formalisms for finite-state parsing and to develop more efficient parsers for natural language processing. Avainsanat: syntactic parsing, finite-state automata, dependency grammar, first-order logic, linguistic performance, star-free regular approximations, mildly context-sensitive grammars

Changes in Beer Labels and their Meaning : A Holistic Approach to the Semiosic Process

The purpose of this study is to find a framework for a holistic approach to, and form a conceptual toolbox for, investigating changes in signs and in their interpretation. Charles S. Peirce s theory of signs in a communicative perspective is taken as a basis for the framework. The concern directing the study is the problem of a missing framework in analysing signs of visual artefacts from a holistic perspective as well as that of the missing conceptual tools. To discover the possibility of such a holistic approach to semiosic processes and to form a conceptual toolbox the following issues are discussed: i) how the many Objects with two aspects involved in Peirce s definition of sign-action, promote multiple semiosis arising from the same sign by the same Interpretant depending on the domination of the Objects; ii) in which way can the relation of the individual and society or group be made more apparent in the construction of the self since this construction is intertwined with the process of meaning-creation and interpretation; iii) how to account for the fundamental role of emotions in semiosis, and the relation of emotions with the often neglected topic of embodiment; iv) how to take into account the dynamic, mediating and processual nature of sign-action in analysing and understanding the changes in signs and in the interpretation of signs. An interdisciplinary approach is chosen for this dissertation. Concepts that developed within social psychology, developmental psychology, neurosciences and semiotics, are discussed. The common aspect of the approaches is that they in one way or another concentrate on mediation provided by signs in explaining human activity and cognition. The holistic approach and conceptual toolbox found are employed in a case study. This consists of an analysis of beer brands including a comparison of brands from two different cultures. It becomes clear that different theories and approaches have mutual affinities and do complement each other. In addition, the affinities in different disciplines somewhat provide credence to the various views. From the combined approach described, it becomes apparent that by the semiosic process, the emerging semiotic self intertwined with the Umwelt, including emotions, can be described. Seeing the interpretation and meaning-making through semiosis allows for the analysis of groups, taking into account the embodied and emotional component. It is concluded that emotions have a crucial role in all human activity, including so-called reflective thinking, and that emotions and embodiment should be consciously taken into account in analysing signs, the interpretation, and in changes of signs and interpretations from both the social and individual level. The analysis of the beer labels expresses well the intertwined nature of the relationship between signs, individual consumers and society. Many direct influences from society on the label design are found, and also some indirect attitude changes that become apparent from magazines, company reports, etc. In addition, the analysis brings up the issues of the unifying tendency of the visual artefacts of different cultures, but also demonstrates that the visual artefacts are able to hold the local signs and meanings, and sometimes are able to represent the local meanings although the signs have changed in the unifying process.

The influence of HIV infection to the periodontium; a clinical, microbiological, and enzymological study

The main targets of human immunodeficiency virus (HIV) are CD4 receptors of CD4+ lymphocytes and many other cells such as monocytes/macrophages, megakaryocytes, peripheral blood dendritic cells, follicular dendritic cells (DC), epidermal Langerhans cells, and astrocytes. Infection and killing of CD4+ lymphocytes or false reaction of the body to HIV infection and the spontaneous apoptosis of CD4+ lymphocytes decrease CD4+ lymphocyte counts leading to immunosuppression, further disease progression, and appearance of opportunistic infections and malignancies. Oral manifestations are considered to be among the first signs of HIV infection. Enhanced degradation of extracellular matrix and basement membrane components in oral diseases including periodontitis is caused by Zn-dependent enzymes called matrix metalloproteinases (MMPs). The levels and degrees of activation of MMP-1, -2, -3, -7, -8, -9, -25, -26, tissue inhibitors of MMPs (TIMP)-1 and -2, and myeloperoxidase (MPO) and collagenolytic/gelatinolytic activities, and also Ig A, -G, and -M, total protein, and albumin levels in a two-year follow-up were studied from salivary samples. The expression of MMP-7, -8, -9, -25, and -26 immunoreactivities in gingival tissue specimens were studied. Healthy HIV-negative subjects served as controls. All studied clinical periodontal parameters and microbiological evaluation of the periodontopathogens showed that periodontal health of the HIV-positive patients was moderately decreased in comparison to the healthy controls. The levels of Candida in the periodontal pockets and salivary MPO increased with the severity of HIV infection. Immunoreactivities and levels of MMPs and TIMPs, and MMP activities (collagenase, gelatinase) were enhanced in the HIV-positive patient salivary samples relative to the healthy controls regardless of the phase of HIV infection. However, these parameters did not reflect periodontal status in a similar way as in the generally healthy periodontitis patients. Salivary total protein, albumin, IgA, -G, and -M levels were significantly higher in all phases of HIV infection compared to the controls, and salivary total protein, IgG and IgM levels remained higher after two years follow-up, partly correlating with the disease progression and which may reflect the leakage of serum components into the mouth and thus a decreased mucosal barrier. Salivary analyses of MMPs and TIMPs with immunohistochemical analyses showed that HIV infection could predispose to periodontal destruction when compared with healthy controls or the body s defence reactions associated with HIV infection may have been reflected or mediated by MMPs.

Tannakian Formalism Applied to the Category of Mixed Hodge Structures

Many problems in analysis have been solved using the theory of Hodge structures. P. Deligne started to treat these structures in a categorical way. Following him, we introduce the categories of mixed real and complex Hodge structures. Category of mixed Hodge structures over the field of real or complex numbers is a rigid abelian tensor category, and in fact, a neutral Tannakian category. Therefore it is equivalent to the category of representations of an affine group scheme. The direct sums of pure Hodge structures of different weights over real or complex numbers can be realized as a representation of the torus group, whose complex points is the Cartesian product of two punctured complex planes. Mixed Hodge structures turn out to consist of information of a direct sum of pure Hodge structures of different weights and a nilpotent automorphism. Therefore mixed Hodge structures correspond to the representations of certain semidirect product of a nilpotent group and the torus group acting on it.

A Probabilistic Approach to the Primary Visual Cortex

What can the statistical structure of natural images teach us about the human brain? Even though the visual cortex is one of the most studied parts of the brain, surprisingly little is known about how exactly images are processed to leave us with a coherent percept of the world around us, so we can recognize a friend or drive on a crowded street without any effort. By constructing probabilistic models of natural images, the goal of this thesis is to understand the structure of the stimulus that is the raison d etre for the visual system. Following the hypothesis that the optimal processing has to be matched to the structure of that stimulus, we attempt to derive computational principles, features that the visual system should compute, and properties that cells in the visual system should have. Starting from machine learning techniques such as principal component analysis and independent component analysis we construct a variety of sta- tistical models to discover structure in natural images that can be linked to receptive field properties of neurons in primary visual cortex such as simple and complex cells. We show that by representing images with phase invariant, complex cell-like units, a better statistical description of the vi- sual environment is obtained than with linear simple cell units, and that complex cell pooling can be learned by estimating both layers of a two-layer model of natural images. We investigate how a simplified model of the processing in the retina, where adaptation and contrast normalization take place, is connected to the nat- ural stimulus statistics. Analyzing the effect that retinal gain control has on later cortical processing, we propose a novel method to perform gain control in a data-driven way. Finally we show how models like those pre- sented here can be extended to capture whole visual scenes rather than just small image patches. By using a Markov random field approach we can model images of arbitrary size, while still being able to estimate the model parameters from the data.

A Soul for Europe? : Contributions of European Churches to the Forum of the Convention on the Future of Europe

The aim of this research was to study how European churches contributed to the shaping of the Constitutional Treaty during the work of the Convention on the future of Europe through the public discussion forum, established by the Convention for this specific purpose in the years 2002 2003. In particular, this study sought to uncover the areas of interest brought up by the churches in their contributions, the objectives they pursued, and the approaches and arguments they employed to reach those objectives. The data for this study comprised all official submissions by European churches and church alliances to the Forum, totalling 21 contributions. A central criterion for inclusion of the data was that the organization can reasonably be assumed to represent the official position of one or more Christian churches within the European Union before the 2004 expansion. The contributing churches and organizations represent the vast majority of Christians in Europe. The data was analyzed using primarily qualitative content analysis. The research approach was a combination of abductive and inductive inference. Based on the analysis a two-fold theoretical framework was adopted, focusing on theories of public religion, secularization and deprivatization of religion, and of legitimation and collective identity. The main areas of interest found in the contributions of the churches were the value foundation of the European Union, which is demanded to coherently permeate all policies and actions of the EU, and the social dimension of Europe, which must be given equal status to the political and economic dimensions. In both areas the churches claim significant experience and expertise, which they want to see recognized in the Constituional Treaty through a formally guaranteed status for churches and religious communities in the EU. In their contributions the churches show a strong determination to secure a significant role for both religion and religious communities in the public life of Europe. As for the role of religion, they point out to its potential as a motivating and cohesive force in society and as a building block for a collective European identity, which is still missing. Churches also pursue a substantial public role for themselves beyond the spiritual dimension, permeating the secular areas of the social, political and economic dimensions. The arguments in suppport of such role are embedded in their interest and expertise in spiritual and other fundamental values and their broad involvement in providing social services. In this context churches use expressions inclusive of all religions and convictions, albeit clearly advocating the primacy of Europe's Christian heritage. Based on their historical role, their social involvement and their spiritual mission they use the public debate on the Constitutional Treaty to gain formal legitimacy for the public status of religion and religious communities, both nationally and on a European level, through appropriate provisions in the constitutional text. In return they offer the European Union ways of improving its own legitimacy by reducing the democratic and ideological deficit of the EU and advancing the development a collective European identity.

From the river to the open sea - a critical life phase of young Atlantic salmon migrating from the Simojoki river

Long-term monitoring data collected from wild smolts of Atlantic salmon (Salmo salar) in the Simojoki river, northern Finland, were used in studying the relationships between the smolt size and age, smolt and postsmolt migration, environmental conditions and postsmolt survival. The onset of the smolt run was significantly dependent on the rising water temperature and decreasing discharge of the river in the spring. The mean length of smolts migrating early in the season was commonly higher and the mean age always older than among smolts migrating later. Many of the smolts migrating early in the season and almost all smolts migrating later had started their new growth in spring in the river before their sea entry. Among postsmolts, the time required for emigration from the estuary was dependent on the sea surface temperature (SST) off the river, being significantly shorter in years with warm than cold sea temperatures. After leaving the estuary, the postsmolts migrated southwards along the eastern coast of the northern Gulf of Bothnia, the geographical distribution of the tag recoveries coinciding with the warm thermal zone in spring in the coastal area. After arriving in the southern Gulf of Bothnia in late summer the postsmolts mostly migrated near the western coast, reaching the Baltic Main Basin in late autumn. Until the early 1990s there was only a weak positive association between smolt length and postsmolt survival. However, following a subsequent decrease in the mean smolt size, a significant positive dependence was observed between smolt size and the reported recapture rate of tagged salmon. The differences in recapture rates between smolts tagged during the first and second half of the annual migration season were insignificant, indicating that the seasonal variation in smolt size and age seem to be too small to affect survival. Among the climatic factors examined, the summer SST in the Gulf of Bothnia was most clearly related to the survival of the wild postsmolts. Postsmolt survival appeared to be highest in years when the SST in June in the Bothnian Bay varied between 9 and 12 ºC. In addition, the survival of wild postsmolts showed a significant positive dependence on the SST in July in the Bothnian Sea, but not on the abundance of the prey fish (0+ herring, Clupea harengus and sprat, Sprattus sprattus) in the Bothnian Sea and in the Baltic Main Basin. The results suggest, that if the incidence of extreme weather conditions were to increase due to climatic changes, it would probably reduce the postsmolt survival of wild salmon populations. For improving the performance of hatchery-reared smolts, it could be useful to examine opportunities to produce smolts that are in their smolt traits and abilities more similar to the wild smolts described in this thesis.