Effective 20 newsgroups dataset cleaning

The rapid increase in the number of text documents available on the Internet has created pressure to use effective cleaning techniques. Cleaning techniques are needed for converting these documents to structured documents. Text cleaning techniques are one of the key mechanisms in typical text mining application frameworks. In this paper, we explore the role of text cleaning in the 20 newsgroups dataset, and report on experimental results.

Personporträttet som tidningsgenre : En närläsningsstudie med fokus på innehållsliga teman, berättarkonventioner och kön

The thesis The portrait interview as a newspaper genre. A qualitative close reading focussing on topical motifs, conventions of narration, and gender defines the portrait interview as a newspaper genre and analyses how the personalities in the portraits are constructed textually. The main body of material consists of 107 portrait interviews in two morning newspapers, Dagens Nyheter (published in Stockholm, Sweden) and Hufvudstadsbladet (published in Swedish in Helsinki, Finland), during two one-week periods (week 46/1999 and week 38/2002). There is also complementary material of 59 portraits from four magazines. The study is carried out within the research traditions of journalistic genre studies, gender and journalism, and critical text analysis. It is comprised of a qualitative close reading focussing on content (topical motifs or themes), conventions of narration, and gender. The methods used to carry out the study are qualitative close reading and quantitative content analysis. The analysis identifies the stylistic elements that differentiate the portrait genre from other journalistic genres, as well as from the autobiographical genre, and explores what opportunities and limitations these elements present for the inclusion of even more women protagonists in the portrait genre. The portrait interview is an exception from the critical mission of journalism in general, with its position as a genre of politeness. Since a typical characteristic of the portrait interview genre is that it pays tribute to the protagonist, the genre reveals the kind of personalities and lives that are seen as admirable in society. Four levels of portrait interview are defined: the prototype portrait, the pure portrait, the hybrid portrait and the marginal portrait. The prototype is a raw version of a portrait that fulfils the criteria but may be lacking in content and stylistics. The pure portrait does not lack these qualities and resembles an ideal portrait. The hybrid is a borderline case which relates to another genre or is a mixture between the portrait and some other genre, most commonly the news genre. The marginal portrait does not fulfil the criteria, and can therefore be seen as an inadequate portrait. For example, obituaries and caricatures are excluded if the protagonist s voice is never quoted. The analysis resulted in three factors that in part help to explain why the portrait interview genre has somewhat more female protagonists than journalistic news texts do in general. The four main reasons why women are presented somewhat more in the portrait genre than in other journalistic genres are: (i) women are shown as exceptions to the female norm when, for example, taking a typical male job or managing in positions where there are few women; (ii) women are shown as representing female themes ; (iii) use of the double bind as a story-generating factor; and (iv) the intimisation of journalism. The double bind usually builds up the narration on female ambiguity in the contradiction between private and public life, for example family and career, personal desire and work. The intimisation of journalism and the double bind give women protagonists somewhat more publicity also because of the tendency of portrait interviews to create conflicts within the protagonist, as an exception to journalism in general where conflicts are created or seen as existing between, for example, persons, groupings or parties. Women protagonists and their lives create an optimal narration of inner conflicts originating in the double bind as men are usually not seen as suffering from these conflicts. The analysis also resulted in gendered portrait norms: The feminine portrait norm and the masculine portrait norm or more concretely, professional life and family life as expectation and exception. Women are expected to be responsible parents and mediocre professionals, while men are expected to be professionals and in their free time engaging fathers. Key words: journalism, genre, portrait interview, gender, interview, newspaper, women s magazine.

Stor Anna, Liten Anna och tio andra personporträtt : Om innehållsliga och språkliga mönster i en mediegenres kvinnobeskrivningar

The aim of this licentiate thesis is to analyse how femininity is constructed in twelve portrait interviews of women in the dailies Dagens Nyheter (Stockholm) and Hufvudstadsbladet (Helsinki) in September 1996, and to explore the portrait interview as a media genre. The qualitative analysis has a feminist and constructionist perspective and is connected to critical text analysis. It was carried out on two levels: first, femininity is identified on the linguistic level by choice of words, and second on the level of content (topical motifs/themes). The portrait interview as a genre constitutes a third dimension in the analysis: The aim is not towards the identification of femininity, but rather towards the identification of the portrait interview a relatively unexplored media genre. References (Swedish: omtal) to the principal character (or protagonist) are traced mainly through reference chains which consist of names, pronouns and substantive phrases. The interviewees were referred to by their full names in Dagens Nyheter (with the exception of the oldest and youngest interviewees, both of whom were mainly referred to by their first names), while the style of reference varied more in Hufvudstadsbladet. The position of the principal character was also analysed through her relation in the text to minor characters from her working life and from her private life. These minor characters maintained their subordinate positions in all of the portraits except that of the youngest principal character, in which the subsidiary voices became at least as strong as the voice of the principal character. Three frequently-recurring topical motifs occurred in the portraits: The first involved explanations for the principal character s success divided into three categories, agent, affect and ambition, the second concerned using journeys or trips as symbols for turning points in life, and the third referred to the ambiguity in the contradiction between private (family/other private life) and public (work) life. This ambiguity is connected to the portrait interview as a text type (genre) which features conclusions at the end of portraits, which in turn is characteristic of reportage. However, the analysis showed that the conclusions of the portrait interviews often also included elements of ambiguity. This was evident in the contradictions be14 tween private and public life that arose in the portrait interviews that focused on these two spheres. The portraits that focused on the principal character s public life showed ambiguity on a more general level concerning questions about being a woman and having a profession, and they often ended with a description of some details of her private life. The women in the portraits were all constructed as being successful, in terms of having achieved direct success, reflective success or success in the form of life wisdom. The women of direct success were described as ambitious individuals with no sidetracks on their life paths, while those of reflective success were described as active heroines who had received help from different agents, who could use their affects as enriching ingredients in life, but who in the end had control over their own lives (life stories). The elderly women were constructed as having achieved life wisdom and their portraits were focused upon the past. The portrait interview as a genre is characterised by journalistic freedom (in relation to the more strict news genre), by a now room (Swedish nurum ) where the journalist meets the principal character (usually via spoken dialogue that she or he transforms into written text to be read by a mass-media audience) and by the relatively closed structure of the portrait. The portrait is relatively independent in relation to the news genre and in relation to the context of what has previously been written, what is being written at the time and what will be written in the future the principal character does not need to belong to the newspaper s usual gallery of actors. Furthermore, the principal character is constructed as being independent in relation to the subsidiary characters and other media actors. The conflict is within the principal character herself and within her life story, unlike the news genre in which equal actors are in conflict with each other. The portrait is also independent in relation to the news lifespan; the publishing timetable is not as strict as in the news genre, but is still dependent on the factors initiating the portrait. The enclosures consist of a raw analysis of two of twelve portrait interviews and of copies of all portraits.

Moral Education in the Japanese Primary School Curricular Revision at the Turn of the Twenty-first Century: Aiming at a Rich and Beautiful Kokoro

This study examines values education in Japanese schools at the beginning of the millennium. The topic was approached by asking the following three questions concerning the curricular background, the morality conveyed through textbooks and the characterization of moral education from a comparative viewpoint: 1) What role did moral education play in the curriculum revision which was initiated in 1998 and implemented in 2002? 2) What kinds of moral responsibilities and moral autonomy do the moral texts develop? 3) What does Japanese moral education look like in terms of the comparative framework? The research was based on curriculum research. Its primary empirical data consisted of the national curriculum guidelines for primary school, which were taken into use in 2002, and moral texts, Kokoro no nôto, published by the Ministry of Education in the same context. Since moral education was approached in the education reform context, the secondary research material involved some key documents of the revision process from the mid-1990s to 2003. The research material was collected during three fieldwork periods in Japan (in 2002, 2003 and 2005). The text-analysis was conducted as a theory-dependent qualitative content analysis. Japanese moral education was analyzed as a product of its own cultural tradition and societal answer to the current educational challenges. In order to understand better its character, secular moral education was reflected upon from a comparative viewpoint. The theory chosen for the comparative framework, the value realistic theory of education, represented the European rational education tradition as well as the Christian tradition of values education. Moral education, which was the most important school subject at the beginning of modern school, was eliminated from the curriculum for political reasons in a school reform after the Second World War, but has gradually regained a stronger position since then. It was reinforced particularly at the turn of millennium, when a curriculum revision attempted to respond to educational and learning problems by emphasizing qualitative and value aspects. Although the number of moral lessons and their status as a non-official-subject remained unchanged, the Ministry of Education made efforts to improve moral education by new curricular emphases, new teaching material and additional in-service training possibilities for teachers. The content of the moral texts was summarized in terms of moral responsibility in four moral areas (intrapersonal, interpersonal, natural-supranatural and societal) as follows: 1) continuous self-development, 2) caring for others, 3) awe of life and forces beyond human power, and 4) societal contribution. There was a social-societal and emotional emphasis in what was taught. Moral autonomy, which was studied from the perspectives of rational, affective and individuality development, stressed independence in action through self-discipline and responsibility more than rational self-direction. Japanese moral education can be characterized as the education of kokoro (heart) and the development of character, which arises from virtue ethics. It aims to overcome egoistic individualism by reciprocal and interdependent moral responsibility based on responsible interconnectedness.

FIN-CLARIN: A Framework for Depositing and Disseminating Language Resources for R&D

Researchers and developers in academia and industry would benefit from a facility that enables them to easily locate, licence and use the kind of empirical data they need for testing and refining their hypotheses and to deposit and disseminate their data e.g. to support replication and validation of reported scientific experiments. To answer these needs initially in Finland, there is an ongoing project at University of Helsinki and its collaborators to create a user-friendly web service for researchers and developers in Finland and other countries. In our talk, we describe ongoing work to create a palette of extensive but easily available Finnish language resources and technologies for the research community, including lexical resources, wordnets, morphologically tagged corpora, dependency syntactic treebanks and parsebanks, open-source finite state toolkits and libraries and language models to support text analysis and processing at customer site. Also first publicly available results are presented.

an empirical study on bug assignment automation using chinese bug data

Univ SE Calif, Ctr Syst & Software Engn, ABB, Microsoft Res, IEEE, ACMSIGSOFT, N Carolina State Univ Comp Sci

La idiosincrasia del lenguaje almodovariano y su repercusión sobre la traducción. Analisis de algunas de las soluciones en el campo de la variación lingüística del subtitulado en polaco de “Volver” (2006)

The identification of an original and idiosyncratic style in the work of the Spanish filmmaker Pedro Almodóvar provides the tone of the speech with a semantic function: linguistic variation and specific registers help to transmit the message and intention of the author. As a consequence of this, the possibilities for the translation being carried away in similar linguistic terms to those of the original text will be higher than in texts without linguistic peculiarities or stylistically unmarked. The purpose of this paper is to reflect on the influence exerted by the original author in the reception of his work abroad and, consequently, in its translation. In this sense, we will analyse the informative value of certain linguistic uses as well as the importance of enriching stylistically the subtitles in these connotative texts through the example of Almodóvar’s film "Volver" and its translation into Polish (2006).

Extracting Policy Positions from Political Texts Using words as Data

We present a new way of extracting policy positions from political texts that treats texts not as discourses to be understood and interpreted but rather, as data in the form of words. We compare this approach to previous methods of text analysis and use it to replicate published estimates of the policy positions of political parties in Britain and Ireland, on both economic and social policy dimensions. We “export” the method to a non-English-language environment, analyzing the policy positions of German parties, including the PDS as it entered the former West German party system. Finally, we extend its application beyond the analysis of party manifestos, to the estimation of political positions from legislative speeches. Our “language-blind” word scoring technique successfully replicates published policy estimates without the substantial costs of time and labor that these require. Furthermore, unlike in any previous method for extracting policy positions from political texts, we provide uncertainty measures for our estimates, allowing analysts to make informed judgments of the extent to which differences between two estimated policy positions can be viewed as significant or merely as products of measurement error.

Litteracitet i fem högstadieungdomars en-till-en-datorpraktiker

The study focuses on five lower secondary school pupils’ daily use of their one-toone computers, the overall aim being to investigate literacy in this form of computing. Theoretically, the study is rooted in the New Literacy tradition with an ecological perspective, in combination with socio-semiotic theory in a multimodal perspective. New Literacy in the ecological perspective focuses on literacy practices and place/space and on the links between them. Literacy is viewed as socially based, in specific situations and in recurring social practices. Socio-semiotic theory embodying the multimodal perspective is used for the text analysis. The methodology is known as socio-semiotic ethnography. The ethnographic methods encompass just over two years of fieldwork with participating observations of the five participants’ computing activities at home, at school and elsewhere. The participants, one boy and two girls from the Blue (Anemone) School and two girls from the White (Anemone) School, were chosen to reflect a broad spectrum in terms of sociocultural and socioeconomic background. The study shows the existence of a both broad and deep variation in the way digital literacy features in the participants’ one-to-one computing. These variations are associated with experience in relation to the home, the living environment, place, personal qualities and school. The more varied computer usage of the Blue School participants is connected with the interests they developed in their homes and living environments and in the computing practices undertaken in school. Their more varied usage of the computer is reflected in their broader digital literacy repertoires and their greater number and variety of digital literacy abilities. The Blue School participants’ text production is more multifaceted, covers a wider range of subjects and displays a broader palette of semiotic resources. It also combines more text types and the texts are generally longer than those of the White School participants. The Blue School girls have developed a text culture that is close to that of the school. In their case, there is clear linkage between school-initiated and self-initiated computing activities, while other participants do not have the same opportunities to link and integrate self-initiated computing activities into the school context. It also becomes clear that the Blue School girls can relate and adapt their texts to different communicative practices and recipients. In addition, the study shows that the Blue School girls have some degree of scope in their school practice as a result of incorporating into it certain communicative practices that they have developed in nonschool contexts. Quite contrary to the hopes expressed that one-to-one computing would reduce digital inequality, it has increased between these participants. Whether the same or similar results apply in a larger perspective, on a more structural level, is a question that this study cannot answer. It can only draw attention to the need to investigate the matter. The study shows in a variety of ways that the White School participants do not have the same opportunity to develop their digital literacy as the Blue School participants. In an equivalence perspective, schools have a compensational task to perform. It is abundantly clear from the study that investing in one-to-one projects is not enough to combat digital inequality and achieve the digitisation goals established for school education. Alongside their investments in technology, schools need to develop a didactic that legitimises and compensates for the different circumstances of different pupils. The compensational role of schools in this connection is important not only for the present participants but also for the community at large, in that it can help to secure a cohesive, open and democratic society.

La melancolía en Atlántida de Oscar Villegas : representación teatral del carácter nacional mexicano

Les images qui représentent le Mexicain le montrent habituellement sous les traits d’un être extrêmement mélancolique qui fait face à un destin tragique. Les nombreux mythes entourant le Mexicain, issus de la culture même, sont effectivement reliés de près ou de loin à la peur et la tristesse, soit deux composantes essentielles de la mélancolie. L’anthropologue Roger Bartra dans La jaula de la melancolía: identidad y metamorfosis del mexicano analyse ces éléments clés qui constitueraient la personnalité du Mexicain. L’objectif de cette recherche est de démontrer que Atlántida d’Oscar Villegas est l’œuvre par excellence qui représente cette mélancolie toute mexicaine. Dans sa pièce de théâtre, Villegas raconte l’histoire d’une jeune artiste de cabaret qui vit de nombreuses désillusions dans un monde vulgaire et pervers où les valeurs humaines font défaut. Le dramaturge met en scène le Mexico urbain des années quarante et montre le désespoir et l’impossibilité pour les habitants de ses quartiers pauvres de changer le cours de leur vie. En plus d’être une pièce de théâtre qui, tant au niveau de son contenu que de sa forme, porte en elle les marques de la mélancolie, Atlántida met en relief ces caractéristiques devenues au fil du temps représentatives de l’image nationale du Mexicain. L’étude de cette œuvre s’appuie sur les théories d’analyse du texte théâtral d’Anne Ubersfeld qui propose une approche centrée sur l’action et les conditions de communication contenues dans les dialogues. Faire le pont entre la pièce de théâtre de Villegas et l’essai de Bartra permet d’explorer le lien intrinsèque qui semble s’établir entre Mexicain et mélancolie.

La biotechnologie dans l’agriculture : une étude du contenu de la presse écrite argentine des années 1999 à 2006

En Argentine, la biotechnologie agricole, spécialement le soya transgénique, a été adoptée de façon fulgurante et elle a provoqué un fort choc dans l’économie nationale et dans la société. Actuellement, dû à la gravité des conséquences de ce phénomène, les médias, et la presse en particulier, ont fait écho du débat. Le but général de cette étude est d’analyser le débat de société sur ce phénomène dans la presse écrite argentine. Pour ce faire, trois objectifs spécifiques ont été retenus : dresser un portrait général du discours; comprendre le contexte politique et économique qui a permis l’insertion de la biotechnologie agricole en Argentine; et analyser les enjeux socioéthiques subjacents au problème des biotechnologies. Pour répondre à ces objectifs, on a effectué une analyse de contenu du discours social circonscrit à la presse écrite argentine entre les années 1999- 2006. La démarche privilégiée inclut la classification des articles de journaux par l’utilisation de mots-clés et l’assignation à des catégories thématiques avec l’assistance des techniques d’analyse de texte par ordinateur. Les résultats de cette étude signalent pour la période étudiée une importante couverture journalistique des biotechnologies agricoles, couverture qui, en général, a été favorable. La quantité d’articles augmente avec les années et montre un virage important des sujets commerciaux à des questions politiques. Le débat autour des conséquences environnementales et sociales de l’application du nouveau modèle agricole sont pauvrement représentées et montrent une apparition plus tardive dans les journaux argentins. Cependant, cela pourrait s’expliquer par un déplacement dans l’axe de la discussion des biotechnologies vers la sojisation qui devient l’enjeu central du débat autour du phénomène agricole.

Explaining legal norm transmission using an epidemiological model : the case of employment drug testing

Dans cette thèse, nous construisons un modèle épidémiologique de la dissémina- tion de normes juridiques. L’objectif est d’expliquer la transmission de normes juridiques américaines régissant les tests de dépistages pour drogues au travail vers le Canada ainsi que la propagation subséquente de ces normes à travers la jurisprudence canadienne. La propagation des normes régissant les tests de dépistages pour drogues au travail sert donc à la fois de point de départ pour une réflexion théorique sur la transmission de normes juridiques et pour une étude de cas empirique. Nous partons de la prémisse que les explications du changement juridique, telles celle de la transplantation et celle de l’harmonisation, sont essentiellement métaphoriques. Ces métaphores explicatives fonctionnent en invitant des comparaisons entre les domaines connus et inconnus. Quand ce processus de comparaison est systématisé, la métaphore devient un modèle. Dans la thèse, nous appliquons cette procédure de systématisation afin de transformer la métaphore de la propagation virale en modèle épidémiologique. Après une revue de la littérature sur les épidémies sociales, nous décrivons les éléments pertinents de la théorie épidémiologique pour, ensuite, les transposer au domaine juridique. Le modèle est alors opérationnalisé en l’appliquant à une base de données composée de la jurisprudence pertinente (n=187). Les résultats soutiennent les hypothèses du modèle. 90 % des décisions qui citent les sources américaines sont infectées selon les critères du modèle, alors que seulement 64 % des décisions qui ne citent pas de sources américaines sont infectées. Cela soutient l’hypothèse d’une épidémie dite de « réservoir commun ». Nous avons également démontré une corrélation positive entre la référence à ces décisions et l’état d’infection! : 87 % des décisions qui citent des décisions qui réfèrent aux sources américaines sont infectées, alors que le taux d’infection parmi la population restante est de seulement 53 %. Les résultats semblables ont été obtenus pour les décisions de troisième génération. Cela soutient l’hypothèse selon laquelle il y a eu propagation à travers la jurisprudence suite aux contacts initiaux avec le réservoir commun. Des corrélations positives ont aussi été démontrées entre l’état d’infection et l’appartenance à l’une ou l’autre de sous-populations particulières qui seraient, par hypothèse, des points d’infection. En conclusion de la thèse, nous avançons que c’est seulement après avoir construit un modèle et d’avoir constaté ses limites que nous pouvons vraiment comprendre le rôle des métaphores et des modèles dans l’explication de phénomènes juridiques.

« Tomorrow Belongs To Me » : représentations de la femme dans une ballade suprémaciste blanche

La version intégrale de ce mémoire est disponible uniquement pour consultation individuelle à la Bibliothèque de musique de l’Université de Montréal (www.bib.umontreal.ca/MU).

Sur la place publique : construction historique de l’événement Nuit de la poésie 1970

Toute historiographie se construit sous la forme d’un récit, soutenue par une narration qui, autour d’une intrigue, sélectionne et organise les événements en fonction de leur importance relative à des critères prédéterminés. La période des années 1960, qui est habituellement décrite comme celle de la naissance de la littérature québécoise, est on ne peut plus représentative de cette logique narrative qui sous-tend toute démarche historique. Un événement retenu par cette histoire, la Nuit de la poésie du 27 mars 1970, s’est littéralement élevé au rang de mythe dans l’imaginaire littéraire, mais aussi identitaire des Québécois. Que ce soit à travers les triomphes de Claude Gauvreau et de Michèle Lalonde ou la foule de plusieurs milliers de personnes devant le Gesù qui espérait assister à la soirée, cet événement, mis sur pellicule par Jean-Claude Labrecque et Jean-Pierre Masse, a été conçu par plusieurs comme l’apothéose de « l’âge de la parole ». Une observation minutieuse de ce happening soulève cependant de nombreuses questions concernant la construction de ce rôle dans l’histoire littéraire québécoise. En effet, tant l’étude des conditions d’organisation de la soirée que l’analyse de son mode de transmission révèlent des motivations archivistiques qui laissent transparaître l’objectif de la Nuit à « faire événement », à produire des traces qui participeront à l’inscription historique de la poésie québécoise. Considérant que l’œuvre filmique de Labrecque et de Masse constitue le seul véritable document témoignant de cet événement et que celui-ci a fait l’objet d’un montage ne présentant qu’une facette de la soirée, les enjeux de représentation et de mise en récit inhérents au cinéma documentaire poussent à questionner le portrait désiré de la poésie de l’époque que l’on voulait créer à travers le long-métrage. Véritable plateau de tournage, le spectacle du 27 mars 1970 appelle à être analysé dans les termes d’une conscience historique qui pousse les acteurs du milieu littéraire de l’époque à ériger les monuments qui seront à la base du canon et de l’institution littéraires québécois. L’étude, mobilisant les ressources de l’analyse de texte, de la sociologie de la littérature, de la théorie historiographique et de la théorie du cinéma, portera principalement sur le documentaire La Nuit de la poésie 27 mars 1970, considéré comme véritable recueil de textes, mais aussi de façon tout à fait originale sur les archives inédites rejetées du montage final des réalisateurs de l’ONF. Au terme de ce travail, j’approfondirai la réflexion sur le rôle historique d’un événement emblématique de la littérature québécoise en explicitant la construction historique autour de celui-ci. Il s’agira non seulement de relativiser l’événement en tant que tel, mais aussi de réfléchir sur le grand récit espéré par les artistes de l’époque.