Abstractive Long Document Summarization: Studio e Sperimentazione di Modelli Generativi Retrieval-Augmented

In questa tesi si trattano lo studio e la sperimentazione di un modello generativo retrieval-augmented, basato su Transformers, per il task di Abstractive Summarization su lunghe sentenze legali. La sintesi automatica del testo (Automatic Text Summarization) è diventata un task di Natural Language Processing (NLP) molto importante oggigiorno, visto il grandissimo numero di dati provenienti dal web e banche dati. Inoltre, essa permette di automatizzare un processo molto oneroso per gli esperti, specialmente nel settore legale, in cui i documenti sono lunghi e complicati, per cui difficili e dispendiosi da riassumere. I modelli allo stato dell’arte dell’Automatic Text Summarization sono basati su soluzioni di Deep Learning, in particolare sui Transformers, che rappresentano l’architettura più consolidata per task di NLP. Il modello proposto in questa tesi rappresenta una soluzione per la Long Document Summarization, ossia per generare riassunti di lunghe sequenze testuali. In particolare, l’architettura si basa sul modello RAG (Retrieval-Augmented Generation), recentemente introdotto dal team di ricerca Facebook AI per il task di Question Answering. L’obiettivo consiste nel modificare l’architettura RAG al fine di renderla adatta al task di Abstractive Long Document Summarization. In dettaglio, si vuole sfruttare e testare la memoria non parametrica del modello, con lo scopo di arricchire la rappresentazione del testo di input da riassumere. A tal fine, sono state sperimentate diverse configurazioni del modello su diverse tipologie di esperimenti e sono stati valutati i riassunti generati con diverse metriche automatiche.

Social Presence Approach Within the Question and Answering eLearning Model: An Experiment with a Multi-Agent System

The model of Questions Answering (Q&A) for eLearning is based on collaborative learning through questions that are posed by students and their answers to that questions which are given by peers, in contrast with the classical model in which students ask questions to the teacher only. In this proposal we extend the Q&A model including the social presence concept and a quantitative measure of it is proposed; besides it is considered the evolution of the resulting Q&A social network after the inclusion of the social presence and taking into account the feedback on questions posed by students and answered by peers. The social network behaviorwas simulated using a Multi-Agent System to compare the proposed social presence model with the classical and the Q&A models

How much flower-rich habitat is enough for wild pollinators? Answering a key policy question with incomplete knowledge

In 2013, an opportunity arose in England to develop an agri-environment package for wild pollinators, as part of the new Countryside Stewardship scheme launched in 2015. It can be understood as a 'policy window', a rare and time-limited opportunity to change policy, supported by a narrative about pollinator decline and widely supported mitigating actions. An agri-environment package is a bundle of management options that together supply sufficient resources to support a target group of species. This paper documents information that was available at the time to develop such a package for wild pollinators. Four questions needed answering: (1) Which pollinator species should be targeted? (2) Which resources limit these species in farmland? (3) Which management options provide these resources? (4) What area of each option is needed to support populations of the target species? Focussing on wild bees, we provide tentative answers that were used to inform development of the package. There is strong evidence that floral resources can limit wild bee populations, and several sources of evidence identify a set of agri-environment options that provide flowers and other resources for pollinators. The final question could only be answered for floral resources, with a wide range of uncertainty. We show that the areas of some floral resource options in the basic Wild Pollinator and Farmland Wildlife Package (2% flower-rich habitat and 1 km flowering hedgerow), are sufficient to supply a set of six common pollinator species with enough pollen to feed their larvae at lowest estimates, using minimum values for estimated parameters where a range was available. We identify key sources of uncertainty, and stress the importance of keeping the Package flexible, so it can be revised as new evidence emerges about how to achieve the policy aim of supporting pollinators on farmland.

Equivalence and translation strategies in multilingual thesaurus construction

In the present dissertation, multilingual thesauri were approached as cultural products and the focus was twofold: On the empirical level the focus was placed on the translatability of certain British-English social science indexing terms into the Finnish language and culture at a concept, a term and an indexing term level. On the theoretical level the focus was placed on the aim of translation and on the concept of equivalence. In accordance with modern communicative and dynamic translation theories the interest was on the human dimension. The study is qualitative. In this study, equivalence was understood in a similar way to how dynamic, functional equivalence is commonly understood in translation studies. Translating was seen as a decision-making process, where a translator often has different kinds of possibilities to choose in order to fulfil the function of the translation. Accordingly, and as a starting point for the construction of the empirical part, the function of the source text was considered to be the same or similar to the function of the target text, that is, a functional thesaurus both in source and target context. Further, the study approached the challenges of multilingual thesaurus construction from the perspectives of semantics and pragmatics. In semantic analysis the focus was on what the words conventionally mean and in pragmatics on the ‘invisible’ meaning - or how we recognise what is meant even when it is not actually said (or written). Languages and ideas expressed by languages are created mainly in accordance with expressional needs of the surrounding culture and thesauri were considered to reflect several subcultures and consequently the discourses which represent them. The research material consisted of different kinds of potential discourses: dictionaries, database records, and thesauri, Finnish versus British social science researches, Finnish versus British indexers, simulated indexing tasks with five articles and Finnish versus British thesaurus constructors. In practice, the professional background of the two last mentioned groups was rather similar. It became even more clear that all the material types had their own characteristics, although naturally not entirely separate from each other. It is further noteworthy that the different types and origins of research material were not used to represent true comparison pairs, and that the aim of triangulation of methods and material was to gain a holistic view. The general research questions were: 1. Can differences be found between Finnish and British discourses regarding family roles as thesaurus terms, and if so, what kinds of differences and which are the implications for multilingual thesaurus construction? 2. What is the pragmatic indexing term equivalence? The first question studied how the same topic (family roles) was represented in different contexts and by different users, and further focused on how the possible differences were handled in multilingual thesaurus construction. The second question was based on findings of the previous one, and answered to the final question as to what kinds of factors should be considered when defining translation equivalence in multilingual thesaurus construction. The study used multiple cases and several data collection and analysis methods aiming at theoretical replication and complementarity. The empirical material and analysis consisted of focused interviews (with Finnish and British social scientists, thesaurus constructors and indexers), simulated indexing tasks with Finnish and British indexers, semantic component analysis of dictionary definitions and translations, coword analysis and datasets retrieved in databases, and discourse analysis of thesauri. As a terminological starting point a topic and case family roles was selected. The results were clear: 1) It was possible to identify different discourses. There also existed subdiscourses. For example within the group of social scientists the orientation to qualitative versus quantitative research had an impact on the way they reacted to the studied words and discourses, and indexers placed more emphasis on the information seekers whereas thesaurus constructors approached the construction problems from a more material based solution. The differences between the different specialist groups i.e. the social scientists, the indexers and the thesaurus constructors were often greater than between the different geo-cultural groups i.e. Finnish versus British. The differences occurred as a result of different translation aims, diverging expectations for multilingual thesauri and variety of practices. For multilingual thesaurus construction this means severe challenges. The clearly ambiguous concept of multilingual thesaurus as well as different construction and translation strategies should be considered more precisely in order to shed light on focus and equivalence types, which are clearly not self-evident. The research also revealed the close connection between the aims of multilingual thesauri and the pragmatic indexing term equivalence. 2) The pragmatic indexing term equivalence is very much context-depended. Although thesaurus term equivalence is defined and standardised in the field of library and information science (LIS), it is not understood in one established way and the current LIS tools are inadequate to provide enough analytical tools for both constructing and studying different kinds of multilingual thesauri as well as their indexing term equivalence. The tools provided in translation science were more practical and theoretical, and especially the division of different meanings of a word provided a useful tool in analysing the pragmatic equivalence, which often differs from the ideal model represented in thesaurus construction literature. The study thus showed that the variety of different discourses should be acknowledged, there is a need for operationalisation of new types of multilingual thesauri, and the factors influencing pragmatic indexing term equivalence should be discussed more precisely than is traditionally done.

The Money Question and the Good Life

This paper proposes a theory of the good life for use in answering the question how much money the rich should spend on fighting poverty. The paper moves from the abstract to the concrete. To begin with, it investigates various ways to get an answer to the question what is good, and finds itself drawn to objective theories of the good. It then develops, taking Bernard Williams and Martha Nussbaum as its guides, a broad outline of a theory of the good. It holds that something evil happens to people if they do not have a real choice from a reasonable number of projects that realize most of their key capacities to a certain degree, and in connection to this it points to the great importance of money. The paper goes on specifically to consider what criticisms of Nussbaum's version of the capability approach are implied in this outline of a theory of the good. Next, it gets more specific and asks how much money the rich can give -and how they can be restricted in spending their money- without suffering any evil. It does three suggestions: the tithe suggestion, the ecological (or footprint) suggestion, and the fair trade suggestion. To conclude, the paper returns to the question how much money the rich should spend on fighting poverty.

Family language policy in the Chinese community in Singapore: a question of balance?

This paper focuses on the language shift phenomenon in Singapore as a consequence of the top-town policies. By looking at bilingual family language policies it examines the characteristics of Singapore’s multilingual nature and cultural diversity. Specifically, it looks at what languages are practiced and how family language policies are enacted in Singaporean English-Chinese bilingual families, and to what extend macro language policies – i.e. national and educational language policies influence and interact with family language policies. Involving 545 families and including parents and grandparents as participants, the study traces the trajectory of the policy history. Data sources include 2 parts: 1) a prescribed linguistic practices survey; and 2) participant observation of actual negotiation of FLP in face-to-face social interaction in bilingual English-Chinese families. The data provides valuable information on how family language policy is enacted and language practices are negotiated, and what linguistic practices have been changed and abandoned against the background of the Speaking Mandarin Campaign and the current bilingual policy implemented in the 1970s. Importantly, the detailed face-to-face interactions and linguistics practices are able to enhance our understanding of the subtleties and processes of language (dis)continuity in relation to policy interventions. The study also discusses the reality of language management measures in contrast to the government’s ‘separate bilingualism’ (Creese & Blackledge, 2011) expectations with regard to ‘striking a balance’ between Asian and Western culture (Curdt-Christiansen & Silver 2013; Shepherd, 2005) and between English and mother tongue languages (Curdt-Christiansen, 2014). Demonstrating how parents and children negotiate their family language policy through translanguaging or heteroglossia practices (Canagarajah, 2013; Garcia & Li Wei, 2014), this paper argues that ‘striking a balance’ as a political ideology places emphasis on discrete and separate notions of cultural and linguistic categorization and thus downplays the significant influences from historical, political and sociolinguistic contexts in which people find themselves. This simplistic view of culture and linguistic code will inevitably constrain individuals’ language expression as it regards code switching and translanguaging as delimited and incompetent language behaviour.

Interview and translation strategies: coping with multilingual settings and data

Central Eastern Europe, the research area this paper is concerned with, is a region characterized by a high diversity of languages and cultures. It is, at the same time, an area where political, cultural and social conflicts have emerged over time, nowadays especially in border zones, where people of different ethnic, cultural or linguistic background live. In this context, it is important for us researchers to get balanced interview data, and consequently we very often have to conduct interviews in several different languages and within changing cultural contexts. In order to avoid "communication problems" or even conflictual (interview) situations, which might damage the outcome of the research, we are thus challenged to find appropriate communication strategies for any of these situations. This is especially difficult when we are confronted with language or culture-specific terminology or taboo expressions that carry political meaning(s). Once the interview data is collected and it comes to translating and analysing it, we face further challenges and new questions arise. First of all, we have to decide what a good translation strategy would be. Many words and phrases that exist in one language do not have an exact equivalent in another. Therefore we have to find a solution for translating these expressions and concepts in a way that their meanings do not get "lost by translation". In this paper I discuss and provide insights to these challenges by presenting and discussing numerous examples from the region in question. Specifically, I focus on the deconstruction of the meaning of geographical names and politically loaded expressions in order to show the sensitivities of language, the difficulties of research in multilingual settings and with multilingual data as well as the strategies or "ways out" of certain dilemmas.

Multilingualism and age:The consequences of retirement on multilingual competence

OBJECTIVES: The research question for this project mainly concentrates on the sociolinguistic aspects of a socalled “language related major life event” (De Bot, 2007): retirement. “Language related major life events” are events in the lifespan that are important for changes happening in the linguistic setting which influence the language development. In my paper I will explore changes happening around retirement in regard to multilingual competence. The focus will be on two groups: Italian migrants living in the city of Berne and Swissgerman-speakers, both at the age around retirement. The above mentioned changes can take place on two levels. (1) On the one hand, people have more time for curricular activities after retirement, which they can use in order to learn new languages or to improve their language skills. In this case we are dealing with the concept of “lifelong learning”. (2) On the other hand, language competence can be lost due to the (partial) loss of the retiree’s social network at their former workplace. METHODS: I will first examine these processes by using quantitative questionnaires in order to obtain general information on demographic data, the social situation, and a self-assessment of linguistic skills. Secondly, I will use qualitative interviews to gain in-depth information on the linguistic changes happening around retirement and their link to different factors, such as social networks, education, gender or the language biography. RESULTS: Since the project is still in its early stages of development, clear results can’t be mentioned yet. By May 2012 I will be able to present results of the quantitative study as well as a first glance into the results of the qualitative part of the project. CONCLUSION: The results of this project are meant to benefit the better insight into different aspects that haven’t been looked at in detail till this point. (1) What is the general and linguistic situation of Italian migrants who decided to remain in Switzerland after retirement and how can their linguistic skills affect their quality of living? (2) Who decides to learn a new language after retirement and how should language courses for older people be designed?

Knowledge Extraction for Question Titling.

This article describes the work performed over the database of questions belonging to the different opinion polls carried during the last 50 years in Spain. Approximately half of the questions are provided with a title while the other half remain untitled. The work and implemented techniques in order to automatically generate the titles for untitled questions are described. This process is performed over very short texts and generated titles are subject to strong stylistic conventions and should be fully grammatical pieces of Spanish

Enhancing QA systems with complex temporal question processing capabilities

This paper presents a multilayered architecture that enhances the capabilities of current QA systems and allows different types of complex questions or queries to be processed. The answers to these questions need to be gathered from factual information scattered throughout different documents. Specifically, we designed a specialized layer to process the different types of temporal questions. Complex temporal questions are first decomposed into simple questions, according to the temporal relations expressed in the original question. In the same way, the answers to the resulting simple questions are recomposed, fulfilling the temporal restrictions of the original complex question. A novel aspect of this approach resides in the decomposition which uses a minimal quantity of resources, with the final aim of obtaining a portable platform that is easily extensible to other languages. In this paper we also present a methodology for evaluation of the decomposition of the questions as well as the ability of the implemented temporal layer to perform at a multilingual level. The temporal layer was first performed for English, then evaluated and compared with: a) a general purpose QA system (F-measure 65.47% for QA plus English temporal layer vs. 38.01% for the general QA system), and b) a well-known QA system. Much better results were obtained for temporal questions with the multilayered system. This system was therefore extended to Spanish and very good results were again obtained in the evaluation (F-measure 40.36% for QA plus Spanish temporal layer vs. 22.94% for the general QA system).

Creación de neologismos en euskera: Análisis descriptivo de la terminología de la odontología en lengua vasca y propuestas para la formación de términos en los ámbitos de especialidad.

450 p.

Facial Changes After Early Treatment Of Unilateral Coronal Synostosis Question The Necessity Of Primary Nasal Osteotomy.

The premature fusion of unilateral coronal suture can cause a significant asymmetry of the craniofacial skeleton, with an oblique deviation of the cranial base that negatively impacts soft tissue facial symmetry. The purpose of this study was to assess facial symmetry obtained in patients with unilateral coronal synostosis (UCS) surgically treated by 2 different techniques. We hypothesized that nasal deviation should not be addressed in a primary surgical correction of UCS. Consecutive UCS patients were enrolled in a prospective study and randomly divided into 2 groups. In group 1, the patients underwent total frontal reconstruction and transferring of onlay bone grafts to the recessive superior orbital rim (n = 7), and in group 2, the patients underwent total frontal reconstruction and unilateral fronto-orbital advancement (n = 5). Computerized photogrammetric analysis measured vertical and horizontal axis of the nose and the orbital globe in the preoperative and postoperative periods. Intragroup and intergroup comparisons were performed. Intragroup preoperative and postoperative comparisons showed a significant (all P < 0.05) reduction of the nasal axis and the orbital-globe axis in the postoperative period in the 2 groups. Intergroup comparisons showed no significant difference (all P > 0.05). Facial symmetry was achieved in the patients with UCS who underwent surgery regardless of surgical approach evaluated here. Our data showed a significant improvement in nasal and orbital-globe deviation, leading us to question the necessity of primary nasal correction in these patients.

Cooperação e autonomia : jogando em grupo e que se aprende

Universidade Estadual de Campinas . Faculdade de Educação Física