Automatic extraction of concepts from texts and applications

The extraction of relevant terms from texts is an extensively researched task in Text- Mining. Relevant terms have been applied in areas such as Information Retrieval or document clustering and classification. However, relevance has a rather fuzzy nature since the classification of some terms as relevant or not relevant is not consensual. For instance, while words such as "president" and "republic" are generally considered relevant by human evaluators, and words like "the" and "or" are not, terms such as "read" and "finish" gather no consensus about their semantic and informativeness. Concepts, on the other hand, have a less fuzzy nature. Therefore, instead of deciding on the relevance of a term during the extraction phase, as most extractors do, I propose to first extract, from texts, what I have called generic concepts (all concepts) and postpone the decision about relevance for downstream applications, accordingly to their needs. For instance, a keyword extractor may assume that the most relevant keywords are the most frequent concepts on the documents. Moreover, most statistical extractors are incapable of extracting single-word and multi-word expressions using the same methodology. These factors led to the development of the ConceptExtractor, a statistical and language-independent methodology which is explained in Part I of this thesis. In Part II, I will show that the automatic extraction of concepts has great applicability. For instance, for the extraction of keywords from documents, using the Tf-Idf metric only on concepts yields better results than using Tf-Idf without concepts, specially for multi-words. In addition, since concepts can be semantically related to other concepts, this allows us to build implicit document descriptors. These applications led to published work. Finally, I will present some work that, although not published yet, is briefly discussed in this document.

Spatial distribution of trachoma cases in the City of Bauru, State of São Paulo, Brazil, detected in 2006: defining key areas for improvement of health resources

IntroductionThe objective of this study was to analyze the spatial behavior of the occurrence of trachoma cases detected in the City of Bauru, State of São Paulo, Brazil, in 2006 in order to use the information collected to set priority areas for optimization of health resources.Methodsthe trachoma cases identified in 2006 were georeferenced. The data evaluated were: schools where the trachoma cases studied, data from the 2000 Census, census tract, type of housing, water supply conditions, distribution of income and levels of education of household heads. In the Google Earth® software and TerraView® were made descriptive spatial analysis and estimates of the Kernel. Each area was studied by interpolation of the density surfaces exposing events to facilitate to recognize the clusters.ResultsOf the 66 cases detected, only one (1.5%) was not a resident of the city's outskirts. A positive association was detected of trachoma cases and the percentage of heads of household with income below three minimum wages and schooling under eight years of education.ConclusionsThe recognition of the spatial distribution of trachoma cases coincided with the areas of greatest social inequality in Bauru City. The micro-areas identified are those that should be prioritized in the rationalization of health resources. There is the possibility of using the trachoma cases detected as an indicator of performance of micro priority health programs.

Detection of purkinje images for automatic positioning of fixation target and interferometric measurements of anterior eye chamber

In cataract surgery, the eye’s natural lens is removed because it has gone opaque and doesn’t allow clear vision any longer. To maintain the eye’s optical power, a new artificial lens must be inserted. Called Intraocular Lens (IOL), it needs to be modelled in order to have the correct refractive power to substitute the natural lens. Calculating the refractive power of this substitution lens requires precise anterior eye chamber measurements. An interferometry equipment, the AC Master from Zeiss Meditec, AG, was in use for half a year to perform these measurements. A Low Coherence Interferometry (LCI) measurement beam is aligned with the eye’s optical axis, for precise measurements of anterior eye chamber distances. The eye follows a fixation target in order to make the visual axis align with the optical axis. Performance problems occurred, however, at this step. Therefore, there was a necessity to develop a new procedure that ensures better alignment between the eye’s visual and optical axes, allowing a more user friendly and versatile procedure, and eventually automatizing the whole process. With this instrument, the alignment between the eye’s optical and visual axes is detected when Purkinje reflections I and III are overlapped, as the eye follows a fixation target. In this project, image analysis is used to detect these Purkinje reflections’ positions, eventually automatically detecting when they overlap. Automatic detection of the third Purkinje reflection of an eye following a fixation target is possible with some restrictions. Each pair of detected third Purkinje reflections is used in automatically calculating an acceptable starting position for the fixation target, required for precise measurements of anterior eye chamber distances.

Genetic algorithm for shipping route estimation with long-range tracking data : automatic reconstruction of shipping routes based on the historical ship positions for maritime safety applications

Ship tracking systems allow Maritime Organizations that are concerned with the Safety at Sea to obtain information on the current location and route of merchant vessels. Thanks to Space technology in recent years the geographical coverage of the ship tracking platforms has increased significantly, from radar based near-shore traffic monitoring towards a worldwide picture of the maritime traffic situation. The long-range tracking systems currently in operations allow the storage of ship position data over many years: a valuable source of knowledge about the shipping routes between different ocean regions. The outcome of this Master project is a software prototype for the estimation of the most operated shipping route between any two geographical locations. The analysis is based on the historical ship positions acquired with long-range tracking systems. The proposed approach makes use of a Genetic Algorithm applied on a training set of relevant ship positions extracted from the long-term storage tracking database of the European Maritime Safety Agency (EMSA). The analysis of some representative shipping routes is presented and the quality of the results and their operational applications are assessed by a Maritime Safety expert.

Automatic generation of ETL physical systems from BPMN conceptual models

ETL conceptual modeling is a very important activity in any data warehousing system project implementation. Owning a high-level system representation allowing for a clear identification of the main parts of a data warehousing system is clearly a great advantage, especially in early stages of design and development. However, the effort to model conceptually an ETL system rarely is properly rewarded. Translating ETL conceptual models directly into something that saves work and time on the concrete implementation of the system process it would be, in fact, a great help. In this paper we present and discuss a hybrid approach to this problem, combining the simplicity of interpretation and power of expression of BPMN on ETL systems conceptualization with the use of ETL patterns to produce automatically an ETL skeleton, a first prototype system, which has the ability to be executed in a commercial ETL tool like Kettle.

Automatic distinction of Fernando Pessoas’ heteronyms

Text Mining has opened a vast array of possibilities concerning automatic information retrieval from large amounts of text documents. A variety of themes and types of documents can be easily analyzed. More complex features such as those used in Forensic Linguistics can gather deeper understanding from the documents, making possible performing di cult tasks such as author identi cation. In this work we explore the capabilities of simpler Text Mining approaches to author identification of unstructured documents, in particular the ability to distinguish poetic works from two of Fernando Pessoas' heteronyms: Alvaro de Campos and Ricardo Reis. Several processing options were tested and accuracies of 97% were reached, which encourage further developments.

Modelo de Gestion Intersectorial para la formalización de villas, a partir de la revisión de normativa urbana, marco jurídico-político, y la innovación tecnológica de los recursos. Intersectorial management model for the formality of the illegal growth settles beginning from the revision of the urban norm, political - juridical, and the technological innovation of the resources.

El Proyecto que se presenta en esta convocatoria está relacionado con el diseño y desarrollo de procesos de gestión intersectorial para la reconversión formal del hábitat en asentamientos de crecimiento espontáneo e ilegal a partir de la la revisión de marcos legales y normativos respecto del derecho al uso de suelo urbano y la seguridad jurídica en la tenencia (regulación dominial) bajo un enfoque sustentable de los Derechos Humanos (DDHH) como así también a partir de la innovación tecnológica de los recursos para el mejoramiento habitacional en el marco de los aportes relacionados con la Responsabilidad Social Empresarial (RSE) .La originalidad, en este caso, se basa en la exploración de nuevos procesos de gestión mixta en los que intervienen diversos actores: ESTADO, SOCIEDAD, EMPRESA y COMUNIDAD CIENTIFICA, configurando un circuito intersectorial de gestión, capacitación y producción de hábitat que respondan al fortalecimiento del desarrollo comunitario, entendido como desarrollo económico con inclusión social y urbana.Los objetivos están relacionados con el fortalecimiento de la producción integral del hábitat social procurando el desarrollo genuino de las comunidades a partir de la expansión de sus capacidades y sus derechos.El presente proyecto de investigación explorará la producción de hábitat y de ciudad informal procurando reconvertirla hacia un modelo de gestión sustentable (normativo y tecnológico), basado en la necesidad de producir ciudadanía digna a partir de la construcción formal de hábitat.La propuesta del proyecto supone la participación intersectorial en la planificación formal y en la toma de decisiones para una inclusión social y económica, en el marco de un modelo de desarrollo de génesis inclusor, constituyéndose en un avance de conocimientos del propio campo disciplinar (hábitat) como así también de otros campos afines a los mismos (jurídico- social - económico- productivo- político ).

Differences on allocation of available resources, in growth, reproduction, and survival, in an exotic gastropod of Physidae compared to an endemic one

Physa acuta Draparnaud, 1805 is an invasive gastropod that can affect local species. In Argentina, it is widespread and abundant, even in environments inhabited by the native species Stenophysa marmorata Guilding, 1828. Its predominance raises the question whether this could be explained by a more successful energy allocation in functional requirements (growth, reproduction and survival) compared to S. marmorata. This study was aimed at comparing growth rates, as well as survival and fecundity, between both species under laboratory conditions. Individuals born on the same day were grouped in four per aquaria and kept under controlled conditions of food, light, and temperature. Snails were weekly measured (maximum shell length), and growth rates were calculated using the Von Bertalanffy's equation. The number of eggs and survivors were grouped by week. Stenophysa marmorata was larger at birth than Physa acuta and invested more energy in growth, delaying sexual maturity. This resulted in a disadvantage in fecundity and survival compared to P. acuta, which had a lower growth rate but matured earlier and survived longer. Furthermore, the growth of P. acuta was not affected by reproduction, its reproductive period was longer, consequently with more eggs laid than S. marmorata.

Endangered Species Act biennial report, status of recovery program / prepared by U.S. Department of Commerce, National Oceanic and Atmospheric Administration, National Marine Fisheries Service, Office of Protected Resources.

1994-1996

Democracy and the curse of natural resources

We propose a theoretical model to explain empirical regularities related to the curse of natural resources. This is an explicitly political model which emphasizes the behavior and incentives of politicians. We extend the standard voting model to give voters political control beyond the elections. This gives rise to a new restriction into our political economy model: policies should not give rise to a revolution. Our model clarifies when resource discoveries might lead to revolutions, namely, in countries with weak institutions. Natural resources may be bad for democracy by harming political turnover. Our model also suggests a non-linear dependence of human capital on natural resources. For low levels of democracy human capital depends negatively on natural resources, while for high levels of democracy the dependence is reversed. This theoretical finding is corroborated in both cross section and panel data regressions.

Automatic measurement of key ski jumping phases and temporal events with a wearable system.

We propose a new method, based on inertial sensors, to automatically measure at high frequency the durations of the main phases of ski jumping (i.e. take-off release, take-off, and early flight). The kinematics of the ski jumping movement were recorded by four inertial sensors, attached to the thigh and shank of junior athletes, for 40 jumps performed during indoor conditions and 36 jumps in field conditions. An algorithm was designed to detect temporal events from the recorded signals and to estimate the duration of each phase. These durations were evaluated against a reference camera-based motion capture system and by trainers conducting video observations. The precision for the take-off release and take-off durations (indoor < 39 ms, outdoor = 27 ms) can be considered technically valid for performance assessment. The errors for early flight duration (indoor = 22 ms, outdoor = 119 ms) were comparable to the trainers' variability and should be interpreted with caution. No significant changes in the error were noted between indoor and outdoor conditions, and individual jumping technique did not influence the error of take-off release and take-off. Therefore, the proposed system can provide valuable information for performance evaluation of ski jumpers during training sessions.

On the automatic application of inequality indexes in the analysis of the international distribution of environmental indicators

In recent years traditional inequality measures have been used to quite a considerable extent to examine the international distribution of environmental indicators. One of its main characteristics is that each one assigns different weights to the changes that occur in the different sections of the variable distribution and, consequently, the results they yield can potentially be very different. Hence, we suggest the appropriateness of using a range of well-recommended measures to achieve more robust results. We also provide an empirical test for the comparative behaviour of several suitable inequality measures and environmental indicators. Our findings support the hypothesis that in some cases there are differences among measures in both the sign of the evolution and its size. JEL codes: D39; Q43; Q56. Keywords: international environment factor distribution; Kaya factors; Inequality measurement