Alternative ways to estimate change points in multinomial sequences. An application to an authorship attribution problem

The statistical analysis of literary style is the part of stylometry that compares measurable characteristics in a text that are rarely controlled by the author, with those in other texts. When the goal is to settle authorship questions, these characteristics should relate to the author’s style and not to the genre, epoch or editor, and they should be such that their variation between authors is larger than the variation within comparable texts from the same author. For an overview of the literature on stylometry and some of the techniques involved, see for example Mosteller and Wallace (1964, 82), Herdan (1964), Morton (1978), Holmes (1985), Oakes (1998) or Lebart, Salem and Berry (1998). Tirant lo Blanc, a chivalry book, is the main work in catalan literature and it was hailed to be “the best book of its kind in the world” by Cervantes in Don Quixote. Considered by writters like Vargas Llosa or Damaso Alonso to be the first modern novel in Europe, it has been translated several times into Spanish, Italian and French, with modern English translations by Rosenthal (1996) and La Fontaine (1993). The main body of this book was written between 1460 and 1465, but it was not printed until 1490. There is an intense and long lasting debate around its authorship sprouting from its first edition, where its introduction states that the whole book is the work of Martorell (1413?-1468), while at the end it is stated that the last one fourth of the book is by Galba (?-1490), after the death of Martorell. Some of the authors that support the theory of single authorship are Riquer (1990), Chiner (1993) and Badia (1993), while some of those supporting the double authorship are Riquer (1947), Coromines (1956) and Ferrando (1995). For an overview of this debate, see Riquer (1990). Neither of the two candidate authors left any text comparable to the one under study, and therefore discriminant analysis can not be used to help classify chapters by author. By using sample texts encompassing about ten percent of the book, and looking at word length and at the use of 44 conjunctions, prepositions and articles, Ginebra and Cabos (1998) detect heterogeneities that might indicate the existence of two authors. By analyzing the diversity of the vocabulary, Riba and Ginebra (2000) estimates that stylistic boundary to be near chapter 383. Following the lead of the extensive literature, this paper looks into word length, the use of the most frequent words and into the use of vowels in each chapter of the book. Given that the features selected are categorical, that leads to three contingency tables of ordered rows and therefore to three sequences of multinomial observations. Section 2 explores these sequences graphically, observing a clear shift in their distribution. Section 3 describes the problem of the estimation of a suden change-point in those sequences, in the following sections we propose various ways to estimate change-points in multinomial sequences; the method in section 4 involves fitting models for polytomous data, the one in Section 5 fits gamma models onto the sequence of Chi-square distances between each row profiles and the average profile, the one in Section 6 fits models onto the sequence of values taken by the first component of the correspondence analysis as well as onto sequences of other summary measures like the average word length. In Section 7 we fit models onto the marginal binomial sequences to identify the features that distinguish the chapters before and after that boundary. Most methods rely heavily on the use of generalized linear models

On the way to solve lighting problems in underwater imaging

A major obstacle to processing images of the ocean floor comes from the absorption and scattering effects of the light in the aquatic environment. Due to the absorption of the natural light, underwater vehicles often require artificial light sources attached to them to provide the adequate illumination. Unfortunately, these flashlights tend to illuminate the scene in a nonuniform fashion, and, as the vehicle moves, induce shadows in the scene. For this reason, the first step towards application of standard computer vision techniques to underwater imaging requires dealing first with these lighting problems. This paper analyses and compares existing methodologies to deal with low-contrast, nonuniform illumination in underwater image sequences. The reviewed techniques include: (i) study of the illumination-reflectance model, (ii) local histogram equalization, (iii) homomorphic filtering, and, (iv) subtraction of the illumination field. Several experiments on real data have been conducted to compare the different approaches

A Motion compensated filtering approach to remove sunlight flicker in shallow water images

A common problem in video surveys in very shallow waters is the presence of strong light fluctuations, due to sun light refraction. Refracted sunlight casts fast moving patterns, which can significantly degrade the quality of the acquired data. Motivated by the growing need to improve the quality of shallow water imagery, we propose a method to remove sunlight patterns in video sequences. The method exploits the fact that video sequences allow several observations of the same area of the sea floor, over time. It is based on computing the image difference between a given reference frame and the temporal median of a registered set of neighboring images. A key observation is that this difference will have two components with separable spectral content. One is related to the illumination field (lower spatial frequencies) and the other to the registration error (higher frequencies). The illumination field, recovered by lowpass filtering, is used to correct the reference image. In addition to removing the sunflickering patterns, an important advantage of the approach is the ability to preserve the sharpness in corrected image, even in the presence of registration inaccuracies. The effectiveness of the method is illustrated in image sets acquired under strong camera motion containing non-rigid benthic structures. The results testify the good performance and generality of the approach

Adaption of Courses and Learning Environment to the User Context in dotLRN

The explosive growth of Internet during the last years has been reflected in the ever-increasing amount of the diversity and heterogeneity of user preferences, types and features of devices and access networks. Usually the heterogeneity in the context of the users which request Web contents is not taken into account by the servers that deliver them implying that these contents will not always suit their needs. In the particular case of e-learning platforms this issue is especially critical due to the fact that it puts at stake the knowledge acquired by their users. In the following paper we present a system that aims to provide the dotLRN e-learning platform with the capability to adapt to its users context. By integrating dotLRN with a multi-agent hypermedia system, online courses being undertaken by students as well as their learning environment are adapted in real time

Response of the benthic macroinvertebrate community to a point source in La Tordera stream (Catalonia, NE Spain)

Vam monitoritzar paràmetres físics i químics, macroinvertebrats bentònics, clorofil·la a, productors primaris i matèria orgànica durant un any (2001-2002) per examinar els efectes d'una font puntual sobre la composició taxonòmica, la estructura de la comunitat, l'organització funcional, la utilització de l'habitat i la estoquiometria al riu la Tordera (Catalunya). Aigües avall de la font puntual, concentració de nutrients, cabal i conductivitat eren majors que al tram d'aigües amunt, mentre que oxigen dissolt era menor. La densitat de macroinvertebrats era més elevada al tram d'aigües avall però la biomassa era similar als dos trams. La riquesa taxonòmica al tram de dalt era un 20% més alt que al tram de baix. Els anàlisis d'ordenació separen clarament els dos trams en el primer eix, mentre que els dos trams presentaven una pauta temporal similar en el segon eix. La similaritat entre els dos trams en composició taxonòmica, densitats i biomasses després de les crescudes d'abril i maig de 2002, indiquen que les pertorbacions del cabal poden actuar com a un mecanisme de reinici de la comunitat bentònica i jugar un paper important per a la restauració d'ecosistemes fluvials. Els dos trams presentaven una biomassa de perifiton, plantes vasculars, CPOM i FPOM similars, mentre que clorofil·la a, algues filamentoses, molses i SPOM eren majors al tram d'aigües avall. La densitat relativa de trituradors era menor sota la font puntual mentre que col·lectors i filtradors van ser afavorits. La biomassa relativa de trituradors també era menor sota la font puntual, però la biomassa de col·lectors i depredadors va augmentar. Les relacions entre densitat de grups tròfics i els seus recursos eren rarament significatives. La relació s'explicava millor amb la biomassa de macroinvertebrats. Els dos trams compartien la mateixa relació per raspadors, col·lectors i filtradors però no per trituradors i depredadors. La densitat i la biomassa de macroinvertebrats es trobaven positivament correlacionades amb la quantitat de recursos tròfics i la complexitat d'habitat, mentre que la riquesa taxonòmica es trobava negativament relacionada amb paràmetres hidràulics. La influència dels substrats inorgànics prenia menor rellevància per a la distribució dels macroinvertebrats. Els anàlisis d'ordenació mostren com les variables del microhabitat de major rellevància eren CPOM, clorofil·la a, algues filamentoses i velocitat. La cobertura de sorra només era significativa per al tram d'aigües amunt i les molses, al d'aigües avall. El número de correlacions significatives entre macroinvertebrats i les variables del microhabitat era més elevat per al tram de dalt que per al de baix, bàsicament per diferències en composició taxonòmica. La biomassa de macroinvertebrats va aportar una informació semblant a la obtinguda per la densitat. Perifiton i molses tenien uns continguts de nutrients similars en els dos trams. Els %C i %N d'algues filamentoses també eren similars en els dos trams però el %P sota la font puntual era el doble que al tram de dalt. Les relacions estoquiomètriques en CPOM, FPOM i SPOM eren considerablement menors sota la font puntual. Els continguts elementals i relacions van ser molt variables entre taxons de macroinvertebrats però no van resultar significativament diferents entre els dos trams. Dípters, tricòpters i efemeròpters presentaven una estoquiometria similar, mentre que el C i el N eren inferiors en moluscs i el P en coleòpters. Els depredadors presentaven un contingut en C i N més elevat que la resta de grups tròfics, mentre que el P era major en els filtradors. Els desequilibris elementals entre consumidors i recursos eren menors en el tram d'aigües avall. A la tardor i l'hivern la major font de nutrients va ser la BOM mentre que a la primavera i a l'estiu va ser el perifiton.