Context Models for Understanding Images and Videos

A computer vision system that has to interact in natural language needs to understand the visual appearance of interactions between objects along with the appearance of objects themselves. Relationships between objects are frequently mentioned in queries of tasks like semantic image retrieval, image captioning, visual question answering and natural language object detection. Hence, it is essential to model context between objects for solving these tasks. In the first part of this thesis, we present a technique for detecting an object mentioned in a natural language query. Specifically, we work with referring expressions which are sentences that identify a particular object instance in an image. In many referring expressions, an object is described in relation to another object using prepositions, comparative adjectives, action verbs etc. Our proposed technique can identify both the referred object and the context object mentioned in such expressions. Context is also useful for incrementally understanding scenes and videos. In the second part of this thesis, we propose techniques for searching for objects in an image and events in a video. Our proposed incremental algorithms use the context from previously explored regions to prioritize the regions to explore next. The advantage of incremental understanding is restricting the amount of computation time and/or resources spent for various detection tasks. Our first proposed technique shows how to learn context in indoor scenes in an implicit manner and use it for searching for objects. The second technique shows how explicitly written context rules of one-on-one basketball can be used to sequentially detect events in a game.

Image summarisation: human action description from static images

Dissertação de Mestrado, Processamento de Linguagem Natural e Indústrias da Língua, Faculdade de Ciências Humanas e Sociais, Universidade do Algarve, 2014

Natural Disasters and Comparative State-Formation and Nation-Building: Earthquakes in Argentina and Chile (1822-1939)

Natural disasters in Argentina and Chile played a significant role in the state-formation and nation-building process (1822-1939). This dissertation explores state and society responses to earthquakes by studying public and private relief efforts reconstruction plans, crime and disorder, religious interpretations of catastrophes, national and transnational cultures of disaster, science and technology, and popular politics. Although Argentina and Chile share a political border and geological boundary, the two countries provide contrasting examples of state formation. Most disaster relief and reconstruction efforts emanated from the centralized Chilean state in Santiago. In Argentina, provincial officials made the majority of decisions in a catastrophe’s aftermath. Patriotic citizens raised money and collected clothing for survivors that helped to weave divergent regions together into a nation. The shared experience of earthquakes in all regions of Chile created a national disaster culture. Similarly, common disaster experiences, reciprocal relief efforts, and aid commissions linked Chileans with Western Argentine societies and generated a transnational disaster culture. Political leaders viewed reconstruction as opportunities to implement their visions for the nation on the urban landscape. These rebuilding projects threatened existing social hierarchies and often failed to come to fruition. Rebuilding brought new technologies from Europe to the Southern Cone. New building materials and systems, however, had to be adapted to the South American economic and natural environment. In a catastrophe’s aftermath, newspapers projected images of disorder and the authorities feared lawlessness and social unrest. Judicial and criminal records, however, show that crime often decreased after a disaster. Finally, nineteenth-century earthquakes heightened antagonism and conflict between the Catholic Church and the state. Conservative clergy asserted that disasters were divine punishments for the state’s anti-clerical measures and later railed against scientific explanations of earthquakes.

Distribution of Light in the Human Retina under Natural Viewing Conditions

Age-related macular degeneration (AMD) is the leading cause of blindness inAmerica. The fact that AMD wreaks most of the damage in the center of the retina raises the question of whether light, integrated over long periods, is more concentrated in the macula. A method, based on eye-tracking, was developed to measure the distribution of light in the retina under natural viewing conditions. The hypothesis was that integrated over time, retinal illumination peaked in the macula. Additionally a possible relationship between age and retinal illumination was investigated. The eye tracker superimposed the subject’s gaze position on a video recorded by a scene camera. Five informed subjects were employed in feasibility tests, and 58 naïve subjects participated in 5 phases. In phase 1 the subjects viewed a gray-scale image. In phase 2, they observed a sequence of photographic images. In phase 3 they viewed a video. In phase 4, they worked on a computer; in phase 5, the subjects walked around freely. The informed subjects were instructed to gaze at bright objects in the field of view and then at dark objects. Naïve subjects were allowed to gaze freely for all phases. Using the subject’s gaze coordinates, and the video provided by the scene camera, the cumulative light distribution on the retina was calculated for ~15° around the fovea. As expected for control subjects, cumulative retinal light distributions peaked and dipped in the fovea when they gazed at bright or dark objects respectively. The light distribution maps obtained from the naïve subjects presented a tendency to peak in the macula for phases 1, 2, and 3, a consistent tendency in phase 4 and a variable tendency in phase 5. The feasibility of using an eye-tracker system to measure the distribution of light in the retina was demonstrated, thus helping to understand the role played by light exposure in the etiology of AMD. Results showed that a tendency for light to peak in the macula is a characteristic of some individuals and of certain tasks. In these situations, risk of AMD could be increased. No significant difference was observed based on age.

Singularity and multifractal characterization of signals with wavelets. Application to clay soil images

In the field of multiscale analysis of signals, including images, the wavelet transform is one of the most attractive and powerful tool due to its ability to focus on signals structures at different scales. Wavelet Transform at different scales is successfully applied to image characterization (which can be applied to a watermarking scheme) and multiscale singularity detection and processing. In this work we show further research of computation of multifractals properties such as the multifractal spectrum (D(alpha)) applied to dye stained images of natural terrain. This can be useful for statically describing preferential flow path geometry.

Propuesta de creación de la Reserva Natural Municipal El Chuval en el Municipio de El Retén, Magdalena, Colombia

Colombia se ha comprometido a nivel internacional a realizar acciones que conduzcan al país hacia el desarrollo sostenible, específicamente a proteger los recursos naturales. En línea con esta apuesta, la presente investigación propone la construcción de la Reserva Natural El Chuval, en el municipio El Retén, Magdalena. Para la construcción de dicha Reserva se realiza un diagnóstico que indica las principales características del Chuval, se identifican posibles riesgos para la conservación de sus valores ambientales, y se complementa el análisis con una propuesta de manejo que se enmarca en la metodología de Agendas Ambientales Locales desarrollada por la ONU. Pese a que el municipio es consciente de la relevancia ambiental del Chuval, aún no se han tomado decisiones definitivas para proteger esta zona, razón por la cual, la presente investigación busca llenar un vacío en el ordenamiento territorial del municipio, que fortalezca la protección de la Ciénaga Grande de Santa Marta.

Biophysical indicators based on satellite images in an irrigated area at the São Francisco River Basin, Brazil.

The Jaíba Irrigated Perimeter is a large irrigated agriculturearea, located in the region Forest Jaíba between the SãoFrancisco and Verde Grande rivers, in the Brazilian semi-arid region. In 2014, irrigators thisthe region face losses in theinterruption of new plantings in irrigated areas due to water scarcity. The objective ofthis study is combine the modelto estimate the Monteith BIO with the SAFER algorithm in the case of obtaining ET, to analyze the dynamics of naturalvegetation and irrigated crops in water scarcity period. For application of the model are necessary data frommeteorological stations and satellite images. Were used 23satellite images of MODIS withspatial resolution of 250mand temporal 16 days, of 2014 year. For analyze the results,we used central pivots irrigation mask of Minas Geraisstate, Brazil. In areas with irrigated agriculture with central pivot, the mean values of BIO over the year 2014 were88.96 kg.ha-1.d-1. The highest values occurred between April 23 and May 8, with BIO 139 kg.ha-1.d-1. For areas withnatural vegetation, the average BIO was 88.34 kg.ha-1.d-1with lower values in September. Estimates of ET varied withthe lowest values of ET observedin natural vegetation 1,91±1,22 mm.d-1and the highest values in irrigated area isobserved 3,51±0,97 mm.d-1. Results of this study can assist in monitoring of river basins, contributing to themanagement irrigated agriculture, with the trend of scarcity of water resources and increasing conflicts for the wateruse.

BETWEEN IMAGES AND SCOURGES: THE REGIONAL CABLE VERDEAN MANUEL LOPES

This article aims to analyze the work The flagellates East Wind (1959), Cape Verdean writer Manuel Lopes, highlighting their contribution to the development of Cape Verde literature, from a regionalist perspective. In this work, Manuel Lopes introduces the reader to the hard reality that the panel are subjected the inhabitants of St. Anthony, victims of insular confinement and natural phenomena that afflict the region. Thus, this analysis understand regionalism as a timeless current, as Ligia Chiappini (1995), which does not exclude the universalism of the work and seek to identify the specifics of the landscape, the structure and organization of the Cape Verdean society, customs, cuisine, music, way of speaking as a translation for the construction of national identity. Therefore, we will use as theorists subsidies Manuel Ferreira (1997), Daniel Spínola (1998), Simone Caputo Gomes (2008) (2015), João Paulo Madeira (2014), Maria Aparecida Santilli (1985), Maria Nazareth Soares Fonseca e Terezinha Taborna Moreira (2014), among others.