Development of a hand-gesture recognition system for human-computer interaction

The aim of this Master Thesis is the analysis, design and development of a robust and reliable Human-Computer Interaction interface, based on visual hand-gesture recognition. The implementation of the required functions is oriented to the simulation of a classical hardware interaction device: the mouse, by recognizing a specific hand-gesture vocabulary in color video sequences. For this purpose, a prototype of a hand-gesture recognition system has been designed and implemented, which is composed of three stages: detection, tracking and recognition. This system is based on machine learning methods and pattern recognition techniques, which have been integrated together with other image processing approaches to get a high recognition accuracy and a low computational cost. Regarding pattern recongition techniques, several algorithms and strategies have been designed and implemented, which are applicable to color images and video sequences. The design of these algorithms has the purpose of extracting spatial and spatio-temporal features from static and dynamic hand gestures, in order to identify them in a robust and reliable way. Finally, a visual database containing the necessary vocabulary of gestures for interacting with the computer has been created.

Induction of inhibitory factor κBα mRNA in the central nervous system after peripheral lipopolysaccharide administration: An in situ hybridization histochemistry study in the rat

In this study we investigate the mRNA expression of inhibitory factor κBα (IκBα) in cells of the rat brain induced by an intraperitoneal (i.p.) injection of lipopolysaccharide (LPS). IκB controls the activity of nuclear factor κB, which regulates the transcription of many immune signal molecules. The detection of IκB induction, therefore, would reveal the extent and the cellular location of brain-derived immune molecules in response to peripheral immune challenges. Low levels of IκBα mRNA were found in the large blood vessels and in circumventricular organs (CVOs) of saline-injected control animals. After an i.p. LPS injection (2.5 mg/kg), dramatic induction of IκBα mRNA occurred in four spatio-temporal patterns. Induced signals were first detected at 0.5 hr in the lumen of large blood vessels and in blood vessels of the choroid plexus and CVOs. Second, at 1–2 hr, labeling dramatically increased in the CVOs and choroid plexus and spread to small vascular and glial cells throughout the entire brain; these responses peaked at 2 hr and declined thereafter. Third, cells of the meninges became activated at 2 hr and persisted until 12 hr after the LPS injection. Finally, only at 12 hr, induced signals were present in ventricular ependyma. Thus, IκBα mRNA is induced in brain after peripheral LPS injection, beginning in cells lining the blood side of the blood–brain barrier and progressing to cells inside brain. The spatiotemporal patterns suggest that cells of the blood–brain barrier synthesize immune signal molecules to activate cells inside the central nervous system in response to peripheral LPS. The cerebrospinal fluid appears to be a conduit for these signal molecules.

Continuous and lurching traveling pulses in neuronal networks with delay and spatially decaying connectivity

Propagation of discharges in cortical and thalamic systems, which is used as a probe for examining network circuitry, is studied by constructing a one-dimensional model of integrate-and-fire neurons that are coupled by excitatory synapses with delay. Each neuron fires only one spike. The velocity and stability of propagating continuous pulses are calculated analytically. Above a certain critical value of the constant delay, these pulses lose stability. Instead, lurching pulses propagate with discontinuous and periodic spatio-temporal characteristics. The parameter regime for which lurching occurs is strongly affected by the footprint (connectivity) shape; bistability may occur with a square footprint shape but not with an exponential footprint shape. For strong synaptic coupling, the velocity of both continuous and lurching pulses increases logarithmically with the synaptic coupling strength gsyn for an exponential footprint shape, and it is bounded for a step footprint shape. We conclude that the differences in velocity and shape between the front of thalamic spindle waves in vitro and cortical paroxysmal discharges stem from their different effective delay; in thalamic networks, large effective delay between inhibitory neurons arises from their effective interaction via the excitatory cells which display postinhibitory rebound.

Inputs to directionally selective simple cells in macaque striate cortex

It is clear that the initial analysis of visual motion takes place in the striate cortex, where directionally selective cells are found that respond to local motion in one direction but not in the opposite direction. Widely accepted motion models postulate as inputs to directional units two or more cells whose spatio-temporal receptive fields (RFs) are approximately 90° out of phase (quadrature) in space and in time. Simple cells in macaque striate cortex differ in their spatial phases, but evidence is lacking for the varying time delays required for two inputs to be in temporal quadrature. We examined the space-time RF structure of cells in macaque striate cortex and found two subpopulations of (nondirectional) simple cells, some that show strongly biphasic temporal responses, and others that are weakly biphasic if at all. The temporal impulse responses of these two classes of cells are very close to 90° apart, with the strongly biphasic cells having a shorter latency than the weakly biphasic cells. A principal component analysis of the spatio-temporal RFs of directionally selective simple cells shows that their RFs could be produced by a linear combination of two components; these two components correspond closely in their respective latencies and biphasic characters to those of strongly biphasic and weakly biphasic nondirectional simple cells, respectively. This finding suggests that the motion system might acquire the requisite temporal quadrature by combining inputs from these two classes of nondirectional cells (or from their respective lateral geniculate inputs, which appear to be from magno and parvo lateral geniculate cells, respectively).

A neuronal model of a global workspace in effortful cognitive tasks

A minimal hypothesis is proposed concerning the brain processes underlying effortful tasks. It distinguishes two main computational spaces: a unique global workspace composed of distributed and heavily interconnected neurons with long-range axons, and a set of specialized and modular perceptual, motor, memory, evaluative, and attentional processors. Workspace neurons are mobilized in effortful tasks for which the specialized processors do not suffice. They selectively mobilize or suppress, through descending connections, the contribution of specific processor neurons. In the course of task performance, workspace neurons become spontaneously coactivated, forming discrete though variable spatio-temporal patterns subject to modulation by vigilance signals and to selection by reward signals. A computer simulation of the Stroop task shows workspace activation to increase during acquisition of a novel task, effortful execution, and after errors. We outline predictions for spatio-temporal activation patterns during brain imaging, particularly about the contribution of dorsolateral prefrontal cortex and anterior cingulate to the workspace.

Seeing properties of an invisible object: Feature inheritance and shine-through

We characterize a class of spatio-temporal illusions with two complementary properties. Firstly, if a vernier stimulus is flashed for a short time on a monitor and is followed immediately by a grating, the latter can express features of the vernier, such as its offset, its orientation, or its motion (feature inheritance). Yet the vernier stimulus itself remains perceptually invisible. Secondly, the vernier can be rendered visible by presenting gratings with a larger number of elements (shine-through). Under these conditions, subjects perceive two independent “objects” each carrying their own features. Transition between these two domains can be effected by subtle changes in the spatio-temporal layout of the grating. This should allow psychophysicists and electrophysiologists to investigate feature binding in a precise and quantitative manner.

The generation of oscillations in networks of electrically coupled cells

In several biological systems, the electrical coupling of nonoscillating cells generates synchronized membrane potential oscillations. Because the isolated cell is nonoscillating and electrical coupling tends to equalize the membrane potentials of the coupled cells, the mechanism underlying these oscillations is unclear. Here we present a dynamic mechanism by which the electrical coupling of identical nonoscillating cells can generate synchronous membrane potential oscillations. We demonstrate this mechanism by constructing a biologically feasible model of electrically coupled cells, characterized by an excitable membrane and calcium dynamics. We show that strong electrical coupling in this network generates multiple oscillatory states with different spatio-temporal patterns and discuss their possible role in the cooperative computations performed by the system.

Relações espaço-temporais como restrições de tomadas de decisões na grande área no futebol

Este estudo investigou as tomadas de decisões de jogadores dentro da grande área do futebol com base em variáveis espaciais e espaço-temporais de coordenações interpessoal e extrapessoal. Participaram do estudo 150 jogadores do sexo masculino, com idade entre 18 e 38 anos, e experiência de prática neste esporte de, no mínimo, 7 anos. Foram filmados 12 jogos de futebol de um campeonato amador na Colômbia. As imagens capturadas foram analisadas através do software TACTO, e as variáveis consideradas para análise foram as seguintes: i) ângulo de chute, formado por vetores ligando o jogador com posse de bola a dois componentes do jogo que geravam uma lacuna no gol; ii) ângulo A de passe, composto por vetores conectando o portador da bola ao seu marcador mais próximo e ao seu companheiro de equipe; iii) ângulo B de passe, formado por vetores ligando o portador da bola ao seu companheiro de equipe e ao marcador mais próximo dele; iv) distância interpessoal, caracterizada pela distância entre o jogador com posse de bola e seu defensor mais próximo; v) velocidade e variabilidade relacionadas às mudanças em cada uma dessas medidas. Essas variáveis foram comparadas em relação a situações de chute, passe e drible. Os resultados revelaram que, em relação à decisão de chutar, o ângulo de chute representando a interação entre as possibilidades de completá-lo e de o mesmo ser interceptado, diferiu do mesmo ângulo em que as decisões de passe e drible foram tomadas; e, na decisão de driblar, a distância interpessoal apresentou diferenças com as situações em que o passe foi executado. Concluiu-se que, no caso do chute ao gol e o drible, os ângulos de chute e distâncias interpessoais, respectivamente, funcionaram como variáveis informacionais de coordenações interpessoal e extrapessoal importantes para as tomadas de decisão

Desenvolvimento floral e do óvulo e aspectos da reprodução em Aechmea sp. e Vriesea sp. (Bromeliaceae)

A utilização de Bromélias tem sido crescente no mercado de plantas onamentais, por outro lado, muitas espécies encontram-se ameaçadas, grande parte pelos impactos humanos no ambiente. Aechmea correia-araujoi E. Pereira & Moutinho, Aechmea gamossepala Wittm, Vriesea ensiformis (Vell.) Beer e Vriesea saundersii (Carrière) E. Morren ex Mez, espécies nativas da Mata Atlântica brasileira, têm sido alvo de extrativismo. Informações básicas sobre a espécie são essenciais para subsidiar a condução de programas de conservação e melhoramento genético, que aliados a ferramentas biotecnológicas permitem a incorporação de estratégias inovadoras aos métodos de melhoramento. Neste sentido, o objetivo do presente trabalho foi descrever essas espécies, quanto à micromorfologia floral, aspectos reprodutivos envolvidos no processo de polinização, desenvolvimento floral e deesenvolvimento gametofítico, como mecanismo de preservação e produção comercial. A caracterização morfológica e anatômica das flores das espécies de Aechmea e Vriesea contribuiu para a compreensão do processo reprodutivo. As espécies apresentam grãos de pólen com alta capacidade reprodutiva, viabilidade polínica superior a 93%, germinação in vitro maior que 80% e o estigma apresenta-se receptivo da antese ao final do dia. A ontogênese floral de A. correia-araujoi é centrípeta, os primórdios desenvolvem-se na ordem, sépala, pétala, androceu e gineceu. O apêndice petalar é formado na fase final do desenvolvimento. O primórdio de óvulo tem origem placentária e caráter trizonal, o óvulo é anátropo, bitegumentado e crassinucelado. O meristema floral de A. gamosepala se desenvolve de forma centrípeta, de forma unidirecional reversa. O estigma diferencia-se na fase inicial do desenvolvimento e os apêndices petalares, na fase final. O óvulo é anátropo, crassinucelado, bitegumentado, tétrade linear, megásporo calazal funcional, desenvolvimento tipo monospórico e Polygonum. As anteras são bitecas, tetraesporangiadas, com tapete secretor. Botões florais de 8,7 - 13,0 mm são indicados no estudo de embriogênese a partir de micrósporo. As alterações celulares e o padrão de distribuição de pectinas e AGPs foram caracterizadas por análise citoquímica com azul de toluidina, KI e DAPI e imunocitoquímica por imunofluorescência com os anticorpos para RNA, pectinas esterificadas (JIM7), não esterificadas (JIM5) e AGPs (LM2, LM6, MAC207, JIM13, JIM14) e analisadas por microscopia de fluorescência. Foram caracterizados padrões de distribuição espaço-temporal de pectinas e AGP que podem ser utilizados como marcadores de desenvolvimento gametofítico masculino. As observações feitas nesse trabalho fornecem dados sobre aspectos reprodutivos das espécies que podem ser utilizados em programas de melhoramento genético, conservação e desenvolvimento de haploides

Deformable templates for tracking and analysis of intravascular ultrasound sequences

Deformable Template models are first applied to track the inner wall of coronary arteries in intravascular ultrasound sequences, mainly in the assistance to angioplasty surgery. A circular template is used for initializing an elliptical deformable model to track wall deformation when inflating a balloon placed at the tip of the catheter. We define a new energy function for driving the behavior of the template and we test its robustness both in real and synthetic images. Finally we introduce a framework for learning and recognizing spatio-temporal geometric constraints based on Principal Component Analysis (eigenconstraints).

Evidence of different thermoregulatory mechanisms between two sympatric Scarabaeus species using infrared thermography and micro-computer tomography

In endotherms insects, the thermoregulatory mechanisms modulate heat transfer from the thorax to the abdomen to avoid overheating or cooling in order to obtain a prolonged flight performance. Scarabaeus sacer and S. cicatricosus, two sympatric species with the same habitat and food preferences, showed daily temporal segregation with S. cicatricosus being more active during warmer hours of the day in opposition to S. sacer who avoid it. In the case of S. sacer, their endothermy pattern suggested an adaptive capacity for thorax heat retention. In S. cicatricosus, an active ‘heat exchanger’ mechanism was suggested. However, no empirical evidence had been documented until now. Thermographic sequences recorded during flight performance showed evidence of the existence of both thermoregulatory mechanisms. In S. sacer, infrared sequences showed a possible heat insulator (passive thermal window), which prevents heat transfer from meso- and metathorax to the abdomen during flight. In S. cicatricosus, infrared sequences revealed clear and effective heat flow between the thorax and abdomen (abdominal heat transfer) that should be considered the main mechanism of thermoregulation. This was related to a subsequent increase in abdominal pumping (as a cooling mechanism) during flight. Computer microtomography scanning, anatomical dissections and internal air volume measurements showed two possible heat retention mechanisms for S. sacer; the abdominal air sacs and the development of the internal abdominal sternites that could explain the thermoregulation between thorax and abdomen. Our results suggest that interspecific interactions between sympatric species are regulated by very different mechanisms. These mechanisms create unique thermal niches for the different species, thereby preventing competition and modulating spatio-temporal distribution and the composition of dung beetle assemblages.

Nuevas herramientas para el estudio de la interacción entre especies en el espacio y en el tiempo

Las funciones de segundo orden son cada vez más empleadas en el análisis de procesos ecológicos. En este trabajo presentamos dos funciones de 2º orden desarrolladas recientemente que permiten analizar la interacción espacio-temporal entre dos especies o tipos funcionales de individuos. Estas funciones han sido desarrolladas para el estudio de interacciones entre especies en masas forestales a partir de la actual distribución diamétrica de los árboles. La primera de ellas es la función bivariante para procesos de puntos con marca Krsmm, que permite analizar la correlación espacial de una variable entre los individuos pertenecientes a dos especies en función de la distancia. La segunda es la función de reemplazo , que permite analizar la asociación entre los individuos pertenecientes a dos especies en función de la diferencia entre sus diámetros u otra variable asociada a dichos individuos. Para mostrar el comportamiento de ambas funciones en el análisis de sistemas forestales en los que operan diferentes procesos ecológicos se presentan tres casos de estudio: una masa mixta de Pinus pinea L. y Pinus pinaster Ait. en la Meseta Norte, un bosque de niebla de la Región Tropical Andina y el ecotono entre las masas de Quercus pyrenaica Willd. y Pinus sylvestris L. en el Sistema Central, en los que tanto la función Krsmm como la función r se utilizan para analizar la dinámica forestal a partir de parcelas experimentales con todos los árboles localizados y de parcelas de inventario.

Twenty-year advanced DInSAR analysis of severe land subsidence: The Alto Guadalentín Basin (Spain) case study

A twenty-year period of severe land subsidence evolution in the Alto Guadalentín Basin (southeast Spain) is monitored using multi-sensor SAR images, processed by advanced differential interferometric synthetic aperture radar (DInSAR) techniques. The SAR images used in this study consist of four datasets acquired by ERS-1/2, ENVISAT, ALOS and COSMO-SkyMed satellites between 1992 and 2012. The integration of ground surface displacement maps retrieved for different time periods allows us to quantify up to 2.50 m of cumulated displacements that occurred between 1992 and 2012 in the Alto Guadalentín Basin. DInSAR results were locally compared with global positioning system (GPS) data available for two continuous stations located in the study area, demonstrating the high consistency of local vertical motion measurements between the two different surveying techniques. An average absolute error of 4.6 ± 4 mm for the ALOS data and of 4.8 ± 3.5 mm for the COSMO-SkyMed data confirmed the reliability of the analysis. The spatial analysis of DInSAR ground surface displacement reveals a direct correlation with the thickness of the compressible alluvial deposits. Detected ground subsidence in the past 20 years is most likely a consequence of a 100–200 m groundwater level drop that has persisted since the 1970s due to the overexploitation of the Alto Guadalentín aquifer system. The negative gradient of the pore pressure is responsible for the extremely slow consolidation of a very thick (> 100 m) layer of fine-grained silt and clay layers with low vertical hydraulic permeability (approximately 50 mm/h) wherein the maximum settlement has still not been reached.

Regional subsidence modelling in Murcia city (SE Spain) using 1-D vertical finite element analysis and 2-D interpolation of ground surface displacements

Subsidence is a hazard that may have natural or anthropogenic origin causing important economic losses. The area of Murcia city (SE Spain) has been affected by subsidence due to groundwater overexploitation since the year 1992. The main observed historical piezometric level declines occurred in the periods 1982–1984, 1992–1995 and 2004–2008 and showed a close correlation with the temporal evolution of ground displacements. Since 2008, the pressure recovery in the aquifer has led to an uplift of the ground surface that has been detected by the extensometers. In the present work an elastic hydro-mechanical finite element code has been used to compute the subsidence time series for 24 geotechnical boreholes, prescribing the measured groundwater table evolution. The achieved results have been compared with the displacements estimated through an advanced DInSAR technique and measured by the extensometers. These spatio-temporal comparisons have showed that, in spite of the limited geomechanical data available, the model has turned out to satisfactorily reproduce the subsidence phenomenon affecting Murcia City. The model will allow the prediction of future induced deformations and the consequences of any piezometric level variation in the study area.

Seasonal mean air temperatures and ice phenology characteristics of Great Bear Lake and Great Slave Lake (2002-2009)

Time series of brightness temperatures (T(B)) from the Advanced Microwave Scanning Radiometer-Earth Observing System (AMSR-E) are examined to determine ice phenology variables on the two largest lakes of northern Canada: Great Bear Lake (GBL) and Great Slave Lake (GSL). T(B) measurements from the 18.7, 23.8, 36.5, and 89.0 GHz channels (H- and V- polarization) are compared to assess their potential for detecting freeze-onset/melt-onset and ice-on/ice-off dates on both lakes. The 18.7 GHz (H-pol) channel is found to be the most suitable for estimating these ice dates as well as the duration of the ice cover and ice-free seasons. A new algorithm is proposed using this channel and applied to map all ice phenology variables on GBL and GSL over seven ice seasons (2002-2009). Analysis of the spatio-temporal patterns of each variable at the pixel level reveals that: (1) both freeze-onset and ice-on dates occur on average about one week earlier on GBL than on GSL (Day of Year (DY) 318 and 333 for GBL; DY 328 and 343 for GSL); (2) the freeze-up process or freeze duration (freeze-onset to ice-on) takes a slightly longer amount of time on GBL than on GSL (about 1 week on average); (3) melt-onset and ice-off dates occur on average one week and approximately four weeks later, respectively, on GBL (DY 143 and 183 for GBL; DY 135 and 157 for GSL); (4) the break-up process or melt duration (melt-onset to ice-off) lasts on average about three weeks longer on GBL; and (5) ice cover duration estimated from each individual pixel is on average about three weeks longer on GBL compared to its more southern counterpart, GSL. A comparison of dates for several ice phenology variables derived from other satellite remote sensing products (e.g. NOAA Interactive Multisensor Snow and Ice Mapping System (IMS), QuikSCAT, and Canadian Ice Service Database) show that, despite its relatively coarse spatial resolution, AMSR-E 18.7 GHz provides a viable means for monitoring of ice phenology on large northern lakes.