Cognitive Surveillance Architecture for Scenario Understanding

Uno de los mayores retos para la comunidad científica es conseguir que las máquinas posean en un futuro la capacidad del sistema visual y cognitivo humanos, de forma que, por ejemplo, en entornos de video vigilancia, puedan llegar a proporcionar de manera automática una descripción fiable de lo que está ocurriendo en la escena. En la presente tesis, mediante la propuesta de un marco de trabajo de referencia, se discuten y plantean los pasos necesarios para el desarrollo de sistemas más inteligentes capaces de extraer y analizar, a diferentes niveles de abstracción y mediante distintos módulos de procesamiento independientes, la información necesaria para comprender qué está sucediendo en un conjunto amplio de escenarios de distinta naturaleza. Se parte de un análisis de requisitos y se identifican los retos para este tipo de sistemas en la actualidad, lo que constituye en sí mismo los objetivos de esta tesis, contribuyendo así a un modelo de datos basado en el conocimiento que permitirá analizar distintas situaciones en las que personas y vehículos son los actores principales, dejando no obstante la puerta abierta a la adaptación a otros dominios. Así mismo, se estudian los distintos procesos que se pueden lanzar a nivel interno así como la necesidad de integrar mecanismos de realimentación a distintos niveles que permitan al sistema adaptarse mejor a cambios en el entorno. Como resultado, se propone un marco de referencia jerárquico que integra las capacidades de percepción, interpretación y aprendizaje para superar los retos identificados en este ámbito; y así poder desarrollar sistemas de vigilancia más robustos, flexibles e inteligentes, capaces de operar en una variedad de entornos. Resultados experimentales ejecutados sobre distintas muestras de datos (secuencias de vídeo principalmente) demuestran la efectividad del marco de trabajo propuesto respecto a otros propuestos en el pasado. Un primer caso de estudio, permite demostrar la creación de un sistema de monitorización de entornos de parking en exteriores para la detección de vehículos y el análisis de plazas libres de aparcamiento. Un segundo caso de estudio, permite demostrar la flexibilidad del marco de referencia propuesto para adaptarse a los requisitos de un entorno de vigilancia completamente distinto, como es un hogar inteligente donde el análisis automático de actividades de la vida cotidiana centra la atención del estudio. ABSTRACT One of the most ambitious objectives for the Computer Vision and Pattern Recognition research community is that machines can achieve similar capacities to the human's visual and cognitive system, and thus provide a trustworthy description of what is happening in the scene under surveillance. Thus, a number of well-established scenario understanding architectural frameworks to develop applications working on a variety of environments can be found in the literature. In this Thesis, a highly descriptive methodology for the development of scene understanding applications is presented. It consists of a set of formal guidelines to let machines extract and analyse, at different levels of abstraction and by means of independent processing modules that interact with each other, the necessary information to understand a broad set of different real World surveillance scenarios. Taking into account the challenges that working at both low and high levels offer, we contribute with a highly descriptive knowledge-based data model for the analysis of different situations in which people and vehicles are the main actors, leaving the door open for the development of interesting applications in diverse smart domains. Recommendations to let systems achieve high-level behaviour understanding will be also provided. Furthermore, feedback mechanisms are proposed to be integrated in order to let any system to understand better the environment and the logical context around, reducing thus the uncertainty and noise, and increasing its robustness and precision in front of low-level or high-level errors. As a result, a hierarchical cognitive architecture of reference which integrates the necessary perception, interpretation, attention and learning capabilities to overcome main challenges identified in this area of research is proposed; thus allowing to develop more robust, flexible and smart surveillance systems to cope with the different requirements of a variety of environments. Once crucial issues that should be treated explicitly in the design of this kind of systems have been formulated and discussed, experimental results shows the effectiveness of the proposed framework compared with other proposed in the past. Two case studies were implemented to test the capabilities of the framework. The first case study presents how the proposed framework can be used to create intelligent parking monitoring systems. The second case study demonstrates the flexibility of the system to cope with the requirements of a completely different environment, a smart home where activities of daily living are performed. Finally, general conclusions and future work lines to further enhancing the capabilities of the proposed framework are presented.

The anatomy of urban social networks and its implications in the searchability problem

The appearance of large geolocated communication datasets has recently increased our understanding of how social networks relate to their physical space. However, many recurrently reported properties, such as the spatial clustering of network communities, have not yet been systematically tested at different scales. In this work we analyze the social network structure of over 25 million phone users from three countries at three different scales: country, provinces and cities. We consistently find that this last urban scenario presents significant differences to common knowledge about social networks. First, the emergence of a giant component in the network seems to be controlled by whether or not the network spans over the entire urban border, almost independently of the population or geographic extension of the city. Second, urban communities are much less geographically clustered than expected. These two findings shed new light on the widely-studied searchability in self-organized networks. By exhaustive simulation of decentralized search strategies we conclude that urban networks are searchable not through geographical proximity as their country-wide counterparts, but through an homophily-driven community structure.

A clustering technique for partial discharge and noise sources identification in power cables by means of waveform parameters

On-line partial discharge (PD) measurements have become a common technique for assessing the insulation condition of installed high voltage (HV) insulated cables. When on-line tests are performed in noisy environments, or when more than one source of pulse-shaped signals are present in a cable system, it is difficult to perform accurate diagnoses. In these cases, an adequate selection of the non-conventional measuring technique and the implementation of effective signal processing tools are essential for a correct evaluation of the insulation degradation. Once a specific noise rejection filter is applied, many signals can be identified as potential PD pulses, therefore, a classification tool to discriminate the PD sources involved is required. This paper proposes an efficient method for the classification of PD signals and pulse-type noise interferences measured in power cables with HFCT sensors. By using a signal feature generation algorithm, representative parameters associated to the waveform of each pulse acquired are calculated so that they can be separated in different clusters. The efficiency of the clustering technique proposed is demonstrated through an example with three different PD sources and several pulse-shaped interferences measured simultaneously in a cable system with a high frequency current transformer (HFCT).

Postsynaptic clustering of γ-aminobutyric acid type A receptors by the γ3 subunit in vivo

Synaptic localization of γ-aminobutyric acid type A (GABAA) receptors is a prerequisite for synaptic inhibitory function, but the mechanism by which different receptor subtypes are localized to postsynaptic sites is poorly understood. The γ2 subunit and the postsynaptic clustering protein gephyrin are required for synaptic localization and function of major GABAA receptor subtypes. We now show that transgenic overexpression of the γ3 subunit in γ2 subunit-deficient mice restores benzodiazepine binding sites, benzodiazepine-modulated whole cell currents, and postsynaptic miniature currents, suggesting the formation of functional, postsynaptic receptors. Moreover, the γ3 subunit can substitute for γ2 in the formation of GABAA receptors that are synaptically clustered and colocalized with gephyrin in vivo. These clusters were formed even in brain regions devoid of endogenous γ3 subunit, indicating that the factors present for clustering of γ2 subunit-containing receptors are sufficient to cluster γ3 subunit-containing receptors. The GABAA receptor and gephyrin-clustering properties of the ectopic γ3 subunit were also observed for the endogenous γ3 subunit, but only in the absence of the γ2 subunit, suggesting that the γ3 subunit is at a competitive disadvantage with the γ2 subunit for clustering of postsynaptic GABAA receptors in wild-type mice.

Activity-dependent regulation of synaptic clustering in a hippocampal culture system

Currently, there is a limited understanding of the factors that influence the localization and density of individual synapses in the central nervous system. Here we have studied the effects of activity on synapse formation between hippocampal dentate granule cells and CA3 pyramidal neurons in culture, taking advantage of FM1–43 as a fluorescent marker of synaptic boutons. We observed an early tendency for synapses to group together, quickly followed by the appearance of synaptic clusters on dendritic processes. These events were strongly influenced by N-methyl-d-aspartic acid receptor- and cyclic AMP-dependent signaling. The microstructure and localization of the synaptic clusters resembled that found in hippocampus, at mossy fiber synapses of stratum lucidum. Activity-dependent clustering of synapses represents a means for synaptic targeting that might contribute to synaptic organization in the brain.

Kinase domain of the muscle-specific receptor tyrosine kinase (MuSK) is sufficient for phosphorylation but not clustering of acetylcholine receptors: Required role for the MuSK ectodomain?

Formation of the neuromuscular junction (NMJ) depends upon a nerve-derived protein, agrin, acting by means of a muscle-specific receptor tyrosine kinase, MuSK, as well as a required accessory receptor protein known as MASC. We report that MuSK does not merely play a structural role by demonstrating that MuSK kinase activity is required for inducing acetylcholine receptor (AChR) clustering. We also show that MuSK is necessary, and that MuSK kinase domain activation is sufficient, to mediate a key early event in NMJ formation—phosphorylation of the AChR. However, MuSK kinase domain activation and the resulting AChR phosphorylation are not sufficient for AChR clustering; thus we show that the MuSK ectodomain is also required. These results indicate that AChR phosphorylation is not the sole trigger of the clustering process. Moreover, our results suggest that, unlike the ectodomain of all other receptor tyrosine kinases, the MuSK ectodomain plays a required role in addition to simply mediating ligand binding and receptor dimerization, perhaps by helping to recruit NMJ components to a MuSK-based scaffold.

A link density clustering algorithm based on automatically selecting density peaks for overlapping community detection

Peer reviewed

Implications of a possible clustering of highest-energy cosmic rays

Recently, a possible clustering of a subset of observed ultra-high energy cosmic rays above ≃40 EeV (4 × 1019 eV) in pairs near the supergalactic plane was reported. We show that a confirmation of this effect would provide information on the origin and nature of these events and, in case of charged primaries, imply interesting constraints on the extragalactic magnetic field. Possible implications for the most common models of ultra-high energy cosmic ray production in the literature are discussed.

Involvement of unique leucine-zipper motif of PSD-Zip45 (Homer 1c/vesl-1L) in group 1 metabotropic glutamate receptor clustering

Several scaffold proteins for neurotransmitter receptors have been identified as candidates for receptor targeting. However, the molecular mechanism underlying such receptor clustering and targeting to postsynaptic specializations remains unknown. PSD-Zip45 (also named Homer 1c/vesl-1L) consists of the NH2 terminus containing the enabled/VASP homology 1 domain and the COOH terminus containing the leucine zipper. Here, we demonstrate immunohistochemically that metabotropic glutamate receptor 1α (mGluR1α) and PSD-Zip45/Homer 1c are colocalized to synapses in the cerebellar molecular layer but not in the hippocampus. In cultured hippocampal neurons, PSD-Zip45/Homer1c and N-methyl-d-aspartate receptors are preferentially colocalized to dendritic spines. Cotransfection of mGluR1α or mGluR5 and PSD-Zip45/Homer 1c into COS-7 cells results in mGluR clustering induced by PSD-Zip45/Homer 1c. An in vitro multimerization assay shows that the extreme COOH-terminal leucine zipper is involved in self-multimerization of PSD-Zip45/Homer 1c. A clustering assay of mGluRs in COS-7 cells also reveals a critical role of this leucine-zipper motif of PSD-Zip45/Homer 1c in mGluR clustering. These results suggest that the leucine zipper of subsynaptic scaffold protein is a candidate motif involved in neurotransmitter receptor clustering at the central synapse.

Clustering of meiotic double-strand breaks on yeast chromosome III

In the yeast Saccharomyces cerevisiae, meiotic recombination is initiated by transient DNA double-strand breaks (DSBs) that are repaired by interaction of the broken chromosome with its homologue. To identify a large number of DSB sites and gain insight into the control of DSB formation at both the local and the whole chromosomal levels, we have determined at high resolution the distribution of meiotic DSBs along the 340 kb of chromosome III. We have found 76 DSB regions, mostly located in intergenic promoter-containing intervals. The frequency of DSBs varies at least 50-fold from one region to another. The global distribution of DSB regions along chromosome III is nonrandom, defining large (39–105 kb) chromosomal domains, both hot and cold. The distribution of these localized DSBs indicates that they are likely to initiate most crossovers along chromosome III, but some discrepancies remain to be explained.

Calcium-dependent Clustering of Inositol 1,4,5-Trisphosphate Receptors

Rat basophilic leukemia (RBL-2H3) cells predominantly express the type II receptor for inositol 1,4,5-trisphosphate (InsP3), which operates as an InsP3-gated calcium channel. In these cells, cross-linking the high-affinity immunoglobulin E receptor (FcεR1) leads to activation of phospholipase C γ isoforms via tyrosine kinase- and phosphatidylinositol 3-kinase-dependent pathways, release of InsP3-sensitive intracellular Ca2+ stores, and a sustained phase of Ca2+ influx. These events are accompanied by a redistribution of type II InsP3 receptors within the endoplasmic reticulum and nuclear envelope, from a diffuse pattern with a few small aggregates in resting cells to large isolated clusters after antigen stimulation. Redistribution of type II InsP3 receptors is also seen after treatment of RBL-2H3 cells with ionomycin or thapsigargin. InsP3 receptor clustering occurs within 5–10 min of stimulus and persists for up to 1 h in the presence of antigen. Receptor clustering is independent of endoplasmic reticulum vesiculation, which occurs only at ionomycin concentrations >1 μM, and maximal clustering responses are dependent on the presence of extracellular calcium. InsP3 receptor aggregation may be a characteristic cellular response to Ca2+-mobilizing ligands, because similar results are seen after activation of phospholipase C-linked G-protein-coupled receptors; cholecystokinin causes type II receptor redistribution in rat pancreatoma AR4–2J cells, and carbachol causes type III receptor redistribution in muscarinic receptor-expressing hamster lung fibroblast E36M3R cells. Stimulation of these three cell types leads to a reduction in InsP3 receptor levels only in AR4–2J cells, indicating that receptor clustering does not correlate with receptor down-regulation. The calcium-dependent aggregation of InsP3 receptors may contribute to the previously observed changes in affinity for InsP3 in the presence of elevated Ca2+ and/or may establish discrete regions within refilled stores with varying capacity to release Ca2+ when a subsequent stimulus results in production of InsP3.

Global warming in the twenty-first century: An alternative scenario

A common view is that the current global warming rate will continue or accelerate. But we argue that rapid warming in recent decades has been driven mainly by non-CO2 greenhouse gases (GHGs), such as chlorofluorocarbons, CH4, and N2O, not by the products of fossil fuel burning, CO2 and aerosols, the positive and negative climate forcings of which are partially offsetting. The growth rate of non-CO2 GHGs has declined in the past decade. If sources of CH4 and O3 precursors were reduced in the future, the change in climate forcing by non-CO2 GHGs in the next 50 years could be near zero. Combined with a reduction of black carbon emissions and plausible success in slowing CO2 emissions, this reduction of non-CO2 GHGs could lead to a decline in the rate of global warming, reducing the danger of dramatic climate change. Such a focus on air pollution has practical benefits that unite the interests of developed and developing countries. However, assessment of ongoing and future climate change requires composition-specific long-term global monitoring of aerosol properties.

Toward optimized carbohydrate-based anticancer vaccines: Epitope clustering, carrier structure, and adjuvant all influence antibody responses to Lewisy conjugates in mice

The feasibility of using carbohydrate-based vaccines for the immunotherapy of cancer is being actively explored at the present time. Although a number of clinical trials have already been conducted with glycoconjugate vaccines, the optimal design and composition of the vaccines has yet to be determined. Among the candidate antigens being examined is Lewisy (Ley), a blood group-related antigen that is overexpressed on the majority of human carcinomas. Using Ley as a model for specificity, we have examined the role of epitope clustering, carrier structure, and adjuvant on the immunogenicity of Ley conjugates in mice. A glycolipopeptide containing a cluster of three contiguous Ley-serine epitopes and the Pam3Cys immunostimulating moiety was found to be superior to a similar construct containing only one Ley-serine epitope in eliciting antitumor cell antibodies. Because only IgM antibodies were produced by this vaccine, the effect on immunogenicity of coupling the glycopeptide to keyhole limpet hemocyanin was examined; although both IgM and IgG antibodies were formed, the antibodies reacted only with the immunizing structure. Reexamination of the clustered Ley-serine Pam3Cys conjugate with the adjuvant QS-21 resulted in the identification of both IgG and IgM antibodies reacting with tumor cells, thus demonstrating the feasibility of an entirely synthetic carbohydrate-based anticancer vaccine in an animal model.

A “midinfrared” scenario for cuprate superconductivity

I conjecture that the mechanism of superconductivity in the cuprates is a saving, due to the improved screening resulting from Cooper pair formation, of the part of the Coulomb energy associated with long wavelengths and midinfrared frequencies. This scenario is shown to provide a plausible explanation of the trend of transition temperature with layering structure in the Ca-spaced compounds and to predict a spectacularly large decrease in the electron-energy-loss spectroscopy cross-section in the midinfrared region on transition to the superconducting state, as well as less spectacular but still surprisingly large changes in the optical behavior. Existing experimental results appear to be consistent with this picture.