Towards automatic extraction of expressive elements from motion pictures : tempo

This paper proposes a unique computational approach to extraction of expressive elements of motion pictures for deriving high level semantics of stories portrayed, thus enabling better video annotation and interpretation systems. This approach, motivated and directed by the existing cinematic conventions known as film grammar, as a first step towards demonstrating its effectiveness, uses the attributes of motion and shot length to define and compute a novel measure of tempo of a movie. Tempo flow plots are defined and derived for four full-length movies and edge analysis is performed leading to the extraction of dramatic story sections and events signaled by their unique tempo. The results confirm tempo as a useful attribute in its own right and a promising component of semantic constructs such as tone or mood of a film.

Early jump-out corner detectors

Two corner detectors are presented, one of which works by testing similarity of image patches along the contour direction to detect curves in the image contour, and the other of which uses direct estimation image curvature along the contour direction. The operators are fast, robust to noise, and self-thresholding. An interpretation of the Kitchen-Rosenfeld corner operator is presented which shows that this operator can also be viewed as the second derivative of the image function along the edge direction.

Intelligent line segment perception with cortex-like mechanisms

This paper proposes a novel general framework for line segment perception, which is motivated by a biological visual cortex, and requires no parameter tuning. In this framework, we design a model to approximate receptive fields of simple cells. More importantly, the structure of biological orientation columns is imitated by organizing artificial complex and hypercomplex cells with the same orientation into independent arrays. Besides, an interaction mechanism is implemented by a set of self-organization rules. Enlightened by the visual topological theory, the outputs of these artificial cells are integrated to generate line segments that can describe nonlocal structural information of images. Each line segment is evaluated quantitatively by its significance. The computation complexity is also analyzed. The proposed method is tested and compared to state-of-the-art algorithms on real images with complex scenes and strong noises. The experiments demonstrate that our method outperforms the existing methods in the balance between conciseness and completeness.

Dynamic programming approach for road centerline extraction from digital images

This paper presents a dynamic programming approach for semi-automated road extraction from medium-and high-resolution images. This method is a modified version of a pre-existing dynamic programming method for road extraction from low-resolution images. The basic assumption of this pre-existing method is that roads manifest as lines in low-resolution images (pixel footprint> 2 m) and as such can be modeled and extracted as linear features. On the other hand, roads manifest as ribbon features in medium- and high-resolution images (pixel footprint ≤ 2 m) and, as a result, the focus of road extraction becomes the road centerlines. The original method can not accurately extract road centerlines from medium- and high- resolution images. In view of this, we propose a modification of the merit function of the original approach, which is carried out by a constraint function embedding road edge properties. Experimental results demonstrated the modified algorithm's potential in extracting road centerlines from medium- and high-resolution images.

Algoritmos de detecção de bordas implementados em FPGA

Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES)

Extração semi-automática de edificações com análise do modelo numérico de elevações

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)

Implementação em FPGA de um sistema para processamento de imagens digitais para aplicações diversificadas

Pós-graduação em Ciência da Computação - IBILCE

Medidas de deslocamento e vibrações através de imagens de câmeras digitais

Pós-graduação em Engenharia Mecânica - FEIS

Segmentação de texturas em imagens digitais utilizando wavelets redundantes

Pós-graduação em Matematica Aplicada e Computacional - FCT

Tecniche per la separazione live di piani di profondita in un flusso video mediante Kinect e una applicazione nell'intrattenimento digitale

Keying e composizione sono da sempre tecniche ampiamente utilizzate in contesti multimediali, quali produzione cinematografica e televisiva; il chroma keying è in particolare la tecnica più popolare, ma presenta una serie di limiti e problematiche. In questo elaborato viene proposta una tecnica alternativa di estrazione, basata sull'uso della profondità, operante in tempo reale e che sfrutta il device Kinect di Microsoft. Sono proposti una serie di algoritmi, basati su tecniche di edge detection, utilizzati per il miglioramento della depth map lungo i bordi di estrazione; viene infine testato il risultato ottenuto dall'implementazione del sistema e proposta una possibile applicazione nell'ambito del teatro multimediale.

A new information fusion method for land-use classification using high resolution satellite imagery

Satellite image classification involves designing and developing efficient image classifiers. With satellite image data and image analysis methods multiplying rapidly, selecting the right mix of data sources and data analysis approaches has become critical to the generation of quality land-use maps. In this study, a new postprocessing information fusion algorithm for the extraction and representation of land-use information based on high-resolution satellite imagery is presented. This approach can produce land-use maps with sharp interregional boundaries and homogeneous regions. The proposed approach is conducted in five steps. First, a GIS layer - ATKIS data - was used to generate two coarse homogeneous regions, i.e. urban and rural areas. Second, a thematic (class) map was generated by use of a hybrid spectral classifier combining Gaussian Maximum Likelihood algorithm (GML) and ISODATA classifier. Third, a probabilistic relaxation algorithm was performed on the thematic map, resulting in a smoothed thematic map. Fourth, edge detection and edge thinning techniques were used to generate a contour map with pixel-width interclass boundaries. Fifth, the contour map was superimposed on the thematic map by use of a region-growing algorithm with the contour map and the smoothed thematic map as two constraints. For the operation of the proposed method, a software package is developed using programming language C. This software package comprises the GML algorithm, a probabilistic relaxation algorithm, TBL edge detector, an edge thresholding algorithm, a fast parallel thinning algorithm, and a region-growing information fusion algorithm. The county of Landau of the State Rheinland-Pfalz, Germany was selected as a test site. The high-resolution IRS-1C imagery was used as the principal input data.

Neuregulin-1 beta attenuates doxorubicin-induced alterations of excitation-contraction coupling and reduces oxidative stress in adult rat cardiomyocytes

Treatment of metastatic breast cancer with doxorubicin (Doxo) in combination with trastuzumab, an antibody targeting the ErbB2 receptor, results in an increased incidence of heart failure. Doxo therapy induces reactive oxygen species (ROS) and alterations of calcium homeostasis. Therefore, we hypothesized that neuregulin-1 beta (NRG), a ligand of the cardiac ErbB receptors, reduces Doxo-induced alterations of EC coupling by triggering antioxidant mechanisms. Adult rat ventricular cardiomyocytes (ARVM) were isolated and treated for 18-48 h. SERCA protein was analyzed by Western blot, EC coupling parameters by fura-2 and video edge detection, gene expression by RT-PCR, and ROS by DCF-fluorescence microscopy. At clinically relevant doses Doxo reduced cardiomyocytes contractility, SERCA protein and SR calcium content. NRG, similarly as the antioxidant N-acetylcystein (NAC), did not affect EC coupling alone, but protected against Doxo-induced damage. NRG and Doxo showed an opposite modulation of glutathione reductase gene expression. NRG, similarly as NAC, reduced peroxide- or Doxo-induced oxidative stress. Specific inhibitors showed, that the antioxidant action of NRG depended on signaling via the ErbB2 receptor and on the Akt- and not on the MAPK-pathway. Therefore, NRG attenuates Doxo-induced alterations of EC coupling and reduces oxidative stress in ARVM. Inhibition of the ErbB2/NRG signaling pathway by trastuzumab in patients concomitantly treated with Doxo might prevent beneficial effects of NRG in the myocardium.

Brain responses to auditory and visual stimulus offset: Shared representations of temporal edges

Edges are crucial for the formation of coherent objects from sequential sensory inputs within a single modality. Moreover, temporally coincident boundaries of perceptual objects across different sensory modalities facilitate crossmodal integration. Here, we used functional magnetic resonance imaging in order to examine the neural basis of temporal edge detection across modalities. Onsets of sensory inputs are not only related to the detection of an edge but also to the processing of novel sensory inputs. Thus, we used transitions from input to rest (offsets) as convenient stimuli for studying the neural underpinnings of visual and acoustic edge detection per se. We found, besides modality-specific patterns, shared visual and auditory offset-related activity in the superior temporal sulcus and insula of the right hemisphere. Our data suggest that right hemispheric regions known to be involved in multisensory processing are crucial for detection of edges in the temporal domain across both visual and auditory modalities. This operation is likely to facilitate cross-modal object feature binding based on temporal coincidence. Hum Brain Mapp, 2008. (c) 2008 Wiley-Liss, Inc.

Inhibition of ErbB2/neuregulin signaling augments paclitaxel-induced cardiotoxicity in adult ventricular myocytes

Paclitaxel (Taxol) has been successfully combined with the monoclonal antibody trastuzumab (Herceptin) in the treatment of ErbB2 overexpressing cancers. However, this combination therapy showed an unexpected synergistic increase in cardiac dysfunction. We have studied the mechanisms of paclitaxel/anti-ErbB2 cardiotoxicity in adult rat ventricular myocytes (ARVM). Myofibrillar organization was assessed by immunofluorescence microscopy and cell viability was tested by the TUNEL-, LDH- and MTT-assay. Oxidative stress was measured by DCF-fluorescence and myocyte contractile function by video edge-detection and fura-2 fluorescence. Treatment of ARVM with paclitaxel or antibodies to ErbB2 caused a significant increase in myofilament degradation, similarly as observed with an inhibitor of MAPK-signaling, but not apoptosis, necrosis or changes in mitochondrial activity. Paclitaxel-treatment and anti-ErbB2 reduced Erk1/2 phosphorylation. Paclitaxel increased diastolic calcium, shortened relaxation time and reduced fractional shortening in combination with anti-ErbB2. A minor increase in oxidative stress by paclitaxel or anti-ErbB2 was found. We conclude, that concomitant inhibition of ErbB2 receptors and paclitaxel treatment has an additive worsening effect on adult cardiomyocytes, mainly discernible in changes of myofibrillar structure and function, but in the absence of cell death. A potential mechanism is the modulation of the MAPK/Erk1/2 signaling by both drugs.

The role of cell death and myofibrillar damage in contractile dysfunction of long-term cultured adult cardiomyocytes exposed to doxorubicin

In failing hearts cardiomyocytes undergo alterations in cytoskeleton structure, contractility and viability. It is not known presently, how stress-induced changes of myofibrils correlate with markers for cell death and contractile function in cardiomyocytes. Therefore, we have studied the progression of contractile dysfunction, myofibrillar damage and cell death in cultured adult cardiomyocytes exposed to the cancer therapy doxorubicin. We demonstrate, that long-term cultured adult cardiomyocytes, a well-established model for the study of myofibrillar structure and effects of growth factors, can also be used to assess contractility and calcium handling. Adult rat ventricular myocytes (ARVM) were isolated and cultured for a total of 14 days in serum containing medium. The organization of calcium-handling proteins and myofibrillar structure in freshly isolated and in long-term cultured adult cardiomyocytes was studied by immunofluorescence and electron microscopy. Excitation contraction-coupling was analyzed by fura 2 and video edge detection in electrically paced cardiomyocytes forming a monolayer, and cell death and viability was measured by TUNEL assay, LDH release, MTT assay, and Western blot for LC3. Adult cardiomyocytes treated with Doxo showed apoptosis and necrosis only at supraclinical concentrations. Treated cells displayed merely alterations in cytoskeleton organization and integrity concomitant with contractile dysfunction and up-regulation of autophagosome formation, but no change in total sarcomeric protein content. We propose, that myofibrillar damage contributes to contractile dysfunction prior to cell death in adult cardiomyocytes exposed to clinically relevant concentrations of anthracyclines.