Active Foreground Region Extraction and Tracking for Sports Video Annotation

Automatic video segmentation plays a vital role in sports videos annotation. This paper presents a fully automatic and computationally efficient algorithm for analysis of sports videos. Various methods of automatic shot boundary detection have been proposed to perform automatic video segmentation. These investigations mainly concentrate on detecting fades and dissolves for fast processing of the entire video scene without providing any additional feedback on object relativity within the shots. The goal of the proposed method is to identify regions that perform certain activities in a scene. The model uses some low-level feature video processing algorithms to extract the shot boundaries from a video scene and to identify dominant colours within these boundaries. An object classification method is used for clustering the seed distributions of the dominant colours to homogeneous regions. Using a simple tracking method a classification of these regions to active or static is performed. The efficiency of the proposed framework is demonstrated over a standard video benchmark with numerous types of sport events and the experimental results show that our algorithm can be used with high accuracy for automatic annotation of active regions for sport videos.

Holistic Design In High-Speed Optical Interconnects

Integrated circuit scaling has enabled a huge growth in processing capability, which necessitates a corresponding increase in inter-chip communication bandwidth. As bandwidth requirements for chip-to-chip interconnection scale, deficiencies of electrical channels become more apparent. Optical links present a viable alternative due to their low frequency-dependent loss and higher bandwidth density in the form of wavelength division multiplexing. As integrated photonics and bonding technologies are maturing, commercialization of hybrid-integrated optical links are becoming a reality. Increasing silicon integration leads to better performance in optical links but necessitates a corresponding co-design strategy in both electronics and photonics. In this light, holistic design of high-speed optical links with an in-depth understanding of photonics and state-of-the-art electronics brings their performance to unprecedented levels. This thesis presents developments in high-speed optical links by co-designing and co-integrating the primary elements of an optical link: receiver, transmitter, and clocking.

In the first part of this thesis a 3D-integrated CMOS/Silicon-photonic receiver will be presented. The electronic chip features a novel design that employs a low-bandwidth TIA front-end, double-sampling and equalization through dynamic offset modulation. Measured results show -14.9dBm of sensitivity and energy efficiency of 170fJ/b at 25Gb/s. The same receiver front-end is also used to implement source-synchronous 4-channel WDM-based parallel optical receiver. Quadrature ILO-based clocking is employed for synchronization and a novel frequency-tracking method that exploits the dynamics of IL in a quadrature ring oscillator to increase the effective locking range. An adaptive body-biasing circuit is designed to maintain the per-bit-energy consumption constant across wide data-rates. The prototype measurements indicate a record-low power consumption of 153fJ/b at 32Gb/s. The receiver sensitivity is measured to be -8.8dBm at 32Gb/s.

Next, on the optical transmitter side, three new techniques will be presented. First one is a differential ring modulator that breaks the optical bandwidth/quality factor trade-off known to limit the speed of high-Q ring modulators. This structure maintains a constant energy in the ring to avoid pattern-dependent power droop. As a first proof of concept, a prototype has been fabricated and measured up to 10Gb/s. The second technique is thermal stabilization of micro-ring resonator modulators through direct measurement of temperature using a monolithic PTAT temperature sensor. The measured temperature is used in a feedback loop to adjust the thermal tuner of the ring. A prototype is fabricated and a closed-loop feedback system is demonstrated to operate at 20Gb/s in the presence of temperature fluctuations. The third technique is a switched-capacitor based pre-emphasis technique designed to extend the inherently low bandwidth of carrier injection micro-ring modulators. A measured prototype of the optical transmitter achieves energy efficiency of 342fJ/bit at 10Gb/s and the wavelength stabilization circuit based on the monolithic PTAT sensor consumes 0.29mW.

Lastly, a first-order frequency synthesizer that is suitable for high-speed on-chip clock generation will be discussed. The proposed design features an architecture combining an LC quadrature VCO, two sample-and-holds, a PI, digital coarse-tuning, and rotational frequency detection for fine-tuning. In addition to an electrical reference clock, as an extra feature, the prototype chip is capable of receiving a low jitter optical reference clock generated by a high-repetition-rate mode-locked laser. The output clock at 8GHz has an integrated RMS jitter of 490fs, peak-to-peak periodic jitter of 2.06ps, and total RMS jitter of 680fs. The reference spurs are measured to be –64.3dB below the carrier frequency. At 8GHz the system consumes 2.49mW from a 1V supply.

Feature-based tracking of urethral motion in low-resolution trans-perineal ultrasound

This paper describes a novel algorithm for tracking the motion of the urethra from trans-perineal ultrasound. Our work is based on the structure-from-motion paradigm and therefore handles well structures with ill-defined and partially missing boundaries. The proposed approach is particularly well-suited for video sequences of low resolution and variable levels of blurriness introduced by anatomical motion of variable speed. Our tracking method identifies feature points on a frame by frame basis using the SURF detector/descriptor. Inter-frame correspondence is achieved using nearest-neighbor matching in the feature space. The motion is estimated using a non-linear bi-quadratic model, which adequately describes the deformable motion of the urethra. Experimental results are promising and show that our algorithm performs well when compared to manual tracking.

Feature-based tracking of urethral motion in low-resolution trans-perineal ultrasound

This paper describes a novel algorithm for tracking the motion of the urethra from trans-perineal ultrasound. Our work is based on the structure-from-motion paradigm and therefore handles well structures with ill-defined and partially missing boundaries. The proposed approach is particularly well-suited for video sequences of low resolution and variable levels of blurriness introduced by anatomical motion of variable speed. Our tracking method identifies feature points on a frame by frame basis using the SURF detector/descriptor. Inter-frame correspondence is achieved using nearest-neighbor matching in the feature space. The motion is estimated using a non-linear bi-quadratic model, which adequately describes the deformable motion of the urethra. Experimental results are promising and show that our algorithm performs well when compared to manual tracking.

Análise dos esforços de alta intensidade de jogadores de futebol profissional

Universidade Estadual de Campinas . Faculdade de Educação Física

Análise quantitativa da distribuição de jogadores de futebol em campo durante jogos oficiais

Universidade Estadual de Campinas. Faculdade de Educação Física

Toward Optimal Design of Piezoelectric Transducers Based on Multifunctional and Smoothly Graded Hybrid Material Systems

This work explores the design of piezoelectric transducers based on functional material gradation, here named functionally graded piezoelectric transducer (FGPT). Depending on the applications, FGPTs must achieve several goals, which are essentially related to the transducer resonance frequency, vibration modes, and excitation strength at specific resonance frequencies. Several approaches can be used to achieve these goals; however, this work focuses on finding the optimal material gradation of FGPTs by means of topology optimization. Three objective functions are proposed: (i) to obtain the FGPT optimal material gradation for maximizing specified resonance frequencies; (ii) to design piezoelectric resonators, thus, the optimal material gradation is found for achieving desirable eigenvalues and eigenmodes; and (iii) to find the optimal material distribution of FGPTs, which maximizes specified excitation strength. To track the desirable vibration mode, a mode-tracking method utilizing the `modal assurance criterion` is applied. The continuous change of piezoelectric, dielectric, and elastic properties is achieved by using the graded finite element concept. The optimization algorithm is constructed based on sequential linear programming, and the concept of continuum approximation of material distribution. To illustrate the method, 2D FGPTs are designed for each objective function. In addition, the FGPT performance is compared with the non-FGPT one.

Mechanical Blocking Mechanism for the Columnar to Equiaxed Transition

Mechanical blocking of the columnar front during the columnar to equiaxed transition (CET) is studied by quantitatively comparing the CET positions obtained with one stochastic model and two deterministic models for the unidirectional solidification of an Al-7 (wt pct) Si alloy. One of the deterministic models is based on the solutal blocking of the columnar front, whereas the other model is based on the mechanical blocking. The solutal-blocking model and the mechanical-blocking model with the traditional blocking fraction of 0.49 give columnar zones larger than those predicted with the stochastic model. When a blocking fraction of 0.2 is adopted, however, the agreement is very good for a range of nucleation undercoolings and number density of equiaxed grains. Therefore, changing the mechanical-blocking fraction in deterministic models from 0.49 to 0.2 seems to model more accurately the mechanical-blocking process that can lead to the CET.

Conservation of a threatened European tree frog (Hyla arborea) metapopulation

Summary: Amphibians are among the most vulnerable animals of the world. One third of all species are currently threatened with extinction. Habitat loss is the major menace to pond- and stream-breeding species in the old world. In highly urbanized landscape like the Swiss Plateau, most species suffer from habitat reduction and fragmentation. Among all indigenous species, the European tree frog (Hyla arborea L., 1758) is one of the most endangered. It experienced an alarming decline during the last century and its regional long-term persistence is not guaranteed. We developed a monitoring framework based on calling male counts which included multiple visits to each wetland during the reproduction period in order to precisely determine its distribution on the Lemanic coast. Our results indicate that visiting populations 3 limes under suitable climatic conditions (temperature >20°C) provides reliable presence/absence data. Based on our monitoring data, we analyzed the species requirements regarding its breeding habitat. It appeared that anthropogenic activities had paradoxical effects on the species. On one hand, urbanization, traffic and intensive agriculture had a strong detrimental effect on tree frog distribution. On the other hand, large tree frog populations were frequently associated with gravel pits and military training grounds. Our results allowed us to create a habitat suitability map taking into account detrimental landscape elements around ponds (>1100m away from urban areas and >500m away from first class roads). In parallel, we developed a metapopulation model of the European tree frog in order to identify the critical threats to the long term persistence of the species. Our results indicated that suitable pond density is at the low end of the species requirements. Pond creation must therefore be considered an essential complementary approach to pond conservation and restoration. Our model also provided a mapping solution permitting the location of the must suitable area for pond creation from a metapopulation perspective. As many other amphibians, the European tree frog is not only exposed to an aquatic habitat (breeding and larval period), but also to a terrestrial stage (summer and overwintering habitats). Unfortunately, animals in their terrestrial phase are less conspicuous and, as a consequence, their terrestrial needs are relatively unknown. Using a recent tracking method (the Harmonic Direction Finder), we followed post-breeding frogs and identified favored terrestrial habitats, thus providing another practical conservation tool. We conclude that only the combination of multiple spatially explicit approaches (landscape-scale habitat suitability, metapopulation dynamics and terrestrial needs) is likely to provide wildlife managers with effective tools for the conservation of highly endangered amphibians. Résumé: Les amphibiens font partie des animaux les plus vulnérables du monde. Un tiers des espèces est actuellement menacé d'extinction. Dans l'ancien monde, la disparition des habitats constitue la principale menace pour les grenouilles, crapauds, tritons et salamandres. Dans les paysages fortement urbanisés comme le Plateau Suisse, la plupart des espèces souffrent d'une réduction et d'une fragmentation de leurs habitats. Parmi toutes les espèces indigènes, la rainette verte (Hyla arborea L., 1758) est l'une des plus menacée. Sa distribution a régressé de manière alarmante durant le siècle passé et sa survie régionale à long terme n'est pas assurée. Nous avons développé une méthode de suivi des populations se basant sur le comptage des mâles chanteurs durant la période de reproduction. Cette méthode requiert plusieurs visites à chaque plan d'eau de manière à déterminer précisément la distribution de l'espèce. Nos résultats démontrent que 3 visites par population dans des conditions climatiques favorable (température >20°C) permettent d'obtenir des données de présence/ absence valables. Sur la base de nos comptages sur la Côte lémanique, nous avons analysé les exigences de l'espèce concernant ses sites de reproduction. Il est apparu que les activités humaines avaient un effet paradoxal sur l'espèce. D'une part, l'urbanisation, le trafic routier et l'intensification de l'agriculture ont un effet fortement préjudiciable, tandis que d'autre part les plus grandes populations sont souvent associées à des gravières et autres places d'armes. Nos résultats ont permis de créer une carte de qualité d'habitat prenant en compte les éléments paysagers préjudiciables à la rainette (situé à plus de 1100m de zones urbaines et à plus de 500m de routes de première classe). En parallèle, nous avons développé un modèle métapopulationnel (incluant l'ensemble des populations) de manière à identifier les menaces prépondérantes sur la survie à long terme de l'espèce. Nos résultats ont permis de déterminer que la densité actuelle de plans d'eau adéquats est à la limite inférieure des exigences de l'espèce. La création d'étangs doit donc être considérée comme une approche indispensable et complémentaire à la protection et à la restauration des sites existants. Notre modèle a également fourni des résultats cartographiables permettant l'identification des sites les plus appropriés dans une perspective métapopulationnelle. Comme de nombreux autres amphibiens, la rainette verte est exposée à un habitat aquatique (reproduction et développement larvaire) ainsi qu'à un habitat terrestre (été et hiver). Les animaux étant particulièrement cryptiques dans cette seconde phase, leurs besoins terrestres sont relativement mal connus. Nous avons donc développé une nouvelle méthode de télémétrie basée sur le goniomètre harmonique. Cette méthode nous a permis de suivre des rainettes dans leurs migrations jusqu'à leurs habitats d'été et d'établir ainsi des recommandations pratiques pour la conservation de la rainette. Nous concluons que la combinaison de multiples approches spatialement explicites (qualité d'habitat, dynamique de métapopulation et habitats terrestres) est seule à même de produire des outils efficaces pour la conservation des espèces menacées d'amphibiens.

Using 3D surface datasets to understand landslide evolution: From analogue models to real case study

Early detection of landslide surface deformation with 3D remote sensing techniques, as TLS, has become a great challenge during last decade. To improve our understanding of landslide deformation, a series of analogue simulation have been carried out on non-rigid bodies coupled with 3D digitizer. All these experiments have been carried out under controlled conditions, as water level and slope angle inclination. We were able to follow 3D surface deformation suffered by complex landslide bodies from precursory deformation still larger failures. These experiments were the basis for the development of a new algorithm for the quantification of surface deformation using automatic tracking method on discrete points of the slope surface. To validate the algorithm, comparisons were made between manually obtained results and algorithm surface displacement results. Outputs will help in understanding 3D deformation during pre-failure stages and failure mechanisms, which are fundamental aspects for future implementation of 3D remote sensing techniques in early warning systems.

Real-time Imaging and Mosaicking of Planar Surfaces

Laajojen pintojen kuvaaminen rajoitetussa työskentelytilassa riittävällä kuvatarkkuudella voi olla vaikeaa. Kuvaaminen on suoritettava osissa ja osat koottava saumattomaksi kokonaisnäkymäksi eli mosaiikkikuvaksi. Kuvauslaitetta käsin siirtelevän käyttäjän on saatava välitöntä palautetta, jotta mosaiikkiin ei jäisi aukkoja ja työ olisi nopeaa. Työn tarkoituksena oli rakentaa pieni, kannettava ja tarkka kuvauslaite paperi- ja painoteollisuuden tarpeisiin sekä kehittää palautteen antamiseen menetelmä, joka koostaaja esittää karkeaa mosaiikkikuvaa tosiajassa. Työssä rakennettiin kaksi kuvauslaitetta: ensimmäinen kuluttajille ja toinen teollisuuteen tarkoitetuista osista. Kuvamateriaali käsiteltiin tavallisella pöytätietokoneella. Videokuvien välinen liike laskettiin yksinkertaisella seurantamenetelmällä ja mosaiikkikuvaa koottiin kameroiden kuvanopeudella. Laskennallista valaistuksenkorjausta tutkittiin ja kehitetty menetelmä otettiin käyttöön. Ensimmäisessä kuvauslaitteessa on ongelmia valaistuksen ja linssivääristymien kanssa tuottaen huonolaatuisia mosaiikkikuvia. Toisessa kuvauslaitteessa nämä ongelmat on korjattu. Seurantamenetelmä toimii hyvin ottaen huomioon sen yksinkertaisuuden ja siihen ehdotetaan monia parannuksia. Työn tulokset osoittavat, että tosiaikainen mosaiikkikuvan koostaminen megapikselin kuvamateriaalista on mahdollista kuluttajille tarkoitetulla tietokonelaitteistolla.

Tunkeuman hallinta MIG/MAG-hitsauksessa

MIG/MAG-hitsaukselle tyypillinen ominaispiirre, valokaaren itsesäätyvyys, saavutetaan vakiojännitelähdettä käyttämällä. Valokaaren sisäisen säätömekanismin ansiosta kaarenpituus pysyy vakiona, vaikka hitsauspolttimen ja työkappaleen välinen etäisyys vaihtelisi hitsauksen aikana. Vakiojännitelähteen käyttäminen aiheuttaa kuitenkin kaaritehon vaihtelua vapaalankapituuden muuttuessa. Vapaalangan kasvaessa liian pitkäksi kaariteho laskee niin alas, ettei se enää riitä sulattamaan tarpeeksi perusainetta railon kyljissä. Tämän seurauksena hitsausliitokseen syntyy erilaisia liittymävirheitä. Käsinhitsauksessa vapaalangan pituus saattaa polttimen epävakaasta kuljetuksesta johtuen vaihdella erityisesti kokemattomilla hitsaajilla. Mekanisoidussa ja automatisoidussa hitsauksessa railojen mitta- ja muotopoikkeamat aiheuttavat vapaalankapituuden vaihtelua. Poikkeamia syntyy kaikissa hitsausrailojen esivalmistusvaiheissa. Lisäksi lämmöntuonnin aiheuttamat muodonmuutokset kappaleissa lisäävät poikkeamia railonsovituksessa hitsauksen aikana. Ongelma on useimmiten ratkaistavissa railonseurantaa käyttämällä. Railonseurantajärjestelmät ovat kuitenkin kalliita, eivätkä ne toimi luotettavasti kaikissa olosuhteissa. Diplomityössä tutkittiin uutta MIG/MAG-hitsauksen reaaliaikaiseen tunkeuman hallintaan kehitettyä säätöjärjestelmää. Työn tavoitteina olivat säätöjärjestelmän luotettavan toiminnan takaavien reunaehtojen ja kosketussuutinetäisyyden suositusrajojen määrittäminen. Tavoitteiden täyttämiseksi työn kokeellisessa osiossa suoritettiin laaja hitsauskokeiden sarja, jossa hitsattavina materiaaleina käytettiin seostamatonta ja runsasseosteista terästä.

Exploitation de contraintes photométriques et géométriques en vision : application au suivi, au calibrage et à la reconstruction

Cette thése a été réalisée dans le cadre d'une cotutelle avec l'Institut National Polytechnique de Grenoble (France). La recherche a été effectuée au sein des laboratoires de vision 3D (DIRO, UdM) et PERCEPTION-INRIA (Grenoble).

Regional Differences in the Prediction of Extratropical Cyclones by the ECMWF Ensemble Prediction System

A regional study of the prediction of extratropical cyclones by the European Centre for Medium-Range Weather Forecasts (ECMWF) Ensemble Prediction System (EPS) has been performed. An objective feature-tracking method has been used to identify and track the cyclones along the forecast trajectories. Forecast error statistics have then been produced for the position, intensity, and propagation speed of the storms. In previous work, data limitations meant it was only possible to present the diagnostics for the entire Northern Hemisphere (NH) or Southern Hemisphere. A larger data sample has allowed the diagnostics to be computed separately for smaller regions around the globe and has made it possible to explore the regional differences in the prediction of storms by the EPS. Results show that in the NH there is a larger ensemble mean error in the position of storms over the Atlantic Ocean. Further analysis revealed that this is mainly due to errors in the prediction of storm propagation speed rather than in direction. Forecast storms propagate too slowly in all regions, but the bias is about 2 times as large in the NH Atlantic region. The results show that storm intensity is generally overpredicted over the ocean and underpredicted over the land and that the absolute error in intensity is larger over the ocean than over the land. In the NH, large errors occur in the prediction of the intensity of storms that originate as tropical cyclones but then move into the extratropics. The ensemble is underdispersive for the intensity of cyclones (i.e., the spread is smaller than the mean error) in all regions. The spatial patterns of the ensemble mean error and ensemble spread are very different for the intensity of cyclones. Spatial distributions of the ensemble mean error suggest that large errors occur during the growth phase of storm development, but this is not indicated by the spatial distributions of the ensemble spread. In the NH there are further differences. First, the large errors in the prediction of the intensity of cyclones that originate in the tropics are not indicated by the spread. Second, the ensemble mean error is larger over the Pacific Ocean than over the Atlantic, whereas the opposite is true for the spread. The use of a storm-tracking approach, to both weather forecasters and developers of forecast systems, is also discussed.

TIGGE: Comparison of the prediction of northern hemisphere extratropical cyclones by different ensemble prediction systems

The Observing System Research and Predictability Experiment (THORPEX) Interactive Grand Global Ensemble (TIGGE) is a World Weather Research Programme project. One of its main objectives is to enhance collaboration on the development of ensemble prediction between operational centers and universities by increasing the availability of ensemble prediction system (EPS) data for research. This study analyzes the prediction of Northern Hemisphere extratropical cyclones by nine different EPSs archived as part of the TIGGE project for the 6-month time period of 1 February 2008–31 July 2008, which included a sample of 774 cyclones. An objective feature tracking method has been used to identify and track the cyclones along the forecast trajectories. Forecast verification statistics have then been produced [using the European Centre for Medium-Range Weather Forecasts (ECMWF) operational analysis as the truth] for cyclone position, intensity, and propagation speed, showing large differences between the different EPSs. The results show that the ECMWF ensemble mean and control have the highest level of skill for all cyclone properties. The Japanese Meteorological Administration (JMA), the National Centers for Environmental Prediction (NCEP), the Met Office (UKMO), and the Canadian Meteorological Centre (CMC) have 1 day less skill for the position of cyclones throughout the forecast range. The relative performance of the different EPSs remains the same for cyclone intensity except for NCEP, which has larger errors than for position. NCEP, the Centro de Previsão de Tempo e Estudos Climáticos (CPTEC), and the Australian Bureau of Meteorology (BoM) all have faster intensity error growth in the earlier part of the forecast. They are also very underdispersive and significantly underpredict intensities, perhaps due to the comparatively low spatial resolutions of these EPSs not being able to accurately model the tilted structure essential to cyclone growth and decay. There is very little difference between the levels of skill of the ensemble mean and control for cyclone position, but the ensemble mean provides an advantage over the control for all EPSs except CPTEC in cyclone intensity and there is an advantage for propagation speed for all EPSs. ECMWF and JMA have an excellent spread–skill relationship for cyclone position. The EPSs are all much more underdispersive for cyclone intensity and propagation speed than for position, with ECMWF and CMC performing best for intensity and CMC performing best for propagation speed. ECMWF is the only EPS to consistently overpredict cyclone intensity, although the bias is small. BoM, NCEP, UKMO, and CPTEC significantly underpredict intensity and, interestingly, all the EPSs underpredict the propagation speed, that is, the cyclones move too slowly on average in all EPSs.