Uma arquitetura de referência para o processamento distribuído de stream de dados em soluções analíticas de near real-time

Dissertação (mestrado)—Universidade de Brasília, Faculdade de Tecnologia, Departamento de Engenharia Elétrica, 2015.

Collaboration in Virtual Enterprises through the Smart Vortex Suite

Part 12: Collaboration Platforms

Modelo de um observatório municipal do desporto no concelho de Setúbal

A presente dissertação tem como objetivo geral apresentar uma proposta de um modelo de observatório municipal do desporto na administração local, nomeadamente no concelho de Setúbal. Podem ser verificados alguns estudos sobre a temática dos observatórios no sector do desporto (Leite, 2013; Gaspar 2014). Em plena sociedade de informação, as organizações têm de gerir grandes fluxos de dados. Têm de ter capacidade de adaptação à realidade, mas acima de tudo, uma atitude pró-ativa no sentido de anteciparem novos cenários. Segundo Albornoz e Herschmann (2006), os observatórios costumam recolher, registar, acompanhar, interpretar dados, produzir indicadores estatísticos, criar metodologias para codificar, classificar e categorizar informações, estabelecendo conexões entre pessoas que trabalham em áreas similares, bem como monitorizar e analisar tendências. É exigido à administração local, serviços de qualidade e de transparência na adoção das suas politicas desportivas e a existência de um instrumento de recolha de informação, estruturado com base num modelo de análise que permita conhecer, analisar e compreender o estado de um dado contexto desportivo em tempo real, irá permitir a criação de uma base de dados contendo informação atualizada e confiável. Neste contexto, os sistemas de informação, quando desenvolvidos e aplicados, vão permitir a recolha de informação fundamental sobre o comportamento interno da organização (Claudino, 2005). A presente pesquisa representa uma investigação descritiva, tratando-se de um estudo de caso a aplicar na Câmara Municipal de Setúbal. Em termos da recolha de dados, foram utilizadas fontes primárias, com base numa análise documental. Os resultados deste estudo, permitem apresentar uma primeira abordagem de estrutura e processos de funcionamento de um modelo de observatório municipal do desporto com aplicação prática, tendo sido estabelecidos sete categorias de análise fundamentais: i) Atividades Desportivas; ii) Instalações Desportivas, iii) Associativismo; iv) Recursos Humanos; v) Sector Privado; vi) Consumo Desportivo; vii) Divisão Desporto. As estratégias das políticas públicas desportivas adotadas, o planeamento desportivo ou o acesso ao apoio financeiro, exigem que estejam disponíveis um conjunto de informações rigorosas e fidedignas sobre o desempenho, a evolução e as tendências do sector a nível local pelo que a estrutura de um observatório do desporto, irá permitir de uma forma eficiente, eficaz e participativa que se desenvolvam e projetem as políticas desportivas locais que melhor se ajustem à sua realidade. Acreditamos que a existência de um observatório municipal do desporto acrescenta benefícios para os municípios. As mudanças e os desafios económicos colocados hoje, obrigam a novas dinâmicas competitivas.

Trajectory Privacy Preservation in Mobile Wireless Sensor Networks

In recent years, there has been an enormous growth of location-aware devices, such as GPS embedded cell phones, mobile sensors and radio-frequency identification tags. The age of combining sensing, processing and communication in one device, gives rise to a vast number of applications leading to endless possibilities and a realization of mobile Wireless Sensor Network (mWSN) applications. As computing, sensing and communication become more ubiquitous, trajectory privacy becomes a critical piece of information and an important factor for commercial success. While on the move, sensor nodes continuously transmit data streams of sensed values and spatiotemporal information, known as ``trajectory information". If adversaries can intercept this information, they can monitor the trajectory path and capture the location of the source node. This research stems from the recognition that the wide applicability of mWSNs will remain elusive unless a trajectory privacy preservation mechanism is developed. The outcome seeks to lay a firm foundation in the field of trajectory privacy preservation in mWSNs against external and internal trajectory privacy attacks. First, to prevent external attacks, we particularly investigated a context-based trajectory privacy-aware routing protocol to prevent the eavesdropping attack. Traditional shortest-path oriented routing algorithms give adversaries the possibility to locate the target node in a certain area. We designed the novel privacy-aware routing phase and utilized the trajectory dissimilarity between mobile nodes to mislead adversaries about the location where the message started its journey. Second, to detect internal attacks, we developed a software-based attestation solution to detect compromised nodes. We created the dynamic attestation node chain among neighboring nodes to examine the memory checksum of suspicious nodes. The computation time for memory traversal had been improved compared to the previous work. Finally, we revisited the trust issue in trajectory privacy preservation mechanism designs. We used Bayesian game theory to model and analyze cooperative, selfish and malicious nodes' behaviors in trajectory privacy preservation activities.

Geometrical Methods in Multivariate Risk Management: Algorithms and Applications

This thesis builds a framework for evaluating downside risk from multivariate data via a special class of risk measures (RM). The peculiarity of the analysis lies in getting rid of strong data distributional assumptions and in orientation towards the most critical data in risk management: those with asymmetries and heavy tails. At the same time, under typical assumptions, such as the ellipticity of the data probability distribution, the conformity with classical methods is shown. The constructed class of RM is a multivariate generalization of the coherent distortion RM, which possess valuable properties for a risk manager. The design of the framework is twofold. The first part contains new computational geometry methods for the high-dimensional data. The developed algorithms demonstrate computability of geometrical concepts used for constructing the RM. These concepts bring visuality and simplify interpretation of the RM. The second part develops models for applying the framework to actual problems. The spectrum of applications varies from robust portfolio selection up to broader spheres, such as stochastic conic optimization with risk constraints or supervised machine learning.

Abrasion, transport and distribution of sediment in selected streams of Southern Ontario and Western New York /

The rate of decrease in mean sediment size and weight per square metre along a 54 km reach of the Credit River was found to depend on variations in the channel geometry. The distribution of a specific sediment size consist of: (1) a transport zone; (2) an accumulation zone; and (3) a depletion zone. These zones shift downstream in response to downcurrent decreases in stream competence. Along a .285 km man-made pond, within the Credit River study area, the sediment is also characterized by downstream shifting accumulation zones for each finer clast size. The discharge required to initiate movement of 8 cm and 6 cm blocks in Cazenovia Creek is closely approximated by Baker and Ritter's equation. Incipient motion of blocks in Twenty Mile Creek is best predicted by Yalin's relation which is more efficient in deeper flows. The transport distance of blocks in both streams depends on channel roughness and geometry. Natural abrasion and distribution of clasts may depend on the size of the surrounding sediment and variations in flow competence. The cumulative percent weight loss with distance of laboratory abraded dolostone is defined by a power function. The decrease in weight of dolostone follows a negative exponential. In the abrasion mill, chipping causes the high initial weight loss of dolostone; crushing and grinding produce most of the subsequent weight loss. Clast size was found to have little effect on the abrasion of dolostone within the diameter range considered. Increasing the speed of the mill increased the initial amount of weight loss but decreased the rate of abrasion. The abrasion mill was found to produce more weight loss than stream action. The maximum percent weight loss determined from laboratory and field abrasion data is approximately 40 percent of the weight loss observed along the Credit River. Selective sorting of sediment explains the remaining percentage, not accounted for by abrasion.

A rights management approach to securing data distribution in coalitions

As network capacity has increased over the past decade, individuals and organisations have found it increasingly appealing to make use of remote services in the form of service-oriented architectures and cloud computing services. Data processed by remote services, however, is no longer under the direct control of the individual or organisation that provided the data, leaving data owners at risk of data theft or misuse. This paper describes a model by which data owners can control the distribution and use of their data throughout a dynamic coalition of service providers using digital rights management technology. Our model allows a data owner to establish the trustworthiness of every member of a coalition employed to process data, and to communicate a machine-enforceable usage policy to every such member.

Application of simulated annealing to data distribution for all-to-all comparison problems in homogeneous systems

Distributed systems are widely used for solving large-scale and data-intensive computing problems, including all-to-all comparison (ATAC) problems. However, when used for ATAC problems, existing computational frameworks such as Hadoop focus on load balancing for allocating comparison tasks, without careful consideration of data distribution and storage usage. While Hadoop-based solutions provide users with simplicity of implementation, their inherent MapReduce computing pattern does not match the ATAC pattern. This leads to load imbalances and poor data locality when Hadoop's data distribution strategy is used for ATAC problems. Here we present a data distribution strategy which considers data locality, load balancing and storage savings for ATAC computing problems in homogeneous distributed systems. A simulated annealing algorithm is developed for data distribution and task scheduling. Experimental results show a significant performance improvement for our approach over Hadoop-based solutions.

Modelling the distribution and relative abundance of feral camels in the Northern Territory using count data

The objectives of this study were to predict the potential distribution, relative abundance and probability of habitat use by feral camels in southern Northern Territory. Aerial survey data were used to model habitat association. The characteristics of ‘used’ (where camels were observed) v. ‘unused’ (pseudo-absence) sites were compared. Habitat association and abundance were modelled using generalised additive model (GAM) methods. The models predicted habitat suitability and the relative abundance of camels in southern Northern Territory. The habitat suitability maps derived in the present study indicate that camels have suitable habitat in most areas of southern Northern Territory. The index of abundance model identified areas of relatively high camel abundance. Identifying preferred habitats and areas of high abundance can help focus control efforts.

Data distribution and task scheduling for distributed computing of all-to-all comparison problems

This research studied distributed computing of all-to-all comparison problems with big data sets. The thesis formalised the problem, and developed a high-performance and scalable computing framework with a programming model, data distribution strategies and task scheduling policies to solve the problem. The study considered storage usage, data locality and load balancing for performance improvement in solving the problem. The research outcomes can be applied in bioinformatics, biometrics and data mining and other domains in which all-to-all comparisons are a typical computing pattern.

Inference for the Component and System Lifetime Distribution of a k-unit Parallel System Based on System Data

In this paper, we consider the inference for the component and system lifetime distribution of a k-unit parallel system with independent components based on system data. The components are assumed to have identical Weibull distribution. We obtain the maximum likelihood estimates of the unknown parameters based on system data. The Fisher information matrix has been derived. We propose -expectation tolerance interval and -content -level tolerance interval for the life distribution of the system. Performance of the estimators and tolerance intervals is investigated via simulation study. A simulated dataset is analyzed for illustration.

Investigation of orographic features influencing spatial distribution of rainfall over the Western Ghats of India using satellite data

Using remotely sensed Tropical Rainfall Measuring Mission (TRMM) 3B42 rainfall and topographic data from the Advanced Spaceborne Thermal Emission and Reflection Radiometer (ASTER) Digital Elevation Model (DEM), the impact of oroghraphical aspects such as topography, spatial variability of elevation and altitude of apexes are examined to investigate capacious summer monsoon rainfall over the Western Ghats (WG) of India. TRMM 3B42 v7 rainfall data is validated with Indian Meteorological Department (IMD) gridded rainfall data at 0.5 degrees resolution over the WG. The analysis of spatial pattern of monsoon rainfall with orography of the WG ascertains that the grade of orographic precipitation depends mainly on topography of the mountain barrier followed by steepness of windward side slope and altitude of the mountain. Longer and broader, i.e. cascaded topography, elevated summits and gradually increasing slopes impel the enhancement in precipitation. Comparing topography of various states of the WG, it has been observed that windward side of Karnataka receives intense rainfall in the WG during summer monsoon. It has been observed that the rainfall is enhanced before the peak of the mountain and confined up to the height about 800m over the WG. In addition to this, the spatial distribution of heavy and very heavy rainfall events in the last 14 years has also been explored. Heavy and very heavy rain events on this hilly terrain are categorized with a threshold of precipitation (R) in the range 150>R>120mmday(-1) and exceeding 150mmday(-1) using probability distribution of TRMM 3B42 v7 rainfall. The areas which are prone to heavy precipitation are identified. The study would help policy makers to manage the hazard scenario and, to improve weather predictions on mountainous terrain of the WG.

An evaluation of the survival of Atlantic salmon (Salmo salar L.)fry stocked in eight streams in the North West of England.

Eight streams from the North West of England were stocked with Atlantic salmon (Salmo salar L.) fed fry at densities ranging from 1 to 4/m2 over a period of up to three years to evaluate survival to the end of the first an d second growing periods and hence assess the value of stocking as a management practice. Survival to the end of the first growin g period (mean duration of 108 days) was found to vary between 7.8 and 41.3% with a mean of 22% and CV of 0.44. Survival from the end of the first growing period to the end of the second growing period (mean duration of 384 days) ranged from 19.9 to 34.1% with a mean of 26.3% and CV of 0.21. Survival was found to be positively related to 0+ trout density (P < 0.05) and negatively related to altitude (P < 0.05). A comparison of the raw survival data (non standardised with respect to duration of experiments) with that from other studies in relation to stocking densities revealed a negative relationship between fry survival and stocking density (P < 0.05). Densities in excess of 5/m2 tended to result in lower levels of survival. Post stocking fry dispersal patterns were examined for the 1991 data. On average 86.7% of the number of fry surviving remained within the stocked zone by the end of the first growing period. With the exception of one stream there was little in the way of dispersal beyond the stocked zone. The dispersal pattern approximated to the normal distribution (P < 0.05). It was estimated that stocking can result in a net gain of fish to a river system compared with natural productivity, however the numerical significance of this gain and its cost effectiveness need to be determined on a river specific basis.

Physiological ecology of juvenile chinook salmon (Oncorhynchus tshawytscha) at the southern end of their distribution, the San Francisco Estuary and Gulf of the Farallones, California

Juvenile chinook salmon, Oncorhynchus tshawytscha, from natal streams in California’s Central Valley demonstrated little estuarine dependency but grew rapidly once in coastal waters. We collected juvenile chinook salmon at locations spanning the San Francisco Estuary from the western side of the freshwater delta—at the confluence of the Sacramento and San Joaquin Rivers—to the estuary exit at the Golden Gate and in the coastal waters of the Gulf of the Farallones. Juveniles spent about 40 d migrating through the estuary at an estimated rate of 1.6 km/d or faster during their migration season (May and June 1997) toward the ocean. Mean growth in length (0.18 mm/d) and weight (0.02 g/d) was insignificant in young chinook salmon while in the estuary, but estimated daily growth of 0.6 mm/d and 0.5 g/d in the ocean was rapid (P≤0.001). Condition (K factor) declined in the estuary, but improved markedly in ocean fish. Total body protein, total lipid, triacylglycerols (TAG), polar lipids, cholesterol, and nonesterified fatty acids concentrations did not change in juveniles in the estuary, but total lipid and TAG were depleted in ocean juveniles. As young chinook migrated from freshwater to the ocean, their prey changed progressively in importance from invertebrates to fish larvae. Once in coastal waters, juvenile salmon appear to employ a strategy of rapid growth at the expense of energy reserves to increase survival potential. In 1997, environmental conditions did not impede development: freshwater discharge was above average and water temperatures were only slightly elevated, within the species’ tolerance. Data suggest that chinook salmon from California’s Central Valley have evolved a strong ecological propensity for a ocean-type life history. But unlike populations in the Pacific Northwest, they show little estuarine dependency and proceed to the ocean to benefit from the upwelling-driven, biologically productive coastal waters.