Anomaly Detection for Data with Spatial Attributes

The problem of detecting spatially-coherent groups of data that exhibit anomalous behavior has started to attract attention due to applications across areas such as epidemic analysis and weather forecasting. Earlier efforts from the data mining community have largely focused on finding outliers, individual data objects that display deviant behavior. Such point-based methods are not easy to extend to find groups of data that exhibit anomalous behavior. Scan Statistics are methods from the statistics community that have considered the problem of identifying regions where data objects exhibit a behavior that is atypical of the general dataset. The spatial scan statistic and methods that build upon it mostly adopt the framework of defining a character for regions (e.g., circular or elliptical) of objects and repeatedly sampling regions of such character followed by applying a statistical test for anomaly detection. In the past decade, there have been efforts from the statistics community to enhance efficiency of scan statstics as well as to enable discovery of arbitrarily shaped anomalous regions. On the other hand, the data mining community has started to look at determining anomalous regions that have behavior divergent from their neighborhood.In this chapter,we survey the space of techniques for detecting anomalous regions on spatial data from across the data mining and statistics communities while outlining connections to well-studied problems in clustering and image segmentation. We analyze the techniques systematically by categorizing them appropriately to provide a structured birds eye view of the work on anomalous region detection;we hope that this would encourage better cross-pollination of ideas across communities to help advance the frontier in anomaly detection.

Modelling mortality: Are we heading in the right direction?

Predicting life expectancy has become of upmost importance in society. Pension providers, insurance companies, government bodies and individuals in the developed world have a vested interest in understanding how long people will live for. This desire to better understand life expectancy has resulted in an explosion of stochastic mortality models many of which identify linear trends in mortality rates by time. In making use of such models for forecasting purposes we rely on the assumption that the direction of the linear trend (determined from the data used for fitting purposes) will not change in the future, recent literature has started to question this assumption. In this paper we carry out a comprehensive investigation of these types of models using male and female data from 30 countries and using the theory of structural breaks to identify changes in the extracted trends by time. We find that structural breaks are present in a substantial number of cases, that they are more prevalent in male data than in female data, that the introduction of additional period factors into the model reduces their presence, and that allowing for changes in the trend improves the fit and forecast substantially.

Management and Control of Water Supply Systems

The fast increase in the energy’s price has brought a growing concern about the highly expensive task of transporting water. By creating an hydraulic model of the Water Supply System’s (WSS) network and predicting its behaviour, it is possible to take advantage of the energy’s tariffs, reducing the total cost on pumping activities. This thesis was developed, in association with a technology transfer project called the E-Pumping. It focuses on finding a flexible supervision and control strategy, adaptable to any existent Water Supply System (WSS), as well as forecasting the water demand on a time period chosen by the end user, so that the pumping actions could be planned to an optimum schedule, that minimizes the total operational cost. The OPC protocol, associated to a MySQL database were used to develop a flexible tool of supervision and control, due to their adaptability to function with equipments from various manufacturers, being another integrated modular part of the E-Pumping project. Furthermore, in this thesis, through the study and performance tests of several statistical models based on time series, specifically applied to this problem, a forecasting tool adaptable to any station, and whose model parameters are automatically refreshed at runtime, was developed and added to the project as another module. Both the aforementioned modules were later integrated with an Graphical User Interface (GUI) and installed in a pilot application at the ADDP’s network. The implementation of this software on WSSs across the country will reduce the water supply companies’ running costs, improving their market competition and, ultimately, lowering the water price to the end costumer.

Towards a hydrodynamic operational model of the Algarve coast and St. Vincent Cape

This study attempts to implement a hydrodynamic operational model which can ultimately be used for projecting oil spill dispersal patterns and also sewage, pollution and can also be used in wave forecasting. A two layer nested model was created using MOHID Water, which is powerful ocean modelling software. The first layer (father) is used to impose the boundary conditions for the second layer (son). This was repeated for two different wind dominant regimes, Easterly and Westerly winds respectively. A qualitative comparison was done between measured tidal data and the tidal output. Sea surface temperature was also qualitatively compared with the model’s results. The results from both simulations were analysed and compared to historical literature. The comparison was done at the surface layer, 100 metre depth and at 800m depth. In the surface layer the first simulation generated an upwelling event near Cape St. Vincent and within the Algarve. The second simulation generated a non-upwelling event within which the surface was flow reversed and the warm water mass was along the Algarve coastline and evening turning clockwise around Cape St. Vincent. At the 100 metre depth for both simulations, velocity vortexes were observed near Cape St. Vincent travelling northerly and southerly at various instances. At 800metre depth a strong oceanic flow was observed moving north westerly along the continental shelf.

Assessing soil erosion due to land use change at the Alqueva reservoir surrounding area

Tese de doutoramento, Ciências do Mar, da Terra e do Ambiente, Faculdade de Ciências e Tecnologia, Universidade do Algarve, 2015

Hotel Valuation Software, Version 4.0

[Updated August 2016] The Hotel Valuation Software, freely available from Cornell’s Center for Hospitality Research, has been updated to reflect the many changes in the 11th Edition of the Uniform System of Accounts for the Lodging Industry (USALI). Version 4.0 of the Hotel Valuation Software provides numerous enhancements over the original tool from 2011. In addition to a significant increase in functionality and an update to reflect the 11th edition of the USALI, Version 4.0 takes advantage of the power of the latest release of Microsoft Excel®. Note that Version 4.0 works only on a PC running Microsoft Windows, it does not work on a Mac running OS X. Users desiring an OS X compatible version should click here (Labeled as Version 2.5). 酒店评估软件手册和三个程序（点击这里 ) Users desiring a Mandarin version of the Hotel Valuation Software should click here The Hotel Valuation Software remains the only non-proprietary computer software designed specifically to assist in the preparation of market studies, forecasts of income and expense, and valuations for lodging property. The software provides an accurate, consistent, and cost-effective way for hospitality professionals to forecast occupancy, revenues and expenses and to perform hotel valuations. Version 4.0 of the Hotel Valuation Software includes the following upgrades – a complete update to reflect the 11th edition of the USALI – the most significant change to the chart of accounts in a generation, an average daily rate forecasting tool, a much more sophisticated valuation module, and an optional valuation tool useful in periods of limited capital liquidity. Using established methodology, the Hotel Valuation Software is a sophisticated tool for lodging professionals. The tool consists of three separate software programs written as Microsoft Excel files and a software users' guide. The tool is provided through the generosity of HVS and the School of Hotel Administration. The three software modules are: Room Night Analysis and Average Daily Rate: Enables the analyst to evaluate the various competitive factors such as occupancy, average room rate, and market segmentation for competitive hotels in a local market. Calculates the area-wide occupancy and average room rate, as well as the competitive market mix. Produce a forecast of occupancy and average daily rate for existing and proposed hotels in a local market. The program incorporates such factors as competitive occupancies, market segmentation, unaccommodated demand, latent demand, growth of demand, and the relative competitiveness of each property in the local market. The program outputs include ten-year projections of occupancy and average daily rate. Fixed and Variable Revenue and Expense Analysis: The key to any market study and valuation is a supportable forecast of revenues and expenses. Hotel revenue and expenses are comprised of many different components that display certain fixed and variable relationships to each other. This program enables the analyst to input comparable financial operating data and forecast a complete 11-year income and expense statement by defining a small set of inputs: The expected future occupancy levels for the subject hotel Base year operating data for the subject hotel Fixed and variable relationships for revenues and expenses Expected inflation rates for revenues and expenses Hotel Capitalization Software: A discounted cash flow valuation model utilizing the mortgage-equity technique forms the basis for this program. Values are produced using three distinct underwriting criteria: A loan-to-value ratio, in which the size of the mortgage is based on property value. A debt coverage ratio (also known as a debt-service coverage ratio), in which the size of the mortgage is based on property level cash flow, mortgage interest rate, and mortgage amortization. A debt yield, in which the size of the mortgage is based on property level cash flow. By entering the terms of typical lodging financing, along with a forecast of revenue and expense, the program determines the value that provides the stated returns to the mortgage and equity components. The program allows for a variable holding period from four to ten years The program includes an optional model useful during periods of capital market illiquidity that assumes a property refinancing during the holding period

The Long Range Transport of Birch (Betula) Pollen from Poland and Germany Causes Significant Pre-season Concentrations in Denmark

Background Birch pollen is highly allergic and has the potential for episodically long range transport. Such episodes will in general occur out of the main pollen season. During that time allergy patients are unprotected and high pollen concentrations will therefore have a full allergenic impact. Objective To show that Denmark obtains significant quantities of birch pollen from Poland or Germany before the local trees start to flower. Methods Simultaneous observations of pollen concentrations and phenology in the potential source area in Poland as well as in Denmark were performed in 2006. The Danish pollen records from 2000-2006 were analysed for possible long range transport episodes and analysed with trajectories in combination with a birch tree source map. Results In 2006 high pollen concentrations were observed in Denmark with bi-hourly concentrations above 500 grains/ m3 before the local trees began to flower. Poland was identified as a source region. The analysis of the historical pollen record from Copenhagen shows significant pre-seasonal pollen episodes almost every year from 2000-2006. In all episodes trajectory analysis identified Germany or Poland as source regions. Conclusion Denmark obtains significant pre-seasonal quantities of birch pollen from either Poland or Germany almost every year. Forecasting of birch pollen quantities relevant to allergy patients must therefore take into account long-range transport. This cannot be based on measured concentrations in Denmark. The most effective way to improve the current Danish pollen forecasts is to extend the current forecasts with atmospheric transport models that take into account pollen emission and transport from countries such as Germany and Poland. Unless long range transport is taken into account pre-seasonal pollen episodes will have a full allergic impact, as the allergy patients in general will be unprotected during that time.

Constructing a 7-day Ahead Forecast Model for Grass Pollen at North London, United Kingdom

A number of media outlets now issue medium-range (~7 day) weather forecasts on a regular basis. It is therefore logical that aerobiologists should attempt to produce medium-range forecasts for allergenic pollen that cover the same time period as the weather forecasts. The objective of this study is to construct a medium-range (< 7 day) forecast model for grass pollen at north London. The forecast models were produced using regression analysis based on grass pollen and meteorological data from 1990-1999 and tested on data from 2000 and 2002. The modelling process was improved by dividing the grass pollen season into three periods; the pre-peak, peak and post peak periods of grass pollen release. The forecast consisted of five regression models. Two simple linear regression models predicting the start and end date of the peak period, and three multiple regression models forecasting daily average grass pollen counts in the pre-peak, peak and post-peak periods. Overall the forecast models achieved 62% accuracy in 2000 and 47% in 2002, reflecting the fact that the 2002 grass pollen season was of a higher magnitude than any of the other seasons included in the analysis. This study has the potential to make a notable contribution to the field of aerobiology. Winter averages of the North Atlantic Oscillation were used to predict certain characteristics of the grass pollen season, which presents an important advance in aerobiological work. The ability to predict allergenic pollen counts for a period between five and seven days will benefit allergy sufferers. Furthermore, medium-range forecasts for allergenic pollen will be of assistance to the medical profession, including allergists planning treatment and physicians scheduling clinical trials.

Examining High Magnitude Grass Pollen Episodes at Worcester, United Kingdom, Using Back-Trajectory Analysis

Trajectory analysis is a valuable tool that has been used before in aerobiological studies, to investigate the movement of airborne pollen. This study has employed back-trajectories to examine the four highest grass pollen episodes at Worcester, during the 2001 grass pollen season. The results have shown that the highest grass pollen counts of the 2001 season were reached when air masses arrived from a westerly direction. Back-trajectory analysis has a limited value to forecasters because the method is retrospective and cannot be employed directly for forecasting. However, when used in conjunction with meteorological data this technique can be used to examine high magnitude events in order to identify conditions that lead to high pollen counts.

Long-term and Short-term Forecast Models for Poaceae (Grass) Pollen in Poznan, Poland, Constructed Using Regression Analysis

Airborne concentrations of Poaceae pollen have been monitored in Poznań for more than ten years and the length of the dataset is now considered sufficient for statistical analysis. The objective of this paper is to produce long-range forecasts that predict certain characteristics of the grass pollen season (such as the start, peak and end dates of the grass pollen season) as well as short-term forecasts that predict daily variations in grass pollen counts for the next day or next few days throughout the main grass pollen season. The method of forecasting was regression analysis. Correlation analysis was used to examine the relationship between grass pollen counts and the factors that affect its production, release and dispersal. The models were constructed with data from 1994-2004 and tested on data from 2005 and 2006. The forecast models predicted the start of the grass pollen season to within 2 days and achieved 61% and 70% accuracy on a scale of 1-4 when forecasting variations in daily grass pollen counts in 2005 and 2006 respectively. This study has emphasised how important the weather during the few weeks or months preceding pollination is to grass pollen production, and draws attention to the importance of considering large-scale patterns of climate variability (indices of the North Atlantic Oscillation) when constructing forecast models for allergenic pollen.

Comportamento de consumo, elites sociais e moda : contributo para a consolidação disciplinar dos estudos de tendências

Tese de doutoramento, Estudos de Literatura e de Cultura (Cultura e Comunicação), Universidade de Lisboa, Faculdade de Letras, 2015

Application of the WRF-Chem Model for a High Ozone Episode in SW Poland – Preliminary Results

The Weather Research and Forecasting model, integrated online with chemistry module, is a multi-scale model suitable for both research and operational forecasts of meteorology and air quality. It is used by many institutions for a variety of applications. In this study, the WRF v3.5 with chemistry (WRF-Chem) is applied to the area of Poland, for a period of 3-20 July 2006, when high concentrations of ground level ozone were observed. The meteorological and chemistry simulations were initiated with ERA-Interim reanalysis and TNO MACC II emissions database, respectively. The model physical parameterization includes RRTM shortwave radiation, Kain-Fritsch cumulus scheme, Purdue Lin microphysics and ACM2 PBL, established previously as the optimal configuration. Chemical mechanism used for the study was RADM2 with MADE/SORGAM aerosols. Simulations were performed for three one-way nested domains covering Europe (36 km x 36 km), Central Europe (12 km x 12 km) and Poland (4 km x 4 km). The results from the innermost domain were analyzed and compared to measurements of ozone concentration at three stations in different environments. The results show underestimation of observed values and daily amplitude of ozone concentrations.

Application of Redundancy Analysis for Aerobiological Data

An aerobiological survey was conducted through five consecutive years (2006–2010) at Worcester (England).The concentration of 20 allergenic fungal spore types was measured using a 7-day volumetric spore trap. The relationship between investigated fungal spore genera and selected meteorological parameters (maximum, minimum, mean and dew point temperatures, rainfall, relative humidity, air pressure,wind direction) was examined using an ordination method(redundancy analysis) to determine which environmental factors favoured their most abundance in the air and whether it would be possible to detect similarities between different genera in their distribution pattern. Redundancy analysis provided additional information about the biology of the studied fungi through the results of the Spearman’s rank correlation. Application of the variance inflation factor in canonical correspondence analysis indicated which explanatory variables were auto-correlated and needed to be excluded from further analyses. Obtained information will be consequently implemented in the selection of factors that will be a foundation for forecasting models for allergenic fungal spores in the future.

Investigating and Predicting Atmospheric Concentrations of Allergenic Fungal Spores (Alternaria, Cladosporium, Didymella and Ganoderma)

Air quality is an increasing concern of the European Union, local authorities, scientists and most of all inhabitants that become more aware of the quality of the surrounding environment. Bioaerosols may be consisted of various elements, and the most important are pollen grains, fungal spores, bacteria, viruses. More than 100 genera of fungal spores have been identified as potential allergens that cause immunological response in susceptible individuals. Alternaria and Cladosporium have been recognised as the most important fungal species responsible for respiratory tract diseases, such as asthma, eczema, rhinitis and chronic sinusitis. While a lot of attention has been given to these fungal species, a limited number of studies can be found on Didymella and Ganoderma, although their allergenic properties were proved clinically. Monitoring of allergenic fungal spore concentration in the air is therefore very important, and in particular at densely populated areas like Worcester, UK. In this thesis a five year spore data set was presented, which was collected using a 7-day volumetric spore trap, analysed with the aid of light microscopy, statistical tests and geographic information system techniques. Although Kruskal-Wallis test detected statistically significant differences between annual concentrations of all examined fungal spore types, specific patterns in their distribution were also found. Alternaria spores were present in the air between mid-May/mid-June until September-October with peak occurring in August. Cladosporium sporulated between mid-May and October, with maximum concentration recorded in July. Didymella spores were seen from June/July up to September, while peaks were found in August. Ganoderma produced spores for 6 months (May-October), and maximum concentration could be found in September. With respect to diurnal fluctuations, Alternaria peaked between 22:00h and 23:00h, Cladosporium 13:00-15:00h, Didymella 04:00-05:00h and 22:00h-23:00h and Ganoderma from 03:00h to 06:00h. Spatial analysis showed that sources of all fungal species were located in England, and there was no evidence for a long distance transport from the continent. The maximum concentration of spores was found several hours delayed in comparison to the approximate time of the spore release from the crops. This was in agreement with diurnal profiles of the spore concentration recorded in Worcester, UK. Spores of Alternaria, Didymella and Ganoderma revealed a regional origin, in contrast to Cladosporium, which sources were situated locally. Hence, the weather conditions registered locally did not exhibit strong statistically significant correlations with fungal spore concentrations. This has had also an impact on the performance of the forecasting models. The best model was obtained for Cladosporium with 66% of the accuracy.

WS-PGRADE/gUSE in European Projects

Besides core project partners, the SCI-BUS project also supported several external user communities in developing and setting up customized science gateways. The focus was on large communities typically represented by other European research projects. However, smaller local efforts with the potential of generalizing the solution to wider communities were also supported. This chapter gives an overview of support activities related to user communities external to the SCI-BUS project. A generic overview of such activities is provided followed by the detailed description of three gateways developed in collaboration with European projects: the agINFRA Science Gateway for Workflows for agricultural research, the VERCE Science Gateway for seismology, and the DRIHM Science Gateway for weather research and forecasting.