WAIS seminar: Application Performance Monitoring and Architecture Discovery with Kieker

Wednesday 23rd April 2014 Speaker(s): Willi Hasselbring Organiser: Leslie Carr Time: 23/04/2014 14:00-15:00 Location: B32/3077 File size: 802Mb Abstract The internal behavior of large-scale software systems cannot be determined on the basis of static (e.g., source code) analysis alone. Kieker provides complementary dynamic analysis capabilities, i.e., monitoring/profiling and analyzing a software system's runtime behavior. Application Performance Monitoring is concerned with continuously observing a software system's performance-specific runtime behavior, including analyses like assessing service level compliance or detecting and diagnosing performance problems. Architecture Discovery is concerned with extracting architectural information from an existing software system, including both structural and behavioral aspects like identifying architectural entities (e.g., components and classes) and their interactions (e.g., local or remote procedure calls). In addition to the Architecture Discovery of Java systems, Kieker supports Architecture Discovery for other platforms, including legacy systems, for instance, inplemented in C#, C++, Visual Basic 6, COBOL or Perl. Thanks to Kieker's extensible architecture it is easy to implement and use custom extensions and plugins. Kieker was designed for continuous monitoring in production systems inducing only a very low overhead, which has been evaluated in extensive benchmark experiments. Please, refer to http://kieker-monitoring.net/ for more information.

Remote sensing of intertidal morphological change in Morecambe Bay, U.K., between 1991 and 2007

Tidal Flats are important examples of extensive areas of natural environment that remain relatively unaffected by man. Monitoring of tidal flats is required for a variety of purposes. Remote sensing has become an established technique for the measurement of topography over tidal flats. A further requirement is to measure topographic changes in order to measure sediment budgets. To date there have been few attempts to make quantitative estimates of morphological change over tidal flat areas. This paper illustrates the use of remote sensing to measure quantitative and qualitative changes in the tidal flats of Morecambe Bay during the relatively long period 1991–2007. An understanding of the patterns of sediment transport within the Bay is of considerable interest for coastal management and defence purposes. Tidal asymmetry is considered to be the dominant cause of morphological change in the Bay, with the higher currents associated with the flood tide being the main agency moulding the channel system. Quantitative changes were measured by comparing a Digital Elevation Model (DEM) of the intertidal zone formed using the waterline technique applied to satellite Synthetic Aperture Radar (SAR) images from 1991–1994, to a second DEM constructed from airborne laser altimetry data acquired in 2005. Qualitative changes were studied using additional SAR images acquired since 2003. A significant movement of sediment from below Mean Sea Level (MSL) to above MSL was detected by comparing the two Digital Elevation Models, though the proportion of this change that could be ascribed to seasonal effects was not clear. Between 1991 and 2004 there was a migration of the Ulverston channel of the river Leven north-east by about 5 km, followed by the development of a straighter channel to the west, leaving the previous channel decoupled from the river. This is thought to be due to independent tidal and fluvial forcing mechanisms acting on the channel. The results demonstrate the effectiveness of remote sensing for measurement of long-term morphological change in tidal flat areas. An alternative use of waterlines as partial bathymetry for assimilation into a morphodynamic model of the coastal zone is also discussed.

Compact cosmic ray detector for unattended atmospheric ionisation monitoring

Two vertical cosmic ray telescopes for atmospheric cosmic ray ionization event detection are compared. Counter A, designed for low power remote use, was deployed in the Welsh mountains; its event rate increased with altitude as expected from atmospheric cosmic ray absorption. Independently, Counter B’s event rate was found to vary with incoming particle acceptance angle. Simultaneous colocated comparison of both telescopes exposed to atmospheric ionization showed a linear relationship between their event rates.

Hyperresolution global land surface modeling: meeting a grand challenge for monitoring Earth's terrestrial water

Monitoring Earth's terrestrial water conditions is critically important to many hydrological applications such as global food production; assessing water resources sustainability; and flood, drought, and climate change prediction. These needs have motivated the development of pilot monitoring and prediction systems for terrestrial hydrologic and vegetative states, but to date only at the rather coarse spatial resolutions (∼10–100 km) over continental to global domains. Adequately addressing critical water cycle science questions and applications requires systems that are implemented globally at much higher resolutions, on the order of 1 km, resolutions referred to as hyperresolution in the context of global land surface models. This opinion paper sets forth the needs and benefits for a system that would monitor and predict the Earth's terrestrial water, energy, and biogeochemical cycles. We discuss six major challenges in developing a system: improved representation of surface‐subsurface interactions due to fine‐scale topography and vegetation; improved representation of land‐atmospheric interactions and resulting spatial information on soil moisture and evapotranspiration; inclusion of water quality as part of the biogeochemical cycle; representation of human impacts from water management; utilizing massively parallel computer systems and recent computational advances in solving hyperresolution models that will have up to 109 unknowns; and developing the required in situ and remote sensing global data sets. We deem the development of a global hyperresolution model for monitoring the terrestrial water, energy, and biogeochemical cycles a “grand challenge” to the community, and we call upon the international hydrologic community and the hydrological science support infrastructure to endorse the effort.

Characterization of a highly biodiverse floodplain meadow using hyperspectral remote sensing within a plant functional trait framework

We assessed the potential for using optical functional types as effective markers to monitor changes in vegetation in floodplain meadows associated with changes in their local environment. Floodplain meadows are challenging ecosystems for monitoring and conservation because of their highly biodiverse nature. Our aim was to understand and explain spectral differences among key members of floodplain meadows and also characterize differences with respect to functional traits. The study was conducted on a typical floodplain meadow in UK (MG4-type, mesotrophic grassland type 4, according to British National Vegetation Classification). We compared two approaches to characterize floodplain communities using field spectroscopy. The first approach was sub-community based, in which we collected spectral signatures for species groupings indicating two distinct eco-hydrological conditions (dry and wet soil indicator species). The other approach was “species-specific”, in which we focused on the spectral reflectance of three key species found on the meadow. One herb species is a typical member of the MG4 floodplain meadow community, while the other two species, sedge and rush, represent wetland vegetation. We also monitored vegetation biophysical and functional properties as well as soil nutrients and ground water levels. We found that the vegetation classes representing meadow sub-communities could not be spectrally distinguished from each other, whereas the individual herb species was found to have a distinctly different spectral signature from the sedge and rush species. The spectral differences between these three species could be explained by their observed differences in plant biophysical parameters, as corroborated through radiative transfer model simulations. These parameters, such as leaf area index, leaf dry matter content, leaf water content, and specific leaf area, along with other functional parameters, such as maximum carboxylation capacity and leaf nitrogen content, also helped explain the species’ differences in functional dynamics. Groundwater level and soil nitrogen availability, which are important factors governing plant nutrient status, were also found to be significantly different for the herb/wetland species’ locations. The study concludes that spectrally distinguishable species, typical for a highly biodiverse site such as a floodplain meadow, could potentially be used as target species to monitor vegetation dynamics under changing environmental conditions.

Sequential variations of phytoplankton growth and mortality in an NPZ model: a remote-sensing-based assessment

Radiometric data in the visible domain acquired by satellite remote sensing have proven to be powerful for monitoring the states of the ocean, both physical and biological. With the help of these data it is possible to understand certain variations in biological responses of marine phytoplankton on ecological time scales. Here, we implement a sequential data-assimilation technique to estimate from a conventional nutrient–phytoplankton–zooplankton (NPZ) model the time variations of observed and unobserved variables. In addition, we estimate the time evolution of two biological parameters, namely, the specific growth rate and specific mortality of phytoplankton. Our study demonstrates that: (i) the series of time-varying estimates of specific growth rate obtained by sequential data assimilation improves the fitting of the NPZ model to the satellite-derived time series: the model trajectories are closer to the observations than those obtained by implementing static values of the parameter; (ii) the estimates of unobserved variables, i.e., nutrient and zooplankton, obtained from an NPZ model by implementation of a pre-defined parameter evolution can be different from those obtained on applying the sequences of parameters estimated by assimilation; and (iii) the maximum estimated specific growth rate of phytoplankton in the study area is more sensitive to the sea-surface temperature than would be predicted by temperature-dependent functions reported previously. The overall results of the study are potentially useful for enhancing our understanding of the biological response of phytoplankton in a changing environment.

A novel satellite-based ocean monitoring system for Mexico

To analyze patterns in marine productivity, harmful algal blooms, thermal stress in coral reefs, and oceanographic processes, optical and biophysical marine parameters, such as sea surface temperature, and ocean color products, such as chlorophyll-a concentration, diffuse attenuation coefficient, total suspended matter concentration, chlorophyll fluorescence line height, and remote sensing reflectance, are required. In this paper we present a novel automatic Satellite-based Ocean Monitoring System (SATMO) developed to provide, in near real-time, continuous spatial data sets of the above-mentioned variables for marine-coastal ecosystems in the Gulf of Mexico, northeastern Pacific Ocean, and western Caribbean Sea, with 1 km spatial resolution. The products are obtained from Moderate Resolution Imaging Spectroradiometer (MODIS) images received at the Direct Readout Ground Station (located at CONABIO) after each overpass of the Aqua and Terra satellites. In addition, at the end of each week and month the system provides composite images for several ocean products, as well as weekly and monthly anomaly composites for chlorophyll-a concentration and sea surface temperature. These anomaly data are reported for the first time for the study region and represent valuable information for analyzing time series of ocean color data for the study of coastal and marine ecosystems in Mexico, Central America, and the western Caribbean.

Utilizing Remote Sensing Imagery to Monitor Vegetation Change within World Heritage Sites

ABSTRACT World Heritage sites provide a glimpse into the stories and civilizations of the past. There are currently 1007 unique World Heritage properties with 779 being classified as cultural sites, 197 as natural sites, and 31 falling into the categories of both cultural and natural sites (UNESCO & World Heritage Centre, 1992-2015). However, of these 1007 World Heritage sites, at least 46 are categorized as in danger and this number continues to grow. These unique and irreplaceable sites are exceptional because of their universality. Consequently, since World Heritage sites belong to all the people of the world and provide inspiration and admiration to all who visit them, it is our responsibility to help preserve these sites. The key form of preservation involves the individual monitoring of each site over time. While traditional methods are still extremely valuable, more recent advances in the field of geographic and spatial technologies including geographic information systems (GIS), laser scanning, and remote sensing, are becoming more beneficial for the monitoring and overall safeguarding of World Heritage sites. Through the employment and analysis of more accurately detailed spatial data, World Heritage sites can be better managed. There is a strong urgency to protect these sites. The purpose of this thesis is to describe the importance of taking care of World Heritage sites and to depict a way in which spatial technologies can be used to monitor and in effect preserve World Heritage sites through the utilization of remote sensing imagery. The research conducted in this thesis centers on the Everglades National Park, a World Heritage site that is continually affected by changes in vegetation. Data used include Landsat satellite imagery that dates from 2001-2003, the Everglades' boundaries shapefile, and Google Earth imagery. In order to conduct the in-depth analysis of vegetation change within the selected World Heritage site, three main techniques were performed to study changes found within the imagery. These techniques consist of conducting supervised classification for each image, incorporating a vegetation index known as Normalized Vegetation Index (NDVI), and utilizing the change detection tool available in the Environment for Visualizing Images (ENVI) software. With the research and analysis conducted throughout this thesis, it has been shown that within the three year time span (2001-2003), there has been an overall increase in both areas of barren soil (5.760%) and areas of vegetation (1.263%) with a decrease in the percentage of areas classified as sparsely vegetated (-6.987%). These results were gathered through the use of the maximum likelihood classification process available in the ENVI software. The results produced by the change detection tool which further analyzed vegetation change correlate with the results produced by the classification method. As well, by utilizing the NDVI method, one is able to locate changes by selecting a specific area and comparing the vegetation index generated for each date. It has been found that through the utilization of remote sensing technology, it is possible to monitor and observe changes featured within a World Heritage site. Remote sensing is an extraordinary tool that can and should be used by all site managers and organizations whose goal it is to preserve and protect World Heritage sites. Remote sensing can be used to not only observe changes over time, but it can also be used to pinpoint threats within a World Heritage site. World Heritage sites are irreplaceable sources of beauty, culture, and inspiration. It is our responsibility, as citizens of this world, to guard these treasures.

Proposal of a dedicated telemetry device for real-time and remote measurements

This work aims to demonstrate an application of telemetry for monitoring process variables. The authors developed the prototype of a dedicated device capable of multiplexing, encoding and transmitting real-time data signals via amplitude-shift keying modulation to remotely located device(s). The prototype development is described in details, enabling the reproduction of the proposed telemetry system for a three-phase motor as well as for other devices. Furthermore, the proposed device has an easy implementation by using of accessible components and low cost, also presenting a tutorial and educational purpose. © 2011 IEEE.

Remote Sensing Detection of atmospheric pollutants using Lidar, Sodar and correlation with air quality data in an industrial area

Optical remote sensing techniques have obvious advantages for monitoring gas and aerosol emissions, since they enable the operation over large distances, far from hostile environments, and fast processing of the measured signal. In this study two remote sensing devices, namely a Lidar (Light Detection and Ranging) for monitoring the vertical profile of backscattered light intensity, and a Sodar (Acoustic Radar, Sound Detection and Ranging) for monitoring the vertical profile of the wind vector were operated during specific periods. The acquired data were processed and compared with data of air quality obtained from ground level monitoring stations, in order to verify the possibility of using the remote sensing techniques to monitor industrial emissions. The campaigns were carried out in the area of the Environmental Research Center (Cepema) of the University of São Paulo, in the city of Cubatão, Brazil, a large industrial site, where numerous different industries are located, including an oil refinery, a steel plant, as well as fertilizer, cement and chemical/petrochemical plants. The local environmental problems caused by the industrial activities are aggravated by the climate and topography of the site, unfavorable to pollutant dispersion. Results of a campaign are presented for a 24- hour period, showing data of a Lidar, an air quality monitoring station and a Sodar. © 2011 SPIE.

Applying machine learning based on multiscale classifiers to detect remote phenology patterns in Cerrado savanna trees

Plant phenology is one of the most reliable indicators of species responses to global climate change, motivating the development of new technologies for phenological monitoring. Digital cameras or near remote systems have been efficiently applied as multi-channel imaging sensors, where leaf color information is extracted from the RGB (Red, Green, and Blue) color channels, and the changes in green levels are used to infer leafing patterns of plant species. In this scenario, texture information is a great ally for image analysis that has been little used in phenology studies. We monitored leaf-changing patterns of Cerrado savanna vegetation by taking daily digital images. We extract RGB channels from the digital images and correlate them with phenological changes. Additionally, we benefit from the inclusion of textural metrics for quantifying spatial heterogeneity. Our first goals are: (1) to test if color change information is able to characterize the phenological pattern of a group of species; (2) to test if the temporal variation in image texture is useful to distinguish plant species; and (3) to test if individuals from the same species may be automatically identified using digital images. In this paper, we present a machine learning approach based on multiscale classifiers to detect phenological patterns in the digital images. Our results indicate that: (1) extreme hours (morning and afternoon) are the best for identifying plant species; (2) different plant species present a different behavior with respect to the color change information; and (3) texture variation along temporal images is promising information for capturing phenological patterns. Based on those results, we suggest that individuals from the same species and functional group might be identified using digital images, and introduce a new tool to help phenology experts in the identification of new individuals from the same species in the image and their location on the ground. © 2013 Elsevier B.V. All rights reserved.

A multisensor, multitemporal approach for monitoring herbaceous vegetation growth in the Amazon floodplain

The Amazon River floodplain is an important source of atmospheric CO2 and CH4. Aquatic herbaceous vegetation (macrophytes) have been shown to contribute significantly to floodplain net primary productivity (NPP) and methane emission in the region. Their fast growth rates under both flooded and dry conditions make herbaceous vegetation the most variable element in the Amazon floodplain NPP budget, and the most susceptible to environmental changes. The present study combines multitemporal Radarsat-1 and MODIS images to monitor spatial and temporal changes in herbaceous vegetation cover in the Amazon floodplain. Radarsat-1 images were acquired from Dec/2003 to Oct/2005, and MODIS daily surface reflectance products were acquired for the two cloud-free dates closest to each Radarsat-1 acquisition. An object-based, hierarchical algorithm was developed using the temporal SAR information to discriminate Permanent Open Water (OW), Floodplain (FP) and Upland (UL) classes at Level 1, and then subdivide the FP class into Woody Vegetation (WV) and Possible Macrophytes (PM) at Level 2. At Level 3, optical and SAR information were combined to discriminate actual herbaceous cover at each date. The resulting maps had accuracies ranging from 80% to 90% for Level 1 and 2 classifications, and from 60% to 70% for Level 3 classifications, with kappa values ranging between 0.7 and 0.9 for Levels 1 and 2 and between 0.5 and 0.6 for Level 3. All study sites had noticeable variations in the extent of herbaceous cover throughout the hydrological year, with maximum areas up to four times larger than minimum areas. The proposed classification method was able to capture the spatial pattern of macrophyte growth and development in the studied area, and the multitemporal information was essential for both separating vegetation cover types and assessing monthly variation in herbaceous cover extent.

Determining large scale actual evapotranspiration using agro-meteorological and remote sensing data in the northwest of Sao Paulo State, Brazil

The best irrigation management depends on accurate estimation of reference evapotranspiration (ET0) and then selection of the appropriate crop coefficient for each phenological stage. However, the evaluation of water productivity on a large scale can be done by using actual evapotranspiration (ETa), determined by coupling agrometeorological and remote sensing data. This paper describes methodologies used for estimating ETa for 20 centerpivots using three different approaches: the traditional FAO crop coefficient (K-c) method and two remote sensing algorithms, one called SEBAL and other named TEIXEIRA. The methods were applied to one Landsat 5 Thematic Mapper image acquired in July 2010 over the Northwest portion of the Sao Paulo State, Brazil. The corn, bean and sugar cane crops are grown under center pivot sprinkler irrigation. ET0 was calculated by the Penman-Monteith method with data from one automated weather station close to the study site. The results showed that for the crops at effective full cover, SEBAL and TEIXEIRA's methods agreed well comparing with the traditional method. However, both remote sensing methods overestimated ETa according to the degree of exposed soil, with the TEIXEIRA method presenting closer ETa values with those resulted from the traditional FAO K-c method. This study showed that remote sensing algorithms can be useful tools for monitoring and establishing realistic K-c values to further determine ETa on a large scale. However, several images during the growing seasons must be used to establish the necessary adjustments to the traditional FAO crop coefficient method.

Coupling remote sensing bio-optical and three-dimensional hydrodynamic modeling to study the phytoplankton dynamics in a tropical hydroelectric reservoir

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)