MONTBLEX tower observations: Instrumentation, data acquisition and data quality

Tower platforms, with instrumentation at six levels above the surface to a height of 30 m, were used to record various atmospheric parameters in the surface layer. Sensors for measuring both mean and fluctuating quantities were used, with the majority of them indigenously built. Soil temperature sensors up to a depth of 30 cm from the surface were among the variables connected to the mean data logger. A PC-based data acquisition system built at the Centre for Atmospheric Sciences, IISc, was used to acquire the data from fast response sensors. This paper reports the various components of a typical MONTBLEX tower observatory and describes the actual experiments carried out in the surface layer at four sites over the monsoon trough region as a part of the MONTBLEX programme. It also describes and discusses several checks made on randomly selected tower data-sets acquired during the experiment. Checks made include visual inspection of time traces from various sensors, comparative plots of sensors measuring the same variable, wind and temperature profile plots calculation of roughness lengths, statistical and stability parameters, diurnal variation of stability parameters, and plots of probability density and energy spectrum for the different sensors. Results from these checks are found to be very encouraging and reveal the potential for further detailed analysis to understand more about surface layer characteristics.

Data rectification and detection of trend shifts in jet engine path measurements using median filters and fuzzy logic

Filtering methods are explored for removing noise from data while preserving sharp edges that many indicate a trend shift in gas turbine measurements. Linear filters are found to be have problems with removing noise while preserving features in the signal. The nonlinear hybrid median filter is found to accurately reproduce the root signal from noisy data. Simulated faulty data and fault-free gas path measurement data are passed through median filters and health residuals for the data set are created. The health residual is a scalar norm of the gas path measurement deltas and is used to partition the faulty engine from the healthy engine using fuzzy sets. The fuzzy detection system is developed and tested with noisy data and with filtered data. It is found from tests with simulated fault-free and faulty data that fuzzy trend shift detection based on filtered data is very accurate with no false alarms and negligible missed alarms.

Improving web server performance by network aware data buffering and caching

In this paper we propose a new method of data handling for web servers. We call this method Network Aware Buffering and Caching (NABC for short). NABC facilitates reduction of data copies in web server's data sending path, by doing three things: (1) Layout the data in main memory in a way that protocol processing can be done without data copies (2) Keep a unified cache of data in kernel and ensure safe access to it by various processes and kernel and (3) Pass only the necessary meta data between processes so that bulk data handling time spent during IPC can be reduced. We realize NABC by implementing a set of system calls and an user library. The end product of the implementation is a set of APIs specifically designed for use by the web servers. We port an in house web server called SWEET, to NABC APIs and evaluate performance using a range of workloads both simulated and real. The results show a very impressive gain of 12% to 21% in throughput for static file serving and 1.6 to 4 times gain in throughput for lightweight dynamic content serving for a server using NABC APIs over the one using UNIX APIs.

Distributed Source Coding for Sensor Data Model and Estimation of Cluster Head Errors Using Bayesian and K-Near Neighborhood Classifiers in Deployment of Dense Wireless Sensor Networks

The lifetime calculation of large dense sensor networks with fixed energy resources and the remaining residual energy have shown that for a constant energy resource in a sensor network the fault rate at the cluster head is network size invariant when using the network layer with no MAC losses.Even after increasing the battery capacities in the nodes the total lifetime does not increase after a max limit of 8 times. As this is a serious limitation lots of research has been done at the MAC layer which allows to adapt to the specific connectivity, traffic and channel polling needs for sensor networks. There have been lots of MAC protocols which allow to control the channel polling of new radios which are available to sensor nodes to communicate. This further reduces the communication overhead by idling and sleep scheduling thus extending the lifetime of the monitoring application. We address the two issues which effects the distributed characteristics and performance of connected MAC nodes. (1) To determine the theoretical minimum rate based on joint coding for a correlated data source at the singlehop, (2a) to estimate cluster head errors using Bayesian rule for routing using persistence clustering when node densities are the same and stored using prior probability at the network layer, (2b) to estimate the upper bound of routing errors when using passive clustering were the node densities at the multi-hop MACS are unknown and not stored at the multi-hop nodes a priori. In this paper we evaluate many MAC based sensor network protocols and study the effects on sensor network lifetime. A renewable energy MAC routing protocol is designed when the probabilities of active nodes are not known a priori. From theoretical derivations we show that for a Bayesian rule with known class densities of omega1, omega2 with expected error P* is bounded by max error rate of P=2P* for single-hop. We study the effects of energy losses using cross-layer simulation of - large sensor network MACS setup, the error rate which effect finding sufficient node densities to have reliable multi-hop communications due to unknown node densities. The simulation results show that even though the lifetime is comparable the expected Bayesian posterior probability error bound is close or higher than Pges2P*.

Spatial Data Mining and Modeling for visualisation of Rapid Urbanisation

Rapid urbanisation in India has posed serious challenges to the decision makers in regional planning involving plethora of issues including provision of basic amenities (like electricity, water, sanitation, transport, etc.). Urban planning entails an understanding of landscape and urban dynamics with causal factors. Identifying, delineating and mapping landscapes on temporal scale provide an opportunity to monitor the changes, which is important for natural resource management and sustainable planning activities. Multi-source, multi-sensor, multi-temporal, multi-frequency or multi-polarization remote sensing data with efficient classification algorithms and pattern recognition techniques aid in capturing these dynamics. This paper analyses the landscape dynamics of Greater Bangalore by: (i) characterisation of direct impervious surface, (ii) computation of forest fragmentation indices and (iii) modeling to quantify and categorise urban changes. Linear unmixing is used for solving the mixed pixel problem of coarse resolution super spectral MODIS data for impervious surface characterisation. Fragmentation indices were used to classify forests – interior, perforated, edge, transitional, patch and undetermined. Based on this, urban growth model was developed to determine the type of urban growth – Infill, Expansion and Outlying growth. This helped in visualising urban growth poles and consequence of earlier policy decisions that can help in evolving strategies for effective land use policies.

Joint data detection and dominant singular mode estimation in time varying reciprocal MIMO systems

This paper proposes an algorithm for joint data detection and tracking of the dominant singular mode of a time varying channel at the transmitter and receiver of a time division duplex multiple input multiple output beamforming system. The method proposed is a modified expectation maximization algorithm which utilizes an initial estimate to track the dominant modes of the channel at the transmitter and the receiver blindly; and simultaneously detects the un known data. Furthermore, the estimates are constrained to be within a confidence interval of the previous estimate in order to improve the tracking performance and mitigate the effect of error propagation. Monte-Carlo simulation results of the symbol error rate and the mean square inner product between the estimated and the true singular vector are plotted to show the performance benefits offered by the proposed method compared to existing techniques.

Data acquisition and processing at ocean bottom for a Tsunami warning system

The design and development of a Bottom Pressure Recorder for a Tsunami Early Warning System is described here. The special requirements that it should satisfy for the specific application of deployment at ocean bed and pressure monitoring of the water column above are dealt with. A high-resolution data digitization and low circuit power consumption are typical ones. The implementation details of the data sensing and acquisition part to meet these are also brought out. The data processing part typically encompasses a Tsunami detection algorithm that should detect an event of significance in the background of a variety of periodic and aperiodic noise signals. Such an algorithm and its simulation are presented. Further, the results of sea trials carried out on the system off the Chennai coast are presented. The high quality and fidelity of the data prove that the system design is robust despite its low cost and with suitable augmentations, is ready for a full-fledged deployment at ocean bed. (C) 2013 Elsevier Ltd. All rights reserved.

Automatic Data Allocation and Buffer Management for Multi-GPU Machines

Multi-GPU machines are being increasingly used in high-performance computing. Each GPU in such a machine has its own memory and does not share the address space either with the host CPU or other GPUs. Hence, applications utilizing multiple GPUs have to manually allocate and manage data on each GPU. Existing works that propose to automate data allocations for GPUs have limitations and inefficiencies in terms of allocation sizes, exploiting reuse, transfer costs, and scalability. We propose a scalable and fully automatic data allocation and buffer management scheme for affine loop nests on multi-GPU machines. We call it the Bounding-Box-based Memory Manager (BBMM). BBMM can perform at runtime, during standard set operations like union, intersection, and difference, finding subset and superset relations on hyperrectangular regions of array data (bounding boxes). It uses these operations along with some compiler assistance to identify, allocate, and manage data required by applications in terms of disjoint bounding boxes. This allows it to (1) allocate exactly or nearly as much data as is required by computations running on each GPU, (2) efficiently track buffer allocations and hence maximize data reuse across tiles and minimize data transfer overhead, and (3) and as a result, maximize utilization of the combined memory on multi-GPU machines. BBMM can work with any choice of parallelizing transformations, computation placement, and scheduling schemes, whether static or dynamic. Experiments run on a four-GPU machine with various scientific programs showed that BBMM reduces data allocations on each GPU by up to 75% compared to current allocation schemes, yields performance of at least 88% of manually written code, and allows excellent weak scaling.

Protected species aerial survey data collection and analysis in waters underlying the R-5306A airspace: final report submitted to US Marine Corps, MCAS Cherry Point

To be in compliance with the Endangered Species Act and the Marine Mammal Protection Act, the United States Department of the Navy is required to assess the potential environmental impacts of conducting at-sea training operations on sea turtles and marine mammals. Limited recent and area-specific density data of sea turtles and dolphins exist for many of the Navy’s operations areas (OPAREAs), including the Marine Corps Air Station (MCAS) Cherry Point OPAREA, which encompasses portions of Core and Pamlico Sounds, North Carolina. Aerial surveys were conducted to document the seasonal distribution and estimated density of sea turtles and dolphins within Core Sound and portions of Pamlico Sound, and coastal waters extending one mile offshore. Sea Surface Temperature (SST) data for each survey were extracted from 1.4 km/pixel resolution Advanced Very High Resolution Radiometer remote images. A total of 92 turtles and 1,625 dolphins were sighted during 41 aerial surveys, conducted from July 2004 to April 2006. In the spring (March – May; 7.9°C to 21.7°C mean SST), the majority of turtles sighted were along the coast, mainly from the northern Core Banks northward to Cape Hatteras. By the summer (June – Aug.; 25.2°C to 30.8°C mean SST), turtles were fairly evenly dispersed along the entire survey range of the coast and Pamlico Sound, with only a few sightings in Core Sound. In the autumn (Sept. – Nov.; 9.6°C to 29.6°C mean SST), the majority of turtles sighted were along the coast and in eastern Pamlico Sound; however, fewer turtles were observed along the coast than in the summer. No turtles were seen during the winter surveys (Dec. – Feb.; 7.6°C to 11.2°C mean SST). The estimated mean surface density of turtles was highest along the coast in the summer of 2005 (0.615 turtles/km², SE = 0.220). In Core and Pamlico Sounds the highest mean surface density occurred during the autumn of 2005 (0.016 turtles/km², SE = 0.009). The mean seasonal abundance estimates were always highest in the coastal region, except in the winter when turtles were not sighted in either region. For Pamlico Sound, surface densities were always greater in the eastern than western section. The range of mean temperatures at which turtles were sighted was 9.68°C to 30.82°C. The majority of turtles sighted were within water ≥ 11°C. Dolphins were observed within estuarine waters and along the coast year-round; however, there were some general seasonal movements. In particular, during the summer sightings decreased along the coast and dolphins were distributed throughout Core and Pamlico Sounds, while in the winter the majority of dolphins were located along the coast and in southeastern Pamlico Sound. Although relative numbers changed seasonally between these areas, the estimated mean surface density of dolphins was highest along the coast in the spring of 2006 (9.564 dolphins/km², SE = 5.571). In Core and Pamlico Sounds the highest mean surface density occurred during the autumn of 2004 (0.192 dolphins/km², SE = 0.066). The estimated mean surface density of dolphins was lowest along the coast in the summer of 2004 (0.461 dolphins/km², SE = 0.294). The estimated mean surface density of dolphins was lowest in Core and Pamlico Sounds in the summer of 2005 (0.024 dolphins/km², SE = 0.011). In Pamlico Sound, estimated surface densities were greater in the eastern section except in the autumn. Dolphins were sighted throughout the entire range of mean SST (7.60°C to 30.82°C), with a tendency towards fewer dolphins sighted as water temperatures increased. Based on the findings of this study, sea turtles are most likely to be encountered within the OPAREAs when SST is ≥ 11°C. Since sea turtle distributions are generally limited by water temperature, knowing the SST of a given area is a useful predictor of sea turtle presence. Since dolphins were observed within estuarine waters year-round and throughout the entire range of mean SST’s, they likely could be encountered in the OPAREAs any time of the year. Although our findings indicated the greatest number of dolphins to be present in the winter and the least in the summer, their movements also may be related to other factors such as the availability of prey. (PDF contains 28 pages)

Bibliographic Data Services and The National Monograph Strategy - Next Steps

This paper summarises the recommendations of a recent report produced by Sero Consulting & Associates that was commissioned (by Jisc) to examine the implications of pursuing specific bibliographic data strategies with reference to the recommendations of the National Monograph Strategy. It reflects input from representatives of RLUK, SCONUL, the British Library and others. It also sets out a brief response to the report from Jisc and some proposals for immediate next steps.

NOAA/MLML Radiometric Data Acquisition and Processing

This report is a detailed description of data processing of NOAA/MLML spectroradiometry data. It introduces the MLML_DBASE programs, describes the assembly of diverse data fues, and describes general algorithms and how individual routines are used. Definitions of data structures are presented in Appendices. [PDF contains 48 pages]