On the Relationship Between File Sizes, Transport Protocols, and Self-Similar Network Traffic

Recent measurements of local-area and wide-area traffic have shown that network traffic exhibits variability at a wide range of scales self-similarity. In this paper, we examine a mechanism that gives rise to self-similar network traffic and present some of its performance implications. The mechanism we study is the transfer of files or messages whose size is drawn from a heavy-tailed distribution. We examine its effects through detailed transport-level simulations of multiple TCP streams in an internetwork. First, we show that in a "realistic" client/server network environment i.e., one with bounded resources and coupling among traffic sources competing for resources the degree to which file sizes are heavy-tailed can directly determine the degree of traffic self-similarity at the link level. We show that this causal relationship is not significantly affected by changes in network resources (bottleneck bandwidth and buffer capacity), network topology, the influence of cross-traffic, or the distribution of interarrival times. Second, we show that properties of the transport layer play an important role in preserving and modulating this relationship. In particular, the reliable transmission and flow control mechanisms of TCP (Reno, Tahoe, or Vegas) serve to maintain the long-range dependency structure induced by heavy-tailed file size distributions. In contrast, if a non-flow-controlled and unreliable (UDP-based) transport protocol is used, the resulting traffic shows little self-similar characteristics: although still bursty at short time scales, it has little long-range dependence. If flow-controlled, unreliable transport is employed, the degree of traffic self-similarity is positively correlated with the degree of throttling at the source. Third, in exploring the relationship between file sizes, transport protocols, and self-similarity, we are also able to show some of the performance implications of self-similarity. We present data on the relationship between traffic self-similarity and network performance as captured by performance measures including packet loss rate, retransmission rate, and queueing delay. Increased self-similarity, as expected, results in degradation of performance. Queueing delay, in particular, exhibits a drastic increase with increasing self-similarity. Throughput-related measures such as packet loss and retransmission rate, however, increase only gradually with increasing traffic self-similarity as long as reliable, flow-controlled transport protocol is used.

Generating Representative Web Workloads for Network and Server Performance Evaluation

One role for workload generation is as a means for understanding how servers and networks respond to variation in load. This enables management and capacity planning based on current and projected usage. This paper applies a number of observations of Web server usage to create a realistic Web workload generation tool which mimics a set of real users accessing a server. The tool, called Surge (Scalable URL Reference Generator) generates references matching empirical measurements of 1) server file size distribution; 2) request size distribution; 3) relative file popularity; 4) embedded file references; 5) temporal locality of reference; and 6) idle periods of individual users. This paper reviews the essential elements required in the generation of a representative Web workload. It also addresses the technical challenges to satisfying this large set of simultaneous constraints on the properties of the reference stream, the solutions we adopted, and their associated accuracy. Finally, we present evidence that Surge exercises servers in a manner significantly different from other Web server benchmarks.

Overlay Network Creation and Maintenance with Selfish Users

Overlay networks have been used for adding and enhancing functionality to the end-users without requiring modifications in the Internet core mechanisms. Overlay networks have been used for a variety of popular applications including routing, file sharing, content distribution, and server deployment. Previous work has focused on devising practical neighbor selection heuristics under the assumption that users conform to a specific wiring protocol. This is not a valid assumption in highly decentralized systems like overlay networks. Overlay users may act selfishly and deviate from the default wiring protocols by utilizing knowledge they have about the network when selecting neighbors to improve the performance they receive from the overlay. This thesis goes against the conventional thinking that overlay users conform to a specific protocol. The contributions of this thesis are threefold. It provides a systematic evaluation of the design space of selfish neighbor selection strategies in real overlays, evaluates the performance of overlay networks that consist of users that select their neighbors selfishly, and examines the implications of selfish neighbor and server selection to overlay protocol design and service provisioning respectively. This thesis develops a game-theoretic framework that provides a unified approach to modeling Selfish Neighbor Selection (SNS) wiring procedures on behalf of selfish users. The model is general, and takes into consideration costs reflecting network latency and user preference profiles, the inherent directionality in overlay maintenance protocols, and connectivity constraints imposed on the system designer. Within this framework the notion of user’s "best response" wiring strategy is formalized as a k-median problem on asymmetric distance and is used to obtain overlay structures in which no node can re-wire to improve the performance it receives from the overlay. Evaluation results presented in this thesis indicate that selfish users can reap substantial performance benefits when connecting to overlay networks composed of non-selfish users. In addition, in overlays that are dominated by selfish users, the resulting stable wirings are optimized to such great extent that even non-selfish newcomers can extract near-optimal performance through naïve wiring strategies. To capitalize on the performance advantages of optimal neighbor selection strategies and the emergent global wirings that result, this thesis presents EGOIST: an SNS-inspired overlay network creation and maintenance routing system. Through an extensive measurement study on the deployed prototype, results presented in this thesis show that EGOIST’s neighbor selection primitives outperform existing heuristics on a variety of performance metrics, including delay, available bandwidth, and node utilization. Moreover, these results demonstrate that EGOIST is competitive with an optimal but unscalable full-mesh approach, remains highly effective under significant churn, is robust to cheating, and incurs minimal overheads. This thesis also studies selfish neighbor selection strategies for swarming applications. The main focus is on n-way broadcast applications where each of n overlay user wants to push its own distinct file to all other destinations as well as download their respective data files. Results presented in this thesis demonstrate that the performance of our swarming protocol for n-way broadcast on top of overlays of selfish users is far superior than the performance on top of existing overlays. In the context of service provisioning, this thesis examines the use of distributed approaches that enable a provider to determine the number and location of servers for optimal delivery of content or services to its selfish end-users. To leverage recent advances in virtualization technologies, this thesis develops and evaluates a distributed protocol to migrate servers based on end-users demand and only on local topological knowledge. Results under a range of network topologies and workloads suggest that the performance of the distributed deployment is comparable to that of the optimal but unscalable centralized deployment.

A Spectral Network Model of Pitch Perception

A model of pitch perception, called the Spatial Pitch Network or SPINET model, is developed and analyzed. The model neurally instantiates ideas front the spectral pitch modeling literature and joins them to basic neural network signal processing designs to simulate a broader range of perceptual pitch data than previous spectral models. The components of the model arc interpreted as peripheral mechanical and neural processing stages, which arc capable of being incorporated into a larger network architecture for separating multiple sound sources in the environment. The core of the new model transforms a spectral representation of an acoustic source into a spatial distribution of pitch strengths. The SPINET model uses a weighted "harmonic sieve" whereby the strength of activation of a given pitch depends upon a weighted sum of narrow regions around the harmonics of the nominal pitch value, and higher harmonics contribute less to a pitch than lower ones. Suitably chosen harmonic weighting functions enable computer simulations of pitch perception data involving mistuned components, shifted harmonics, and various types of continuous spectra including rippled noise. It is shown how the weighting functions produce the dominance region, how they lead to octave shifts of pitch in response to ambiguous stimuli, and how they lead to a pitch region in response to the octave-spaced Shepard tone complexes and Deutsch tritones without the use of attentional mechanisms to limit pitch choices. An on-center off-surround network in the model helps to produce noise suppression, partial masking and edge pitch. Finally, it is shown how peripheral filtering and short term energy measurements produce a model pitch estimate that is sensitive to certain component phase relationships.

Remote electricity actuation and monitoring mote

This work presents the design and evaluation of the REAM (Remote Electricity Actuation and Monitoring) node based around the modular Tyndall Mote platform. The REAM node enables the user to remotely actuate power to a mains power extension board while sampling the current, voltage, power and power factor of the attached load. The node contains a current transformer interfaced to an Energy Metering IC which continuously samples current and voltage. These values are periodically read from the part by a PIC24 microcontroller, which calculates the RMS current and voltage, power factor and overall power. The resultant values can then be queried wirelessly employing the Tyndall 802.15.4 compliant wireless module.

Biological wastes as plant growth substrate amendments

Globally, agriculture is being intensified with mechanization and increased use of synthetic fertilizers and pesticides. There has been a scaling up of production to satisfy the demands of supermarket distribution. Problems associated with intensification of production, trade globalisation and a larger market demand for greater volumes of fresh produce, include consumers' concern about pesticide residues and leaching of nutrients and pesticides into the environment, as well as increases in the transmission of human food-poisoning pathogens on raw vegetables and in fruit juices. The first part of this research was concerned with the evaluation of a biological control strategy for soil-borne pathogens, these are difficult to eliminate and the chemicals of which the most effective fumigants e.g. methyl bromide, are being withdrawn form use. Chitin-containing crustaceans shellfish waste was investigated as a selective growth substrate amendment in the field, in glasshouse and in storage trials against Sclerotinia disease of Helianthus tuberosus, Phytophthora fragariae disease of Fragaria vesca and Fusarium disease of Dianthus. Results showed that addition to shellfish waste stimulated substrate microbial populations and lytic activity and induced plant defense proteins, namely chitinases and cellulases. Protective effects were seen in all crop models but the results indicate that further trials are required to confirm long-term efficacy. The second part of the research investigated the persistence of enteric bacteria in raw salad vegetables using model food poisoning isolates. In clinical investigations plants are sampled for bacterial contamination but no attempt is made to differentiate between epiphytes and endophytes. Results here indicate that the mode isolates persist endophytically thereby escaping conventional chlorine washes and they may also induce host defenses, which results in their suppression and in negative results in conventional plate count screening. Finally a discussion of criteria that should be considered for a HACCP plan for safe raw salad vegetable production is presented.

ALD: adaptive layer distribution for scalable video

Recent years have witnessed a rapid growth in the demand for streaming video over the Internet and mobile networks, exposes challenges in coping with heterogeneous devices and varying network throughput. Adaptive schemes, such as scalable video coding, are an attractive solution but fare badly in the presence of packet losses. Techniques that use description-based streaming models, such as multiple description coding (MDC), are more suitable for lossy networks, and can mitigate the effects of packet loss by increasing the error resilience of the encoded stream, but with an increased transmission byte cost. In this paper, we present our adaptive scalable streaming technique adaptive layer distribution (ALD). ALD is a novel scalable media delivery technique that optimises the tradeoff between streaming bandwidth and error resiliency. ALD is based on the principle of layer distribution, in which the critical stream data are spread amongst all packets, thus lessening the impact on quality due to network losses. Additionally, ALD provides a parameterised mechanism for dynamic adaptation of the resiliency of the scalable video. The Subjective testing results illustrate that our techniques and models were able to provide levels of consistent high-quality viewing, with lower transmission cost, relative to MDC, irrespective of clip type. This highlights the benefits of selective packetisation in addition to intuitive encoding and transmission.

ALD: adaptive layer distribution for scalable video

Bandwidth constriction and datagram loss are prominent issues that affect the perceived quality of streaming video over lossy networks, such as wireless. The use of layered video coding seems attractive as a means to alleviate these issues, but its adoption has been held back in large part by the inherent priority assigned to the critical lower layers and the consequences for quality that result from their loss. The proposed use of forward error correction (FEC) as a solution only further burdens the bandwidth availability and can negate the perceived benefits of increased stream quality. In this paper, we propose Adaptive Layer Distribution (ALD) as a novel scalable media delivery technique that optimises the tradeoff between the streaming bandwidth and error resiliency. ALD is based on the principle of layer distribution, in which the critical stream data is spread amongst all datagrams thus lessening the impact on quality due to network losses. Additionally, ALD provides a parameterised mechanism for dynamic adaptation of the scalable video, while providing increased resilience to the highest quality layers. Our experimental results show that ALD improves the perceived quality and also reduces the bandwidth demand by up to 36% in comparison to the well-known Multiple Description Coding (MDC) technique.

Analysis of soil carbon transit times and age distributions using network theories

The long-term soil carbon dynamics may be approximated by networks of linear compartments, permitting theoretical analysis of transit time (i.e., the total time spent by a molecule in the system) and age (the time elapsed since the molecule entered the system) distributions. We compute and compare these distributions for different network. configurations, ranging from the simple individual compartment, to series and parallel linear compartments, feedback systems, and models assuming a continuous distribution of decay constants. We also derive the transit time and age distributions of some complex, widely used soil carbon models (the compartmental models CENTURY and Rothamsted, and the continuous-quality Q-Model), and discuss them in the context of long-term carbon sequestration in soils. We show how complex models including feedback loops and slow compartments have distributions with heavier tails than simpler models. Power law tails emerge when using continuous-quality models, indicating long retention times for an important fraction of soil carbon. The responsiveness of the soil system to changes in decay constants due to altered climatic conditions or plant species composition is found to be stronger when all compartments respond equally to the environmental change, and when the slower compartments are more sensitive than the faster ones or lose more carbon through microbial respiration. Copyright 2009 by the American Geophysical Union.

Evaluation of the new ESR network software for the retrieval of direct sun products from cimel ce318 and prede pom01 sun-sky radiometers.

The European Skynet Radiometers network (EuroSkyRad or ESR) has been recently established as a research network of European PREDE sun-sky radiometers. Moreover, ESR is federated with SKYNET, an international network of PREDE sun-sky radiometers mostly present in East Asia. In contrast to SKYNET, the European network also integrates users of the CIMEL CE318 sky–sun photometer. Keeping instrumental duality in mind, a set of open source algorithms has been developed consisting of two modules for (1) the retrieval of direct sun products (aerosol optical depth, wavelength exponent and water vapor) from the sun extinction measurements; and (2) the inversion of the sky radiance to derive other aerosol optical properties such as size distribution, single scattering albedo or refractive index. In this study we evaluate the ESR direct sun products in comparison with the AERosol RObotic NETwork (AERONET) products. Specifically, we have applied the ESR algorithm to a CIMEL CE318 and PREDE POM simultaneously for a 4-yr database measured at the Burjassot site (Valencia, Spain), and compared the resultant products with the AERONET direct sun measurements obtained with the same CIMEL CE318 sky–sun photometer. The comparison shows that aerosol optical depth differences are mostly within the nominal uncertainty of 0.003 for a standard calibration instrument, and fall within the nominal AERONET uncertainty of 0.01–0.02 for a field instrument in the spectral range 340 to 1020 nm. In the cases of the Ångström exponent and the columnar water vapor, the differences are lower than 0.02 and 0.15 cm, respectively. Therefore, we present an open source code program that can be used with both CIMEL and PREDE sky radiometers and whose results are equivalent to AERONET and SKYNET retrievals.

Seasonal shelf-sea front mapping using satellite ocean colour and temperature to support development of a marine protected area network

Front detection and aggregation techniques were applied to 300m resolution MERIS satellite ocean colour data for the first time, to describe frequently occurring shelf-sea fronts near to the Scottish coast. Medium resolution (1km) thermal and colour data have previously been used to analyse the distribution of surface fronts, though these cannot capture smaller frontal zones or those in close proximity to the coast, particularly where the coastline is convoluted. Seasonal frequent front maps, derived from both chlorophyll and SST data, revealed a number of key frontal zones, a subset of which were based on new insights into the sediment and plankton dynamics provided exclusively by the higher-resolution chlorophyll fronts. The methodology is described for applying colour and thermal front data to the task of identifying zones of ecological importance that could assist the process of defining marine protected areas. Each key frontal zone is analysed to describe its spatial and temporal extent and variability, and possible mechanisms. It is hoped that these tools can provide guidance on the dynamic habitats of marine fauna towards aspects of marine spatial planning and conservation.

Discovery of a SAR11 growth requirement for thiamin’s pyrimidine precursor and its distribution in the Sargasso Sea

Vitamin traffic, the production of organic growth factors by some microbial community members and their use by other taxa, is being scrutinized as a potential explanation for the variation and highly connected behavior observed in ocean plankton by community network analysis. Thiamin (vitamin B1), a cofactor in many essential biochemical reactions that modify carbon-carbon bonds of organic compounds, is distributed in complex patterns at subpicomolar concentrations in the marine surface layer (0-300 m). Sequenced genomes from organisms belonging to the abundant and ubiquitous SAR11 clade of marine chemoheterotrophic bacteria contain genes coding for a complete thiamin biosynthetic pathway, except for thiC, encoding the 4-amino-5-hydroxymethyl-2-methylpyrimidine (HMP) synthase, which is required for de novo synthesis of thiamin's pyrimidine moiety. Here we demonstrate that the SAR11 isolate 'Candidatus Pelagibacter ubique', strain HTCC1062, is auxotrophic for the thiamin precursor HMP, and cannot use exogenous thiamin for growth. In culture, strain HTCC1062 required 0.7 zeptomoles per cell (ca. 400 HMP molecules per cell). Measurements of dissolved HMP in the Sargasso Sea surface layer showed that HMP ranged from undetectable (detection limit: 2.4 pM) to 35.7 pM, with maximum concentrations coincident with the deep chlorophyll maximum. In culture, some marine cyanobacteria, microalgae and bacteria exuded HMP, and in the Western Sargasso Sea, HMP profiles changed between the morning and evening, suggesting a dynamic biological flux from producers to consumers.

Seasonal shelf-sea front mapping using satellite ocean colour and temperature to support development of a marine protected area network

Front detection and aggregation techniques were applied to 300m resolution MERIS satellite ocean colour data for the first time, to describe frequently occurring shelf-sea fronts near to the Scottish coast. Medium resolution (1km) thermal and colour data have previously been used to analyse the distribution of surface fronts, though these cannot capture smaller frontal zones or those in close proximity to the coast, particularly where the coastline is convoluted. Seasonal frequent front maps, derived from both chlorophyll and SST data, revealed a number of key frontal zones, a subset of which were based on new insights into the sediment and plankton dynamics provided exclusively by the higher-resolution chlorophyll fronts. The methodology is described for applying colour and thermal front data to the task of identifying zones of ecological importance that could assist the process of defining marine protected areas. Each key frontal zone is analysed to describe its spatial and temporal extent and variability, and possible mechanisms. It is hoped that these tools can provide guidance on the dynamic habitats of marine fauna towards aspects of marine spatial planning and conservation.

Sports programs of the Spanish radio in the social network Facebook: compared study (2010-2015)

Social networks have increasingly become a showcase where the media can be promoted. Like many other media, radio stations have made use of social networks to promote themselves in a better way and, sometimes, to keep more feedback with their listeners. But not all programs make the same use and not all of them have managed to reach in the same way his followers. This article discusses the consolidation in the social networks of the major radio sports programs in Spain. Through a comparative analysis between 2010 and 2015, throughout the text, the authors have tried to observe the evolution of the programs and, at the same time, to establish comparisons between the followers that these programs have on social networks and the number of listeners as EGM.

Entanglement distribution with global control in a star-shaped multi-splitter

Distributed quantum information processing (QIP) is a promising way to bypass problems due to unwanted interactions between elements. However, this strategy presupposes the engineering of protocols for remote processors. In many of them, pairwise entanglement is a key resource. We study a model which distributes entanglement among elements of a delocalized network without local control. The model is efficient both in finite- and infinite-dimensional Hilbert spaces. We suggest a setup of electromechanical systems to implement our proposal.