Structural Analysis of Network Traffic Flows

Network traffic arises from the superposition of Origin-Destination (OD) flows. Hence, a thorough understanding of OD flows is essential for modeling network traffic, and for addressing a wide variety of problems including traffic engineering, traffic matrix estimation, capacity planning, forecasting and anomaly detection. However, to date, OD flows have not been closely studied, and there is very little known about their properties. We present the first analysis of complete sets of OD flow timeseries, taken from two different backbone networks (Abilene and Sprint-Europe). Using Principal Component Analysis (PCA), we find that the set of OD flows has small intrinsic dimension. In fact, even in a network with over a hundred OD flows, these flows can be accurately modeled in time using a small number (10 or less) of independent components or dimensions. We also show how to use PCA to systematically decompose the structure of OD flow timeseries into three main constituents: common periodic trends, short-lived bursts, and noise. We provide insight into how the various constituents contribute to the overall structure of OD flows and explore the extent to which this decomposition varies over time.

An Independent-Connection Model for Traffic Matrices

A common assumption made in traffic matrix (TM) modeling and estimation is independence of a packet's network ingress and egress. We argue that in real IP networks, this assumption should not and does not hold. The fact that most traffic consists of two-way exchanges of packets means that traffic streams flowing in opposite directions at any point in the network are not independent. In this paper we propose a model for traffic matrices based on independence of connections rather than packets. We argue that the independent connection (IC) model is more intuitive, and has a more direct connection to underlying network phenomena than the gravity model. To validate the IC model, we show that it fits real data better than the gravity model and that it works well as a prior in the TM estimation problem. We study the model's parameters empirically and identify useful stability properties. This justifies the use of the simpler versions of the model for TM applications. To illustrate the utility of the model we focus on two such applications: synthetic TM generation and TM estimation. To the best of our knowledge this is the first traffic matrix model that incorporates properties of bidirectional traffic.

Genetic algorithm for shipping route estimation with long-range tracking data : automatic reconstruction of shipping routes based on the historical ship positions for maritime safety applications

Ship tracking systems allow Maritime Organizations that are concerned with the Safety at Sea to obtain information on the current location and route of merchant vessels. Thanks to Space technology in recent years the geographical coverage of the ship tracking platforms has increased significantly, from radar based near-shore traffic monitoring towards a worldwide picture of the maritime traffic situation. The long-range tracking systems currently in operations allow the storage of ship position data over many years: a valuable source of knowledge about the shipping routes between different ocean regions. The outcome of this Master project is a software prototype for the estimation of the most operated shipping route between any two geographical locations. The analysis is based on the historical ship positions acquired with long-range tracking systems. The proposed approach makes use of a Genetic Algorithm applied on a training set of relevant ship positions extracted from the long-term storage tracking database of the European Maritime Safety Agency (EMSA). The analysis of some representative shipping routes is presented and the quality of the results and their operational applications are assessed by a Maritime Safety expert.

Forecasting Containerized Traffic for the Port of Montreal (1981-1995)

Le But de Ce Rapport Est de Presenter L'approche Utilisee Par les Auteurs Pour Effectuer des Previsions a Long Terme du Trafic de Conteneurs Outre-Mer, Pour le Port de Montreal. Cette Approche Suppose D'abord L'estimation du Trafic de Conteneurs Par Categories de Marchandise, Par Origine et Destination, au Cours des Annees Recentes. Ensuite, Nous Avons Obtenu des Previsions du Trafic de Conteneurs Pour 1995, En Nous Basant Sur des Anticipations Relatives aux Tendances Generales du Commerce Exterieur Canadien et a la Composition de Ces Echanges, Par Groupes de Marchandises. Nous Avons Egalement du Effectuer des Projections Sur L'evolution Probable des Taux de Conteneurisation, En Tenant Compte des Diverses Marchandises et Egalement des Partenaires Commerciaux Impliques. Nous Avons Aussi Considere L'evolution Possible des Frontieres de la Zone D'influence (\"Hinterland\") du Port de Montreal. L'importance du Trafic Genere Par le Midwest des Etats Unis a Augmente Considerablement au Cours de la Derniere Decennie, a Cause D'un Certain Nombre de Facteurs Institutionnels. Nos Previsions du Trafic de Conteneurs, Pour le Port de Montreal, Dependent Donc,En Grande Partie, de L'eventualite Que le Midwest des Etats Unis Demeure Dans la Zone D'influence du Port de Montreal. Finalement, Nous Presentons Deux Scenarios de Previsions. le Premier de Ces Scenarios Suppose Que la Position Concurrentielle Actuelle du Port de Montreal Demeure Virtuellement Inchangee. le Second Scenario Suppose la Disparition D'une Importante Entreprise de Transport de Conteneurs, Situee a Montreal.

Estimation of the probability of congestion using Monte Carlo method in OPS networks

In networks with small buffers, such as optical packet switching based networks, the convolution approach is presented as one of the most accurate method used for the connection admission control. Admission control and resource management have been addressed in other works oriented to bursty traffic and ATM. This paper focuses on heterogeneous traffic in OPS based networks. Using heterogeneous traffic and bufferless networks the enhanced convolution approach is a good solution. However, both methods (CA and ECA) present a high computational cost for high number of connections. Two new mechanisms (UMCA and ISCA) based on Monte Carlo method are proposed to overcome this drawback. Simulation results show that our proposals achieve lower computational cost compared to enhanced convolution approach with an small stochastic error in the probability estimation

Blind channel estimation for multi-rate multicarrier DS/CDMA communications

Multi-rate multicarrier DS/CDMA is a potentially attractive multiple access method for future wireless communications networks that must support multimedia, and thus multi-rate, traffic. Several receiver structures exist for single-rate multicarrier systems, but little has been reported on multi-rate multicarrier systems. Considering that high-performance detection such as coherent demodulation needs the explicit knowledge of the channel, based on the finite-length chip waveform truncation, this paper proposes a subspace-based scheme for timing and channel estimation in multi-rate multicarrier DS/CDMA systems, which is applicable to both multicode and variable spreading factor systems. The performance of the proposed scheme for these two multi-rate systems is validated via numerical simulations. The effects of the finite-length chip waveform truncation on the performance of the proposed scheme is also analyzed theoretically.

Blind channel estimation in multi-rate multicarrier DS-CDMA systems

Multi-rate multicarrier DS-CDMA is a potentially attractive multiple access method for future broadband wireless multimedia networks that must support integrated voice/data traffic. This paper proposes a subspace based channel estimation scheme for multi-rate multicarrier DS-CDMA, which is applicable to both multicode and variable spreading factor systems. The performance of the proposed scheme for these two multi-rate systems is compared via numerical simulations.

Blind channel acquisition and channel estimation for multi-rate multicarrier DS-CDMA communications

Multi-rate multicarrier DS-CDMA is a potentially attractive multiple access method for future wireless networks that must support multimedia, and thus multi-rate, traffic. Considering that high performance detection such as coherent demodulation needs the explicit knowledge of the channel, this paper proposes a subspace-based blind adaptive algorithm for timing acquisition and channel estimation in asynchronous multirate multicarrier DS-CDMA systems, which is applicable to both multicode and variable spreading factor systems.

Internet traffic classification using constrained clustering

Statistics-based Internet traffic classification using machine learning techniques has attracted extensive research interest lately, because of the increasing ineffectiveness of traditional port-based and payload-based approaches. In particular, unsupervised learning, that is, traffic clustering, is very important in real-life applications, where labeled training data are difficult to obtain and new patterns keep emerging. Although previous studies have applied some classic clustering algorithms such as K-Means and EM for the task, the quality of resultant traffic clusters was far from satisfactory. In order to improve the accuracy of traffic clustering, we propose a constrained clustering scheme that makes decisions with consideration of some background information in addition to the observed traffic statistics. Specifically, we make use of equivalence set constraints indicating that particular sets of flows are using the same application layer protocols, which can be efficiently inferred from packet headers according to the background knowledge of TCP/IP networking. We model the observed data and constraints using Gaussian mixture density and adapt an approximate algorithm for the maximum likelihood estimation of model parameters. Moreover, we study the effects of unsupervised feature discretization on traffic clustering by using a fundamental binning method. A number of real-world Internet traffic traces have been used in our evaluation, and the results show that the proposed approach not only improves the quality of traffic clusters in terms of overall accuracy and per-class metrics, but also speeds up the convergence.

Estimation and evaluation of dynamic properties as indicators of changes on soil structure in sugarcane fields of São Paulo State - Brazil

The indiscriminate management and use of soils without moisture control has changed the structure of it due to the increment of the traffic by agricultural machines through the years, causing in consequence, a soil compaction and yield reduction in the areas of intensive traffic. The purpose of this work was to estimate and to evaluate the performance of preconsolidation pressure of the soil and shear stress as indicators of changes on soil structure in fields cropped with sugarcane, as well as the impact of management processes in an Eutrorthox soil structure located in São Paulo State. The experimental field was located in Piracicaba's rural area (São Paulo State, Brazil) and has been cropped with sugarcane, in the second harvest cycle. The soil was classified by Empresa Brasileira de Pesquisa Agropecuária (EMBRAPA) [Empresa Brasileira de Pesquisa Agropecuária (EMBRAPA), 1999. Centro Nacional de Pesquisa de Solos. Sistema Brasileiro de Classificao de Solos, Empresa Brasileira de Pesquisa Agropecuária (EMBRAPA), Brasilia, 412 pp.] as an Eutrorthox. Undisturbed samples were collected and georeferenced in a grid of 60 m x 60 m from two depths: 0-0.10 m (superficial layer - SL) and in the layer of greatest mechanical resistance (LGMR), previously identified by cone index (CI). The investigated variables were pressure preconsolidation (sigma(p)), apparent cohesion (c) and internal friction angle (phi). The conclusions from the results were that the SLSC was predicted satisfactorily from up as a function of soil moisture; thus, decisions about machinery size and loading (contact pressures) can be taken. Apparent cohesion (c), internal friction angle (phi) and the Coulomb equation were significantly altered by traffic intensity. The sigma(p), c and phi maps were shown to be important tools to localize and visualize soil compaction and mechanical resistance zones. They constitute a valuable resource to evaluate the traffic impact in areas cropped with sugarcane in State of São Paulo, Brazil. (C) 2008 Elsevier B.V. All rights reserved.

Method for estimating railroad track settlements due to dynamic traffic loads

This paper is the result of real-scale physical modeling study designed to simulate the load-deformation characteristics of railroad foundation systems that include the railroad ties, the ballast, and the sub-base layers of a railroad embankment. The study presents comparisons of the application of dynamic loads of 100kN on the rails, and the resulting deformations during a 500,000 cycle testing period for three rail support systems; wood, concrete and steel. The results show that the deformation curve has an exponential shape, with the larger portion of the deformation occurring during the first 50,000 load cycles followed by a tendency to stabilize between 100,000 to 500,000 cycles. These results indicate that the critical phase of deformations of a new railroad is within the first 50,000 cycles of loading, and after that, it slowly attenuates as it approaches a stable value. The paper also presents empirically derived formulations for the estimation of the deformations of the rail supports as a result of rail traffic.

Comparison between common traffic lights and three types of traffic lights with visual cycle a safety and capacity analysis

The objective of this paper is compare the common traffic lights (CTL) to three different types of traffic lights with countdown displays (SCD) and assess their effects on road safety and capacity. This comparison is required because the results found in the literature are divergent among countries and cities, and one of the SCD analyzed in our study is different from the SCD used worldwide. An observational before-after study was conducted to evaluate the safety and capacity in a period of one year before and one year after the implementation of the SCD in three Brazilian cities. The results indicate that the SCD models 1 and 3 had around 35%±14% reduction in the total number of accidents; the model 2, does not have significant reduction. In order to perform the capacity analysis a framework for data collection and an adaptation for estimation of initial lost time in each phase were developed. Considering the capacity analysis there was a reduction around 11% in the lost time in SCD model 1, 7% in SCD model 2 and 3% in SCD model 3. However the implications of this on capacity are trifle due to a small increase in the average headways for all SCD models compare to CTL.

On the accuracy of Software-based Energy Estimation Techniques

This paper examines the accuracy of software-based on-line energy estimation techniques. It evaluates today’s most widespread energy estimation model in order to investigate whether the current methodology of pure software-based energy estimation running on a sensor node itself can indeed reliably and accurately determine its energy consumption - independent of the particular node instance, the traffic load the node is exposed to, or the MAC protocol the node is running. The paper enhances today’s widely used energy estimation model by integrating radio transceiver switches into the model, and proposes a methodology to find the optimal estimation model parameters. It proves by statistical validation with experimental data that the proposed model enhancement and parameter calibration methodology significantly increases the estimation accuracy.

Traffic-Adaptive and Link-Quality-Aware Communication in Wireless Sensor Networks

This paper is a summary of the main contribu- tions of the PhD thesis published in [1]. The main research contributions of the thesis are driven by the research question how to design simple, yet efficient and robust run-time adaptive resource allocation schemes within the commu- nication stack of Wireless Sensor Network (WSN) nodes. The thesis addresses several problem domains with con- tributions on different layers of the WSN communication stack. The main contributions can be summarized as follows: First, a a novel run-time adaptive MAC protocol is intro- duced, which stepwise allocates the power-hungry radio interface in an on-demand manner when the encountered traffic load requires it. Second, the thesis outlines a metho- dology for robust, reliable and accurate software-based energy-estimation, which is calculated at network run- time on the sensor node itself. Third, the thesis evaluates several Forward Error Correction (FEC) strategies to adap- tively allocate the correctional power of Error Correcting Codes (ECCs) to cope with timely and spatially variable bit error rates. Fourth, in the context of TCP-based communi- cations in WSNs, the thesis evaluates distributed caching and local retransmission strategies to overcome the perfor- mance degrading effects of packet corruption and trans- mission failures when transmitting data over multiple hops. The performance of all developed protocols are eval- uated on a self-developed real-world WSN testbed and achieve superior performance over selected existing ap- proaches, especially where traffic load and channel condi- tions are suspect to rapid variations over time.

Generic multisensor multitarget bias estimation architecture

Current bias estimation algorithms for air traffic control (ATC) surveillance are focused on radar sensors, but the integration of new sensors (especially automatic dependent surveillance-broadcast and wide area multilateration) demands the extension of traditional procedures. This study describes a generic architecture for bias estimation applicable to multisensor multitarget surveillance systems. It consists on first performing bias estimations using measurements from each target, of a subset of sensors, assumed to be reliable, forming track bias estimations. All track bias estimations are combined to obtain, for each of those sensors, the corresponding sensor bias. Then, sensor bias terms are corrected, to subsequently calculate the target or sensor-target pair specific biases. Once these target-specific biases are corrected, the process is repeated recursively for other sets of less reliable sensors, assuming bias corrected measures from previous iterations are unbiased. This study describes the architecture and outlines the methodology for the estimation and the bias estimation design processes. Then the approach is validated through simulation, and compared with previous methods in the literature. Finally, the study describes the application of the methodology to the design of the bias estimation procedures for a modern ATC surveillance application, specifically for off-line assessment of ATC surveillance performance.