Classifying network traffic in the big data era

With the arrival of Big Data Era, properly utilizing the power of big data is becoming increasingly essential for the strength and competitiveness of businesses and organizations. We are facing grand challenges from big data from different perspectives, such as processing, communication, security, and privacy. In this talk, we discuss the big data challenges in network traffic classification and our solutions to the challenges. The significance of the research lies in the fact that each year the network traffic increase exponentially on the current Internet. Traffic classification has wide applications in network management, from security monitoring to quality of service measurements. Recent research tends to apply machine-learning techniques to flow statistical feature based classification methods. In this talk, we propose a series of novel approaches for traffic classification, which can improve the classification performance effectively by incorporating correlated information into the classification process. We analyze the new classification approaches and their performance benefit from both theoretical and empirical perspectives. A large number of experiments are carried out on two real-world traffic datasets to validate the proposed approach. The results show the traffic classification performance can be improved significantly even under the extreme difficult circumstance of very few training samples. Our work has significant impact on security applications.

Stomach temperature records reveal nursing behaviour and transition to solid food consumption in an unweaned mammal, the harbour seal pup (Phoca vitulina)

Knowledge of milk transfer from mother to offspring and early solid food ingestions in mammals allows for a greater understanding of the factors affecting transition to nutritional independence and pre-weaning growth and survival. Yet studies monitoring suckling behaviour have often relied on visual observations, which might not accurately represent milk intake. We assessed the use of stomach temperature telemetry to monitor suckling and foraging behaviour in free-ranging harbour seal (Phoca vitulina) pups during lactation. Stomach temperature declines were analysed using principal component and cluster analyses, as well as trials using simulated stomachs resulting in a precise classification of stomach temperature drops into milk, seawater and solid food ingestions. Seawater and solid food ingestions represented on average 15.361.6% [0-40.0%] and 0.760.2% [0-13.0%], respectively, of individual ingestions. Overall, 63.7% of milk ingestions occurred while the pups were in the water, of which 13.9% were preceded by seawater ingestion. The average time between subsequent ingestions was significantly less for seawater than for milk ingestions. These results suggest that seawater ingestion might represent collateral ingestion during aquatic suckling attempts. Alternatively, as solid food ingestions (n = 19) were observed among 7 pups, seawater ingestion could result from missed prey capture attempts. This study shows that some harbour seals start ingesting prey while still being nursed, indicating that weaning occurs more gradually than previously thought in this species. Stomach temperature telemetry represents a promising method to study suckling behaviour in wild mammals and transition to nutritional independence in various endotherm species.

Automatic network traffic classification

The thesis addresses a number of critical problems in regard to fully automating the process of network traffic classification and protocol identification. Several effective solutions based on statistical analysis and machine learning techniques are proposed, which significantly reduce the requirements for human interventions in network traffic classification systems.

2Loud?: Community mapping of exposure to traffic noise with mobile phones

Abstract: Despite ample medical evidence of the adverse impacts of traffic noise on health, most policies for traffic noise management are arbitrary or incomplete, resulting in serious social and economic impacts. Surprisingly, there is limited information about citizen’s exposure to traffic noise worldwide. This paper presents the 2Loud? mobile phone application, developed and tested as a methodology to monitor, assess and map the level of exposure to traffic noise of citizens with focus on the night period and indoor locations, since sleep disturbance is one of the major triggers for ill health related to traffic noise. Based on a community participation experiment using the 2Loud? mobile phone application in a region close to freeways in Australia, the results of this research indicates a good level of accuracy for the noise monitoring by mobile phones and also demonstrates significant levels of indoor night exposure to traffic noise in the study area. The proposed methodology, through the data produced and the participatory process involved, can potentially assist in planning and management towards healthier urban environments.

Machine-learning prediction of cancer survival: a retrospective study using electronic administrative records and a cancer registry

Using the prediction of cancer outcome as a model, we have tested the hypothesis that through analysing routinely collected digital data contained in an electronic administrative record (EAR), using machine-learning techniques, we could enhance conventional methods in predicting clinical outcomes.

Participatory sensing and education: helping the community mitigate sleep disturbance from traffic noise

Purpose – This paper aims to present a project in Australia, where participants use smartphones to measure the level of traffic noise in their homes. Through the data collected, participants learn if they are subjected to sleep disturbances and, if so, understand how they can manage the issue to protect their health. The project also has a secondary purpose: the local council would like to engage its community through the exercise and be seen as acting on the community’s problems.

ANFIS traffic signal controller for an isolated intersection

Traffic signal controlling is one of the solutions to reduce the traffic congestion in cities. To set appropriate green times for traffic signal lights, we have applied Adaptive Neuro-Fuzzy Inference System (ANFIS) method in traffic signal controllers. ANFIS traffic signal controller is used for controlling traffic congestion of a single intersection with the purpose of minimizing travel delay time. The ANFIS traffic controller is an intelligent controller that learns to set an appropriate green time for each phase of traffic signal lights at the start of the phase and based on the traffic information. The controller uses genetic algorithm to tune ANFIS parameters during learning time. The results of the experiments show higher performance of the ANFIS traffic signal controller compared to three other traffic controllers that are developed as benchmarks. One of the benchmarks is GA-FLC (Araghi et al., 2014), next one is a fixed-FLC, and a fixed-time controller with three different values for green phase. Results show the higher performance of ANFIS controller.

Detection and defense of application-layer DDoS attacks in backbone web traffic

Web servers are usually located in a well-organized data center where these servers connect with the outside Internet directly through backbones. Meanwhile, the application-layer distributed denials of service (AL-DDoS) attacks are critical threats to the Internet, particularly to those business web servers. Currently, there are some methods designed to handle the AL-DDoS attacks, but most of them cannot be used in heavy backbones. In this paper, we propose a new method to detect AL-DDoS attacks. Our work distinguishes itself from previous methods by considering AL-DDoS attack detection in heavy backbone traffic. Besides, the detection of AL-DDoS attacks is easily misled by flash crowd traffic. In order to overcome this problem, our proposed method constructs a Real-time Frequency Vector (RFV) and real-timely characterizes the traffic as a set of models. By examining the entropy of AL-DDoS attacks and flash crowds, these models can be used to recognize the real AL-DDoS attacks. We integrate the above detection principles into a modularized defense architecture, which consists of a head-end sensor, a detection module and a traffic filter. With a swift AL-DDoS detection speed, the filter is capable of letting the legitimate requests through but the attack traffic is stopped. In the experiment, we adopt certain episodes of real traffic from Sina and Taobao to evaluate our AL-DDoS detection method and architecture. Compared with previous methods, the results show that our approach is very effective in defending AL-DDoS attacks at backbones. © 2013 Elsevier B.V. All rights reserved.

Optimal design of traffic signal controller using neural networks and fuzzy logic systems

This paper aims at optimally adjusting a set of green times for traffic lights in a single intersection with the purpose of minimizing travel delay time and traffic congestion. Neural network (NN) and fuzzy logic system (FLS) are two methods applied to develop intelligent traffic timing controller. For this purpose, an intersection is considered and simulated as an intelligent agent that learns how to set green times in each cycle based on the traffic information. The training approach and data for both these learning methods are similar. Both methods use genetic algorithm to tune their parameters during learning. Finally, The performance of the two intelligent learning methods is compared with the performance of simple fixed-time method. Simulation results indicate that both intelligent methods significantly reduce the total delay in the network compared to the fixed-time method.