A distributed spatial-temporal weighted model on MapReduce for short-term traffic flow forecasting

Accurate and timely traffic flow prediction is crucial to proactive traffic management and control in data-driven intelligent transportation systems (D2ITS), which has attracted great research interest in the last few years. In this paper, we propose a Spatial-Temporal Weighted K-Nearest Neighbor model, named STW-KNN, in a general MapReduce framework of distributed modeling on a Hadoop platform, to enhance the accuracy and efficiency of short-term traffic flow forecasting. More specifically, STW-KNN considers the spatial-temporal correlation and weight of traffic flow with trend adjustment features, to optimize the search mechanisms containing state vector, proximity measure, prediction function, and K selection. urthermore, STW-KNN is implemented on a widely adopted Hadoop distributed computing platform with the MapReduce parallel processing paradigm, for parallel prediction of traffic flow in real time. inally, with extensive experiments on real-world big taxi trajectory data, STW-KNN is compared with the state-of-the-art prediction models including conventional K-Nearest Neighbor (KNN), Artificial Neural Networks (ANNs), Naïve Bayes (NB), Random orest (R), and C4.. The results demonstrate that the proposed model is superior to existing models on accuracy by decreasing the mean absolute percentage error (MAPE) value more than 11.9% only in time domain and even achieves 89.71% accuracy improvement with the MAPEs of between 4% and 6.% in both space and time domains, and also significantly improves the efficiency and scalability of short-term traffic flow forecasting over existing approaches.

Real-time traffic flow statistical analysis based on network-constrained moving object trajectories

In this paper, we propose a novel traffic flow analysis method, Network-constrained Moving Objects Database based Traffic Flow Statistical Analysis (NMOD-TFSA) model. By sampling and analyzing the spatial-temporal trajectories of network constrained moving objects, NMOD-TFSA can get the real-time traffic conditions of the transportation network. The experimental results show that, compared with the floating-car methods which are widely used in current traffic flow analyzing systems, NMOD-TFSA provides an improved performance in terms of communication costs and statistical accuracy.

A MapReduce-based nearest neighbor approach for big-data-driven traffic flow prediction

In big-data-driven traffic flow prediction systems, the robustness of prediction performance depends on accuracy and timeliness. This paper presents a new MapReduce-based nearest neighbor (NN) approach for traffic flow prediction using correlation analysis (TFPC) on a Hadoop platform. In particular, we develop a real-time prediction system including two key modules, i.e., offline distributed training (ODT) and online parallel prediction (OPP). Moreover, we build a parallel k-nearest neighbor optimization classifier, which incorporates correlation information among traffic flows into the classification process. Finally, we propose a novel prediction calculation method, combining the current data observed in OPP and the classification results obtained from large-scale historical data in ODT, to generate traffic flow prediction in real time. The empirical study on real-world traffic flow big data using the leave-one-out cross validation method shows that TFPC significantly outperforms four state-of-the-art prediction approaches, i.e., autoregressive integrated moving average, Naïve Bayes, multilayer perceptron neural networks, and NN regression, in terms of accuracy, which can be improved 90.07% in the best case, with an average mean absolute percent error of 5.53%. In addition, it displays excellent speedup, scaleup, and sizeup.

An optimal transportation routing approach using GIS-based dynamic traffic flows

This paper examines the value of real-time traffic information gathered through Geographic Information Systems for achieving an optimal vehicle routing within a dynamically stochastic transportation network. We present a systematic approach in determining the dynamically varying parameters and implementation attributes that were used for the development of a Web-based transportation routing application integrated with real-time GIS services. We propose and implement an optimal routing algorithm by modifying Dijkstra’s algorithm in order to incorporate stochastically changing traffic flows. We describe the significant features of our Web application in making use of the real-time dynamic traffic flow information from GIS services towards achieving total costs savings and vehicle usage reduction. These features help users and vehicle drivers in improving their service levels and productivity as the Web application enables them to interactively find the optimal path and in identifying destinations effectively.

Hierarchical summarization techniques for network traffic

In today’s high speed networks it is becoming increasingly challenging for network managers to understand the nature of the traffic that is carried in their network. A major problem for traffic analysis in this context is how to extract a concise yet accurate summary of the relevant aggregate traffic flows that are present in network traces. In this paper, we present two summarization techniques to minimize the size of the traffic flow report that is generated by a hierarchical cluster analysis tool. By analyzing the accuracy and compaction gain of our approach on a standard benchmark dataset, we demonstrate that our approach achieves more accurate summaries than those of an existing tool that is based on frequent itemset mining.

Detecting deviations from known paths and speeds in a surveillance situation

This paper presents techniques for analysing human behaviour via video surveillance. In known scenes under surveillance, common paths of movement between entry and exit points are obtained and classified. These are used, together with a priori velocity data, to serve as a model of normal traffic flow in the scene. Surveillance sequences are then processed to extract and track the movement of people in the scene, which is compared with the models to enable detection of abnormal movement

Spatial coordinated medium sharing: Optimal access control management in drive-thru internet

Driven by the ever-growing expectation of ubiquitous connectivity and the widespread adoption of IEEE 802.11 networks, it is not only highly demanded but also entirely possible for in-motion vehicles to establish convenient Internet access to roadside WiFi access points (APs) than ever before, which is referred to as Drive-Thru Internet. The performance of Drive-Thru Internet, however, would suffer from the high vehicle mobility, severe channel contentions, and instinct issues of the IEEE 802.11 MAC as it was originally designed for static scenarios. As an effort to address these problems, in this paper, we develop a unified analytical framework to evaluate the performance of Drive-Thru Internet, which can accommodate various vehicular traffic flow states, and to be compatible with IEEE 802.11a/b/g networks with a distributed coordination function (DCF). We first develop the mathematical analysis to evaluate the mean saturated throughput of vehicles and the transmitted data volume of a vehicle per drive-thru. We show that the throughput performance of Drive-Thru Internet can be enhanced by selecting an optimal transmission region within an AP's coverage for the coordinated medium sharing of all vehicles. We then develop a spatial access control management approach accordingly, which ensures the airtime fairness for medium sharing and boosts the throughput performance of Drive-Thru Internet in a practical, efficient, and distributed manner. Simulation results show that our optimal access control management approach can efficiently work in IEEE 802.11b and 802.11g networks. The maximal transmitted data volume per drive-thru can be enhanced by 113.1% and 59.5% for IEEE 802.11b and IEEE 802.11g networks with a DCF, respectively, compared with the normal IEEE 802.11 medium access with a DCF.

A flow control methodology for the rapid generation of vehicle traffic models

This paper presents a conveyor-based methodology to model complex vehicle flows common to factory and distribution warehouse facilities. The AGV and human path modelling techniques available in many commercial discrete event simulation packages require extensive knowledge and time to implement even the simplest flow control rules for multiple vehicle interaction. Although discrete event simulation is accepted as an effective tool to model vehicle delivery movements, human paths and delivery schedules for modern assembly lines, the time to generate accurate models is a significant limitation of existing simulation-based optimisation methodologies. The flow control method has been successfully implemented using two commercial simulation packages. It provides a realistic visual representation, as well as accurate statistical results, and reduces the model development process cost.

Stability of oxide films formed on mild steel in turbulent flow conditions of alkaline solutions at elevated temperatures

In the industries involving alkaline solutions in different process streams, the nature and stability of oxide films formed on the metallic surfaces determine the rates of erosion–corrosion of the equipment. In the present study the characteristics of the oxide films formed on AISI 1020 steel in a 2.75 M sodium hydroxide solution at temperatures up to 175°C, have been investigated by employing electrochemical techniques of cyclic voltammetry and chronoamperometry. The experiments were carried out in an autoclave system based upon a ‘rotating cylinder electrode’ geometry to determine the effects of turbulence on the stability of the films. The results suggest that little protection is afforded in the active region (at about −0.8 V_SHE). In the passive region at low potentials (−0.6 V to −0.4 V_SHE), it appears the films are compact and more stable, and therefore provide good protection. At higher potentials (>−0.4 V_SHE) in the passive region, the results suggest that film formation and dissolution occur simultaneously and the increase in temperature and turbulence causes a breakdown of the passive film resulting in a situation similar to nonprotective magnetite growth.

An effective network traffic classification method with unknown flow detection

Traffic classification technique is an essential tool for network and system security in the complex environments such as cloud computing based environment. The state-of-the-art traffic classification methods aim to take the advantages of flow statistical features and machine learning techniques, however the classification performance is severely affected by limited supervised information and unknown applications. To achieve effective network traffic classification, we propose a new method to tackle the problem of unknown applications in the crucial situation of a small supervised training set. The proposed method possesses the superior capability of detecting unknown flows generated by unknown applications and utilizing the correlation information among real-world network traffic to boost the classification performance. A theoretical analysis is provided to confirm performance benefit of the proposed method. Moreover, the comprehensive performance evaluation conducted on two real-world network traffic datasets shows that the proposed scheme outperforms the existing methods in the critical network environment.

Development of a stable continuous flow immobilized enzyme reactor for the hydrolysis of inulin

A 23.5-fold purified exoinulinase with a specific activity of 413 IU/mg and covalently immobilized on Duolite A568 has been used for the development of a continuous flow immobilized enzyme reactor for the hydrolysis of inulin. In a packed bed reactor containing 72 IU of exoinulinase from Kluyveromyces marxianus YS-1, inulin solution (5%, pH 5.5) with a flow rate of 4 mL/h was completely hydrolyzed at 55 °C. The reactor was run continuously for 75 days and its experimental half-life was 72 days under the optimized operational conditions. The volumetric productivity and fructose yield of the reactor were 44.5 g reducing sugars/L/h and 53.3 g/L, respectively. The hydrolyzed product was a mixture of fructose (95.8%) and glucose (4.2%) having an average fructose/glucose ratio of 24. An attempt has also been made to substitute pure inulin with raw Asparagus racemosus inulin to determine the operational stability of the developed reactor. The system remained operational only for 11 days, where 85.9% hydrolysis of raw inulin was achieved.

Distinguishing DDoS attacks from flash crowds using probability metrics

Both Flash crowds and DDoS (Distributed Denial-of-Service) attacks have very similar properties in terms of internet traffic, however Flash crowds are legitimate flows and DDoS attacks are illegitimate flows, and DDoS attacks have been a serious threat to internet security and stability. In this paper we propose a set of novel methods using probability metrics to distinguish DDoS attacks from Flash crowds effectively, and our simulations show that the proposed methods work well. In particular, these mathods can not only distinguish DDoS attacks from Flash crowds clearly, but also can distinguish the anomaly flow being DDoS attacks flow or being Flash crowd flow from Normal network flow effectively. Furthermore, we show our proposed hybrid probability metrics can greatly reduce both false positive and false negative rates in detection.

An automatic application signature construction system for unknown traffic

Identifying applications and classifying network traffic flows according to their source applications are critical for a broad range of network activities. Such a decision can be based on packet header fields, packet payload content, statistical characteristics of traffic and communication patterns of network hosts. However, most present techniques rely on some sort of apriori knowledge, which means they require labor-intensive preprocessing before running and cannot deal with previously unknown applications. In this paper, we propose a traffic classification system based on application signatures, with a novel approach to fully automate the process of deriving signatures from unidentified traffic. The key idea is to integrate statistics-based flow clustering with payload-based signature matching method, so as to eliminate the requirement of pre-labeled training data sets. We evaluate the efficiency of our approach using real-world traffic trace, and the results indicate that signature classifiers built from clustered data and pre-labeled data are able to achieve similar high accuracy better than 99%.

Milk lactate determination with a rotating bioreactor based on an electron transfer mediated by osmium complexes incorporating a continuous-flow/stopped-flow system

The high sensitivity that can be attained using a bienzymatic system and mediated by the redox polymer [Os(bpy)₂ClPyCH₂NHpoly(allylamine)] (Os-PAA), has been verified by on-line interfacing of a rotating bioreactor and continuous-flow/stopped-flow/continuous-flow processing. When the hydrogen peroxide formed by LO_x layer reaches the inner layer, the electronic flow between the immobilized peroxidase and the electrode surface produces a current, proportional to lactate concentration. The determination of lactate was possible with a limit of detection of 5 nmol l⁻¹ in the processing of as many as 30 samples per hour. This arrangement allows working in undiluted milk samples with a good stability and reproducibility. Horseradish peroxidase [EC 1.11.1.7] and Os-PAA were covalently immobilized on the glassy carbon electrode surface (upper cell body), lactate oxidase [EC 1.1.3.x] was immobilized on a disk that can be rotated.