Semantic feature-based visual attention model for pedestrian detection

Objective
Pedestrian detection under video surveillance systems has always been a hot topic in computer vision research. These systems are widely used in train stations, airports, large commercial plazas, and other public places. However, pedestrian detection remains difficult because of complex backgrounds. Given its development in recent years, the visual attention mechanism has attracted increasing attention in object detection and tracking research, and previous studies have achieved substantial progress and breakthroughs. We propose a novel pedestrian detection method based on the semantic features under the visual attention mechanism.
Method
The proposed semantic feature-based visual attention model is a spatial-temporal model that consists of two parts: the static visual attention model and the motion visual attention model. The static visual attention model in the spatial domain is constructed by combining bottom-up with top-down attention guidance. Based on the characteristics of pedestrians, the bottom-up visual attention model of Itti is improved by intensifying the orientation vectors of elementary visual features to make the visual saliency map suitable for pedestrian detection. In terms of pedestrian attributes, skin color is selected as a semantic feature for pedestrian detection. The regional and Gaussian models are adopted to construct the skin color model. Skin feature-based visual attention guidance is then proposed to complete the top-down process. The bottom-up and top-down visual attentions are linearly combined using the proper weights obtained from experiments to construct the static visual attention model in the spatial domain. The spatial-temporal visual attention model is then constructed via the motion features in the temporal domain. Based on the static visual attention model in the spatial domain, the frame difference method is combined with optical flowing to detect motion vectors. Filtering is applied to process the field of motion vectors. The saliency of motion vectors can be evaluated via motion entropy to make the selected motion feature more suitable for the spatial-temporal visual attention model.
Result
Standard datasets and practical videos are selected for the experiments. The experiments are performed on a MATLAB R2012a platform. The experimental results show that our spatial-temporal visual attention model demonstrates favorable robustness under various scenes, including indoor train station surveillance videos and outdoor scenes with swaying leaves. Our proposed model outperforms the visual attention model of Itti, the graph-based visual saliency model, the phase spectrum of quaternion Fourier transform model, and the motion channel model of Liu in terms of pedestrian detection. The proposed model achieves a 93% accuracy rate on the test video.
Conclusion
This paper proposes a novel pedestrian method based on the visual attention mechanism. A spatial-temporal visual attention model that uses low-level and semantic features is proposed to calculate the saliency map. Based on this model, the pedestrian targets can be detected through focus of attention shifts. The experimental results verify the effectiveness of the proposed attention model for detecting pedestrians.

A framework for experimental determination of localised vertical pedestrian forces on full-scale structures using wireless attitude and heading reference systems

A major weakness among loading models for pedestrians walking on flexible structures proposed in recent years is the various uncorroborated assumptions made in their development. This applies to spatio-temporal characteristics of pedestrian loading and the nature of multi-object interactions. To alleviate this problem, a framework for the determination of localised pedestrian forces on full-scale structures is presented using a wireless attitude and heading reference systems (AHRS). An AHRS comprises a triad of tri-axial accelerometers, gyroscopes and magnetometers managed by a dedicated data processing unit, allowing motion in three-dimensional space to be reconstructed. A pedestrian loading model based on a single point inertial measurement from an AHRS is derived and shown to perform well against benchmark data collected on an instrumented treadmill. Unlike other models, the current model does not take any predefined form nor does it require any extrapolations as to the timing and amplitude of pedestrian loading. In order to assess correctly the influence of the moving pedestrian on behaviour of a structure, an algorithm for tracking the point of application of pedestrian force is developed based on data from a single AHRS attached to a foot. A set of controlled walking tests with a single pedestrian is conducted on a real footbridge for validation purposes. A remarkably good match between the measured and simulated bridge response is found, indeed confirming applicability of the proposed framework.

Abnormal Pedestrian Trajectory analysis based on arbitrary-length clustering

This papers examines the use of trajectory distance measures and clustering techniques to define normal
and abnormal trajectories in the context of pedestrian tracking in public spaces. In order to detect abnormal
trajectories, what is meant by a normal trajectory in a given scene is firstly defined. Then every trajectory
that deviates from this normality is classified as abnormal. By combining Dynamic Time Warping and a
modified K-Means algorithms for arbitrary-length data series, we have developed an algorithm for trajectory
clustering and abnormality detection. The final system performs with an overall accuracy of 83% and 75%
when tested in two different standard datasets.

Monitoring and model updating of an FRP pedestrian truss bridge

This paper presents the results of a real bridge field experiment, carried out on a fiber reinforced polymer (FRP) pedestrian truss bridge of which nodes are reinforced with stainless steel plates. The aim of this paper is to identify the dynamic parameters of this bridge by using both conventional techniques and a model updating algorithm. In the field experiment, the bridge was instrumented with accelerometers at a number of locations on the bridge deck, recording both vertical and transverse vibrations. It was excited via jump tests at particular locations along its span and the resulting acceleration signals are used to identify dynamic parameters, such as the bridge mode shape, natural frequency and damping constant. Pedestrianinduced vibrations are also measured and utilized to identify dynamic parameters of the bridge. For a complete analysis of the bridge, a numerical model of the FRP bridge is created whose properties are calibrated utilizing a model updating algorithm. Comparable frequencies and mode shapes to those from the experiment were obtained by the FE models considering the reinforcement by increasing elastic modulus at every node of the bridge by stainless steel plate. Moreover, considering boundary conditions at both ends as fixed in the model resulted in modal properties comparable/similar to those from the experiment. This study also demonstrated that the effect of reinforcement and boundary conditions must be properly considered in an FE model to analyze real behavior of the FRP bridge.

Combining human perception and geometric restrictions for automatic pedestrian detection

[EN]Automatic detection systems do not perform as well as human observers, even on simple detection tasks. A potential solution to this problem is training vision systems on appropriate regions of interests (ROIs), in contrast to training on predefined and arbitrarily selected regions. Here we focus on detecting pedestrians in static scenes. Our aim is to answer the following question: Can automatic vision systems for pedestrian detection be improved by training them on perceptually-defined ROIs?

Improving automatic pedestrian detection by means of human perception

[EN]Can automatic vision systems for pedestrian detection be improved by training them on perceptually-defined ROIs?

Public Perceptions of the Midwest's Pavements - Executive Summary: Iowa

This report summarizes Iowa results of a five year, Pooled Fund study involving the Wisconsin, Iowa, and Minnesota Departments of Transportation (DOTs) designed to 1) assess the public's perceptions of the DOTs' pavement improvement strategies and 2) develop customer-based thresholds of satisfaction with pavements on rural two lane highways in each state as related to the DOTs' physical indices, such as pavement ride and condition. The primary objective was to seek systematic customer input to improve the DOTs' pavement improvement policies by 1) determining how drivers perceive the DOTs' pavements in terms of comfort and convenience but also in terms of other tradeoffs the DOTs had not previously considered, 2) determining relationships between perceptions and measured pavement condition thresholds (including a general level of tolerance of winter ride conditions in two of the states), and 3) identifying important attributes and issues that may not have been considered in the past. Secondary objectives were 1) to provide a tool for systematic customer input in the future and 2) to provide information which can help structure public information programs. A University of Wisconsin-Extension survey lab conducted the surveys under the direction of a multi-disciplinary team from Marquette University. Approximately 4500 drivers in the 3 states participated in the 3 phases of the project. Researchers conducted 6 focus groups in each state, approximately 400 statewide telephone interviews in each state and 700-800 targeted telephone interviews in each state. Approximately 400 winter ride interviews were conducted in Wisconsin and Minnesota. A summary of the method for each survey is included. In Phase I, focus groups were conducted with drivers to get an initial indication of what the driving public believes in regards to pavements and to frame issues for inclusion in the more representative statewide surveys of drivers conducted in Phase II. Phase II interviews gathered information about improvement policy tradeoff issues and about preliminary thresholds of improvement in terms of physical pavement indices. In Phase III, a two step recruitment and post-drive interview procedure yielded thresholds of ride and condition index summarized for each state. Results show that, in general, the driving public wants longer lasting pavements and are willing to pay for them. They want to minimize construction delay, improve entire sections of highway at one time but they dislike detours, and prefer construction under traffic even if it stretches out construction time. Satisfaction with pavements does not correlate directly to a high degree with physical pavement indices, but was found instead to be a complex, multi-faceted phenomenon. A psychological model was applied to explain satisfaction to a respectable degree for the social sciences. Results also indicate a high degree of trust in the 3 DOTs which is enhanced when the public is asked for input on specific highway segments. Conclusions and recommendations include a 3-step methodology for other state studies.

Development of a Wireless MEMS Multifunction Sensor System and Field Demonstration of Embedded Sensors for Monitoring Concrete Pavements, TR-637, 2016

Pavements tend to deteriorate with time under repeated traffic and/or environmental loading. By detecting pavement distresses and damage early enough, it is possible for transportation agencies to develop more effective pavement maintenance and rehabilitation programs and thereby achieve significant cost and time savings. The structural health monitoring (SHM) concept can be considered as a systematic method for assessing the structural state of pavement infrastructure systems and documenting their condition. Over the past several years, this process has traditionally been accomplished through the use of wired sensors embedded in bridge and highway pavement. However, the use of wired sensors has limitations for long-term SHM and presents other associated cost and safety concerns. Recently, micro-electromechanical sensors and systems (MEMS) and nano-electromechanical systems (NEMS) have emerged as advanced/smart-sensing technologies with potential for cost-effective and long-term SHM. This two-pronged study evaluated the performance of commercial off-the-shelf (COTS) MEMS sensors embedded in concrete pavement (Final Report Volume I) and developed a wireless MEMS multifunctional sensor system for health monitoring of concrete pavement (Final Report Volume II).

Soft computing based parameter identification in pavements and geomechanical systems

Accurate estimation of road pavement geometry and layer material properties through the use of proper nondestructive testing and sensor technologies is essential for evaluating pavement’s structural condition and determining options for maintenance and rehabilitation. For these purposes, pavement deflection basins produced by the nondestructive Falling Weight Deflectometer (FWD) test data are commonly used. The nondestructive FWD test drops weights on the pavement to simulate traffic loads and measures the created pavement deflection basins. Backcalculation of pavement geometry and layer properties using FWD deflections is a difficult inverse problem, and the solution with conventional mathematical methods is often challenging due to the ill-posed nature of the problem. In this dissertation, a hybrid algorithm was developed to seek robust and fast solutions to this inverse problem. The algorithm is based on soft computing techniques, mainly Artificial Neural Networks (ANNs) and Genetic Algorithms (GAs) as well as the use of numerical analysis techniques to properly simulate the geomechanical system. A widely used pavement layered analysis program ILLI-PAVE was employed in the analyses of flexible pavements of various pavement types; including full-depth asphalt and conventional flexible pavements, were built on either lime stabilized soils or untreated subgrade. Nonlinear properties of the subgrade soil and the base course aggregate as transportation geomaterials were also considered. A computer program, Soft Computing Based System Identifier or SOFTSYS, was developed. In SOFTSYS, ANNs were used as surrogate models to provide faster solutions of the nonlinear finite element program ILLI-PAVE. The deflections obtained from FWD tests in the field were matched with the predictions obtained from the numerical simulations to develop SOFTSYS models. The solution to the inverse problem for multi-layered pavements is computationally hard to achieve and is often not feasible due to field variability and quality of the collected data. The primary difficulty in the analysis arises from the substantial increase in the degree of non-uniqueness of the mapping from the pavement layer parameters to the FWD deflections. The insensitivity of some layer properties lowered SOFTSYS model performances. Still, SOFTSYS models were shown to work effectively with the synthetic data obtained from ILLI-PAVE finite element solutions. In general, SOFTSYS solutions very closely matched the ILLI-PAVE mechanistic pavement analysis results. For SOFTSYS validation, field collected FWD data were successfully used to predict pavement layer thicknesses and layer moduli of in-service flexible pavements. Some of the very promising SOFTSYS results indicated average absolute errors on the order of 2%, 7%, and 4% for the Hot Mix Asphalt (HMA) thickness estimation of full-depth asphalt pavements, full-depth pavements on lime stabilized soils and conventional flexible pavements, respectively. The field validations of SOFTSYS data also produced meaningful results. The thickness data obtained from Ground Penetrating Radar testing matched reasonably well with predictions from SOFTSYS models. The differences observed in the HMA and lime stabilized soil layer thicknesses observed were attributed to deflection data variability from FWD tests. The backcalculated asphalt concrete layer thickness results matched better in the case of full-depth asphalt flexible pavements built on lime stabilized soils compared to conventional flexible pavements. Overall, SOFTSYS was capable of producing reliable thickness estimates despite the variability of field constructed asphalt layer thicknesses.

Rutting performance of asphalt pavements

Cold in-place recycling (CIR) and cold central plant recycling (CCPR) of asphalt concrete (AC) and/or full-depth reclamation (FDR) of AC and aggregate base are faster and less costly rehabilitation alternatives to conventional reconstruction for structurally distressed pavements. This study examines 26 different rehabilitation projects across the USA and Canada. Field cores from these projects were tested for dynamic modulus and repeated load permanent deformation. These structural characteristics are compared to reference values for hot mix asphalt (HMA). A rutting sensitivity analysis was performed on two rehabilitation scenarios with recycled and conventional HMA structural overlays in different climatic conditions using the Mechanistic Empirical Pavement Design (MEPDG). The cold-recycled scenarios exhibited performance similar to that of HMA overlays for most cases. The exceptions were the cases with thin HMA wearing courses and/or very poor cold-recycled material quality. The overall conclusion is that properly designed CIR/FDR/CCPR cold-recycled materials are a viable alternative to virgin HMA materials.

FDOT District Six Pedestrian Safety Web GIS Application

A group of four applications including Top 20 Pedestrian Crash Locations: This application is designed to display top 20 pedestrian crash locations into both map- view and detailed information view. FDOT Crash Reporting Tool: This application is designed to simplify the usage and sharing of CAR data. The application can load raw data from CAR and display it into a web map interface. FDOT Online Document Portal: This application is designed for FDOT project managers to be able to share and manage documents through a user friendly, GIS enable web interface GIS Data Collection for Pedestrian Safety Tool: FIU-GIS Center was responsible for data collection and processing work for the project of Pedestrian Safety Tool Project. The outcome of this task is present by a simple web-GIS application design to host GIS by projects.

Retail centers for community : addressing both pedestrian and car traffic

The purpose of this thesis was to redesign a commercial center in Miami, Florida in a manner that incorporates the needs of pedestrians as well as the automobile. In my research, I studied projects that had been successful at integrating cars in retail design. I applied the strategies learned from this research to the design of a center that creates a positive interaction of pedestrian and car traffic, addressing the needs of the surrounding community. I designed a master plan that includes a mix of residential, retail, commercial and parking space. The parking is designed so that the retail center is not dominated by surface parking. Rather, the automobile is introduced into the different layers of the proposed buildings. The design focused on connecting pedestrian plazas and parking areas beneath them through the introduction of light and greenery. The findings show how a shopping center might transform the area around it by including spaces for residential, civic, cultural and social functions, as well as for the automotive infrastructure that make those functions possible.

Effects of truck traffic on top-down fatigue cracking performance of flexible pavements using a new mechanics-based analysis framework

The mechanics-based analysis framework predicts top-down fatigue cracking initiation time in asphalt concrete pavements by utilising fracture mechanics and mixture morphology-based property. To reduce the level of complexity involved, traffic data were characterised and incorporated into the framework using the equivalent single axle load (ESAL) approach. There is a concern that this kind of simplistic traffic characterisation might result in erroneous performance predictions and pavement structural designs. This paper integrates axle load spectra and other traffic characterisation parameters into the mechanics-based analysis framework and studies the impact these traffic characterisation parameters have on predicted fatigue cracking performance. The traffic characterisation inputs studied are traffic growth rate, axle load spectra, lateral wheel wander and volume adjustment factors. For this purpose, a traffic integration approach which incorporates Monte Carlo simulation and representative traffic characterisation inputs was developed. The significance of these traffic characterisation parameters was established by evaluating a number of field pavement sections. It is evident from the results that all the traffic characterisation parameters except truck wheel wander have been observed to have significant influence on predicted top-down fatigue cracking performance.

A crowd of pedestrian dynamics – the perspective of physics.

Walking is the most basic form of transportation. A good understanding of pedestrian’s dynamics is essential in meeting the mobility and accessibility needs of people by providing a safe and quick walking flow. Advances in the dynamics of pedestrians in crowds are of great theoretical and practical interest, as they lead to new insights regarding the planning of pedestrian facilities, crowd management, or evacuation analysis. As a physicist, I would like to put forward some additional theoretical and practical contributions that could be interesting to explore, regarding the perspective of physics on about human crowd dynamics (panic as a specific form of behavior excluded).