Semantic feature-based visual attention model for pedestrian detection

Objective
Pedestrian detection under video surveillance systems has always been a hot topic in computer vision research. These systems are widely used in train stations, airports, large commercial plazas, and other public places. However, pedestrian detection remains difficult because of complex backgrounds. Given its development in recent years, the visual attention mechanism has attracted increasing attention in object detection and tracking research, and previous studies have achieved substantial progress and breakthroughs. We propose a novel pedestrian detection method based on the semantic features under the visual attention mechanism.
Method
The proposed semantic feature-based visual attention model is a spatial-temporal model that consists of two parts: the static visual attention model and the motion visual attention model. The static visual attention model in the spatial domain is constructed by combining bottom-up with top-down attention guidance. Based on the characteristics of pedestrians, the bottom-up visual attention model of Itti is improved by intensifying the orientation vectors of elementary visual features to make the visual saliency map suitable for pedestrian detection. In terms of pedestrian attributes, skin color is selected as a semantic feature for pedestrian detection. The regional and Gaussian models are adopted to construct the skin color model. Skin feature-based visual attention guidance is then proposed to complete the top-down process. The bottom-up and top-down visual attentions are linearly combined using the proper weights obtained from experiments to construct the static visual attention model in the spatial domain. The spatial-temporal visual attention model is then constructed via the motion features in the temporal domain. Based on the static visual attention model in the spatial domain, the frame difference method is combined with optical flowing to detect motion vectors. Filtering is applied to process the field of motion vectors. The saliency of motion vectors can be evaluated via motion entropy to make the selected motion feature more suitable for the spatial-temporal visual attention model.
Result
Standard datasets and practical videos are selected for the experiments. The experiments are performed on a MATLAB R2012a platform. The experimental results show that our spatial-temporal visual attention model demonstrates favorable robustness under various scenes, including indoor train station surveillance videos and outdoor scenes with swaying leaves. Our proposed model outperforms the visual attention model of Itti, the graph-based visual saliency model, the phase spectrum of quaternion Fourier transform model, and the motion channel model of Liu in terms of pedestrian detection. The proposed model achieves a 93% accuracy rate on the test video.
Conclusion
This paper proposes a novel pedestrian method based on the visual attention mechanism. A spatial-temporal visual attention model that uses low-level and semantic features is proposed to calculate the saliency map. Based on this model, the pedestrian targets can be detected through focus of attention shifts. The experimental results verify the effectiveness of the proposed attention model for detecting pedestrians.

A simple approach to the supernova progenitor–explosion connection

We present a new approach to understand the landscape of supernova explosion energies, ejected nickel masses, and neutron star birth masses. In contrast to other recent parametric approaches, our model predicts the properties of neutrino-driven explosions based on the pre-collapse stellar structure without the need for hydrodynamic simulations. The model is based on physically motivated scaling laws and simple differential equations describing the shock propagation, the contraction of the neutron star, the neutrino emission, the heating conditions, and the explosion energetics. Using model parameters compatible with multi-D simulations and a fine grid of thousands of supernova progenitors, we obtain a variegated landscape of neutron star and black hole formation similar to other parametrized approaches and find good agreement with semi-empirical measures for the ‘explodability’ of massive stars. Our predicted explosion properties largely conform to observed correlations between the nickel mass and explosion energy. Accounting for the coexistence of outflows and downflows during the explosion phase, we naturally obtain a positive correlation between explosion energy and ejecta mass. These correlations are relatively robust against parameter variations, but our results suggest that there is considerable leeway in parametric models to widen or narrow the mass ranges for black hole and neutron star formation and to scale explosion energies up or down. Our model is currently limited to an all-or-nothing treatment of fallback and there remain some minor discrepancies between model predictions and observational constraints.

Projected equations of motion approach to hybrid quantum/classical dynamics in dielectric-metal composites

We introduce a hybrid method for dielectric-metal composites that describes the dynamics of the metallic system classically whilst retaining a quantum description of the dielectric. The time-dependent dipole moment of the classical system is mimicked by the introduction of projected equations of motion (PEOM) and the coupling between the two systems is achieved through an effective dipole-dipole interaction. To benchmark this method, we model a test system (semiconducting quantum dot-metal nanoparticle hybrid). We begin by examining the energy absorption rate, showing agreement between the PEOM method and the analytical rotating wave approximation (RWA) solution. We then investigate population inversion and show that the PEOM method provides an accurate model for the interaction under ultrashort pulse excitation where the traditional RWA breaks down.