Multi-spectral fusion for surveillance systems

Surveillance systems such as object tracking and abandoned object detection systems typically rely on a single modality of colour video for their input. These systems work well in controlled conditions but often fail when low lighting, shadowing, smoke, dust or unstable backgrounds are present, or when the objects of interest are a similar colour to the background. Thermal images are not affected by lighting changes or shadowing, and are not overtly affected by smoke, dust or unstable backgrounds. However, thermal images lack colour information which makes distinguishing between different people or objects of interest within the same scene difficult. ----- By using modalities from both the visible and thermal infrared spectra, we are able to obtain more information from a scene and overcome the problems associated with using either modality individually. We evaluate four approaches for fusing visual and thermal images for use in a person tracking system (two early fusion methods, one mid fusion and one late fusion method), in order to determine the most appropriate method for fusing multiple modalities. We also evaluate two of these approaches for use in abandoned object detection, and propose an abandoned object detection routine that utilises multiple modalities. To aid in the tracking and fusion of the modalities we propose a modified condensation filter that can dynamically change the particle count and features used according to the needs of the system. ----- We compare tracking and abandoned object detection performance for the proposed fusion schemes and the visual and thermal domains on their own. Testing is conducted using the OTCBVS database to evaluate object tracking, and data captured in-house to evaluate the abandoned object detection. Our results show that significant improvement can be achieved, and that a middle fusion scheme is most effective.

Multi-modal object tracking using dynamic performance metrics

Intelligent surveillance systems typically use a single visual spectrum modality for their input. These systems work well in controlled conditions, but often fail when lighting is poor, or environmental effects such as shadows, dust or smoke are present. Thermal spectrum imagery is not as susceptible to environmental effects, however thermal imaging sensors are more sensitive to noise and they are only gray scale, making distinguishing between objects difficult. Several approaches to combining the visual and thermal modalities have been proposed, however they are limited by assuming that both modalities are perfuming equally well. When one modality fails, existing approaches are unable to detect the drop in performance and disregard the under performing modality. In this paper, a novel middle fusion approach for combining visual and thermal spectrum images for object tracking is proposed. Motion and object detection is performed on each modality and the object detection results for each modality are fused base on the current performance of each modality. Modality performance is determined by comparing the number of objects tracked by the system with the number detected by each mode, with a small allowance made for objects entering and exiting the scene. The tracking performance of the proposed fusion scheme is compared with performance of the visual and thermal modes individually, and a baseline middle fusion scheme. Improvement in tracking performance using the proposed fusion approach is demonstrated. The proposed approach is also shown to be able to detect the failure of an individual modality and disregard its results, ensuring performance is not degraded in such situations.

Project 2.7 Leveraging R&D Investment for the Australian built environment : Phase 2 Case Study Report Part 2 - Road Construction Safety

This report discusses findings of a case study into "Road Construction Safety" undertaken as a part of the retrospective analysis component of Sustainable Built Environment National Research Centre (SBEnrc) Project 2.7 Leveraging R&D investment for the Australian Built Environment. The Queensland Department of Transport and Main Roads (QTMR) has taken a leadership role in developing a safer working environment for road construction workers. In the past decades, a range of initiatives have been introduced to contribute to improved performance in this area. Several initiatives have been undertaken by QTMR as part of their overarching commitment to safety. Three such initiatives form the basis for this case study investigation, in order to better illustrate the nature of R&D investment and its impact on day-to-day operations and the supply chain. These are the development and implementation of: (i) the Mechanical Traffic Aid: (ii) the Thermal Imaging Camera; and (iii) the Trailer-based CCTV (camera). This case study should be read in conjunction with Part 1 of this suite of reports.

Brisbane ~ Tokyo : subtropical lifestyle research

Tokyo-based architectural firm Atelier Bow-Wow's interest in Queensland's timber vernacular housing style can be traced back to 2006. In 2009, the group undertook a study of Brisbane housing types, which forms the basis of this chapter. Atelier Bow-Wow suggested that the study of Brisbane housing types could provide insights into architectural alternatives for Tokyo that might ameliorate the warming "heat island" effect exacerbated by widespread urbanisation. In addition, they examined the veranda of the "Queenslander" as a way of mitigating social isolation in aging population.

The effects of cold air (-110°C) and water (8°C) cryotherapy on knee skin temperature

Exposure to cold air, whole body cryotherapy (WBC), is a novel treatment employed by athletes. In WBC individuals dressed in minimal clothing are exposed to a temperature below -100°C for 2-4 min. The use of WBC has been advocated as a treatment for various knee injuries. PURPOSE: To compare the effects of two modalities of cryotherapy, -110°C WBC and 8°C cold water immersion (CWI) on knee skin temperature (Tsk). METHODS: With ethical approval and written informed consent 10 healthy active male participants (26.5±4.9 yr, 183.5±6.0 cm, 90.7±19.9 kg, 26.8±5.0 kg/m2, 23.0±9.3% body fat (measured by DXA), 7.6 ± 2.0 mm patellar skin fold; mean±SD) were exposed to 4 min of CWI and WBC. The treatment order was randomised in a controlled crossover design, with a minimum of 7 days between treatments. During WBC participants stood in a chamber (-60±3°C) for 20 s before entering the main chamber (-110°C±3°C) where they remained for 3 min and 40 s. For CWI participants were seated in a tank filled with cold water (8±0.3°C) and immersed to the level of the sternum for 4 min. Right knee Tsk was assessed via non-contact, infrared thermal imaging. A quadrilateral region of interest was created using inert markers placed 5 cm above and below the most superior and inferior aspect of the patella. Tsk within this quadrilateral was recorded pre, immediately post and every 10 min thereafter for 60 min. Tsk changes were examined using a two-way (treatment x time) repeated measures analyses of variance. In addition, a paired sample t-test was used to compare baseline Tsk before both treatments. RESULTS: Knee Tsk was similar before treatment (WBC: 29.9±0.7°C, CWI: 29.6±0.9°C, p>0.05). There was a significant main effect for treatment (p<0.05) and time (p<0.001). Compared to baseline, Tsk was significantly reduced (p<0.05) immediately post and at 10, 20, 30, 40, 50 and 60 min after both cooling modalities. Knee Tsk was lower (p<0.05) immediately after WBC (19.0±0.9°C) compared to CWI (20.5±0.6°C). However, from 10 to 60 min post, knee Tsk was lower (p<0.05) following the CWI treatment. CONCLUSION: WBC elicited a greater decrease in knee Tsk compared to CWI immediately after treatment. However, both modalities display different recovery patterns and Tsk after CWI was significantly lower than WBC at 10, 20, 30, 40, 50 and 60 min after treatment.

Effects of whole body cryotherapy and cold water immersion on knee skin temperature

This study sought to a) compare and contrast the effect of 2 commonly used cryotherapy treatments, 4 min of − 110 °C whole body cryotherapy and 8 °C cold water immersion, on knee skin temperature and b) establish whether either protocol was capable of achieving a skin temperature ( < 13 °C) believed to be required for analgesic purposes. After ethics committee approval and written informed consent was obtained, 10 healthy males (26.5 ± 4.9 yr, 183.5 ± 6.0 cm, 90.7 ± 19.9 kg, 26.8 ± 5.0 kg/m 2 , 23.0 ± 9.3 % body fat; mean ± SD) participated in this randomised controlled crossover study. Skin temperature around the patellar region was assessed in both knees via non-contact, infrared thermal imaging and recorded pre-, immediately post-treatment and every 10 min thereafter for 60 min. Compared to baseline, average, minimum and maximum skin temperatures were significantly reduced (p < 0.001) immediately post-treatment and at 10, 20, 30, 40, 50 and 60 min after both cooling modalities. Average and minimum skin temperatures were lower (p < 0.05) immediately after whole body cryotherapy (19.0 ± 0.9 ° C) compared to cold water immersion (20.5 ± 0.6 ° C). However, from 10 to 60 min post, the average, minimum and maximum skin temperatures were lower (p < 0.05) following the cold water treatment. Finally, neither protocol achieved a skin temperature believed to be required to elicit an analgesic effect.

Effect of moisture and temperature distribution on dried food microstructure and porosity

Dehydration of food materials requires water removal from it. This removal of moisture prevents the growth and reproduction of microorganisms that cause decay and minimizes many of the moisture-driven deterioration reactions (Brennan, 1994). However, during food drying, many other changes occur simultaneously resulting in a modified overall quality (Kompany et al., 1993). Among the physical attributes of dried food material porosity and microstructure are the important ones that can dominant other quality of dried foods (Aguilera et al., 2000). In addition, this two concerned quality attributes affected by process conditions, material components and raw structure of food stuff. In this work, temperature moisture distribution within food materials during microwave drying will be taken into consideration to observe its participation on the microstructure and porosity of the finished product. Apple is the selective materials for this work. Generally, most of the food materials are found in non-uniformed moisture contained condition. To develop non uniform temperature distribution, food materials have been dried in a microwave oven with different power levels (Chua et al., 2000). First of all, temperature and moisture model is simulated by COMSOL Multiphysics. Later on, digital imaging camera and Image Pro Premier software have been deployed to observation moisture distribution and thermal imaging camera for temperature distribution. Finally, Microstructure and porosity of the food materials are obtained from scanning electron microscope and porosity measuring devices respectively . Moisture distribution and temperature during drying influence the microstructure and porosity significantly. Specially, High temperature and moisture contained regions show less porosity and more rupture. These findings support other literatures of Halder et al. (2011) and Rahman et al (1990). On the other hand, low temperature and moisture regions depict uniform microstructure and high porosity. This work therefore assists in better understanding of the role of moisture and temperature distribution to a prediction of micro structure and porosity of dried food materials.

Effect of temperature distribution on predicting quality of microwave dehydrated food

During food drying, many other changes occur simultaneously, resulting in an improved overall quality. Among the quality attributes, the structure and its corresponding color influence directly or indirectly other properties of food. In addition, these quality attributes are affected by process conditions, material components and the raw structure of the foodstuff. In this work, the temperature distribution within food materials during microwave drying has been taken into consideration to observe its role in color modification. In order to determine the temperature distribution of microwave-dried food (apple), a thermal imaging camera has been used. The image acquired from the digital camera has been analysed using image J software in order to get the color change of fresh and dried apple. The results show that temperature distribution plays an important role in determining the quality of the food. The thermal imaging camera was deployed to observe the temperature distribution within food materials during drying. It is clearly observed from the higher value of (ERGB =102) and the uneven color change that uneven temperature distribution can influence customer perceptions of the quality of dried food. Simulation of a mathematical model of temperature distribution during microwave drying can make it possible to predict the colour and texture of the microwaved food.

Solar evaporator-collectors : analyses and applications

Taking into consideration of growing energy needs and concern for environmental degradation, clean and inexhaustible energy source, such as solar energy, is receiving greater attention for various applications. The use of solar energy system reduces pollution, waste and has little or no harmful effects on the environment. It is appreciated that this source of energy can be complementary rather than being competitive to conventional energy sources. In order to collect and harness energy from the sun, a solar collector is essential. A solar collector is basically a heat exchanger that transforms solar radiant energy into heat or thermal energy. Improvement of performance is essential for commercial acceptance of their use in such applications. Many studies have been undertaken on the enhancement of thermal performance of solar collectors, using diverse materials of various shapes, dimensions and layouts. In the literature, various collector designs have been proposed and tested with the objective of meeting these requirements [1-8]. Omer et al. [1] found the efficiency of a solar collector of about 70% in a solar assisted heat pump system. Traditional solar collectors are single phase collectors, in which the working fluid is either air or water. Different modifications are suggested and applied to improve the heat transfer between the absorber and working fluid in a collector. These modifications include the use of absorber with fins attached [2,3], corrugated absorber [4,5], matrix type absorber [6], V-groove solar air collector [7]. Karim et al. [8] approached a review of design and construction of three types (flat, vee-grooved, and finned) of air collectors. Two-phase collectors, on the other hand, have significant potential for continuous operation round the clock, when used in conjunction with a compressor, as found in a solar assisted heat-pump cycle.

The effect of using different regions of interest on local and mean skin temperature

The dynamic nature of tissue temperature and the subcutaneous properties, such as blood flow, fatness, and metabolic rate, leads to variation in local skin temperature. Therefore, we investigated the effects of using multiple regions of interest when calculating weighted mean skin temperature from four local sites. Twenty-six healthy males completed a single trial in a thermonetural laboratory (mean ± SD): 24.0 (1.2) °C; 56 (8%) relative humidity; < 0.1 m/s air speed). Mean skin temperature was calculated from four local sites (neck, scapula, hand and shin) in accordance with International Standards using digital infrared thermography. A 50 x 50 mm square, defined by strips of aluminium tape, created six unique regions of interest, top left quadrant, top right quadrant, bottom left quadrant, bottom right quadrant, centre quadrant and the entire region of interest, at each of the local sites. The largest potential error in weighted mean skin temperature was calculated using a combination of a) the coolest and b) the warmest regions of interest at each of the local sites. Significant differences between the six regions interest were observed at the neck (P < 0.01), scapula (P < 0.001) and shin (P < 0.05); but not at the hand (P = 0.482). The largest difference (± SEM) at each site was as follows: neck 0.2 (0.1) °C; scapula 0.2 (0.0) °C; shin 0.1 (0.0) °C and hand 0.1 (0.1) °C. The largest potential error (mean ± SD) in weighted mean skin temperature was 0.4 (0.1) °C (P < 0.001) and the associated 95% limits of agreement for these differences was 0.2 to 0.5 °C. Although we observed differences in local and mean skin temperature based on the region of interest employed, these differences were minimal and are not considered physiologically meaningful.

Can perceptual indices estimate physiological strain across a range of environments and metabolic workloads when wearing explosive ordnance disposal and chemical protective clothing?

Objective Explosive ordnance disposal (EOD) often requires technicians to wear multiple protective garments in challenging environmental conditions. The accumulative effect of increased metabolic cost coupled with decreased heat dissipation associated with these garments predisposes technicians to high levels of physiological strain. It has been proposed that a perceptual strain index (PeSI) using subjective ratings of thermal sensation and perceived exertion as surrogate measures of core body temperature and heart rate, may provide an accurate estimation of physiological strain. Therefore, this study aimed to determine if the PeSI could estimate the physiological strain index (PSI) across a range of metabolic workloads and environments while wearing heavy EOD and chemical protective clothing. Methods Eleven healthy males wore an EOD and chemical protective ensemble while walking on a treadmill at 2.5, 4 and 5.5 km·h− 1 at 1% grade in environmental conditions equivalent to wet bulb globe temperature (WBGT) 21, 30 and 37 °C. WBGT conditions were randomly presented and a maximum of three randomised treadmill walking trials were completed in a single testing day. Trials were ceased at a maximum of 60-min or until the attainment of termination criteria. A Pearson's correlation coefficient, mixed linear model, absolute agreement and receiver operating characteristic (ROC) curves were used to determine the relationship between the PeSI and PSI. Results A significant moderate relationship between the PeSI and the PSI was observed [r = 0.77; p < 0.001; mean difference = 0.8 ± 1.1 a.u. (modified 95% limits of agreement − 1.3 to 3.0)]. The ROC curves indicated that the PeSI had a good predictive power when used with two, single-threshold cut-offs to differentiate between low and high levels of physiological strain (area under curve: PSI three cut-off = 0.936 and seven cut-off = 0.841). Conclusions These findings support the use of the PeSI for monitoring physiological strain while wearing EOD and chemical protective clothing. However, future research is needed to confirm the validity of the PeSI for active EOD technicians operating in the field.

Unmanned Aerial Vehicles (UAVs) and artificial intelligence revolutionizing wildlife monitoring and conservation

Surveying threatened and invasive species to obtain accurate population estimates is an important but challenging task that requires a considerable investment in time and resources. Estimates using existing ground-based monitoring techniques, such as camera traps and surveys performed on foot, are known to be resource intensive, potentially inaccurate and imprecise, and difficult to validate. Recent developments in unmanned aerial vehicles (UAV), artificial intelligence and miniaturized thermal imaging systems represent a new opportunity for wildlife experts to inexpensively survey relatively large areas. The system presented in this paper includes thermal image acquisition as well as a video processing pipeline to perform object detection, classification and tracking of wildlife in forest or open areas. The system is tested on thermal video data from ground based and test flight footage, and is found to be able to detect all the target wildlife located in the surveyed area. The system is flexible in that the user can readily define the types of objects to classify and the object characteristics that should be considered during classification.

Numerical modelling of non-load bearing light gauge cold-formed steel frame walls under fire conditions

Recently an innovative composite panel system was developed, where a thin insulation layer was used externally between two plasterboards to improve the fire performance of light gauge cold-formed steel frame walls. In this research, finite-element thermal models of both the traditional light gauge cold-formed steel frame wall panels with cavity insulation and the new light gauge cold-formed steel frame composite wall panels were developed to simulate their thermal behaviour under standard and realistic fire conditions. Suitable apparent thermal properties of gypsum plasterboard, insulation materials and steel were proposed and used. The developed models were then validated by comparing their results with available fire test results. This article presents the details of the developed finite-element models of small-scale non-load-bearing light gauge cold-formed steel frame wall panels and the results of the thermal analysis. It has been shown that accurate finite-element models can be used to simulate the thermal behaviour of small-scale light gauge cold-formed steel frame walls with varying configurations of insulations and plasterboards. The numerical results show that the use of cavity insulation was detrimental to the fire rating of light gauge cold-formed steel frame walls, while the use of external insulation offered superior thermal protection to them. The effects of real fire conditions are also presented.