Illumination-invariant face recognition from a single image across extreme pose using a dual dimension AAM ensemble in the thermal infrared spectrum

Over the course of the last decade, infrared (IR) and particularly thermal IR imaging based face recognition has emerged as a promising complement to conventional, visible spectrum based approaches which continue to struggle when applied in practice. While inherently insensitive to visible spectrum illumination changes, IR data introduces specific challenges of its own, most notably sensitivity to factors which affect facial heat emission patterns, e.g. emotional state, ambient temperature, and alcohol intake. In addition, facial expression and pose changes are more difficult to correct in IR images because they are less rich in high frequency detail which is an important cue for fitting any deformable model. In this paper we describe a novel method which addresses these major challenges. Specifically, when comparing two thermal IR images of faces, we mutually normalize their poses and facial expressions by using an active appearance model (AAM) to generate synthetic images of the two faces with a neutral facial expression and in the same view (the average of the two input views). This is achieved by piecewise affine warping which follows AAM fitting. A major contribution of our work is the use of an AAM ensemble in which each AAM is specialized to a particular range of poses and a particular region of the thermal IR face space. Combined with the contributions from our previous work which addressed the problem of reliable AAM fitting in the thermal IR spectrum, and the development of a person-specific representation robust to transient changes in the pattern of facial temperature emissions, the proposed ensemble framework accurately matches faces across the full range of yaw from frontal to profile, even in the presence of scale variation (e.g. due to the varying distance of a subject from the camera). The effectiveness of the proposed approach is demonstrated on the largest public database of thermal IR images of faces and a newly acquired data set of thermal IR motion videos. Our approach achieved perfect recognition performance on both data sets, significantly outperforming the current state of the art methods even when they are trained with multiple images spanning a range of head views.

Vesselness features and the inverse compositional AAM for robust face recognition using thermal IR

Over the course of the last decade, infrared (IR) and particularly thermal IR imaging based face recognition has emerged as a promising complement to conventional, visible spectrum based approaches which continue to struggle when applied in the real world. While inherently insensitive to visible spectrum illumination changes, IR images introduce specific challenges of their own, most notably sensitivity to factors which affect facial heat emission patterns, e.g. emotional state, ambient temperature, and alcohol intake. In addition, facial expression and pose changes are more difficult to correct in IR images because they are less rich in high frequency detail which is an important cue for fitting any deformable model. In this paper we describe a novel method which addresses these major challenges. Specifically, to normalize for pose and facial expression changes we generate a synthetic frontal image of a face in a canonical, neutral facial expression from an image of the face in an arbitrary pose and facial expression. This is achieved by piecewise affine warping which follows active appearance model (AAM) fitting. This is the first publication which explores the use of an AAM on thermal IR images; we propose a pre-processing step which enhances detail in thermal images, making AAM convergence faster and more accurate. To overcome the problem of thermal IR image sensitivity to the exact pattern of facial temperature emissions we describe a representation based on reliable anatomical features. In contrast to previous approaches, our representation is not binary; rather, our method accounts for the reliability of the extracted features. This makes the proposed representation much more robust both to pose and scale changes. The effectiveness of the proposed approach is demonstrated on the largest public database of thermal IR images of faces on which it achieved 100% identification rate, significantly outperforming previously described methods

Multiple-object tracking in cluttered and crowded public spaces

This paper addresses the problem of tracking moving objects of variable appearance in challenging scenes rich with features and texture. Reliable tracking is of pivotal importance in surveillance applications. It is made particularly difficult by the nature of objects encountered in such scenes: these too change in appearance and scale, and are often articulated (e.g. humans). We propose a method which uses fast motion detection and segmentation as a constraint for both building appearance models and their robust propagation (matching) in time. The appearance model is based on sets of local appearances automatically clustered using spatio-kinetic similarity, and is updated with each new appearance seen. This integration of all seen appearances of a tracked object makes it extremely resilient to errors caused by occlusion and the lack of permanence of due to low data quality, appearance change or background clutter. These theoretical strengths of our algorithm are empirically demonstrated on two hour long video footage of a busy city marketplace.

Does the presence and mix of destinations influence walking and physical activity?

Background: Local destinations have previously been shown to be associated with higher levels of both physical activity and walking, but little is known about how specific destinations are related to activity. This study examined associations between types and mix of destinations and both walking frequency and physical activity. Method: The sample consisted of 2349 residents of 50 urban areas in metropolitan Melbourne, Australia. Using geographic information systems, seven types of destinations were examined within three network buffers (400 meters (m), 800 m and 1200 m) of respondents' homes. Multilevel logistic regression was used to estimate effects of each destination type separately, as well as destination mix (variety) on: 1) likelihood of walking for at least 10 min ≥ 4/week; 2) likelihood of being sufficiently physically active. All models were adjusted for potential confounders. Results: All destination types were positively associated with walking frequency, and physical activity sufficiency at 1200 m. For the 800 m buffer: all destinations except transport stops and sports facilities were significantly associated with physical activity, while all except sports facilities were associated with walking frequency; at 400 m, café/takeaway food stores and transport stops were associated with walking frequency and physical activity sufficiency, and sports facilities were also associated with walking frequency. Strongest associations for both outcomes were observed for community resources and small food stores at both 800 m and 1200 m. For all buffer distances: greater mix was associated with greater walking frequency. Inclusion of walking in physical activity models led to attenuation of associations. Conclusions: The results of this analysis indicate that there is an association between destinations and both walking frequency and physical activity sufficiency, and that this relationship varies by destination type. It is also clear that greater mix of destinations positively predicts walking frequency and physical activity sufficiency.

A mechanistic study of the intestinal absorption of crypotanshinone, the major active constituent of Saliva miltiorrhiza

The nature of intestinal absorption of most herbal medicine is unknown. Cryptotanshinone (CTS) is the principal active constituent of the widely used cardiovascular herb Salvia miltiorrhiza (Danshen). We investigated the oral bioavailability of CTS in rats and the mechanism for its intestinal absorption using several in vitro and in vivo models:1) Caco-2 cell monolayers; 2) monolayers of MDCKII cells overexpressing P-glycoprotein
(PgP); and 3) single-pass rat intestinal perfusion with mesenteric vein cannulation. The systemic bioavailabilities of CTS after oral and intraperitoneal administration at 100 mg/kg were 2.05 and 10.60%, respectively. In the perfused rat intestinal model, permeability coefficients based on CTS disappearance from the luminal perfusate (P_lumen) were 6.7- to 10.3-fold higher than permeability coefficients based on drug appearance in venous blood (P_blood). P_blood significantly increased in the presence of the P-gP inhibitor, verapamil. CTS transport across Caco-2 monolayers was pH-, temperature- and ATP-dependent. The transport from the apical (AP) to the basolateral (BL) side was 3- to 9-fold lower than that from the BL to the AP side. Inclusion of verapamil (50 µM) in both AP and BL sides abolished the polarized CTS transport across Caco-2 cells. Moreover, CTS was significantly more permeable in the BL to AP than in the AP to BL direction in MDCKII and MDR1-MDCKII cells. The permeability coefficients in the BL to AP direction were significantly higher in MDCKII cells overexpressing PgP. These findings indicate that CTS is a substrate for PgP that can pump CTS into the luminal side.

Hypothesis verification using parametric models and active vision strategies

This paper proposes a methodology for determining the shape and ultimately the functionality of objects from intensity images; 2D analytic functions are used to track 3D features during known camera motions. Three analytic functions are proposed that describe the relationship between pairs of points that are either stationary or moving depending on whether the points are on occluding boundaries or otherwise. Many of the problems of correspondence are reduced by using foveation, known camera motion, and active vision methods. The three analytic functions are shown to enable hypothesis refinement of the functionality of a number of 3D objects without full 3D information about the shape.

Obtaining functional parametric models using active vision strategies

This paper addresses the problem of determining which 3D shape is present, and more importantly, the dimensions of the shape in a scene. This is performed in an active vision system because it reduces the complexity of the problem through the use of gaze stabilization, choice of foveation point, and selective processing by adaptively processing regions of interest. In our case, only a small number of equations and parameters are needed for each shape and these are incorporated into functional descriptions of the shapes.

Emerging hypothesis verification using function-based geometric models and active vision strategies

This paper describes an investigation into the use of parametric 2D models describing the movement of edges for the determination of possible 3D shape and hence function of an object. An assumption of this research is that the camera can foveate and track particular features. It is argued that simple 2D analytic descriptions of the movement of edges can infer 3D shape while the camera is moved. This uses an advantage of foveation i.e. the problem becomes object centred. The problem of correspondence for numerous edge points is overcome by the use of a tree based representation for the competing hypotheses. Numerous hypothesis are maintained simultaneously and it does not rely on a single kinematic model which assumes constant velocity or acceleration. The numerous advantages of this strategy are described.

Obtaining function models using active vision strategies

This paper addresses the problem of determening which 3D shape is present, and more importantly, the dimensions of the shape within a scene. This is performed in an active vision system because it reduces the complexity of the problem through the use of gaze stabilisation, choice of foveation point and selective processing by adaptively processing regions of interest. In our case only a small number of equations and parameters are needed for each shape. For example, a container has width and height. These are incorporated into functional descriptions of the shapes.

An active stereo vision-based learning approach for robotic tracking, fixating and grasping control

In this paper, an active stereo vision-based learning approach is proposed for a robot to track, fixate and grasp an object in unknown environments. First, the functional mapping relationships between the joint angles of the active stereo vision system and the spatial representations of the object are derived and expressed in a three-dimensional workspace frame. Next, the self-adaptive resonance theory-based neural networks and the feedforward neural networks are used to learn the mapping relationships in a self-organized way. Then, the approach is verified by simulation using the models of an active stereo vision system which is installed in the end-effector of a robot. Finally, the simulation results confirm the effectiveness of the present approach.

Role of P-glycoprotein in the intestinal absorption of tanshinone IIA, a major active ingredient in the root of Salvia miltiorrhiza Bunge

The extracts from the roots of Salvia miltiorrhiza Bunge (Danshen) are widely and traditionally used in the treatment of angina pectoris, acute myocardial infarct, hyperlipidemia and stroke in China and other Asian countries. In this study, we have investigated the role of P-glycoprotein (P-gp) in the intestinal absorption of tanshinone IIA (TSA), a major active constituent of Danshen, using several in vitro and in vivo models. The oral bioavailability of TSA was about 2.9

Role of P-glycoprotein in limiting the brain penetration of glabridin, an active isoflavan from the root of Glycyrrhiza glabra.

Purpose. Glabridin is a major active constituent of Glycyrrhiza glabra which is commonly used in the treatment of cardiovascular and central nervous system (CNS) diseases. Recently, we have found that glabridin is a substrate of P-glycoprotein (PgP/MDR1). This study aimed to investigate the role of PgP in glabridin penetration across the blood–brain barrier (BBB) using several in vitro and in vivo models.
Materials and Methods. Cultured primary rat brain microvascular endothelial cells (RBMVECs) were used in the uptake, efflux and transcellular transport studies. A rat bilateral in situ brain perfusion model was used to investigate the brain distribution of glabridin. The brain and tissue distribution of glabridin in rats with or without coadministered verapamil or quinidine were examined with correction for the tissue residual blood. In addition, the brain distribution of glabridin in mdr1a(-/-) mice was compared with the wild-type mice. Glabridin in various biological matrices was determined by a validated liquid chromatography mass spectrometric method.
Results. The uptake and efflux of glabridin in cultured RBMVECs were ATP-dependent and significantly altered in the presence of a PgP or multi-drug resistance protein (Mrp1/2) inhibitor (e.g. verapamil or MK-571). A polarized transport of glabridin was found in RBMVEC monolayers with
facilitated efflux from the abluminal (BL) to luminal (AP) side. Addition of a PgP or Mrp1/2 inhibitor in both luminal and abluminal sides attenuated the polarized transport across RBMVECs. In a bilateral in situ brain perfusion model, the uptake of glabridin into the cerebrum increased from 0.42 T 0.09% at 1 min to 9.27 T 1.69% (ml/100 g tissue) at 30 min and was significantly greater than that for sucrose. Coperfusion of a PgP or Mrp1/2 inhibitor significantly increased the brain distribution of glabridin by 33.6j142.9%. The rat brain levels of glabridin were only about 27% of plasma levels when corrected by tissue residual blood and it was increased to up to 44% when verapamil or quinidine was coadministered. The area under the brain concentration-time curve (AUC) of glabridin in mdr1a(-/-) mice was 6.0-fold higher than the wild-type mice.
Conclusions. These findings indicate that PgP limits the brain penetration of glabridin through the BBB and PgP may cause drug resistance to glabridin (licorice) therapy for CNS diseases and potential drugglabridin interactions. However, further studies are needed to explore the role of other drug transporters (e.g. Mrp1-4) in restricting the brain penetration of glabridin.

Role of the ATP-binding cassette drug transporters in the intestinal absorption of tanshinone IIB, one of the major active diterpenoids from the root of Salvia miltiorrhiza

There is an increasing use of herbal medicines worldwide, and the extracts from the root of Salvia miltiorrhiza are widely used in the treatment of angina and stroke. In this study, we investigated the mechanism for the intestinal absorption of tanshinone IIB (TSB), a major constituent of S. miltiorrhiza. The oral bioavailability of TSB was about 3% in rats with less proportional increase in its maximum plasma concentration (C_max) and area under the plasma concentration-time curve (AUC) with increasing dosage. The time to C_max (T_max) was prolonged at higher oral dosage. In a single pass rat intestinal perfusion model, the permeability coefficients (P_app) based on TSB disappearance from the lumen (P_lumen) were 6.2- to 7.2-fold higher (p < 0.01) than those based on drug appearance in mesenteric venous blood (P_blood). The uptake and efflux of TSB in Caco-2 cells were also significantly altered in the presence of an inhibitor for P-glycoprotein (PgP) or for multi-drug resistance associated protein (MRP1/2). TSB transport from the apical (AP) to basolateral (BL) side in Caco-2 monolayers was 3.3- to 5.7-fold lower than that from BL to AP side, but this polarized transport was attenuated by co-incubation of PgP or MRP1/2 inhibitors. The P_app values of TSB in the BL-AP direction were significantly higher in MDCKII cells over-expressing MDR1 or MRP1, but not in cells over-expressing MRP2-5, as compared with the wild-type cells. The plasma AUC_0-24hr in mdr1a and mrp1 gene-deficient mice was 10.2- to 1.7-fold higher than that in the wild-type mice. Furthermore, TSB significantly inhibited the uptake of digoxin and vinblastine in membrane vesicles containing PgP or MRP1. TSB also moderately stimulated PgP ATPase activity. Taken collectively, our findings indicate that TSB is a substrate for PgP and MRP1 and that drug resistance to TSB therapy and drug interactions may occur through PgP and MRP1 modulation.