Robust face recognition with partial occlusion, illumination variation and limited training data by optimal feature selection

This study investigates face recognition with partial occlusion, illumination variation and their combination, assuming no prior information about the mismatch, and limited training data for each person. The authors extend their previous posterior union model (PUM) to give a new method capable of dealing with all these problems. PUM is an approach for selecting the optimal local image features for recognition to improve robustness to partial occlusion. The extension is in two stages. First, authors extend PUM from a probability-based formulation to a similarity-based formulation, so that it operates with as little as one single training sample to offer robustness to partial occlusion. Second, they extend this new formulation to make it robust to illumination variation, and to combined illumination variation and partial occlusion, by a novel combination of multicondition relighting and optimal feature selection. To evaluate the new methods, a number of databases with various simulated and realistic occlusion/illumination mismatches have been used. The results have demonstrated the improved robustness of the new methods.

Bimodal biometric verification based on face and lips

In this paper, we present a novel approach to person verification by fusing face and lip features. Specifically, the face is modeled by the discriminative common vector and the discrete wavelet transform. Our lip features are simple geometric features based on a lip contour, which can be interpreted as multiple spatial widths and heights from a center of mass. In order to combine these features, we consider two simple fusion strategies: data fusion before training and score fusion after training, working with two different face databases. Fusing them together boosts the performance to achieve an equal error rate as low as 0.4% and 0.28%, respectively, confirming that our approach of fusing lips and face is effective and promising.

Predicting community responses to perturbations in the face of imperfect knowledge and network complexity

How best to predict the effects of perturbations to ecological communities has been a long-standing goal for both applied and basic ecology. This quest has recently been revived by new empirical data, new analysis methods, and increased computing speed, with the promise that ecologically important insights may be obtainable from a limited knowledge of community interactions. We use empirically based and simulated networks of varying size and connectance to assess two limitations to predicting perturbation responses in multispecies communities: (1) the inaccuracy by which species interaction strengths are empirically quantified and (2) the indeterminacy of species responses due to indirect effects associated with network size and structure. We find that even modest levels of species richness and connectance (similar to 25 pairwise interactions) impose high requirements for interaction strength estimates because system indeterminacy rapidly overwhelms predictive insights. Nevertheless, even poorly estimated interaction strengths provide greater average predictive certainty than an approach that uses only the sign of each interaction. Our simulations provide guidance in dealing with the trade-offs involved in maximizing the utility of network approaches for predicting dynamics in multispecies communities.

Comparison of teleconsultations and face-to-face consultations:preliminary results of a United Kingdom multicentre teledermatology study

The objective of this multicentre study was to undertake a systematic comparison of face-to-face consultations and teleconsultations performed using low-cost videoconferencing equipment. One hundred and twenty-six patients were enrolled by their general practitioners across three sites. Each patient underwent a teleconsultation with a distant dermatologist followed by a traditional face-to-face consultation with a dermatologist. The main outcome measures were diagnostic concordance rates, management plans and patient and doctor satisfaction. One hundred and fifty-five diagnoses were identified by the face-to-face consultations from the sample of 126 patients. Identical diagnoses were recorded from both types of consultation in 59% of cases. Teledermatology consultations missed a secondary diagnosis in 6% of cases and were unable to make a useful diagnosis in 11% of cases. Wrong diagnoses were made by the teledermatologist in 4% of cases. Dermatologists were able to make a definitive diagnosis by face-to-face consultations in significantly more cases than by teleconsultations (P = 0.001). Where both types of consultation resulted in a single diagnosis there was a high level of agreement (kappa = 0.96, lower 95% confidence limit 0.91-1.00). Overall follow-up rates from both types of consultation were almost identical. Fifty per cent of patients seen could have been managed using a single videoconferenced teleconsultation without any requirement for further specialist intervention. Patients reported high levels of satisfaction with the teleconsultations. General practitioners reported that 75% of the teleconsultations were of educational benefit. This study illustrates the potential of telemedicine to diagnose and manage dermatology cases referred from primary care. Once the problem of image quality has been addressed, further studies will be required to investigate the cost-effectiveness of a teledermatology service and the potential consequences for the provision of dermatological services in the U.K.

Protected area networks and savannah bird biodiversity in the face of climate change and land degradation

The extent to which climate change might diminish the efficacy of protected areas is one of the most pressing conservation questions. Many projections suggest that climate-driven species distribution shifts will leave protected areas impoverished and species inadequately protected while other evidence suggests that intact ecosystems within protected areas will be resilient to change. Here, we tackle this problem empirically. We show how recent changes in distribution of 139 Tanzanian savannah bird species are linked to climate change, protected area status and land degradation. We provide the first evidence of climate-driven range shifts for an African bird community. Our results suggest that the continued maintenance of existing protected areas is an appropriate conservation response to the challenge of climate and environmental change.

A systematic review evaluating the impact of online or blended learning vs. face-to-face learning of clinical skills in undergraduate nurse education.

Aim: To determine whether the use of an online or blended learning paradigm has the potential to enhance the teaching of clinical skills in undergraduate nursing.

Background: The need to adequately support and develop students in clinical skills is now arguably more important than previously considered due to reductions in practice opportunities. Online and blended teaching methods are being developed to try and meet this requirement, but knowledge about their effectiveness in teaching clinical skills is limited.

Design: Mixed methods systematic review, which follows the Joanna Briggs Institute User guide version 5.

Data Sources: Computerized searches of five databases were undertaken for the period 1995-August 2013.

Review Methods: Critical appraisal and data extraction were undertaken using Joanna Briggs Institute tools for experimental/observational studies and interpretative and critical research. A narrative synthesis was used to report results.

Results: Nineteen published papers were identified. Seventeen papers reported on online approaches and only two papers reported on a blended approach. The synthesis of findings focused on the following four areas: performance/clinical skill, knowledge, self-efficacy/clinical confidence and user experience/satisfaction. The e-learning interventions used varied throughout all the studies.

Conclusion: The available evidence suggests that online learning for teaching clinical skills is no less effective than traditional means. Highlighted by this review is the lack of available evidence on the implementation of a blended learning approach to teaching clinical skills in undergraduate nurse education. Further research is required to assess the effectiveness of this teaching methodology.

3D Morphable Model Construction for Robust Ear and Face Recognition

Recent work suggests that the human ear varies significantly between different subjects and can be used for identification. In principle, therefore, using ears in addition to the face within a recognition system could improve accuracy and robustness, particularly for non-frontal views. The paper describes work that investigates this hypothesis using an approach based on the construction of a 3D morphable model of the head and ear. One issue with creating a model that includes the ear is that existing training datasets contain noise and partial occlusion. Rather than exclude these regions manually, a classifier has been developed which automates this process. When combined with a robust registration algorithm the resulting system enables full head morphable models to be constructed efficiently using less constrained datasets. The algorithm has been evaluated using registration consistency, model coverage and minimalism metrics, which together demonstrate the accuracy of the approach. To make it easier to build on this work, the source code has been made available online.

Burkholderia cenocepacia and Salmonella enterica ArnT proteins that transfer 4-amino-4-deoxy-L-arabinose to lipopolysaccharide share membrane topology and functional amino acids

We recently demonstrated that incorporation of 4-amino-4-deoxy-l-arabinose (l-Ara4N) to the lipid A moiety of lipopolysaccharide (LPS) is required for transport of LPS to the outer membrane and viability of the Gram-negative bacterium Burkholderia cenocepacia. ArnT is a membrane protein catalyzing the transfer of l-Ara4N to the LPS molecule at the periplasmic face of the inner membrane, but its topology and mechanism of action are not well characterized. Here, we elucidate the topology of ArnT and identify key amino acids that likely contribute to its enzymatic function. PEGylation assays using a cysteineless version of ArnT support a model of 13 transmembrane helices and a large C-terminal region exposed to the periplasm. The same topological configuration is proposed for the Salmonella enterica serovar Typhimurium ArnT. Four highly conserved periplasmic residues in B. cenocepacia ArnT, tyrosine-43, lysine-69, arginine-254 and glutamic acid-493, were required for activity. Tyrosine-43 and lysine-69 span two highly conserved motifs, 42RYA44 and 66YFEKP70, that are found in ArnT homologues from other species. The same residues in S. enterica ArnT are also needed for function. We propose these aromatic and charged amino acids participate in either undecaprenyl phosphate-l-Ara4N substrate recognition or transfer of l-Ara4N to the LPS.

Largest Matching Areas for Illumination and Occlusion Robust Face Recognition

In this paper, we introduce a novel approach to face recognition which simultaneously tackles three combined challenges: 1) uneven illumination; 2) partial occlusion; and 3) limited training data. The new approach performs lighting normalization, occlusion de-emphasis and finally face recognition, based on finding the largest matching area (LMA) at each point on the face, as opposed to traditional fixed-size local area-based approaches. Robustness is achieved with novel approaches for feature extraction, LMA-based face image comparison and unseen data modeling. On the extended YaleB and AR face databases for face identification, our method using only a single training image per person, outperforms other methods using a single training image, and matches or exceeds methods which require multiple training images. On the labeled faces in the wild face verification database, our method outperforms comparable unsupervised methods. We also show that the new method performs competitively even when the training images are corrupted.

Face Recognition in the Scrambled Domain via Salience-Aware Ensembles of Many Kernels

With the rapid development of internet-of-things (IoT), face scrambling has been proposed for privacy protection during IoT-targeted image/video distribution. Consequently in these IoT applications, biometric verification needs to be carried out in the scrambled domain, presenting significant challenges in face recognition. Since face models become chaotic signals after scrambling/encryption, a typical solution is to utilize traditional data-driven face recognition algorithms. While chaotic pattern recognition is still a challenging task, in this paper we propose a new ensemble approach – Many-Kernel Random Discriminant Analysis (MK-RDA) to discover discriminative patterns from chaotic signals. We also incorporate a salience-aware strategy into the proposed ensemble method to handle chaotic facial patterns in the scrambled domain, where random selections of features are made on semantic components via salience modelling. In our experiments, the proposed MK-RDA was tested rigorously on three human face datasets: the ORL face dataset, the PIE face dataset and the PUBFIG wild face dataset. The experimental results successfully demonstrate that the proposed scheme can effectively handle chaotic signals and significantly improve the recognition accuracy, making our method a promising candidate for secure biometric verification in emerging IoT applications.

Perceções sociais dos portugueses face aos riscos associados às alterações climáticas

O aquecimento do sistema climático é inequívoco e a influência humana é clara. A continuação da emissão de gases com efeito de estufa irá potenciar os impactes das alterações climáticas, representando um compromisso futuro que se perpetuará por vários séculos. As alterações climáticas não proporcionam uma experiência sensorial direta, embora as variações de temperatura e de precipitação e os extremos climáticos de vários tipos poderem ser experienciados. O cidadão comum não se apercebe do que está a acontecer, a menos que ocorram mudanças significativas, no estado normal do tempo para uma determinada época, na região do mundo onde ele vive. Mesmo para os especialistas, o problema só é cognoscível através de uma vasta rede científica, técnica e institucional. O conhecimento, é portanto, transmitido ao público em geral maioritariamente através de representações dos media sobre o discurso produzido pela comunidade científica. O principal objetivo deste trabalho é averiguar a interligação entre o discurso científico, o discurso mediático e as perceções da população portuguesa na temática das alterações climáticas. A metodologia utilizada, para a prossecução do objetivo, num trabalho que cruza o domínio científico da engenharia do ambiente com o das ciências sociais, encontra-se dividida em 3 fases principais: (1) Uma primeira fase onde se realiza uma análise ao discurso científico de produção nacional, com uma análise de conteúdo aos resumos dos artigos científicos, utilizando 884 resumos da base de dados Scopus de 1975 a 2013 com a palavra-chave ‘Climate Change’; (2) Uma segunda fase onde se analisa o conteúdo de notícias de meios de comunicação social portugueses, aplicando uma análise de conteúdo a 4340 notícias veiculadas por 4 órgãos de comunicação social (Correio da Manhã, Público, RTP e TSF) entre 2004 e 2013, utilizando os respetivos motores de busca online com a palavra-chave ‘Alterações Climáticas’; e, (3) uma terceira fase onde se compila a informação dos estudos existentes sobre a população portuguesa, utilizando os dados dos Eurobarómetros que incluem o tema das alterações climáticas de 1982 a 2014. Seguindo uma linha condutora que inclui o discurso científico, o discurso mediático e as perceções sociais, almejou-se uma abrangência do tema das alterações climáticas, investigando a existência do fenómeno e as respetivas causas, as consequências com a análise dos impactes e dos riscos associados a esses impactes e as soluções através de medidas de mitigação e de adaptação. Nos principais resultados emerge a evidência de que a intensidade de crescimento da produção científica nacional não se traduz num crescimento consistente dos índices de noticiabilidade dos órgãos de comunicação social e desde 2010 que o número de dias por ano, sem notícias sobre alterações climáticas, ultrapassa dos 50%. Em consequência, os níveis de informação da população portuguesa sobre as alterações climáticas são sistematicamente inferiores à média europeia. Em Portugal as taxas de pouco ou nulo conhecimento rondam os dois terços de inquiridos. Não obstante o seu caráter contínuo, para que as alterações climáticas se tornem alvo de interesse dos media é necessário que ocorram reuniões políticas, encontros científicos ou outros acontecimentos. A visibilidade alcançada pelos acontecimentos nacionais é muito fraca e os acontecimentos meteorológicos extremos, não são frequentemente relacionados com o fenómeno das alterações climáticas. No seio da comunidade científica portuguesa existe um claro consenso sobre a existência das alterações climáticas e das suas causas antropogénicas. No discurso mediático português não se verifica enviesamento da informação não sendo surpreendente os baixos níveis de ceticismo dos portugueses. A abordagem aos impactes das alterações climáticas, tanto no discurso científico como no discurso mediático, é robusta e em 2014, cerca de sete em dez portugueses afirma que as alterações climáticas são um problema muito sério. Contudo, Portugal apresenta a proporção mais baixa da Europa de respondentes que percepcionam as alterações climáticas como o problema mais grave que o mundo enfrenta. Para estes resultados poderá contribuir a baixa inclusão de termos relacionados com o risco, tanto no discurso científico como no mediático, não ultrapassando os 20%. Tanto o discurso científico como o discurso mediático não estão direcionados para as soluções (mencionando especificamente medidas de mitigação ou medidas de adaptação). A menção às medidas de mitigação e às medidas de adaptação não ultrapassam os 16% no discurso científico e apresentam valores ainda mais baixos no discurso mediático (13%). Em ambos os discursos existe uma clara preferência pela menção às medidas de adaptação em detrimento das medidas de mitigação. Com valores tão baixos na abordagem às soluções das alterações climáticas não surpreendem os também diminutos níveis de responsabilidade que a população portuguesa atribui a si própria no combate às alterações climáticas.

Do people have insight into their face recognition abilities?

Diagnosis of developmental or congenital prosopagnosia (CP) involves self-report of everyday face recognition difficulties, which are corroborated with poor performance on behavioural tests. This approach requires accurate self-evaluation. We examine the extent to which typical adults have insight into their face recognition abilities across four studies involving nearly 300 participants. The studies used five tests of face recognition ability: two that tap into the ability to learn and recognise previously unfamiliar faces (the Cambridge Face Memory Test, CFMT, Duchaine & Nakayama, 2006 and a newly devised test based on the CFMT but where the study phases involve watching short movies rather than viewing static faces – the CFMT-Films) and three that tap face matching (Benton Facial Recognition Test, BFRT, Benton, Sivan, Hamsher, Varney, & Spreen, 1983; and two recently devised sequential face matching tests). Self-reported ability was measured with the 15-item Kennerknecht et al. (2008) questionnaire; two single-item questions assessing face recognition ability; and a new 77-item meta-cognition questionnaire). Overall, we find that adults with typical face recognition abilities have only modest insight into their ability to recognise faces on behavioural tests. In a fifth study, we assess self-reported face recognition ability in people with CP and find that some people who expect to perform poorly on behavioural tests of face recognition do indeed perform poorly. However, it is not yet clear whether individuals within this group of poor performers have greater levels of insight (i.e., into their degree of impairment) than those with more typical levels of performance.

Face matching impairment in developmental prosopagnosia

Developmental prosopagnosia (DP) is commonly referred to as ‘face blindness’, a term that implies a perceptual basis to the condition. However, DP presents as a deficit in face recognition and is diagnosed using memory-based tasks. Here, we test face identification ability in six people with DP, who are severely impaired on face memory tasks, using tasks that do not rely on memory. First, we compared DP to control participants on a standardised test of unfamiliar face matching using facial images taken on the same day and under standardised studio conditions (Glasgow Face Matching Test; GFMT). DP participants did not differ from normative accuracy scores on the GFMT. Second, we tested face matching performance on a test created using images that were sourced from the Internet and so vary substantially due to changes in viewing conditions and in a person’s appearance (Local Heroes Test; LHT). DP participants show significantly poorer matching accuracy on the LHT relative to control participants, for both unfamiliar and familiar face matching. Interestingly, this deficit is specific to ‘match’ trials, suggesting that people with DP may have particular difficulty in matching images of the same person that contain natural day-to-day variations in appearance. We discuss these results in the broader context of individual differences in face matching ability.

Multi-scale keypoints in V1 and face detection

End-stopped cells in cortical area V1, which combine out- puts of complex cells tuned to different orientations, serve to detect line and edge crossings (junctions) and points with a large curvature. In this paper we study the importance of the multi-scale keypoint representa- tion, i.e. retinotopic keypoint maps which are tuned to different spatial frequencies (scale or Level-of-Detail). We show that this representation provides important information for Focus-of-Attention (FoA) and object detection. In particular, we show that hierarchically-structured saliency maps for FoA can be obtained, and that combinations over scales in conjunction with spatial symmetries can lead to face detection through grouping operators that deal with keypoints at the eyes, nose and mouth, especially when non-classical receptive field inhibition is employed. Al- though a face detector can be based on feedforward and feedback loops within area V1, such an operator must be embedded into dorsal and ventral data streams to and from higher areas for obtaining translation-, rotation- and scale-invariant face (object) detection.

Face segregation and recognition by cortical multi-scale line and edge coding

Models of visual perception are based on image representations in cortical area V1 and higher areas which contain many cell layers for feature extraction. Basic simple, complex and end-stopped cells provide input for line, edge and keypoint detection. In this paper we present an improved method for multi-scale line/edge detection based on simple and complex cells. We illustrate the line/edge representation for object reconstruction, and we present models for multi-scale face (object) segregation and recognition that can be embedded into feedforward dorsal and ventral data streams (the “what” and “where” subsystems) with feedback streams from higher areas for obtaining translation, rotation and scale invariance.