Super-resolved faces for improved face recognition from surveillance video advances in biometrics

Characteristics of surveillance video generally include low resolution and poor quality due to environmental, storage and processing limitations. It is extremely difficult for computers and human operators to identify individuals from these videos. To overcome this problem, super-resolution can be used in conjunction with an automated face recognition system to enhance the spatial resolution of video frames containing the subject and narrow down the number of manual verifications performed by the human operator by presenting a list of most likely candidates from the database. As the super-resolution reconstruction process is ill-posed, visual artifacts are often generated as a result. These artifacts can be visually distracting to humans and/or affect machine recognition algorithms. While it is intuitive that higher resolution should lead to improved recognition accuracy, the effects of super-resolution and such artifacts on face recognition performance have not been systematically studied. This paper aims to address this gap while illustrating that super-resolution allows more accurate identification of individuals from low-resolution surveillance footage. The proposed optical flow-based super-resolution method is benchmarked against Baker et al.’s hallucination and Schultz et al.’s super-resolution techniques on images from the Terrascope and XM2VTS databases. Ground truth and interpolated images were also tested to provide a baseline for comparison. Results show that a suitable super-resolution system can improve the discriminability of surveillance video and enhance face recognition accuracy. The experiments also show that Schultz et al.’s method fails when dealing surveillance footage due to its assumption of rigid objects in the scene. The hallucination and optical flow-based methods performed comparably, with the optical flow-based method producing less visually distracting artifacts that interfered with human recognition.

Activity modelling in crowded environments : a soft decision approach

Probabilistic topic models have recently been used for activity analysis in video processing, due to their strong capacity to model both local activities and interactions in crowded scenes. In those applications, a video sequence is divided into a collection of uniform non-overlaping video clips, and the high dimensional continuous inputs are quantized into a bag of discrete visual words. The hard division of video clips, and hard assignment of visual words leads to problems when an activity is split over multiple clips, or the most appropriate visual word for quantization is unclear. In this paper, we propose a novel algorithm, which makes use of a soft histogram technique to compensate for the loss of information in the quantization process; and a soft cut technique in the temporal domain to overcome problems caused by separating an activity into two video clips. In the detection process, we also apply a soft decision strategy to detect unusual events.We show that the proposed soft decision approach outperforms its hard decision counterpart in both local and global activity modelling.

Noninvasive in vivo assessment of soft contact lens type on tear film surface quality

To evaluate the effect of soft contact lens type on the in vivo tear film surface quality (TFSQ) on daily disposable lenses and to establish whether two recently developed techniques for noninvasive measurement of TFSQ can distinguish between different contact lens types.

Tear film surface quality with rigid and soft contact lenses

Objectives: To measure tear film surface quality (TFSQ) using dynamic high-speed videokeratoscopy during short-term (8 hours) use of rigid and soft contact lenses. Methods: A group of fourteen subjects wore 3 different types of contact lenses on 3 different non-consecutive days (order randomized) in one eye only. Subjects were screened to exclude those with dry eye. The lenses included a PMMA hard, an RGP (Boston XO) and a soft silicone hydrogel lens. Three 30 second long high speed videokeratoscopy recordings were taken with contact lenses in-situ, in the morning and again after 8 hours of contact lens wear, both in normal and suppressed blinking conditions. Recordings were also made on a baseline day with no contact lens wear. Results: The presence of a contact lens in the eye had a significant effect on the mean TFSQ in both natural and suppressed blinking conditions (p=0.001 and p=0.01 respectively, repeated measures ANOVA). TFSQ was worse with all the lenses compared to no lens in the eye (in the afternoon during both normal and suppressed blinking conditions (all p<0.05). In natural blinking conditions, the mean TFSQ for the PMMA and RGP lenses was significantly worse than the baseline day (no lens) for both morning and afternoon measures (p<0.05). Conclusions: This study shows that both rigid and soft contact lenses adversely affect the TFSQ in both natural and suppressed blinking conditions. No significant differences were found between the lens types and materials. Keywords: Tear film surface quality, rigid contact lens, soft contact lens, dynamic high-speed videokeratoscopy

Towards determining soft tissue properties for modelling spine surgery : current progress and challenges

Current complication rates for adolescent scoliosis surgery necessitate the development of better surgical planning tools to improve outcomes. Here we present our approach to developing finite element models of the thoracolumbar spine for deformity surgery simulation, with patient-specific model anatomy based on low-dose pre-operative computed tomography scans. In a first step towards defining patient-specific tissue properties, an initial 'benchmark' set of properties were used to simulate a clinically performed pre-operative spinal flexibility assessment, the fulcrum bending radiograph. Clinical data for ten patients were compared with the simulated results for this assessment and in cases where these data differed by more than 10%, soft tissue properties for the costo-vertebral joint (CVJt) were altered to achieve better agreement. Results from these analyses showed that changing the CVJt stiffness resulted in acceptable agreement between clinical and simulated flexibility in two of the six cases. In light of these results and those of our previous studies in this area, it is suggested that spinal flexibility in the fulcrum bending test is not governed by any single soft tissue structure acting in isolation. More detailed biomechanical characterisation of the fulcrum bending test is required to provide better data for determination of patient-specific soft tissue properties.

Using optical coherence tomography to assess corneoscleral morphology after soft contact lens wear

Purpose. To evaluate the use of optical coherence tomography (OCT) to assess the effect of different soft contact lenses on corneoscleral morphology. Methods. Ten subjects had anterior segment OCT B-scans taken in the morning and again after six hours of soft contact lens wear. For each subject, three different contact lenses were used in the right eye on non-consecutive days, including a hydrogel sphere, a silicone hydrogel sphere and a silicone hydrogel toric. After image registration and layer segmentation, analyses were performed of the first hyper-reflective layer (HRL), the epithelial basement membrane (EBL) and the epithelial thickness (HRL to EBL). A root mean square difference (RMSD) of the layer profiles and the thickness change between the morning and afternoon measurements, was used to assess the effect of the contact lens on the corneoscleral morphology. Results. The soft contact lenses had a statistically significant effect on the morphology of the anterior segment layers (p <0.001). The average amounts of change for the three lenses (average RMSD values) for the corneal region were lower (3.93±1.95 µm for the HRL and 4.02±2.14 µm for the EBL) than those measured in the limbal/scleral region (11.24±6.21 µm for the HRL and 12.61±6.42 µm for the EBL). Similarly, averaged across the three lenses, the RMSD in epithelial thickness was lower in the cornea (2.84±0.84 µm) than the limbal/scleral (5.47±1.71 µm) region. Post-hoc analysis showed that ocular surface changes were significantly smaller with the silicone hydrogel sphere lens than both the silicone hydrogel toric (p<0.005) and hydrogel sphere (p<0.02) for the combined HRL and EBL data. Conclusions. In this preliminary study, we have shown that soft contact lenses can produce small but significant changes in the morphology of the limbal/scleral region and that OCT technology is useful in assessing these changes. The clinical significance of these changes is yet to be determined.

Do thermal agents affect range of movement and mechanical properties in soft tissues? A systematic review

OBJECTIVES: To examine the effect of thermal agents on the range of movement (ROM) and mechanical properties in soft tissue and to discuss their clinical relevance. DATA SOURCES: Electronic databases (Cochrane Central Register of Controlled Trials, MEDLINE, and EMBASE) were searched from their earliest available record up to May 2011 using Medical Subjects Headings and key words. We also undertook related articles searches and read reference lists of all incoming articles. STUDY SELECTION: Studies involving human participants describing the effects of thermal interventions on ROM and/or mechanical properties in soft tissue. Two reviewers independently screened studies against eligibility criteria. DATA EXTRACTION: Data were extracted independently by 2 review authors using a customized form. Methodologic quality was also assessed by 2 authors independently, using the Cochrane risk of bias tool. DATA SYNTHESIS: Thirty-six studies, comprising a total of 1301 healthy participants, satisfied the inclusion criteria. There was a high risk of bias across all studies. Meta-analyses were not undertaken because of clinical heterogeneity; however, effect sizes were calculated. There were conflicting data on the effect of cold on joint ROM, accessory joint movement, and passive stiffness. There was limited evidence to determine whether acute cold applications enhance the effects of stretching, and further evidence is required. There was evidence that heat increases ROM, and a combination of heat and stretching is more effective than stretching alone. CONCLUSIONS: Heat is an effective adjunct to developmental and therapeutic stretching techniques and should be the treatment of choice for enhancing ROM in a clinical or sporting setting. The effects of heat or ice on other important mechanical properties (eg, passive stiffness) remain equivocal and should be the focus of future study.

Identity theft, computers and behavioral biometrics

The increase of online services, such as eBanks, WebMails, in which users are verified by a username and password, is increasingly exploited by Identity Theft procedures. Identity Theft is a fraud, in which someone pretends to be someone else is order to steal money or get other benefits. To overcome the problem of Identity Theft an additional security layer is required. Within the last decades the option of verifying users based on their keystroke dynamics was proposed during login verification. Thus, the imposter has to be able to type in a similar way to the real user in addition to having the username and password. However, verifying users upon login is not enough, since a logged station/mobile is vulnerable for imposters when the user leaves her machine. Thus, verifying users continuously based on their activities is required. Within the last decade there is a growing interest and use of biometrics tools, however, these are often costly and require additional hardware. Behavioral biometrics, in which users are verified, based on their keyboard and mouse activities, present potentially a good solution. In this paper we discuss the problem of Identity Theft and propose behavioral biometrics as a solution. We survey existing studies and list the challenges and propose solutions.

A generic framework and runtime environment for development and evaluation of behavioral biometrics solutions

Increasing use of computerized systems in our daily lives creates new adversarial opportunities for which complex mechanisms are exploited to mend the rapid development of new attacks. Behavioral Biometrics appear as one of the promising response to these attacks. But it is a relatively new research area, specific frameworks for evaluation and development of behavioral biometrics solutions could not be found yet. In this paper we present a conception of a generic framework and runtime environment which will enable researchers to develop, evaluate and compare their behavioral biometrics solutions with repeatable experiments under the same conditions with the same data.