Quality based frame selection for face clustering in news video

Clustering identities in a broadcast video is a useful task to aid in video annotation and retrieval. Quality based frame selection is a crucial task in video face clustering, to both improve the clustering performance and reduce the computational cost. We present a frame work that selects the highest quality frames available in a video to cluster the face. This frame selection technique is based on low level and high level features (face symmetry, sharpness, contrast and brightness) to select the highest quality facial images available in a face sequence for clustering. We also consider the temporal distribution of the faces to ensure that selected faces are taken at times distributed throughout the sequence. Normalized feature scores are fused and frames with high quality scores are used in a Local Gabor Binary Pattern Histogram Sequence based face clustering system. We present a news video database to evaluate the clustering system performance. Experiments on the newly created news database show that the proposed method selects the best quality face images in the video sequence, resulting in improved clustering performance.

Image segmentation and pose estimation of humans in video

This thesis introduces improved techniques towards automatically estimating the pose of humans from video. It examines a complete workflow to estimating pose, from the segmentation of the raw video stream to extract silhouettes, to using the silhouettes in order to determine the relative orientation of parts of the human body. The proposed segmentation algorithms have improved performance and reduced complexity, while the pose estimation shows superior accuracy during difficult cases of self occlusion.

Patron-driven acquisition of online video

Letting the patron choose ebooks has been a successful experience. Why not apply the same purchase model to other formats? This showcase outlines Queensland University of Technology’s experience with a trial of patron driven acquisition (PDA) for online video. The trial commencing in August 2012 provided access to over 700 online videos licensed from Kanopy across a number of discipline areas. As online video publishing is still in the early stages of development, and as the trial is only in the very early stages, it is too early to draw any firm conclusions about the likely suitability of this model for online video selection and acquisition. However, the trial provides some interesting initial comparisons with ebook PDA and existing online video purchase models and prompts further consideration of PDA as a method for online video selection and licensing.

Possible, inevitable or fait accompli? An analysis of streaming video acquisition, acceptance and use in higher education

This paper explores the potential for online video as a mechanism to transform the ways students learn, as measured by research, user experience and usage following surveys and trials of patron-driven acquisition collaboratively undertaken by Queensland University of Technology, La Trobe University and Kanopy.

Non-contact laser-scanning confocal microscopy of the human cornea in vivo

PURPOSE To investigate the utility of using non-contact laser-scanning confocal microscopy (NC-LSCM), compared with the more conventional contact laser-scanning confocal microscopy (C-LSCM), for examining corneal substructures in vivo. METHODS An attempt was made to capture representative images from the tear film and all layers of the cornea of a healthy, 35 year old female, using both NC-LSCM and C-LSCM, on separate days. RESULTS Using NC-LSCM, good quality images were obtained of the tear film, stroma, and a section of endothelium, but the corneal depth of the images of these various substructures could not be ascertained. Using C-LSCM, good quality, full-field images were obtained of the epithelium, subbasal nerve plexus, stroma, and endothelium, and the corneal depth of each of the captured images could be ascertained. CONCLUSIONS NC-LSCM may find general use for clinical examination of the tear film, stroma and endothelium, with the caveat that the depth of stromal images cannot be determined when using this technique. This technique also facilitates image capture of oblique sections of multiple corneal layers. The inability to clearly and consistently image thin corneal substructures - such as the tear film, subbasal nerve plexus and endothelium - is a key limitation of NC-LSCM.

Colloidal drug probe : method development and validation for adhesion force measurement using atomic force microscopy

This study demonstrates a novel technique of preparing drug colloid probes to determine the adhesion force between the drug salbutamol sulphate (SS) and the surfaces of polymer microparticles to be used as carriers for the dispersion of drug particles from a dry powder inhaler (DPI) formulation. Initially model silica probes of approximately 4 μm size, similar to a drug particle used in DPI formulations, were coated with a saturated SS solution with the aid of capillary forces acting between the silica probe and the drug solution. The developed method of ensuring a smooth and uniform layer of SS on the silica probe was validated using X-Ray Photoelectron Spectroscopy (XPS) and Scanning Electron Microscopy (SEM). Using the same technique, silica microspheres preattached on the AFM cantilever were coated with SS. The adhesion forces between the silica probe and drug coated silica (drug probe) and polymer surfaces (hydrophilic and hydrophobic) were determined. Our experimental results showed that the technique for preparing the drug probe was robust and can be used to determine the adhesion force between hydrophilic/hydrophobic drug probe and carrier surfaces to gain a better understanding on drug carrier adhesion forces in DPI formulations.

‘Teachers flipping out’ beyond the online lecture : maximising the educational potential of video

While video is recognised as an important medium for teaching and learning in the digital age, many video resources are not as effective as they might be, because they do not adequately exploit the strengths of the medium. Presented here are some case studies of video learning resources produced for various courses in a university environment. This ongoing project attempts to identify pedagogic strategies for the use of video; learning situations in which video has the most efficacy; and what production techniques can be employed to make effective video learning resources.

Semi-binary based video features for activity representation

Efficient and effective feature detection and representation is an important consideration when processing videos, and a large number of applications such as motion analysis, 3D scene understanding, tracking etc. depend on this. Amongst several feature description methods, local features are becoming increasingly popular for representing videos because of their simplicity and efficiency. While they achieve state-of-the-art performance with low computational complexity, their performance is still too limited for real world applications. Furthermore, rapid increases in the uptake of mobile devices has increased the demand for algorithms that can run with reduced memory and computational requirements. In this paper we propose a semi binary based feature detectordescriptor based on the BRISK detector, which can detect and represent videos with significantly reduced computational requirements, while achieving comparable performance to the state of the art spatio-temporal feature descriptors. First, the BRISK feature detector is applied on a frame by frame basis to detect interest points, then the detected key points are compared against consecutive frames for significant motion. Key points with significant motion are encoded with the BRISK descriptor in the spatial domain and Motion Boundary Histogram in the temporal domain. This descriptor is not only lightweight but also has lower memory requirements because of the binary nature of the BRISK descriptor, allowing the possibility of applications using hand held devices.We evaluate the combination of detectordescriptor performance in the context of action classification with a standard, popular bag-of-features with SVM framework. Experiments are carried out on two popular datasets with varying complexity and we demonstrate comparable performance with other descriptors with reduced computational complexity.

Acceptability-based QoE models for mobile video

Quality of experience (QoE) measures the overall perceived quality of mobile video delivery from subjective user experience and objective system performance. Current QoE computing models have two main limitations: 1) insufficient consideration of the factors influencing QoE, and; 2) limited studies on QoE models for acceptability prediction. In this paper, a set of novel acceptability-based QoE models, denoted as A-QoE, is proposed based on the results of comprehensive user studies on subjective quality acceptance assessments. The models are able to predict users’ acceptability and pleasantness in various mobile video usage scenarios. Statistical regression analysis has been used to build the models with a group of influencing factors as independent predictors, including encoding parameters and bitrate, video content characteristics, and mobile device display resolution. The performance of the proposed A-QoE models has been compared with three well-known objective Video Quality Assessment metrics: PSNR, SSIM and VQM. The proposed A-QoE models have high prediction accuracy and usage flexibility. Future user-centred mobile video delivery systems can benefit from applying the proposed QoE-based management to optimize video coding and quality delivery decisions.

Video analytics for the detection of near-miss incidents on approach to railway level crossings

Recent modelling of socio-economic costs by the Australian railway industry in 2010 has estimated the cost of level crossing accidents to exceed AU$116 million annually. To better understand causal factors that contribute to these accidents, the Cooperative Research Centre for Rail Innovation is running a project entitled Baseline Level Crossing Video. The project aims to improve the recording of level crossing safety data by developing an intelligent system capable of detecting near-miss incidents and capturing quantitative data around these incidents. To detect near-miss events at railway level crossings a video analytics module is being developed to analyse video footage obtained from forward-facing cameras installed on trains. This paper presents a vision base approach for the detection of these near-miss events. The video analytics module is comprised of object detectors and a rail detection algorithm, allowing the distance between a detected object and the rail to be determined. An existing publicly available Histograms of Oriented Gradients (HOG) based object detector algorithm is used to detect various types of vehicles in each video frame. As vehicles are usually seen from a sideway view from the cabin’s perspective, the results of the vehicle detector are verified using an algorithm that can detect the wheels of each detected vehicle. Rail detection is facilitated using a projective transformation of the video, such that the forward-facing view becomes a bird’s eye view. Line Segment Detector is employed as the feature extractor and a sliding window approach is developed to track a pair of rails. Localisation of the vehicles is done by projecting the results of the vehicle and rail detectors on the ground plane allowing the distance between the vehicle and rail to be calculated. The resultant vehicle positions and distance are logged to a database for further analysis. We present preliminary results regarding the performance of a prototype video analytics module on a data set of videos containing more than 30 different railway level crossings. The video data is captured from a journey of a train that has passed through these level crossings.

Corneal confocal microscopy detects early nerve regeneration in diabetic neuropathy after simultaneous pancreas and kidney transplantation

Diabetic neuropathy is associated with increased morbidity and mortality. To date, limited data in subjects with impaired glucose tolerance and diabetes demonstrate nerve fiber repair after intervention. This may reflect a lack of efficacy of the interventions but may also reflect difficulty of the tests currently deployed to adequately assess nerve fiber repair, particularly in short-term studies. Corneal confocal microscopy (CCM) represents a novel noninvasive means to quantify nerve fiber damage and repair. Fifteen type 1 diabetic patients undergoing simultaneous pancreas-kidney transplantation (SPK) underwent detailed assessment of neurologic deficits, quantitative sensory testing (QST), electrophysiology, skin biopsy, corneal sensitivity, and CCM at baseline and at 6 and 12 months after successful SPK. At baseline, diabetic patients had a significant neuropathy compared with control subjects. After successful SPK there was no significant change in neurologic impairment, neurophysiology, QST, corneal sensitivity, and intraepidermal nerve fiber density (IENFD). However, CCM demonstrated significant improvements in corneal nerve fiber density, branch density, and length at 12 months. Normalization of glycemia after SPK shows no significant improvement in neuropathy assessed by the neurologic deficits, QST, electrophysiology, and IENFD. However, CCM shows a significant improvement in nerve morphology, providing a novel noninvasive means to establish early nerve repair that is missed by currently advocated assessment techniques.

In vivo confocal microscopy of the ocular surface : from bench to bedside

In vivo confocal microscopy (IVCM) is an emerging technology that provides minimally invasive, high resolution, steady-state assessment of the ocular surface at the cellular level. Several challenges still remain but, at present, IVCM may be considered a promising technique for clinical diagnosis and management. This mini-review summarizes some key findings in IVCM of the ocular surface, focusing on recent and promising attempts to move “from bench to bedside”. IVCM allows prompt diagnosis, disease course follow-up, and management of potentially blinding atypical forms of infectious processes, such as acanthamoeba and fungal keratitis. This technology has improved our knowledge of corneal alterations and some of the processes that affect the visual outcome after lamellar keratoplasty and excimer keratorefractive surgery. In dry eye disease, IVCM has provided new information on the whole-ocular surface morphofunctional unit. It has also improved understanding of pathophysiologic mechanisms and helped in the assessment of prognosis and treatment. IVCM is particularly useful in the study of corneal nerves, enabling description of the morphology, density, and disease- or surgically induced alterations of nerves, particularly the subbasal nerve plexus. In glaucoma, IVCM constitutes an important aid to evaluate filtering blebs, to better understand the conjunctival wound healing process, and to assess corneal changes induced by topical antiglaucoma medications and their preservatives. IVCM has significantly enhanced our understanding of the ocular response to contact lens wear. It has provided new perspectives at a cellular level on a wide range of contact lens complications, revealing findings that were not previously possible to image in the living human eye. The final section of this mini-review provides a focus on advances in confocal microscopy imaging. These include 2D wide-field mapping, 3D reconstruction of the cornea and automated image analysis.

Talk about a YouTube video in preschool : the mutual production of shared understanding for learning with digital technology

Much of what is written about digital technologies in preschool contexts focuses on young children’s acquisition of skills rather than their meaning-making during use of technologies. In this paper, we consider how the viewing of a YouTube video was used by a teacher and children to produce shared understandings about it. Conversation analysis of talk and interaction during the viewing of the video establishes some of the ways that individual accounts of events were produced for others and then endorsed as shared understandings. The analysis establishes how adults and children made use of verbal and embodied actions during interactions to produce shared understandings of the YouTube video, the events it recorded and written commentary about those events

Repeatability of confocal microscopy measurements on the central and peripheral cornea

Purpose To assess confocal microscopy repeatability (ConfoScan3, Nidek, Italy) when assessing the morphology of the limbus, midperipheral and central cornea. Method The central, mid-peripheral and limbal cornea (temporal and nasal) of the right eye of 8 subjects were examined with a ConfoScan3 in two different visits, at least six months apart. Bland-Altman repeatability was measured for 29 parameters: basal cell density and size, anterior and posterior keratocyte densities (AKD/PKD), endothelial cell density, polymegethism, pleomorphism, mean area and sides of endothelial cells - in the five different corneal areas examined. Results As a percentage of the mean absolute values, repeatability of 0–10% was classified as “excellent”, between 10–30% as “acceptable” and over 30% as “poor”. Repeatability was excellent for 14% of parameters and acceptable for 52% of parameters. The number of endothelial cell sides in the central cornea demonstrated the best repeatability (2.0%) whilst mid-temporal PKD showed the poorest repeatability (53.7%). Conclusions Confocal microscopy is at least an adequately repeatablemethodof evaluating the various corneal layers at different locations. Our dataset supports the ongoing use of the technique in research and clinical practice.

Comparing skin biopsy with confocal microscopy : diagnostic yield of nerve fiber density

Background and aims: The assessment of intra-epidermal nerve fiber density (IENFD) in skin biopsies and corneal nerve fiber density (CNFD) using corneal confocal microscopy (CCM) provides promising techniques to detect small nerve fiber damage in patients with peripheral neuropathy. To help define the clinical utility of each of these techniques in patients with diabetic neuropathy we have assessed sensitivity and specificity of IENFD and CNFD in predicting the following: 1) diabetic polyneuropathy (DPN); 2) risk of foot ulceration (RFU); 3) initial small fiber neuropathy (iSFN); 4) severe small fiber neuropathy (sSFN)...