The backfilled GEI : a cross-capture modality gait feature for frontal and side-view gait recognition

In this paper, we propose a novel direction for gait recognition research by proposing a new capture-modality independent, appearance-based feature which we call the Back-filled Gait Energy Image (BGEI). It can can be constructed from both frontal depth images, as well as the more commonly used side-view silhouettes, allowing the feature to be applied across these two differing capturing systems using the same enrolled database. To evaluate this new feature, a frontally captured depth-based gait dataset was created containing 37 unique subjects, a subset of which also contained sequences captured from the side. The results demonstrate that the BGEI can effectively be used to identify subjects through their gait across these two differing input devices, achieving rank-1 match rate of 100%, in our experiments. We also compare the BGEI against the GEI and GEV in their respective domains, using the CASIA dataset and our depth dataset, showing that it compares favourably against them. The experiments conducted were performed using a sparse representation based classifier with a locally discriminating input feature space, which show significant improvement in performance over other classifiers used in gait recognition literature, achieving state of the art results with the GEI on the CASIA dataset.

Enabling aircraft emergency landings using active visual site detection

The ability to automate forced landings in an emergency such as engine failure is an essential ability to improve the safety of Unmanned Aerial Vehicles operating in General Aviation airspace. By using active vision to detect safe landing zones below the aircraft, the reliability and safety of such systems is vastly improved by gathering up-to-the-minute information about the ground environment. This paper presents the Site Detection System, a methodology utilising a downward facing camera to analyse the ground environment in both 2D and 3D, detect safe landing sites and characterise them according to size, shape, slope and nearby obstacles. A methodology is presented showing the fusion of landing site detection from 2D imagery with a coarse Digital Elevation Map and dense 3D reconstructions using INS-aided Structure-from-Motion to improve accuracy. Results are presented from an experimental flight showing the precision/recall of landing sites in comparison to a hand-classified ground truth, and improved performance with the integration of 3D analysis from visual Structure-from-Motion.

Evaluation of two-view geometry methods with automatic ground-truth generation

A large number of methods have been published that aim to evaluate various components of multi-view geometry systems. Most of these have focused on the feature extraction, description and matching stages (the visual front end), since geometry computation can be evaluated through simulation. Many data sets are constrained to small scale scenes or planar scenes that are not challenging to new algorithms, or require special equipment. This paper presents a method for automatically generating geometry ground truth and challenging test cases from high spatio-temporal resolution video. The objective of the system is to enable data collection at any physical scale, in any location and in various parts of the electromagnetic spectrum. The data generation process consists of collecting high resolution video, computing accurate sparse 3D reconstruction, video frame culling and down sampling, and test case selection. The evaluation process consists of applying a test 2-view geometry method to every test case and comparing the results to the ground truth. This system facilitates the evaluation of the whole geometry computation process or any part thereof against data compatible with a realistic application. A collection of example data sets and evaluations is included to demonstrate the range of applications of the proposed system.

In vivo confocal microscopy of the ocular surface : from bench to bedside

In vivo confocal microscopy (IVCM) is an emerging technology that provides minimally invasive, high resolution, steady-state assessment of the ocular surface at the cellular level. Several challenges still remain but, at present, IVCM may be considered a promising technique for clinical diagnosis and management. This mini-review summarizes some key findings in IVCM of the ocular surface, focusing on recent and promising attempts to move “from bench to bedside”. IVCM allows prompt diagnosis, disease course follow-up, and management of potentially blinding atypical forms of infectious processes, such as acanthamoeba and fungal keratitis. This technology has improved our knowledge of corneal alterations and some of the processes that affect the visual outcome after lamellar keratoplasty and excimer keratorefractive surgery. In dry eye disease, IVCM has provided new information on the whole-ocular surface morphofunctional unit. It has also improved understanding of pathophysiologic mechanisms and helped in the assessment of prognosis and treatment. IVCM is particularly useful in the study of corneal nerves, enabling description of the morphology, density, and disease- or surgically induced alterations of nerves, particularly the subbasal nerve plexus. In glaucoma, IVCM constitutes an important aid to evaluate filtering blebs, to better understand the conjunctival wound healing process, and to assess corneal changes induced by topical antiglaucoma medications and their preservatives. IVCM has significantly enhanced our understanding of the ocular response to contact lens wear. It has provided new perspectives at a cellular level on a wide range of contact lens complications, revealing findings that were not previously possible to image in the living human eye. The final section of this mini-review provides a focus on advances in confocal microscopy imaging. These include 2D wide-field mapping, 3D reconstruction of the cornea and automated image analysis.

Outdoor flight testing of a pole inspection UAV incorporating high-speed vision

We present a pole inspection system for outdoor environments comprising a high-speed camera on a vertical take-off and landing (VTOL) aerial platform. The pole inspection task requires a vehicle to fly close to a structure while maintaining a fixed stand-off distance from it. Typical GPS errors make GPS-based navigation unsuitable for this task however. When flying outdoors a vehicle is also affected by aerodynamics disturbances such as wind gusts, so the onboard controller must be robust to these disturbances in order to maintain the stand-off distance. Two problems must therefor be addressed: fast and accurate state estimation without GPS, and the design of a robust controller. We resolve these problems by a) performing visual + inertial relative state estimation and b) using a robust line tracker and a nested controller design. Our state estimation exploits high-speed camera images (100Hz) and 70Hz IMU data fused in an Extended Kalman Filter (EKF). We demonstrate results from outdoor experiments for pole-relative hovering, and pole circumnavigation where the operator provides only yaw commands. Lastly, we show results for image-based 3D reconstruction and texture mapping of a pole to demonstrate the usefulness for inspection tasks.

Human identification from video using advanced gait recognition techniques

The solutions proposed in this thesis contribute to improve gait recognition performance in practical scenarios that further enable the adoption of gait recognition into real world security and forensic applications that require identifying humans at a distance. Pioneering work has been conducted on frontal gait recognition using depth images to allow gait to be integrated with biometric walkthrough portals. The effects of gait challenging conditions including clothing, carrying goods, and viewpoint have been explored. Enhanced approaches are proposed on segmentation, feature extraction, feature optimisation and classification elements, and state-of-the-art recognition performance has been achieved. A frontal depth gait database has been developed and made available to the research community for further investigation. Solutions are explored in 2D and 3D domains using multiple images sources, and both domain-specific and independent modality gait features are proposed.

Evaluation of a patient-specific finite-element model to simulate conservative treatment in adolescent idiopathic scoliosis

Study design Retrospective validation study. Objectives To propose a method to evaluate, from a clinical standpoint, the ability of a finite-element model (FEM) of the trunk to simulate orthotic correction of spinal deformity and to apply it to validate a previously described FEM. Summary of background data Several FEMs of the scoliotic spine have been described in the literature. These models can prove useful in understanding the mechanisms of scoliosis progression and in optimizing its treatment, but their validation has often been lacking or incomplete. Methods Three-dimensional (3D) geometries of 10 patients before and during conservative treatment were reconstructed from biplanar radiographs. The effect of bracing was simulated by modeling displacements induced by the brace pads. Simulated clinical indices (Cobb angle, T1–T12 and T4–T12 kyphosis, L1–L5 lordosis, apical vertebral rotation, torsion, rib hump) and vertebral orientations and positions were compared to those measured in the patients' 3D geometries. Results Errors in clinical indices were of the same order of magnitude as the uncertainties due to 3D reconstruction; for instance, Cobb angle was simulated with a root mean square error of 5.7°, and rib hump error was 5.6°. Vertebral orientation was simulated with a root mean square error of 4.8° and vertebral position with an error of 2.5 mm. Conclusions The methodology proposed here allowed in-depth evaluation of subject-specific simulations, confirming that FEMs of the trunk have the potential to accurately simulate brace action. These promising results provide a basis for ongoing 3D model development, toward the design of more efficient orthoses.

Glycoprotein Interactions in the Assembly of Hantaviruses

Hantaviruses are one of the five genera of the vector-borne virus family Bunyaviridae. While other members of the family are transmitted via arthropods, hantaviruses are carried and transmitted by rodents and insectivores. Occasional transmission to humans occurs via inhalation of aerosolized rodent excreta. When transmitted to man hantaviruses cause hemorrhagic fever with renal syndrome (HFRS, in Eurasia, mortality ~10%) and hantavirus cardiopulmonary syndrome (HCPS, in the Americas, mortality ~40%). The single-stranded, negative-sense RNA genome of hantaviruses is in segments S, M and L that respectively encode for nucleocapsid (N), glycoproteins Gn and Gc, and RNA-dependent RNA-polymerase (RdRp or L protein). The genome segments, encapsidated by N protein to form ribonucleoprotein (RNP), are enclosed inside a lipid envelope decorated by spikes formed of Gn and Gc. The focus of this study was to understand the mechanisms and interactions through which the virion is formed and maintained. We observed that when extracted from virions both Gn and Gc favor homo- over hetero-oligomerization. The minimal glycoprotein complexes extracted from virion by detergent were observed, by using ultracentrifugation and gel filtration, to be tetrameric Gn and homodimeric Gc. These results led us to suggest a model where tetrameric Gn complexes are interconnected through homodimeric Gc units to form the grid-like surface architecture described for hantaviruses. This model was found to correlate with the three-dimensional (3D) reconstruction of virion surface created using cryo-electron tomography (cryo-ET). The 3D-density map showed the spike complex formed of Gn and Gc to be 10 nm high and to display a four-fold symmetry with dimensions of 15 nm times 15 nm. This unique square-shaped complex on a roughly round virion creates a hitch for the assembly, since a sphere cannot be broken into rectangles. Thus additional interactions are likely required for the virion assembly. In cryo-ET we observed that the RNP makes occasional contacts to the viral membrane, suggesting an interaction between the spike and RNP. We were able to demonstrate this interaction using various techniques, and showed that both Gn and Gc contribute to the interaction. This led us to suggest that in addition to the interactions between Gn and Gc, also the interaction between spike and RNP is required for assembly. We found galectin-3 binding protein (referred to as 90K) to co-purify with the virions and showed an interaction between 90K and the virion. Analysis of plasma samples taken from patients hospitalized for Puumala virus infection showed increased concentrations of 90K in the acute phase and the increased 90K level was found to correlate with several parameters that reflect the severity of acute HFRS. The results of these studies confirmed, but also challenged some of the dogmas on the structure and assembly of hantaviruses. We confirmed that Gn and RNP do interact, as long assumed. On the other hand we demonstrated that the glycoproteins Gn and Gc exist as homo-oligomers or appear in large hetero-oligomeric complexes, rather than form primarily heterodimers as was previously assumed. This work provided new insight into the structure and assembly of hantaviruses.

Reconstructing Solid Model from 2D Scanned Images of Biological Organs for Finite Element Simulation

This work presents a methodology to reconstruct 3D biological organs from image sequences or other scan data using readily available free softwares with the final goal of using the organs (3D solids) for finite element analysis. The methodology deals with issues such as segmentation, conversion to polygonal surface meshes, and finally conversion of these meshes to 3D solids. The user is able to control the detail or the level of complexity of the solid constructed. The methodology is illustrated using 3D reconstruction of a porcine liver as an example. Finally, the reconstructed liver is imported into the commercial software ANSYS, and together with a cyst inside the liver, a nonlinear analysis performed. The results confirm that the methodology can be used for obtaining 3D geometry of biological organs. The results also demonstrate that the geometry obtained by following this methodology can be used for the nonlinear finite element analysis of organs. The methodology (or the procedure) would be of use in surgery planning and surgery simulation since both of these extensively use finite elements for numerical simulations and it is better if these simulations are carried out on patient specific organ geometries. Instead of following the present methodology, it would cost a lot to buy a commercial software which can reconstruct 3D biological organs from scanned image sequences.

Perturbation of nucleo-cytoplasmic transport affects size of nucleus and nucleolus in human cells

Size regulation of human cell nucleus and nucleolus are poorly understood subjects. 3D reconstruction of live image shows that the karyoplasmic ratio (KR) increases by 30-80% in transformed cell lines compared to their immortalized counterpart. The attenuation of nucleo-cytoplasmic transport causes the KR value to increase by 30-50% in immortalized cell lines. Nucleolus volumes are significantly increased in transformed cell lines and the attenuation of nucleo-cytoplasmic transport causes a significant increase in the nucleolus volume of immortalized cell lines. A cytosol and nuclear fraction swapping experiment emphasizes the potential role of unknown cytosolic factors in nuclear and nucleolar size regulation.

Estudo clínico prospectivo das modificações da borda alveolar inferior após projeção ortodôntica em tomografia computadorizada de feixe cônico

A projeção de incisivos e expansão dos arcos dentários são uma alternativa valiosa à extração dentária, especialmente quando se considera a estética facial em pacientes adultos. O efeito da projeção ortodôntica dos incisivos inferiores sobre o periodonto é controverso devido às avaliações em exames bidimensionais e os aspectos multi-fatoriais que envolvem as recessões gengivais. O objetivo deste estudo foi comparar as modificações na altura da borda alveolar dos dentes ântero-inferiores de pacientes, que foram submetidos à projeção ortodôntica, com pacientes tratados sem projeção; e correlacionar estas modificações com o grau de inclinação dentária, com as alterações da distância bicanina e com o biotipo gengival. Pacientes adultos com mais de 3 mm de falta de espaço no arco inferior e curva de Spee moderada ou acentuada compuseram o grupo experimental (n=15). O grupo controle (n=7) consistiu de pacientes com bons arcos inferiores, que não necessitavam de grandes movimentos dentários. Estes pacientes foram submetidos a alinhamento e nivelamento dentário até o fio de aço .020". Tomografias computadorizadas de feixe cônico (TCFC) foram obtidas antes do tratamento e ao final da fase de alinhamento e nivelamento. As alturas das bordas alveolares (BA) de incisivos e caninos inferiores foram medidas nas TCFC em reconstruções 3D e comparadas entre os grupos e entre os tempos pelos testes-t de Student não pareado e pareado, respectivamente. As BA foram correlacionadas com o grau de inclinação dentária (IMPA), com a distância intercaninos (DIC) e com o biotipo gengival (BG) pelo teste de correlação de Pearson. Os resultados demonstraram que os caninos inferiores do grupo experimental apresentaram perda óssea significativa (p<0,005), quando comparados com o grupo controle, em média 2,5 mm. As BA dos dentes 43, 33 e 32 ao final do alinhamento e nivelamento eram significativamente maiores do que ao início do tratamento no grupo experimental (p<0,001). Não foram encontradas diferenças significativas entre as medidas iniciais e finais das BA de todos os dentes do grupo controle. Apesar destes resultados, não foram encontradas correlações entre a remodelação da BA e o IMPA, a DIC e o BG. Pode-se concluir que o aumento no comprimento do arco inferior com arcos ortodônticos contínuos aumenta a inclinação dos incisivos inferiores e a DIC. O aumento da DIC parece exercer maior efeito sobre a BA dos caninos inferiores do que a inclinação de incisivos sobre a BA dos incisivos inferiores. No entanto, as modificações da BA não estão associadas ao grau de inclinação dos incisivos, a quantidade de expansão do arco inferior e ao biotipo gengival.

Avaliação volumétrica e funcional do músculo glúteo máximo submetido a gluteoplastia de aumento com implantes de silicone

A operação para aumento de glúteos com implantes teve início no fim da década de 1960, entretanto a técnica intramuscular, considerada padrão atualmente, foi descrita cerca de 30 anos depois. Cirurgiões e pacientes apresentam crescente interesse na realização do aumento de glúteos haja vista que sua frequência apresenta aumento nos últimos anos. A utilização de implantes intramusculares que superam o volume do músculo em mais de cinquenta por cento configura uma situação nova que deve ser estudada. O tecido muscular estriado esquelético apresenta grande suscetibilidade para atrofia secundariamente à compressão, e sendo o glúteo máximo um músculo importante na manutenção da postura ereta, deambulação, corrida e salto, é necessário pesquisar possíveis alterações musculares decorrentes da operação. O objetivo deste estudo é avaliar o volume e força do músculo glúteo máximo ao longo de 12 meses após a introdução de implantes intramusculares, o posicionamento destes implantes no interior da musculatura e mudanças antropométricas obtidas com a operação. Foram selecionadas 48 mulheres, 24 candidatas a gluteoplastia de aumento com implantes compuseram o grupo de estudo e 24 candidatas a mamoplastia de aumento compuseram o grupo controle de acordo com os critérios de inclusão e exclusão. As pacientes foram avaliadas em quatro momentos diferentes: pré-operatório e após três, seis e 12 meses da operação. Em todas as etapas foi realizada avaliação clínica nutricional, tomografia computadorizada com reconstrução 3D e teste isocinético. Todas as pacientes permaneceram afastadas de atividades físicas durante três meses após a operação. Foram utilizados implantes glúteos em gel coesivo de base oval e superfície lisa com volumes de 350 cm3 e 400 cm3. O nível de significância estatística foi mantido em 5%. As pacientes candidatas a gluteoplastia apresentaram valores da relação entre as medidas da cintura e do quadril maiores que aquelas do grupo controle. A operação de aumento glúteo com implantes demonstrou eficácia na melhora desta relação. Os implantes apresentaram posição obliqua com inclinação semelhante à das fibras musculares após três meses da operação, independente da posição em que foram inseridos. As pacientes do grupo de estudo apresentaram atrofia muscular após 12 meses em 6,14% à esquerda e 6,43% à direita, as pacientes do grupo controle não apresentaram atrofia. A força muscular apresentou redução do valor de torque máximo durante a flexão do quadril a 30 /s em ambos os grupos e aumento do torque máximo durante a adução a 60 /s apenas no grupo de estudo. Concluímos que a introdução de implante de silicone no interior do músculo glúteo máximo causa atrofia muscular após 12 meses. As variações na força deste músculo nesse período não podem ser atribuídas primariamente à operação ou à presença dos implantes em seu interior. Os implantes permaneceram em posição obliqua. O aumento de glúteos com implantes gera mudanças antropométricas nas mulheres submetidas a esta operação.

Automated Computation of the Fundamental Matrix for Vision-Based Construction Site Applications

Estimating the fundamental matrix (F), to determine the epipolar geometry between a pair of images or video frames, is a basic step for a wide variety of vision-based functions used in construction operations, such as camera-pair calibration, automatic progress monitoring, and 3D reconstruction. Currently, robust methods (e.g., SIFT + normalized eight-point algorithm + RANSAC) are widely used in the construction community for this purpose. Although they can provide acceptable accuracy, the significant amount of required computational time impedes their adoption in real-time applications, especially video data analysis with many frames per second. Aiming to overcome this limitation, this paper presents and evaluates the accuracy of a solution to find F by combining the use of two speedy and consistent methods: SURF for the selection of a robust set of point correspondences and the normalized eight-point algorithm. This solution is tested extensively on construction site image pairs including changes in viewpoint, scale, illumination, rotation, and moving objects. The results demonstrate that this method can be used for real-time applications (5 image pairs per second with the resolution of 640 × 480) involving scenes of the built environment.

Machine Vision-Based Infrastructure As-Built Documentation Using Edge Points

The existing machine vision-based 3D reconstruction software programs provide a promising low-cost and in some cases automatic solution for infrastructure as-built documentation. However in several steps of the reconstruction process, they only rely on detecting and matching corner-like features in multiple views of a scene. Therefore, in infrastructure scenes which include uniform materials and poorly textured surfaces, these programs fail with high probabilities due to lack of feature points. Moreover, except few programs that generate dense 3D models through significantly time-consuming algorithms, most of them only provide a sparse reconstruction which does not necessarily include required points such as corners or edges; hence these points have to be manually matched across different views that could make the process considerably laborious. To address these limitations, this paper presents a video-based as-built documentation method that automatically builds detailed 3D maps of a scene by aligning edge points between video frames. Compared to corner-like features, edge points are far more plentiful even in untextured scenes and often carry important semantic associations. The method has been tested for poorly textured infrastructure scenes and the results indicate that a combination of edge and corner-like features would allow dealing with a broader range of scenes.

Optimized selection of key frames for monocular videogrammetric surveying of civil infrastructure

Videogrammetry is an inexpensive and easy-to-use technology for spatial 3D scene recovery. When applied to large scale civil infrastructure scenes, only a small percentage of the collected video frames are required to achieve robust results. However, choosing the right frames requires careful consideration. Videotaping a built infrastructure scene results in large video files filled with blurry, noisy, or redundant frames. This is due to frame rate to camera speed ratios that are often higher than necessary; camera and lens imperfections and limitations that result in imaging noise; and occasional jerky motions of the camera that result in motion blur; all of which can significantly affect the performance of the videogrammetric pipeline. To tackle these issues, this paper proposes a novel method for automating the selection of an optimized number of informative, high quality frames. According to this method, as the first step, blurred frames are removed using the thresholds determined based on a minimum level of frame quality required to obtain robust results. Then, an optimum number of key frames are selected from the remaining frames using the selection criteria devised by the authors. Experimental results show that the proposed method outperforms existing methods in terms of improved 3D reconstruction results, while maintaining the optimum number of extracted frames needed to generate high quality 3D point clouds.© 2012 Elsevier Ltd. All rights reserved.