A low cost one-camera optical tracking system for indoor wide-area augmented and virtual reality environments

In the last years the number of industrial applications for Augmented Reality (AR) and Virtual Reality (VR) environments has significantly increased. Optical tracking systems are an important component of AR/VR environments. In this work, a low cost optical tracking system with adequate attributes for professional use is proposed. The system works in infrared spectral region to reduce optical noise. A highspeed camera, equipped with daylight blocking filter and infrared flash strobes, transfers uncompressed grayscale images to a regular PC, where image pre-processing software and the PTrack tracking algorithm recognize a set of retro-reflective markers and extract its 3D position and orientation. Included in this work is a comprehensive research on image pre-processing and tracking algorithms. A testbed was built to perform accuracy and precision tests. Results show that the system reaches accuracy and precision levels slightly worse than but still comparable to professional systems. Due to its modularity, the system can be expanded by using several one-camera tracking modules linked by a sensor fusion algorithm, in order to obtain a larger working range. A setup with two modules was built and tested, resulting in performance similar to the stand-alone configuration.

Integrating eye tracking in virtual reality for stroke rehabilitation

This thesis reports on research done for the integration of eye tracking technology into virtual reality environments, with the goal of using it in rehabilitation of patients who suffered from stroke. For the last few years, eye tracking has been a focus on medical research, used as an assistive tool  to help people with disabilities interact with new technologies  and as an assessment tool  to track the eye gaze during computer interactions. However, tracking more complex gaze behaviors and relating them to motor deficits in people with disabilities is an area that has not been fully explored, therefore it became the focal point of this research. During the research, two exploratory studies were performed in which eye tracking technology was integrated in the context of a newly created virtual reality task to assess the impact of stroke. Using an eye tracking device and a custom virtual task, the system developed is able to monitor the eye gaze pattern changes over time in patients with stroke, as well as allowing their eye gaze to function as an input for the task. Based on neuroscientific hypotheses of upper limb motor control, the studies aimed at verifying the differences in gaze patterns during the observation and execution of the virtual goal-oriented task in stroke patients (N=10), and also to assess normal gaze behavior in healthy participants (N=20). Results were found consistent and supported the hypotheses formulated, showing that eye gaze could be used as a valid assessment tool on these patients. However, the findings of this first exploratory approach are limited in order to fully understand the effect of stroke on eye gaze behavior. Therefore, a novel model-driven paradigm is proposed to further understand the relation between the neuronal mechanisms underlying goal-oriented actions and eye gaze behavior.

Employing 2D Projections for Fast Visual Exploration of Large Fiber Tracking Data

Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq)

Analysis of hourly global, direct and diffuse solar radiations attenuation as a function of optical air mass

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)

Riverbed: A Novel User-Steered Image Segmentation Method Based on Optimum Boundary Tracking

This paper presents an optimum user-steered boundary tracking approach for image segmentation, which simulates the behavior of water flowing through a riverbed. The riverbed approach was devised using the image foresting transform with a never-exploited connectivity function. We analyze its properties in the derived image graphs and discuss its theoretical relation with other popular methods such as live wire and graph cuts. Several experiments show that riverbed can significantly reduce the number of user interactions (anchor points), as compared to live wire for objects with complex shapes. This paper also includes a discussion about how to combine different methods in order to take advantage of their complementary strengths.

Myocardial Deformation by Speckle Tracking in Severe Dilated Cardiomyopathy

Background: The high and increasing prevalence of Dilated Cardiomyopathy (DCM) represents a serious public health issue. Novel technologies have been used aiming to improve diagnosis and the therapeutic approach. In this context, speckle tracking echocardiography (STE) uses natural myocardial markers to analyze the systolic deformation of the left ventricle (LV). Objective: Measure the longitudinal transmural global strain (GS) of the LV through STE in patients with severe DCM, comparing the results with normal individuals and with echocardiographic parameters established for the analysis of LV systolic function, in order to validate the method in this population. Methods: Seventy-one patients with severe DCM (53 +/- 12 years, 72% men) and 20 controls (30 +/- 8 years, 45% men) were studied. The following variables were studied: LV volumes and ejection fraction calculated by two and three-dimensional echocardiography, Doppler parameters, Tissue Doppler Imaging systolic and diastolic LV velocities and GS obtained by STE. Results: Compared with controls, LV volumes were higher in the DCM group; however, LVEF and peak E-wave velocity were lower in the latter. The myocardial performance index was higher in the patient group. Tissue Doppler myocardial velocities (S', e', a') were significantly lower and E/e' ratio was higher in the DCM group. GS was decreased in the DCM group (-5.5% +/- 2.3%) when compared with controls (-14.0% +/- 1.8%). Conclusion: In this study, GS was significantly lower in patients with severe DCM, bringing new perspectives for therapeutic approaches in this specific population. (Arq Bras Cardiol 2012;99(3):834-842)

New concept for CTO recanalization using controlled antegrade and retrograde subintimal tracking: the CART technique

OBJECTIVES: To demonstrate the safety and feasibility of a new concept for CTO recanalization using a controlled antegrade and retrograde subintimal tracking technique (CART technique). BACKGROUND: A successful percutaneous recanalization of chronic coronary occlusions results in improved survival, as well as enhanced left ventricular function, reduction in angina, and improved exercise tolerance. However, successful recanalization of CTOs is still not optimal, and needs further improvements. METHODS: Ten patients with a CTO underwent the CART procedure. This technique combines the simultaneous use of the antegrade and retrograde approaches. A subintimal dissection is created antegradely and retrogradely, which allows the operator to limit the extension of the subintimal dissection in the CTO portion. A retrograde approach means that the occlusion site is approached in a retrograde fashion through the best collateral channel from any other patent coronary artery. RESULTS: The occlusion site was located in the RCA in 9 patients, and in the LAD in 1 patient. CTO duration varied from 7 to 84 months. Vessel recanalization was achieved in all patients. In all cases, the subintimal dissection was limited to the CTO region. No complications occurred in the collateral channel used for the retrograde approach. There were no in-hospital major adverse cardiac events. CONCLUSIONS: The CART technique is feasible, safe, and has a high success rate.

Tracking virus-specific CD4+ T cells during and after acute hepatitis C virus infection

BACKGROUND: CD4+ T cell help is critical in maintaining antiviral immune responses and such help has been shown to be sustained in acute resolving hepatitis C. In contrast, in evolving chronic hepatitis C CD4+ T cell helper responses appear to be absent or short-lived, using functional assays. METHODOLOGY/PRINCIPAL FINDINGS: Here we used a novel HLA-DR1 tetramer containing a highly targeted CD4+ T cell epitope from the hepatitis C virus non-structural protein 4 to track number and phenotype of hepatitis C virus specific CD4+ T cells in a cohort of seven HLA-DR1 positive patients with acute hepatitis C in comparison to patients with chronic or resolved hepatitis C. We observed peptide-specific T cells in all seven patients with acute hepatitis C regardless of outcome at frequencies up to 0.65% of CD4+ T cells. Among patients who transiently controlled virus replication we observed loss of function, and/or physical deletion of tetramer+ CD4+ T cells before viral recrudescence. In some patients with chronic hepatitis C very low numbers of tetramer+ cells were detectable in peripheral blood, compared to robust responses detected in spontaneous resolvers. Importantly we did not observe escape mutations in this key CD4+ T cell epitope in patients with evolving chronic hepatitis C. CONCLUSIONS/SIGNIFICANCE: During acute hepatitis C a CD4+ T cell response against this epitope is readily induced in most, if not all, HLA-DR1+ patients. This antiviral T cell population becomes functionally impaired or is deleted early in the course of disease in those where viremia persists.

Effect of lifetime endurance training on left atrial mechanical function and on the risk of atrial fibrillation

Background Left atrium (LA) dilation and P-wave duration are linked to the amount of endurance training and are risk factors for atrial fibrillation (AF). The aim of this study was to evaluate the impact of LA anatomical and electrical remodeling on its conduit and pump function measured by two-dimensional speckle tracking echocardiography (STE). Method Amateur male runners > 30 years were recruited. Study participants (n = 95) were stratified in 3 groups according to lifetime training hours: low (< 1500 h, n = 33), intermediate (1500 to 4500 h, n = 32) and high training group (> 4500 h, n = 30). Results No differences were found, between the groups, in terms of age, blood pressure, and diastolic function. LA maximal volume (30 ± 5, 33 ± 5 vs. 37 ± 6 ml/m2, p < 0.001), and conduit volume index (9 ± 3, 11 ± 3 vs. 12 ± 3 ml/m2, p < 0.001) increased significantly from the low to the high training group, unlike the STE parameters: pump strain − 15.0 ± 2.8, − 14.7 ± 2.7 vs. − 14.9 ± 2.6%, p = 0.927; conduit strain 23.3 ± 3.9, 22.1 ± 5.3 vs. 23.7 ± 5.7%, p = 0.455. Independent predictors of LA strain conduit function were age, maximal early diastolic velocity of the mitral annulus, heart rate and peak early diastolic filling velocity. The signal-averaged P-wave (135 ± 11, 139 ± 10 vs. 148 ± 14 ms, p < 0.001) increased from the low to the high training group. Four episodes of non-sustained AF were recorded in one runner of the high training group. Conclusion The LA anatomical and electrical remodeling does not have a negative impact on atrial mechanical function. Hence, a possible link between these risk factors for AF and its actual, rare occurrence in this athlete population, could not be uncovered in the present study.

Tracking the Flow of Information through the Hippocampal Formation in the Rat

The hippocampus receives input from upper levels of the association cortex and is implicated in many mnemonic processes, but the exact mechanisms by which it codes and stores information is an unresolved topic. This work examines the flow of information through the hippocampal formation while attempting to determine the computations that each of the hippocampal subfields performs in learning and memory. The formation, storage, and recall of hippocampal-dependent memories theoretically utilize an autoassociative attractor network that functions by implementing two competitive, yet complementary, processes. Pattern separation, hypothesized to occur in the dentate gyrus (DG), refers to the ability to decrease the similarity among incoming information by producing output patterns that overlap less than the inputs. In contrast, pattern completion, hypothesized to occur in the CA3 region, refers to the ability to reproduce a previously stored output pattern from a partial or degraded input pattern. Prior to addressing the functional role of the DG and CA3 subfields, the spatial firing properties of neurons in the dentate gyrus were examined. The principal cell of the dentate gyrus, the granule cell, has spatially selective place fields; however, the behavioral correlates of another excitatory cell, the mossy cell of the dentate polymorphic layer, are unknown. This report shows that putative mossy cells have spatially selective firing that consists of multiple fields similar to previously reported properties of granule cells. Other cells recorded from the DG had single place fields. Compared to cells with multiple fields, cells with single fields fired at a lower rate during sleep, were less likely to burst, and were more likely to be recorded simultaneously with a large population of neurons that were active during sleep and silent during behavior. These data suggest that single-field and multiple-field cells constitute at least two distinct cell classes in the DG. Based on these characteristics, we propose that putative mossy cells tend to fire in multiple, distinct locations in an environment, whereas putative granule cells tend to fire in single locations, similar to place fields of the CA1 and CA3 regions. Experimental evidence supporting the theories of pattern separation and pattern completion comes from both behavioral and electrophysiological tests. These studies specifically focused on the function of each subregion and made implicit assumptions about how environmental manipulations changed the representations encoded by the hippocampal inputs. However, the cell populations that provided these inputs were in most cases not directly examined. We conducted a series of studies to investigate the neural activity in the entorhinal cortex, dentate gyrus, and CA3 in the same experimental conditions, which allowed a direct comparison between the input and output representations. The results show that the dentate gyrus representation changes between the familiar and cue altered environments more than its input representations, whereas the CA3 representation changes less than its input representations. These findings are consistent with longstanding computational models proposing that (1) CA3 is an associative memory system performing pattern completion in order to recall previous memories from partial inputs, and (2) the dentate gyrus performs pattern separation to help store different memories in ways that reduce interference when the memories are subsequently recalled.

Nonparametric Message Passing Methods for Cooperative Localization and Tracking

The objective of this thesis is the development of cooperative localization and tracking algorithms using nonparametric message passing techniques. In contrast to the most well-known techniques, the goal is to estimate the posterior probability density function (PDF) of the position of each sensor. This problem can be solved using Bayesian approach, but it is intractable in general case. Nevertheless, the particle-based approximation (via nonparametric representation), and an appropriate factorization of the joint PDFs (using message passing methods), make Bayesian approach acceptable for inference in sensor networks. The well-known method for this problem, nonparametric belief propagation (NBP), can lead to inaccurate beliefs and possible non-convergence in loopy networks. Therefore, we propose four novel algorithms which alleviate these problems: nonparametric generalized belief propagation (NGBP) based on junction tree (NGBP-JT), NGBP based on pseudo-junction tree (NGBP-PJT), NBP based on spanning trees (NBP-ST), and uniformly-reweighted NBP (URW-NBP). We also extend NBP for cooperative localization in mobile networks. In contrast to the previous methods, we use an optional smoothing, provide a novel communication protocol, and increase the efficiency of the sampling techniques. Moreover, we propose novel algorithms for distributed tracking, in which the goal is to track the passive object which cannot locate itself. In particular, we develop distributed particle filtering (DPF) based on three asynchronous belief consensus (BC) algorithms: standard belief consensus (SBC), broadcast gossip (BG), and belief propagation (BP). Finally, the last part of this thesis includes the experimental analysis of some of the proposed algorithms, in which we found that the results based on real measurements are very similar with the results based on theoretical models.

Efficient Model-based 3D Tracking by Using Direct Image Registration

This thesis deals with the problem of efficiently tracking 3D objects in sequences of images. We tackle the efficient 3D tracking problem by using direct image registration. This problem is posed as an iterative optimization procedure that minimizes a brightness error norm. We review the most popular iterative methods for image registration in the literature, turning our attention to those algorithms that use efficient optimization techniques. Two forms of efficient registration algorithms are investigated. The first type comprises the additive registration algorithms: these algorithms incrementally compute the motion parameters by linearly approximating the brightness error function. We centre our attention on Hager and Belhumeur’s factorization-based algorithm for image registration. We propose a fundamental requirement that factorization-based algorithms must satisfy to guarantee good convergence, and introduce a systematic procedure that automatically computes the factorization. Finally, we also bring out two warp functions to register rigid and nonrigid 3D targets that satisfy the requirement. The second type comprises the compositional registration algorithms, where the brightness function error is written by using function composition. We study the current approaches to compositional image alignment, and we emphasize the importance of the Inverse Compositional method, which is known to be the most efficient image registration algorithm. We introduce a new algorithm, the Efficient Forward Compositional image registration: this algorithm avoids the necessity of inverting the warping function, and provides a new interpretation of the working mechanisms of the inverse compositional alignment. By using this information, we propose two fundamental requirements that guarantee the convergence of compositional image registration methods. Finally, we support our claims by using extensive experimental testing with synthetic and real-world data. We propose a distinction between image registration and tracking when using efficient algorithms. We show that, depending whether the fundamental requirements are hold, some efficient algorithms are eligible for image registration but not for tracking.

Two-layer particle filter for multiple target detection and tracking

This paper deals with the detection and tracking of an unknown number of targets using a Bayesian hierarchical model with target labels. To approximate the posterior probability density function, we develop a two-layer particle filter. One deals with track initiation, and the other with track maintenance. In addition, the parallel partition method is proposed to sample the states of the surviving targets.

Analytic free-form lens design for tracking integration in concentrating photovoltaics

In this work the concept of tracking integration in concentrating photovoltaics (CPV) is revisited and developed further. With respect to conventional CPV, tracking integration eliminates the clear separation between stationary units of optics and solar cells, and external solar trackers. This approach is capable of further increasing the concentration ratio and makes high concentrating photovoltaics (> 500x) available for single-axis tracker installations. The reduced external solar tracking effort enables possibly cheaper and more compact installations. Our proposed optical system uses two laterally moving plano-convex lenses to achieve high concentration over a wide angular range of ±24°. The lateral movement allows to combine both steering and concentration of the incident direct sun light. Given the specific symmetry conditions of the underlying optical design problem, rotational symmetric lenses are not ideal for this application. For this type of design problems, a new free-form optics design method presented in previous papers perfectly matches the symmetry. It is derived directly from Fermat's principle, leading to sets of functional differential equations allowing the successive calculation of the Taylor series coeficients of each implicit surface function up to very high orders. For optical systems designed for wide field of view and with clearly separated optical surfaces, this new analytic design method has potential application in both fields of nonimaging and imaging optics.

A novel motion tracking system for evaluation of functional rehabilitation of the upper limbs

Upper limb function impairment is one of the most common sequelae of central nervous system injury, especially in stroke patients and when spinal cord injury produces tetraplegia. Conventional assessment methods cannot provide objective evaluation of patient performance and the tiveness of therapies. The most common assessment tools are based on rating scales, which are inefficient when measuring small changes and can yield subjective bias. In this study, we designed an inertial sensor-based monitoring system composed of five sensors to measure and analyze the complex movements of the upper limbs, which are common in activities of daily living. We developed a kinematic model with nine degrees of freedom to analyze upper limb and head movements in three dimensions. This system was then validated using a commercial optoelectronic system. These findings suggest that an inertial sensor-based motion tracking system can be used in patients who have upper limb impairment through data integration with a virtual reality-based neuroretation system.