Three-dimensional vision enhances task performance independently of the surgical method

Within the next few years, the medical industry will launch increasingly affordable three-dimensional (3D) vision systems for the operating room (OR). This study aimed to evaluate the effect of two-dimensional (2D) and 3D visualization on surgical skills and task performance.

Integration of merged delayed-enhanced magnetic resonance imaging and multidetector computed tomography for the guidance of ventricular tachycardia ablation: a pilot study

BACKGROUND Delayed enhancement (DE) MRI can assess the fibrotic substrate of scar-related VT. MDCT has the advantage of inframillimetric spatial resolution and better 3D reconstructions. We sought to evaluate the feasibility and usefulness of integrating merged MDCT/MRI data in 3D-mapping systems for structure-function assessment and multimodal guidance of VT mapping and ablation. METHODS Nine patients, including 3 ischemic cardiomyopathy (ICM), 3 nonischemic cardiomyopathy (NICM), 2 myocarditis, and 1 redo procedure for idiopathic VT, underwent MRI and MDCT before VT ablation. Merged MRI/MDCT data were integrated in 3D-mapping systems and registered to high-density endocardial and epicardial maps. Low-voltage areas (<1.5 mV) and local abnormal ventricular activities (LAVA) during sinus rhythm were correlated to DE at MRI, and wall-thinning (WT) at MDCT. RESULTS Endocardium and epicardium were mapped with 391 ± 388 and 1098 ± 734 points per map, respectively. Registration of MDCT allowed visualization of coronary arteries during epicardial mapping/ablation. In the idiopathic patient, integration of MRI data identified previously ablated regions. In ICM patients, both DE at MRI and WT at MDCT matched areas of low voltage (overlap 94 ± 6% and 79 ± 5%, respectively). In NICM patients, wall-thinning areas matched areas of low voltage (overlap 63 ± 21%). In patients with myocarditis, subepicardial DE matched areas of epicardial low voltage (overlap 92 ± 12%). A total number of 266 LAVA sites were found in 7/9 patients. All LAVA sites were associated to structural substrate at imaging (90% inside, 100% within 18 mm). CONCLUSION The integration of merged MDCT and DEMRI data is feasible and allows combining substrate assessment with high-spatial resolution to better define structure-function relationship in scar-related VT.

Reconstruction and 3D visualisation based on objective real 3D based documentation

Reconstructions based directly upon forensic evidence alone are called primary information. Historically this consists of documentation of findings by verbal protocols, photographs and other visual means. Currently modern imaging techniques such as 3D surface scanning and radiological methods (Computer Tomography, Magnetic Resonance Imaging) are also applied. Secondary interpretation is based on facts and the examiner's experience. Usually such reconstructive expertises are given in written form, and are often enhanced by sketches. However, narrative interpretations can, especially in complex courses of action, be difficult to present and can be misunderstood. In this report we demonstrate the use of graphic reconstruction of secondary interpretation with supporting pictorial evidence, applying digital visualisation (using 'Poser') or scientific animation (using '3D Studio Max', 'Maya') and present methods of clearly distinguishing between factual documentation and examiners' interpretation based on three cases. The first case involved a pedestrian who was initially struck by a car on a motorway and was then run over by a second car. The second case involved a suicidal gunshot to the head with a rifle, in which the trigger was pushed with a rod. The third case dealt with a collision between two motorcycles. Pictorial reconstruction of the secondary interpretation of these cases has several advantages. The images enable an immediate overview, give rise to enhanced clarity, and compel the examiner to look at all details if he or she is to create a complete image.

A global ”imaging” view on systems approaches in immunology

The immune system exhibits an enormous complexity. High throughput methods such as the "-omic'' technologies generate vast amounts of data that facilitate dissection of immunological processes at ever finer resolution. Using high-resolution data-driven systems analysis, causal relationships between complex molecular processes and particular immunological phenotypes can be constructed. However, processes in tissues, organs, and the organism itself (so-called higher level processes) also control and regulate the molecular (lower level) processes. Reverse systems engineering approaches, which focus on the examination of the structure, dynamics and control of the immune system, can help to understand the construction principles of the immune system. Such integrative mechanistic models can properly describe, explain, and predict the behavior of the immune system in health and disease by combining both higher and lower level processes. Moving from molecular and cellular levels to a multiscale systems understanding requires the development of methodologies that integrate data from different biological levels into multiscale mechanistic models. In particular, 3D imaging techniques and 4D modeling of the spatiotemporal dynamics of immune processes within lymphoid tissues are central for such integrative approaches. Both dynamic and global organ imaging technologies will be instrumental in facilitating comprehensive multiscale systems immunology analyses as discussed in this review.

Cord entanglement in monoamniotic twins: 2D and 3D colour Doppler studies

Cord entanglement affects the majority of monoamniotic (MA) twins, accounting for the high proportion of intrauterine deaths of MA twins, and it is often present from early gestation. 3D ultrasound can be used to acquire volume data comprising information on umbilical colour Doppler flow, providing a very graphic depiction of cord entanglement. We have used 2D, "conventional" and a novel 3D display of colour Doppler ultrasound showing cord entanglement.

An economic assessment of drought effects on three grassland systems in Switzerland

This paper analyzes the economic impacts of summer drought on Swiss grassland production. We combine field trial data from drought experiments in three different grasslands in Switzerland with site-specific information on economic costs and benefits. The analysis focuses on the economic implications of drought effects on grassland yields as well as grassland composition. In agreement with earlier studies, we found rather heterogeneous yield effects of drought on Swiss grassland systems, with significantly reduced yields as a response to drought at the lowland and sub-alpine sites, but increased yields at the wetter pre-alpine site. Relative yield losses were highest at the sub-alpine site (with annual yield losses of up to 37 %). However, because income from grassland production at extensive sites relies to a large extent on ecological direct payments, even large yield losses had only limited implications in terms of relative profit reductions. In contrast, negative drought impacts at the most productive, intensively managed lowland site were dominant, with average annual drought-induced profit margin reductions of about 28 %. This is furthermore emphasized if analyzing the farm level perspective of drought impacts. Combining site-specific effects at the farm level, we found that in particular farms with high shares of lowland grassland sites suffer from summer droughts in terms of farm-level fodder production and profit margins. Moreover, our results showed that the higher competitiveness of weeds (broad-leaved dock) under drought conditions will require increasing attention on weed control measures in future grassland production systems. Taking into account that the risk of drought occurrence is expected to increase in the coming years, additional instruments to cope with drought risks in fodder production and finally farmers’ income have to be developed.

A systems analysis identifies a feedforward inflammatory circuit leading to lethal influenza infection

For acutely lethal influenza infections, the relative pathogenic contributions of direct viral damage to lung epithelium versus dysregulated immunity remain unresolved. Here, we take a top-down systems approach to this question. Multigene transcriptional signatures from infected lungs suggested that elevated activation of inflammatory signaling networks distinguished lethal from sublethal infections. Flow cytometry and gene expression analysis involving isolated cell subpopulations from infected lungs showed that neutrophil influx largely accounted for the predictive transcriptional signature. Automated imaging analysis, together with these gene expression and flow data, identified a chemokine-driven feedforward circuit involving proinflammatory neutrophils potently driven by poorly contained lethal viruses. Consistent with these data, attenuation, but not ablation, of the neutrophil-driven response increased survival without changing viral spread. These findings establish the primacy of damaging innate inflammation in at least some forms of influenza-induced lethality and provide a roadmap for the systematic dissection of infection-associated pathology.

3D Conversion using Vanishing Points and Image Warping

We describe a user assisted technique for 3D stereo conversion from 2D images. Our approach exploits the geometric structure of perspective images including vanishing points. We allow a user to indicate lines, planes, and vanishing points in the input image, and directly employ these as constraints in an image warping framework to produce a stereo pair. By sidestepping explicit construction of a depth map, our approach is applicable to more general scenes and avoids potential artifacts of depth-image-based rendering. Our method is most suitable for scenes with large scale structures such as buildings.

3D Face Reconstruction from 2D Pictures: First Results of a Web-Based Computer Aided System for Aesthetic Procedures

The human face is a vital component of our identity and many people undergo medical aesthetics procedures in order to achieve an ideal or desired look. However, communication between physician and patient is fundamental to understand the patient’s wishes and to achieve the desired results. To date, most plastic surgeons rely on either “free hand” 2D drawings on picture printouts or computerized picture morphing. Alternatively, hardware dependent solutions allow facial shapes to be created and planned in 3D, but they are usually expensive or complex to handle. To offer a simple and hardware independent solution, we propose a web-based application that uses 3 standard 2D pictures to create a 3D representation of the patient’s face on which facial aesthetic procedures such as filling, skin clearing or rejuvenation, and rhinoplasty are planned in 3D. The proposed application couples a set of well-established methods together in a novel manner to optimize 3D reconstructions for clinical use. Face reconstructions performed with the application were evaluated by two plastic surgeons and also compared to ground truth data. Results showed the application can provide accurate 3D face representations to be used in clinics (within an average of 2 mm error) in less than 5 min.

Hand-held 3D light field photography and applications

We propose a method to acquire 3D light fields using a hand-held camera, and describe several computational photography applications facilitated by our approach. As our input we take an image sequence from a camera translating along an approximately linear path with limited camera rotations. Users can acquire such data easily in a few seconds by moving a hand-held camera. We include a novel approach to resample the input into regularly sampled 3D light fields by aligning them in the spatio-temporal domain, and a technique for high-quality disparity estimation from light fields. We show applications including digital refocusing and synthetic aperture blur, foreground removal, selective colorization, and others.

Optimized CUDA-Based PDE Solver for Reaction Diffusion Systems on Arbitrary Surfaces

Partial differential equation (PDE) solvers are commonly employed to study and characterize the parameter space for reaction-diffusion (RD) systems while investigating biological pattern formation. Increasingly, biologists wish to perform such studies with arbitrary surfaces representing ‘real’ 3D geometries for better insights. In this paper, we present a highly optimized CUDA-based solver for RD equations on triangulated meshes in 3D. We demonstrate our solver using a chemotactic model that can be used to study snakeskin pigmentation, for example. We employ a finite element based approach to perform explicit Euler time integrations. We compare our approach to a naive GPU implementation and provide an in-depth performance analysis, demonstrating the significant speedup afforded by our optimizations. The optimization strategies that we exploit could be generalized to other mesh based processing applications with PDE simulations.