Non-photorealistic rendering of virtual implant models for computer-assisted fluoroscopy-based surgical procedures

Surgical navigation systems visualize the positions and orientations of surgical instruments and implants as graphical overlays onto a medical image of the operated anatomy on a computer monitor. The orthopaedic surgical navigation systems could be categorized according to the image modalities that are used for the visualization of surgical action. In the so-called CT-based systems or 'surgeon-defined anatomy' based systems, where a 3D volume or surface representation of the operated anatomy could be constructed from the preoperatively acquired tomographic data or through intraoperatively digitized anatomy landmarks, a photorealistic rendering of the surgical action has been identified to greatly improve usability of these navigation systems. However, this may not hold true when the virtual representation of surgical instruments and implants is superimposed onto 2D projection images in a fluoroscopy-based navigation system due to the so-called image occlusion problem. Image occlusion occurs when the field of view of the fluoroscopic image is occupied by the virtual representation of surgical implants or instruments. In these situations, the surgeon may miss part of the image details, even if transparency and/or wire-frame rendering is used. In this paper, we propose to use non-photorealistic rendering to overcome this difficulty. Laboratory testing results on foamed plastic bones during various computer-assisted fluoroscopybased surgical procedures including total hip arthroplasty and long bone fracture reduction and osteosynthesis are shown.

Image Space Adaptive Rendering

In this thesis, we develop an adaptive framework for Monte Carlo rendering, and more specifically for Monte Carlo Path Tracing (MCPT) and its derivatives. MCPT is attractive because it can handle a wide variety of light transport effects, such as depth of field, motion blur, indirect illumination, participating media, and others, in an elegant and unified framework. However, MCPT is a sampling-based approach, and is only guaranteed to converge in the limit, as the sampling rate grows to infinity. At finite sampling rates, MCPT renderings are often plagued by noise artifacts that can be visually distracting. The adaptive framework developed in this thesis leverages two core strategies to address noise artifacts in renderings: adaptive sampling and adaptive reconstruction. Adaptive sampling consists in increasing the sampling rate on a per pixel basis, to ensure that each pixel value is below a predefined error threshold. Adaptive reconstruction leverages the available samples on a per pixel basis, in an attempt to have an optimal trade-off between minimizing the residual noise artifacts and preserving the edges in the image. In our framework, we greedily minimize the relative Mean Squared Error (rMSE) of the rendering by iterating over sampling and reconstruction steps. Given an initial set of samples, the reconstruction step aims at producing the rendering with the lowest rMSE on a per pixel basis, and the next sampling step then further reduces the rMSE by distributing additional samples according to the magnitude of the residual rMSE of the reconstruction. This iterative approach tightly couples the adaptive sampling and adaptive reconstruction strategies, by ensuring that we only sample densely regions of the image where adaptive reconstruction cannot properly resolve the noise. In a first implementation of our framework, we demonstrate the usefulness of our greedy error minimization using a simple reconstruction scheme leveraging a filterbank of isotropic Gaussian filters. In a second implementation, we integrate a powerful edge aware filter that can adapt to the anisotropy of the image. Finally, in a third implementation, we leverage auxiliary feature buffers that encode scene information (such as surface normals, position, or texture), to improve the robustness of the reconstruction in the presence of strong noise.

Recent Advances in Adaptive Sampling and Reconstruction for Monte Carlo Rendering

Monte Carlo integration is firmly established as the basis for most practical realistic image synthesis algorithms because of its flexibility and generality. However, the visual quality of rendered images often suffers from estimator variance, which appears as visually distracting noise. Adaptive sampling and reconstruction algorithms reduce variance by controlling the sampling density and aggregating samples in a reconstruction step, possibly over large image regions. In this paper we survey recent advances in this area. We distinguish between “a priori” methods that analyze the light transport equations and derive sampling rates and reconstruction filters from this analysis, and “a posteriori” methods that apply statistical techniques to sets of samples to drive the adaptive sampling and reconstruction process. They typically estimate the errors of several reconstruction filters, and select the best filter locally to minimize error. We discuss advantages and disadvantages of recent state-of-the-art techniques, and provide visual and quantitative comparisons. Some of these techniques are proving useful in real-world applications, and we aim to provide an overview for practitioners and researchers to assess these approaches. In addition, we discuss directions for potential further improvements.

Regularizing Image Reconstruction for Gradient-Domain Rendering with Feature Patches

We present a novel algorithm to reconstruct high-quality images from sampled pixels and gradients in gradient-domain rendering. Our approach extends screened Poisson reconstruction by adding additional regularization constraints. Our key idea is to exploit local patches in feature images, which contain per-pixels normals, textures, position, etc., to formulate these constraints. We describe a GPU implementation of our approach that runs on the order of seconds on megapixel images. We demonstrate a significant improvement in image quality over screened Poisson reconstruction under the L1 norm. Because we adapt the regularization constraints to the noise level in the input, our algorithm is consistent and converges to the ground truth.

Biomimetic coating of organic polymers with a protein-functionalized layer of calcium phosphate: the surface properties of the carrier influence neither the coating characteristics nor the incorporation mechanism or release kinetics of the protein

Polymers that are used in clinical practice as bone-defect-filling materials possess many essential qualities, such as moldability, mechanical strength and biodegradability, but they are neither osteoconductive nor osteoinductive. Osteoconductivity can be conferred by coating the material with a layer of calcium phosphate, which can be rendered osteoinductive by functionalizing it with an osteogenic agent. We wished to ascertain whether the morphological and physicochemical characteristics of unfunctionalized and bovine-serum-albumin (BSA)-functionalized calcium-phosphate coatings were influenced by the surface properties of polymeric carriers. The release kinetics of the protein were also investigated. Two sponge-like materials (Helistat® and Polyactive®) and two fibrous ones (Ethisorb and poly[lactic-co-glycolic acid]) were tested. The coating characteristics were evaluated using state-of-the-art methodologies. The release kinetics of BSA were monitored spectrophotometrically. The characteristics of the amorphous and the crystalline phases of the coatings were not influenced by either the surface chemistry or the surface geometry of the underlying polymer. The mechanism whereby BSA was incorporated into the crystalline layer and the rate of release of the truly incorporated depot were likewise unaffected by the nature of the polymeric carrier. Our biomimetic coating technique could be applied to either spongy or fibrous bone-defect-filling organic polymers, with a view to rendering them osteoconductive and osteoinductive.

Long-term cell-mediated protein release from calcium phosphate ceramics

Efficient delivery of growth factors from carrier biomaterials depends critically on the release kinetics of the proteins that constitute the carrier. Immobilizing growth factors to calcium phosphate ceramics has been attempted by direct adsorption and usually resulted in a rapid and passive release of the superficially adherent proteins. The insufficient retention of growth factors limited their bioavailability and their efficacy in the treatment of bone regeneration. In this study, a coprecipitation technique of proteins and calcium phosphate was employed to modify the delivery of proteins from biphasic calcium phosphate (BCP) ceramics. To this end, tritium-labeled bovine serum albumin ([(3)H]BSA) was utilized as a model protein to analyze the coprecipitation efficacy and the release kinetics of the protein from the carrier material. Conventional adsorption of [(3)H]BSA resulted in a rapid and passive release of the protein from BCP ceramics, whereas the coprecipitation technique effectively prevented the burst release of [(3)H]BSA. Further analysis of the in vitro kinetics demonstrated a sustained, cell-mediated release of coprecipitated [(3)H]BSA from BCP ceramics induced by resorbing osteoclasts. The coprecipitation technique described herein, achieved a physiologic-like protein release, by incorporating [(3)H]BSA into its respective carriers, rendering it a promising tool in growth factor delivery for bone healing.

Putative cancer stem cells in malignant pleural mesothelioma show resistance to cisplatin and pemetrexed

Malignant pleural mesothelioma (MPM) is a lethal cancer of the mesothelium with high chemotherapeutic resistance via unknown mechanisms. A prevailing hypothesis states that cancer stem cells (CSCs) persist in tumors causing relapse after chemotherapy, thus, rendering these cells as critical targets responsible for tumor resistance and recurrence. We selected candidate CSC markers based on expansion under hypoxic conditions, a hallmark for the selection of chemoresistant cells; and investigated the expression of CSC markers: CD133, Bmi-1, uPAR and ABCG2 in three MPM cell lines and normal mesothelial cells by quantitative RT-PCR. Furthermore, we evaluated the chemotherapeutic resistance associated with each CSC marker by determining the change in CSC marker-mRNA levels as an index of drug-resistance following treatment with either cisplatin or pemetrexed. We demonstrate the expression of CSC markers: CD133, Bmi-1, uPAR and ABCG2 in both normal and MPM cell lines. Bmi-1+, uPAR+ and ABCG2+ cells show a distinct role in conferring chemoresistance to cisplatin and pemetrexed in the malignant setting. By contrast, these markers have no apparent participation in chemoresistance to drug treatments in normal mesothelial cells. Intriguingly, CD133 revealed chemoresistant properties in both normal mesothelial and malignant pleural mesothelioma cells. This study provides evidence of putative CSCs conferring drug-resistance to cisplatin and pemetrexed in MPM cell lines. Specific targeting of these drug-resistant cells, while considering the functional heterogeneity of the MPM subtypes, may contribute to more focused and effective chemotherapeutic regimens for malignant pleural mesothelioma.

Getting in touch-3D printing in Forensic Imaging

With the increasing use of medical imaging in forensics, as well as the technological advances in rapid prototyping, we suggest combining these techniques to generate displays of forensic findings. We used computed tomography (CT), CT angiography, magnetic resonance imaging (MRI) and surface scanning with photogrammetry in conjunction with segmentation techniques to generate 3D polygon meshes. Based on these data sets, a 3D printer created colored models of the anatomical structures. Using this technique, we could create models of bone fractures, vessels, cardiac infarctions, ruptured organs as well as bitemark wounds. The final models are anatomically accurate, fully colored representations of bones, vessels and soft tissue, and they demonstrate radiologically visible pathologies. The models are more easily understood by laypersons than volume rendering or 2D reconstructions. Therefore, they are suitable for presentations in courtrooms and for educational purposes.

Importance of 3D-CT imaging in single-bullet cranioencephalic gunshot wounds

PURPOSE: The aim of this paper is to demonstrate that computed tomography (CT) and three-dimensional (3D) CT imaging techniques can be useful tools for evaluating gunshot wounds of the skull in forensic medicine. Three purposes can be achieved: (1) identifying and recognising the bullet entrance wound - and exit wound, if present; (2) recognising the bullet's intracranial course by studying damage to bone and brain tissue; (3) suggesting hypotheses as to the dynamics of the event. MATERIALS AND METHODS: Ten cadavers of people who died of a fatal head injury caused by a single gunshot were imaged with total-body CT prior to conventional autoptic examination. Three-dimensional-CT reconstructions were obtained with the volume-rendering technique, and data were analysed by two independent observers and compared with autopsy results. RESULTS: In our experience, CT analysis and volumetric reconstruction techniques allowed the identification of the bullet entrance and exit wounds and intracranial trajectory, as well as helping to formulate a hypothesis on the extracranial trajectory to corroborate circumstantial evidence. CONCLUSIONS: CT imaging techniques are excellent tools for addressing the most important questions of forensic medicine in the case of gunshot wounds of the skull, with results as good as (or sometimes better than) traditional autoptic methods.

Novel magnetic iron oxide nanoparticles coated with poly(ethylene imine)-g-poly(ethylene glycol) for potential biomedical application: synthesis, stability, cytotoxicity and MR imaging

Magnetic iron oxide nanoparticles have found application as contrast agents for magnetic resonance imaging (MRI) and as switchable drug delivery vehicles. Their stabilization as colloidal carriers remains a challenge. The potential of poly(ethylene imine)-g-poly(ethylene glycol) (PEGPEI) as stabilizer for iron oxide (γ-Fe₂O₃) nanoparticles was studied in comparison to branched poly(ethylene imine) (PEI). Carrier systems consisting of γ-Fe₂O₃-PEI and γ-Fe₂O₃-PEGPEI were prepared and characterized regarding their physicochemical properties including magnetic resonance relaxometry. Colloidal stability of the formulations was tested in several media and cytotoxic effects in adenocarcinomic epithelial cells were investigated. Synthesized γ-Fe₂O₃ cores showed superparamagnetism and high degree of crystallinity. Diameters of polymer-coated nanoparticles γ-Fe₂O₃-PEI and γ-Fe₂O₃-PEGPEI were found to be 38.7 ± 1.0 nm and 40.4 ± 1.6 nm, respectively. No aggregation tendency was observable for γ-Fe₂O₃-PEGPEI over 12 h even in high ionic strength media. Furthermore, IC₅₀ values were significantly increased by more than 10-fold when compared to γ-Fe₂O₃-PEI. Formulations exhibited r₂ relaxivities of high numerical value, namely around 160 mM⁻¹ s⁻¹. In summary, novel carrier systems composed of γ-Fe₂O₃-PEGPEI meet key quality requirements rendering them promising for biomedical applications, e.g. as MRI contrast agents.

Micromorphology and adhesive performance of Er:YAG laser-treated dentin of primary teeth

This study evaluated (1) the micromorphology by scanning electron microscopy (SEM) and (2) the adhesive performance by microtensile bond strength (μTBS) of diamond bur-treated dentin compared to Er:YAG laser-treated dentin of human primary teeth. (1) For qualitative SEM evaluation, dentin of 18 second primary molars (n = 3/method) was treated with either diamond bur as a control (group 1a: 40 μm diamond bur only (clinical situation); group 1b: grinding + 40 μm diamond bur) or with Er:YAG laser (group 2a (clinical situation, manufacturer's settings): 200 mJ/25 Hz (5 W) + 100 mJ/35 Hz (3.5 W) laser only; group 2b (experimental setting "high"): grinding + 400 mJ/20 Hz (8 W); group 2c (manufacturer's setting "finishing"): grinding + 100 mJ/35 Hz (3.5 W); group 2d (experimental setting "low"): grinding + 50 mJ/35 Hz (1.75 W)). (2) For evaluation of adhesive performance, 64 second primary molars were divided into four groups and treated as described for group 1b and groups 2b/c/d (n = 16/method), and μTBS of Clearfil SE/Clearfil Majesty Esthetic to dentin was measured. The SEM micrographs were qualitatively analyzed. The μTBS values were compared with a Kruskal-Wallis test. The significance level was set at α = 0.05. SEM micrographs showed the typical micromorphologies with a smear layer for the diamond bur groups and open dentin tubules for all laser-treated groups. However, in group 2d, the laser beam had insufficiently irradiated the dentin area, rendering the underlying ground surface partly visible. There were no statistically significant differences between μTBS values of the four groups (p = 0.394). This suggests that Er:YAG laser treatment of dentin of primary molars provides bond strengths similar to those obtained following diamond bur treatment.

Cross-sectional observational study of 208 patients with non-classical urea cycle disorders

Urea cycle disorders (UCDs) are inherited disorders of ammonia detoxification often regarded as mainly of relevance to pediatricians. Based on an increasing number of case studies it has become obvious that a significant number of UCD patients are affected by their disease in a non-classical way: presenting outside the newborn period, following a mild course, presenting with unusual clinical features, or asymptomatic patients with only biochemical signs of a UCD. These patients are surviving into adolescence and adulthood, rendering this group of diseases clinically relevant to adult physicians as well as pediatricians. In preparation for an international workshop we collected data on all patients with non-classical UCDs treated by the participants in 20 European metabolic centres. Information was collected on a cohort of 208 patients 50% of which were ≥ 16 years old. The largest subgroup (121 patients) had X-linked ornithine transcarbamylase deficiency (OTCD) of whom 83 were female and 29% of these were asymptomatic. In index patients, there was a mean delay from first symptoms to diagnosis of 1.6 years. Cognitive impairment was present in 36% of all patients including female OTCD patients (in 31%) and those 41 patients identified presymptomatically following positive newborn screening (in 12%). In conclusion, UCD patients with non-classical clinical presentations require the interest and care of adult physicians and have a high risk of neurological complications. To improve the outcome of UCDs, a greater awareness by health professionals of the importance of hyperammonemia and UCDs, and ultimately avoidance of the still long delay to correctly diagnose the patients, is crucial.

Global Change and the World's Mountains-Research Needs and Emerging Themes for Sustainable Development A Synthesis From the 2010 Perth II Conference

The conference on Global Change and the World’s Mountains held in Perth, Scotland, in 2010 offered a unique opportunity to analyze the state and progress of mountain research and its contribution to sustainable mountain development, as well as to reflect on required reorientations of research agendas. In this paper we provide the results of a three-step assessment of the research presented by 450 researchers from around the world. First, we determined the state of the art of mountain research and categorized it based on the analytical structure of the Global Land Project (GLP 2005). Second, we identified emerging themes for future research. Finally, we assessed the contribution of mountain research to sustainable development along the lines of the Grand Challenges in Global Sustainability Research (International Council for Science 2010). Analysis revealed that despite the growing recognition of the importance of more integrative research (inter- and transdisciplinary), the research community gathered in Perth still focuses on environmental drivers of change and on interactions within ecological systems. Only a small percentage of current research seeks to enhance understanding of social systems and of interactions between social and ecological systems. From the ecological systems perspective, a greater effort is needed to disentangle and assess different drivers of change and to investigate impacts on the rendering of ecosystem services. From the social systems perspective, significant shortcomings remain in understanding the characteristics, trends, and impacts of human movements to, within, and out of mountain areas as a form of global change. Likewise, sociocultural drivers affecting collective behavior as well as incentive systems devised by policy and decision makers are little understood and require more in-depth investigation. Both the complexity of coupled social– ecological systems and incomplete data sets hinder integrated systems research. Increased understanding of linkages and feedbacks between social and ecological systems will help to identify nonlinearities and thresholds (tipping points) in both system types. This presupposes effective collaboration between ecological and social sciences. Reflections on the Grand Challenges in Sustainability Research put forth by the International Council for Science (2010) reveal the need to intensify research on effective responses and innovations. This will help to achieve sustainable development in mountain regions while maintaining the core competence of mountain research in forecasting and observation.

In vitro metacestodicidal activities of genistein and other isoflavones against Echinococcus multilocularis and Echinococcus granulosus

Echinococcus multilocularis and Echinococcus granulosus metacestode infections in humans cause alveolar echinococcosis and cystic echinococcosis, respectively, in which metacestode development in visceral organs often results in particular organ failure. Further, cystic hydatidosis in farm animals causes severe economic losses. Although benzimidazole derivatives such as mebendazole and albendazole are being used as therapeutic agents, there is often no complete recovery after treatment. Hence, in searching for novel treatment options, we examined the in vitro efficacies of a number of isoflavones against Echinococcus metacestodes and protoscoleces. The most prominent isoflavone, genistein, exhibits significant metacestodicidal activity in vitro. However, genistein binds to the estrogen receptor and can thus induce estrogenic effects, which is a major concern during long-term chemotherapy. We have therefore investigated the activities of a number of synthetic genistein derivatives carrying a modified estrogen receptor binding site. One of these, Rm6423, induced dramatic breakdown of the structural integrity of the metacestode germinal layer of both species within 5 to 7 days of in vitro treatment. Further, examination of the culture medium revealed increased leakage of parasite proteins into the medium during treatment, but zymography demonstrated a decrease in the activity of metalloproteases. Moreover, two of the genistein derivatives, Rm6423 and Rm6426, induced considerable damage in E. granulosus protoscoleces, rendering them nonviable. These findings demonstrate that synthetic isoflavones exhibit distinct in vitro effects on Echinococcus metacestodes and protoscoleces, which could potentially be exploited further for the development of novel chemotherapeutical tools against larval-stage Echinococcus infection.