Reconstruction of patient-specific 3D bone surface from 2D calibrated fluoroscopic images and point distribution model

Reconstruction of patient-specific 3D bone surface from 2D calibrated fluoroscopic images and a point distribution model is discussed. We present a 2D/3D reconstruction scheme combining statistical extrapolation and regularized shape deformation with an iterative image-to-model correspondence establishing algorithm, and show its application to reconstruct the surface of proximal femur. The image-to-model correspondence is established using a non-rigid 2D point matching process, which iteratively uses a symmetric injective nearest-neighbor mapping operator and 2D thin-plate splines based deformation to find a fraction of best matched 2D point pairs between features detected from the fluoroscopic images and those extracted from the 3D model. The obtained 2D point pairs are then used to set up a set of 3D point pairs such that we turn a 2D/3D reconstruction problem to a 3D/3D one. We designed and conducted experiments on 11 cadaveric femurs to validate the present reconstruction scheme. An average mean reconstruction error of 1.2 mm was found when two fluoroscopic images were used for each bone. It decreased to 1.0 mm when three fluoroscopic images were used.

VIRTOPSY--scientific documentation, reconstruction and animation in forensic: individual and real 3D data based geo-metric approach including optical body/object surface and radiological CT/MRI scanning.

Until today, most of the documentation of forensic relevant medical findings is limited to traditional 2D photography, 2D conventional radiographs, sketches and verbal description. There are still some limitations of the classic documentation in forensic science especially if a 3D documentation is necessary. The goal of this paper is to demonstrate new 3D real data based geo-metric technology approaches. This paper present approaches to a 3D geo-metric documentation of injuries on the body surface and internal injuries in the living and deceased cases. Using modern imaging methods such as photogrammetry, optical surface and radiological CT/MRI scanning in combination it could be demonstrated that a real, full 3D data based individual documentation of the body surface and internal structures is possible in a non-invasive and non-destructive manner. Using the data merging/fusing and animation possibilities, it is possible to answer reconstructive questions of the dynamic development of patterned injuries (morphologic imprints) and to evaluate the possibility, that they are matchable or linkable to suspected injury-causing instruments. For the first time, to our knowledge, the method of optical and radiological 3D scanning was used to document the forensic relevant injuries of human body in combination with vehicle damages. By this complementary documentation approach, individual forensic real data based analysis and animation were possible linking body injuries to vehicle deformations or damages. These data allow conclusions to be drawn for automobile accident research, optimization of vehicle safety (pedestrian and passenger) and for further development of crash dummies. Real 3D data based documentation opens a new horizon for scientific reconstruction and animation by bringing added value and a real quality improvement in forensic science.

3D-modeling of Mercury's solar wind sputtered surface-exosphere environment

The efficiency of sputtered refractory elements by H+ and He++ solar wind ions from Mercury's surface and their contribution to the exosphere are studied for various solar wind conditions. A 3D solar wind-planetary interaction hybrid model is used for the evaluation of precipitation maps of the sputter agents on Mercury's surface. By assuming a global mineralogical surface composition, the related sputter yields are calculated by means of the 2013 SRIM code and are coupled with a 3D exosphere model. Because of Mercury's magnetic field, for quiet and nominal solar wind conditions the plasma can only precipitate around the polar areas, while for extreme solar events (fast solar wind, coronal mass ejections, interplanetary magnetic clouds) the solar wind plasma has access to the entire dayside. In that case the release of particles form the planet's surface can result in an exosphere density increase of more than one order of magnitude. The corresponding escape rates are also about an order of magnitude higher. Moreover, the amount of He++ ions in the precipitating solar plasma flow enhances also the release of sputtered elements from the surface in the exosphere. A comparison of our model results with MESSENGER observations of sputtered Mg and Ca elements in the exosphere shows a reasonable quantitative agreement. (C) 2015 Elsevier Ltd. All rights reserved.

Getting in touch-3D printing in Forensic Imaging

With the increasing use of medical imaging in forensics, as well as the technological advances in rapid prototyping, we suggest combining these techniques to generate displays of forensic findings. We used computed tomography (CT), CT angiography, magnetic resonance imaging (MRI) and surface scanning with photogrammetry in conjunction with segmentation techniques to generate 3D polygon meshes. Based on these data sets, a 3D printer created colored models of the anatomical structures. Using this technique, we could create models of bone fractures, vessels, cardiac infarctions, ruptured organs as well as bitemark wounds. The final models are anatomically accurate, fully colored representations of bones, vessels and soft tissue, and they demonstrate radiologically visible pathologies. The models are more easily understood by laypersons than volume rendering or 2D reconstructions. Therefore, they are suitable for presentations in courtrooms and for educational purposes.

The examination and identification of bite marks in foods using 3D scanning and 3D comparison methods

Bite mark analysis offers the opportunity to identify the biter based on the individual characteristics of the dentitions. Normally, the main focus is on analysing bite mark injuries on human bodies, but also, bite marks in food may play an important role in the forensic investigation of a crime. This study presents a comparison of simulated bite marks in different kinds of food with the dentitions of the presumed biter. Bite marks were produced by six adults in slices of buttered bread, apples, different kinds of Swiss chocolate and Swiss cheese. The time-lapse influence of the bite mark in food, under room temperature conditions, was also examined. For the documentation of the bite marks and the dentitions of the biters, 3D optical surface scanning technology was used. The comparison was performed using two different software packages: the ATOS modelling and analysing software and the 3D studio max animation software. The ATOS software enables an automatic computation of the deviation between the two meshes. In the present study, the bite marks and the dentitions were compared, as well as the meshes of each bite mark which were recorded in the different stages of time lapse. In the 3D studio max software, the act of biting was animated to compare the dentitions with the bite mark. The examined food recorded the individual characteristics of the dentitions very well. In all cases, the biter could be identified, and the dentitions of the other presumed biters could be excluded. The influence of the time lapse on the food depends on the kind of food and is shown on the diagrams. However, the identification of the biter could still be performed after a period of time, based on the recorded individual characteristics of the dentitions.

Analysis of 3D Soft Tissue Changes After 1- and 2-Jaw Orthognathic Surgery in Mandibular Prognathism Patients

Purpose Orthognathic surgery has the objective of altering facial balance to achieve esthetic results in patients who have severe disharmony of the jaws. The purpose was to quantify the soft tissue changes after orthognathic surgery, as well as to assess the differences in 3D soft tissue changes in the middle and lower third of the face between the 1- and 2-jaw surgery groups, in mandibular prognathism patients. Materials and Methods We assessed soft tissue changes of patients who have been diagnosed with mandibular prognathism and received either isolated mandibular surgery or bimaxillary surgery. The quantitative surface displacement was assessed by superimposing preoperative and postoperative volumetric images. An observer measured a surface-distance value that is shown as a contour line. Differences between the groups were determined by the Mann-Whitney U test. The Spearman correlation coefficient was used to evaluate a potential correlation between patients' surgical and cephalometric variables and soft tissue changes after orthognathic surgery in each group. Results There were significant differences in the middle third of the face between the 1- and 2-jaw surgery groups. Soft tissues in the lower third of the face changed in both surgery groups, but not significantly. The correlation patterns were more evident in the lower third of the face. Conclusion The overall soft tissue changes of the midfacial area were more evident in the 2-jaw surgery group. In 2-jaw surgery, significant changes would be expected in the midfacial area, but caution should be exercised in patients who have a wide alar base.

Photodissociation dynamics of tert-butylnitrite following excitation to the S(1) and S(2) states. A study by velocity-map ion-imaging and 3D-REMPI spectroscopy

Excitation of tert-butylnitrite into the first and second UV absorption bands leads to efficient dissociation into the fragment radicals NO and tert-butoxy in their electronic ground states (2)Π and (2)E, respectively. Velocity distributions and angular anisotropies for the NO fragment in several hundred rotational and vibrational quantum states were obtained by velocity-map imaging and the recently developed 3D-REMPI method. Excitation into the well resolved vibronic progression bands (k = 0, 1, 2) of the NO stretch mode in the S(1) ← S(0) transition produces NO fragments mostly in the vibrational state with v = k, with smaller fractions in v = k - 1 and v = k - 2. It is concluded that dissociation occurs on the purely repulsive PES of S(1) without barrier. All velocity distributions from photolysis via the S(1)(nπ*) state are monomodal and show high negative anisotropy (β ≈ -1). The rotational distributions peak near j = 30.5 irrespective of the vibronic state S(1)(k) excited and the vibrational state v of the NO fragment. On average 46% of the excess energy is converted to kinetic energy, 23% and 31% remain as internal energy in the NO fragment and the t-BuO radical, respectively. Photolysis via excitation into the S(2) ← S(0) transition at 227 nm yields NO fragments with about equal populations in v = 0 and v = 1. The rotational distributions have a single maximum near j = 59.5. The velocity distributions are monomodal with positive anisotropy β ≈ 0.8. The average fractions of the excess energy distributed into translation, internal energy of NO, and internal energy of t-BuO are 39%, 23%, and 38%, respectively. In all cases ∼8500 cm(-1) of energy remain in the internal degrees of freedom of the t-BuO fragment. This is mostly assigned to rotational energy. An ab initio calculation of the dynamic reaction path shows that not only the NO fragment but also the t-BuO fragment gain large angular momentum during dissociation on the purely repulsive potential energy surface of S(2).

An integrated approach for reconstructing surface models of the proximal femur from sparse input data for surgical navigation

A patient-specific surface model of the proximal femur plays an important role in planning and supporting various computer-assisted surgical procedures including total hip replacement, hip resurfacing, and osteotomy of the proximal femur. The common approach to derive 3D models of the proximal femur is to use imaging techniques such as computed tomography (CT) or magnetic resonance imaging (MRI). However, the high logistic effort, the extra radiation (CT-imaging), and the large quantity of data to be acquired and processed make them less functional. In this paper, we present an integrated approach using a multi-level point distribution model (ML-PDM) to reconstruct a patient-specific model of the proximal femur from intra-operatively available sparse data. Results of experiments performed on dry cadaveric bones using dozens of 3D points are presented, as well as experiments using a limited number of 2D X-ray images, which demonstrate promising accuracy of the present approach.

Projector-based augmented reality for intuitive intraoperative guidance in image-guided 3D interstitial brachytherapy

PURPOSE: The aim of this study is to implement augmented reality in real-time image-guided interstitial brachytherapy to allow an intuitive real-time intraoperative orientation. METHODS AND MATERIALS: The developed system consists of a common video projector, two high-resolution charge coupled device cameras, and an off-the-shelf notebook. The projector was used as a scanning device by projecting coded-light patterns to register the patient and superimpose the operating field with planning data and additional information in arbitrary colors. Subsequent movements of the nonfixed patient were detected by means of stereoscopically tracking passive markers attached to the patient. RESULTS: In a first clinical study, we evaluated the whole process chain from image acquisition to data projection and determined overall accuracy with 10 patients undergoing implantation. The described method enabled the surgeon to visualize planning data on top of any preoperatively segmented and triangulated surface (skin) with direct line of sight during the operation. Furthermore, the tracking system allowed dynamic adjustment of the data to the patient's current position and therefore eliminated the need for rigid fixation. Because of soft-part displacement, we obtained an average deviation of 1.1 mm by moving the patient, whereas changing the projector's position resulted in an average deviation of 0.9 mm. Mean deviation of all needles of an implant was 1.4 mm (range, 0.3-2.7 mm). CONCLUSIONS: The developed low-cost augmented-reality system proved to be accurate and feasible in interstitial brachytherapy. The system meets clinical demands and enables intuitive real-time intraoperative orientation and monitoring of needle implantation.

The impact of different nanoparticle surface chemistry and size on uptake and toxicity in a murine macrophage cell line

This study investigated the uptake, kinetics and cellular distribution of different surface coated quantum dots (QDs) before relating this to their toxicity. J774.A1 cells were treated with organic, COOH and NH2 (PEG) surface coated QDs (40 nM). Model 20 nm and 200 nm COOH-modified coated polystyrene beads (PBs) were also examined (50 microg ml(-1)). The potential for uptake of QDs was examined by both fixed and live cell confocal microscopy as well as by flow cytometry over 2 h. Both the COOH 20 nm and 200 nm PBs were clearly and rapidly taken up by the J774.A1 cells, with uptake of 20 nm PBs being relatively quicker and more extensive. Similarly, COOH QDs were clearly taken up by the macrophages. Uptake of NH2 (PEG) QDs was not detectable by live cell imaging however, was observed following 3D reconstruction of fixed cells, as well as by flow cytometry. Cells treated with organic QDs, monitored by live cell imaging, showed only a small amount of uptake in a relatively small number of cells. This uptake was insufficient to be detected by flow cytometry. Imaging of fixed cells was not possible due to a loss in cell integrity related to cytotoxicity. A significant reduction (p<0.05) in the fluorescent intensity in a cell-free environment was found with organic QDs, NH2 (PEG) QDs, 20 nm and 200 nm PBs at pH 4.0 (indicative of an endosome) after 2 h, suggesting reduced stability. No evidence of exocytosis was found over 2 h. These findings confirm that surface coating has a significant influence on the mode of NP interaction with cells, as well as the subsequent consequences of that interaction.

Accuracy of navigated surgery of the pelvis after surface matching with an a-mode ultrasound probe

Computer-aided surgery (CAS) allows for real-time intraoperative feedback resulting in increased accuracy, while reducing intraoperative radiation. CAS is especially useful for the treatment of certain pelvic ring fractures, which necessitate the precise placement of screws. Flouroscopy-based CAS modules have been developed for many orthopedic applications. The integration of the isocentric flouroscope even enables navigation using intraoperatively acquired three-dimensional (3D) data, though the scan volume and imaging quality are limited. Complicated and comprehensive pathologies in regions like the pelvis can necessitate a CT-based navigation system because of its larger field of view. To be accurate, the patient's anatomy must be registered and matched with the virtual object (CT data). The actual precision within the region of interest depends on the area of the bone where surface matching is performed. Conventional surface matching with a solid pointer requires extensive soft tissue dissection. This contradicts the primary purpose of CAS as a minimally invasive alternative to conventional surgical techniques. We therefore integrated an a-mode ultrasound pointer into the process of surface matching for pelvic surgery and compared it to the conventional method. Accuracy measurements were made in two pelvic models: a foam model submerged in water and one with attached porcine muscle tissue. Three different tissue depths were selected based on CT scans of 30 human pelves. The ultrasound pointer allowed for registration of virtually any point on the pelvis. This method of surface matching could be successfully integrated into CAS of the pelvis.

A system for 3-D reconstruction of a patient-specific surface model from calibrated X-ray images

This paper presents a system for 3-D reconstruction of a patient-specific surface model from calibrated X-ray images. Our system requires two X-ray images of a patient with one acquired from the anterior-posterior direction and the other from the axial direction. A custom-designed cage is utilized in our system to calibrate both images. Starting from bone contours that are interactively identified from the X-ray images, our system constructs a patient-specific surface model of the proximal femur based on a statistical model based 2D/3D reconstruction algorithm. In this paper, we present the design and validation of the system with 25 bones. An average reconstruction error of 0.95 mm was observed.

Accident or homicide - virtual crime scene reconstruction using 3D methods

The analysis and reconstruction of forensically relevant events, such as traffic accidents, criminal assaults and homicides are based on external and internal morphological findings of the injured or deceased person. For this approach high-tech methods are gaining increasing importance in forensic investigations. The non-contact optical 3D digitising system GOM ATOS is applied as a suitable tool for whole body surface and wound documentation and analysis in order to identify injury-causing instruments and to reconstruct the course of event. In addition to the surface documentation, cross-sectional imaging methods deliver medical internal findings of the body. These 3D data are fused into a whole body model of the deceased. Additional to the findings of the bodies, the injury inflicting instruments and incident scene is documented in 3D. The 3D data of the incident scene, generated by 3D laser scanning and photogrammetry, is also included into the reconstruction. Two cases illustrate the methods. In the fist case a man was shot in his bedroom and the main question was, if the offender shot the man intentionally or accidentally, as he declared. In the second case a woman was hit by a car, driving backwards into a garage. It was unclear if the driver drove backwards once or twice, which would indicate that he willingly injured and killed the woman. With this work, we demonstrate how 3D documentation, data merging and animation enable to answer reconstructive questions regarding the dynamic development of patterned injuries, and how this leads to a real data based reconstruction of the course of event.