Reconstruction and 3D visualisation based on objective real 3D based documentation

Reconstructions based directly upon forensic evidence alone are called primary information. Historically this consists of documentation of findings by verbal protocols, photographs and other visual means. Currently modern imaging techniques such as 3D surface scanning and radiological methods (Computer Tomography, Magnetic Resonance Imaging) are also applied. Secondary interpretation is based on facts and the examiner's experience. Usually such reconstructive expertises are given in written form, and are often enhanced by sketches. However, narrative interpretations can, especially in complex courses of action, be difficult to present and can be misunderstood. In this report we demonstrate the use of graphic reconstruction of secondary interpretation with supporting pictorial evidence, applying digital visualisation (using 'Poser') or scientific animation (using '3D Studio Max', 'Maya') and present methods of clearly distinguishing between factual documentation and examiners' interpretation based on three cases. The first case involved a pedestrian who was initially struck by a car on a motorway and was then run over by a second car. The second case involved a suicidal gunshot to the head with a rifle, in which the trigger was pushed with a rod. The third case dealt with a collision between two motorcycles. Pictorial reconstruction of the secondary interpretation of these cases has several advantages. The images enable an immediate overview, give rise to enhanced clarity, and compel the examiner to look at all details if he or she is to create a complete image.

Importance of 3D-CT imaging in single-bullet cranioencephalic gunshot wounds

PURPOSE: The aim of this paper is to demonstrate that computed tomography (CT) and three-dimensional (3D) CT imaging techniques can be useful tools for evaluating gunshot wounds of the skull in forensic medicine. Three purposes can be achieved: (1) identifying and recognising the bullet entrance wound - and exit wound, if present; (2) recognising the bullet's intracranial course by studying damage to bone and brain tissue; (3) suggesting hypotheses as to the dynamics of the event. MATERIALS AND METHODS: Ten cadavers of people who died of a fatal head injury caused by a single gunshot were imaged with total-body CT prior to conventional autoptic examination. Three-dimensional-CT reconstructions were obtained with the volume-rendering technique, and data were analysed by two independent observers and compared with autopsy results. RESULTS: In our experience, CT analysis and volumetric reconstruction techniques allowed the identification of the bullet entrance and exit wounds and intracranial trajectory, as well as helping to formulate a hypothesis on the extracranial trajectory to corroborate circumstantial evidence. CONCLUSIONS: CT imaging techniques are excellent tools for addressing the most important questions of forensic medicine in the case of gunshot wounds of the skull, with results as good as (or sometimes better than) traditional autoptic methods.

Photodissociation dynamics of tert-butylnitrite following excitation to the S(1) and S(2) states. A study by velocity-map ion-imaging and 3D-REMPI spectroscopy

Excitation of tert-butylnitrite into the first and second UV absorption bands leads to efficient dissociation into the fragment radicals NO and tert-butoxy in their electronic ground states (2)Π and (2)E, respectively. Velocity distributions and angular anisotropies for the NO fragment in several hundred rotational and vibrational quantum states were obtained by velocity-map imaging and the recently developed 3D-REMPI method. Excitation into the well resolved vibronic progression bands (k = 0, 1, 2) of the NO stretch mode in the S(1) ← S(0) transition produces NO fragments mostly in the vibrational state with v = k, with smaller fractions in v = k - 1 and v = k - 2. It is concluded that dissociation occurs on the purely repulsive PES of S(1) without barrier. All velocity distributions from photolysis via the S(1)(nπ*) state are monomodal and show high negative anisotropy (β ≈ -1). The rotational distributions peak near j = 30.5 irrespective of the vibronic state S(1)(k) excited and the vibrational state v of the NO fragment. On average 46% of the excess energy is converted to kinetic energy, 23% and 31% remain as internal energy in the NO fragment and the t-BuO radical, respectively. Photolysis via excitation into the S(2) ← S(0) transition at 227 nm yields NO fragments with about equal populations in v = 0 and v = 1. The rotational distributions have a single maximum near j = 59.5. The velocity distributions are monomodal with positive anisotropy β ≈ 0.8. The average fractions of the excess energy distributed into translation, internal energy of NO, and internal energy of t-BuO are 39%, 23%, and 38%, respectively. In all cases ∼8500 cm(-1) of energy remain in the internal degrees of freedom of the t-BuO fragment. This is mostly assigned to rotational energy. An ab initio calculation of the dynamic reaction path shows that not only the NO fragment but also the t-BuO fragment gain large angular momentum during dissociation on the purely repulsive potential energy surface of S(2).

Application of 3D documentation and geometric reconstruction methods in traffic accident analysis: with high resolution surface scanning, radiological MSCT/MRI scanning and real data based animation

The examination of traffic accidents is daily routine in forensic medicine. An important question in the analysis of the victims of traffic accidents, for example in collisions between motor vehicles and pedestrians or cyclists, is the situation of the impact. Apart from forensic medical examinations (external examination and autopsy), three-dimensional technologies and methods are gaining importance in forensic investigations. Besides the post-mortem multi-slice computed tomography (MSCT) and magnetic resonance imaging (MRI) for the documentation and analysis of internal findings, highly precise 3D surface scanning is employed for the documentation of the external body findings and of injury-inflicting instruments. The correlation of injuries of the body to the injury-inflicting object and the accident mechanism are of great importance. The applied methods include documentation of the external and internal body and the involved vehicles and inflicting tools as well as the analysis of the acquired data. The body surface and the accident vehicles with their damages were digitized by 3D surface scanning. For the internal findings of the body, post-mortem MSCT and MRI were used. The analysis included the processing of the obtained data to 3D models, determination of the driving direction of the vehicle, correlation of injuries to the vehicle damages, geometric determination of the impact situation and evaluation of further findings of the accident. In the following article, the benefits of the 3D documentation and computer-assisted, drawn-to-scale 3D comparisons of the relevant injuries with the damages to the vehicle in the analysis of the course of accidents, especially with regard to the impact situation, are shown on two examined cases.

Hardware accelerated ray cast of volume data and volume gradient for an optimized splines-based multi-resolution 2D-3D registration

This paper describes a method for DRR generation as well as for volume gradients projection using hardware accelerated 2D texture mapping and accumulation buffering and demonstrates its application in 2D-3D registration of X-ray fluoroscopy to CT images. The robustness of the present registration scheme are guaranteed by taking advantage of a coarse-to-fine processing of the volume/image pyramids based on cubic B-splines. A human cadaveric spine specimen together with its ground truth was used to compare the present scheme with a purely software-based scheme in three aspects: accuracy, speed, and capture ranges. Our experiments revealed an equivalent accuracy and capture ranges but with much shorter registration time with the present scheme. More specifically, the results showed 0.8 mm average target registration error, 55 second average execution time per registration, and 10 mm and 10° capture ranges for the present scheme when tested on a 3.0 GHz Pentium 4 computer.

Non-photorealistic rendering of virtual implant models for computer-assisted fluoroscopy-based surgical procedures

Surgical navigation systems visualize the positions and orientations of surgical instruments and implants as graphical overlays onto a medical image of the operated anatomy on a computer monitor. The orthopaedic surgical navigation systems could be categorized according to the image modalities that are used for the visualization of surgical action. In the so-called CT-based systems or 'surgeon-defined anatomy' based systems, where a 3D volume or surface representation of the operated anatomy could be constructed from the preoperatively acquired tomographic data or through intraoperatively digitized anatomy landmarks, a photorealistic rendering of the surgical action has been identified to greatly improve usability of these navigation systems. However, this may not hold true when the virtual representation of surgical instruments and implants is superimposed onto 2D projection images in a fluoroscopy-based navigation system due to the so-called image occlusion problem. Image occlusion occurs when the field of view of the fluoroscopic image is occupied by the virtual representation of surgical implants or instruments. In these situations, the surgeon may miss part of the image details, even if transparency and/or wire-frame rendering is used. In this paper, we propose to use non-photorealistic rendering to overcome this difficulty. Laboratory testing results on foamed plastic bones during various computer-assisted fluoroscopybased surgical procedures including total hip arthroplasty and long bone fracture reduction and osteosynthesis are shown.

The performance of computer-aided detection when analyzing prior mammograms of newly detected breast cancers with special focus on the time interval from initial imaging to detection

PURPOSE: The clinical role of CAD systems to detect breast cancer, which have not been on cancer containing mammograms not detected by the radiologist was proven retrospectively. METHODS: All patients from 1992 to 2005 with a histologically verified malignant breast lesion and a mammogram at our department, were analyzed in retrospect focussing on the time of detection of the malignant lesion. All prior mammograms were analyzed by CAD (CADx, USA). The resulting CAD printout was matched with the cancer containing images yielding to the radiological diagnosis of breast cancer. CAD performance, sensitivity as well as the association of CAD and radiological features were analyzed. RESULTS: 278 mammograms fulfilled the inclusion criteria. 111 cases showed a retrospectively visible lesion (71 masses, 23 single microcalcification clusters, 16 masses with microcalcifications, in one case two microcalcification clusters). 54/87 masses and 34/41 microcalcifications were detected by CAD. Detection rates varied from 9/20 (ACR 1) to 5/7 (ACR 4) (45% vs. 71%). The detection of microcalcifications was not influenced by breast tissue density. CONCLUSION: CAD might be useful in an earlier detection of subtle breast cancer cases, which might remain otherwise undetected.

Haptics in forensics: the possibilities and advantages in using the haptic device for reconstruction approaches in forensic science

Non-invasive documentation methods such as surface scanning and radiological imaging are gaining in importance in the forensic field. These three-dimensional technologies provide digital 3D data, which are processed and handled in the computer. However, the sense of touch gets lost using the virtual approach. The haptic device enables the use of the sense of touch to handle and feel digital 3D data. The multifunctional application of a haptic device for forensic approaches is evaluated and illustrated in three different cases: the representation of bone fractures of the lower extremities, by traffic accidents, in a non-invasive manner; the comparison of bone injuries with the presumed injury-inflicting instrument; and in a gunshot case, the identification of the gun by the muzzle imprint, and the reconstruction of the holding position of the gun. The 3D models of the bones are generated from the Computed Tomography (CT) images. The 3D models of the exterior injuries, the injury-inflicting tools and the bone injuries, where a higher resolution is necessary, are created by the optical surface scan. The haptic device is used in combination with the software FreeForm Modelling Plus for touching the surface of the 3D models to feel the minute injuries and the surface of tools, to reposition displaced bone parts and to compare an injury-causing instrument with an injury. The repositioning of 3D models in a reconstruction is easier, faster and more precisely executed by means of using the sense of touch and with the user-friendly movement in the 3D space. For representation purposes, the fracture lines of bones are coloured. This work demonstrates that the haptic device is a suitable and efficient application in forensic science. The haptic device offers a new way in the handling of digital data in the virtual 3D space.

The role of 3D fusion imaging in sentinel lymphadenectomy for vulvar cancer

OBJECTIVES: To evaluate the feasibility of fusion imaging compound tomography (FICT) of CT/MRI and single photon emission tomography (SPECT) versus planar scintigraphy only (plSc) in pre-surgical staging for vulvar cancer. MATERIALS AND METHODS: Analysis of consecutive patients with vulvar cancer who preoperatively underwent sentinel scintigraphy (planar and 3D-SPECT imaging) and CT or MRI. Body markers were used for exact anatomical co-registration and fusion datasets were reconstructed using SPECT and CT/MRI. The number and localisation of all intraoperatively identified and resected sentinel lymph nodes (SLN) were compared between planar and 3D fusion imaging. RESULTS: Twenty six SLN were localized on planar scintigraphy. Twelve additional SLN were identified after SPECT and CT/MRI reconstruction, all of them were confirmed intraoperatively. In seven cases where single foci were identified at plSc, fusion imaging revealed grouped individual nodes and five additional localisations were discovered at fusion imaging. In seven patients both methods identified SLN contra lateral to the primary tumor site, but only fusion imaging allowed to localise iliac SLN in four patients. All SLN predicted on fusion imaging could be localised and resected during surgery. CONCLUSIONS: Fusion imaging using SPECT and CT/MRI can detect SLN in vulvar cancer more precisely than planar imaging regarding number and anatomical localisation. FICT revealed additional information in seven out of ten cases (70%).

3D Ultrasound imaging--a useful non-invasive tool to detect AV fistulas in transplanted kidneys

BACKGROUND: A precise, non-invasive, non-toxic, repeatable, convenient and inexpensive follow-up of renal transplants, especially following biopsies, is in the interest of nephrologists. Formerly, the rate of biopsies leading to AV fistulas had been underestimated. Imaging procedures suited to a detailed judgement of these vascular malformations are to be assessed. METHODS: Three-dimensional (3D) reconstruction techniques of ultrasound flow-directed and non-flow-directed energy mode pictures were compared with a standard procedure, gadolinium-enhanced nuclear magnetic resonance imaging angiography (MRA) using the phase contrast technique. RESULTS: Using B-mode and conventional duplex information, AV fistulas were localized in the upper pole of the kidney transplant of the index patient. The 3D reconstruction provided information about the exact localization and orientation of the fistula in relation to other vascular structures, and the flow along the fistula. The MRA provided localization and orientation information, but less functional information. Flow-directed and non-flow-directed energy mode pictures could be reconstructed to provide 3D information about vascular malformations in transplanted kidneys. CONCLUSION: In transplanted kidneys, 3D-ultrasound angiography may be equally as effective as MRA in localizing and identifying AV malformations. Advantages of the ultrasound method are that it is cheaper, non-toxic, non-invasive, more widely availability and that it even provides more functional information. Future prospective studies will be necessary to evaluate the two techniques further.

Accident or homicide - virtual crime scene reconstruction using 3D methods

The analysis and reconstruction of forensically relevant events, such as traffic accidents, criminal assaults and homicides are based on external and internal morphological findings of the injured or deceased person. For this approach high-tech methods are gaining increasing importance in forensic investigations. The non-contact optical 3D digitising system GOM ATOS is applied as a suitable tool for whole body surface and wound documentation and analysis in order to identify injury-causing instruments and to reconstruct the course of event. In addition to the surface documentation, cross-sectional imaging methods deliver medical internal findings of the body. These 3D data are fused into a whole body model of the deceased. Additional to the findings of the bodies, the injury inflicting instruments and incident scene is documented in 3D. The 3D data of the incident scene, generated by 3D laser scanning and photogrammetry, is also included into the reconstruction. Two cases illustrate the methods. In the fist case a man was shot in his bedroom and the main question was, if the offender shot the man intentionally or accidentally, as he declared. In the second case a woman was hit by a car, driving backwards into a garage. It was unclear if the driver drove backwards once or twice, which would indicate that he willingly injured and killed the woman. With this work, we demonstrate how 3D documentation, data merging and animation enable to answer reconstructive questions regarding the dynamic development of patterned injuries, and how this leads to a real data based reconstruction of the course of event.

3D Face Reconstruction from 2D Pictures: First Results of a Web-Based Computer Aided System for Aesthetic Procedures

The human face is a vital component of our identity and many people undergo medical aesthetics procedures in order to achieve an ideal or desired look. However, communication between physician and patient is fundamental to understand the patient’s wishes and to achieve the desired results. To date, most plastic surgeons rely on either “free hand” 2D drawings on picture printouts or computerized picture morphing. Alternatively, hardware dependent solutions allow facial shapes to be created and planned in 3D, but they are usually expensive or complex to handle. To offer a simple and hardware independent solution, we propose a web-based application that uses 3 standard 2D pictures to create a 3D representation of the patient’s face on which facial aesthetic procedures such as filling, skin clearing or rejuvenation, and rhinoplasty are planned in 3D. The proposed application couples a set of well-established methods together in a novel manner to optimize 3D reconstructions for clinical use. Face reconstructions performed with the application were evaluated by two plastic surgeons and also compared to ground truth data. Results showed the application can provide accurate 3D face representations to be used in clinics (within an average of 2 mm error) in less than 5 min.