Landmark-based augmented reality system for paranasal and transnasal endoscopic surgeries

BACKGROUND: In this paper we present a landmark-based augmented reality (AR) endoscope system for endoscopic paranasal and transnasal surgeries along with fast and automatic calibration and registration procedures for the endoscope. METHODS: Preoperatively the surgeon selects natural landmarks or can define new landmarks in CT volume. These landmarks are overlaid, after proper registration of preoperative CT to the patient, on the endoscopic video stream. The specified name of the landmark, along with selected colour and its distance from the endoscope tip, is also augmented. The endoscope optics are calibrated and registered by fast and automatic methods. Accuracy of the system is evaluated in a metallic grid and cadaver set-up. RESULTS: Root mean square (RMS) error of the system is 0.8 mm in a controlled laboratory set-up (metallic grid) and was 2.25 mm during cadaver studies. CONCLUSIONS: A novel landmark-based AR endoscope system is implemented and its accuracy is evaluated. Augmented landmarks will help the surgeon to orientate and navigate the surgical field. Studies prove the capability of the system for the proposed application. Further clinical studies are planned in near future.

Methods and Applications in Interactive Broadcasting

Interactive TV technology has been addressed in many previous works, but there is sparse research on the topic of interactive content broadcasting and how to support the production process. In this article, the interactive broadcasting process is broadly defined to include studio technology and digital TV applications at consumer set-top boxes. In particular, augmented reality studio technology employs smart-projectors as light sources and blends real scenes with interactive computer graphics that are controlled at end-user terminals. Moreover, TV producer-friendly multimedia authoring tools empower the development of novel TV formats. Finally, the support for user-contributed content raises the potential to revolutionize the hierarchical TV production process, by introducing the viewer as part of content delivery chain.

Cement-augmented anterior screw fixation of Type II odontoid fractures in elderly patients with osteoporosis

BACKGROUND CONTEXT: Closed reduction and internal fixation by an anterior approach is an established option for operative treatment of displaced Type II odontoid fractures. In elderly patients, however, inadequate screw purchase in osteoporotic bone can result in severe procedure-related complications. PURPOSE: To improve the stability of odontoid fracture screw fixation in the elderly using a new technique that includes injection of polymethylmethacrylat (PMMA) cement into the C2 body. STUDY DESIGN: Retrospective review of hospital and outpatient records as well as radiographs of elderly patients treated in a university hospital department of orthopedic surgery. PATIENT SAMPLE: Twenty-four elderly patients (8 males and 16 females; mean age, 81 years; range, 62-98 years) with Type II fractures of the dens. OUTCOME MEASURES: Complications, cement leakage (symptomatic/asymptomatic), operation time, loss of reduction, pseudarthrosis and revision surgery, patient complaints, return to normal activities, and signs of neurologic complications were all documented. METHODS: After closed reduction and anterior approach to the inferior border of C2, a guide wire is advanced to the tip of the odontoid under biplanar fluoroscopic control. Before the insertion of one cannulated, self-drilling, short thread screws, a 12 gauge Yamshidi cannula is inserted from anterior and 1 to 3 mL of high-viscosity PMMA cement is injected into the anteroinferior portion of the C2 body. During polymerization of the cement, the screws are further inserted using a lag-screw compression technique. The cervical spine then is immobilized with a soft collar for 8 weeks postoperatively. RESULTS: Anatomical reduction of the dens was achieved in all 24 patients. Mean operative time was 64 minutes (40-90 minutes). Early loss of reduction occurred in three patients, but revision surgery was indicated in only one patient 2 days after primary surgery. One patient died within the first eight postoperative weeks, one within 3 months after surgery. In five patients, asymptomatic cement leakage was observed (into the C1-C2 joint in three patients, into the fracture in two). Conventional radiologic follow-up at 2 and 6 months confirmed anatomical healing in 16 of the19 patients with complete follow-up. In two patients, the fractures healed in slight dorsal angulation; one patient developed a asymptomatic pseudarthrosis. All patients were able to resume their pretrauma level of activity. CONCLUSIONS: Cement augmentation of the screw in Type II odontoid fractures in elderly patients is technically feasible in a clinical setting with a low complication rate. This technique may improve screw purchase, especially in the osteoporotic C2 body.

Osteocyte lacunar density and area in newly formed bone of the augmented sinus

OBJECTIVES Osteocytes, the most common cells of the bone, are buried in lacunae. Density and area of the osteocyte lacunae change with increasing maturation of the newly formed bone. Evaluation of osteocyte lacunae can therefore provide insights into the process of graft consolidation. MATERIALS AND METHODS Here, we determined the osteocyte lacunar density (number of osteocyte lacunae per bone area; N.Ot/BAr) and the osteocyte lacunar area in μm(2) (Lac.Ar) in histological specimens 6 and 12 weeks after the sinuses of 10 minipigs were augmented with Bio-Oss(®) , a deproteinized bovine bone mineral, and Ostim(®) , an aqueous paste of synthetic nanoparticular hydroxyapatite. The region of interest was defined by the following criteria: (i) >1 mm from the host bone, (ii) >0.5 mm from the sinus mucosa, (iii) minimum area of 0.2 mm(2) , and (iv) bone tissue spanning at least two bone substitute particles. RESULTS The overall osteocyte lacunar density was significantly higher in the Bio-Oss(®) group than in the Ostim(®) group and decreased during the observation period at a similar range in both groups. The osteocyte lacunar area was smaller in the Bio-Oss(®) group than the Ostim(®) group but there was no significant change within the groups over time. CONCLUSIONS These results suggest that bone substitutes affect the osteocyte lacunar density and the osteocyte lacunar area in the newly formed bone within the augmented sinus in this particular model situation. These measures can provide insights into the maturation of newly formed bone in the augmented sinus.

Long-term clinical, microbiological, and radiographic outcomes of Brånemark™ implants installed in augmented maxillary bone for fixed full-arch rehabilitation

PURPOSE The purpose of this study was to document the long-term outcome of Brånemark implants installed in augmented maxillary bone and to identify parameters that are associated with peri-implant bone level. MATERIAL AND METHODS Patients of a periodontal practice who had been referred to a maxillofacial surgeon for iliac crest bone grafting in the atrophic maxilla were retrospectively recruited. Five months following grafting, they received 7-8 turned Brånemark implants. Following submerged healing of another 5 months, implants were uncovered and restorative procedures for fixed rehabilitation were initiated 2-3 months thereafter. The primary outcome variable was bone level defined as the distance from the implant-abutment interface to the first visible bone-to-implant contact. Secondary outcome variables included plaque index, bleeding index, probing depth, and levels of 40 species in subgingival plaque samples as identified by means of checkerboard DNA-DNA hybridization. RESULTS Nine out of 16 patients (eight females, one male; mean age 59) with 71 implants agreed to come in for evaluation after on average 9 years (SD 4; range 3-13) of function. One implant was deemed mobile at the time of inspection. Clinical conditions were acceptable with 11% of the implants showing pockets ≥ 5 mm. Periodontopathogens were encountered frequently and in high numbers. Clinical parameters and bacterial levels were highly patient dependent. The mean bone level was 2.30 mm (SD 1.53; range 0.00-6.95), with 23% of the implants demonstrating advanced resorption (bone level > 3 mm). Regression analysis showed a significant association of the patient (p < .001) and plaque index (p = .007) with bone level. CONCLUSIONS The long-term outcome of Brånemark implants installed in iliac crest-augmented maxillary bone is acceptable; however, advanced peri-implant bone loss is rather common and indicative of graft resorption. This phenomenon is patient dependent and seems also associated with oral hygiene.

An experimentally validated finite element method for augmented vertebral bodies

Background Finite element models of augmented vertebral bodies require a realistic modelling of the cement infiltrated region. Most methods published so far used idealized cement shapes or oversimplified material models for the augmented region. In this study, an improved, anatomy-specific, homogenized finite element method was developed and validated to predict the apparent as well as the local mechanical behavior of augmented vertebral bodies. Methods Forty-nine human vertebral body sections were prepared by removing the cortical endplates and scanned with high-resolution peripheral quantitative CT before and after injection of a standard and a low-modulus bone cement. Forty-one specimens were tested in compression to measure stiffness, strength and contact pressure distributions between specimens and loading-plates. From the remaining eight, fourteen cylindrical specimens were extracted from the augmented region and tested in compression to obtain material properties. Anatomy-specific finite element models were generated from the CT data. The models featured element-specific, density-fabric-based material properties, damage accumulation, real cement distributions and experimentally determined material properties for the augmented region. Apparent stiffness and strength as well as contact pressure distributions at the loading plates were compared between simulations and experiments. Findings The finite element models were able to predict apparent stiffness (R2 > 0.86) and apparent strength (R2 > 0.92) very well. Also, the numerically obtained pressure distributions were in reasonable quantitative (R2 > 0.48) and qualitative agreement with the experiments. Interpretation The proposed finite element models have proven to be an accurate tool for studying the apparent as well as the local mechanical behavior of augmented vertebral bodies.

Augmented environments for the targeting of hepatic lesions during image-guided robotic liver surgery

BACKGROUND Stereotactic navigation technology can enhance guidance during surgery and enable the precise reproduction of planned surgical strategies. Currently, specific systems (such as the CAS-One system) are available for instrument guidance in open liver surgery. This study aims to evaluate the implementation of such a system for the targeting of hepatic tumors during robotic liver surgery. MATERIAL AND METHODS Optical tracking references were attached to one of the robotic instruments and to the robotic endoscopic camera. After instrument and video calibration and patient-to-image registration, a virtual model of the tracked instrument and the available three-dimensional images of the liver were displayed directly within the robotic console, superimposed onto the endoscopic video image. An additional superimposed targeting viewer allowed for the visualization of the target tumor, relative to the tip of the instrument, for an assessment of the distance between the tumor and the tool for the realization of safe resection margins. RESULTS Two cirrhotic patients underwent robotic navigated atypical hepatic resections for hepatocellular carcinoma. The augmented endoscopic view allowed for the definition of an accurate resection margin around the tumor. The overlay of reconstructed three-dimensional models was also used during parenchymal transection for the identification of vascular and biliary structures. Operative times were 240 min in the first case and 300 min in the second. There were no intraoperative complications. CONCLUSIONS The da Vinci Surgical System provided an excellent platform for image-guided liver surgery with a stable optic and instrumentation. Robotic image guidance might improve the surgeon's orientation during the operation and increase accuracy in tumor resection. Further developments of this technological combination are needed to deal with organ deformation during surgery.

Design and Implementation of a Laparoscope Calibration Method for Augmented Reality Navigation

Intraoperative laparoscopic calibration remains a challenging task. In this work we present a new method and instrumentation for intraoperative camera calibration. Contrary to conventional calibration methods, the proposed technique allows intraoperative laparoscope calibration from single perspective observations, resulting in a standardized scheme for calibrating in a clinical scenario. Results show an average displacement error of 0.52 ± 0.19 mm, indicating sufficient accuracy for clinical use. Additionally, the proposed method is validated clinically by performing a calibration during the surgery.

Generation of an hTERT-restricted, CMV-augmented oncolytic adenovirus capable of tumor-specific transgene expression: Development, characterization, and optimization

Current shortcomings in cancer therapy require the generation of new, broadly applicable, potent, targeted treatments. Here, an adenovirus is engineered to replicate specifically in cells with active human telomerase promotion using a modified hTERT promoter, fused to a CMV promoter element. The virus was also modified to contain a visible reporter transgene, GFP. The virus, Ad/hTC-GFP-E1 was characterized in vitro and demonstrated tumor specific activity both by dose and over time course experiments in a variety of cell lines. In vivo, Ad/hTC-GFP-E1 was affected at suppressing tumor growth and providing a survival benefit without causing any measurable toxicity. To increase the host range of the vector, the fiber region was modified to contain an RGD-motif. The vector, AdRGD/hTC-GFP-E1, was recharacterized in vitro, revealing heightened levels of infectivity and toxicity however maintaining a therapeutic window between cancer and normal cell toxicity. AdRGD/hTC-GFP-E1 was administered in vivo by limb perfusion and was observed to be tumor specific both in expression and replication. To further enhance the efficacy of viral vectors in lung delivery, asthma medications were investigated for their abilities to enhance transgene delivery and expression. A combination of bronchodilators, mast cell inhibitors, and mucolytic agents was devised which demonstrated fold increases in expression in immunocompetent mouse lungs as single agents and more homogenous, intense levels of expression when done in combination of all agents. To characterize the methods in which some cancers are resistant or may become resistant to oncolytic treatments, several small molecule inhibitors of metabolic pathways were applied in combination with oncolytic infection in vitro. SP600125 and PD 98059, respective JNK and ERK inhibitors, successfully suppressed oncolytic toxicity, however did not affect infectivity or transgene expression of Ad/hTC-GFP-E1. JNK and ERK inhibition did significantly suppress viral replication, however, as analyzed by lysate transfer and titration assays. In contrast, SB 203580, an inhibitor for p38, did not demonstrate any protective effects with infected cells. Flow cytometric analysis indicated a possible correlation with G1 arrest and suppressed viral production, however more compounds must be investigated to clarify this observation. ^

On the non-slip boundary condition enforcement in SPH methods.

The implementation of boundary conditions is one of the points where the SPH methodology still has some work to do. The aim of the present work is to provide an in-depth analysis of the most representative mirroring techniques used in SPH to enforce boundary conditions (BC) along solid profiles. We specifically refer to dummy particles, ghost particles, and Takeda et al. [1] boundary integrals. A Pouseuille flow has been used as a example to gradually evaluate the accuracy of the different implementations. Our goal is to test the behavior of the second-order differential operator with the proposed boundary extensions when the smoothing length h and other dicretization parameters as dx/h tend simultaneously to zero. First, using a smoothed continuous approximation of the unidirectional Pouseuille problem, the evolution of the velocity profile has been studied focusing on the values of the velocity and the viscous shear at the boundaries, where the exact solution should be approximated as h decreases. Second, to evaluate the impact of the discretization of the problem, an Eulerian SPH discrete version of the former problem has been implemented and similar results have been monitored. Finally, for the sake of completeness, a 2D Lagrangian SPH implementation of the problem has been also studied to compare the consequences of the particle movement

Airport Taxi Planning: Lagrangian Decomposition

The airport taxi planning (TP) module is a decision tool intended to guide airport surface management operations. TP is defined by a flow network optimization model that represents flight ground movements and improves aircraft taxiing routes and schedules during periods of aircraft congestion. TP is not intended to operate as a stand‐alone tool for airport operations management: on the contrary, it must be used in conjunction with existing departing and arriving traffic tools and overseen by the taxi planner of the airport, also known as the aircraft ground controller. TP must be flexible in order to accommodate changing inputs while maintaining consistent routes and schedules already delivered from past executions. Within this dynamic environment, the execution time of TP may not exceed a few minutes. Classic methods for solving binary multi‐commodity flow networks with side constraints are not efficient enough; therefore, a Lagrangian decomposition methodology has been adapted to solve it. We demonstrate TP Lagrangian decomposition using actual data from the Madrid‐Barajas Airport

Lagrangian skeleton on the Gulf of Mexico oil spill

The understanding of the circulation of ocean currents, the exchange of CO2 between atmosphere and oceans, and the influence of the oceans on the distribution of heat on a global scale is key to our ability to predict and assess the future evolution of climate [1, 2]. Global climate change is affecting sea breathing through mechanisms not yet understood.

A global Lagrangian descriptor applied to the Kuroshio current

A global Lagrangian descriptor applied to the Kuroshio current

The application of inverse-dispersion and gradient methods to estimate ammonia emissions from a penguin colony.

Penguin colonies represent some of the most concentrated sources of ammonia emissions to the atmosphere in the world. The ammonia emitted into the atmosphere can have a large influence on the nitrogen cycling of ecosystems near the colonies. However, despite the ecological importance of the emissions, no measurements of ammonia emissions from penguin colonies have been made. The objective of this work was to determine the ammonia emission rate of a penguin colony using inverse-dispersion modelling and gradient methods. We measured meteorological variables and mean atmospheric concentrations of ammonia at seven locations near a colony of Adélie penguins in Antarctica to provide input data for inverse-dispersion modelling. Three different atmospheric dispersion models (ADMS, LADD and a Lagrangian stochastic model) were used to provide a robust emission estimate. The Lagrangian stochastic model was applied both in ‘forwards’ and ‘backwards’ mode to compare the difference between the two approaches. In addition, the aerodynamic gradient method was applied using vertical profiles of mean ammonia concentrations measured near the centre of the colony. The emission estimates derived from the simulations of the three dispersion models and the aerodynamic gradient method agreed quite well, giving a mean emission of 1.1 g ammonia per breeding pair per day (95% confidence interval: 0.4–2.5 g ammonia per breeding pair per day). This emission rate represents a volatilisation of 1.9% of the estimated nitrogen excretion of the penguins, which agrees well with that estimated from a temperature-dependent bioenergetics model. We found that, in this study, the Lagrangian stochastic model seemed to give more reliable emission estimates in ‘forwards’ mode than in ‘backwards’ mode due to the assumptions made.

Lagrangian descriptors: a method for revealing phase space structures of general time dependent dynamical systems

Lagrangian descriptors are a recent technique which reveals geometrical structures in phase space and which are valid for aperiodically time dependent dynamical systems. We discuss a general methodology for constructing them and we discuss a "heuristic argument" that explains why this method is successful. We support this argument by explicit calculations on a benchmark problem. Several other benchmark examples are considered that allow us to assess the performance of Lagrangian descriptors with both finite time Lyapunov exponents (FTLEs) and finite time averages of certain components of the vector field ("time averages"). In all cases Lagrangian descriptors are shown to be both more accurate and computationally efficient than these methods.