Landmark-based augmented reality system for paranasal and transnasal endoscopic surgeries

BACKGROUND: In this paper we present a landmark-based augmented reality (AR) endoscope system for endoscopic paranasal and transnasal surgeries along with fast and automatic calibration and registration procedures for the endoscope. METHODS: Preoperatively the surgeon selects natural landmarks or can define new landmarks in CT volume. These landmarks are overlaid, after proper registration of preoperative CT to the patient, on the endoscopic video stream. The specified name of the landmark, along with selected colour and its distance from the endoscope tip, is also augmented. The endoscope optics are calibrated and registered by fast and automatic methods. Accuracy of the system is evaluated in a metallic grid and cadaver set-up. RESULTS: Root mean square (RMS) error of the system is 0.8 mm in a controlled laboratory set-up (metallic grid) and was 2.25 mm during cadaver studies. CONCLUSIONS: A novel landmark-based AR endoscope system is implemented and its accuracy is evaluated. Augmented landmarks will help the surgeon to orientate and navigate the surgical field. Studies prove the capability of the system for the proposed application. Further clinical studies are planned in near future.

Expression, purification, and projection structure by single particle electron microscopy of functional human TRPM4 heterologously expressed in Xenopus laevis oocytes

Despite efforts implicating the cationic channel transient receptor potential melastatin member 4 (TRPM4) to cardiac, nervous, and immunological pathologies, little is known about its structure and function. In this study, we optimized the requirements for purification and extraction of functional human TRPM4 protein and investigated its supra-molecular assembly. We selected the Xenopus laevis oocyte expression system because it lacks endogenous TRPM4 expression, it is known to overexpress functional human membrane channels, can be used for structure-function analysis within the same system, and is easily scaled to improve yield and develop moderate throughput capabilities through the use of robotics. Negative-stain electron microscopy (EM) revealed various sized low-resolution particles. Single particle analysis identified the majority of the projections represented the monomeric form with additional oligomeric structures potentially characterized as tetramers. Two-electrode voltage clamp electrophysiology demonstrated that human TRPM4 is functionally expressed at the oocyte plasma membrane. This study opens the door for medium-throughput screening and structure-function determination of this important therapeutically relevant target.

Comparison of freehand-navigated and aiming device-navigated targeting of liver lesions

BACKGROUND Accurate needle placement is crucial for the success of percutaneous radiological needle interventions. We compared three guiding methods using an optical-based navigation system: freehand, using a stereotactic aiming device and active depth control, and using a stereotactic aiming device and passive depth control. METHODS For each method, 25 punctures were performed on a non-rigid phantom. Five 1 mm metal screws were used as targets. Time requirements were recorded, and target positioning errors (TPE) were measured on control scans as the distance between needle tip and target. RESULTS Time requirements were reduced using the aiming device and passive depth control. The Euclidian TPE was similar for each method (4.6 ± 1.2-4.9 ± 1.7 mm). However, the lateral component was significantly lower when an aiming device was used (2.3 ± 1.3-2.8 ± 1.6 mm with an aiming device vs 4.2 ± 2.0 mm without). DISCUSSION Using an aiming device may increase the lateral accuracy of navigated needle insertion.

ARMin III – arm therapy exoskeleton with an ergonomic shoulder actuation

Rehabilitation robots have become important tools in stroke rehabilitation. Compared to manual arm training, robot-supported training can be more intensive, of longer duration and more repetitive. Therefore, robots have the potential to improve the rehabilitation process in stroke patients. Whereas a majority of previous work in upper limb rehabilitation robotics has focused on end-effector-based robots, a shift towards exoskeleton robots is taking place because they offer a better guidance of the human arm, especially for movements with a large range of motion. However, the implementation of an exoskeleton device introduces the challenge of reproducing the motion of the human shoulder, which is one of the most complex joints of the body. Thus, this paper starts with describing a simplified model of the human shoulder. On the basis of that model, a new ergonomic shoulder actuation principle that provides motion of the humerus head is proposed, and its implementation in the ARMin III arm therapy robot is described. The focus lies on the mechanics and actuation principle. The ARMin III robot provides three actuated degrees of freedom for the shoulder and one for the elbow joint. An additional module provides actuated lower arm pro/supination and wrist flexion/extension. Five ARMin III devices have been manufactured and they are currently undergoing clinical evaluation in hospitals in Switzerland and in the United States.

A novel paradigm for patient-cooperative control of upper-limb rehabilitation robots

Early intervention and intensive therapy improve the outcome of neuromuscular rehabilitation. There are indications that where a patient is motivated and premeditates their movement, the recovery is more effective. Therefore, a strategy for patient-cooperative control of rehabilitation devices for upper extremities is proposed and evaluated. The strategy is based on the minimal intervention principle allowing an efficient exploitation of task space redundancies and resulting in user-driven movement trajectories. The patient's effort is taken into consideration by enabling the machine to comply with forces exerted by the user. The interaction is enhanced through a multimodal display and a virtually generated environment that includes haptic, visual and sound modalities.

ARMin - robot for rehabilitation of the upper extremities

Task-oriented repetitive movements can improve motor recovery in patients with neurological or orthopaedic lesions. The application of robotics can serve to assist, enhance, evaluate, and document neurological and orthopaedic rehabilitation. ARMin is a new robot for arm therapy applicable to the training of activities of daily living in clinics. ARMin has a semiexoskeletal structure with six degrees of freedom, and is equipped with position and force sensors. The mechanical structure, the actuators and the sensors of the robot are optimized for patient-cooperative control strategies based on impedance and admittance architectures. This paper describes the mechanical structure, the control system, the sensors and actuators, safety aspects and results of a first pilot study with hemiplegic and spinal cord injured subjects.

Robot-aided neurorehabilitation of the upper extremities

Task-oriented repetitive movements can improve muscle strength and movement co-ordination in patients with impairments due to neurological lesions. The application of robotics and automation technology can serve to assist, enhance, evaluate and document the rehabilitation of movements. The paper provides an overview of existing devices that can support movement therapy of the upper extremities in subjects with neurological pathologies. The devices are critically compared with respect to technical function, clinical applicability, and, if they exist, clinical outcomes.

Mechatronic feasibility of minimally invasive, atraumatic cochleostomy

Robotic assistance in the context of lateral skull base surgery, particularly during cochlear implantation procedures, has been the subject of considerable research over the last decade. The use of robotics during these procedures has the potential to provide significant benefits to the patient by reducing invasiveness when gaining access to the cochlea, as well as reducing intracochlear trauma when performing a cochleostomy. Presented herein is preliminary work on the combination of two robotic systems for reducing invasiveness and trauma in cochlear implantation procedures. A robotic system for minimally invasive inner ear access was combined with a smart drilling tool for robust and safe cochleostomy; evaluation was completed on a single human cadaver specimen. Access to the middle ear was successfully achieved through the facial recess without damage to surrounding anatomical structures; cochleostomy was completed at the planned position with the endosteum remaining intact after drilling as confirmed by microscope evaluation.

A complete-pelvis segmentation framework for image-free total hip arthroplasty (THA): methodology and clinical study

Background Complete-pelvis segmentation in antero-posterior pelvic radiographs is required to create a patient-specific three-dimensional pelvis model for surgical planning and postoperative assessment in image-free navigation of total hip arthroplasty. Methods A fast and robust framework for accurately segmenting the complete pelvis is presented, consisting of two consecutive modules. In the first module, a three-stage method was developed to delineate the left hemipelvis based on statistical appearance and shape models. To handle complex pelvic structures, anatomy-specific information processing techniques were employed. As the input to the second module, the delineated left hemi-pelvis was then reflected about an estimated symmetry line of the radiograph to initialize the right hemi-pelvis segmentation. The right hemi-pelvis was segmented by the same three-stage method, Results Two experiments conducted on respectively 143 and 40 AP radiographs demonstrated a mean segmentation accuracy of 1.61±0.68 mm. A clinical study to investigate the postoperative assessment of acetabular cup orientations based on the proposed framework revealed an average accuracy of 1.2°±0.9° and 1.6°±1.4° for anteversion and inclination, respectively. Delineation of each radiograph costs less than one minute. Conclusions Despite further validation needed, the preliminary results implied the underlying clinical applicability of the proposed framework for image-free THA.

Application of Deadlock Risk Evaluation of Architectural Models

Software architectural evaluation is a key discipline used to identify, at early stages of a real-time system (RTS) development, the problems that may arise during its operation. Typical mechanisms supporting concurrency, such as semaphores, mutexes or monitors, usually lead to concurrency problems in execution time that are difficult to be identified, reproduced and solved. For this reason, it is crucial to understand the root causes of these problems and to provide support to identify and mitigate them at early stages of the system lifecycle. This paper aims to present the results of a research work oriented to the development of the tool called ‘Deadlock Risk Evaluation of Architectural Models’ (DREAM) to assess deadlock risk in architectural models of an RTS. A particular architectural style, Pipelines of Processes in Object-Oriented Architectures–UML (PPOOA) was used to represent platform-independent models of an RTS architecture supported by the PPOOA –Visio tool. We validated the technique presented here by using several case studies related to RTS development and comparing our results with those from other deadlock detection approaches, supported by different tools. Here we present two of these case studies, one related to avionics and the other to planetary exploration robotics. Copyright © 2011 John Wiley & Sons, Ltd.

A Motor-less and Gear-less Bio-mimetic Robotic Fish Design

In this paper, we describe our current work on bio-inspired locomotion systems using a deformable structure and smart materials, concretely Shape Memory Alloys, exploring the possibility of building motor-less and gear-less robots. A swimming underwater robot has been developed whose movements are generated using such actuators, used for bending the backbone of the fish, which in turn causes a change on the curvature of the body. This paper focuses on how standard swimming patterns can be reproduced with the proposed design, using an actuation dynamics model identified in prior work.

Cooperative Task Execution between Modular Robots Based on Tight-Loose Cooperation Strategies

The complexity in the execution of cooperative tasks is high due to the fact that a robot team requires movement coordination at the beginning of the mission and continuous coordination during the execution of the task. A variety of techniques have been proposed to give a solution to this problem assuming standard mobile robots. This work focuses on presenting the execution of a cooperative task by a modular robot team. The complexity of the task execution increases due to the fact that each robot is composed of modules which have to be coordinated in a proper way to successfully work. A combined tight and loose cooperation strategy is presented and a bar-pushing example is used as a cooperative task to show the performance of this type of system.