Hand-held robotic device for laparoscopic surgery and training

Laparoscopic surgery (LS) has revolutionized traditional surgical techniques introducing minimally invasive procedures for diagnosis and local therapies. LSs have undeniable advantages, such as small patient incisions, reduced postoperative pain and faster recovery. On the other hand, restricted vision of the anatomical target, difficult handling of the surgical instruments, restricted mobility inside the human body, need of dexterity to hand-eye coordination and inadequate and non-ergonomic surgical instruments may restrict LS only to more specialized surgeons. To overcome the referred limitations, this work presents a new robotic surgical handheld system – the EndoRobot. The EndoRobot was designed to be used in clinical practice or even as a surgical simulator. It integrates an electromechanical system with 3 degrees of freedom. Each degree can be manipulated independently and combined with different levels of sensitivity allowing fast and slow movements. As other features, the EndoRobot has battery power or external power supply, enables the use of bipolar radiofrequency to prevent bleeding while cutting and allows plug-and-play of the laparoscopic forceps for rapid exchange. As a surgical simulator, the system was also instrumented to measure and transmit, in real time, its position and orientation for a training software able to monitor and assist the trainee’s surgical movements.

Fast left ventricle tracking in CMR images using localized anatomical affine optical flow

In daily cardiology practice, assessment of left ventricular (LV) global function using non-invasive imaging remains central for the diagnosis and follow-up of patients with cardiovascular diseases. Despite the different methodologies currently accessible for LV segmentation in cardiac magnetic resonance (CMR) images, a fast and complete LV delineation is still limitedly available for routine use. In this study, a localized anatomically constrained affine optical flow method is proposed for fast and automatic LV tracking throughout the full cardiac cycle in short-axis CMR images. Starting from an automatically delineated LV in the end-diastolic frame, the endocardial and epicardial boundaries are propagated by estimating the motion between adjacent cardiac phases using optical flow. In order to reduce the computational burden, the motion is only estimated in an anatomical region of interest around the tracked boundaries and subsequently integrated into a local affine motion model. Such localized estimation enables to capture complex motion patterns, while still being spatially consistent. The method was validated on 45 CMR datasets taken from the 2009 MICCAI LV segmentation challenge. The proposed approach proved to be robust and efficient, with an average distance error of 2.1 mm and a correlation with reference ejection fraction of 0.98 (1.9 ± 4.5%). Moreover, it showed to be fast, taking 5 seconds for the tracking of a full 4D dataset (30 ms per image). Overall, a novel fast, robust and accurate LV tracking methodology was proposed, enabling accurate assessment of relevant global function cardiac indices, such as volumes and ejection fraction.

Mechatronic system for ABO human blood typing

In medical emergency situations, when a patient needs a blood transfusion, the universal blood type O− is administered. This procedure may lead to the depletion of stock reserves of O− blood. Nowadays, there is no commercial equipment capable of determining the patient's blood type in situ, in a fast and reliable process. Human blood typing is usually performed through the manual test, which involves a macroscopic observation and interpretation of the results by an analyst. This test, despite of having a fast response time, may lead to human errors, which sometimes can be fatal to the patient. This paper presents the development of an automatic mechatronic prototype for determining human blood typing (ABO and Rh systems) through image processing techniques. The prototype design takes into account the characteristics of reliability of analysis, portability, and response time allowing the system to be used in emergency situations. The developed prototype performs blood and reagents mixture acquires the resultant image and processes the data (based on image processing techniques) to determine the sample blood type. It was tested in a laboratory, using cataloged samples of blood types, provided by the Portuguese Institute of Blood and Transplantation. Hereafter, it is expected to test and validate the prototype in clinical environments.

Robust temporal alignment of multimodal cardiac sequences

Given the dynamic nature of cardiac function, correct temporal alignment of pre-operative models and intraoperative images is crucial for augmented reality in cardiac image-guided interventions. As such, the current study focuses on the development of an image-based strategy for temporal alignment of multimodal cardiac imaging sequences, such as cine Magnetic Resonance Imaging (MRI) or 3D Ultrasound (US). First, we derive a robust, modality-independent signal from the image sequences, estimated by computing the normalized crosscorrelation between each frame in the temporal sequence and the end-diastolic frame. This signal is a resembler for the left-ventricle (LV) volume curve over time, whose variation indicates di erent temporal landmarks of the cardiac cycle. We then perform the temporal alignment of these surrogate signals derived from MRI and US sequences of the same patient through Dynamic Time Warping (DTW), allowing to synchronize both sequences. The proposed framework was evaluated in 98 patients, which have undergone both 3D+t MRI and US scans. The end-systolic frame could be accurately estimated as the minimum of the image-derived surrogate signal, presenting a relative error of 1:6 1:9% and 4:0 4:2% for the MRI and US sequences, respectively, thus supporting its association with key temporal instants of the cardiac cycle. The use of DTW reduces the desynchronization of the cardiac events in MRI and US sequences, allowing to temporally align multimodal cardiac imaging sequences. Overall, a generic, fast and accurate method for temporal synchronization of MRI and US sequences of the same patient was introduced. This approach could be straightforwardly used for the correct temporal alignment of pre-operative MRI information and intra-operative US images.