Multimodal Integration in Statistical Learning: Evidence from the McGurk Illusion

Recent advances in the field of statistical learning have established that learners are able to track regularities of multimodal stimuli, yet it is unknown whether the statistical computations are performed on integrated representations or on separate, unimodal representations. In the present study, we investigated the ability of adults to integrate audio and visual input during statistical learning. We presented learners with a speech stream synchronized with a video of a speaker's face. In the critical condition, the visual (e.g., /gi/) and auditory (e.g., /mi/) signals were occasionally incongruent, which we predicted would produce the McGurk illusion, resulting in the perception of an audiovisual syllable (e.g., /ni/). In this way, we used the McGurk illusion to manipulate the underlying statistical structure of the speech streams, such that perception of these illusory syllables facilitated participants' ability to segment the speech stream. Our results therefore demonstrate that participants can integrate audio and visual input to perceive the McGurk illusion during statistical learning. We interpret our findings as support for modality-interactive accounts of statistical learning.

Different duration of at-risk mental state associated with neurofunctional abnormalities. A multimodal imaging study

Objectives: Neurofunctional alterations are correlates of vulnerability to psychosis, as well as of the disorder itself. How these abnormalities relate to different probabilities for later transition to psychosis is unclear. We investigated vulnerability- versus disease-related versus resilience biomarkers of psychosis during working memory (WM) processing in individuals with an at-risk mental state (ARMS). Experimental design: Patients with “first-episode psychosis” (FEP, n = 21), short-term ARMS (ARMS-ST, n = 17), long-term ARMS (ARMS-LT, n = 16), and healthy controls (HC, n = 20) were investigated with an n-back WM task. We examined functional magnetic resonance imaging (fMRI) and structural magnetic resonance imaging (sMRI) data in conjunction using biological parametric mapping (BPM) toolbox. Principal observations: There were no differences in accuracy, but the FEP and the ARMS-ST group had longer reaction times compared with the HC and the ARMS-LT group. With the 2-back > 0-back contrast, we found reduced functional activation in ARMS-ST and FEP compared with the HC group in parietal and middle frontal regions. Relative to ARMS-LT individuals, FEP patients showed decreased activation in the bilateral inferior frontal gyrus and insula, and in the left prefrontal cortex. Compared with the ARMS-LT, the ARMS-ST subjects showed reduced activation in the right inferior frontal gyrus and insula. Reduced insular and prefrontal activation was associated with gray matter volume reduction in the same area in the ARMS-LT group. Conclusions: These findings suggest that vulnerability to psychosis was associated with neurofunctional alterations in fronto-temporo-parietal networks in a WM task. Neurofunctional differences within the ARMS were related to different duration of the prodromal state and resilience factors

Physiological parameters after nonpharmacological analgesia in preterm infants: a randomized trial

To compare the influence of three different nonpharmacological interventions on cortical activation, heart rate and peripheral oxygen saturation (SaO2 ) after heelstick in preterm infants.

Multimodal augmented reality system for surgical microscopy

Image-guided, computer-assisted neurosurgery has emerged to improve localization and targeting, to provide a better anatomic definition of the surgical field, and to decrease invasiveness. Usually, in image-guided surgery, a computer displays the surgical field in a CT/MR environment, using axial, coronal or sagittal views, or even a 3D representation of the patient. Such a system forces the surgeon to look away from the surgical scene to the computer screen. Moreover, this kind of information, being pre-operative imaging, can not be modified during the operation, so it remains valid for guidance in the first stage of the surgical procedure, and mainly for rigid structures like bones. In order to solve the two constraints mentioned before, we are developing an ultrasoundguided surgical microscope. Such a system takes the advantage that surgical microscopy and ultrasound systems are already used in neurosurgery, so it does not add more complexity to the surgical procedure. We have integrated an optical tracking device in the microscope and an augmented reality overlay system with which we avoid the need to look away from the scene, providing correctly aligned surgical images with sub-millimeter accuracy. In addition to the standard CT and 3D views, we are able to track an ultrasound probe, and using a previous calibration and registration of the imaging, the image obtained is correctly projected to the overlay system, so the surgeon can always localize the target and verify the effects of the intervention. Several tests of the system have been already performed to evaluate the accuracy, and clinical experiments are currently in progress in order to validate the clinical usefulness of the system.

Hemodynamic effects of thoracic epidural analgesia in ovine hyperdynamic endotoxemia

BACKGROUND AND OBJECTIVES: Thoracic epidural analgesia (TEA) is increasingly used for perioperative analgesia. If patients with TEA develop sepsis or systemic inflammatory response subsequent to extended surgery the question arises if it would be safe to continue TEA with its beneficial effects of improving gastrointestinal perfusion and augmenting tissue oxygenation. A major concern in this regard is hemodynamic instability that might ensue from TEA-induced vasodilation. The objective of the present study was to assess the effects of TEA on systemic and pulmonary hemodynamics in a sepsis model of hyperdynamic endotoxemia. METHODS: After a baseline measurement in healthy sheep (n = 14), Salmonella thyphosa endotoxin was continuously infused at a rate of 10 ngxkg(-1)xmin(-1) over 16 hours. The surviving animals (n = 12) were then randomly assigned to 1 of 2 study groups. In the treatment group (n = 6), continuous TEA was initiated with 0.1 mLxkg(-1) bupivacaine 0.125% and maintained with 0.1 mLxkg(-1)xh(-1). In the control group (n = 6) the same amount of isotonic sodium saline solution was injected at the same rate through the epidural catheter. RESULTS: In both experimental groups cardiac index increased and systemic vascular resistance decreased concurrently (each P < .05). Functional epidural blockade in the TEA group was confirmed by sustained suppression of the cutaneous (or panniculus) reflex. During the observational period of 6 hours neither systemic nor pulmonary circulatory variables were impaired by TEA. CONCLUSIONS: From a hemodynamic point of view, TEA presents as a safe treatment option in sepsis or systemic inflammatory response syndrome.

Multimodal imaging in macular diagnostics: combined OCT-SLO improves therapeutical monitoring

BACKGROUND: Digital imaging methods are a centrepiece for diagnosis and management of macular disease. A recently developed imaging device is composed of simultaneous confocal scanning laser ophthalmoscopy (SLO) and optical coherence tomography (OCT). By means of clinical samples the benefit of this technique concerning diagnostic and therapeutic follow-up will be assessed. METHODS: The combined OCT-SLO-System (Ophthalmic Technologies Inc., Toronto, Canada) allows for confocal en-face fundus imaging and high resolution OCT scanning at the same time. OCT images are obtained from transversal line scans. One light source and the identical scanning rate yield a pixel-to-pixel correspondence of images. Three-dimensional thickness maps are derived from C-scan stacking. RESULTS: We followed-up patients with cystoid macular edema, pigment epithelium detachment, macular hole, venous branch occlusion, and vitreoretinal tractions during their course of therapy. The new imaging method illustrates the reduction of cystoid volume, e.g. after intravitreal injections of either angiostatic drugs or steroids. C-scans are used for appreciation of lesion diameters, visualisation of pathologies involving the vitreoretinal interface, and quantification of retinal thickness change. CONCLUSION: The combined OCT-SLO system creates both topographic and tomographic images of the retina. New therapeutic options can be followed-up closely by observing changes in lesion thickness and cyst volumes. For clinical use further studies are needed.

Is the combination of morphine with ketamine better than morphine alone for postoperative intravenous patient-controlled analgesia?

BACKGROUND: The addition of ketamine to morphine for patient-controlled analgesia (PCA) is supported by previous basic and clinical research, but has been challenged by subsequent negative studies. Important limitations of previous studies are the low number of patients analyzed, the use of morphine-ketamine combinations that may not the optimal, and that not all the relevant outcomes have been analyzed. In this study, we compared the combination of morphine and ketamine with morphine alone for postoperative PCA in large patient groups. We used a morphine-ketamine combination identified by an optimization procedure in our previous study. METHODS: After major elective orthopedic surgery, 352 patients received either PCA with morphine bolus 1.5 mg (Group M, n = 176) or a bolus of morphine plus ketamine 1.5 mg each (Group MK, n = 176) in a randomized, double-blind fashion. Unsatisfactory treatment was defined as the occurrence of either inadequate analgesia or unacceptable side effects. In addition, total consumption of PCA drugs, duration of PCA use, direct medical costs, and number of patients with chronic postoperative pain 3 and 6 mo after operation were recorded. RESULTS: The incidence of unsatisfactory treatment was 33.0% in Group M and 36.9% in Group MK (P = 0.50). No significant differences were found between the groups with respect to secondary end points. CONCLUSIONS: Small-dose ketamine combined with morphine for PCA provides no benefit to patients undergoing major orthopedic surgery and cannot be recommended for routine use.

Preemptive analgesia by lornoxicam--an NSAID--significantly inhibits perioperative platelet aggregation

BACKGROUND AND OBJECTIVE: To investigate whether preemptive administered lornoxicam changes perioperative platelet function during thoracic surgery. METHODS: A total of 20 patients scheduled for elective thoracic surgery were randomly assigned to receive either lornoxicam (16 mg, i.v.; n = 10) or placebo (n = 10) preoperatively. All patients underwent treatment of solitary lung metastasis and denied any antiplatelet medication within the past 2 weeks. Blood samples were drawn via an arterial catheter directly into silicone-coated Vacutainer tubes containing 0.5 mL of 0.129 M buffered sodium citrate 3.8% before, 15 min, 4 h and 8 h after the study medication was administered. Platelet aggregation curves were obtained by whole blood electrical impedance aggregometry (Chrono Log). RESULTS: Platelet aggregation was significantly reduced 15 min, 4 h and 8 h after lornoxicam administration compared to placebo (P < 0.05) for collagen, adenosine diphosphate and arachidonic acid as trigger substances. Adenosine diphosphate-induced platelet aggregation decreased by 85% 15 min after lornoxicam administration, and remained impaired for 8 h. CONCLUSION: Platelet aggregation assays are impaired for at least 8 h after lornoxicam application. Therefore perioperative analgesia by use of lornoxicam should be carefully administered under consideration of subsequent platelet dysfunction.

Entropy and bispectral index for assessment of sedation, analgesia and the effects of unpleasant stimuli in critically ill patients: an observational study

INTRODUCTION: Sedative and analgesic drugs are frequently used in critically ill patients. Their overuse may prolong mechanical ventilation and length of stay in the intensive care unit. Guidelines recommend use of sedation protocols that include sedation scores and trials of sedation cessation to minimize drug use. We evaluated processed electroencephalography (response and state entropy and bispectral index) as an adjunct to monitoring effects of commonly used sedative and analgesic drugs and intratracheal suctioning. METHODS: Electrodes for monitoring bispectral index and entropy were placed on the foreheads of 44 critically ill patients requiring mechanical ventilation and who previously had no brain dysfunction. Sedation was targeted individually using the Ramsay Sedation Scale, recorded every 2 hours or more frequently. Use of and indications for sedative and analgesic drugs and intratracheal suctioning were recorded manually and using a camera. At the end of the study, processed electroencephalographical and haemodynamic variables collected before and after each drug application and tracheal suctioning were analyzed. Ramsay score was used for comparison with processed electroencephalography when assessed within 15 minutes of an intervention. RESULTS: The indications for boli of sedative drugs exhibited statistically significant, albeit clinically irrelevant, differences in terms of their association with processed electroencephalographical parameters. Electroencephalographical variables decreased significantly after bolus, but a specific pattern in electroencephalographical variables before drug administration was not identified. The same was true for opiate administration. At both 30 minutes and 2 minutes before intratracheal suctioning, there was no difference in electroencephalographical or clinical signs in patients who had or had not received drugs 10 minutes before suctioning. Among patients who received drugs, electroencephalographical parameters returned to baseline more rapidly. In those cases in which Ramsay score was assessed before the event, processed electroencephalography exhibited high variation. CONCLUSIONS: Unpleasant or painful stimuli and sedative and analgesic drugs are associated with significant changes in processed electroencephalographical parameters. However, clinical indications for drug administration were not reflected by these electroencephalographical parameters, and barely by sedation level before drug administration or tracheal suction. This precludes incorporation of entropy and bispectral index as target variables for sedation and analgesia protocols in critically ill patients.

Multimodal approach in the use of clinical scoring, morphological MRI and biochemical T2-mapping and diffusion-weighted imaging in their ability to assess differences between cartilage repair tissue after microfracture therapy and matrix-associated autologous chondrocyte transplantation: a pilot study

OBJECTIVE: The aim of the present pilot study is to show initial results of a multimodal approach using clinical scoring, morphological magnetic resonance imaging (MRI) and biochemical T2-relaxation and diffusion-weighted imaging (DWI) in their ability to assess differences between cartilage repair tissue after microfracture therapy (MFX) and matrix-associated autologous chondrocyte transplantation (MACT). METHOD: Twenty patients were cross-sectionally evaluated at different post-operative intervals from 12 to 63 months after MFX and 12-59 months after MACT. The two groups were matched by age (MFX: 36.0+/-10.4 years; MACT: 35.1+/-7.7 years) and post-operative interval (MFX: 32.6+/-16.7 months; MACT: 31.7+/-18.3 months). After clinical evaluation using the Lysholm score, 3T-MRI was performed obtaining the MR observation of cartilage repair tissue (MOCART) score as well as T2-mapping and DWI for multi-parametric MRI. Quantitative T2-relaxation was achieved using a multi-echo spin-echo sequence; semi-quantitative diffusion-quotient (signal intensity without diffusion-weighting divided by signal intensity with diffusion weighting) was prepared by a partially balanced, steady-state gradient-echo pulse sequence. RESULTS: No differences in Lysholm (P=0.420) or MOCART (P=0.209) score were observed between MFX and MACT. T2-mapping showed lower T2 values after MFX compared to MACT (P=0.039). DWI distinguished between healthy cartilage and cartilage repair tissue in both procedures (MFX: P=0.001; MACT: P=0.007). Correlations were found between the Lysholm and the MOCART score (Pearson: 0.484; P=0.031), between the Lysholm score and DWI (Pearson:-0.557; P=0.011) and a trend between the Lysholm score and T2 (Person: 0.304; P=0.193). CONCLUSION: Using T2-mapping and DWI, additional information could be gained compared to clinical scoring or morphological MRI. In combination clinical, MR-morphological and MR-biochemical parameters can be seen as a promising multimodal tool in the follow-up of cartilage repair.

High-Level Modeling of Multimodal Interaction Techniques Using NiMMiT

The past few years, multimodal interaction has been gaining importance in virtual environments. Although multimodality renders interacting with an environment more natural and intuitive, the development cycle of such an application is often long and expensive. In our overall field of research, we investigate how modelbased design can facilitate the development process by designing environments through the use of highlevel diagrams. In this scope, we present ‘NiMMiT’, a graphical notation for expressing and evaluating multimodal user interaction; we elaborate on the NiMMiT primitives and demonstrate its use by means of a comprehensive example.

Evaluation of peri-operative epidural analgesia with ropivacaine, ropivacaine and sufentanil, and ropivacaine, sufentanil and epinephrine in isoflurane anesthetized dogs undergoing tibial plateau levelling osteotomy

The purpose of this study was to compare four epidural protocols for peri-operative analgesia in dogs undergoing tibial plateau levelling osteotomy. Forty client-owned dogs were randomly assigned to one of four treatments - groups R0.5 and R1 received 0.5mg/kg and 1mg/kg ropivacaine, respectively. Group SR0.5 received 1mug/kg sufentanil plus 0.5mg/kg ropivacaine, and group SER0.5 received 1mug/kg sufentanil, 0.5mg/kg ropivacaine plus 6mug/kg epinephrine. Dilution, when required, was performed with saline, so that the injected volume was always 0.2mL/kg. Intra-operatively, nociception assessment was based on the evaluation of changes in heart rate, respiratory rate and mean arterial pressure. Post-operative pain assessment was performed using the Glasgow visual analogue pain scale, and an ad hoc multifactorial pain score. Motor block was evaluated using a modified Bromage score. Intra-operatively, none of the animals was hypotensive. All groups except SER0.5 required rescue intra-operative fentanyl (40%, 30% and 40% of the animals in groups R0.5, R1 and SR0.5, respectively). Group SER0.5 showed lower post-operative pain scores, and group R1 significantly greater motor block, compared to the other treatment groups. None of the dogs had urinary retention. Epidural sufentanil-epinephrine-ropivacaine provided superior peri-operative analgesia compared to the other treatments, without producing clinically relevant side effects.