Multimodal automatic user disposition recognition in human-machine interaction

Magdeburg, Univ., Fak. für Elektrotechnik und Informationstechnik, Diss., 2013

Primary localized rectal/pararectal gastrointestinal stromal tumors: results of surgical and multimodal therapy from the French Sarcoma group.

BACKGROUND: Rectal and pararectal gastrointestinal stromal tumors (GISTs) are rare. The optimal management strategy for primary localized GISTs remains poorly defined. METHODS: We conducted a retrospective analysis of 41 patients with localized rectal or pararectal GISTs treated between 1991 and 2011 in 13 French Sarcoma Group centers. RESULTS: Of 12 patients who received preoperative imatinib therapy for a median duration of 7 (2-12) months, 8 experienced a partial response, 3 had stable disease, and 1 had a complete response. Thirty and 11 patients underwent function-sparing conservative surgery and abdominoperineal resection, respectively. Tumor resections were mostly R0 and R1 in 35 patients. Tumor rupture occurred in 12 patients. Eleven patients received postoperative imatinib with a median follow-up of 59 (2.4-186) months. The median time to disease relapse was 36 (9.8-62) months. The 5-year overall survival rate was 86.5%. Twenty patients developed local recurrence after surgery alone, two developed recurrence after resection combined with preoperative and/or postoperative imatinib, and eight developed metastases. In univariate analysis, the mitotic index (≤5) and tumor size (≤5 cm) were associated with a significantly decreased risk of local relapse. Perioperative imatinib was associated with a significantly reduced risk of overall relapse and local relapse. CONCLUSIONS: Perioperative imatinib therapy was associated with improved disease-free survival. Preoperative imatinib was effective. Tumor shrinkage has a clear benefit for local excision in terms of feasibility and function preservation. Given the complexity of rectal GISTs, referral of patients with this rare disease to expert centers to undergo a multidisciplinary approach is recommended.

Accuracy of Brain Multimodal Monitoring to Detect Cerebral Hypoperfusion After Traumatic Brain Injury.

OBJECTIVE:: To examine the accuracy of brain multimodal monitoring-consisting of intracranial pressure, brain tissue PO2, and cerebral microdialysis-in detecting cerebral hypoperfusion in patients with severe traumatic brain injury. DESIGN:: Prospective single-center study. PATIENTS:: Patients with severe traumatic brain injury. SETTING:: Medico-surgical ICU, university hospital. INTERVENTION:: Intracranial pressure, brain tissue PO2, and cerebral microdialysis monitoring (right frontal lobe, apparently normal tissue) combined with cerebral blood flow measurements using perfusion CT. MEASUREMENTS AND MAIN RESULTS:: Cerebral blood flow was measured using perfusion CT in tissue area around intracranial monitoring (regional cerebral blood flow) and in bilateral supra-ventricular brain areas (global cerebral blood flow) and was matched to cerebral physiologic variables. The accuracy of intracranial monitoring to predict cerebral hypoperfusion (defined as an oligemic regional cerebral blood flow < 35 mL/100 g/min) was examined using area under the receiver-operating characteristic curves. Thirty perfusion CT scans (median, 27 hr [interquartile range, 20-45] after traumatic brain injury) were performed on 27 patients (age, 39 yr [24-54 yr]; Glasgow Coma Scale, 7 [6-8]; 24/27 [89%] with diffuse injury). Regional cerebral blood flow correlated significantly with global cerebral blood flow (Pearson r = 0.70, p < 0.01). Compared with normal regional cerebral blood flow (n = 16), low regional cerebral blood flow (n = 14) measurements had a higher proportion of samples with intracranial pressure more than 20 mm Hg (13% vs 30%), brain tissue PO2 less than 20 mm Hg (9% vs 20%), cerebral microdialysis glucose less than 1 mmol/L (22% vs 57%), and lactate/pyruvate ratio more than 40 (4% vs 14%; all p < 0.05). Compared with intracranial pressure monitoring alone (area under the receiver-operating characteristic curve, 0.74 [95% CI, 0.61-0.87]), monitoring intracranial pressure + brain tissue PO2 (area under the receiver-operating characteristic curve, 0.84 [0.74-0.93]) or intracranial pressure + brain tissue PO2+ cerebral microdialysis (area under the receiver-operating characteristic curve, 0.88 [0.79-0.96]) was significantly more accurate in predicting low regional cerebral blood flow (both p < 0.05). CONCLUSION:: Brain multimodal monitoring-including intracranial pressure, brain tissue PO2, and cerebral microdialysis-is more accurate than intracranial pressure monitoring alone in detecting cerebral hypoperfusion at the bedside in patients with severe traumatic brain injury and predominantly diffuse injury.

Sex biased spatial strategies relying on the integration of multimodal cues in a rat model of schizophrenia: impairment in predicting future context?

Male and female Wistar rats were treated postnatally (PND 5-16) with BSO (l-buthionine-(S,R)-sulfoximine) to provide a rat model of schizophrenia based on transient glutathione deficit. In the watermaze, BSO-treated male rats perform very efficiently in conditions where a diversity of visual information is continuously available during orientation trajectories [1]. Our hypothesis is that the treatment impairs proactive strategies anticipating future sensory information, while supporting a tight visual adjustment on memorized snapshots, i.e. compensatory reactive strategies. To test this hypothesis, BSO rats' performance was assessed in two conditions using an 8-arm radial maze task: a semi-transparent maze with no available view on the environment from maze centre [2], and a modified 2-parallel maze known to induce a neglect of the parallel pair in normal rats [3-5]. Male rats, but not females, were affected by the BSO treatment. In the semi-transparent maze, BSO males expressed a higher error rate, especially in completing the maze after an interruption. In the 2-parallel maze shape, BSO males, unlike controls, expressed no neglect of the parallel arms. This second result was in accord with a reactive strategy using accurate memory images of the contextual environment instead of a representation based on integrating relative directions. These results are coherent with a treatment-induced deficit in proactive decision strategy based on multimodal cognitive maps, compensated by accurate reactive adaptations based on the memory of local configurations. Control females did not express an efficient proactive capacity in the semi-transparent maze, neither did they show the significant neglect of the parallel arms, which might have masked the BSO induced effect. Their reduced sensitivity to BSO treatment is discussed with regard to a sex biased basal cognitive style.

Characterizing aging in the human brainstem using quantitative multimodal MRI analysis.

Aging is ubiquitous to the human condition. The MRI correlates of healthy aging have been extensively investigated using a range of modalities, including volumetric MRI, quantitative MRI (qMRI), and diffusion tensor imaging. Despite this, the reported brainstem related changes remain sparse. This is, in part, due to the technical and methodological limitations in quantitatively assessing and statistically analyzing this region. By utilizing a new method of brainstem segmentation, a large cohort of 100 healthy adults were assessed in this study for the effects of aging within the human brainstem in vivo. Using qMRI, tensor-based morphometry (TBM), and voxel-based quantification (VBQ), the volumetric and quantitative changes across healthy adults between 19 and 75 years were characterized. In addition to the increased R2* in substantia nigra corresponding to increasing iron deposition with age, several novel findings were reported in the current study. These include selective volumetric loss of the brachium conjunctivum, with a corresponding decrease in magnetization transfer and increase in proton density (PD), accounting for the previously described "midbrain shrinkage." Additionally, we found increases in R1 and PD in several pontine and medullary structures. We consider these changes in the context of well-characterized, functional age-related changes, and propose potential biophysical mechanisms. This study provides detailed quantitative analysis of the internal architecture of the brainstem and provides a baseline for further studies of neurodegenerative diseases that are characterized by early, pre-clinical involvement of the brainstem, such as Parkinson's and Alzheimer's diseases.

Rehabilitación multimodal en cirugía electiva colorrectal: análisis de resultados, impacto en los costes hospitalarios y curva de aprendizaje

Els objectius són avaluar la seguretat, resultats i l’impacte en els costs d’un programa de rehabilitació multimodal en cirurgia colorrectal, així com estudiar la influència de la experiència de l’equip en el seu compliment i resultats. Estudi prospectiu de cohorts consecutives. La rehabilitació multimodal no augmenta la morbilitat ni la mortalitat. A més a més disminueix l’estada a l’hospital en 3 dies sense incrementar els reingressos. També s’associa a una disminució dels costs totals de 912 euros per pacient. El compliment del protocol millora amb l’experiència de l’equip multidisciplinari, accelerant la recuperació dels pacients i conseqüentment l’alta precoç.

Multimodal evaluation for medical image segmentation

This paper is a joint effort between five institutionsthat introduces several novel similarity measures andcombines them to carry out a multimodal segmentationevaluation. The new similarity measures proposed arebased on the location and the intensity values of themisclassified voxels as well as on the connectivity andthe boundaries of the segmented data. We showexperimentally that the combination of these measuresimprove the quality of the evaluation. The study that weshow here has been carried out using four differentsegmentation methods from four different labs applied toa MRI simulated dataset of the brain. We claim that ournew measures improve the robustness of the evaluation andprovides better understanding about the differencebetween segmentation methods.

Agrupador de imágenes multimodal no supervisado

Trabajo Fin de Máster donde se implementa un método multimodal para la clasificación de imágenes sin etiquetar y sin intervención humana.

The Multiscenario Multienvironment BioSecure Multimodal Database (BMDB)

A new multimodal biometric database designed and acquired within the framework of the European BioSecure Network of Excellence is presented. It is comprised of more than 600 individuals acquired simultaneously in three scenarios: 1) over the Internet, 2) in an office environment with desktop PC, and 3) in indoor/outdoor environments with mobile portable hardware. The three scenarios include a common part of audio/video data. Also, signature and fingerprint data have been acquired both with desktop PC and mobile portable hardware. Additionally, hand and iris data were acquired in the second scenario using desktop PC. Acquisition has been conducted by 11 European institutions. Additional features of the BioSecure Multimodal Database (BMDB) are: two acquisitionsessions, several sensors in certain modalities, balanced gender and age distributions, multimodal realistic scenarios with simple and quick tasks per modality, cross-European diversity, availability of demographic data, and compatibility with other multimodal databases. The novel acquisition conditions of the BMDB allow us to perform new challenging research and evaluation of eithermonomodal or multimodal biometric systems, as in the recent BioSecure Multimodal Evaluation campaign. A description of this campaign including baseline results of individual modalities from the new database is also given. The database is expected to beavailable for research purposes through the BioSecure Association during 2008.

Multimodal Highlighting of Structural Abnormalities in Diabetic Rat and Human Corneas.

PURPOSE: This study aimed to highlight structural corneal changes in a model of type 2 diabetes, using in vivo corneal confocal microscopy (CCM). The abnormalities were also characterized by transmission electron microscopy (TEM) and second harmonic generation (SHG) microscopy in rat and human corneas. METHODS: Goto-Kakizaki (GK) rats were observed at age 12 weeks (n = 3) and 1 year (n = 6), and compared to age-matched controls. After in vivo CCM examination, TEM and SHG microscopy were used to characterize the ultrastructure and the three-dimensional organization of the abnormalities. Human corneas from diabetic (n = 3) and nondiabetic (n = 3) patients were also included in the study. RESULTS: In the basal epithelium of GK rats, CCM revealed focal hyper-reflective areas, and histology showed proliferative cells with irregular basement membrane. In the anterior stroma, extracellular matrix modifications were detected by CCM and confirmed in histology. In the Descemet's membrane periphery of all the diabetic corneas, hyper-reflective deposits were highlighted using CCM and characterized as long-spacing collagen fibrils by TEM. SHG microscopy revealed these deposits with high contrast, allowing specific detection in diabetic human and rat corneas without preparation and characterization of their three-dimensional organization. CONCLUSION: Pathologic findings were observed early in the development of diabetes in GK rats. Similar abnormalities have been found in corneas from diabetic patients. TRANSLATIONAL RELEVANCE: This multidisciplinary study highlights diabetes-induced corneal abnormalities in an animal model, but also in diabetic donors. This could constitute a potential early marker for diagnosis of hyperglycemia-induced tissue changes.

Landmark detection for fusion of fundus and MRI toward a patient-specific multimodal eye model.

Ophthalmologists typically acquire different image modalities to diagnose eye pathologies. They comprise, e.g., Fundus photography, optical coherence tomography, computed tomography, and magnetic resonance imaging (MRI). Yet, these images are often complementary and do express the same pathologies in a different way. Some pathologies are only visible in a particular modality. Thus, it is beneficial for the ophthalmologist to have these modalities fused into a single patient-specific model. The goal of this paper is a fusion of Fundus photography with segmented MRI volumes. This adds information to MRI that was not visible before like vessels and the macula. This paper contributions include automatic detection of the optic disc, the fovea, the optic axis, and an automatic segmentation of the vitreous humor of the eye.

The Acute STroke Registry and Analysis of Lausanne (ASTRAL): design and baseline analysis of an ischemic stroke registry including acute multimodal imaging.

BACKGROUND AND PURPOSE: Stroke registries are valuable tools for obtaining information about stroke epidemiology and management. The Acute STroke Registry and Analysis of Lausanne (ASTRAL) prospectively collects epidemiological, clinical, laboratory and multimodal brain imaging data of acute ischemic stroke patients in the Centre Hospitalier Universitaire Vaudois (CHUV). Here, we provide design and methods used to create ASTRAL and present baseline data of our patients (2003 to 2008). METHODS: All consecutive patients admitted to CHUV between January 1, 2003 and December 31, 2008 with acute ischemic stroke within 24 hours of symptom onset were included in ASTRAL. Patients arriving beyond 24 hours, with transient ischemic attack, intracerebral hemorrhage, subarachnoidal hemorrhage, or cerebral sinus venous thrombosis, were excluded. Recurrent ischemic strokes were registered as new events. RESULTS: Between 2003 and 2008, 1633 patients and 1742 events were registered in ASTRAL. There was a preponderance of males, even in the elderly. Cardioembolic stroke was the most frequent type of stroke. Most strokes were of minor severity (National Institute of Health Stroke Scale [NIHSS] score ≤ 4 in 40.8% of patients). Cardioembolic stroke and dissections presented with the most severe clinical picture. There was a significant number of patients with unknown onset stroke, including wake-up stroke (n=568, 33.1%). Median time from last-well time to hospital arrival was 142 minutes for known onset and 759 minutes for unknown-onset stroke. The rate of intravenous or intraarterial thrombolysis between 2003 and 2008 increased from 10.8% to 20.8% in patients admitted within 24 hours of last-well time. Acute brain imaging was performed in 1695 patients (97.3%) within 24 hours. In 1358 patients (78%) who underwent acute computed tomography angiography, 717 patients (52.8%) had significant abnormalities. Of the 1068 supratentorial stroke patients who underwent acute perfusion computed tomography (61.3%), focal hypoperfusion was demonstrated in 786 patients (73.6%). CONCLUSIONS: This hospital-based prospective registry of consecutive acute ischemic strokes incorporates demographic, clinical, metabolic, acute perfusion, and arterial imaging. It is characterized by a high proportion of minor and unknown-onset strokes, short onset-to-admission time for known-onset patients, rapidly increasing thrombolysis rates, and significant vascular and perfusion imaging abnormalities in the majority of patients.

Early multimodal outcome prediction after cardiac arrest in patients treated with hypothermia.

OBJECTIVES: Therapeutic hypothermia and pharmacological sedation may influence outcome prediction after cardiac arrest. The use of a multimodal approach, including clinical examination, electroencephalography, somatosensory-evoked potentials, and serum neuron-specific enolase, is recommended; however, no study examined the comparative performance of these predictors or addressed their optimal combination. DESIGN: Prospective cohort study. SETTING: Adult ICU of an academic hospital. PATIENTS: One hundred thirty-four consecutive adults treated with therapeutic hypothermia after cardiac arrest. MEASUREMENTS AND MAIN RESULTS: Variables related to the cardiac arrest (cardiac rhythm, time to return of spontaneous circulation), clinical examination (brainstem reflexes and myoclonus), electroencephalography reactivity during therapeutic hypothermia, somatosensory-evoked potentials, and serum neuron-specific enolase. Models to predict clinical outcome at 3 months (assessed using the Cerebral Performance Categories: 5 = death; 3-5 = poor recovery) were evaluated using ordinal logistic regressions and receiving operator characteristic curves. Seventy-two patients (54%) had a poor outcome (of whom, 62 died), and 62 had a good outcome. Multivariable ordinal logistic regression identified absence of electroencephalography reactivity (p < 0.001), incomplete recovery of brainstem reflexes in normothermia (p = 0.013), and neuron-specific enolase higher than 33 μg/L (p = 0.029), but not somatosensory-evoked potentials, as independent predictors of poor outcome. The combination of clinical examination, electroencephalography reactivity, and neuron-specific enolase yielded the best predictive performance (receiving operator characteristic areas: 0.89 for mortality and 0.88 for poor outcome), with 100% positive predictive value. Addition of somatosensory-evoked potentials to this model did not improve prognostic accuracy. CONCLUSIONS: Combination of clinical examination, electroencephalography reactivity, and serum neuron-specific enolase offers the best outcome predictive performance for prognostication of early postanoxic coma, whereas somatosensory-evoked potentials do not add any complementary information. Although prognostication of poor outcome seems excellent, future studies are needed to further improve prediction of good prognosis, which still remains inaccurate.

Daisy: un libro digital abierto, multimodal y accesible

Se presenta el formato de libro multimedia Daisy que permite integrar texto, sonido, imágenes y vídeo de forma sincronizada y con una navegación avanzada por el texto y el audio que lo hace altamente usable para lecturas en digital. También se presenta su componente principal DTBook xml, disposición estructurada del texto que permite generar formatos alternativos. El artículo detalla las diferencias de Daisy respecto a otros audiolibros, los dispositivos de lectura existentes y su adopción en el mercado y en la enseñanza. Si se abaratan los costes de los aparatos lectores y se soluciona la gestión de derechos digitales, tiene muchas posibilidades de convertirse en estrella para editar libros digitales.