"Two hundred ninety-four": Remediation and multimodal performance in tourist placemaking

We offer here a multimodal discourse analysis of a range of verbal (writing and speech), nonverbal (movement and gesture) and technological (photography and video) resources used by tourists at the Leaning Tower of Pisa. In doing so, we pin-point the recycling and layering of mediatized representations (e.g. guidebooks and official brochures), mediated actions (e.g. climbing the Tower or posing in front of it), and remediated practices (e.g. posting a YouTube video of oneself climbing the 294 steps to the top of the Tower). Through this kind of empirically-based examination of tourists’ discursive and embodied performances – their ways of talking about and behaving in spaces – we witness how people never simply visit places but are always actively shaping and making these places. The Leaning Tower of Pisa is, therefore, as much an emergent production of the tourist imagination as it is a pre-existing, lop-sided construction of stone.

The Multimodal Brain TumorImage Segmentation Benchmark (BRATS)

In this paper we report the set-up and results of the Multimodal Brain Tumor Image Segmentation Benchmark (BRATS) organized in conjunction with the MICCAI 2012 and 2013 conferences. Twenty state-of-the-art tumor segmentation algorithms were applied to a set of 65 multi-contrast MR scans of low- and high-grade glioma patients - manually annotated by up to four raters - and to 65 comparable scans generated using tumor image simulation software. Quantitative evaluations revealed considerable disagreement between the human raters in segmenting various tumor sub-regions (Dice scores in the range 74-85%), illustrating the difficulty of this task. We found that different algorithms worked best for different sub-regions (reaching performance comparable to human inter-rater variability), but that no single algorithm ranked in the top for all subregions simultaneously. Fusing several good algorithms using a hierarchical majority vote yielded segmentations that consistently ranked above all individual algorithms, indicating remaining opportunities for further methodological improvements. The BRATS image data and manual annotations continue to be publicly available through an online evaluation system as an ongoing benchmarking resource.

Diagnosis of cardiac metastasis from cervical cancer in a 33-year-old patient using multimodal imaging studies: a case report and literature review.

We report a case of a 33-year-old woman with emergency admission due to dyspnoea and fever. History included squamous cell carcinoma of the cervix in complete remission. Contrast-enhanced computed tomography (CT) scanning of the chest, which was indicated to rule out pneumonia, revealed an infiltrative cardiac mass. Further assessment of the tumour by echocardiography and cardiac magnetic resonance imaging (MRI) showed transmural infiltration of the apical interventricular septum with a mass extending into the left and right ventricle cavities. The mass was highly suspicious for a cardiac metastasis. Cardiac metastases from cervical cancer are extremely rare. Recurrence of cervical carcinoma involving the heart should be considered even after a curative therapy approach. Non-invasive imaging plays a paramount role in investigating cardiac masses. Echocardiography, CT and MRI are complementary imaging modalities for complete work-up of intracardiac lesions.

Multimodal sequence learning

While sequence learning research models complex phenomena, previous studies have mostly focused on unimodal sequences. The goal of the current experiment is to put implicit sequence learning into a multimodal context: to test whether it can operate across different modalities. We used the Task Sequence Learning paradigm to test whether sequence learning varies across modalities, and whether participants are able to learn multimodal sequences. Our results show that implicit sequence learning is very similar regardless of the source modality. However, the presence of correlated task and response sequences was required for learning to take place. The experiment provides new evidence for implicit sequence learning of abstract conceptual representations. In general, the results suggest that correlated sequences are necessary for implicit sequence learning to occur. Moreover, they show that elements from different modalities can be automatically integrated into one unitary multimodal sequence.

Cognitive Cities: An Application for Nairobi. Text Message Participation of Slum Inhabitants to Improve Sanitary Facilities

Population growth is always increasing, and thus the concept of smart and cognitive cities is becoming more important. Developed countries are aware of and working towards needed changes in city management. However, emerging countries require the optimization of their own city management. This chapter illustrates, based on a use case, how a city in an emerging country can quickly progress using the concept of smart and cognitive cities. Nairobi, the capital of Kenya, is chosen for the test case. More than half of the population of Nairobi lives in slums with poor sanitation, and many slum inhabitants often share a single toilet, so the proper functioning and reliable maintenance of toilets are crucial. For this purpose, an approach for processing text messages based on cognitive computing (using soft computing methods) is introduced. Slum inhabitants can inform the responsible center via text messages in cases when toilets are not functioning properly. Through cognitive computer systems, the responsible center can fix the problem in a quick and efficient way by sending repair workers to the area. Focusing on the slum of Kibera, an easy-to-handle approach for slum inhabitants is presented, which can make the city more efficient, sustainable and resilient (i.e., cognitive).

Expanded Clinical Spectrum of Multiple Evanescent White Dot Syndrome with Multimodal Imaging

PURPOSE: To evaluate and characterize multiple evanescent white dot syndrome abnormalities with modern multimodal imaging modalities. METHODS: This retrospective cohort study evaluated fundus photography, fluorescein angiography, indocyanine green angiography, optical coherence tomography, enhanced depth imaging optical coherence tomography, short-wavelength autofluorescence, and near-infrared autofluorescence. RESULTS: Thirty-four multiple evanescent white dot syndrome patients with mean age of 28.7 years were studied (range, 14-49 years). Twenty-six patients were women, and eight were men. Initial mean visual acuity was 0.41 logMAR. Final mean visual acuity was 0.03 logMAR. Fluorescein angiography shows a variable number of mid retinal early fluorescent dots distributed in a wreathlike pattern, which correlate to fundus photography, fundus autofluorescence, and indocyanine green angiography. Indocyanine green angiography imaging shows the dots and also hypofluorescent, deeper, and larger spots, which are occasionally confluent, demonstrating a large plaque of deep retinal hypofluorescence. Optical coherence tomography imaging shows multifocal debris centered at and around the ellipsoid layer, corresponding to the location of spots seen with photography, indocyanine green angiography, and fluorescein angiography. Protrusions of the hyperreflectant material from the ellipsoid layer toward the outer nuclear layer correspond to the location of dots seen with photography, indocyanine green angiography, and fluorescein angiography. CONCLUSION: Multimodal imaging analysis of the retina in patients with multiple evanescent white dot syndrome shows additional features that may help in the diagnosis of the disease and in further understanding its etiology. Multiple evanescent white dot syndrome is predominantly a disease of the outer retina, centered at the ellipsoid zone, but also involving the interdigitation zone and the outer nuclear layer.

Multimodal Imaging of Cotton Wool Spots in Branch Retinal Vein Occlusion.

PURPOSE: To describe and follow cotton wool spots (CWS) in branch retinal vein occlusion (BRVO) using multimodal imaging. METHODS: In this prospective cohort study including 24 patients with new-onset BRVO, CWS were described and analyzed in color fundus photography (CF), spectral domain optical coherence tomography (SD-OCT), infrared (IR) and fluorescein angiography (FA) every 3 months for 3 years. The CWS area on SD-OCT and CF was evaluated using OCT-Tool-Kit software: CWS were marked in each single OCT B-scan and the software calculated the area by interpolation. RESULTS: 29 central CWS lesions were found. 100% of these CWS were visible on SD-OCT, 100% on FA and 86.2% on IR imaging, but only 65.5% on CF imaging. CWS were visible for 12.4 ± 7.5 months on SD-OCT, for 4.4 ± 3 months and 4.3 ± 3.4 months on CF and on IR, respectively, and for 17.5 ± 7.1 months on FA. The evaluated CWS area on SD-OCT was larger than on CF (0.26 ± 0.17 mm(2) vs. 0.13 ± 0.1 mm(2), p < 0.0001). The CWS area on SD-OCT and surrounding pathology such as intraretinal cysts, avascular zones and intraretinal hemorrhage were predictive for how long CWS remained visible (r(2) = 0.497, p < 0.002). CONCLUSIONS: The lifetime and presentation of CWS in BRVO seem comparable to other diseases. SD-OCT shows a higher sensitivity for detecting CWS compared to CF. The duration of visibility of CWS varies among different image modalities and depends on the surrounding pathology and the CWS size.

A multimodal tablet-based interface for designing and reviewing 3D engineering models

The ability to view and interact with 3D models has been happening for a long time. However, vision-based 3D modeling has only seen limited success in applications, as it faces many technical challenges. Hand-held mobile devices have changed the way we interact with virtual reality environments. Their high mobility and technical features, such as inertial sensors, cameras and fast processors, are especially attractive for advancing the state of the art in virtual reality systems. Also, their ubiquity and fast Internet connection open a path to distributed and collaborative development. However, such path has not been fully explored in many domains. VR systems for real world engineering contexts are still difficult to use, especially when geographically dispersed engineering teams need to collaboratively visualize and review 3D CAD models. Another challenge is the ability to rendering these environments at the required interactive rates and with high fidelity. In this document it is presented a virtual reality system mobile for visualization, navigation and reviewing large scale 3D CAD models, held under the CEDAR (Collaborative Engineering Design and Review) project. It’s focused on interaction using different navigation modes. The system uses the mobile device's inertial sensors and camera to allow users to navigate through large scale models. IT professionals, architects, civil engineers and oil industry experts were involved in a qualitative assessment of the CEDAR system, in the form of direct user interaction with the prototypes and audio-recorded interviews about the prototypes. The lessons learned are valuable and are presented on this document. Subsequently it was prepared a quantitative study on the different navigation modes to analyze the best mode to use it in a given situation.

Nonparametric Message Passing Methods for Cooperative Localization and Tracking

The objective of this thesis is the development of cooperative localization and tracking algorithms using nonparametric message passing techniques. In contrast to the most well-known techniques, the goal is to estimate the posterior probability density function (PDF) of the position of each sensor. This problem can be solved using Bayesian approach, but it is intractable in general case. Nevertheless, the particle-based approximation (via nonparametric representation), and an appropriate factorization of the joint PDFs (using message passing methods), make Bayesian approach acceptable for inference in sensor networks. The well-known method for this problem, nonparametric belief propagation (NBP), can lead to inaccurate beliefs and possible non-convergence in loopy networks. Therefore, we propose four novel algorithms which alleviate these problems: nonparametric generalized belief propagation (NGBP) based on junction tree (NGBP-JT), NGBP based on pseudo-junction tree (NGBP-PJT), NBP based on spanning trees (NBP-ST), and uniformly-reweighted NBP (URW-NBP). We also extend NBP for cooperative localization in mobile networks. In contrast to the previous methods, we use an optional smoothing, provide a novel communication protocol, and increase the efficiency of the sampling techniques. Moreover, we propose novel algorithms for distributed tracking, in which the goal is to track the passive object which cannot locate itself. In particular, we develop distributed particle filtering (DPF) based on three asynchronous belief consensus (BC) algorithms: standard belief consensus (SBC), broadcast gossip (BG), and belief propagation (BP). Finally, the last part of this thesis includes the experimental analysis of some of the proposed algorithms, in which we found that the results based on real measurements are very similar with the results based on theoretical models.

DAEDALUS at ImageCLEF Medical Retrieval 2011: Textual, Visual and Multimodal Experiments

This paper describes the participation of DAEDALUS at ImageCLEF 2011 Medical Retrieval task. We have focused on multimodal (or mixed) experiments that combine textual and visual retrieval. The main objective of our research has been to evaluate the effect on the medical retrieval process of the existence of an extended corpus that is annotated with the image type, associated to both the image itself and also to its textual description. For this purpose, an image classifier has been developed to tag each document with its class (1st level of the hierarchy: Radiology, Microscopy, Photograph, Graphic, Other) and subclass (2nd level: AN, CT, MR, etc.). For the textual-based experiments, several runs using different semantic expansion techniques have been performed. For the visual-based retrieval, different runs are defined by the corpus used in the retrieval process and the strategy for obtaining the class and/or subclass. The best results are achieved in runs that make use of the image subclass based on the classification of the sample images. Although different multimodal strategies have been submitted, none of them has shown to be able to provide results that are at least comparable to the ones achieved by the textual retrieval alone. We believe that we have been unable to find a metric for the assessment of the relevance of the results provided by the visual and textual processes

A visual object counter based on a multimodal data association for embedded systems with limited computational power

A low complex but highly-efficient object counter algorithm is presented that can be embedded in hardware with a low computational power. This is achieved by a novel soft-data association strategy that can handle multimodal distributions.