Semantic-associative visual content labelling and retrieval: A multimodal approach

A novel framework referred to as collaterally confirmed labelling (CCL) is proposed, aiming at localising the visual semantics to regions of interest in images with textual keywords. Both the primary image and collateral textual modalities are exploited in a mutually co-referencing and complementary fashion. The collateral content and context-based knowledge is used to bias the mapping from the low-level region-based visual primitives to the high-level visual concepts defined in a visual vocabulary. We introduce the notion of collateral context, which is represented as a co-occurrence matrix of the visual keywords. A collaborative mapping scheme is devised using statistical methods like Gaussian distribution or Euclidean distance together with collateral content and context-driven inference mechanism. We introduce a novel high-level visual content descriptor that is devised for performing semantic-based image classification and retrieval. The proposed image feature vector model is fundamentally underpinned by the CCL framework. Two different high-level image feature vector models are developed based on the CCL labelling of results for the purposes of image data clustering and retrieval, respectively. A subset of the Corel image collection has been used for evaluating our proposed method. The experimental results to-date already indicate that the proposed semantic-based visual content descriptors outperform both traditional visual and textual image feature models. (C) 2007 Elsevier B.V. All rights reserved.

Queue-based agent architecture for multimodal interfaces

This paper presents a queue-based agent architecture for multimodal interfaces. Using a novel approach to intelligently organise both agents and input data, this system has the potential to outperform current state-of-the-art multimodal systems, while at the same time allowing greater levels of interaction and flexibility. This assertion is supported by simulation test results showing that significant improvements can be obtained over normal sequential agent scheduling architectures. For real usage, this translates into faster, more comprehensive systems, without the limited application domain that restricts current implementations.

Dynamic Niche Clustering: a fuzzy variable radius niching technique for multimodal optimisation in GAs

This paper describes the recent developments and improvements made to the variable radius niching technique called Dynamic Niche Clustering (DNC). DNC is fitness sharing based technique that employs a separate population of overlapping fuzzy niches with independent radii which operate in the decoded parameter space, and are maintained alongside the normal GA population. We describe a speedup process that can be applied to the initial generation which greatly reduces the complexity of the initial stages. A split operator is also introduced that is designed to counteract the excessive growth of niches, and it is shown that this improves the overall robustness of the technique. Finally, the effect of local elitism is documented and compared to the performance of the basic DNC technique on a selection of 2D test functions. The paper is concluded with a view to future work to be undertaken on the technique.

The TGR5 receptor mediates bile acid-induced itch and analgesia

Patients with cholestatic disease exhibit pruritus and analgesia, but the mechanisms underlying these symptoms are unknown. We report that bile acids, which are elevated in the circulation and tissues during cholestasis, cause itch and analgesia by activating the GPCR TGR5. TGR5 was detected in peptidergic neurons of mouse dorsal root ganglia and spinal cord that transmit itch and pain, and in dermal macrophages that contain opioids. Bile acids and a TGR5-selective agonist induced hyperexcitability of dorsal root ganglia neurons and stimulated the release of the itch and analgesia transmitters gastrin-releasing peptide and leucine-enkephalin. Intradermal injection of bile acids and a TGR5-selective agonist stimulated scratching behavior by gastrin-releasing peptide- and opioid-dependent mechanisms in mice. Scratching was attenuated in Tgr5-KO mice but exacerbated in Tgr5-Tg mice (overexpressing mouse TGR5), which exhibited spontaneous pruritus. Intraplantar and intrathecal injection of bile acids caused analgesia to mechanical stimulation of the paw by an opioid-dependent mechanism. Both peripheral and central mechanisms of analgesia were absent from Tgr5-KO mice. Thus, bile acids activate TGR5 on sensory nerves, stimulating the release of neuropeptides in the spinal cord that transmit itch and analgesia. These mechanisms could contribute to pruritus and painless jaundice that occur during cholestatic liver diseases.

TESSA - Toolkit for experimentation with multimodal sensory substitution and augmentation

TESSA is a toolkit for experimenting with sensory augmentation. It includes hardware and software to facilitate rapid prototyping of interfaces that can enhance one sense using information gathered from another sense. The toolkit contains a range of sensors (e.g. ultrasonics, temperature sensors) and actuators (e.g. tactors or stereo sound), designed modularly so that inputs and outputs can be easily swapped in and out and customized using TESSA’s graphical user interface (GUI), with “real time” feedback. The system runs on a Raspberry Pi with a built-in touchscreen, providing a compact and portable form that is amenable for field trials. At CHI Interactivity, the audience will have the opportunity to experience sensory augmentation effects using this system, and design their own sensory augmentation interfaces.

Robust multimodal face and fingerprint fusion in the presence of spoofing attacks

Anti-spoofing is attracting growing interest in biometrics, considering the variety of fake materials and new means to attack biometric recognition systems. New unseen materials continuously challenge state-of-the-art spoofing detectors, suggesting for additional systematic approaches to target anti-spoofing. By incorporating liveness scores into the biometric fusion process, recognition accuracy can be enhanced, but traditional sum-rule based fusion algorithms are known to be highly sensitive to single spoofed instances. This paper investigates 1-median filtering as a spoofing-resistant generalised alternative to the sum-rule targeting the problem of partial multibiometric spoofing where m out of n biometric sources to be combined are attacked. Augmenting previous work, this paper investigates the dynamic detection and rejection of livenessrecognition pair outliers for spoofed samples in true multi-modal configuration with its inherent challenge of normalisation. As a further contribution, bootstrap aggregating (bagging) classifiers for fingerprint spoof-detection algorithm is presented. Experiments on the latest face video databases (Idiap Replay- Attack Database and CASIA Face Anti-Spoofing Database), and fingerprint spoofing database (Fingerprint Liveness Detection Competition 2013) illustrate the efficiency of proposed techniques.

Epidural analgesia with morphine or buprenorphine in ponies with lipopolysaccharide (LPS)-induced carpal synovitis

This study evaluated the analgesia effects of the epidural administration of 0.1 mg/kg bodyweight (BW) of morphine or 5 mu g/kg BW of buprenorphine in ponies with radiocarpal joint synovitis. Six ponies were submitted to 3 epidural treatments: the control group (C) received 0.15 mL/kg BW of a 0.9% sodium chloride (NaCl) solution; group M was administered 0.1 mg/kg BW of morphine; and group B was administered 5 mu g/kg BW of buprenorphine, both diluted in 0.9% NaCl to a total volume of 0.15 mL/kg BW administered epidurally at 10 s/mL. The synovitis model was induced by injecting 0.5 ng of lipopolysaccharide (LPS) in the left or right radiocarpal joint. An epidural catheter was later introduced in the lumbosacral space and advanced up to the thoracolumbar level. The treatment started 6 h after synovitis induction. Lameness, maximum angle of carpal flexion, heart rate, systolic arterial pressure, respiratory rate, temperature, and intestinal motility were evaluated before LPS injection (baseline), 6 h after LPS injection (time 0), and 0.5, 1, 2, 4, 6, 8, 10, 12, 16, 20, and 24 h after treatments. Although the model of synovitis produced clear clinical signs of inflammation, the lameness scores in group C were different from the baseline for only up to 12 h. Both morphine and buprenorphine showed a reduction in the degree of lameness starting at 0.5 and 6 h, respectively. Reduced intestinal motility was observed at 0.5 h in group M and at 0.5 to 1 h in group B. Epidural morphine was a more effective analgesic that lasted for more than 12 h and without side effects. It was concluded that morphine would be a valuable analgesic option to alleviate joint pain in the thoracic limbs in ponies.

Morphine peripheral analgesia depends on activation of the PI3K gamma/AKT/nNOS/NO/K(ATP) signaling pathway

Morphine is one of the most prescribed and effective drugs used for the treatment of acute and chronic pain conditions. In addition to its central effects, morphine can also produce peripheral analgesia. However, the mechanisms underlying this peripheral action of morphine have not yet been fully elucidated. Here, we show that the peripheral antinociceptive effect of morphine is lost in neuronal nitric-oxide synthase null mice and that morphine induces the production of nitric oxide in primary nociceptive neurons. The activation of the nitric-oxide pathway by morphine was dependent on an initial stimulation of PI3K gamma/AKT protein kinase B (AKT) and culminated in increasedactivation of K(ATP) channels. In the latter, this intracellular signaling pathway might cause a hyperpolarization of nociceptive neurons, and it is fundamental for the direct blockade of inflammatory pain by morphine. This understanding offers new targets for analgesic drug development.

A full family of multimodal maps on the circle

We exhibit a family of trigonometric polynomials inducing a family of 2m-multimodal maps on the circle which contains all relevant dynamical behavior.

RailsTNE : En multimodal informationsplattform i ett interorganisatoriskt nätverk

Att utreda möjligheterna att etablera dataförsörjning riktade mot multimodala transporttjänster är idag av största intresse. Det är också intressant att försöka utnyttja de standarder som tagits fram när en dataförsörjningskedja ska etableras. Detta examensarbete genomfördes på Triona AB i Borlänge. Triona har utvecklat databasen Transport Network Engine (TNE), som idag används för att läsa in data från Nationella VägDataBasen (NVDB) och från skogsnäringen. Målet med arbetet var att ta fram en informationsmodell, som beskriver hur ett transportnät med nätanknutna data, som stödjer multimodala transporter och resor, kan lagras i TNE. En förlängning av målet blev att, utifrån ett givet användarfall, etablera dataförsörjning till TNE och lägga in de nödvändiga datamängderna. TNE bygger på ESRI:s produkter och funktionalitet för hantering av geografisk information och informationsmodell och datahantering i TNE baseras på internationella och svenska standarder. Idag finns all information om järnvägsnätet hos Banverket och det finns ingen koppling mellan Banverkets databas Baninformationssystemet (BIS) och Vägverkets databas NVDB. För att den kopplingen ska kunna ske, krävs att de båda verken kan samarbeta som två stora organisationer i ett väl fungerande nätverk. Ett så kallat interorganisatoriskt nätverk. Det akademiska syftet var att föreslå en arkitekturstrategi som stödjer ett sådant nätverk. Vi upptäckte att arkitekturstrategierna IRM och VBS är uppbyggda för att inrikta sig på enskilda organisationer, och det visade sig svårt att följa en specifik strategi inom ett nätverk med flera organisationer. I vårt användarfall måste nätverket mellan Banverket, Vägverket och Stora Enso samarbeta över organisationsgränserna. Därför behövs en strategi för ett interorganisatoriskt samarbete så att informationen kan struktureras på ett gemensamt sätt. Vi föreslår ett antal idealtypskriterier som vi utgått efter i struktureringen av systemarkitekturen. Den innehåller en informationsmodell för både väg- och järnvägsdata som följer standarden SS 63 70 04. Arbetet avgränsades till att endast innehålla de datamängder som användarfallet kräver. Vi har analyserat KombiTIF-rapporten som är ett avslutat projekt styrt av Banverket på uppdrag av Näringsdepartementet. Rapporten ger ett förslag på en lösning i form av en arena som ska göra data tillgänglig för användning. Vi väljer att se TNE-plattformen som en realisering av denna arena. Enligt vårt förslg så ska TNE-plattformen hämta in det mest grundläggande datat om järnvägsnät och nätanknuten data från BIS och standardiserad information om vägnät och nätanknuten data från NVDB via ett gränssnitt. I framtiden är det möjligt att på samma sätt ta in andra trafiknät såsom Sjöfartsverket, Luftfartsverket och Rikstrafiken. Vi arbetade efter en egen metod som vi tog fram med valda delar från andra metoder; kartläggning, perspektivanalys, verksamhetsanalys, utveckling och utvärdering. Arbetet genomfördes iterativt i de fem olika faserna.

Multimodal Literacy as a form of Communication : What is the state of the students at Dalarna University multimodal literacy?

Literacy is an invaluable asset to have, and has allowed for communication, documentation and the spreading of ideas since the beginning of the written language. With technological advancements, and new possibilities to communicate, it is important to question the degree to which people’s abilities to utilise these new methods have developed in relation to these emerging technologies. The purpose of this bachelor’s thesis is to analyse the state of students’ at Dalarna University mulitimodal literacy, as well as their experience of multimodality in their education. This has led to the two main research questions: What is the state of the students at Dalarna University multimodal literacy? And: How have the students at Dalarna University experienced multimodality in education? The paper is based on a mixed-method study that incorporates both a quantitative and qualitative aspect to it. The main thrust of the research paper is, however, based on a quantitative study that was conducted online and emailed to students via their program coordinators. The scope of the research is in audio-visual modes, i.e. audio, video and images, while textual literacy is presumed and serves as an inspiration to the study. The purpose of the study is to analyse the state of the students’ multimodal literacy and their experience of multimodality in education. The study revealed that the students at Dalarna University have most skill in image editing, while not being very literate in audio or video editing. The students seem to have had mediocre experience creating meaning through multimodality both in private use and in their respective educational institutions. The study also reveals that students prefer learning by means of video (rather than text or audio), yet are not able to create meaning (communicate) through it.