924 resultados para Multimodal interfaces
Resumo:
The number of large research networks and programmes engaging in knowledge production for development has grown over the past years. One of these programmes devoted to generating knowledge about and for development is National Centre of Competence in Research (NCCR) North–South, a cross-disciplinary, international development research network funded by the Swiss Agency for Development and Cooperation and the Swiss National Science Foundation. Producing relevant knowledge for development is a core goal of the programme and an important motivation for many of the participating researchers. Over the years, the researchers have made use of various spaces for exchange and instruments for co-production of knowledge by academic and non-academic development actors. In this article we explore the characteristics of co-producing and sharing knowledge in interfaces between development research, policy and NCCR North–South practice. We draw on empirical material of the NCCR North–South programme and its specific programme element of the Partnership Actions. Our goal is to make use of the concept of the interface to reflect critically about the pursued strategies and instruments applied in producing and sharing knowledge for development across boundaries.
Resumo:
The past few years, multimodal interaction has been gaining importance in virtual environments. Although multimodality renders interacting with an environment more natural and intuitive, the development cycle of such an application is often long and expensive. In our overall field of research, we investigate how modelbased design can facilitate the development process by designing environments through the use of highlevel diagrams. In this scope, we present ‘NiMMiT’, a graphical notation for expressing and evaluating multimodal user interaction; we elaborate on the NiMMiT primitives and demonstrate its use by means of a comprehensive example.
Resumo:
Electronic apppliances are increasingly a part of our everyday lives. In particular, mobile devices, with their reduced dimensions with power rivaling desktop computers, have substantially augmented our communication abilities offering instant availability, anywhere, to everyone. These devices have become essential for human communication but also include a more comprehensive tool set to support productivity and leisure applications. However, the many applications commonly available are not adapted to people with special needs. Rather, most popular devices are targeted at teenagers or young adults with excellent eyesight and coordination. What is worse, most of the commonly used assistive control interfaces are not available in a mobile environment where user's position, accommodation and capacities can vary even widely. To try and address people with special needs new approaches and techniques are sorely needed. This paper presents a control interface to allow tetraplegic users to interact with electronic devices. Our method uses myographic information (Electromyography or EMG) collected from residually controlled body areas. User evaluations validate electromyography as a daily wearable interface. In particular our results show that EMG can be used even in mobility contexts.
Resumo:
Recent copyright cases on both sides of the Atlantic focused on important interoperability issues. While the decision by the Court of Justice of the European Union in SAS Institute, Inc.v. World Programming Ltd. assessed data formats under the EU Software Directive, the ruling by the Northern District of California Court in Oracle America, Inc. v. Google Inc. dealt with application programming interfaces. The European decision is rightly celebrated as a further important step in the promotion of interoperability in the EU. This article argues that, despite appreciable signs of convergence across the Atlantic, the assessment of application programming interfaces under EU law could still turn out to be quite different, and arguably much less pro-interoperability, than under U.S. law.
Resumo:
Three-dimensional (3D) immersive virtual worlds have been touted as being capable of facilitating highly interactive, engaging, multimodal learning experiences. Much of the evidence gathered to support these claims has been anecdotal but the potential that these environments hold to solve traditional problems in online and technology-mediated education—primarily learner isolation and student disengagement—has resulted in considerable investments in virtual world platforms like Second Life, OpenSimulator, and Open Wonderland by both professors and institutions. To justify this ongoing and sustained investment, institutions and proponents of simulated learning environments must assemble a robust body of evidence that illustrates the most effective use of this powerful learning tool. In this authoritative collection, a team of international experts outline the emerging trends and developments in the use of 3D virtual worlds for teaching and learning. They explore aspects of learner interaction with virtual worlds, such as user wayfinding in Second Life, communication modes and perceived presence, and accessibility issues for elderly or disabled learners. They also examine advanced technologies that hold potential for the enhancement of learner immersion and discuss best practices in the design and implementation of virtual world-based learning interventions and tasks. By evaluating and documenting different methods, approaches, and strategies, the contributors to Learning in Virtual Worlds offer important information and insight to both scholars and practitioners in the field. AU Press is an open access publisher and the book is available for free in PDF format as well as for purchase on our website: http://bit.ly/1W4yTRA
Resumo:
Electrochemical reactivity and structure properties of electrogenic bacteria, Geobacter sulfurreducens (Gs) were studied to explore the heterogeneous electron transfer at the bacteria/electrode interface using electrochemical and in-situ spectroscopic techniques. The redox behavior of Gs adsorbed on a gold electrode, which is modified with a ω-functionalized self-assembled monolayer (SAM) of alkanethiols, depends strongly on the terminal group. The latter interacts directly with outermost cytochromes embedded into the outer membrane of the Gs cells. The redox potential of bacterial cells bound electrostatically to a carboxyl-terminated SAM is close to that observed for bacteria attached to a bare gold electrode, revealing a high electronic coupling at the cell/SAM interface. The redox potentials of bacterial cells adsorbed on amino- and pyridyl-terminated SAMs are significantly different suggesting that the outermost cytochromes changes their conformation upon adsorption on these SAMs. No redox activity of Gs was found with CH3-, N(CH3)3+- and OH-terminated SAMs. Complementary in-situ spectroscopic studies on bacteria/SAMs/Au electrode assemblies were carried out to monitor structure changes of the bacterial cells upon polarization. Spectro-electrochemical techniques revealed the electrochemical turnover of the oxidized and reduced states of outer membrane cytochromes (OMCs) in Gs, providing evidence that the OMCs are responsible for the direct electron transfer to metal electrodes, such as gold or silver, during the electricity production. Furthermore, we observed spectroscopic signatures of the native structure of the OMCs and no conformational change during the oxidation/reduction process of the microorganisms. These findings indicate that the carboxyl-anchoring group provides biocompatible conditions for the outermost cytochromes of the Gs, which facilitate the heterogeneous electron transfer at the microorganism/electrode interface.
Resumo:
We have studied Au(55 nm)@SiO2 nanoparticles (NPs) on two low-index phases of gold and platinum single crystal electrodes in ClO4– and SO42– ion-containing electrolytes by both electrochemical methods and in-situ shell-isolated nanoparticle enhanced Raman spectroscopy (SHINERS). We showed the blocking of the electrode with surfactants originating from the synthesis of as-prepared SHINERS NPs. We introduce an efficient procedure to overcome this problem, which provides a fundamental platform for the application of SHINERS in surface electrochemistry and beyond. Our method is based on a hydrogen evolution treatment of the SHINERS-NP-modified single-crystal surfaces. The reliability of our preparation strategy is demonstrated in electrochemical SHINERS experiments on the potential-controlled adsorption and phase formation of pyridine on Au(hkl) and Pt(hkl). We obtained high-quality Raman spectra on these well-defined and structurally carefully characterized single-crystal surfaces. The analysis of the characteristic A1 vibrational modes revealed perfect agreement with the interpretation of single-crystal voltammetric and chronoamperometric experiments. Our study demonstrates that the SHINERS protocol developed in this work qualifies this Raman method as a pioneering approach with unique opportunities for in situ structure and reactivity studies at well-defined electrochemical solid/liquid interfaces.
Resumo:
Information theory-based metric such as mutual information (MI) is widely used as similarity measurement for multimodal registration. Nevertheless, this metric may lead to matching ambiguity for non-rigid registration. Moreover, maximization of MI alone does not necessarily produce an optimal solution. In this paper, we propose a segmentation-assisted similarity metric based on point-wise mutual information (PMI). This similarity metric, termed SPMI, enhances the registration accuracy by considering tissue classification probabilities as prior information, which is generated from an expectation maximization (EM) algorithm. Diffeomorphic demons is then adopted as the registration model and is optimized in a hierarchical framework (H-SPMI) based on different levels of anatomical structure as prior knowledge. The proposed method is evaluated using Brainweb synthetic data and clinical fMRI images. Both qualitative and quantitative assessment were performed as well as a sensitivity analysis to the segmentation error. Compared to the pure intensity-based approaches which only maximize mutual information, we show that the proposed algorithm provides significantly better accuracy on both synthetic and clinical data.
Resumo:
Multimodality – the interdependence of semiotic resources in text – is an existential element of today’s media. The term multimodality attends systematically to the social interpretation of a wide range of communicational forms used in meaning making. A primary focus of social- semiotic multimodal analysis is on mapping how modal resources are used by people in a given social context. In November 2012 the “Ola ke ase” catchphrase, which is a play on “Hola ¿qué hace?”, appeared for the first time in Spain and immediately has been adopted as a Twitter hashtag and an image macro series. Its viral spread on social networks has been tremendous, being a trending topic in various Spanish-speaking countries. The objective of analysis is how language and image work together in the “Ola ke ase” meme. The interplay between text and image in one of the original memes and some of its variations is quantitatively analysed applying a social-semiotic approach. Results demonstrate how the “Ola ke ase” meme functions through its multimodal character and the non-standard orthography. The spread of uncountable variations of the meme shows the social process that goes on in the meaning making of the semiotic elements.