How new online communication tools and the availability of content influence the audiences and the creative process

We live in a changing world. At an impressive speed, every day new technological resources appear. We increasingly use the Internet to obtain and share information, and new online communication tools are emerging. Each of them encompasses new potential and creates new audiences. In recent years, we witnessed the emergence of Facebook, Twitter, YouTube and other media platforms. They have provided us with an even greater interactivity between sender and receiver, as well as generated a new sense of community. At the same time we also see the availability of content like it never happened before. We are increasingly sharing texts, videos, photos, etc. This poster intends to explore the potential of using these new online communication tools in the cultural sphere to create new audiences, to develop of a new kind of community, to provide information as well as different ways of building organizations’ memory. The transience of performing arts is accompanied by the need to counter that transience by means of documentation. This desire to ‘save’ events reaches its expression with the information archive of the different production moments as well as the opportunity to record the event and present it through, for instance, digital platforms. In this poster we intend to answer the following questions: which online communication tools are being used to engage audiences in the cultural sphere (specifically between theater companies in Lisbon)? Is there a new relationship with the public? Are online communication tools creating a new kind of community? What changes are these tools introducing in the creative process? In what way the availability of content and its archive contribute to the organization memory? Among several references, we will approach the two-way communication model that James E. Grunig & Todd T. Hunt (1984) already presented and the concept of mass self-communication of Manuel Castells (2010). Castells also tells us that we have moved from traditional media to a system of communication networks. For Scott Kirsner (2010), we have entered an era of digital creativity, where artists have the tools to do what they imagined and the public no longer wants to just consume cultural goods, but instead to have a voice and participate. The creativity process is now depending on the public choice as they wander through the screen. It is the receiver who owns an object which can be exchanged. Virtual reality has encouraged the receiver to abandon its position of passive observer and to become a participant agent, which implies a challenge to organizations: inventing new forms of interfaces. Therefore, we intend to find new and effective online tools that can be used by cultural organizations; the best way to manage them; to show how organizations can create a community with the public and how the availability of online content and its archive can contribute to the organizations’ memory.

Média digitais e lusofonia

É meu propósito, neste texto, discutir a Lusofonia através de um conjunto de conceitos ligados aos média digitais interativos, rompendo os limites da ligação entre produtores e recetores de conteúdos nas relações multi, inter e transculturais. Vou insistir na ideia de que os média digitais interativos significam novas práticas nas relações interculturais: por um lado, formas digitais interativas de comunicação intercultural e, por outro, textualidades multimodais (“hipertextualidades”) na produção do sentido lusófono. O percurso que proponho tem um cariz preponderantemente epistemológico. Tomando a Lusofonia como figura de interesse geoestratégico e cultural e os média digitais como objeto de análise, é minha preocupação fundamental interrogar a inovação, a hibridez e a interatividade digitais e verificar de que modo se articulam com as relações multi, inter e transculturais. Palavras-chave: Lusofonia, comunicação intercultural, média digitais interativos, comunicação multimodal, tecnologia da comunicação, Museu da Língua Portuguesa em São Paulo, Museu Virtual da Lusofonia.

Poder e valores da linguagem verbal na publicidade

A publicidade sabe que tem de procurar as estratégias mais diretas e mais eficientes na construção das suas mensagens. A ser assim, pode parecer que o imediatismo das imagens ligado às facilidades tecnológicas tenderá a secundarizar o poder da componente verbal na elaboração dos anúncios. O presente texto procura mostrar como a componente verbal é uma dimensão imprescindível da linguagem publicitária, utilizando estratégias diversificadas que podem ir da ausência (quase) absoluta de palavras até a usos em que é a própria mensagem verbal o principal elemento estruturador do anúncio.

Uma nova espécie de Hylodes (Anura, Hylodidae) da Serra do Japi: descrição, modo reprodutivo e comunicação

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)

Teletandem: possibilidades, dificuldades e abrangência de um projeto de comunicação online de PLE

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)

Diversity and evolution of sexually dimorphic mental and lateral glands in Cophomantini treefrogs (Anura: Hylidae: Hylinae)

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)

A study for the self similarity smile detection

[EN]This work makes an extensive experimental study of smile detection testing the Local Binary Patterns (LBP) combined with self similarity (LAC) as main descriptors of the image, along with the powerful Support Vector Machines classifier. Results show that error rates can be acceptable and the self similarity approach for the detection of smiles is suitable for real-time interaction, although there is still room for improvement.

La telefonía móvil : el impacto social

El objetivo de este proyecto ha sido el de realizar un análisis del importante desarrollo que han sufrido las telecomunicaciones, haciendo un especial hincapié en la telefonía móvil y el impacto y repercusión que ha causado actualmente en nuestra sociedad. Para ello se hará un repaso evolutivo de las tecnologías de la información y las telecomunicaciones, y se establecerá una relación entre la gran difusión de éstas y su efecto sobre los usos, y cambios percibidos por los consumidores del nuevo siglo. Ciertamente la historia de la tecnología, nos enseña que la gente y las organizaciones acaban utilizándola para unos propósitos muy diferentes de aquellos que inicialmente fueron concebidas. Además cuanto más interactiva sea una tecnología, tanto más probable será que los usuarios se conviertan en productores o modificadores de la misma. Por tanto, la sociedad necesita resolver las incógnitas que pueda suscitar el rápido y continúo cambio de las comunicaciones. Este proyecto trata de ayudar a responder alguna de las cuestiones que actualmente se están planteando. ¿Son los teléfonos móviles una expresión de identidad, artilugios de moda, herramientas de la vida cotidiana, o todo lo anterior? ¿Existen nuevos modelos de comportamiento y conducta social? ¿La comunicación móvil está favoreciendo la aparición de una nueva cultura joven con un lenguaje propio basado en la comunicación textual y multimodal? ¿Tienen los teléfonos móviles efectos nocivos en la salud? La respuesta a estas preguntas afecta a nuestras vidas y también condiciona las políticas públicas y las estrategias de negocio, por eso requiere adquirir un conocimiento cimentado en la información, y la recopilación de datos de diversas fuentes, tanto de estadísticas provenientes de diferentes estudios e investigaciones, como de empresas consultoras, siempre basada en una perspectiva global. En conjunto, se espera dentro de los límites del conocimiento actual, contribuir a establecer las bases para el análisis y valoración de la relación existente entre comunicación, tecnología y sociedad en todo el mundo. Abstract The purpose of this project has been to analyse the significant development undergone by telecommunications, putting a special emphasis on mobile phones and the impact it has caused in society. We will go over the evolution of IT technologies and telecommunications as well as establish a relationship between its spread and effect of its uses and changes understood by the new century consumers. Technology history shows us that people and organizations use it for very different purposes from those originally thought. Furthermore, the more interactive technologies are, the more users will modify or produce it. Therefore, society needs to solve the mysteries of the quick and continuous change of communications. This project tries to help and answer some of the questions considered these days. Are mobile phones an expression of identity, fashionable devices, tools for everyday life or all at once? Are there any new models of performance and social behaviour? Is mobile communication favouring the existence of a new young culture with a typical language based on textual and multimodal communication? Are mobile phones bad for our health? The answer to these questions affects us all and conditions public politics and business strategies so it is required to get firm knowledge based on information. It is also important to compile data from various sources, from statistics of research and studies, based on a global perspective. As a whole, we hope to contribute to establish the bases for the future analysis and assessment of a fundamental trend that is redefining the relationship between communication, technology and society worldwide by transforming the wireless networks that make our lives.

An ethnographic investigation into gender and language in the Northern Ireland Assembly

This paper investigates the extent to which the negative evaluation of one of the women Ministers in the Northern Ireland Assembly can be attributed to gender. Interviews with politicians as well as the Minister herself illuminate this discussion by identifying the ‘gendered discourses’ that are drawn upon when describing the Minister’s communicative style in debates. Close analyses of transcripts of debates offer a description of some elements of this style, and find that while the Minister is confrontational in debates and ‘stands her ground’, she does not take part in illegal interventions that disrupt the debate floor and are characteristic of the Assembly as a whole. Although the construction of the Minister’s unpopularity can be attributed to a complex interplay of factors, it can be concluded that it is partly the way she draws on gendered linguistic resources that leads her to be negatively judged by her peers.

La dimensione interazionale nell'interpretazione di conferenza: il caso dell'interpretazione consecutiva tra l'italiano e il cinese in conferenze con minor grado di formalità

La nascita dell’interpretazione di conferenza è strettamente legata a storici incontri diplomatici e ai congressi di istituzioni internazionali di grande rilievo. Tuttavia, oggi, nell’epoca della globalizzazione, ci si riunisce sempre più per la condivisione di conoscenze e per motivi personali, anche in contesti meno formalizzati. Sebbene, in quanto conferenza, le norme interazionali continuino a vincolare il meccanismo dei turni di parola, in tali circostanze tra l’oratore e chi lo ascolta si instaurano maggiore sintonia e attenzione reciproca attraverso molteplici mezzi comunicativi, verbali e non-verbali. Il presente studio, posizionandosi nella prospettiva dell’analisi discorsiva e della comunicazione multimodale, ha come obiettivo quello di verificare se la presenza dell’interprete modifichi la relazione interpersonale caratterizzata dal senso di reciprocità tra chi enuncia e chi ascolta, e se sì, quali siano le nuove dinamiche comunicative che emergono. A tal fine, sono stati reperiti filmati di nove conferenze con minor grado di formalità dove era previsto lo svolgimento dell’interpretazione consecutiva tra l’italiano e il cinese e, relativamente a questi, sono state eseguite dapprima due fasi di valutazione preliminare: la prima prevedeva la raccolta e l’analisi delle informazioni di base riguardanti lo svolgimento dei nove eventi e i relativi partecipanti; la seconda consisteva nell’esame contrastivo tra i sistemi linguistico-culturali italiano e cinese. In seguito all’acquisizione delle informazioni contestuali e circostanziali, si è proceduto all’analisi qualitativa dei casi di studio di interazione tra l’interprete e gli altri partecipanti. A tal fine, soni stati esaminati non solo gli interventi linguistici, ma anche le attività non-verbali. Nonostante la molteplicità delle dinamiche osservate, è stato possibile riconoscere una tendenza secondo cui l’interprete stabilisce relazioni di carattere dialogico sia con i partecipanti presenti sul palco, ovvero l’oratore e il moderatore, che con il pubblico presente agli eventi analizzati.

Multimodal Literacy as a form of Communication : What is the state of the students at Dalarna University multimodal literacy?

Literacy is an invaluable asset to have, and has allowed for communication, documentation and the spreading of ideas since the beginning of the written language. With technological advancements, and new possibilities to communicate, it is important to question the degree to which people’s abilities to utilise these new methods have developed in relation to these emerging technologies. The purpose of this bachelor’s thesis is to analyse the state of students’ at Dalarna University mulitimodal literacy, as well as their experience of multimodality in their education. This has led to the two main research questions: What is the state of the students at Dalarna University multimodal literacy? And: How have the students at Dalarna University experienced multimodality in education? The paper is based on a mixed-method study that incorporates both a quantitative and qualitative aspect to it. The main thrust of the research paper is, however, based on a quantitative study that was conducted online and emailed to students via their program coordinators. The scope of the research is in audio-visual modes, i.e. audio, video and images, while textual literacy is presumed and serves as an inspiration to the study. The purpose of the study is to analyse the state of the students’ multimodal literacy and their experience of multimodality in education. The study revealed that the students at Dalarna University have most skill in image editing, while not being very literate in audio or video editing. The students seem to have had mediocre experience creating meaning through multimodality both in private use and in their respective educational institutions. The study also reveals that students prefer learning by means of video (rather than text or audio), yet are not able to create meaning (communicate) through it.

Multimodal viral communication: a social semiotic analysis of the popular Spanish "Ola ke ase" meme

Multimodality – the interdependence of semiotic resources in text – is an existential element of today’s media. The term multimodality attends systematically to the social interpretation of a wide range of communicational forms used in meaning making. A primary focus of social- semiotic multimodal analysis is on mapping how modal resources are used by people in a given social context. In November 2012 the “Ola ke ase” catchphrase, which is a play on “Hola ¿qué hace?”, appeared for the first time in Spain and immediately has been adopted as a Twitter hashtag and an image macro series. Its viral spread on social networks has been tremendous, being a trending topic in various Spanish-speaking countries. The objective of analysis is how language and image work together in the “Ola ke ase” meme. The interplay between text and image in one of the original memes and some of its variations is quantitatively analysed applying a social-semiotic approach. Results demonstrate how the “Ola ke ase” meme functions through its multimodal character and the non-standard orthography. The spread of uncountable variations of the meme shows the social process that goes on in the meaning making of the semiotic elements.

A PHENOMENOLOGY OF MIMETIC LEARNING AND MULTIMODAL COGNITION: INTEGRATING EXPERIENTIAL KNOWLEDGE INTO PROGRAMS IN RHETORIC, COMPOSITION, AND TECHNICAL COMMUNICATION

My dissertation emphasizes a cognitive account of multimodality that explicitly integrates experiential knowledge work into the rhetorical pedagogy that informs so many composition and technical communication programs. In these disciplines, multimodality is widely conceived in terms of what Gunther Kress calls “socialsemiotic” modes of communication shaped primarily by culture. In the cognitive and neurolinguistic theories of Vittorio Gallese and George Lakoff, however, multimodality is described as a key characteristic of our bodies’ sensory-motor systems which link perception to action and action to meaning, grounding all communicative acts in knowledge shaped through body-engaged experience. I argue that this “situated” account of cognition – which closely approximates Maurice Merleau-Ponty’s phenomenology of perception, a major framework for my study – has pedagogical precedence in the mimetic pedagogy that informed ancient Sophistic rhetorical training, and I reveal that training’s multimodal dimensions through a phenomenological exegesis of the concept mimesis. Plato’s denigration of the mimetic tradition and his elevation of conceptual contemplation through reason, out of which developed the classic Cartesian separation of mind from body, resulted in a general degradation of experiential knowledge in Western education. But with the recent introduction into college classrooms of digital technologies and multimedia communication tools, renewed emphasis is being placed on the “hands-on” nature of inventive and productive praxis, necessitating a revision of methods of instruction and assessment that have traditionally privileged the acquisition of conceptual over experiential knowledge. The model of multimodality I construct from Merleau-Ponty’s phenomenology, ancient Sophistic rhetorical pedagogy, and current neuroscientific accounts of situated cognition insists on recognizing the significant role knowledges we acquire experientially play in our reading and writing, speaking and listening, discerning and designing practices.

Enhancing Multimodal Silent Speech Interfaces With Feature Selection

In research on Silent Speech Interfaces (SSI), different sources of information (modalities) have been combined, aiming at obtaining better performance than the individual modalities. However, when combining these modalities, the dimensionality of the feature space rapidly increases, yielding the well-known "curse of dimensionality". As a consequence, in order to extract useful information from this data, one has to resort to feature selection (FS) techniques to lower the dimensionality of the learning space. In this paper, we assess the impact of FS techniques for silent speech data, in a dataset with 4 non-invasive and promising modalities, namely: video, depth, ultrasonic Doppler sensing, and surface electromyography. We consider two supervised (mutual information and Fisher's ratio) and two unsupervised (meanmedian and arithmetic mean geometric mean) FS filters. The evaluation was made by assessing the classification accuracy (word recognition error) of three well-known classifiers (knearest neighbors, support vector machines, and dynamic time warping). The key results of this study show that both unsupervised and supervised FS techniques improve on the classification accuracy on both individual and combined modalities. For instance, on the video component, we attain relative performance gains of 36.2% in error rates. FS is also useful as pre-processing for feature fusion. Copyright © 2014 ISCA.

Analyse de la traduction d’un texte multimodal : la bande dessinée : le cas de Mujeres alteradas

La présente recherche porte sur la traduction de la bande dessinée. Ce sujet, auparavant négligé par les traductologes, commence à susciter l’intérêt des chercheurs à partir les années 80. Toutefois, la plupart des travaux se sont concentrés sur l’aspect linguistique des BD. Ce mémoire, par contre, aborde la bande dessinée comme un texte multimodal. Il s’inscrit ainsi à la croisée des domaines de la traduction et de la multimodalité telle que proposée dans les travaux de Gunther Kress et Theo Van Leeuwen (2001). L’objectif de cette recherche est d’implanter un outil d’analyse pour la bande dessinée qui permettrait de rendre compte des différents modes intervenant dans le texte. Cet outil, conçu pour la présente recherche, a été développé à partir des travaux de Hatim et Mason (1990, 1997) sur les trois dimensions de la situation de communication : transaction communicative, action pragmatique et interaction sémiotique. L’analyse menée ici porte sur la traduction vers le français de la bande dessinée argentine Mujeres alteradas de Maitena Burundarena, parue sous le titre de Les déjantées.