Reading hybrid texts : remarks on text/image transitions

The reading of printed materials implies the visual processing of information originated in two distinct semiotic systems. The rapid identification of redundancy, complementation or contradiction rhetoric strategies between the two information types may be crucial for an adequate interpretation of bimodal materials. Hybrid texts (verbal and visual) are particular instances of bimodal materials, where the redundant information is often neglected while the complementary and the contradictory ones are essential.Studies using the 504 ASL eye-tracking system while reading either additive or exhibiting captions (Baptista, 2009) revealed fixations on the verbal material and transitions between the written and the pictorial in a much higher number and duration than the initially foreseen as necessary to read the verbal text. We therefore hypothesized that confirmation strategies of the written information are taking place, by using information available in the other semiotic system.Such eye-gaze patterns obtained from denotative texts and pictures seem to contradict some of the scarce existing data on visual processing of texts and images, namely cartoons (Carroll, Young and Guertain, 1992), descriptive captions (Hegarty, 1992 a and b), and advertising images with descriptive and explanatory texts (cf. Rayner and Rotello, 2001, who refer to a previous reading of the whole text before looking at the image, or even Rayner, Miller and Rotello, 2008 who refer to an earlier and longer look at the picture) and seem to consolidate findings of Radach et al. (2003) on systematic transitions between text and image.By framing interest areas in the printed pictorial material of non redundant hybrid texts, we have identified the specific areas where transitions take place after fixations in the verbal text. The way those transitions are processed brings a new interest to further research.

Manquer de regard : enjeux intermédiatiques du texte et de l'image chez Julie Doucet et Ken Lum

Mémoire numérisé par la Division de la gestion de documents et des archives de l'Université de Montréal

Schriftlicher Text im Film und seine Übersetzung : die Inserts der BBC-Serie Sherlock (2010-12) ; aus der Perspektive von Untertiteltheorie, Comictheorie und Translationspraxis

Die BBC-Serie SHERLOCK war 2011 eine der meistexportierten Fernsehproduktionen Großbritanniens und wurde weltweit in viele Sprachen übersetzt. Eine der Herausforderungen bei der Übersetzung stellen die Schrifteinblendungen der Serie (kurz: Inserts) dar. Die Inserts versprachlichen die Gedanken des Protagonisten, bilden schriftliche und digitale Kommunikation ab und zeichnen sich dabei durch ihre visuelle Auffälligkeit und teilweise als einzige Träger sprachlicher Kommunikation aus, womit sie zum wichtigen ästhetischen und narrativen Mittel in der Serie werden. Interessanterweise sind in der Übersetztung alle stilistischen Eigenschaften der Original-Inserts erhalten. In dieser Arbeit wird einerseits untersucht, wie Schrifteinblendungen im Film theoretisch beschrieben werden können, und andererseits, was sie in der Praxis so übersetzt werden können, wie es in der deutschen Version von Sherlock geschah. Zur theoretischen Beschreibung werden zunächst die Schrifteinblendungen in Sherlock Untertitelungsnormen anhand relevanter grundlegender semiotischer Dimensionen gegenübergestellt. Weiterhin wird das Verhältnis zwischen Schrifteinblendungen und Filmbild erkundet. Dazu wird geprüft, wie gut verschiedene Beschreibungsansätze zu Text-Bild-Verhältnissen aus der Sprachwissenschaft, Comicforschung, Übersetzungswissenschaft und Typografie die Einblendungen in Sherlock erklären können. Im praktischen Teil wird die Übersetzung der Einblendungen beleuchtet. Der Übersetzungsprozess bei der deutschen Version wird auf Grundlage eines Experteninterviews mit dem Synchronautor der Serie rekonstruiert, der auch für die Formulierung der Inserts zuständig war. Abschließend werden spezifische Übersetzungsprobleme der Inserts aus der zweiten Staffel von SHERLOCK diskutiert. Es zeigt sich, dass Untertitelungsnormen zur Beschreibung von Inserts nicht geeignet sind, da sie in Dimensionen wie Position, grafische Gestaltung, Animation, Soundeffekte, aber auch Timing stark eingeschränkt sind. Dies lässt sich durch das historisch geprägte Verständnis von Untertiteln erklären, die als möglichst wenig störendes Beiwerk zum fertigen Filmbild und -ablauf (notgedrungen) hinzugefügt werden, wohingegen für die Inserts in SHERLOCK teilweise sogar ein zentraler Platz in der Bild- und Szenenkomposition bereits bei den Dreharbeiten vorgesehen wurde. In Bezug auf Text-Bild-Verhältnisse zeigen sich die größten Parallelen zu Ansätzen aus der Comicforschung, da auch dort schriftliche Texte im Bild eingebettet sind anstatt andersherum. Allerdings sind auch diese Ansätze zur Beschreibung von Bewegung und Ton unzureichend. Die Erkundung der Erklärungsreichweite weiterer vielversprechender Konzepte, wie Interface und Usability, bleibt ein Ziel für künftige Studien. Aus dem Experteninterview lässt sich schließen, dass die Übersetzung von Inserts ein neues, noch unstandardisiertes Verfahren ist, in dem idiosynkratische praktische Lösungen zur sprachübergreifenden Kommunikation zwischen verschiedenen Prozessbeteiligten zum Einsatz kommen. Bei hochqualitative Produktionen zeigt ist auch für die ersetzende Insertübersetzung der Einsatz von Grafikern unerlässlich, zumindest für die Erstellung neuer Inserts als Übersetzungen von gefilmtem Text (Display). Hierbei sind die theoretisch möglichen Synergien zwischen Sprach- und Bildexperten noch nicht voll ausgeschöpft. Zudem zeigt sich Optimierungspotential mit Blick auf die Bereitstellung von sorgfältiger Dokumentation zur ausgangssprachlichen Version. Diese wäre als Referenzmaterial für die Übersetzung insbesondere auch für Zwecke der internationalen Qualitätssicherung relevant. Die übersetzten Inserts in der deutschen Version weisen insgesamt eine sehr hohe Qualität auf. Übersetzungsprobleme ergeben sich für das genretypische Element der Codes, die wegen ihrer Kompaktheit und multiplen Bezügen zum Film eine Herausforderung darstellen. Neben weiteren bekannten Übersetzungsproblemen wie intertextuellen Bezügen und Realia stellt sich immer wieder die Frage, wieviel der im Original dargestellten Insert- und Displaytexte übersetzt werden müssen. Aus Gründen der visuellen Konsistenz wurden neue Inserts zur Übersetzung von Displays notwendig. Außerdem stellt sich die Frage insbesondere bei Fülltexten. Sie dienen der Repräsentation von Text und der Erweiterung der Grenzen der fiktiv dargestellten Welt, sind allerdings mit hohem Übersetzungsaufwand bei minimaler Bedeutung für die Handlung verbunden.

Hausdorff Distances for Searching in Binary Text Images

This work has been partially supported by Grant No. DO 02-275, 16.12.2008, Bulgarian NSF, Ministry of Education and Science.

Unpacking Japan's 21st century "National Conversation" : images of the future beyond the iron cage of the "Catch Up" model

How does the image of the future operate upon history, and upon national and individual identities? To what extent are possible futures colonized by the image? What are the un-said futurecratic discourses that underlie the image of the future? Such questions inspired the examination of Japan’s futures images in this thesis. The theoretical point of departure for this examination is Polak’s (1973) seminal research into the theory of the ‘image of the future’ and seven contemporary Japanese texts which offer various alternative images for Japan’s futures, selected as representative of a ‘national conversation’ about the futures of that nation. These seven images of the future are: 1. Report of the Prime Minister’s Commission on Japan’s Goals in the 21st Century—The Frontier Within: Individual Empowerment and Better Governance in the New Millennium, compiled by a committee headed by Japan’s preeminent Jungian psychologist Kawai Hayao (1928-2007); 2. Slow Is Beautiful—a publication by Tsuji Shinichi, in which he re-images Japan as a culture represented by the metaphor of the sloth, concerned with slow and quality-oriented livingry as a preferred image of the future to Japan’s current post-bubble cult of speed and economic efficiency; 3. MuRatopia is an image of the future in the form of a microcosmic prototype community and on-going project based on the historically significant island of Awaji, and established by Japanese economist and futures thinker Yamaguchi Kaoru; 4. F.U.C.K, I Love Japan, by author Tanja Yujiro provides this seven text image of the future line-up with a youth oriented sub-culture perspective on that nation’s futures; 5. IMAGINATION / CREATION—a compilation of round table discussions about Japan’s futures seen from the point of view of Japan’s creative vanguard; 6. Visionary People in a Visionless Country: 21 Earth Connecting Human Stories is a collection of twenty one essays compiled by Denmark born Tokyo resident Peter David Pedersen; and, 7. EXODUS to the Land of Hope, authored by Murakami Ryu, one of Japan’s most prolific and influential writers, this novel suggests a future scenario portraying a massive exodus of Japan’s youth, who, literate with state-of-the-art information and communication technologies (ICTs) move en masse to Japan’s northern island of Hokkaido to launch a cyber-revolution from the peripheries. The thesis employs a Futures Triangle Analysis (FTA) as the macro organizing framework and as such examines both pushes of the present and weights from the past before moving to focus on the pulls to the future represented by the seven texts mentioned above. Inayatullah’s (1999) Causal Layered Analysis (CLA) is the analytical framework used in examining the texts. Poststructuralist concepts derived primarily from the work of Michel Foucault are a particular (but not exclusive) reference point for the analytical approach it encompasses. The research questions which reflect the triangulated analytic matrix are: 1. What are the pushes—in terms of current trends—that are affecting Japan’s futures? 2. What are the historical and cultural weights that influence Japan’s futures? 3. What are the emerging transformative Japanese images of the future discourses, as embodied in actual texts, and what potential do they offer for transformative change in Japan? Research questions one and two are discussed in Chapter five and research question three is discussed in Chapter six. The first two research questions should be considered preliminary. The weights outlined in Chapter five indicate that the forces working against change in Japan are formidable, structurally deep-rooted, wide-spread, and under-recognized as change-adverse. Findings and analyses of the push dimension reveal strong forces towards a potentially very different type of Japan. However it is the seven contemporary Japanese images of the future, from which there is hope for transformative potential, which form the analytical heart of the thesis. In analyzing these texts the thesis establishes the richness of Japan’s images of the future and, as such, demonstrates the robustness of Japan’s stance vis-à-vis the problem of a perceived map-less and model-less future for Japan. Frontier is a useful image of the future, whose hybrid textuality, consisting of government, business, academia, and creative minority perspectives, demonstrates the earnestness of Japan’s leaders in favour of the creation of innovative futures for that nation. Slow is powerful in its aim to reconceptualize Japan’s philosophies of temporality, and build a new kind of nation founded on the principles of a human-oriented and expanded vision of economy based around the core metaphor of slowness culture. However its viability in Japan, with its post-Meiji historical pushes to an increasingly speed-obsessed social construction of reality, could render it impotent. MuRatopia is compelling in its creative hybridity indicative of an advanced IT society, set in a modern day utopian space based upon principles of a high communicative social paradigm, and sustainability. IMAGINATION / CREATION is less the plan than the platform for a new discussion on Japan’s transformation from an econo-centric social framework to a new Creative Age. It accords with emerging discourses from the Creative Industries, which would re-conceive of Japan as a leading maker of meaning, rather than as the so-called guzu, a term referred to in the book meaning ‘laggard’. In total, Love Japan is still the most idiosyncratic of all the images of the future discussed. Its communication style, which appeals to Japan’s youth cohort, establishes it as a potentially formidable change agent in a competitive market of futures images. Visionary People is a compelling image for its revolutionary and subversive stance against Japan’s vision-less political leadership, showing that it is the people, not the futures-making elite or aristocracy who must take the lead and create a new vanguard for the nation. Finally, Murakami’s Exodus cannot be ruled out as a compelling image of the future. Sharing the appeal of Tanja’s Love Japan to an increasingly disenfranchised youth, Exodus portrays a near-term future that is achievable in the here and now, by Japan’s teenagers, using information and communications technologies (ICTs) to subvert leadership, and create utopianist communities based on alternative social principles. The principal contribution from this investigation in terms of theory belongs to that of developing the Japanese image of the future. In this respect, the literature reviews represent a significant compilation, specifically about Japanese futures thinking, the Japanese image of the future, and the Japanese utopia. Though not exhaustive, this compilation will hopefully serve as a useful starting point for future research, not only for the Japanese image of the future, but also for all image of the future research. Many of the sources are in Japanese and their English summations are an added reason to respect this achievement. Secondly, the seven images of the future analysed in Chapter six represent the first time that Japanese image of the future texts have been systematically organized and analysed. Their translation from Japanese to English can be claimed as a significant secondary contribution. What is more, they have been analysed according to current futures methodologies that reveal a layeredness, depth, and overall richness existing in Japanese futures images. Revealing this image-richness has been one of the most significant findings of this investigation, suggesting that there is fertile research to be found from this still under-explored field, whose implications go beyond domestic Japanese concerns, and may offer fertile material for futures thinkers and researchers, Japanologists, social planners, and policy makers.

MAPS: midline analysis and propagation of segmentation

Scenic word images undergo degradations due to motion blur, uneven illumination, shadows and defocussing, which lead to difficulty in segmentation. As a result, the recognition results reported on the scenic word image datasets of ICDAR have been low. We introduce a novel technique, where we choose the middle row of the image as a sub-image and segment it first. Then, the labels from this segmented sub-image are used to propagate labels to other pixels in the image. This approach, which is unique and distinct from the existing methods, results in improved segmentation. Bayesian classification and Max-flow methods have been independently used for label propagation. This midline based approach limits the impact of degradations that happens to the image. The segmented text image is recognized using the trial version of Omnipage OCR. We have tested our method on ICDAR 2003 and ICDAR 2011 datasets. Our word recognition results of 64.5% and 71.6% are better than those of methods in the literature and also methods that competed in the Robust reading competition. Our method makes an implicit assumption that degradation is not present in the middle row.

Patrimonio e Identidad en la Investigación Educativa Basada en las Artes desde un Enfoque Multimodal

Este artículo describe dos experiencias de investigación de nuestro grupo interconectadas, la primera desarrollada durante el año 2007 a través del proyecto internacional CALVINO del Programa Cultura 2000 de la Unión Europea, y la segunda implementada durante el año 2014 en el marco del Proyecto Investigación e Innovación en Secundaria en Andalucía (PIIISA). Ambos proyectos tienen en común el eje temático de la identidad a partir de una idea de patrimonio y el hecho de haber puesto en práctica metodologías de investigación basadas en las artes visuales con un enfoque multimodal. Desde estos dos puntos de anclaje relativos a la temática (qué) y a la metodología (cómo) analizamos lo acontecido para obtener conclusiones relevantes que, por una parte, pongan en valor estas prácticas significativas y, por otra, aporten nuestra experiencia para futuras propuestas de investigación en el ámbito temático y/o metodológico.

Compreensão do texto escrito em inglês língua estrangeira: estudo de caso sobre o uso de um hipermédia de flexibilidade cognitiva

O presente estudo, no âmbito da Didática do Inglês, incidiu sobre a compreensão do texto escrito em Inglês, língua estrangeira, num ambiente de aprendizagem hipermédia, o DidaktosOnLine (Moreira et al., 2005). A investigação teve como objetivos avaliar a importância das características do design do hiperdocumento e de características dos participantes no estudo, tais como conhecimentos de língua inglesa, estilos de aprendizagem ou preferências epistémicas, na compreensão dos textos do hiperdocumento Images of Britain and the British. Pretendeu-se ainda avaliar a opinião dos participantes sobre a utilização do DidaktosOnLine para aceder a documentos e estudar um tema do programa. A importância do desenvolvimento da competência de compreensão de textos escritos no âmbito da aprendizagem do Inglês no Ensino Superior e as dificuldades dos alunos na compreensão dos textos mais complexos e nas tarefas que exigem transferência de conhecimentos constituem a justificação para a escolha da problemática deste estudo. A plataforma DidaktosOnLine foi desenvolvida na Universidade de Aveiro, com base nos princípios da Teoria da Flexibilidade Cognitiva (Spiro et al, 1988). É uma ferramenta hipermédia que permite a organização didática de vários tipos de materiais, por exemplo texto, imagem, som e vídeo. A investigação efetuada utilizou uma abordagem de estudo de caso. Duas turmas de alunos do curso de Ciências da Comunicação da Escola Superior de Educação e Comunicação da Universidade do Algarve utilizaram a plataforma em contexto de sala de aula. Da análise dos resultados conclui-se que as características do hiperdocumento são importantes para a compreensão dos textos, com particular destaque para os recursos que integram os minicasos e as sequências que permitem uma leitura cruzada da informação. Quanto às características dos participantes, são relevantes os conhecimentos de língua inglesa, as preferências epistémicas e os estilos de aprendizagem, sobretudo no que diz respeito a algumas subescalas do constructo utilizado. A avaliação da plataforma e do hiperdocumento utilizado é globalmente positiva, tendo os participantes referido que permite uma forma de aprender diferente. A reflexão sobre os resultados do estudo leva-nos a recomendar práticas de ensino da leitura adequadas aos novos modos de ler utilizando os media digitais, que dão ênfase ao papel ativo do leitor na construção de significado, e para as quais o DidaktosOnLine dá um contributo relevante. Apresentam-se sugestões para estudos futuros.

Physical activity in deprived communities in London: examining individual and neighbourhood-level factors

Introduction: The objectives of this study were to examine relationships between neighbourhood-level and individual-level characteristics and physical activity in deprived London neighbourhoods. Methods: In 40 of the most deprived neighbourhoods in London (ranked in top 11% in London by Index of Multiple Deprivation) a cross-sectional survey (n = 4107 adults aged > = 16 years), neighbourhood audit tool, GIS measures and routine data measured neighbourhood and individual-level characteristics. The binary outcome was meeting the minimum recommended (CMO, UK) 5×30 mins moderate physical activity per week. Multilevel modelling was used to examine associations between physical activity and individual and neighbourhood-level characteristics. Results: Respondents living more than 300 m away from accessible greenspace had lower odds of achieving recommended physical activity levels than those who lived within 300 m; from 301–600 m (OR = 0.7; 95% CI 0.5–0.9) and from 601–900 m (OR = 0.6; 95% CI 0.4–0.8). There was substantial residual between-neighbourhood variance in physical activity (median odds ratio = 1.7). Other objectively measured neighbourhood-level characteristics were not associated with physical activity levels. Conclusions Distance to nearest greenspace is associated with meeting recommended physical activity levels in deprived London neighbourhoods. Despite residual variance in physical activity levels between neighbourhoods, we found little evidence for the influence of other measured neighbourhood-level characteristics.

Book review. Cartographies of Time: a history of the timeline.

A review of 'Cartographies of Time: a history of the timeline' by Daniel Rosenberg and Anthony Grafton. Princeton, NJ: Princeton Architectural Press, 2010. (272pp. ISBN: 9781568987637). Keywords: timeline, chronographics

A World Drawn: An Introduction to the art of Julian Opie (for a Polish Audience)

Essay in a monograph associated with the exhibition Julian Opie: Sculptures, Paintings, Films at the Museum of Contemporary Art in Krakow, Poland, 18 October 2014 to 25 January 2015. Slyce attempts to re-examine the lineaments of Opie's practice for a new and broader audience. During which, he calls attention in the writing to the processes of its commissioning and early request to do so for a 'Polish audience'. He attempts to bring to light some of these often invisible moves in the commissioning of catalogue essays, while also re-examining Julian Opie's practice in light of its established reception in Britain.

As potencialidades da internet no jornalismo digital: Jornal de Notícias vs Diário de Notícias

Dissertação apresentada à Escola Superior de Comunicação Social como parte dos requisitos para obtenção de grau de mestre em Jornalismo.