Towards an Asynchronous Cinema: how can the asynchronous use of sound in artists' moving image underpin the creation of dialectic tension between the audio, the visual and the audience?

This PhD by publication examines selected practice-based audio-visual works made by the author over a ten-year period, placing them in a critical context. Central to the publications, and the focus of the thesis, is an exploration of the role of sound in the creation of dialectic tension between the audio, the visual and the audience. By first analysing a number of texts (films/videos and key writings) the thesis locates the principal issues and debates around the use of audio in artists’ moving image practice. From this it is argued that asynchronism, first advocated in 1929 by Pudovkin as a response to the advent of synchronised sound, can be used to articulate audio-visual relationships. Central to asynchronism’s application in this paper is a recognition of the propensity for sound and image to adhere, and in visual music for there to be a literal equation of audio with the visual, often married with a quest for the synaesthetic. These elements can either be used in an illusionist fashion, or employed as part of an anti-illusionist strategy for realising dialectic. Using this as a theoretical basis, the paper examines how the publications implement asynchronism, including digital mapping to facilitate innovative reciprocal sound and image combinations, and the asynchronous use of ‘found sound’ from a range of online sources to reframe the moving image. The synthesis of publications and practice demonstrates that asynchronism can both underpin the creation of dialectic, and be an integral component in an audio-visual anti-illusionist methodology.

Design de Comunicação Para Sistemas Educativos não Formais

Relatório de Actividade Profissional apresentado para cumprimento dos requisitos necessários à obtenção do grau de Mestre em Ciências da Comunicação – vertente de Novos Média e Práticas Web

O emprego de linguagens acessíveis para alunos com deficiência visual em aulas de Óptica

O presente artigo encontra-se inserido dentro de um estudo que busca compreender as principais alternativas para a inclusão de alunos com deficiência visual no contexto do ensino de física. Focalizando aulas de óptica, analisa as viabilidades comunicacionais entre licenciandos e discentes com deficiência visual. Para tal, enfatiza as estruturas empírica e semântico-sensorial das linguagens utilizadas, indicando fatores geradores de acessibilidade às informações veiculadas. Recomenda, ainda, alternativas que visam dar condições à participação efetiva do discente com deficiência visual no processo comunicativo, das quais se destacam: a identificação da estrutura semântico-sensorial dos significados veiculados, o conhecimento da história visual do aluno, a utilização de linguagens de estrutura empírica tátil-auditiva interdependente em contextos interativos, bem como, a exploração das potencialidades comunicacionais das linguagens constituídas de estruturas empíricas fundamental auditiva, e auditiva e visual independentes.

As aves da Estação Ecológica Serra Geral do Tocantins, Centro do Brasil

A Estação Ecológica Serra Geral do Tocantins (EESGT) é uma das maiores Unidades de Conservação dentro do Bioma Cerrado. A avifauna desta UC foi inventariada entre os dias 25 de janeiro e 15 de fevereiro de 2008. Durante esse trabalho buscou-se amostrar os diferentes hábitats encontrados na EESGT, bem como algumas localidades no entorno. Além de registros auditivos e visuais foram utilizadas redes-de-neblina e armas de fogo para coletas de material testemunho, que se encontra depositado na coleção ornitológica do Museu de Zoologia da Universidade de São Paulo (MZUSP). Os resultados obtidos foram comparados com os dados disponíveis para outras unidades de conservação presentes na região. Foram registradas 254 espécies de aves, incluindo 11 endêmicas do Cerrado e outras três ameaçadas de extinção (Taoniscus nanus, Anodorhynchus hyacinthinus e Procnias averano). Três indivíduos pertencentes ao gênero Picumnus foram coletados; estes apresentam um distinto padrão de plumagem e de vocalização, podendo representar um táxon ainda não descrito.

Mielikuvien luominen traileroinnilla : tutkimuskohteena Big Brother Suomi

The thesis studies the launch campaign of Big Brother Finland, especially from the viewpoint of on-air promotion. Interest to the subject arose when participating in the campaign as an on-air promotion planner together with Subtv's marketing director, on-air promotion editor and the channel's advertising agency. The launch of the campaign was a challenge due to the format, since not a lot of information can be revealed before the start of the program. When the planning started, all the material consisted of two logos. The first season of the Finnish version of Big Brother begun on Subtv August 2005. The goal of the program was to become a topic of discussion on TV on the fall 2005 and to raise the profile of the channel. The goal of the launch was to get good ratings for the first episode. The launch campaign was also supposed to open up the format to the viewers and to arouse interest in the show. Secrecy and the size of the program were set to be the marketing tones of the launch. Although partly different messages were told via on-air promotion and external media, the campaign was congruent in visual design. In the study, interviews of Subtv's staff, campaign plans and notes were used as research material. From the aspect of affecting images and emotions, the finished campaign promos and other on-air elements were analyzed. In on-air promotion, all choices in audio and visual design affect the outcome and therefore the images that the viewer constructs. The two promo series were made to affect emotions and to awaken curiosity. Other on-air elements were merely used to present program information. The campaign and the series were accepted with enthusiasm. The launch of the second season was even more massive than the first. Participation in the launch campaign of Big Brother Finland was an essential experience in the development of professional identity. When one has taken part in the creation of a massive campaign from scarce materials, tools are given to future assignments in the field of on-air promotion.

Multimedian elementit aikuiskoulutuksen kehittämisessä

Tämän työn teoreettisen sisällön tavoitteena on esitellä multimedian eri elementit ja Moving Picture Experts Groupin kehittämä MPEG-formaattiperhe, joka yhdistää kattavimmin eri elementit multimediaesityksiksi. Työssä esitellään videon ja audion pakkausformaatit MPEG-1 ja MPEG-2, interaktiivisen median jakelun verkoissa mahdollistava MPEG-4, multimediasisällön kuvausstandardi MPEG-7 sekä multimedian toimitusketjun hallinnan verkoissa määrittävä MPEG-21. Edellisten lisäksi teoreettisessa osassa esitellään multimediaohjelmistoista SMIL-teknologia ja selostetaan yksityiskohtaisesti, kuinka sillä luodaan multimediaesityksiä. Empiirisessä osassa laaditaan Helsingin yliopiston Maaseudun tutkimus- ja koulutuskeskukselle kehittämissuunnitelma, jossa multimedian elementtejä käytetään mahdollisimman monipuolisesti kehittämään aikuiskoulutusta. Suunnitelman perustaksi tehtiin koulutushenkilökunnalle osaamiskartoitus ja kartoitettiin yksikön tekninen valmius hyödyntää multimediaa. Suunnitelman mielekästä jäsentämistä varten yksikön aikuiskoulutus jaettiin neljään osaan: varsinaiseen koulutukseen, sitä tukevaan tutkimus- ja kehittämistoimintaan, opetusmateriaaleja tuottavaan julkaisu- ja tietopalvelutoimintaan sekä edellisiä avustaviin tukitoimintoihin.

Hire me: Computational inference of hirability in employment interviews based on nonverbal behavior

Understanding the basis on which recruiters form hirability impressions for a job applicant is a key issue in organizational psychology and can be addressed as a social computing problem. We approach the problem from a face-to-face, nonverbal perspective where behavioral feature extraction and inference are automated. This paper presents a computational framework for the automatic prediction of hirability. To this end, we collected an audio-visual dataset of real job interviews where candidates were applying for a marketing job. We automatically extracted audio and visual behavioral cues related to both the applicant and the interviewer. We then evaluated several regression methods for the prediction of hirability scores and showed the feasibility of conducting such a task, with ridge regression explaining 36.2% of the variance. Feature groups were analyzed, and two main groups of behavioral cues were predictive of hirability: applicant audio features and interviewer visual cues, showing the predictive validity of cues related not only to the applicant, but also to the interviewer. As a last step, we analyzed the predictive validity of psychometric questionnaires often used in the personnel selection process, and found that these questionnaires were unable to predict hirability, suggesting that hirability impressions were formed based on the interaction during the interview rather than on questionnaire data.

Generic control interface for networked haptic virtual environments

As Virtual Reality pushes the boundaries of the human computer interface new ways of interaction are emerging. One such technology is the integration of haptic interfaces (force-feedback devices) into virtual environments. This modality offers an improved sense of immersion to that achieved when relying only on audio and visual modalities. The paper introduces some of the technical obstacles such as latency and network traffic that need to be overcome for maintaining a high degree of immersion during haptic tasks. The paper describes the advantages of integrating haptic feedback into systems, and presents some of the technical issues inherent in a networked haptic virtual environment. A generic control interface has been developed to seamlessly mesh with existing networked VR development libraries.

Espaços transversais em educação matemática :uma contribuição para a formação de professores na perspectiva etnomatemática

This PH.D. thesis is an attempt to show the beginning, evolution and unfolding of the making of a pedagogical work proposal based on culturally-built knowings in the heart of a traditional community, having as one of its starting points the knowings and doings experienced by dish-making women from Maruanum living in the city of Macapá, State of Amapá, Brazil. This proposal is strongly associated with the need we have to think about the nature of (ethnological)-mathematical knowledge generated by particular communities and about the way such knowledge can be discussed, worked out, and validated in learning environments, regardless of the level of instruction and the constraints imposed by government programs and educational institutions. Among its theoretical foundations are studies on instrumental activities that are typical of the Maruanum ceramics and investigative studies from the point of view of ethnomathematics. Methodological development took place with the application of activities, where traditional and instrumental knowledge observed in the production of ceramics had been adapted for and brought into the school environment , participative observation, as well as data collecting and organization techniques, such as interviews, statements, and audio an visual recordings. Analysis of the data collected focused on the relationship between the data-generating potential and the purpose of this study. Our aim is to make and estimate of the potential contributions from local situations and/or problems it would possibly bring to the formative learning of people involved in the educational processes of these communities, with a view to a spatial and temporal transformation of reality

Ensino por investigação: contribuições de um curso de formação continuada para a prática de professores de ciências naturais e biologia

Normally initial teacher training has not been sufficient to provide all the tools for an updated and efficient teaching practice. It is presented here one of the ways of working the completion of the initial training through a course of continuing education. This course is based on inquiry teaching which is considered an important teaching strategy for science education. This kind of teaching enables improvement of students reasoning and cognitive skills, the cooperation among them, the understanding of the nature of scientific work, and the motivation to think about the relationship between science, technology, society and environment. For this dissertation a course of continuing education based on this approach was followed in order to evaluate which contributions it can bring to the teaching practice. The course was followed based on three stages: on the first there was a questionnaire and an informal interview; next it happened through participant observation with audio and visual aid; the third stage happened through semi structured interview. The collected information was analyzed based on Content Analysis. An inquiry teaching pedagogical material was produced for the course including some examples and applications of this approach. The aim of the material is that it can be a support for the teachers after de course. The results allowed seeing that the course was very useful, different from the traditional and the teachers that put the approach to use found it to be very positive. Thus it can be said that some of the teachers who participated will try again to apply it, try to contextualize more the teaching situations with the students day to day life, as well make them more active and critic. We can also gather from the study, that the inquiry teaching is a very different tool from what the teacher was taught and is accustomed to use and the theoretical comprehension, acceptance and practice change is a complicated process and demands time

Da pena em punho ao olho da câmera: a dialogia na (re)construção da identidade nacional em O Guarani

Pós-graduação em Letras - FCLAS

Navegação, reconhecimento de gestos e controle de interface no sistema ITV utilizando o dispositivo kinect

Esta dissertação apresenta a implementação de navegação no ambiente virtual, reconhecimento de gestos e controle de interface, feitos através do dispositivo Kinect, no Sistema ITV: um sistema de treinamento de operadores e mantenedores de usinas hidrelétricas e subestações elétricas. São mostrados, também, determinados aperfeiçoamentos recentes, como conversão em vídeo, telas de alarmes sonoros e visuais, ambientação sonora em três dimensões e narração do processo. Além da apresentação do Sistema ITV, são expostos o dispositivo Kinect e o algoritmo utilizado na comparação dos padrões de movimento, o DTW. Em seguida, são abordados em detalhes o projeto e a implementação da navegação, do reconhecimento de gestos e do controle de interface. Como estudo de caso, é exibida uma Instrução Técnica Virtual (ITV), elaborada especialmente para testar e avaliar a nova interface proposta. Posteriormente, são apresentados os resultados, considerados satisfatórios, obtidos através da análise de questionários qualitativos aplicados a estudantes da Universidade Federal do Pará. Por fim, são realizadas as considerações referentes a este trabalho e expostas idéias de trabalhos futuros.

Videoaulas de escrita/redação científica na internet: um estudo bakhtiniano

Pós-graduação em Linguística e Língua Portuguesa - FCLAR

Multimodal Integration in Statistical Learning: Evidence from the McGurk Illusion

Recent advances in the field of statistical learning have established that learners are able to track regularities of multimodal stimuli, yet it is unknown whether the statistical computations are performed on integrated representations or on separate, unimodal representations. In the present study, we investigated the ability of adults to integrate audio and visual input during statistical learning. We presented learners with a speech stream synchronized with a video of a speaker's face. In the critical condition, the visual (e.g., /gi/) and auditory (e.g., /mi/) signals were occasionally incongruent, which we predicted would produce the McGurk illusion, resulting in the perception of an audiovisual syllable (e.g., /ni/). In this way, we used the McGurk illusion to manipulate the underlying statistical structure of the speech streams, such that perception of these illusory syllables facilitated participants' ability to segment the speech stream. Our results therefore demonstrate that participants can integrate audio and visual input to perceive the McGurk illusion during statistical learning. We interpret our findings as support for modality-interactive accounts of statistical learning.

Dosimetric impact of geometric errors due to respiratory motion prediction on dynamic multileaf collimator-based four-dimensional radiation delivery

The synchronization of dynamic multileaf collimator (DMLC) response with respiratory motion is critical to ensure the accuracy of DMLC-based four dimensional (4D) radiation delivery. In practice, however, a finite time delay (response time) between the acquisition of tumor position and multileaf collimator response necessitates predictive models of respiratory tumor motion to synchronize radiation delivery. Predicting a complex process such as respiratory motion introduces geometric errors, which have been reported in several publications. However, the dosimetric effect of such errors on 4D radiation delivery has not yet been investigated. Thus, our aim in this work was to quantify the dosimetric effects of geometric error due to prediction under several different conditions. Conformal and intensity modulated radiation therapy (IMRT) plans for a lung patient were generated for anterior-posterior/posterior-anterior (AP/PA) beam arrangements at 6 and 18 MV energies to provide planned dose distributions. Respiratory motion data was obtained from 60 diaphragm-motion fluoroscopy recordings from five patients. A linear adaptive filter was employed to predict the tumor position. The geometric error of prediction was defined as the absolute difference between predicted and actual positions at each diaphragm position. Distributions of geometric error of prediction were obtained for all of the respiratory motion data. Planned dose distributions were then convolved with distributions for the geometric error of prediction to obtain convolved dose distributions. The dosimetric effect of such geometric errors was determined as a function of several variables: response time (0-0.6 s), beam energy (6/18 MV), treatment delivery (3D/4D), treatment type (conformal/IMRT), beam direction (AP/PA), and breathing training type (free breathing/audio instruction/visual feedback). Dose difference and distance-to-agreement analysis was employed to quantify results. Based on our data, the dosimetric impact of prediction (a) increased with response time, (b) was larger for 3D radiation therapy as compared with 4D radiation therapy, (c) was relatively insensitive to change in beam energy and beam direction, (d) was greater for IMRT distributions as compared with conformal distributions, (e) was smaller than the dosimetric impact of latency, and (f) was greatest for respiration motion with audio instructions, followed by visual feedback and free breathing. Geometric errors of prediction that occur during 4D radiation delivery introduce dosimetric errors that are dependent on several factors, such as response time, treatment-delivery type, and beam energy. Even for relatively small response times of 0.6 s into the future, dosimetric errors due to prediction could approach delivery errors when respiratory motion is not accounted for at all. To reduce the dosimetric impact, better predictive models and/or shorter response times are required.