Sonification as Concurrent Augmented Feedback for Motor Skill Learning and the Importance of Mapping Design

In recent years, sonification of movement has emerged as a viable method for the provision of feedback in motor learning. Despite some experimental validation of its utility, controlled trials to test the usefulness of sonification in a motor learning context are still rare. As such, there are no accepted conventions for dealing with its implementation. This article addresses the question of how continuous movement information should be best presented as sound to be fed back to the learner. It is proposed that to establish effective approaches to using sonification in this context, consideration must be given to the processes that underlie motor learning, in particular the nature of the perceptual information available to the learner for performing the task at hand. Although sonification has much potential in movement performance enhancement, this potential is largely unrealised as of yet, in part due to the lack of a clear framework for sonification mapping: the relationship between movement and sound. By grounding mapping decisions in a firmer understanding of how perceptual information guides learning, and an embodied cognition stance in general, it is hoped that greater advances in use of sonification to enhance motor learning can be achieved.

Transposing Musical Skill: Sonification of movement as concurrent augmented feedback enhances learning in a bimanual task

Concurrent feedback provided during acquisition can enhance performance of novel tasks. The ‘guidance hypothesis’ predicts that feedback provision leads to dependence and poor performance in its absence. However, appropriately-structured feedback information provided through sound (‘sonification’) may not be subject to this effect. We test this directly using a rhythmic bimanual shape-tracing task in which participants learned to move at a 4:3 timing ratio. Sonification of movement and demonstration was compared to two other learning conditions: (1) sonification of task demonstration alone and (2) completely silent practice (control). Sonification of movement emerged as the most effective form of practice, reaching significantly lower error scores than control. Sonification of solely the demonstration, which was expected to benefit participants by perceptually unifying task requirements, did not lead to better performance than control. Good performance was maintained by participants in the sonification condition in an immediate retention test without feedback, indicating that the use of this feedback can overcome the guidance effect. On a 24-hour retention test, performance had declined and was equal between groups. We argue that this and similar findings in the feedback literature are best explained by an ecological approach to motor skill learning which places available perceptual information at the highest level of importance.

Movement Sonification: Effects on Motor Learning beyond Rhythmic Adjustments

Motor learning is based on motor perception and emergent perceptual-motor representations. A lot of behavioral research is related to single perceptual modalities but during last two decades the contribution of multimodal perception on motor behavior was discovered more and more. A growing number of studies indicates an enhanced impact of multimodal stimuli on motor perception, motor control and motor learning in terms of better precision and higher reliability of the related actions. Behavioral research is supported by neurophysiological data, revealing that multisensory integration supports motor control and learning. But the overwhelming part of both research lines is dedicated to basic research. Besides research in the domains of music, dance and motor rehabilitation, there is almost no evidence for enhanced effectiveness of multisensory information on learning of gross motor skills. To reduce this gap, movement sonification is used here in applied research on motor learning in sports. Based on the current knowledge on the multimodal organization of the perceptual system, we generate additional real-time movement information being suitable for integration with perceptual feedback streams of visual and proprioceptive modality. With ongoing training, synchronously processed auditory information should be initially integrated into the emerging internal models, enhancing the efficacy of motor learning. This is achieved by a direct mapping of kinematic and dynamic motion parameters to electronic sounds, resulting in continuous auditory and convergent audiovisual or audio-proprioceptive stimulus arrays. In sharp contrast to other approaches using acoustic information as error-feedback in motor learning settings, we try to generate additional movement information suitable for acceleration and enhancement of adequate sensorimotor representations and processible below the level of consciousness. In the experimental setting, participants were asked to learn a closed motor skill (technique acquisition of indoor rowing). One group was treated with visual information and two groups with audiovisual information (sonification vs. natural sounds). For all three groups learning became evident and remained stable. Participants treated with additional movement sonification showed better performance compared to both other groups. Results indicate that movement sonification enhances motor learning of a complex gross motor skill-even exceeding usually expected acoustic rhythmic effects on motor learning.

The Empty City (playreading)

This 45 minute non-verbal intermedial performance for children was adapted from the picture book I authored of the same name. The process involved writing and re-writing text and music with the result being a new draft of both script and soundtrack. Part of the judging process for the award the script was nominated for involved a playreading, which offered a particular challenge to the researcher in terms of composition and playwriting. How can a script and soundtrack for a non-verbal, intermedial work adapt and innovate the within the formal and practical constraints of the traditional ‘playreading’? This project’s emphasis on nestling intermediality within ostensibly traditional theatrical constraints and processes draws on concepts of musicalisation, identified by Varopolou. (in Lehmann 2006:91) Certain ‘musical moments’ in the piece echoed Ross Brown’s (2010) acoustemological concepts of sonification of everyday life, and the process involved dynamic curation of ‘music under’ for emotional effect, avoiding cinematic clichés and reaching for connections between music and emotion characterized by scholars such as Juslin and Sloboda (2001) The resulting performance was a hybrid of playreading and slideshow, supported by an original soundtrack of ‘music under’ (pre-recorded, but ‘DJ’ed’ live) as well as text-driven moments where music and sound were foregrounded. Research contribution This iteration of The Empty City shows that the tradition of the playreading can be a playful space where even the multiple layers of an intermedial performance text can be represented. The Empty City was a finalist in the 2012-13 Queensland Premier’s Drama Award. A ticketed public playreading of the script was held in the Queensland Theatre Company’s Bille Brown Studio on the 28th of July 2012 alongside the other finalists.

Avaliacoes da infeccao de explantes de feijoeiro por Agrobacterium tumefaciens por meio de microscopia.

Phaseolus vulgaris L. e considerada recalcitrante a transformacao por Agrobacterium tumefaciens. Contudo, alteracoes no meio de co-cultivo, utilizacao de linhagens hipervirulentas de Agrobacterium e de vetores binarios contendo genes vir demostraram que o feijoeiro e susceptivel a essa bacteria. O objetivo do presente trabalho foi estudar o efeito da sonificacao nos tecidos vegetais de feijoeiro, bem como a penetracao da Agrobacterium nas camadas subepidermicas do tecido vegetal, usando a metodologia SAAT ("Sonification-Assisted Agrobacterium-mediated Transformation"). A variedade de feijoeiro utilizada foi a Olathe Pinto, a linhagem de A. tumefaciens foi LBA4404:pTOK.Os embrioes de feijao foram pre-tratados po 14 dias em meio de multibrotacao e, entao submetidos a sonificacao (de 0 ou 60 segundos) na presenca de Agrobacterium. Apos a inoculacao foram co-cultivados por 24 horas em meio liquido seguido de 48 horas em meio solido, ambos, contendo 20 m. L -1 de acetoceringona. Os explantes inoculados foram fixadas em solucao de Karnovsk para avaliacoes em microscopia optica e eletronica de varredura. As analises da microspia demostraram a presenca de rupturas na epiderme, quebras da parede celular e invasao da Agrobacterium nos tecidos subepidermicos. Os reultados demostraram que o metodo SAAT e uma tecnica viavel para a inoculcao de Agrobacterium em explantes de P. vulgaris.

Persistent luminescence of SrAl2O4:Ce(III), Dy, Eu nanotubes, nanowires and core-shells for people with disabilities: nano-emergency

Este estudo transversal está focado na propriedade de luminescência persistente do aluminato de estrôncio co-dopado com cério (III), disprósio (III) e európio (II), SrAl2O4:Ce3+, Dy3+, Eu2+, em sistemas de sinalização de áreas de risco e emergências para pessoas com deficiências. Na área da ciência e engenharia dos materiais, foram desenvolvidos novos materiais com características nanométricas, nanotubos, nanoarames e nanobastões luminescentes de SrAl2O4:Ce3+, Dy3+, Eu2+ para aplicações na área da reabilitação e acessibilidade de pessoas com deficiências. Os nanotubos foram obtidos a partir de micro- e nano-partículas precursoras sintetizadas por reacção do estado-sólido e tratamento térmico de recozedura (1273-1473 K). Os nanoarames e nanobastões foram preparados por moagem, sonificação e recozedura (373 K). Novas nanocápsulas de aluminatos luminescentes dopados com cério (III) e encapsulados com TiO2 foram criadas de modo a obter-se materiais multifuncionais, designadamente com acção fotocatalítica antimicrobiana, antibacteriana e resistência à água. Tais aluminatos podem ser amplamente aplicados como superfícies higiénicas, auto-limpantes, em biomateriais, no domínio de medicamentos antibióticos, na formulação de vacinas, e com ênfase à aplicação em cerâmicas fotoluminescentes. As metodologias de obtenção de tais nanoestruturas de aluminato de estrôncio dopado com cério (III) e do seu encapsulamento, desenvolvidas no âmbito desta tese, são aplicáveis a diversos aluminatos dopados com outros iões lantanídeos (Ln consiste em La, Ce, Pr, Nd, Pm, Sm, Eu, Gd, Tb, Dy, Ho, Er, Yb, Tm ou Lu) com a fórmula M(1-x-y)N2O4:Cex, Lny, onde M é Be, Mg, Ca, Sr ou Ba. Na área da oftalmologia, foi desenvolvido um equipamento médico para o diagnóstico de biofuncionalidade das células retinais fotoreceptoras, e como suporte à telemedicina oftalmológica. Este equipamento foi utilizado para realizar testes de visão cromática FM100HUE em fundo branco/preto para a personalização de materiais luminescentes. Os resultados demonstraram uma biofuncionalidade celular à visibilidade fotópica das cores em fundo preto superior no grupo de tratamento, composto por pessoas com retinopatia diabética (n=38), em comparação ao grupo de referência (n=38). Estes resultados sugerem a recomendação de materiais com fotoluminescência persistente (λem=485-555 nm), incluindo SrAl2O4:Ce3+, Dy3+, Eu2+, para o referido grupo de tratamento, em sinalização de emergência e em ambientes de baixa iluminação. Na área da arquitectura, foi proposta uma nova aplicação dos referidos nanomateriais luminescentes à base de SrAl2O4:Ce3+, Dy3+, Eu2+ em cerâmica de revestimento, tendo em vista a sua boa visibilidade e uso por pessoas com deficiências. Novos pavimentos, cerâmicos, fotoluminescentes, foram desenhados com propriedades multisensoriais (contraste táctil, sonoro e visual) e antimicrobianas, para pessoas portadoras de deficiências utilizarem, no escuro, com a prioridade de salvar vidas em emergências. Tais pisos, com relevos, podem ser combinados de modo a compor um sistema exclusivo de sinalização fotoluminescente multisensorial que possibilita a rápida evacuação mediante o uso de auxílios de mobilidade (e.g. bengala, cadeira de rodas, andadores, muletas). A solução integrada de tais inovações que potencializa a propriedade de luminescência persistente de SrAl2O4:Ce3+, Dy3+, Eu2+ de modo acessível para as pessoas com deficiências, pode contribuir para salvar vidas, no escuro, em emergências.

A influência das emoções positivas e da idade na interpretação de gráficos com dimensões visuais e auditivas

Dissertação apresentada à Escola Superior de Comunicação Social como parte dos requisitos para obtenção de grau de mestre em Audiovisual e Multimédia.

Turning Gigabytes into Gigs: “Songification” and Live Music Data

Complex data is challenging to understand when it is represented as written communication even when it is structured in a table. How- ever, choosing to represent data in creative ways can aid our under- standing of complex ideas and patterns. In this regard, the creative industries have a great deal to offer data-intensive scholarly disci- plines. Music, for example, is not often used to interpret data, yet the rhythmic nature of music lends itself to the representation and anal- ysis of temporal data.Taking the music industry as a case study, this paper explores how data about historical live music gigs can be analysed, extend- ed and re-presented to create new insights. Using a unique process called ‘songification’ we demonstrate how enhanced auditory data design can provide a medium for aural intuition. The case study also illustrates the benefits of an expanded and inclusive view of research; in which computation and communication, method and media, in combination enable us to explore the larger question of how we can employ technologies to produce, represent, analyse, deliver and exchange knowledge.

Determinação de fósforo biodisponível em rações de peixes utilizando extração assistida por ultra-som e espectrofotometria no visível

The aim of the present work was to develop and optimize a method for determination of bioavailable phosphorus in samples of feces and fish feed using ultrasound extraction and subsequent quantification by visible spectrophotometry. Using as extractor solution HNO(3) 0.50 mol L(-1), the great conditions of extraction established were: sample mass - 100 mg, samples granulometry - < 60 mu m, sonification time - five cycles of 40 s and ultrasound potency - 136 W. The proposed method was applied in studies of digestibility of this nutrient in different feeds used in diets of juvenile of Nile tilapia.

Evaluation of residual iron in carbon nanotubes purified by acid treatments

Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES)

qPCR-based mitochondrial DNA quantification: Influence of template DNA fragmentation on accuracy

Real-time PCR (qPCR) is the method of choice for quantification of mitochondrial DNA (mtDNA) by relative comparison of a nuclear to a mitochondrial locus. Quantitative abnormal mtDNA content is indicative of mitochondrial disorders and mostly confines in a tissue-specific manner. Thus handling of degradation-prone bioptic material is inevitable. We established a serial qPCR assay based on increasing amplicon size to measure degradation status of any DNA sample. Using this approach we can exclude erroneous mtDNA quantification due to degraded samples (e.g. long post-exicision time, autolytic processus, freeze-thaw cycles) and ensure abnormal DNA content measurements (e.g. depletion) in non-degraded patient material. By preparation of degraded DNA under controlled conditions using sonification and DNaseI digestion we show that erroneous quantification is due to the different preservation qualities of the nuclear and the mitochondrial genome. This disparate degradation of the two genomes results in over- or underestimation of mtDNA copy number in degraded samples. Moreover, as analysis of defined archival tissue would allow to precise the molecular pathomechanism of mitochondrial disorders presenting with abnormal mtDNA content, we compared fresh frozen (FF) with formalin-fixed paraffin-embedded (FFPE) skeletal muscle tissue of the same sample. By extrapolation of measured decay constants for nuclear DNA (λnDNA) and mtDNA (λmtDNA) we present an approach to possibly correct measurements in degraded samples in the future. To our knowledge this is the first time different degradation impact of the two genomes is demonstrated and which evaluates systematically the impact of DNA degradation on quantification of mtDNA copy number.

Tailoring reveals information requirements: the case of anaesthesia alarms

We discuss the phenomenon of system tailoring in the context of data from an observational study of anaesthesia. We found that anaesthetists tailor their monitoring equipment so that the auditory alarms are more informative. However, the occurrence of tailoring by anaesthetists in the operating theatre was infrequent, even though the flexibility to tailor exists on many of the patient monitoring systems used in the study. We present an influence diagram to explain how alarm tailoring can increase situation awareness in the operating theatre but why factors inhibiting tailoring prevent widespread use. Extending the influence diagram, we discuss ways that more informative displays could achieve the results sought by anaesthetists when they tailor their alarm systems. In particular, we argue that we should improve our designs rather than simply provide more flexible tailoring systems. because users often find tailoring a complex task. We conclude that properly designed auditory displays may benefit anaesthetists in achieving greater patient situation awareness and that designers should consider carefully how factors promoting and inhibiting tailoring will affect the end-users' likelihood of conducting tailoring. (C) 2004 Elsevier B.V. All rights reserved.