Towards an Asynchronous Cinema: how can the asynchronous use of sound in artists' moving image underpin the creation of dialectic tension between the audio, the visual and the audience?

This PhD by publication examines selected practice-based audio-visual works made by the author over a ten-year period, placing them in a critical context. Central to the publications, and the focus of the thesis, is an exploration of the role of sound in the creation of dialectic tension between the audio, the visual and the audience. By first analysing a number of texts (films/videos and key writings) the thesis locates the principal issues and debates around the use of audio in artists’ moving image practice. From this it is argued that asynchronism, first advocated in 1929 by Pudovkin as a response to the advent of synchronised sound, can be used to articulate audio-visual relationships. Central to asynchronism’s application in this paper is a recognition of the propensity for sound and image to adhere, and in visual music for there to be a literal equation of audio with the visual, often married with a quest for the synaesthetic. These elements can either be used in an illusionist fashion, or employed as part of an anti-illusionist strategy for realising dialectic. Using this as a theoretical basis, the paper examines how the publications implement asynchronism, including digital mapping to facilitate innovative reciprocal sound and image combinations, and the asynchronous use of ‘found sound’ from a range of online sources to reframe the moving image. The synthesis of publications and practice demonstrates that asynchronism can both underpin the creation of dialectic, and be an integral component in an audio-visual anti-illusionist methodology.

Cultural influences on positive affect and reward processing in depressed youth

Thesis (Ph.D.)--University of Washington, 2016-07

A visual and contextual comparative study of the work of Picasso and Chanel towards an understanding of the overlaps between Modern Art and Fashion.

From the beginning of the twentieth century, ``Modernism`` impacted and transformed art and clothing. Pablo Picasso and Gabrielle ``Coco`` Chanel were two of the most central characters in Modernism working simultaneously in their disciplines. Picasso`s innovations, particularly in abstract art and Chanel`s fashion designs, that dramatically departed from the previous corseted and highly deco-rative styles, were so significant that they have left an influence on contemporary art and fashion. This study will compare their visual works and documented evidence of their motivations, within the context of their cultural backgrounds, to reveal meaning in the occurrences of overlaps. This approach has ex-amined the historical, cultural background of the artist and designer`s environment from different per-spectives, adding to previous research in this area. Through this research, outcomes of the analysis have shown similarities and divergences in the wider genres of art and fashion and the practice of the artist and fashion designer. The reference list to this text, used in the survey, gives a comprehensive overview of pertinent publications disseminating Picasso and Chanel`s visual works, oral perspectives and cultural impact.

Dyslexia, problem solving and text processing : a conceptual framework describing reading difficulties in dyslexia as an information-processing problem

Résumé : Une définition opérationnelle de la dyslexie qui est adéquate et pertinente à l'éducation n'a pu être identifiée suite à une recension des écrits. Les études sur la dyslexie se retrouvent principalement dans trois champs: la neurologie, la neurolinguistique et la génétique. Les résultats de ces recherches cependant, se limitent au domaine médical et ont peu d'utilité pour une enseignante ou un enseignant. La classification de la dyslexie de surface et la dyslexie profonde est la plus appropriée lorsque la dyslexie est définie comme trouble de lecture dans le contexte de l'éducation. L'objectif de ce mémoire était de développer un cadre conceptuel théorique dans lequel les troubles de lecture chez les enfants dyslexiques sont dû à une difficulté en résolution de problèmes dans le traitement de l'information. La validation du cadre conceptuel a été exécutée à l'aide d'un expert en psychologie cognitive, un expert en dyslexie et une enseignante. La perspective de la résolution de problèmes provient du traitement de l'information en psychologie cognitive. Le cadre conceptuel s'adresse uniquement aux troubles de lectures qui sont manifestés par les enfants dyslexiques.||Abstract : An extensive literature review failed to uncover an adequate operational definition of dyslexia applicable to education. The predominant fields of research that have produced most of the studies on dyslexia are neurology, neurolinguistics and genetics. Their perspectives were shown to be more pertinent to medical experts than to teachers. The categorization of surface and deep dyslexia was shown to be the best description of dyslexia in an educational context. The purpose of the present thesis was to develop a theoretical conceptual framework which describes a link between dyslexia, a text-processing model and problem solving. This conceptual framework was validated by three experts specializing in a specific field (either cognitive psychology, dyslexia or teaching). The concept of problem solving was based on information-processing theories in cognitive psychology. This framework applies specifically to reading difficulties which are manifested by dyslexic children.

Xylose from lignocellulosic waste in the production and industrial processing of pinneaple (Ananascomusus)

Lignocellulosicwaste from the pineapple production is a raw material useful for the xylose production by hydrolysis and it can be converted to xylitol. The objective of this work was to study the hydrolysis of pineapple peel with sulfuric acid at variable concentration (2-6%), reaction time (0-350 min) and temperature at 98 ˚C. The concentration of xylose, glucose and degradation products as acetic acid and furfural was determined. Optimal conditions found for hydrolysis were 6% H2SO4 at 98 ˚C for 83 min which yield was 26,9 g xylose/L, 2,61 g glucose/L, 7,71 g acetic acid/L and 0,29 g furfural/L.

A Decomposition, Construction and Post-Processing Approach for Nurse Rostering

This paper presents our work on decomposing a specific nurse rostering problem by cyclically assigning blocks of shifts, which are designed considering both hard and soft constraints, to groups of nurses. The rest of the shifts are then assigned to the nurses to construct a schedule based on the one cyclically generated by blocks. The schedules obtained by decomposition and construction can be further improved by a variable neighborhood search. Significant results are obtained and compared with a genetic algorithm and a variable neighborhood search approach on a problem that was presented to us by our collaborator, ORTEC bv, The Netherlands. We believe that the approach has the potential to be further extended to solve a wider range of nurse rostering problems.

Gestural communication of music structure during solo classical piano performance

The production and perception of music is a multimodal activity involving auditory, visual and conceptual processing, integrating these with prior knowledge and environmental experience. Musicians utilise expressive physical nuances to highlight salient features of the score. The question arises within the literature as to whether performers’ non-technical, non-sound-producing movements may be communicatively meaningful and convey important structural information to audience members and co-performers. In the light of previous performance research (Vines et al., 2006, Wanderley, 2002, Davidson, 1993), and considering findings within co-speech gestural research and auditory and audio-visual neuroscience, this thesis examines the nature of those movements not directly necessary for the production of sound, and their particular influence on audience perception. Within the current research 3D performance analysis is conducted using the Vicon 12- camera system and Nexus data-processing software. Performance gestures are identified as repeated patterns of motion relating to music structure, which not only express phrasing and structural hierarchy but are consistently and accurately interpreted as such by a perceiving audience. Gestural characteristics are analysed across performers and performance style using two Chopin preludes selected for their diverse yet comparable structures (Opus 28:7 and 6). Effects on perceptual judgements of presentation modes (visual-only, auditory-only, audiovisual, full- and point-light) and viewing conditions are explored. This thesis argues that while performance style is highly idiosyncratic, piano performers reliably generate structural gestures through repeated patterns of upper-body movement. The shapes and locations of phrasing motions are identified particular to the sample of performers investigated. Findings demonstrate that despite the personalised nature of the gestures, performers use increased velocity of movements to emphasise musical structure and that observers accurately and consistently locate phrasing junctures where these patterns and variation in motion magnitude, shape and velocity occur. By viewing performance motions in polar (spherical) rather than cartesian coordinate space it is possible to get mathematically closer to the movement generated by each of the nine performers, revealing distinct patterns of motion relating to phrasing structures, regardless of intended performance style. These patterns are highly individualised both to each performer and performed piece. Instantaneous velocity analysis indicates a right-directed bias of performance motion variation at salient structural features within individual performances. Perceptual analyses demonstrate that audience members are able to accurately and effectively detect phrasing structure from performance motion alone. This ability persists even for degraded point-light performances, where all extraneous environmental information has been removed. The relative contributions of audio, visual and audiovisual judgements demonstrate that the visual component of a performance does positively impact on the over- all accuracy of phrasing judgements, indicating that receivers are most effective in their recognition of structural segmentations when they can both see and hear a performance. Observers appear to make use of a rapid online judgement heuristics, adjusting response processes quickly to adapt and perform accurately across multiple modes of presentation and performance style. In line with existent theories within the literature, it is proposed that this processing ability may be related to cognitive and perceptual interpretation of syntax within gestural communication during social interaction and speech. Findings of this research may have future impact on performance pedagogy, computational analysis and performance research, as well as potentially influencing future investigations of the cognitive aspects of musical and gestural understanding.

Traitement des émotions évoquées par les expressions faciales, vocales et musicales à la suite d’un traumatisme craniocérébral

Le traitement des émotions joue un rôle essentiel dans les relations interpersonnelles. Des déficits dans la reconnaissance des émotions évoquées par les expressions faciales et vocales ont été démontrés à la suite d’un traumatisme craniocérébral (TCC). Toutefois, la majorité des études n’ont pas différencié les participants selon le niveau de gravité du TCC et n’ont pas évalué certains préalables essentiels au traitement émotionnel, tels que la capacité à percevoir les caractéristiques faciales et vocales, et par le fait même, la capacité à y porter attention. Aucune étude ne s’est intéressée au traitement des émotions évoquées par les expressions musicales, alors que la musique est utilisée comme méthode d’intervention afin de répondre à des besoins de prise en charge comportementale, cognitive ou affective chez des personnes présentant des atteintes neurologiques. Ainsi, on ignore si les effets positifs de l’intervention musicale sont basés sur la préservation de la reconnaissance de certaines catégories d’émotions évoquées par les expressions musicales à la suite d’un TCC. La première étude de cette thèse a évalué la reconnaissance des émotions de base (joie, tristesse, peur) évoquées par les expressions faciales, vocales et musicales chez quarante et un adultes (10 TCC modéré-sévère, 9 TCC léger complexe, 11 TCC léger simple et 11 témoins), à partir de tâches expérimentales et de tâches perceptuelles contrôles. Les résultats suggèrent un déficit de la reconnaissance de la peur évoquée par les expressions faciales à la suite d’un TCC modéré-sévère et d’un TCC léger complexe, comparativement aux personnes avec un TCC léger simple et sans TCC. Le déficit n’est pas expliqué par un trouble perceptuel sous-jacent. Les résultats montrent de plus une préservation de la reconnaissance des émotions évoquées par les expressions vocales et musicales à la suite d’un TCC, indépendamment du niveau de gravité. Enfin, malgré une dissociation observée entre les performances aux tâches de reconnaissance des émotions évoquées par les modalités visuelle et auditive, aucune corrélation n’a été trouvée entre les expressions vocales et musicales. La deuxième étude a mesuré les ondes cérébrales précoces (N1, N170) et plus tardives (N2) de vingt-cinq adultes (10 TCC léger simple, 1 TCC léger complexe, 3 TCC modéré-sévère et 11 témoins), pendant la présentation d’expressions faciales évoquant la peur, la neutralité et la joie. Les résultats suggèrent des altérations dans le traitement attentionnel précoce à la suite d’un TCC, qui amenuisent le traitement ultérieur de la peur évoquée par les expressions faciales. En somme, les conclusions de cette thèse affinent notre compréhension du traitement des émotions évoquées par les expressions faciales, vocales et musicales à la suite d’un TCC selon le niveau de gravité. Les résultats permettent également de mieux saisir les origines des déficits du traitement des émotions évoquées par les expressions faciales à la suite d’un TCC, lesquels semblent secondaires à des altérations attentionnelles précoces. Cette thèse pourrait contribuer au développement éventuel d’interventions axées sur les émotions à la suite d’un TCC.

ViDRILO: The Visual and Depth Robot Indoor Localization with Objects information dataset

In this article we describe a semantic localization dataset for indoor environments named ViDRILO. The dataset provides five sequences of frames acquired with a mobile robot in two similar office buildings under different lighting conditions. Each frame consists of a point cloud representation of the scene and a perspective image. The frames in the dataset are annotated with the semantic category of the scene, but also with the presence or absence of a list of predefined objects appearing in the scene. In addition to the frames and annotations, the dataset is distributed with a set of tools for its use in both place classification and object recognition tasks. The large number of labeled frames in conjunction with the annotation scheme make this dataset different from existing ones. The ViDRILO dataset is released for use as a benchmark for different problems such as multimodal place classification and object recognition, 3D reconstruction or point cloud data compression.

The gaps-in-noise test: Gap detection thresholds in normal-hearing young adults

The aim of this study was to establish parameters for the gaps-in-noise test in normal-hearing young adults. One hundred subjects (50 males and 50 females) received an audiological evaluation to rule out hearing loss and auditory processing disorder. The gaps-in-noise test was then conducted on all subjects. The mean gap detection threshold was 4.19 ms. A psychometric function by gap duration was constructed, revealing that the percentage of correct responses was less than or equal to 5% for a gap duration of 2 ms, 10-30% for a gap duration of 3 ms, 60-70% for a gap duration of 4 ms, and over 96% for gap durations of 5 ms or longer. The results suggest that the data obtained can be applied as reference values for future testing. In the subjects evaluated, the gaps-in-noise test proved to be consistent with low variability.

A role of Eye Vergence in Covert Attention

Covert spatial attention produces biases in perceptual and neural responses in the absence of overt orienting movements. The neural mechanism that gives rise to these effects is poorly understood. Here we report the relation between fixational eye movements, namely eye vergence, and covert attention. Visual stimuli modulate the angle of eye vergence as a function of their ability to capture attention. This illustrates the relation between eye vergence and bottom-up attention. In visual and auditory cue/no-cue paradigms, the angle of vergence is greater in the cue condition than in the no-cue condition. This shows a top-down attention component. In conclusion, observations reveal a close link between covert attention and modulation in eye vergence during eye fixation. Our study suggests a basis for the use of eye vergence as a tool for measuring attention and may provide new insights into attention and perceptual disorders.

"Dov'è la sinistra?" Hemispatial neglect in stroke

As long as the incidence of stroke continues to grow, patients with large right hemisphere lesions suffering from hemispatial neglect will require neuropsychological evaluation and rehabilitation. The inability to process information especially that coming from the left side accompanied by the magnetic orientation to the ipsilesional side represents a real challenge for rehabilitation. This dissertation is concerned with crucial aspects in the clinical neuropsychological practice of hemispatial neglect. In studying the convergence of the visual and behavioural test batteries in the assessment of neglect, nine of the seventeen patients, who completed both the conventional subtests of the Behavioural Inattention Test and the Catherine Bergego Scale assessments, showed a similar severity of neglect and thus good convergence in both tests. However, patients with neglect and hemianopia had poorer scores in the line bisection test and they displayed stronger neglect in behaviour than patients with pure neglect. The second study examined, whether arm activation, modified from the Constraint Induced Movement Therapy, could be applied as neglect rehabilitation alone without any visual training. Twelve acute- or subacute patients were randomized into two rehabilitation groups: arm activation training or traditional voluntary visual scanning training. Neglect was ameliorated significantly or almost significantly in both training groups due to rehabilitation with the effect being maintained for at least six months. In studying the reflections of hemispatial neglect on visual memory, the associations of severity of neglect and visual memory performances were explored. The performances of acute and subacute patients with hemispatial neglect were compared with the performances of matched healthy control subjects. As hypothesized, encoding from the left side and immediate recall of visual material were significantly compromised in patients with neglect. Another mechanism of neglect affecting visual memory processes is observed in delayed visual reproduction. Delayed recall demands that the individual must make a match helped by a cue or it requires a search for relevant material from long-term memory storage. In the case of representational neglect, the search may succeed but the left side of the recollected memory still fails to open. Visual and auditory evoked potentials were measured in 21 patients with hemispatial neglect. Stimuli coming from the left or right were processed differently in both sensory modalities in acute and subacute patients as compared with the chronic patients. The differences equalized during the course of recovery. Recovery from hemispatial neglect was strongly associated with early rehabilitation and with the severity of neglect. Extinction was common in patients with neglect and it did not ameliorate with the recovery of neglect. The presence of pusher symptom hampered amelioration of visual neglect in acute and subacute stroke patients, whereas depression did not have any significant effect in the early phases after the stroke. However, depression had an unfavourable effect on recovery in the chronic phase. In conclusion, the combination of neglect and hemianopia may explain part of the residual behavioural neglect that is no longer evident in visual testing. Further research is needed in order to determine which specific rehabilitation procedures would be most beneficial in patients suffering the combination of neglect and hemianopia. Arm activation should be included in the rehabilitation programs of neglect; this is a useful technique for patients who need bedside treatment in the acute phase. With respect to the deficit in visual memory in association with neglect, the possible mechanisms of lateralized deficit in delayed recall need to be further examined and clarified. Intensive treatment induced recovery in both severe and moderate visual neglect long after the first two to first three months after the stroke.

The effects of manipulated augmented sensory feedback on error detection when using a touch screen

The purpose of the present study was to determine which augmented sensory modality would best develop subjective error-detection capabilities of learners performing a spatial-temporal task when using a touch screen monitor. Participants were required to learn a 5-digit key-pressing task in a goal time of 2550 ms over 100 acquisition trials on a touch screen. Participants were randomized into 1 of 4 groups: 1) visual-feedback (colour change of button when selected), 2) auditory-feedback (click sound when button was selected), 3) visual-auditory feedback (both colour change and click sound when button was selected), and 4) no-feedback (no colour change or click sound when button was selected). Following each trial, participants were required to provide a subjective estimate regarding their performance time in relation to the actual time it took for them complete the 5-digit sequence. A no-KR retention test was conducted approximately 24-hours after the last completed acquisition trial. Results showed that practicing a timing task on a touch screen augmented with both visual and auditory information may have differentially impacted motor skill acquisition such that removal of one or both sources of augmented feedback did not result in a severe detriment to timing performance or error detection capabilities of the learner. The present study reflects the importance of multimodal augmented feedback conditions to maximize cognitive abilities for developing a stronger motor memory for subjective error-detection and correction capabilities.