Criteria for graphic representation in musical scores: Visual elements in musical scores

A interdisciplinaridade entre a música e as artes visuais tem sido explorado por conceituados teóricos e filósofos, embora não exista muito na área da interpretação visual do grafismo de partituras musicais. Este estudo investiga como os grafismos na notação e símbolos musicais afectam o intérprete na sua transformação em som, com referência especial a partituras contemporâneas, que utilizam notação menos convencional para a criação de uma interpretação por sugestão. Outras relações entre o som e o visual são exploradas, incluindo a sinestesia, a temporalidade e a relação entre obra de arte e público. O objectivo desta dissertação é a de constituir um estudo inovativo sobre partituras musicais contemporâneas, simultaneamente do ponto de vista musical e visual. Finalmente, também vai mais longe, incluindo desenhos da própria autora inspirados e motivados pela música. Estes já não cumprem uma função de notação convencional para o músico, embora existe uma constante possibilidade de uma reinterpretação. ABSTRACT; The inter-disciplinarity between music and visual art has been explored by leading theorists and philosophers, though very little exists in the area of the visual interpretation of graphic musical scores. This study looks at how the graphics of musical notation and symbols affect the performer in transforming them into sound, with particular reference to contemporary scores that use non¬conventional notation to create an interpretation through suggestion. Other sound-visual relationships are explored, including synaesthesia, temporality and the interconnection between work of art and audience or public. This dissertation aims to be an innovative study of contemporary musical scores, from a musical as well as visual perspective. Finally, it takes a step further with drawings of my own, directly inspired and motivated by the music. These no longer fulfil a conventionally notational function for the musician, yet the potential for a re-interpretation is ever-present.

Instagrammatics and digital methods: Studying visual social media, from selfies and GIFs to memes and emoji

Visual content is a critical component of everyday social media, on platforms explicitly framed around the visual (Instagram and Vine), on those offering a mix of text and images in myriad forms (Facebook, Twitter, and Tumblr), and in apps and profiles where visual presentation and provision of information are important considerations. However, despite being so prominent in forms such as selfies, looping media, infographics, memes, online videos, and more, sociocultural research into the visual as a central component of online communication has lagged behind the analysis of popular, predominantly text-driven social media. This paper underlines the increasing importance of visual elements to digital, social, and mobile media within everyday life, addressing the significant research gap in methods for tracking, analysing, and understanding visual social media as both image-based and intertextual content. In this paper, we build on our previous methodological considerations of Instagram in isolation to examine further questions, challenges, and benefits of studying visual social media more broadly, including methodological and ethical considerations. Our discussion is intended as a rallying cry and provocation for further research into visual (and textual and mixed) social media content, practices, and cultures, mindful of both the specificities of each form, but also, and importantly, the ongoing dialogues and interrelations between them as communication forms.

A Structured Model of Video Reproduces Primary Visual Cortical Organisation

The visual system must learn to infer the presence of objects and features in the world from the images it encounters, and as such it must, either implicitly or explicitly, model the way these elements interact to create the image. Do the response properties of cells in the mammalian visual system reflect this constraint? To address this question, we constructed a probabilistic model in which the identity and attributes of simple visual elements were represented explicitly and learnt the parameters of this model from unparsed, natural video sequences. After learning, the behaviour and grouping of variables in the probabilistic model corresponded closely to functional and anatomical properties of simple and complex cells in the primary visual cortex (V1). In particular, feature identity variables were activated in a way that resembled the activity of complex cells, while feature attribute variables responded much like simple cells. Furthermore, the grouping of the attributes within the model closely parallelled the reported anatomical grouping of simple cells in cat V1. Thus, this generative model makes explicit an interpretation of complex and simple cells as elements in the segmentation of a visual scene into basic independent features, along with a parametrisation of their moment-by-moment appearances. We speculate that such a segmentation may form the initial stage of a hierarchical system that progressively separates the identity and appearance of more articulated visual elements, culminating in view-invariant object recognition.

Design e gênero: diretrizes metodológicas para validação do uso da linguagem visual na roupa infantil

Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES)

Entre o sonoro e o visual: relações e processos nas artes

Pós-graduação em Artes - IA

The impact of visual-verbal relationships on native-nonnative english speakers' reading processes and comprehension

The aim of this study was to comparatively investigate the impact of visual-verbal relationships that exist in expository texts on the reading process and comprehension of readers from different language background: native speakers of English (LI) and speakers of English as a foreign language (EFL). The study focussed, in this respect, on the visual elements (VEs) mainly graphs and tables that accompanied the selected texts. Two major experiments were undertaken. The first, was for the reading process using the post-reading questionnaire technique. Participants were 163 adult readers representing three groups: 77 (LI), 56 (EFL postgraduates); and 30 (EFL undergraduates). The second experiment was for the reading comprehension using cloze procedure. Participants were 123 representing the same above gorups: 50, 33 and 40 respectively. It was hypothesised that the LI readers would make use of VEs in the reading process in ways different from both EFL groups and that use would enhance each group's comprehension in different aspects and to different levels. In the analysis of the data of both experiments two statistical measurements were used. The chi-square was used to measure the differences between frequencies and the t-test was used to measure the differences between means. The results indicated a significant relationship between readers' language background and the impact of visual-verbal relationships on their reading processes and comprehension of such type of texts. The results also revealed considerable similarities between the two EFL groups in the reading process of texts accompanied by VEs. In the reading comprehension, however, the EFL undergraduates seemed to benefit from the visual-verbal relationships in their comprehension more than the postgraduates, suggesting a weak relationship of this impact for older EFL readers. Furthermore, the results showed considerable similarities between the reading process of texts accompanied by VEs and of whole prose texts. Finally an evaluation of this study was undertaken as well as practical implications for EFL readers and suggestions for future research.

The influence of MTV

MTV has had a key impact on advertising, not only from the point of view that commercials are aired during its programmes, but also because videos themselves can be viewed as advertisements. Music videos came about as a result of the music industry being in a recession during the early eighties. Initially MTV’s incentive to develop music television was advertiser led (Goodwin, 1992, p.38). One needs to remember that television is in the business to make money - not to entertain (Allen, 1992); and that viewers are in effect sold to the advertisers (White, 1992), and MTV is an influential media forces on their targets audience of between the ages twelve and thirty-four, with a median age of twenty-three (Englis et al., 1994). The reason why MTV is such an effective advertising medium, is that it utilises music, mood, visual elements, popular culture and the socialising effect of television, to sell its message in a susceptible/ passive manner. Its primary goal is to promote the artist or band performing in the video clip, so that consumers will purchase their CDs, as well as other band related products. But more often than not, the video clip sells much more than just that. Lifestyles, fashion, cosmetics, cars, consumer and social behaviour are all promoted in an unsuspecting manner. Advertisers, as a result, have looked to MTV for ideas on how to better communicate with the youth market; adopting similar styles to get their message across. The following looks at how and why, the fusion of MTV and advertising works so well together by considering past research.

Seeing is understanding : the effect of visualisation in understanding programming concepts

How and why visualisations support learning was the subject of this qualitative instrumental collective case study. Five computer programming languages (PHP, Visual Basic, Alice, GameMaker, and RoboLab) supporting differing degrees of visualisation were used as cases to explore the effectiveness of software visualisation to develop fundamental computer programming concepts (sequence, iteration, selection, and modularity). Cognitive theories of visual and auditory processing, cognitive load, and mental models provided a framework in which student cognitive development was tracked and measured by thirty-one 15-17 year old students drawn from a Queensland metropolitan secondary private girls’ school, as active participants in the research. Seventeen findings in three sections increase our understanding of the effects of visualisation on the learning process. The study extended the use of mental model theory to track the learning process, and demonstrated application of student research based metacognitive analysis on individual and peer cognitive development as a means to support research and as an approach to teaching. The findings also forward an explanation for failures in previous software visualisation studies, in particular the study has demonstrated that for the cases examined, where complex concepts are being developed, the mixing of auditory (or text) and visual elements can result in excessive cognitive load and impede learning. This finding provides a framework for selecting the most appropriate instructional programming language based on the cognitive complexity of the concepts under study.

A conceptual framework for a systematic mapping of layout design principles by using Yin and Yang theory

There are various principles for layout design such as balance, rhythm, unity and harmony, but each principle has often been introduced as a separate concept rather than within an integrated and systematic structure, so that designers and design students have to keep practices for the acquisition of skills. The paper seeks to develop a conceptual framework for a systematic mapping of layout design principles by using Yin and Yang and the Five Elements. Yin and Yang theory explains all natural phenomena with its own conceptual model and facilitates finding harmony and balance between the visual elements in terms of systematic and organic relations. Most common and well-known layout design principles are defined with 10 different resources such as design books and articles, and have been remapped following with the structure of Yin and Yang and the Five Elements. A systematic framework explaining the relationships of design principles was created and 32 design students participated in its efficiency test. The outcome suggests there is a high possibility that the framework can be used in professional fields and design education.

Writing the visible page : a multimodal approach to graphic devices in literary fiction

This practice-led project has two outcomes: a collection of short stories titled 'Corkscrew Section', and an exegesis. The short stories combine written narrative with visual elements such as images and typographic devices, while the exegesis analyses the function of these graphic devices within adult literary fiction. My creative writing explores a variety of genres and literary styles, but almost all of the stories are concerned with fusing verbal and visual modes of communication. The exegesis adopts the interpretive paradigm of multimodal stylistics, which aims to analyse graphic devices with the same level of detail as linguistic analysis. Within this framework, the exegesis compares and extends previous studies to develop a systematic method for analysing how the interactions between language, images and typography create meaning within multimodal literature.

Examining intuitive navigation in airports

Airports accommodate passengers with a range of prior experience, from frequent flyers, to passengers who fly every couple of years, to those who have never flown before. Passengers with varying levels of prior experience may use different visual elements when navigating the airport. Ensuring all passengers can navigate to the processing activities intuitively is important for passengers, airports and airlines. This paper examines how participants with Low, Medium and High airport familiarity navigate through the departures area at an Australian international airport. Three navigation activities are investigated: (i) navigating to the check-in row, (ii) navigating through the Liquids, Aerosols and Gels (LAGs) preparation area before security screening, and; (iii) navigating to either the boarding gate first or to a discretionary activity first, after exiting customs. In the three activities, differences were observed between the familiarity groups. These differences include the use of different information to locate the check-in desk, different actions when navigating through the LAG preparation area, and evidence that Low familiarity passengers have a desire to locate the boarding gate as soon as possible once through customs. This research provides evidence based design reccomendations for airports to benefit from intuitive passenger navigation.

Scene signatures : localised and point-less features for localisation

This paper is about localising across extreme lighting and weather conditions. We depart from the traditional point-feature-based approach as matching under dramatic appearance changes is a brittle and hard thing. Point feature detectors are fixed and rigid procedures which pass over an image examining small, low-level structure such as corners or blobs. They apply the same criteria applied all images of all places. This paper takes a contrary view and asks what is possible if instead we learn a bespoke detector for every place. Our localisation task then turns into curating a large bank of spatially indexed detectors and we show that this yields vastly superior performance in terms of robustness in exchange for a reduced but tolerable metric precision. We present an unsupervised system that produces broad-region detectors for distinctive visual elements, called scene signatures, which can be associated across almost all appearance changes. We show, using 21km of data collected over a period of 3 months, that our system is capable of producing metric localisation estimates from night-to-day or summer-to-winter conditions.

The Artful Interpretation of Science through Picture Books

Science picture books offer pleasurable and educational reading experiences. These texts open up opportunities for cross-curriculum teaching and learning and a means for developing students’ visual literacy skills, aesthetic appreciation, and higher level thinking skills. Picture books demonstrate how one mode or semiotic system (visual and verbal) mediates the other, often complementing, extending, and filling-in the gaps between words and images. Students’ meaning making is further extended when they can understand the subtleties and effects (and affects) of the visual elements of art and design, and the different styles of writing and language use.

Prior and posterior linear pooling for combining expert opinions: Uses and impact on Bayesian Networks

The use of expert knowledge to quantify a Bayesian Network (BN) is necessary when data is not available. This however raises questions regarding how opinions from multiple experts can be used in a BN. Linear pooling is a popular method for combining probability assessments from multiple experts. In particular, Prior Linear Pooling (PrLP), which pools opinions then places them into the BN is a common method. This paper firstly proposes an alternative pooling method, Posterior Linear Pooling (PoLP). This method constructs a BN for each expert, then pools the resulting probabilities at the nodes of interest. Secondly, it investigates the advantages and disadvantages of using these pooling methods to combine the opinions of multiple experts. Finally, the methods are applied to an existing BN, the Wayfinding Bayesian Network Model, to investigate the behaviour of different groups of people and how these different methods may be able to capture such differences. The paper focusses on 6 nodes Human Factors, Environmental Factors, Wayfinding, Communication, Visual Elements of Communication and Navigation Pathway, and three subgroups Gender (female, male),Travel Experience (experienced, inexperienced), and Travel Purpose (business, personal) and finds that different behaviors can indeed be captured by the different methods.