Seeing music performance: Visual influences on perception and experience

Drawing from ethnographic, empirical, and historical/cultural perspectives, we examine the extent to which visual aspects of music contribute to the communication that takes place between performers and their listeners. First, we introduce a framework for understanding how media and genres shape aural and visual experiences of music. Second, we present case studies of two performances, and describe the relation between visual and aural aspects of performance. Third, we report empirical evidence that visual aspects of performance reliably influence perceptions of musical structure (pitch related features) and affective interpretations of music. Finally, we trace new and old media trajectories of aural and visual dimensions of music, and highlight how our conceptions, perceptions and appreciation of music are intertwined with technological innovation and media deployment strategies.

Animal visual systems and the evolution of color patterns: Sensory processing illuminates signal evolution

Animal color pattern phenotypes evolve rapidly. What influences their evolution? Because color patterns are used in communication, selection for signal efficacy, relative to the intended receiver's visual system, may explain and predict the direction of evolution. We investigated this in bowerbirds, whose color patterns consist of plumage, bower structure, and ornaments and whose visual displays are presented under predictable visual conditions. We used data on avian vision, environmental conditions, color pattern properties, and an estimate of the bowerbird phylogeny to test hypotheses about evolutionary effects of visual processing. Different components of the color pattern evolve differently. Plumage sexual dimorphism increased and then decreased, while overall (plumage plus bower) visual contrast increased. The use of bowers allows relative crypsis of the bird but increased efficacy of the signal as a whole. Ornaments do not elaborate existing plumage features but instead are innovations (new color schemes) that increase signal efficacy. Isolation between species could be facilitated by plumage but not ornaments, because we observed character displacement only in plumage. Bowerbird color pattern evolution is at least partially predictable from the function of the visual system and from knowledge of different functions of different components of the color patterns. This provides clues to how more constrained visual signaling systems may evolve.

Advanced patient monitoring displays: Tools or continuous informing

We reviewed the use of advanced display technologies for monitoring in anesthesia. Researchers are investigating displays that integrate information and that, in some cases, also deliver the results continuously to the anesthesiologist. Integrated visual displays reveal higher-order properties of patient state and speed in responding to events, but their benefits under an intensely timeshared load is unknown. Head-mounted displays seem to shorten the time to respond to changes, but their impact on peripheral awareness and attention is unknown. Continuous auditory displays extending pulse oximetry seem to shorten response times and improve the ability to time-share other tasks, but their integration into the already noisy operative environment still needs to be tested. We reviewed the advantages and disadvantages of the three approaches, drawing on findings from other fields, such as aviation, to suggest outcomes where there are still no results for the anesthesia context. Proving that advanced patient monitoring displays improve patient outcomes is difficult, and a more realistic goal is probably to prove that such displays lead to better situational awareness, earlier responding, and less workload, all of which keep anesthesia practice away from the outer boundaries of safe operation.

Business communication in interactions between mainland Chinese and western firms through Hong Kong Chinese intermediaries

Purpose-The paper aims to analyse the nature of business communication and its influence on relationships development between Hong Kong Chinese intermediaries sourcing from Mainland Chinese sellers involved in manufacturing for sale to Western buyer firms. Design/methodology/approach-A case study-driven methodology with purposeful sampling is applied to yield maximum variation in the sampling to elicit underlying tendencies and generative mechanisms that exist within and across the multiple cases of relationships. Findings-The paper finds that Mainland Chinese sellers and Hong Kong Chinese intermediaries tend not to have the close ties that might be expected. Mainland Chinese sellers constrained their use of social information, requiring Hong Kong Chinese intermediaries to use commercial information transfers to evaluate the trustworthiness of their Mainland Chinese partners. An ingroup/outgroup bias exacerbates the modesty bias of the Mainland Chinese and also hinders learning through the transfer of technical information within these Chinese interactions. On the other hand, Western buyers tend not to prefer social information interactions with their Hong Kong Chinese intermediaries, requiring these intermediaries to emphasise commercial information interactions to evaluate the trustworthiness of their Western buyers. Research limitations/implications-This research uses a restricted sample of case study respondents. Representative sampling across multiple contexts will assist in testing the generality of the findings. Practical implications-For the West to source increasingly attractive manufactures from Mainland China, Hong Kong intermediaries will remain fundamentally important even though this creates further interactions. The aggregate of these multiple exchange arrangements is less problematic than would be the case if Western business were to deal directly with the Mainland Chinese. Originality/value-This article sheds light on the nature of business communication interactions in a group of relationships between Hong Kong Chinese intermediaries and Mainland sellers, and buyers from the West. Implications for relationships development among the Chinese and Western actors are identified with propositions framed to guide further investigation.

Biologically inspired visual landmark processing for simultaneous localization and mapping

This paper illustrates a method for finding useful visual landmarks for performing simultaneous localization and mapping (SLAM). The method is based loosely on biological principles, using layers of filtering and pooling to create learned templates that correspond to different views of the environment. Rather than using a set of landmarks and reporting range and bearing to the landmark, this system maps views to poses. The challenge is to produce a system that produces the same view for small changes in robot pose, but provides different views for larger changes in pose. The method has been developed to interface with the RatSLAM system, a biologically inspired method of SLAM. The paper describes the method of learning and recalling visual landmarks in detail, and shows the performance of the visual system in real robot tests.

Suit keen renovator: Alternate reality design

Virtual territories and their theme parks are more akin to the physical world of real estate than they might at first appear. The trick in triggering the designer's imagination, is to find a 'nice renovator' (cottage/ house) at a low price, with loads of potential, and by doing it on the cheap to add character, and engage the imagination. Here the designer can construct changes from an imagined space. Vision is more important than how the actual place presents.This work describes a case study involving undergraduate students in the Creative Industries who needed a place to explore, so as to create their own visions and projects. The place had to inspire, trigger engagement, and their imaginations. At the same time it was important that the place did not coerce activity, or distract from the task by confusing tools with task, or architectural navigation with conceptual skills.The solution was an alternate reality.

Efficient Data Management with Applications to IoT

The Internet of Things (IoT) consists of a worldwide “network of networks,” composed by billions of interconnected heterogeneous devices denoted as things or “Smart Objects” (SOs). Significant research efforts have been dedicated to port the experience gained in the design of the Internet to the IoT, with the goal of maximizing interoperability, using the Internet Protocol (IP) and designing specific protocols like the Constrained Application Protocol (CoAP), which have been widely accepted as drivers for the effective evolution of the IoT. This first wave of standardization can be considered successfully concluded and we can assume that communication with and between SOs is no longer an issue. At this time, to favor the widespread adoption of the IoT, it is crucial to provide mechanisms that facilitate IoT data management and the development of services enabling a real interaction with things. Several reference IoT scenarios have real-time or predictable latency requirements, dealing with billions of device collecting and sending an enormous quantity of data. These features create a new need for architectures specifically designed to handle this scenario, hear denoted as “Big Stream”. In this thesis a new Big Stream Listener-based Graph architecture is proposed. Another important step, is to build more applications around the Web model, bringing about the Web of Things (WoT). As several IoT testbeds have been focused on evaluating lower-layer communication aspects, this thesis proposes a new WoT Testbed aiming at allowing developers to work with a high level of abstraction, without worrying about low-level details. Finally, an innovative SOs-driven User Interface (UI) generation paradigm for mobile applications in heterogeneous IoT networks is proposed, to simplify interactions between users and things.

Envisioning innovation : the communication of technological change through graphic representation

Graphic depiction is an established method for academics to present concepts about theories of innovation. These expressions have been adopted by policy-makers, the media and businesses. However, there has been little research on the extent of their usage or effectiveness ex-academia. In addition, innovation theorists have ignored this area of study, despite the communication of information about innovation being acknowledged as a major determinant of success for corporate enterprise. The thesis explores some major themes in the theories of innovation and compares how graphics are used to represent them. The thesis examines the contribution of visual sociology and graphic theory to an investigation of a sample of graphics. The methodological focus is a modified content analysis. The following expressions are explored: check lists, matrices, maps and mapping in the management of innovation; models, flow charts, organisational charts and networks in the innovation process; and curves and cycles in the representation of performance and progress. The main conclusion is that academia is leading the way in usage as well as novelty. The graphic message is switching from prescription to description. The computerisation of graphics has created a major role for the information designer. It is recommended that use of the graphic representation of innovation should be increased in all domains, though it is conceded that its content and execution need to improve, too. Education of graphic 'producers', 'intermediaries' and 'consumers' will play a part in this, as will greater exploration of diversity, novelty and convention. Work has begun to tackle this and suggestions for future research are made.

Attentional changes in pre-stimulus oscillatory activity within early visual cortex are predictive of human visual performance

Physiological and neuroimaging studies provide evidence to suggest that attentional mechanisms operating within the fronto-parietal network may exert top–down control on early visual areas, priming them for forthcoming sensory events. The believed consequence of such priming is enhanced task performance. Using the technique of magnetoencephalography (MEG), we investigated this possibility by examining whether attention-driven changes in cortical activity are correlated with performance on a line-orientation judgment task. We observed that, approximately 200 ms after a covert attentional shift towards the impending visual stimulus, the level of phase-resetting (transient neural coherence) within the calcarine significantly increased for 2–10 Hz activity. This was followed by a suppression of alpha activity (near 10 Hz) which persisted until the onset of the stimulus. The levels of phase-resetting, alpha suppression and subsequent behavioral performance varied between subjects in a systematic fashion. The magnitudes of phase-resetting and alpha-band power were negatively correlated, with high levels of coherence associated with high levels of performance. We propose that top–down attentional control mechanisms exert their initial effects within the calcarine through a phase-resetting within the 2–10 Hz band, which in turn triggers a suppression of alpha activity, priming early visual areas for incoming information and enhancing behavioral performance.

A visual interactive modelling system as a learning tool

This paper presents a case study of the use of a visual interactive modelling system to investigate issues involved in the management of a hospital ward. Visual Interactive Modelling systems are seen to offer the learner the opportunity to explore operational management issues from a varied perspective and to provide an interactive system in which the learner receives feedback on the consequences of their actions. However to maximise the potential learning experience for a student requires the recognition that they require task structure which helps them to understand the concepts involved. These factors can be incorporated into the visual interactive model by providing an interface customised to guide the student through the experimentation. Recent developments of VIM systems in terms of their connectivity with the programming language Visual Basic facilitates this customisation.

Advanced handover procedure for cellular communication systems

Third Generation cellular communication systems are expected to support mixed cell architecture in which picocells, microcells and macrocells are used to achieve full coverage and increase the spectral capacity. Supporting higher numbers of mobile terminals and the use of smaller cells will result in an increase in the number of handovers, and consequently an increase in the time delays required to perform these handovers. Higher time delays will generate call interruptions and forced terminations, particularly for time sensitive applications like real-time multimedia and data services. Currently in the Global System for Mobile communications (GSM), the handover procedure is initiated and performed by the fixed part of the Public Land Mobile Network (PLMN). The mobile terminal is only capable of detecting candidate base stations suitable for the handover; it is the role of the network to interrogate a candidate base station for a free channel. Handover signalling is exchanged via the fixed network and the time delay required to perform the handover is greatly affected by the levels of teletraffic handled by the network. In this thesis, a new handover strategy is developed to reduce the total time delay for handovers in a microcellular system. The handover signalling is diverted from the fixed network to the air interface to prevent extra delays due to teletraffic congestion, and to allow the mobile terminal to exchange signalling directly with the candidate base station. The new strategy utilises Packet Reservation Multiple Access (PRMA) technique as a mechanism to transfer the control of the handover procedure from the fixed network to the mobile terminal. Simulation results are presented to show a dramatic reduction in the handover delay as compared to those obtained using fixed channel allocation and dynamic channel allocation schemes.

Visual data mining: integrating machine learning with information visualization

Today, the data available to tackle many scientific challenges is vast in quantity and diverse in nature. The exploration of heterogeneous information spaces requires suitable mining algorithms as well as effective visual interfaces. Most existing systems concentrate either on mining algorithms or on visualization techniques. Though visual methods developed in information visualization have been helpful, for improved understanding of a complex large high-dimensional dataset, there is a need for an effective projection of such a dataset onto a lower-dimension (2D or 3D) manifold. This paper introduces a flexible visual data mining framework which combines advanced projection algorithms developed in the machine learning domain and visual techniques developed in the information visualization domain. The framework follows Shneiderman’s mantra to provide an effective user interface. The advantage of such an interface is that the user is directly involved in the data mining process. We integrate principled projection methods, such as Generative Topographic Mapping (GTM) and Hierarchical GTM (HGTM), with powerful visual techniques, such as magnification factors, directional curvatures, parallel coordinates, billboarding, and user interaction facilities, to provide an integrated visual data mining framework. Results on a real life high-dimensional dataset from the chemoinformatics domain are also reported and discussed. Projection results of GTM are analytically compared with the projection results from other traditional projection methods, and it is also shown that the HGTM algorithm provides additional value for large datasets. The computational complexity of these algorithms is discussed to demonstrate their suitability for the visual data mining framework.

Characteristics of visual function in Asperger’s syndrome and the autism spectrum

Autism is a pervasive developmental disorder and Asperger’s syndrome is part of the spectrum of autism disorders. This thesis aims to: • Review and investigate current theories concerning visual function in individuals with Asperger’s syndrome and high functioning autism spectrum disorder and to translate the findings into clinical practice by developing a specific protocol for the eye examination of individuals of this population. • Investigate whether those with Asperger’s syndrome are more likely to suffer from Meares-Irlen syndrome and/or dyslexia. • Assess the integrity of the M-cell pathway in Asperger’s syndrome using perimetric tests available in optometric practice to investigate and also to describe the nature of any defects. • Evaluate eye movement strategies in Asperger’s whilst viewing both text and images. Also to evaluate the most appropriate methodology for investigating eye movements; namely optical digital eye tracking and electrophysiology methodologies. Findings of the investigations include • Eye examinations for individuals with Asperger’s syndrome should contain the same testing methods as for the general population, with special consideration for clear communication. • There is a depression of M-pathway visual field sensitivity in 57% (8/14) of people with Asperger’s syndrome, supporting previous evidence for an M-cell deficit in some individuals. • There is a raised prevalence of dyslexia in Asperger’s syndrome (26% of a sample of 31) but not necessarily of Meares-Irlen syndrome. • Gaze strategies are abnormal in Asperger’s syndrome, for both reading and viewing of images. With increased saccadic movement and decreased viewing of faces in comparison to background detail.

Accessing networked services : a user interface design problem

This research investigates the general user interface problems in using networked services. Some of the problems are: users have to recall machine names and procedures to. invoke networked services; interactions with some of the services are by means of menu-based interfaces which are quite cumbersome to use; inconsistencies exist between the interfaces for different services because they were developed independently. These problems have to be removed so that users can use the services effectively. A prototype system has been developed to help users interact with networked services. This consists of software which gives the user an easy and consistent interface with the various services. The prototype is based on a graphical user interface and it includes the following appJications: Bath Information & Data Services; electronic mail; file editor. The prototype incorporates an online help facility to assist users using the system. The prototype can be divided into two parts: the user interface part that manages interactlon with the user; the communicatIon part that enables the communication with networked services to take place. The implementation is carried out using an object-oriented approach where both the user interface part and communication part are objects. The essential characteristics of object-orientation, - abstraction, encapsulation, inheritance and polymorphism - can all contribute to the better design and implementation of the prototype. The Smalltalk Model-View-Controller (MVC) methodology has been the framework for the construction of the prototype user interface. The purpose of the development was to study the effectiveness of users interaction to networked services. Having completed the prototype, tests users were requested to use the system to evaluate its effectiveness. The evaluation of the prototype is based on observation, i.e. observing the way users use the system and the opinion rating given by the users. Recommendations to improve further the prototype are given based on the results of the evaluation. based on the results of the evah:1ation. . .'. " "', ':::' ,n,<~;'.'