Haptic Aurality: Listening in a Digital World

I will question modes of listening in network music performance environments, drawing on my experience as a performer listening in these scenarios. I will situate network listening, which I have previously examined as ‘haptic aurality’ (Schroeder, 2009, 2012, 2013) within the context of current music making, and will refer to changes in compositional practices that draw specific attention to listening. I will show that some of these compositional developments play a determining role in articulating a new discourse of listening. French composer Eric Satie’s concept of Furniture Music (in Duckworth, 2005), Pierre Schaeffer’s ideas on reduced listening (1966), Pauline Oliveros’ deep listening practices (2005) as well as digital music platforms all serve to show a development towards a proliferation in listening experiences. I expand this narrative to listening practices in network performance environments, and identify a specific bodily fragility in listening in and to the network. This fragile state of listening and de-centered kind of performative being allow me to draw parallels to the Japanese art form Butoh (Kasai, 1999, 2000; Kasai and Parsons, 2003) and Elaine Scarry’s metaphor of beauty (Scarry, 2001). My own performance experiences, set within the context of several critical texts, allow me to understand network[ed] listening as an ideal corporeal state, which offers a rethinking of linear conceptions of the other and a subject’s own relation with her world. Ultimately, network[ed] listening posits listening as a corporeal and multi-dimensional experience that is continuously being re-shaped by technological, socio-political and cultural concerns.

Haptic Aurality – performing in a digital world

Paper accepted at 2015 ISIS in Utrecht. This presentation will examine the performative body from the viewpoint of the listening body in digital media platforms, and thus investigates the proposed conference issues which are at the intersections of ‘play’, ‘perform’ and ‘participate’.

Coupled Effects of a Perturbation in a Complex Structure Observed with SDO/AIA, SDO/HMI and ROSA/HARDcam

We study properties of intensity fluctuations in NOAA Active Region 11250 observed on 13 July 2011 starting at UT 13:32. Included are data obtained in the EUV bands of the Atmospheric Imaging Assembly on board the Solar Dynamics Observatory (SDO/AIA) as well as nearly simultaneous observations of the chromosphere made, at much higher spatial and temporal resolution, with the Rapid Oscillations in the Solar Atmosphere (ROSA) and Hydrogen-Alpha Rapid Dynamics camera (HARDcam) systems at the Dunn Solar Telescope. A complex structure seen in both the ROSA/HARDcam and SDO data sets comprises a system of loops extending outward from near the boundary of the leading sunspot umbra. It is visible in the ROSA Ca II K and HARDcam Hα images, as well as the SDO 304 Å, 171 Å and 193 Å channels, and it thus couples the chromosphere, transition region and corona. In the ground-based images the loop structure is 4.1 Mm long. Some 17.5 Mm, can be traced in the SDO/AIA data. The chromospheric emissions observed by ROSA and HARDcam appear to occupy the inner, and apparently cooler and lower, quarter of the loop. We compare the intensity fluctuations of two points within the structure. From alignment with SDO/HMI images we identify a point "A" near the loop structure, which sits directly above a bipolar magnetic feature in the photosphere. Point "B" is characteristic of locations within the loops that are visible in both the ROSA/HARDcam and the SDO/AIA data. The intensity traces for point A are quiet during the first part of the data string. At time ~ 19 min they suddenly begin a series of impulsive brightenings. In the 171 Å and 193 Å coronal lines the brightenings are localized impulses in time, but in the transition region line at 304 Å they are more extended in time. The intensity traces in the 304 Å line for point B shows a quasi-periodic signal that changes properties at about 19 min. The wavelet power spectra are characterized by two periodicities. A 6.7 min period extends from the beginning of the series until about 25 minutes, and another signal with period ~3 min starts at about 20 min. The 193 Å power spectrum has a characteristic period of 5 min, before the 20 min transition and a 2.5 min periodicity afterward. In the case of HARDcam Hα data a localized 4 min periodicity can be found until about 7 min, followed by a quiet regime. After ~20 min a 2.3 min periodicity appears. Interestingly a coronal loop visible in the 94 Å line that is centrally located in the AR, running from the leading umbra to the following polarity, at about time 20 min undergoes a strong brightening beginning at the same moment all along 15 Mm of its length. The fact that these different signals all experience a clear-cut change at time about 20 min suggests an underlying organizing mechanism. Given that point A has a direct connection to the photospheric magnetic bipole, we conjecture that the whole extended structure is connected in a complex manner to the underlying magnetic field. The periodicities in these features may favor the wave nature rather than upflows and interpretations will be discussed.

Facteurs influencing haptic shape perception

Le but de cette étude était de déterminer la contribution de plusieurs facteurs (le design de la tâche, l’orientation d’angle, la position de la tête et du regard) sur la capacité des sujets à percevoir les différences de formes bidimensionnelles (2-D) en utilisant le toucher haptique. Deux séries d'expériences (n = 12 chacune) ont été effectuées. Dans tous les cas, les angles ont été explorés avec l'index du bras tendu. La première expérience a démontré que le seuil de discrimination des angles 2-D a été nettement plus élevé, 7,4°, que le seuil de catégorisation des angles 2-D, 3,9°. Ce résultat étend les travaux précédents, en montrant que la différence est présente dans les mêmes sujets testés dans des conditions identiques (connaissance des résultats, conditions d'essai visuel, l’orientation d’angle). Les résultats ont également montré que l'angle de catégorisation ne varie pas en fonction de l'orientation des angles dans l'espace (oblique, verticale). Étant donné que les angles présentés étaient tous distribués autour de 90°, ce qui peut être un cas particulier comme dans la vision, cette constatation doit être étendue à différentes gammes d'angles. Le seuil plus élevé dans la tâche de discrimination reflète probablement une exigence cognitive accrue de cette tâche en demandant aux sujets de mémoriser temporairement une représentation mentale du premier angle exploré et de la comparer avec le deuxième angle exploré. La deuxième expérience représente la suite logique d’une expérience antérieure dans laquelle on a constaté que le seuil de catégorisation est modifié avec la direction du regard, mais pas avec la position de la tête quand les angles (non visibles) sont explorés en position excentrique, 60° à la droite de la ligne médiane. Cette expérience a testé l'hypothèse que l'augmentation du seuil, quand le regard est dirigé vers l'extrême droite, pourrait refléter une action de l'attention spatiale. Les sujets ont exploré les angles situés à droite de la ligne médiane, variant systématiquement la direction du regard (loin ou vers l’angle) de même que l'emplacement d'angle (30° et 60° vers la droite). Les seuils de catégorisation n’ont démontré aucun changement parmi les conditions testées, bien que le biais (point d'égalité subjective) ait été modifié (décalage aux valeurs inférieurs à 90°). Puisque notre test avec le regard fixé à l’extrême droite (loin) n'a eu aucun effet sur le seuil, nous proposons que le facteur clé contribuant à l'augmentation du seuil vu précédemment (tête tout droit/regard à droite) doit être cette combinaison particulière de la tête/regard/angles et non l’attention spatiale.

Dental training system using haptic technology

In the U.K., dental students require to perform training and practice on real human tissues at the very early stage of their courses. Currently, the human tissues, such as decayed teeth, are mounted in a human head like physical model. The problems with these models in teaching are; (1) every student operates on tooth, which are always unique; (2) the process cannot be recorded for examination purposes and (3) same training are not repeatable. The aim of the PHATOM Project is to develop a dental training system using Haptic technology. This paper documents the project background, specification, research and development of the first prototype system. It also discusses the research in the visual display, haptic devices and haptic rendering. This includes stereo vision, motion parallax, volumetric modelling, surface remapping algorithms as well as analysis design of the system. A new volumetric to surface model transformation algorithm is also introduced. This paper includes the future work on the system development and research.

High bandwidth, large workspace haptic interaction: flying phantoms

It is well understood that for haptic interaction: free motion performance and closed-loop constrained motion performance have conflicting requirements. The difficulties for both conditions are compounded when increased workspace is required as most solutions result in a reduction of achievable impedance and bandwidth. A method of chaining devices together to increase workspace without adverse effect on performance is described and analysed. The method is then applied to a prototype, colloquially known as 'The Flying Phantom', and shown to provide high-bandwidth, low impedance interaction over the full range of horizontal movement across the front of a human user.

Perceptual cues for orientation in a two finger haptic grasp task

Single point interaction haptic devices do not provide the natural grasp and manipulations found in the real world, as afforded by multi-fingered haptics. The present study investigates a two-fingered grasp manipulation involving rotation with and without force feedback. There were three visual cue conditions: monocular, binocular and projective lighting. Performance metrics of time and positional accuracy were assessed. The results indicate that adding haptics to an object manipulation task increases the positional accuracy but slightly increases the overall time taken.

Extending the friction cone algorithm for arbitrary polygon based haptic objects

Most haptic environments are based on single point interactions whereas in practice, object manipulation requires multiple contact points between the object, fingers, thumb and palm. The Friction Cone Algorithm was developed specifically to work well in a multi-finger haptic environment where object manipulation would occur. However, the Friction Cone Algorithm has two shortcomings when applied to polygon meshes: there is no means of transitioning polygon boundaries or feeling non-convex edges. In order to overcome these deficiencies, Face Directed Connection Graphs have been developed as well as a robust method for applying friction to non-convex edges. Both these extensions are described herein, as well as the implementation issues associated with them.