Sonification supports eyes-free respiratory monitoring and task time-sharing

Three experiments explored the effectiveness of continuous auditory displays, or sonifications, for conveying information about a simulated anesthetized patient's respiration. Experiment 1 established an effective respiratory sonification. Experiment 2 showed an effect of expertise in the use of respiratory sonification and revealed that some apparent differences in sonification effectiveness could be accounted for by response bias. Experiment 3 showed that sonification helps anesthesiologists to maintain high levels of awareness of the simulated patient's state while performing other tasks more effectively than when relying upon visual monitoring of the simulated patient state. Overall, sonification of patient physiology beyond traditional pulse oximetry appears to be a viable and useful adjunct to visual monitors. Actual and potential applications of this research include monitoring in a wide variety of busy critical care contexts.

Movement Sonification: Effects on Motor Learning beyond Rhythmic Adjustments

Motor learning is based on motor perception and emergent perceptual-motor representations. A lot of behavioral research is related to single perceptual modalities but during last two decades the contribution of multimodal perception on motor behavior was discovered more and more. A growing number of studies indicates an enhanced impact of multimodal stimuli on motor perception, motor control and motor learning in terms of better precision and higher reliability of the related actions. Behavioral research is supported by neurophysiological data, revealing that multisensory integration supports motor control and learning. But the overwhelming part of both research lines is dedicated to basic research. Besides research in the domains of music, dance and motor rehabilitation, there is almost no evidence for enhanced effectiveness of multisensory information on learning of gross motor skills. To reduce this gap, movement sonification is used here in applied research on motor learning in sports. Based on the current knowledge on the multimodal organization of the perceptual system, we generate additional real-time movement information being suitable for integration with perceptual feedback streams of visual and proprioceptive modality. With ongoing training, synchronously processed auditory information should be initially integrated into the emerging internal models, enhancing the efficacy of motor learning. This is achieved by a direct mapping of kinematic and dynamic motion parameters to electronic sounds, resulting in continuous auditory and convergent audiovisual or audio-proprioceptive stimulus arrays. In sharp contrast to other approaches using acoustic information as error-feedback in motor learning settings, we try to generate additional movement information suitable for acceleration and enhancement of adequate sensorimotor representations and processible below the level of consciousness. In the experimental setting, participants were asked to learn a closed motor skill (technique acquisition of indoor rowing). One group was treated with visual information and two groups with audiovisual information (sonification vs. natural sounds). For all three groups learning became evident and remained stable. Participants treated with additional movement sonification showed better performance compared to both other groups. Results indicate that movement sonification enhances motor learning of a complex gross motor skill-even exceeding usually expected acoustic rhythmic effects on motor learning.

Panson: An interactive sonification framework for real-time applications

Many sonification systems face a number of common design challenges. These are addressed in every project with different, specific-purpose solutions. We present Panson – an interactive sonification framework implemented in Python that can ease the development of sonification systems. Panson allows the user to implement sonifications using the sc3nb library as interface to the SuperCollider sound synthesis engine. The framework provides support for both offline and online (real-time) sonification through a set of composable classes; these classes are designed to natively support interaction in Jupyter Notebooks. Using Panson, we will show an example of its application by implementing a facial expression sonification Jupyter Notebook based on OpenFace 2.0.

Data Visualization e Sonification per aumentare la consapevolezza sull'inquinamento attraverso un'applicazione web interattiva

Nonostante la consapevolezza sulle condizioni non ottimali della qualità dell'aria sia sempre più diffusa, a molte persone risulta ancora insidioso comprendere il significato dei dati sull'argomento tramite la sola rappresentazione grafica. L'obbiettivo di questo progetto è quello di presentare, tramite un'applicazione web interattiva, le informazioni sull'inquinamento atmosferico in maniera più semplice e coinvolgente. La strategia scelta è la Sonificazione: un processo che trasforma un dato di qualsiasi natura in un suono che ne rispecchia le caratteristiche. Su questa base, vengono approfondite le problematiche dell'inquinamento, le metodologie di rappresentazione e le debolezze di queste ultime. Dopo essere entrato in dettaglio sul funzionamento della Sonificazione e sulle sue applicazioni, il volume segue lo sviluppo del sistema in tutte le sue fasi: l'analisi dei requisiti, la scelta delle tecnologie, l'implementazione e i test. L'elaborato presta particolare attenzione a spiegare in dettaglio la realizzazione della traccia audio di Sonificazione, l'elemento più importante di tutto l'applicativo.

Aumentare la consapevolezza sul benessere digitale: Data Visualization e Sonification in un’applicazione mobile

La tecnologia gioca un ruolo importante nella vita della maggior parte delle persone, ma come possiamo assicurarci che migliori effettivamente la vita piuttosto che distrarci da essa? Con gli smartphone di oggi, i social media e i flussi infiniti di contenuti, molte persone sono pronte a condannare la tecnologia sulla base della loro convinzione che questi prodotti siano dannosi per la salute mentale e il benessere. Ma concentrarsi solo su questi effetti potenzialmente dannosi non ci aiuta a raccogliere tutti i vantaggi che questi strumenti hanno da offrire, gestendo anche i loro rischi. Da qui nasce il digital wellbeing: un termine utilizzato per descrivere l’impatto delle tecnologie e dei servizi digitali sulla salute mentale, fisica, sociale ed emotiva delle persone. Lo scopo di questa tesi è quello di aumentare la consapevolezza sul reale utilizzo dei dispositivi e sulle proprie abitudini salutari attraverso la sonificazione, un processo di traduzione dei dati in suono, a volte in un contesto musicale utilizzato come metodo per superare le barriere della comunicazione scientifica. Questo metodo è particolarmente vantaggioso per la sua capacità di rappresentare i dati scientifici per le persone con disabilità visive, che spesso non sono in grado di interagire con le tradizionali visualizzazioni dei dati. Per raggiungere l'obiettivo della tesi viene preso in esame una solo tipologia di dispositivi, gli iPhone, per la quale verrà creata un'applicazione che riesca ad ottenere i dati sulla salute, sulla forma fisica e di utilizzo dello smartphone.

A technique to assess small-scale heterogeneity of chemical properties in soil aggregates

A new method is presented which allows the separation of the soil aggregate exterior from the aggregate core. The method employs a combination of aggregate freezing with rapid separation of aggregate exteriors using ultrasonic energy. The factors influencing the thickness of the removed aggregate surface layer include water content of the aggregate prior to freezing, temperature difference between that of the frozen aggregate and that of the liquid it is submerged in during sonification, sonification time and energy, and the type of the immersion liquid. The success of the method and the thickness of the removed aggregate surface were examined using barium ( Ba2+) as a tracer. Barium ( as BaCl2) is rapidly absorbed by soil and is present at only very low levels in natural soils. Surface layers of 0.2 - 0.4 cm thickness were successfully removed from aggregates of 1 - 4 cm diameter. Two examples are given from soils in northern NSW to demonstrate the occurrence of small- scale heterogeneity in soil chemical properties. Compared with the surface fraction, a 4 - 7% higher calcium concentration was found in the core fraction of a clay loam soil ( Dermosol). Conversely, on a cracking clay soil ( Vertosol), atrazine concentration was around 15 times greater in the aggregate surface fractions compared with core fractions. Compared with the traditional estimation of soil chemical properties on homogenised bulk soil samples, it is suggested that separate analysis of aggregate surface and core fractions could provide useful additional information on the relationships between soil properties and environmental responses.

A influência das emoções positivas e da idade na interpretação de gráficos com dimensões visuais e auditivas

Dissertação apresentada à Escola Superior de Comunicação Social como parte dos requisitos para obtenção de grau de mestre em Audiovisual e Multimédia.

Using music as a signal for biofeedback

Studies on the potential benefits of conveying biofeedback stimulus using a musical signal have appeared in recent years with the intent of harnessing the strong effects that music listening may have on subjects. While results are encouraging, the fundamental question has yet to be addressed, of how combined music and biofeedback compares to the already established use of either of these elements separately. This experiment, involving young adults (N = 24), compared the effectiveness at modulating participants' states of physiological arousal of each of the following conditions: A) listening to pre-recorded music, B) sonification biofeedback of the heart rate, and C) an algorithmically modulated musical feedback signal conveying the subject's heart rate. Our hypothesis was that each of the conditions (A), (B) and (C) would differ from the other two in the extent to which it enables participants to increase and decrease their state of physiological arousal, with (C) being more effective than (B), and both more than (A). Several physiological measures and qualitative responses were recorded and analyzed. Results show that using musical biofeedback allowed participants to modulate their state of physiological arousal at least equally well as sonification biofeedback, and much better than just listening to music, as reflected in their heart rate measurements, controlling for respiration-rate. Our findings indicate that the known effects of music in modulating arousal can therefore be beneficially harnessed when designing a biofeedback protocol.

Using music as a signal for biofeedback

Studies on the potential benefits of conveying biofeedback stimulus using a musical signal have appeared in recent years with the intent of harnessing the strong effects that music listening may have on subjects. While results are encouraging, the fundamental question has yet to be addressed, of how combined music and biofeedback compares to the already established use of either of these elements separately. This experiment, involving young adults (N = 24), compared the effectiveness at modulating participants' states of physiological arousal of each of the following conditions: A) listening to pre-recorded music, B) sonification biofeedback of the heart rate, and C) an algorithmically modulated musical feedback signal conveying the subject's heart rate. Our hypothesis was that each of the conditions (A), (B) and (C) would differ from the other two in the extent to which it enables participants to increase and decrease their state of physiological arousal, with (C) being more effective than (B), and both more than (A). Several physiological measures and qualitative responses were recorded and analyzed. Results show that using musical biofeedback allowed participants to modulate their state of physiological arousal at least equally well as sonification biofeedback, and much better than just listening to music, as reflected in their heart rate measurements, controlling for respiration-rate. Our findings indicate that the known effects of music in modulating arousal can therefore be beneficially harnessed when designing a biofeedback protocol.

Ondas ultrassônicas e pérolas de vidro: um novo método de extração de beta-galactosidase para uso em laboratório

The optimization of a traditional technique of cellular disruption by abrasion was carried out and a process using ultrasonic waves associated with glass pearls to extract beta-galactosidase from Kluyveromyces marxianus proposed. In the first case, the effects of the diameter and weight of the pearls in relation to the volume of cellular suspension and amount of time for cellular disruption were evaluated. The efficiency of the new process of cellular disruption was evaluated by varying the length of time of sonification and comparing with the method of abrasion under the same conditions. The proposed method can be efficiently applied to obtain beta-galactosidase at laboratory scale.

Determinação de fósforo biodisponível em rações de peixes utilizando extração assistida por ultra-som e espectrofotometria no visível

The aim of the present work was to develop and optimize a method for determination of bioavailable phosphorus in samples of feces and fish feed using ultrasound extraction and subsequent quantification by visible spectrophotometry. Using as extractor solution HNO3 0.50 mol L-1, the great conditions of extraction established were: sample mass - 100 mg, samples granulometry - < 60 µm, sonification time - five cycles of 40 s and ultrasound potency - 136 W. The proposed method was applied in studies of digestibility of this nutrient in different feeds used in diets of juvenile of Nile tilapia.

Determinação de fósforo biodisponível em rações de peixes utilizando extração assistida por ultra-som e espectrofotometria no visível

The aim of the present work was to develop and optimize a method for determination of bioavailable phosphorus in samples of feces and fish feed using ultrasound extraction and subsequent quantification by visible spectrophotometry. Using as extractor solution HNO(3) 0.50 mol L(-1), the great conditions of extraction established were: sample mass - 100 mg, samples granulometry - < 60 mu m, sonification time - five cycles of 40 s and ultrasound potency - 136 W. The proposed method was applied in studies of digestibility of this nutrient in different feeds used in diets of juvenile of Nile tilapia.