Talk2Me : the art of augmenting conversations

This paper describes an interactive installation work set in a large dome space. The installation is an audio and physical re-rendition of an interactive writing work. In the original work, the user interacted via keyboard and screen while online. This rendition of the work retains the online interaction, but also places the interaction within a physical space, where the main 'conversation' takes place by the participant-audience speaking through microphones and listening through headphones. The work now also includes voice and SMS input, using speech-to-text and text-to-speech conversion technologies, and audio and displayed text for output. These additions allow the participant-audience to co-author the work while they participate in audible conversation with keyword-triggering characters (bots). Communication in the space can be person-to-computer via microphone, keyboard, and phone; person-to-person via machine and within the physical space; computer-to- computer; and computer-to-person via audio and projected text.

Macrophonics II

Macrophonics II presents new Australian work emerging from the leading edge of performance interface research. The program addresses the emerging dialogue between traditional media and emerging digital media, as well as dialogues across a broad range of musical traditions. Recent technological developments are causing a complete reevaluation of the relationships between media and genres in art, and Macrophonics II presents a cross-section of responses to this situation. Works in the program foreground an approach to performance that integrates sensors with novel performance control devices, and/or examine how machines can be made musical in performance. The program presents works by Australian artists Donna Hewitt, Julian Knowles and Wade Marynowsky, with choreography by Avril Huddy and dance performance by Lizzie and Zaimon Vilmanis. From sensor-based microphones and guitars, through performance a/v, to post-rock dronescapes, movement inspired works and experimental electronica, Macrophonics II provides a broad and engaging survey of new performance approaches in mediatised environments. Initial R&D for the work was supported by a range of institutions internationally, including the Australia Council for the Arts, Arts Queensland, STEIM (Holland) and the Nes Artist Residency (Iceland).

Investigations on road noise level spatial variability within a specially designed acoustic balcony

An investigation into the spatial distribution of road traffic noise levels on a balcony is conducted. A balcony constructed to a special acoustic design due to its elevation above an 8 lane motorway is selected for detailed measurements. The as-constructed balcony design includes solid parapets, side walls, ceiling shields and highly absorptive material placed on the ceiling. Road traffic noise measurements are conducted spatially using a five channel acoustic analyzer, where four microphones are located at various positions within the balcony space and one microphone placed outside the parapet at a reference position. Spatial distributions in both vertical and horizontal planes are measured. A theoretical model and prediction configuration is presented that assesses the acoustic performance of the balcony under existing traffic flow conditions. The prediction model implements a combined direct path, specular reflection path and diffuse reflection path utilizing image source and radiosity techniques. Results obtained from the prediction model are presented and compared to the measurement results. The predictions are found to correlate well with measurements with some minor differences that are explained. It is determined that the prediction methodology is acceptable to assess a wider range of street and balcony configuration scenarios.

Channel selection in the short-time modulation domain for distant speech recognition

Automatic speech recognition from multiple distant micro- phones poses significant challenges because of noise and reverberations. The quality of speech acquisition may vary between microphones because of movements of speakers and channel distortions. This paper proposes a channel selection approach for selecting reliable channels based on selection criterion operating in the short-term modulation spectrum domain. The proposed approach quantifies the relative strength of speech from each microphone and speech obtained from beamforming modulations. The new technique is compared experimentally in the real reverb conditions in terms of perceptual evaluation of speech quality (PESQ) measures and word error rate (WER). Overall improvement in recognition rate is observed using delay-sum and superdirective beamformers compared to the case when the channel is selected randomly using circular microphone arrays.

Design of a high sensitivity FET integrated MEMS microphone

FET based MEMS microphones comprise of a flexible diaphragm that works as the moving gate of the transistor. The integrated electromechanical transducer can be made more sensitive to external sound pressure either by increasing the mechanical or the electrical sensitivities. We propose a method of increasing the overall sensitivity of the microphone by increasing its electrical sensitivity. The proposed microphone uses the transistor biased in the sub-threshold region where the drain current depends exponentially on the difference between the gate-to-source voltage and the threshold voltage. The device is made more sensitive without adding any complexity in the mechanical design of the diaphragm.

Study Of Acoustic Source Localization Algorithm For Planar Arrays

The source localization algorithms in the earlier works, mostly used non-planar arrays. If we consider scenarios like human-computer communication, or human-television communication where the microphones need to be placed on the computer monitor or television front panel, i.e we need to use the planar arrays. The algorithm proposed in 1], is a Linear Closed Form source localization algorithm (LCF algorithm) which is based on Time Difference of Arrivals (TDOAs) that are obtained from the data collected using the microphones. It assumes non-planar arrays. The LCF algorithm is applied to planar arrays in the current work. The relationship between the error in the source location estimate and the perturbation in the TDOAs is derived using first order perturbation analysis and validated using simulations. If the TDOAs are erroneous, both the coefficient matrix and the data matrix used for obtaining source location will be perturbed. So, the Total least squares solution for source localization is proposed in the current work. The sensitivity analysis of the source localization algorithm for planar arrays and non-planar arrays is done by introducing perturbation in the TDOAs and the microphone locations. It is shown that the error in the source location estimate is less when we use planar array instead of the particular non-planar array considered for same perturbation in the TDOAs or microphone location. The location of the reference microphone is proved to be important for getting an accurate source location estimate if we are using the LCF algorithm.

Matching sender and receiver: poikilothermy and frequency tuning in a tree cricket

Animals communicate in non-ideal and noisy conditions. The primary method they use to improve communication efficiency is sender-receiver matching: the receiver's sensory mechanism filters the impinging signal based on the expected signal. In the context of acoustic communication in crickets, such a match is made in the frequency domain. The males broadcast a mate attraction signal, the calling song, in a narrow frequency band centred on the carrier frequency (CF), and the females are most sensitive to sound close to this frequency. In tree crickets, however, the CF changes with temperature. The mechanisms used by female tree crickets to accommodate this change in CF were investigated at the behavioural and biomechanical level. At the behavioural level, female tree crickets were broadly tuned and responded equally to CFs produced within the naturally occurring range of temperatures (18 to 27 degrees C). To allow such a broad response, however, the transduction mechanisms that convert sound into mechanical and then neural signals must also have a broad response. The tympana of the female tree crickets exhibited a frequency response that was even broader than suggested by the behaviour. Their tympana vibrate with equal amplitude to frequencies spanning nearly an order of magnitude. Such a flat frequency response is unusual in biological systems and cannot be modelled as a simple mechanical system. This feature of the tree cricket auditory system not only has interesting implications for mate choice and species isolation but may also prove exciting for bio-mimetic applications such as the design of miniature low frequency microphones.

Effects of surface roughness on airframe noise

The generation of sound by turbulent boundary layer flow at low Mach number over a rough wall is investigated by applying the theoretical model which describes the scattering of the turbulence near field into sound by roughness elements. Attention is focused on the numerical method to approximately quantify the absolute level of the roughness noise radiated to far field. Empirical models for the source statistics are obtained by scaling smooth-wall data through increased skin friction velocity and boundary layer thickness for the rough surface. Numerical integration is performed to determine the roughness noise, and it reproduces the spectral characteristics of the available empirical formula and experimental data. Experiments are conducted to measure the radiated sound from two rough plates in an open jet by four 1/2'' free-field condenser microphones. The measured noise spectra of the rough plates are above that of a smooth plate in 1-2.5 kHz frequency and exhibits encouraging agreement with the predicted spectra. Also, a phased microphone array is utilized to localize the sound source, and it confirms that the rough plates generate higher source strengthes in this frequency range. A parametric study illustrates that the roughness height and roughness density significantly affect the far-field radiated roughness noise with the roughness height having the dominant effect. The estimates of the roughness noise for a Boeing 757 sized aircraft wing show that in high frequency region the sound radiated from surface roughness may exceed that from the trailing edge, and higher overall sound pressure levels for the roughness noise are also observed.

Parylene-C as a new piezoelectric material

The goal of this thesis is to develop a proper microelectromechanical systems (MEMS) process to manufacture piezoelectric Parylene-C (PA-C), which is famous for its chemical inertness, mechanical and thermal properties and electrical insulation. Furthermore, piezoelectric PA-C is used to build miniature, inexpensive, non-biased piezoelectric microphones.

These piezoelectric PA-C MEMS microphones are to be used in any application where a conventional piezoelectric and electret microphone can be used, such as in cell phones and hearing aids. However, they have the advantage of a simplified fabrication process compared with existing technology. In addition, as a piezoelectric polymer, PA-C has varieties of applications due to its low dielectric constant, low elastic stiffness, low density, high voltage sensitivity, high temperature stability and low acoustic and mechanical impedance. Furthermore, PA-C is an FDA approved biocompatible material and is able to maintain operate at a high temperature.

To accomplish piezoelectric PA-C, a MEMS-compatible poling technology has been developed. The PA-C film is poled by applying electrical field during heating. The piezoelectric coefficient, -3.75pC/N, is obtained without film stretching.

The millimeter-scale piezoelectric PA-C microphone is fabricated with an in-plane spiral arrangement of two electrodes. The dynamic range is from less than 30 dB to above 110 dB SPL (referenced 20 µPa) and the open-circuit sensitivities are from 0.001 – 0.11 mV/Pa over a frequency range of 1 - 10 kHz. The total harmonic distortion of the device is less than 20% at 110 dB SPL and 1 kHz.

Desenvolvimento de um sistema de detecção fotoacústico utilizando dois microfones: aplicações em medidas de difusividade térmica

Neste trabalho, desenvolveu-se um sistema de detecção fotoacústico para medidas simultâneas e independentes dos sinais fotoacústicos dianteiro e traseiro, utilizando dois microfones e um único feixe de excitação. Utiliza-se a diferença de fase entre estes sinais para a determinação da difusividade térmica de materiais, com base na abordagem teórica da técnica da Diferença de Fase dos Dois Feixes (T2F). Na metodologia apresentada não há a necessidade de se alternar o feixe de excitação entre as faces da amostra. Esta característica torna mais rápido o procedimento de medida e simplifica o monitoramento automatizado de processos dinâmicos que afetam a difusividade térmica do material, como a cura de resinas poliméricas. É apresentado o procedimento utilizado para determinar a diferença entre as fases intrínsecas dos microfones e o método empregado para compensar tal diferença e, assim, obter a defasagem entre os sinais fotoacústicos dianteiro e traseiro. O sistema de detecção desenvolvido é avaliado em medidas de difusividade térmica de amostras metálicas (aço inoxidável AISI 304 e aço SAE 1020) e poliméricas (polipropileno e polietileno de baixa densidade). Os resultados obtidos concordam de forma satisfatória com dados disponíveis na literatura. Finalmente, a aplicação do sistema proposto ao monitoramento de cura de amostras de resina epóxi indicou sua potencialidade de acompanhar, em tempo real, este tipo de processo dinâmico.

Museos, redes sociales y tecnología 2.0

Índice: - Sobre museos, redes sociales y tecnología 2.0 (Alex Ibáñez Etxeberria). - Sitios web y museos: nuevas aplicaciones para el aprendizaje informal (Mikel Asensio, Elena Asenjo y Alex Ibáñez Etxeberria). - From headphones to microphones: mobile social media in the museum as distributed network (Nancy Proctor). - Mobile learning y patrimionio: aprendiendo historia con mi teléfono, mi GPS y mi PDA (Alex Ibáñez Etxeberria, Mikel Asensio y José Miguel Correa). - Digital asset management strategies for multi-platform content delivery (Titus Bicknell). - Redes sociales y museos participativos: la irrupción de las tecnologías 2.0 en la sociedad y su aplicación en los museos a través del caso de Arazi (Juan José Aranburu).

"Muito prazer, eu existo!" Visibilidade e reconhecimento no ativismo de pessoas Trans no Brasil.

Esta é uma tese sobre cartazes, faixas, memes, cartilhas, palanques, microfones, panfletos, pessoas na rua, megafones, performances, vídeos, biografias, blogs, tweets e postagens no Facebook. Esta é uma tese sobre as interações sociais envolvidas na luta por reconhecimento empreendida por ativistas trans numa multiplicidade de palcos que vem sendo disponibilizados e construídos na arena política. Na última década, essa luta foi construída através da reivindicação por visibilidade. Assim, o dia específico de celebração ou de protesto de pessoas trans no Brasil, o dia 29 de janeiro, é chamado de Dia da Visibilidade Trans. A categoria visibilidade, cuja construção histórica pode ser percebida por diferentes meios, é polissêmica e contextual. É, portanto, o objetivo inicial desta tese explorar os diferentes sentidos atribuídos à visibilidade enquanto categoria chave da luta política no ativismo de pessoas trans no Brasil. Para tanto, foram realizadas observações etnográficas em diversos encontros de ativistas, tanto exclusivamente trans como LGBT em geral; em manifestações de rua; em seminários realizados em parcerias com órgãos governamentais; em uma campanha eleitoral e em espaços de sociabilidade e de ativismo online; além da análise de diversos materiais (cartazes, panfletos, memes, cartilhas, faixas, etc.) produzidos por ativistas; e duas entrevistas complementares ao trabalho etnográfico. A partir desse material de campo, busco tecer relações entre produções de regimes alternativos de visibilidade de pessoas trans e sua luta por reconhecimento, tendo como foco as interações sociais (online e offline), nas quais se fazem presentes processos comunicativos e negociações do estigma.

Abrindo os microfones: revisitando a experiência de um programa radifônico infantil

Esta dissertação apresenta um estudo sobre as experiências infantis na produção, recepção e apresentação de um programa radiofônico feito com e para crianças, durante o período de quinze anos de sua veiculação. Com o objetivo de trazer para o debate o que pensam as crianças sobre o programa que fazem e ouvem no contexto de uma emissora comunitária, este trabalho pretende, a partir dos relatos, refletir sobre os sentidos da produção infantil contemporânea e suas experiências culturais e sociais. Para o desenvolvimento da pesquisa, contei com o aporte teórico de Mikhail Bakthin e, a partir de suas concepções, foi sendo construída uma metodologia que garantisse um olhar exotópico para o programa de rádio, buscando um afastamento do lugar da radialista, para o lugar da pesquisadora que se inaugurava, uma vez que o programa manteve sua veiculação durante este estudo. Ainda como opção teórico metodológica, contei com a filosofia de Walter Benjamin para que a história da rádio e a história do programa infantil fossem contadas pelas pessoas adultos e crianças que fizeram e fazem parte deste contexto, por meio de suas rememorações. Como estratégia inicial, buscou-se a escuta dos áudios dos programas e, em seguida, o contato com os interlocutores da pesquisa, quais sejam: três adultos que apresentam seus programas na rádio comunitária, três jovens moças que participaram do programa infantil quando eram crianças e dez crianças que produzem e apresentam os programas atualmente

Integrated online speaker clustering and adaptation

For many applications, it is necessary to produce speech transcriptions in a causal fashion. To produce high quality transcripts, speaker adaptation is often used. This requires online speaker clustering and incremental adaptation techniques to be developed. This paper presents an integrated approach to online speaker clustering and adaptation which allows efficient clustering of speakers using the same accumulated statistics that are normally used for adaptation. Using a consistent criterion for both clustering and adaptation should yield gains for both stages. The proposed approach is evaluated on a meetings transcription task using audio from multiple distant microphones. Consistent gains over standard clustering and adaptation were obtained. Copyright © 2011 ISCA.

A six sensor method for measuring acoustic properties in ducts.

An accurate description of sound propagation in a duct is important to obtain the sound power radiating from a source in both near and far fields. A technique has been developed and applied to decompose higher-order modes of sound emitted into a duct. Traditional experiments and theory based on two-sensor methods are limited to the plane-wave contribution to the sound field at low frequency. Due to the increase in independent measurements required, a computational method has been developed to simulate sensitivities of real measurements (e.g., noise) and optimize the set-up. An experimental rig has been constructed to decompose the first two modes using six independent measurements from surface, flush-mounted microphones. Experiments were initially performed using a loudspeaker as the source for validation. Subsequently, the sound emitted by a mixed-flow fan has been investigated and compared to measurements made in accordance with the internationally standardized in-duct fan measurement method. This method utilizes large anechoic terminations and a procedure involving averaging over measurements in space and time to account for the contribution from higher-order modes. The new method does not require either of these added complications and gives detail about the underlying modal content of the emitted sound.