Nonverbal social sensing in action: Unobtrusive recording and extracting of nonverbal behavior in social interactions illustrated with a research example

Nonverbal behavior coding is typically conducted by "hand". To remedy this time and resource intensive undertaking, we illustrate how nonverbal social sensing, defined as the automated recording and extracting of nonverbal behavior via ubiquitous social sensing platforms, can be achieved. More precisely, we show how and what kind of nonverbal cues can be extracted and to what extent automated extracted nonverbal cues can be validly obtained with an illustrative research example. In a job interview, the applicant's vocal and visual nonverbal immediacy behavior was automatically sensed and extracted. Results show that the applicant's nonverbal behavior can be validly extracted. Moreover, both visual and vocal applicant nonverbal behavior predict recruiter hiring decision, which is in line with previous findings on manually coded applicant nonverbal behavior. Finally, applicant average turn duration, tempo variation, and gazing best predict recruiter hiring decision. Results and implications of such a nonverbal social sensing for future research are discussed.

Digital Audio Broadcasting: Technology and Prospects

The subject of the thesis was the digital audio broadcasting technology developed in the Eureka project 147. The research was based on the literature on the subject. At first, some reasons for the digitisation of broadcasting technology were given. Next, the channel multiplexing and channel coding methods employed by digital radio were discussed. The design of these methods is based on certain phenomena related to the propagation of radio-frequency signals, and these phenomena were also described. After that, audio and data transfer mechanisms as well as the structure of digital radio network were explained. Furthermore, digital audio and data services were considered. Finally, the digital radio was examined from marketing and administrative aspects. From a merely technical point of view, the digital radio technology offers several improvements in comparison with analogue technology. However, the digital radio has not become as widespread as it was perhaps originally expected during its development.

Secure logarithmic audio watermarking scheme based on the human auditory system

Peer-reviewed

Bowing the violin : a case study for auditory-motor pattern modelling in the context of music performance

This project addresses methodological and technological challenges in the development of multi-modal data acquisition and analysis methods for the representation of instrumental playing technique in music performance through auditory-motor patterning models. The case study is violin playing: a multi-modal database of violin performances has been constructed by recording different musicians while playing short exercises on different violins. The exercise set and recording protocol have been designed to sample the space defined by dynamics (from piano to forte) and tone (from sul tasto to sul ponticello), for each bow stroke type being played on each of the four strings (three different pitches per string) at two different tempi. The data, containing audio, video, and motion capture streams, has been processed and segmented to facilitate upcoming analyses. From the acquired motion data, the positions of the instrument string ends and the bow hair ribbon ends are tracked and processed to obtain a number of bowing descriptors suited for a detailed description and analysis of the bow motion patterns taking place during performance. Likewise, a number of sound perceptual attributes are computed from the audio streams. Besides the methodology and the implementation of a number of data acquisition tools, this project introduces preliminary results from analyzing bowing technique on a multi-modal violin performance database that is unique in its class. A further contribution of this project is the data itself, which will be made available to the scientific community through the repovizz platform.

Recording and reproducing Soundscapes : using and interpreting data in a creative way

http://elo.aalto.fi/fi/studies/elomedia/dataseminar/

Secure Bluetooth Audio Transmission System

The growing spread of small but powerful mobile devices (such as PDAs, mobile phone, Internet Tablet, etc.) opens up new scenarios in which users can interact with such devices in many environments in order to access the information at different locations. In this thesis, a ubiquitous computing based system called Secure Bluetooth Audio Transmission System is introduced. This system is situated in a large public place (like airport, festival venues, etc.), where voice messages are conveyed from the system to users' Bluetooth headsets in order to inform users the latest flight schedule and other public information. The reliability of the message is secured by adopting an authorization strategy and ECDSA. In order to assess and evaluate the risks and potential weaknesses of the system, an easy-to-use prototype implementation was written and tested. Other possible uses and further research were also considered.

Avalon Media System project update: a Hydra solution for digital audio and video access

Presentation at Open Repositories 2014, Helsinki, Finland, June 9-13, 2014

Audio and Video Repositories at Scale: Indiana University’s Media Digitization and Preservation Initiative

Presentation at Open Repositories 2014, Helsinki, Finland, June 9-13, 2014

Low-cost automatic activity data recording system

We describe a low-cost, high quality device capable of monitoring indirect activity by detecting touch-release events on a conducting surface, i.e., the animal's cage cover. In addition to the detecting sensor itself, the system includes an IBM PC interface for prompt data storage. The hardware/software design, while serving for other purposes, is used to record the circadian activity rhythm pattern of rats with time in an automated computerized fashion using minimal cost computer equipment (IBM PC XT). Once the sensor detects a touch-release action of the rat in the upper portion of the cage, the interface sends a command to the PC which records the time (hours-minutes-seconds) when the activity occurred. As a result, the computer builds up several files (one per detector/sensor) containing a time list of all recorded events. Data can be visualized in terms of actograms, indicating the number of detections per hour, and analyzed by mathematical tools such as Fast Fourier Transform (FFT) or cosinor. In order to demonstrate method validation, an experiment was conducted on 8 Wistar rats under 12/12-h light/dark cycle conditions (lights on at 7:00 a.m.). Results show a biological validation of the method since it detected the presence of circadian activity rhythm patterns in the behavior of the rats

The elderly : reminiscing, coping with loss, accepting death

This study investigated loss, death and dying, reminiscing, coping and the process of adaptation from the sUbjective perspective. A number of theories and models of death and dying were reviewed in the background literature search with the focus on reminiscing as a coping phenomenon. The format of the study was audio-taped interviews with ten sUbjects and the recording of their memories and reminiscing of life stories. The sUbjects were required to complete an initial questionnaire in a demographic data collection process. Two separate interviews consisted of a primary data collecting interview and a verification interview four to eight weeks later. An independent chart review completed the data collecting process. Data analysis was by the examination of the emerging themes in the subjects' personal narratives which revealed the sUb-categories of reminiscing, loss (including death and dying), acceptance, hope, love, despair and belief. Belief was shown to be the foundation and the base for living and reminiscing. Reminiscing was found to be a coping phenomenon, within the foundation of a belief system. Both living and reminiscing revealed the existence of a central belief or value with a great deal of importance attached to it. Whether the belief was of a spiritual nature, a value of marriage, tradition, a work ethic or belief in an abstract value such as fate,it gave support and control to the individuals' living and reminiscing process. That which caused despair or allowed acceptance indicated the sUbjects' basic belief and was identified in the story narrations. The findings were significant to health care in terms of education, increased dignity for the elderly and better understanding by society. The profiles represented an average age of 86.3 years with age showing no bearing on the life experiences associated with the emerging themes. Overwhelmingly, belief was shown to be the foundation in reminiscing. A Judeo-Christian cultural value base supported the belief in 90% of the sUbjects; however, different beliefs were clearly shown indicating that belief is central to all thinking beings, in everyday life and in reminiscing. Belief was not necessarily spiritual or a practised or verbalized religion. It was shown to be a way of understanding, a fundamental and single thread tying the individual's life and stories together. The benefits were the outcomes, in that knowledge of an individual's belief can optimize care planning for any age group, and/or setting. The strength of the study was the open question format and the feedback process of data verification. The unrestricted outcomes and non-specificity were significant in a world where dying is everybody's business.