Building Autonomous Sensitive Artificial Listeners

This paper describes a substantial effort to build a real-time interactive multimodal dialogue system with a focus on emotional and non-verbal interaction capabilities. The work is motivated by the aim to provide technology with competences in perceiving and producing the emotional and non-verbal behaviours required to sustain a conversational dialogue. We present the Sensitive Artificial Listener (SAL) scenario as a setting which seems particularly suited for the study of emotional and non- verbal behaviour, since it requires only very limited verbal understanding on the part of the machine. This scenario allows us to concentrate on non-verbal capabilities without having to address at the same time the challenges of spoken language understanding, task modeling etc. We first report on three prototype versions of the SAL scenario, in which the behaviour of the Sensitive Artificial Listener characters was determined by a human operator. These prototypes served the purpose of verifying the effectiveness of the SAL scenario and allowed us to collect data required for building system components for analysing and synthesising the respective behaviours. We then describe the fully autonomous integrated real-time system we created, which combines incremental analysis of user behaviour, dialogue management, and synthesis of speaker and listener behaviour of a SAL character displayed as a virtual agent. We discuss principles that should underlie the evaluation of SAL-type systems. Since the system is designed for modularity and reuse, and since it is publicly available, the SAL system has potential as a joint research tool in the affective computing research community.

Computer simulations of seasonal outbreak and diurnal vertical migration of cyanobacteria

Algal blooms caused by cyanobacteria are characterized by two features with different time scales: one is seasonal outbreak and collapse of a bloom and the other is diurnal vertical migration. Our two-component mathematical model can simulate both phenomena, in which the state variables are nutrients and cyanobacteria. The model is a set of one-dimensional reaction-advection-diffusion equations, and temporal changes of these two variables are regulated by the following five factors: (1) annual variation of light intensity, (2) diurnal variation of light intensity, (3) annual variation of water temperature, (4) thermal stratification within a water column and (5) the buoyancy regulation mechanism. The seasonal change of cyanobacteria biomass is mainly controlled by factors, (1), (3) and (4), among which annual variations of light intensity and water temperature directly affect the maximum growth rate of cyanobacteria. The latter also contributes to formation of the thermocline during the summer season. Thermal stratification causes a reduction in vertical diffusion and largely prevents mixing of both nutrients and cyanobacteria between the epilimnion and the hypolimnion. Meanwhile, the other two factors, (2) and (5), play a significant role in diurnal vertical migration of cyanobacteria. A key mechanism of vertical migration is buoyancy regulation due to gas-vesicle synthesis and ballast formation, by which a quick reversal between floating and sinking becomes possible within a water column. The mechanism of bloom formation controlled by these five factors is integrated into the one-dimensional model consisting of two reaction-advection-diffusion equations.

Mesophases in Nearly 2D Room-Temperature Ionic Liquids

Computer simulations of (i) a [C(12)mim][Tf2N] film of nanometric thickness squeezed at kbar pressure by a piecewise parabolic confining potential reveal a mesoscopic in-plane density and composition modulation reminiscent of mesophases seen in 3D samples of the same room-temperature ionic liquid (RTIL). Near 2D confinement, enforced by a high normal load, as well as relatively long aliphatic chains are strictly required for the mesophase formation, as confirmed by computations for two related systems made of (ii) the same [C(12)mim][Tf2N] adsorbed at a neutral solid surface and (iii) a shorter-chain RTIL ([C(4)mim][Tf2N]) trapped in the potential well of part i. No in-plane modulation is seen for ii and iii. In case ii, the optimal arrangement of charge and neutral tails is achieved by layering parallel to the surface, while, in case iii, weaker dispersion and packing interactions are unable to bring aliphatic tails together into mesoscopic islands, against overwhelming entropy and Coulomb forces. The onset of in-plane mesophases could greatly affect the properties of long-chain RTILs used as lubricants.

Interview with Paul DeMarinis

Since the early 1970s, the American electronic media artist Paul DeMarinis (b. 1948, Cleveland, Ohio, USA) has created works that re-imagine modes of communication and reinvent the technologies that enable communication. His works (see Table 1) have taken shape as recordings, performances, electronic inventions, and site-specific and interactive installations; many are considered landmarks in the histories of electronic music and media art. Paul DeMarinis pioneered live performance with computers, collaborated on landmark works with artists like David Tudor and Robert Ashley, undertook several tours with the Merce Cunningham Dance Company, and brought to life obscure technologies such as the flame loudspeaker (featured in his 2004 sculpture Firebirds). His interactive installation The Music Room (1982), commissioned by Frank Oppenheimer for the Exploratorium in San Francisco, was the first automatic music work to reach a significant audience. His album Music As A Second Language (1991) marks one of the most extensive explorations of the synthesized voice and speech melodies to date. Installations like The Edison Effect (1989-1993), in which lasers scan ancient recordings to produce music, and The Messenger (1998/2005), in which electronic mail messages are displayed on alphabetic telegraph receivers, illustrate a creative process that Douglas Kahn (1994) has called "reinventing invention." [etc]

Computer-assisted pathological immunohistochemistry scoring is more time-effective than conventional scoring, but provides no analytical advantage

Computer-assisted pathological immunohistochemistry scoring is more time-effective than conventional scoring, but provides no analytical advantage