A Cross-modal Approach for Karaoke Artifacts Correction

Karaoke singing is a popular form of entertainment in several parts of the world. Since this genre of performance attracts amateurs, the singing often has artifacts related to scale, tempo, and synchrony. We have developed an approach to correct these artifacts using cross-modal multimedia streams information. We first perform adaptive sampling on the user's rendition and then use the original singer's rendition as well as the video caption highlighting information in order to correct the pitch, tempo and the loudness. A method of analogies has been employed to perform this correction. The basic idea is to manipulate the user's rendition in a manner to make it as similar as possible to the original singing. A pre-processing step of noise removal due to feedback and huffing also helps improve the quality of the user's audio. The results are described in the paper which shows the effectiveness of this multimedia approach.

Multimedia psycho-educational interventions to support patient self-care in degenerative conditions: a realist review

Objective: Multimedia interventions are increasingly used to deliver information in order to promote self-care among patients with degenerative conditions. We carried out a realist review of the literature to investigate how the characteristics of multimedia psychoeducational interventions combine with the contexts in which they are introduced to help or hinder their effectiveness in supporting self-care for patients with degenerative conditions.

Method: Electronic databases (Medline, Science Direct, PSYCHinfo, EBSCO, and Embase) were searched in order to identify papers containing information on multimedia psychoeducational interventions. Using a realist review approach, we reviewed all relevant studies to identify theories that explained how the interventions work.

Results: Ten papers were included in the review. All interventions sought to promote self-care behaviors among participants. We examined the development and content of the multimedia interventions and the impact of patient motivation and of the organizational context of implementation. We judged seven studies to be methodologically weak. All completed studies showed small effects in favor of the intervention.

Significance of Results: Multimedia interventions may provide high-quality information in an accessible format, with the potential to promote self-care among patients with degenerative conditions, if the patient perceives the information as important and develops confidence about self-care. The evidence base is weak, so that research is needed to investigate effective modes of delivery at different resource levels. We recommend that developers consider how an intervention will reduce uncertainty and increase confidence in self-care, as well as the impact of the context in which it will be employed.

An Event Driven Fusion Approach for Enjoyment Recognition in Real-time

Social signals and interpretation of carried information is of high importance in Human Computer Interaction. Often used for affect recognition, the cues within these signals are displayed in various modalities. Fusion of multi-modal signals is a natural and interesting way to improve automatic classification of emotions transported in social signals. Throughout most present studies, uni-modal affect recognition as well as multi-modal fusion, decisions are forced for fixed annotation segments across all modalities. In this paper, we investigate the less prevalent approach of event driven fusion, which indirectly accumulates asynchronous events in all modalities for final predictions. We present a fusion approach, handling short-timed events in a vector space, which is of special interest for real-time applications. We compare results of segmentation based uni-modal classification and fusion schemes to the event driven fusion approach. The evaluation is carried out via detection of enjoyment-episodes within the audiovisual Belfast Story-Telling Corpus.