Investigating human audio-visual object perception with a combination of hypothesis-generating and hypothesis-testing fMRI analysis tools

Primate multisensory object perception involves distributed brain regions. To investigate the network character of these regions of the human brain, we applied data-driven group spatial independent component analysis (ICA) to a functional magnetic resonance imaging (fMRI) data set acquired during a passive audio-visual (AV) experiment with common object stimuli. We labeled three group-level independent component (IC) maps as auditory (A), visual (V), and AV, based on their spatial layouts and activation time courses. The overlap between these IC maps served as definition of a distributed network of multisensory candidate regions including superior temporal, ventral occipito-temporal, posterior parietal and prefrontal regions. During an independent second fMRI experiment, we explicitly tested their involvement in AV integration. Activations in nine out of these twelve regions met the max-criterion (A < AV > V) for multisensory integration. Comparison of this approach with a general linear model-based region-of-interest definition revealed its complementary value for multisensory neuroimaging. In conclusion, we estimated functional networks of uni- and multisensory functional connectivity from one dataset and validated their functional roles in an independent dataset. These findings demonstrate the particular value of ICA for multisensory neuroimaging research and using independent datasets to test hypotheses generated from a data-driven analysis.

Perception of co-speech gestures in aphasic patients: A visual exploration study during the observation of dyadic conversations.

BACKGROUND Co-speech gestures are part of nonverbal communication during conversations. They either support the verbal message or provide the interlocutor with additional information. Furthermore, they prompt as nonverbal cues the cooperative process of turn taking. In the present study, we investigated the influence of co-speech gestures on the perception of dyadic dialogue in aphasic patients. In particular, we analysed the impact of co-speech gestures on gaze direction (towards speaker or listener) and fixation of body parts. We hypothesized that aphasic patients, who are restricted in verbal comprehension, adapt their visual exploration strategies. METHODS Sixteen aphasic patients and 23 healthy control subjects participated in the study. Visual exploration behaviour was measured by means of a contact-free infrared eye-tracker while subjects were watching videos depicting spontaneous dialogues between two individuals. Cumulative fixation duration and mean fixation duration were calculated for the factors co-speech gesture (present and absent), gaze direction (to the speaker or to the listener), and region of interest (ROI), including hands, face, and body. RESULTS Both aphasic patients and healthy controls mainly fixated the speaker's face. We found a significant co-speech gesture × ROI interaction, indicating that the presence of a co-speech gesture encouraged subjects to look at the speaker. Further, there was a significant gaze direction × ROI × group interaction revealing that aphasic patients showed reduced cumulative fixation duration on the speaker's face compared to healthy controls. CONCLUSION Co-speech gestures guide the observer's attention towards the speaker, the source of semantic input. It is discussed whether an underlying semantic processing deficit or a deficit to integrate audio-visual information may cause aphasic patients to explore less the speaker's face.

Perception of co-speech gestures in aphasic patients: A visual exploration study during the observation of dyadic conversations

Background: Co-speech gestures are part of nonverbal communication during conversations. They either support the verbal message or provide the interlocutor with additional information. Furthermore, they prompt as nonverbal cues the cooperative process of turn taking. In the present study, we investigated the influence of co-speech gestures on the perception of dyadic dialogue in aphasic patients. In particular, we analysed the impact of co-speech gestures on gaze direction (towards speaker or listener) and fixation of body parts. We hypothesized that aphasic patients, who are restricted in verbal comprehension, adapt their visual exploration strategies. Methods: Sixteen aphasic patients and 23 healthy control subjects participated in the study. Visual exploration behaviour was measured by means of a contact-free infrared eye-tracker while subjects were watching videos depicting spontaneous dialogues between two individuals. Cumulative fixation duration and mean fixation duration were calculated for the factors co-speech gesture (present and absent), gaze direction (to the speaker or to the listener), and region of interest (ROI), including hands, face, and body. Results: Both aphasic patients and healthy controls mainly fixated the speaker’s face. We found a significant co-speech gesture x ROI interaction, indicating that the presence of a co-speech gesture encouraged subjects to look at the speaker. Further, there was a significant gaze direction x ROI x group interaction revealing that aphasic patients showed reduced cumulative fixation duration on the speaker’s face compared to healthy controls. Conclusion: Co-speech gestures guide the observer’s attention towards the speaker, the source of semantic input. It is discussed whether an underlying semantic processing deficit or a deficit to integrate audio-visual information may cause aphasic patients to explore less the speaker’s face. Keywords: Gestures, visual exploration, dialogue, aphasia, apraxia, eye movements

Unmasking the contribution of low-level features to the guidance of attention

The role of low-level stimulus-driven control in the guidance of overt visual attention has been difficult to establish because low- and high-level visual content are spatially correlated within natural visual stimuli. Here we show that impairment of parietal cortical areas, either permanently by a lesion or reversibly by repetitive transcranial magnetic stimulation (rTMS), leads to fixation of locations with higher values of low-level features as compared to control subjects or in a no-rTMS condition. Moreover, this unmasking of stimulus-driven control crucially depends on the intrahemispheric balance between top-down and bottom-up cortical areas. This result suggests that although in normal behavior high-level features might exert a strong influence, low-level features do contribute to guide visual selection during the exploration of complex natural stimuli.

Internet video telephony allows speech reading by deaf individuals and improves speech perception by cochlear implant users

OBJECTIVE To analyze speech reading through Internet video calls by profoundly hearing-impaired individuals and cochlear implant (CI) users. METHODS Speech reading skills of 14 deaf adults and 21 CI users were assessed using the Hochmair Schulz Moser (HSM) sentence test. We presented video simulations using different video resolutions (1280 × 720, 640 × 480, 320 × 240, 160 × 120 px), frame rates (30, 20, 10, 7, 5 frames per second (fps)), speech velocities (three different speakers), webcameras (Logitech Pro9000, C600 and C500) and image/sound delays (0-500 ms). All video simulations were presented with and without sound and in two screen sizes. Additionally, scores for live Skype™ video connection and live face-to-face communication were assessed. RESULTS Higher frame rate (>7 fps), higher camera resolution (>640 × 480 px) and shorter picture/sound delay (<100 ms) were associated with increased speech perception scores. Scores were strongly dependent on the speaker but were not influenced by physical properties of the camera optics or the full screen mode. There is a significant median gain of +8.5%pts (p = 0.009) in speech perception for all 21 CI-users if visual cues are additionally shown. CI users with poor open set speech perception scores (n = 11) showed the greatest benefit under combined audio-visual presentation (median speech perception +11.8%pts, p = 0.032). CONCLUSION Webcameras have the potential to improve telecommunication of hearing-impaired individuals.

Comparing three CPR feedback devices and standard BLS in a single rescuer scenario: a randomised simulation study

BACKGROUND Efficiently performed basic life support (BLS) after cardiac arrest is proven to be effective. However, cardiopulmonary resuscitation (CPR) is strenuous and rescuers' performance declines rapidly over time. Audio-visual feedback devices reporting CPR quality may prevent this decline. We aimed to investigate the effect of various CPR feedback devices on CPR quality. METHODS In this open, prospective, randomised, controlled trial we compared three CPR feedback devices (PocketCPR, CPRmeter, iPhone app PocketCPR) with standard BLS without feedback in a simulated scenario. 240 trained medical students performed single rescuer BLS on a manikin for 8min. Effective compression (compressions with correct depth, pressure point and sufficient decompression) as well as compression rate, flow time fraction and ventilation parameters were compared between the four groups. RESULTS Study participants using the PocketCPR performed 17±19% effective compressions compared to 32±28% with CPRmeter, 25±27% with the iPhone app PocketCPR, and 35±30% applying standard BLS (PocketCPR vs. CPRmeter p=0.007, PocketCPR vs. standard BLS p=0.001, others: ns). PocketCPR and CPRmeter prevented a decline in effective compression over time, but overall performance in the PocketCPR group was considerably inferior to standard BLS. Compression depth and rate were within the range recommended in the guidelines in all groups. CONCLUSION While we found differences between the investigated CPR feedback devices, overall BLS quality was suboptimal in all groups. Surprisingly, effective compression was not improved by any CPR feedback device compared to standard BLS. All feedback devices caused substantial delay in starting CPR, which may worsen outcome.

Finding a voice - Nollywood inspired filmmaking practices in Switzerland

Under the name Nollywood a unique video film industry has developed in Nigeria in the last few decades, which now forms one of the world’s biggest entertainment industries. With its focus on stories reflecting „the values, desires and fears” (Haynes 2007: 133) of African viewers and its particular way of production, Nollywood brings „lived practices and its representation together in ways that make the films deeply accessible and entirely familiar to their audience“ (Marston et al. 2007: 57). In doing so, Nollywood shows its spectators new postcolonial forms of performative self‐expression and becomes a point of reference for a wide range of people. However, Nollywood not only excites a large number of viewers inside and outside Nigeria, it also inspires some of them to become active themselves and make their own films. This effect of Nigerian filmmaking can be found in many parts of sub‐Saharan Africa as well as in African diasporas all over the world – including Switzerland (Mooser 2011: 63‐66). As a source of inspiration, Nollywood and its unconventional ways of filmmaking offer African migrants a benchmark that meets their wish to express themselves as minority group in a foreign country. As Appadurai (1996: 53), Ginsburg (2003: 78) and Marks (2000: 21) assume, filmmakers with a migratory background have a specific need to express themselves through media. As minority group members in their country of residence they not only wish to reflect upon their situation within the diaspora and illustrate their everyday struggles as foreigners, but to also express their own views and ideas in order to challenge dominant public opinion (Ginsburg 2003: 78). They attempt to “talk back to the structures of power” (2003: 78) they live in. In this process, their audio-visual works become a means of response and “an answering echo to a previous presentation or representation” (Mitchell 1994: 421). The American art historian Mitchell, therefore, suggests interpreting representation as “the relay mechanism in exchange of power, value, and publicity” (1994: 420). This desire of interacting with the local public has also been expressed during a film project of African, mainly Nigerian, first-generation migrants in Switzerland I am currently partnering in. Several cast and crew members have expressed feelings of being under-represented, even misrepresented, in the dominant Swiss media discourse. In order to create a form of exchange and give themselves a voice, they consequently produce a Nollywood inspired film and wish to present it to the society they live in. My partnership in this on‐going film production (which forms the foundation of my PhD field study) allows me to observe and experience this process. By employing qualitative media anthropological methods and in particular Performance Ethnography, I seek to find out more about the ways African migrants represent themselves as a community through audio‐visual media and the effect the transnational use of Nollywood has on their form of self‐representations as well as the ways they express themselves.

Short structured feedback training is equivalent to a mechanical feedback device in two-rescuer BLS: a randomised simulation study.

BACKGROUND Resuscitation guidelines encourage the use of cardiopulmonary resuscitation (CPR) feedback devices implying better outcomes after sudden cardiac arrest. Whether effective continuous feedback could also be given verbally by a second rescuer ("human feedback") has not been investigated yet. We, therefore, compared the effect of human feedback to a CPR feedback device. METHODS In an open, prospective, randomised, controlled trial, we compared CPR performance of three groups of medical students in a two-rescuer scenario. Group "sCPR" was taught standard BLS without continuous feedback, serving as control. Group "mfCPR" was taught BLS with mechanical audio-visual feedback (HeartStart MRx with Q-CPR-Technology™). Group "hfCPR" was taught standard BLS with human feedback. Afterwards, 326 medical students performed two-rescuer BLS on a manikin for 8 min. CPR quality parameters, such as "effective compression ratio" (ECR: compressions with correct hand position, depth and complete decompression multiplied by flow-time fraction), and other compression, ventilation and time-related parameters were assessed for all groups. RESULTS ECR was comparable between the hfCPR and the mfCPR group (0.33 vs. 0.35, p = 0.435). The hfCPR group needed less time until starting chest compressions (2 vs. 8 s, p < 0.001) and showed fewer incorrect decompressions (26 vs. 33 %, p = 0.044). On the other hand, absolute hands-off time was higher in the hfCPR group (67 vs. 60 s, p = 0.021). CONCLUSIONS The quality of CPR with human feedback or by using a mechanical audio-visual feedback device was similar. Further studies should investigate whether extended human feedback training could further increase CPR quality at comparable costs for training.

Core networks for visual-concrete and abstract thought content: a brain electric microstate analysis

Commonality of activation of spontaneously forming and stimulus-induced mental representations is an often made but rarely tested assumption in neuroscience. In a conjunction analysis of two earlier studies, brain electric activity during visual-concrete and abstract thoughts was studied. The conditions were: in study 1, spontaneous stimulus-independent thinking (post-hoc, visual imagery or abstract thought were identified); in study 2, reading of single nouns ranking high or low on a visual imagery scale. In both studies, subjects' tasks were similar: when prompted, they had to recall the last thought (study 1) or the last word (study 2). In both studies, subjects had no instruction to classify or to visually imagine their thoughts, and accordingly were not aware of the studies' aim. Brain electric data were analyzed into functional topographic brain images (using LORETA) of the last microstate before the prompt (study 1) and of the word-type discriminating event-related microstate after word onset (study 2). Conjunction analysis across the two studies yielded commonality of activation of core networks for abstract thought content in left anterior superior regions, and for visual-concrete thought content in right temporal-posterior inferior regions. The results suggest that two different core networks are automatedly activated when abstract or visual-concrete information, respectively, enters working memory, without a subject task or instruction about the two classes of information, and regardless of internal or external origin, and of input modality. These core machineries of working memory thus are invariant to source or modality of input when treating the two types of information.

Content comparison of health status measures for obesity based on the international classification of functioning, disability and health

OBJECTIVE: To compare the content covered by twelve obesity-specific health status measures using the International Classification of Functioning, Disability and Health (ICF). DESIGN: Obesity-specific health status measures were identified and then linked to the ICF separately by two trained health professionals according to standardized guidelines. The degree of agreement between health professionals was calculated by means of the kappa (kappa) statistic. Bootstrapped confidence intervals (CI) were calculated. The obesity-specific health-status measures were compared on the component and category level of the ICF. MEASUREMENTS: welve condition-specific health-status measures were identified and included in this study, namely the obesity-related problem scale, the obesity eating problems scale, the obesity-related coping and obesity-related distress questionnaire, the impact of weight on quality of life questionnaire (short version), the health-related quality of life questionnaire, the obesity adjustment survey (short form), the short specific quality of life scale, the obesity-related well-being questionnaire, the bariatric analysis and reporting outcome system, the bariatric quality of life index, the obesity and weight loss quality of life questionnaire and the weight-related symptom measure. RESULTS: In the 280 items of the eight measures, a total of 413 concepts were identified and linked to the 87 different ICF categories. The measures varied strongly in the number of concepts contained and the number of ICF categories used to map these concepts. Items on body functions varied form 12% in the obesity-related problem scale to 95% in the weight-related symptom measure. The estimated kappa coefficients ranged between 0.79 (CI: 0.72, 0.86) at the component ICFs level and 0.97 (CI: 0.93, 1.0) at the third ICF's level. CONCLUSION: The ICF proved highly useful for the content comparison of obesity-specific health-status measures. The results may provide clinicians and researchers with new insights when selecting health-status measures for clinical studies in obesity.

Classification of organisms previously reported as the SP and Stewart-Letscher groups, with descriptions of Necropsobacter gen. nov. and of Necropsobacter rosorum sp. nov. for organisms of the SP group

To allow classification of bacteria previously reported as the SP group and the Stewart-Letscher group, 35 isolates from rodents (21), rabbits (eight), a dog and humans (five) were phenotypically and genotypically characterized. Comparison of partial rpoB sequences showed that 34 of the isolates were closely related, demonstrating at least 97.4 % similarity. 16S rRNA gene sequence comparison of 20 selected isolates confirmed the monophyly of the SP group and revealed 98.5 %-100 % similarity between isolates. A blast search using the 16S rRNA gene sequences showed that the highest similarity outside the SP group was 95.5 % to an unclassified rat isolate. The single strain, P625, representing the Stewart-Letscher group showed the highest 16S rRNA gene similarity (94.9-95.5 %) to members of the SP group. recN gene sequence analysis of 11 representative strains resulted in similarities of 97-100 % among the SP group strains, which showed 80 % sequence similarity to the Stewart-Letscher group strain. Sequence similarity values based on the recN gene, indicative for whole genome similarity, showed the SP group being clearly separated from established genera, whereas the Stewart-Letscher group strain was associated with the SP group. A new genus, Necropsobacter gen. nov., with only one species, Necropsobacter rosorum sp. nov., is proposed to include all members of the SP group. The new genus can be separated from existing genera of the family Pasteurellaceae by at least three phenotypic characters. The most characteristic properties of the new genus are that haemolysis is not observed on bovine blood agar, positive reactions are observed in the porphyrin test, acid is produced from (+)-L-arabinose, (+)-D-xylose, dulcitol, (+)-D-galactose, (+)-D-mannose, maltose and melibiose, and negative reactions are observed for symbiotic growth, urease, ornithine decarboxylase and indole. Previous publications have documented that both ubiquinones and demethylmenaquinone were produced by the proposed type strain of the new genus, Michel A/76(T), and that the major polyamine of representative strains (type strain not included) of the genus is 1,3-diaminopropane, spermidine is present in moderate amounts and putrescine and spermine are detectable only in minor amounts. The major fatty acids of strain Michel A/76(T) are C(14 : 0), C(16 : 0), C(16:1)omega7c and summed feature C(14 : 0) 3-OH/iso-C(16 : 1) I. This fatty acid profile is typical for members of the family Pasteurellaceae. The G+C content of DNA of strain Michel A/76(T) was estimated to be 52.5 mol% in a previous investigation. The type strain is P709(T) ( = Michel A/76(T) = CCUG 28028(T) = CIP 110147(T) = CCM 7802(T)).

Visual histological grading system for the evaluation of in vitro-generated neocartilage

Here we present the development of a visual evaluation system for routine assessment of in vitro-engineered cartilaginous tissue. Neocartilage was produced by culturing human articular chondrocytes in pellet culture systems or in a scaffold-free bioreactor system. All engineered tissues were embedded in paraffin and were sectioned and stained with Safranin O-fast green. The evaluation of each sample was broken into 3 categories (uniformity and intensity of Safranin O stain, distance between cells/amount of matrix produced, and cell morphology), and each category had 4 components with a score ranging from 0 to 3. Three observers evaluated each sample, and the new system was independently tested against an objective computer-based histomorphometry system. Pellets were also assessed biochemically for glycosaminoglycan (GAG) content. Pellet histology scores correlated significantly with GAG contents and were in agreement with the computer-based histomorphometry system. This system allows a valid and rapid assessment of in vitro-generated cartilaginous tissue that has a relevant association with objective parameters indicative of cartilage quality.

Content comparison of health-related quality of life instruments for COPD

BACKGROUND: Due to the increasing importance of quality of life assessments in chronic obstructive pulmonary disease (COPD) patients, and the increased use of the International Classification of Functioning, Disability and Health (ICF) for comparative purposes it is essential to understand the relationship between health-related quality of life (HRQL) instruments and the ICF. OBJECTIVE: The objective of this study was to compare the content of recommended COPD-specific HRQL instruments using the ICF as reference. COPD-specific instruments mentioned in widely accepted guidelines were linked to the ICF using standardized linking rules. The degree of agreement between various health professionals was assessed by calculating the kappa statistic. RESULTS: Eleven instruments were included. They varied strongly in the number of concepts contained and the number of ICF categories used to map these concepts. A total of 548 concepts were identified and linked to 60 different ICF categories. Only the single category 'dyspnea' was covered by all instruments, whilst 21 categories were unique to specific instruments. The relationships of the measures with the ICF were identified. CONCLUSIONS: This study may aid researchers and clinicians to choose the most appropriate instrument for a specific purpose as well as help compare studies that have used different instruments for HRQL assessment.