Is it me? Self-recognition bias across sensory modalities and its relationship to autistic traits

Background Atypical self-processing is an emerging theme in autism research, suggested by lower self-reference effect in memory, and atypical neural responses to visual self-representations. Most research on physical self-processing in autism uses visual stimuli. However, the self is a multimodal construct, and therefore, it is essential to test self-recognition in other sensory modalities as well. Self-recognition in the auditory modality remains relatively unexplored and has not been tested in relation to autism and related traits. This study investigates self-recognition in auditory and visual domain in the general population and tests if it is associated with autistic traits. Methods Thirty-nine neurotypical adults participated in a two-part study. In the first session, individual participant’s voice was recorded and face was photographed and morphed respectively with voices and faces from unfamiliar identities. In the second session, participants performed a ‘self-identification’ task, classifying each morph as ‘self’ voice (or face) or an ‘other’ voice (or face). All participants also completed the Autism Spectrum Quotient (AQ). For each sensory modality, slope of the self-recognition curve was used as individual self-recognition metric. These two self-recognition metrics were tested for association between each other, and with autistic traits. Results Fifty percent ‘self’ response was reached for a higher percentage of self in the auditory domain compared to the visual domain (t = 3.142; P < 0.01). No significant correlation was noted between self-recognition bias across sensory modalities (τ = −0.165, P = 0.204). Higher recognition bias for self-voice was observed in individuals higher in autistic traits (τ AQ = 0.301, P = 0.008). No such correlation was observed between recognition bias for self-face and autistic traits (τ AQ = −0.020, P = 0.438). Conclusions Our data shows that recognition bias for physical self-representation is not related across sensory modalities. Further, individuals with higher autistic traits were better able to discriminate self from other voices, but this relation was not observed with self-face. A narrow self-other overlap in the auditory domain seen in individuals with high autistic traits could arise due to enhanced perceptual processing of auditory stimuli often observed in individuals with autism.

Should healthy eating programmes incorporate interaction with foods in different sensory modalities? A review of the evidence

Commercial interventions seeking to promote fruit and vegetable consumption by encouraging preschool- and school-aged children to engage with foods with ‘all their senses’ are increasing in number. We review the efficacy of such sensory interaction programmes and consider the components of these that are likely to encourage food acceptance. Repeated exposure to a food's flavour has robust empirical support in terms of its potential to increase food intake. However, children are naturally reluctant to taste new or disliked foods, and parents often struggle to provide sufficient taste opportunities for these foods to be adopted into the child's diet. We therefore explore whether prior exposure to a new food's non-taste sensory properties, such as its smell, sound, appearance or texture, might facilitate the food's introduction into the child's diet, by providing the child with an opportunity to become partially familiar with the food without invoking the distress associated with tasting it. We review the literature pertaining to the benefits associated with exposure to foods through each of the five sensory modalities in turn. We conclude by calling for further research into the potential for familiarisation with the visual, olfactory, somaesthetic and auditory properties of foods to enhance children's willingness to consume a variety of fruits and vegetables.

Multi-modal fingerprinting for multimedia assets: optimisation of media security protection in online distribution environments

Since the advent of the internet in every day life in the 1990s, the barriers to producing, distributing and consuming multimedia data such as videos, music, ebooks, etc. have steadily been lowered for most computer users so that almost everyone with internet access can join the online communities who both produce, consume and of course also share media artefacts. Along with this trend, the violation of personal data privacy and copyright has increased with illegal file sharing being rampant across many online communities particularly for certain music genres and amongst the younger age groups. This has had a devastating effect on the traditional media distribution market; in most cases leaving the distribution companies and the content owner with huge financial losses. To prove that a copyright violation has occurred one can deploy fingerprinting mechanisms to uniquely identify the property. However this is currently based on only uni-modal approaches. In this paper we describe some of the design challenges and architectural approaches to multi-modal fingerprinting currently being examined for evaluation studies within a PhD research programme on optimisation of multi-modal fingerprinting architectures. Accordingly we outline the available modalities that are being integrated through this research programme which aims to establish the optimal architecture for multi-modal media security protection over the internet as the online distribution environment for both legal and illegal distribution of media products.

Multi-level Input Fusion in multi-modal systems

Context-aware multimodal interactive systems aim to adapt to the needs and behavioural patterns of users and offer a way forward for enhancing the efficacy and quality of experience (QoE) in human-computer interaction. The various modalities that constribute to such systems each provide a specific uni-modal response that is integratively presented as a multi-modal interface capable of interpretation of multi-modal user input and appropriately responding to it through dynamically adapted multi-modal interactive flow management , This paper presents an initial background study in the context of the first phase of a PhD research programme in the area of optimisation of data fusion techniques to serve multimodal interactivite systems, their applications and requirements.

Implicit and explicit processes in a second-language learning task

Two experiments examined the learning of a set of Greek pronunciation rules through explicit and implicit modes of rule presentation. Experiment 1 compared the effectiveness of implicit and explicit modes of presentation in two modalities, visual and auditory. Subjects in the explicit or rule group were presented with the rule set, and those in the implicit or natural group were shown a set of Greek words, composed of letters from the rule set, linked to their pronunciations. Subjects learned the Greek words to criterion and were then given a series of tests which aimed to tap different types of knowledge. The results showed an advantage of explicit study of the rules. In addition, an interaction was found between mode of presentation and modality. Explicit instruction was more effective in the visual than in the auditory modality, whereas there was no modality effect for implicit instruction. Experiment 2 examined a possible reason for the advantage of the rule groups by comparing different combinations of explicit and implicit presentation in the study and learning phases. The results suggested that explicit presentation of the rules is only beneficial when it is followed by practice at applying them.

The United Nations and the African Union: Assessing a partnership for peace in Darfur

In Resolution 1556, the Security Council, with the conflict in Darfur clearly in mind, determined that the ‘situation in Sudan constitutes a threat to international peace and security and to stability in the region’. This article focuses on the response by the United Nations, in particular the Security Council, and the African Union to the Darfur conflict. It begins by exploring the role of peacekeeping operations and regional arrangements or agencies in the overarching architecture of international peace and security. Having laid this frame of reference, it then looks at the modalities of peacekeeping in Darfur. These operations began with the African Union acting in isolation but have transitioned to an increasingly important role being played by the United Nations and a hybrid peacekeeping presence. Finally, this article asks whether, assuming that a legally dispositive conclusion can be drawn that genocide has taken place in Darfur since the outbreak of hostilities there in 2003, there exists a legal justification, or even obligation, for non-compliance by states with the sanctions regime established by Security Council Resolutions 1556 and 1591. This regime of sanctions has played an important part in the Security Council's approach to Darfur but has been, unfortunately, left largely unexamined from the standpoint of international legality.

Flesh colour dominates consumer preference for chicken

Existing research investigating interactions between visual and oral sensory cues has tended to use model food systems. In contrast, this study compared product quality assessments of corn-fed and wheat-fed chicken products among persons recruited in Northern Ireland. Three approaches have been adopted to investigate the effect of colour upon consumer choice of chicken: sensory assessment under normal lighting; focus group discussion; and sensory assessment under controlled lighting conditions. Initial consumer sensory assessment indicated that wheat-fed chicken was perceived to be tenderer and to have a more intense flavour than that which was corn-fed. Qualitative enquiry discerned that this was because consumers perceived the yellow colour of corn-fed chicken negatively. Yellow-coloured corn-fed chicken was therefore again compared with wheat-fed chicken in terms of flavour, texture and overall liking with the flesh colour disguised by means of controlled lighting. Quality ratings for corn-fed chicken were more positive when the yellow flesh colour was disguised, with corn-fed chicken judged to be tenderer than wheat-fed chicken and more flavoursome. This study illustrates the importance of using a combination of methods to gain insight into interactions between different sensory modalities in consumer quality judgements and adds to previous research on the importance of colour upon consumer choice of real foods. (c) 2005 Elsevier Ltd. All rights reserved.

Reality monitoring and visual hallucinations in Parkinson's disease

Between 8 and 40% of Parkinson disease (PD) patients will have visual hallucinations (VHs) during the course of their illness. Although cognitive impairment has been identified as a risk factor for hallucinations, more specific neuropsychological deficits underlying such phenomena have not been established. Research in psychopathology has converged to suggest that hallucinations are associated with confusion between internal representations of events and real events (i.e. impaired-source monitoring). We evaluated three groups: 17 Parkinson's patients with visual hallucinations, 20 Parkinson's patients without hallucinations and 20 age-matched controls, using tests of visual imagery, visual perception and memory, including tests of source monitoring and recollective experience. The study revealed that Parkinson's patients with hallucinations appear to have intact visual imagery processes and spatial perception. However, there were impairments in object perception and recognition memory, and poor recollection of the encoding episode in comparison to both non-hallucinating Parkinson's patients and healthy controls. Errors were especially likely to occur when encoding and retrieval cues were in different modalities. The findings raise the possibility that visual hallucinations in Parkinson's patients could stem from a combination of faulty perceptual processing of environmental stimuli, and less detailed recollection of experience combined with intact image generation. (C) 2002 Elsevier Science Ltd. All fights reserved.

Multimodal semantic-associative collateral labelling and indexing of still images

A novel framework for multimodal semantic-associative collateral image labelling, aiming at associating image regions with textual keywords, is described. Both the primary image and collateral textual modalities are exploited in a cooperative and complementary fashion. The collateral content and context based knowledge is used to bias the mapping from the low-level region-based visual primitives to the high-level visual concepts defined in a visual vocabulary. We introduce the notion of collateral context, which is represented as a co-occurrence matrix, of the visual keywords, A collaborative mapping scheme is devised using statistical methods like Gaussian distribution or Euclidean distance together with collateral content and context-driven inference mechanism. Finally, we use Self Organising Maps to examine the classification and retrieval effectiveness of the proposed high-level image feature vector model which is constructed based on the image labelling results.

Reach and grasp therapy: effects of the Gentle/G System assessing sub-acute stroke whole-arm rehabilitation

This paper reports preliminary results of a reach and grasp study of robot mediated neurorehabilitation. These results are presented on a case-by-case basis and give a good indication of a positive effect of robot mediated therapy. The study investigated both reach and grasp assistance and although it is not possible to attribute the response to the benefits of providing assistance of both modalities the study is a good indicator that this strategy should be pursued. The paper also reports on the benefits of motivational queues such as exercise scores and on subject attitudes to the robot mediated therapy.

Generic control interface for networked haptic virtual environments

As Virtual Reality pushes the boundaries of the human computer interface new ways of interaction are emerging. One such technology is the integration of haptic interfaces (force-feedback devices) into virtual environments. This modality offers an improved sense of immersion to that achieved when relying only on audio and visual modalities. The paper introduces some of the technical obstacles such as latency and network traffic that need to be overcome for maintaining a high degree of immersion during haptic tasks. The paper describes the advantages of integrating haptic feedback into systems, and presents some of the technical issues inherent in a networked haptic virtual environment. A generic control interface has been developed to seamlessly mesh with existing networked VR development libraries.

Factors mediating the routinisation of e-learning within a traditional university education environment

Technology-enhanced or Computer Aided Learning (e-learning) can be institutionally integrated and supported by learning management systems or Virtual Learning Environments (VLEs) to offer efficiency gains, effectiveness and scalability of the e-leaning paradigm. However this can only be achieved through integration of pedagogically intelligent approaches and lesson preparation tools environment and VLE that is well accepted by both the students and teachers. This paper critically explores some of the issues relevant to scalable routinisation of e-learning at the tertiary level, typically first year university undergraduates, with the teaching of Relational Data Analysis (RDA), as supported by multimedia authoring, as a case study. The paper concludes that blended learning approaches which balance the deployment of e-learning with other modalities of learning delivery such as instructor–mediated group learning etc offer the most flexible and scalable route to e-learning but that this requires the graceful integration of platforms for multimedia production, distribution and delivery through advanced interactive spaces that provoke learner engagement and promote learning autonomy and group learning facilitated by a cooperative-creative learning environment that remains open to personal exploration of constructivist-constructionist pathways to learning.

Semantic-associative visual content labelling and retrieval: A multimodal approach

A novel framework referred to as collaterally confirmed labelling (CCL) is proposed, aiming at localising the visual semantics to regions of interest in images with textual keywords. Both the primary image and collateral textual modalities are exploited in a mutually co-referencing and complementary fashion. The collateral content and context-based knowledge is used to bias the mapping from the low-level region-based visual primitives to the high-level visual concepts defined in a visual vocabulary. We introduce the notion of collateral context, which is represented as a co-occurrence matrix of the visual keywords. A collaborative mapping scheme is devised using statistical methods like Gaussian distribution or Euclidean distance together with collateral content and context-driven inference mechanism. We introduce a novel high-level visual content descriptor that is devised for performing semantic-based image classification and retrieval. The proposed image feature vector model is fundamentally underpinned by the CCL framework. Two different high-level image feature vector models are developed based on the CCL labelling of results for the purposes of image data clustering and retrieval, respectively. A subset of the Corel image collection has been used for evaluating our proposed method. The experimental results to-date already indicate that the proposed semantic-based visual content descriptors outperform both traditional visual and textual image feature models. (C) 2007 Elsevier B.V. All rights reserved.

European Union: Shadow WTO agricultural domestic support notifications

The notification of the level of domestic support to the World Trade Organization (WTO) is intended to reflect compliance with obligations entered into at the time of the Uruguay Round. WTO members have often been slow to provide notification of domestic support levels. This makes the process of notification less useful as an indicator of the degree to which changes in policy have or have not benefited the trade system as a whole and exporting countries in particular. The notification of domestic support in the E.U. illustrates the value of a measure that reflects current policies and can therefore act as a basis for negotiation of further disciplines where these are necessary. The E.U. has made major changes in its Common Agricultural Policy (CAP) over the period since 1992 when the MacSharry reforms were implemented. Payments originally notified in the blue box (related to supply control) have over time been changed until in their present form they are unrelated to current production or price levels, and hence can satisfy the criteria for the green box. The E.U. has therefore much more latitude in trade talks to agree to reductions in the allowable trade-distorting support. This paper reproduced the E.U. notifications relating to 2003/04 and extends these with official statistics to the year 2006/07. It then projects forward the components of domestic support until the year 2013/14, based on forecasts of future production and estimates of policy parameters. The impact of a successful Doha Round is simulated, showing that the constraints envisaged in the WTO draft modalities document of May 19, 2008, would be binding by the year 2013, at about the time the next budget cycle in the E.U. starts. Without the Doha Round constraints, further reform might still happen for domestic reasons, but the framework provided by the WTO for domestic policy spending would be less relevant. In that case, much could hinge on the legitimacy of the Single Farm Payment system under the current rules governing the green box.

An introduction to medical imaging with coherent terahertz frequency radiation

Methods have recently been developed that make use of electromagnetic radiation at terahertz (THz) frequencies, the region of the spectrum between millimetre wavelengths and the infrared, for imaging purposes. Radiation at these wavelengths is non-ionizing and subject to far less Rayleigh scatter than visible or infrared wavelengths, making it suitable for medical applications. This paper introduces THz pulsed imaging and discusses its potential for in vivo medical applications in comparison with existing modalities.