Non-visual and multisensory BCI systems: present and future

During the past decade, brain–computer interfaces (BCIs) have rapidly developed, both in technological and application domains. However, most of these interfaces rely on the visual modality. Only some research groups have been studying non-visual BCIs, primarily based on auditory and, sometimes, on somatosensory signals. These non-visual BCI approaches are especially useful for severely disabled patients with poor vision. From a broader perspective, multisensory BCIs may offer more versatile and user-friendly paradigms for control and feedback. This chapter describes current systems that are used within auditory and somatosensory BCI research. Four categories of noninvasive BCI paradigms are employed: (1) P300 evoked potentials, (2) steady-state evoked potentials, (3) slow cortical potentials, and (4) mental tasks. Comparing visual and non-visual BCIs, we propose and discuss different possible multisensory combinations, as well as their pros and cons. We conclude by discussing potential future research directions of multisensory BCIs and related research questions

Coding of visual space during motor preparation: approaching objects rapidly modulate corticospinal excitability in hand-centered coordinates

Defensive behaviors, such as withdrawing your hand to avoid potentially harmful approaching objects, rely on rapid sensorimotor transformations between visual and motor coordinates. We examined the reference frame for coding visual information about objects approaching the hand during motor preparation. Subjects performed a simple visuomanual task while a task-irrelevant distractor ball rapidly approached a location either near to or far from their hand. After the distractor ball appearance, single pulses of transcranial magnetic stimulation were delivered over the subject's primary motor cortex, eliciting motor evoked potentials (MEPs) in their responding hand. MEP amplitude was reduced when the ball approached near the responding hand, both when the hand was on the left and the right of the midline. Strikingly, this suppression occurred very early, at 70-80ms after ball appearance, and was not modified by visual fixation location. Furthermore, it was selective for approaching balls, since static visual distractors did not modulate MEP amplitude. Together with additional behavioral measurements, we provide converging evidence for automatic hand-centered coding of visual space in the human brain.

Reduced cortico-motor facilitation in a normal sample with high traits of autism

Recent research in social neuroscience proposes a link between mirror neuron system (MNS) and social cognition. The MNS has been proposed to be the neural mechanism underlying action recognition and intention understanding and more broadly social cognition. Pre-motor MNS has been suggested to modulate the motor cortex during action observation. This modulation results in an enhanced cortico-motor excitability reflected in increased motor evoked potentials (MEPs) at the muscle of interest during action observation. Anomalous MNS activity has been reported in the autistic population whose social skills are notably impaired. It is still an open question whether traits of autism in the normal population are linked to the MNS functioning. We measured TMS-induced MEPs in normal individuals with high and low traits of autism as measured by the autistic quotient (AQ), while observing videos of hand or mouth actions, static images of a hand or mouth or a blank screen. No differences were observed between the two while they observed a blank screen. However participants with low traits of autism showed significantly greater MEP amplitudes during observation of hand/mouth actions relative to static hand/mouth stimuli. In contrast, participants with high traits of autism did not show such a MEP amplitude difference between observation of actions and static stimuli. These results are discussed with reference to MNS functioning.

Early and late stimulus-evoked cortical hemodynamic responses provide insight into the neurogenic nature of neurovascular coupling

Understanding neurovascular coupling is a prerequisite for the interpretation of results obtained from modern neuroimaging techniques. This study investigated the hemodynamic and neural responses in rat somatosensory cortex elicited by 16 seconds electrical whisker stimuli. Hemodynamics were measured by optical imaging spectroscopy and neural activity by multichannel electrophysiology. Previous studies have suggested that the whisker-evoked hemodynamic response contains two mechanisms, a transient ‘backwards’ dilation of the middle cerebral artery, followed by an increase in blood volume localized to the site of neural activity. To distinguish between the mechanisms responsible for these aspects of the response, we presented whisker stimuli during normocapnia (‘control’), and during a high level of hypercapnia. Hypercapnia was used to ‘predilate’ arteries and thus possibly ‘inhibit’ aspects of the response related to the ‘early’ mechanism. Indeed, hemodynamic data suggested that the transient stimulus-evoked response was absent under hypercapnia. However, evoked neural responses were also altered during hypercapnia and convolution of the neural responses from both the normocapnic and hypercapnic conditions with a canonical impulse response function, suggested that neurovascular coupling was similar in both conditions. Although data did not clearly dissociate early and late vascular responses, they suggest that the neurovascular coupling relationship is neurogenic in origin.

Cholinergic modulation of intrinsic fibre-evoked excitatory transmission contains a nicotinic component in immature but not adult rat piriform cortex, in vitro

The piriform cortex (PC) is highly prone to epileptogenesis, particularly in immature animals, where decreased muscarinic modulation of PC intrinsic fibre excitatory neurotransmission is implicated as a likely cause. However, whether higher levels of acetylcholine (ACh) release occur in immature vs. adult PC remains unclear. We investigated this using in vitro extracellular electrophysiological recording techniques. Intrinsic fibre-evoked extracellular field potentials (EFPs) were recorded from layers II to III in PC brain slices prepared from immature (P14-18) and adult (P>40) rats. Adult and immature PC EFPs were suppressed by eserine (1muM) or neostigmine (1muM) application, with a greater suppression in immature ( approximately 40%) than adult ( approximately 30%) slices. Subsequent application of atropine (1muM) reversed EFP suppression, producing supranormal ( approximately 12%) recovery in adult slices, suggesting that suppression was solely muscarinic ACh receptor-mediated and that some 'basal' cholinergic 'tone' was present. Conversely, atropine only partially reversed anticholinesterase effects in immature slices, suggesting the presence of additional non-muscarinic modulation. Accordingly, nicotine (50muM) caused immature field suppression ( approximately 30%) that was further enhanced by neostigmine, whereas it had no effect on adult EFPs. Unlike atropine, nicotinic antagonists, mecamylamine and methyllycaconitine, induced immature supranormal field recovery ( approximately 20%) following anticholinesterase-induced suppression (with no effect on adult slices), confirming that basal cholinergic 'tone' was also present. We suggest that nicotinic inhibitory cholinergic modulation occurs in the immature rat PC intrinsic excitatory fibre system, possibly to complement the existing, weak muscarinic modulation, and could be another important developmentally regulated system governing immature PC susceptibility towards epileptogenesis.

The distinct contributions of age of acquisition and word frequency in auditory word perception

We report two studies of the distinct effects that a word's age of acquisition (AoA) and frequency have on the mental lexicon. In the first study, a purely statistical analysis, we show that AoA and frequency are related in different ways to the phonological form and imageability of different words. In the second study, three groups of participants (34 seven-year-olds, 30 ten-year-olds, and 17 adults) took part in an auditory lexical decision task, with stimuli varying in AoA, frequency, length, neighbourhood density, and imageability. The principal result is that the influence of these different variables changes as a function of AoA: Neighbourhood density effects are apparent for early and late AoA words, but not for intermediate AoA, whereas imageability effects are apparent for intermediate AoA words but not for early or late AoA. These results are discussed from the perspective that AoA affects a word's representation, but frequency affects processing biases.

The effect of colored lenses on the visual evoked response in children with visual stress

Purpose. Some children with visual stress and/or headaches have fewer symptoms when wearing colored lenses. Although subjective reports of improved perception exist, few objective correlates of these effects have been established. Methods. In a pilot study, 10 children who wore Intuitive Colorimeter lenses, and claimed benefit, and two asymptomatic children were tested. Steady-state potentials were measured in response to low contrast patterns modulating at a frequency of 12 Hz. Four viewing conditions were compared: 1) no lens; 2) Colorimeter lens; 3) lens of complementary color; and 4) spectrally neutral lens with similar photopic transmission. Results. The asymptomatic children showed little or no difference between the lens and no lens conditions. When all the symptomatic children were tested together, a similar result was found. However, when the symptomatic children were divided into two groups depending on their symptoms, an interaction emerged. Children with visual stress but no headaches showed the largest amplitude visual evoked potential response in the no lens condition, whereas those children whose symptoms included severe headaches or migraine showed the largest amplitude visual evoked potential response when wearing their prescribed lens. Conclusions. The results suggest that it is possible to measure objective correlates of the beneficial subjective perceptual effects of colored lenses, at least in some children who have a history of migraine or severe headaches.

Enhancing dominant modes in nonstationary time series by means of the symbolic resonance analysis

We present the symbolic resonance analysis (SRA) as a viable method for addressing the problem of enhancing a weakly dominant mode in a mixture of impulse responses obtained from a nonlinear dynamical system. We demonstrate this using results from a numerical simulation with Duffing oscillators in different domains of their parameter space, and by analyzing event-related brain potentials (ERPs) from a language processing experiment in German as a representative application. In this paradigm, the averaged ERPs exhibit an N400 followed by a sentence final negativity. Contemporary sentence processing models predict a late positivity (P600) as well. We show that the SRA is able to unveil the P600 evoked by the critical stimuli as a weakly dominant mode from the covering sentence final negativity. (c) 2007 American Institute of Physics. (c) 2007 American Institute of Physics.

Adaptive control of event integration: evidence from event-related potentials

We investigated whether it is possible to control the temporal window of attention used to rapidly integrate visual information. To study the underlying neural mechanisms, we recorded ERPs in an attentional blink task, known to elicit Lag-1 sparing. Lag-1 sparing fosters joint integration of the two targets, evidenced by increased order errors. Short versus long integration windows were induced by showing participants mostly fast or slow stimuli. Participants expecting slow speed used a longer integration window, increasing joint integration. Difference waves showed an early (200 ms post-T2) negative and a late positive modulation (390 ms) in the fast group, but not in the slow group. The modulations suggest the creation of a separate event for T2, which is not needed in the slow group, where targets were often jointly integrated. This suggests that attention can be guided by global expectations of presentation speed within tens of milliseconds.

The primary somatosensory cortex largely contributes to the early part of the cortical response elicited by nociceptive stimuli.

Research on the cortical sources of nociceptive laser-evoked brain potentials (LEPs) began almost two decades ago (Tarkka and Treede, 1993). Whereas there is a large consensus on the sources of the late part of the LEP waveform (N2 and P2 waves), the relative contribution of the primary somatosensory cortex (S1) to the early part of the LEP waveform (N1 wave) is still debated. To address this issue we recorded LEPs elicited by the stimulation of four limbs in a large population (n=35). Early LEP generators were estimated both at single-subject and group level, using three different approaches: distributed source analysis, dipolar source modeling, and probabilistic independent component analysis (ICA). We show that the scalp distribution of the earliest LEP response to hand stimulation was maximal over the central-parietal electrodes contralateral to the stimulated side, while that of the earliest LEP response to foot stimulation was maximal over the central-parietal midline electrodes. Crucially, all three approaches indicated hand and foot S1 areas as generators of the earliest LEP response. Altogether, these findings indicate that the earliest part of the scalp response elicited by a selective nociceptive stimulus is largely explained by activity in the contralateral S1, with negligible contribution from the secondary somatosensory cortex (S2).

Modulation of visually evoked cortical fMRI responses by phase of ongoing occipital alpha oscillations

Using simultaneous electroencephalography as a measure of ongoing activity and functional magnetic resonance imaging (fMRI) as a measure of the stimulus-driven neural response, we examined whether the amplitude and phase of occipital alpha oscillations at the onset of a brief visual stimulus affects the amplitude of the visually evoked fMRI response. When accounting for intrinsic coupling of alpha amplitude and occipital fMRI signal by modeling and subtracting pseudo-trials, no significant effect of prestimulus alpha amplitude on the evoked fMRI response could be demonstrated. Regarding the effect of alpha phase, we found that stimuli arriving at the peak of the alpha cycle yielded a lower blood oxygenation level-dependent (BOLD) fMRI response in early visual cortex (V1/V2) than stimuli presented at the trough of the cycle. Our results therefore show that phase of occipital alpha oscillations impacts the overall strength of a visually evoked response, as indexed by the BOLD signal. This observation complements existing evidence that alpha oscillations reflect periodic variations in cortical excitability and suggests that the phase of oscillations in postsynaptic potentials can serve as a mechanism of gain control for incoming neural activity. Finally, our findings provide a putative neural basis for observations of alpha phase dependence of visual perceptual performance.

Analysis of the variability of auditory brainstem response components through linear regression

(ABR) is of fundamental importance to the investiga- tion of the auditory system behavior, though its in- terpretation has a subjective nature because of the manual process employed in its study and the clinical experience required for its analysis. When analyzing the ABR, clinicians are often interested in the identi- fication of ABR signal components referred to as Jewett waves. In particular, the detection and study of the time when these waves occur (i.e., the wave la- tency) is a practical tool for the diagnosis of disorders affecting the auditory system. In this context, the aim of this research is to compare ABR manual/visual analysis provided by different examiners. Methods: The ABR data were collected from 10 normal-hearing subjects (5 men and 5 women, from 20 to 52 years). A total of 160 data samples were analyzed and a pair- wise comparison between four distinct examiners was executed. We carried out a statistical study aiming to identify significant differences between assessments provided by the examiners. For this, we used Linear Regression in conjunction with Bootstrap, as a me- thod for evaluating the relation between the responses given by the examiners. Results: The analysis sug- gests agreement among examiners however reveals differences between assessments of the variability of the waves. We quantified the magnitude of the ob- tained wave latency differences and 18% of the inves- tigated waves presented substantial differences (large and moderate) and of these 3.79% were considered not acceptable for the clinical practice. Conclusions: Our results characterize the variability of the manual analysis of ABR data and the necessity of establishing unified standards and protocols for the analysis of these data. These results may also contribute to the validation and development of automatic systems that are employed in the early diagnosis of hearing loss.

Assessment of inter-examiner agreement and variability in the manual classification of auditory brainstem response

Abstract Background: The analysis of the Auditory Brainstem Response (ABR) is of fundamental importance to the investigation of the auditory system behaviour, though its interpretation has a subjective nature because of the manual process employed in its study and the clinical experience required for its analysis. When analysing the ABR, clinicians are often interested in the identification of ABR signal components referred to as Jewett waves. In particular, the detection and study of the time when these waves occur (i.e., the wave latency) is a practical tool for the diagnosis of disorders affecting the auditory system. Significant differences in inter-examiner results may lead to completely distinct clinical interpretations of the state of the auditory system. In this context, the aim of this research was to evaluate the inter-examiner agreement and variability in the manual classification of ABR. Methods: A total of 160 ABR data samples were collected, for four different stimulus intensity (80dBHL, 60dBHL, 40dBHL and 20dBHL), from 10 normal-hearing subjects (5 men and 5 women, from 20 to 52 years). Four examiners with expertise in the manual classification of ABR components participated in the study. The Bland-Altman statistical method was employed for the assessment of inter-examiner agreement and variability. The mean, standard deviation and error for the bias, which is the difference between examiners’ annotations, were estimated for each pair of examiners. Scatter plots and histograms were employed for data visualization and analysis. Results: In most comparisons the differences between examiner’s annotations were below 0.1 ms, which is clinically acceptable. In four cases, it was found a large error and standard deviation (>0.1 ms) that indicate the presence of outliers and thus, discrepancies between examiners. Conclusions: Our results quantify the inter-examiner agreement and variability of the manual analysis of ABR data, and they also allows for the determination of different patterns of manual ABR analysis.

Property loss potentials for European midlatitude storms in a changing climate

Winter storms of the midlatitudes are an important factor for property losses caused by natural hazards over Europe. The storm series in early 1990 and late 1999 led to enormous economic damages and insured claims. Although significant trends in North Atlantic/European storm activity have not been identified for the last few decades, recent studies provide evidence that under anthropogenic climate change the number of extreme storms could increase, whereas the total number of cyclones may be slightly reduced. In this study, loss potentials derived from an ensemble of climate models using a simple storm damage model under climate change conditions are shown. For the United Kingdom and Germany ensemble-mean storm-related losses are found to increase by up to 37%. Furthermore, the interannual variability of extreme events will increase leading to a higher risk of extreme storm activity and related losses.

Balanced excitation and inhibition: Model based analysis of local field potentials

We have developed a model of the local field potential (LFP) based on the conservation of charge, the independence principle of ionic flows and the classical Hodgkin–Huxley (HH) type intracellular model of synaptic activity. Insights were gained through the simulation of the HH intracellular model on the nonlinear relationship between the balance of synaptic conductances and that of post-synaptic currents. The latter is dependent not only on the former, but also on the temporal lag between the excitatory and inhibitory conductances, as well as the strength of the afferent signal. The proposed LFP model provides a method for decomposing the LFP recordings near the soma of layer IV pyramidal neurons in the barrel cortex of anaesthetised rats into two highly correlated components with opposite polarity. The temporal dynamics and the proportional balance of the two components are comparable to the excitatory and inhibitory post-synaptic currents computed from the HH model. This suggests that the two components of the LFP reflect the underlying excitatory and inhibitory post-synaptic currents of the local neural population. We further used the model to decompose a sequence of evoked LFP responses under repetitive electrical stimulation (5 Hz) of the whisker pad. We found that as neural responses adapted, the excitatory and inhibitory components also adapted proportionately, while the temporal lag between the onsets of the two components increased during frequency adaptation. Our results demonstrated that the balance between neural excitation and inhibition can be investigated using extracellular recordings. Extension of the model to incorporate multiple compartments should allow more quantitative interpretations of surface Electroencephalography (EEG) recordings into components reflecting the excitatory, inhibitory and passive ionic current flows generated by local neural populations.