Affective and linguistic processing of speech prosody: DC potential studies

Speech melody or prosody subserves linguistic, emotional, and pragmatic functions in speech communication. Prosodic perception is based on the decoding of acoustic cues with a predominant function of frequency-related information perceived as speaker's pitch. Evaluation of prosodic meaning is a cognitive function implemented in cortical and subcortical networks that generate continuously updated affective or linguistic speaker impressions. Various brain-imaging methods allow delineation of neural structures involved in prosody processing. In contrast to functional magnetic resonance imaging techniques, DC (direct current, slow) components of the EEG directly measure cortical activation without temporal delay. Activation patterns obtained with this method are highly task specific and intraindividually reproducible. Studies presented here investigated the topography of prosodic stimulus processing in dependence on acoustic stimulus structure and linguistic or affective task demands, respectively. Data obtained from measuring DC potentials demonstrated that the right hemisphere has a predominant role in processing emotions from the tone of voice, irrespective of emotional valence. However, right hemisphere involvement is modulated by diverse speech and language-related conditions that are associated with a left hemisphere participation in prosody processing. The degree of left hemisphere involvement depends on several factors such as (i) articulatory demands on the perceiver of prosody (possibly, also the poser), (ii) a relative left hemisphere specialization in processing temporal cues mediating prosodic meaning, and (iii) the propensity of prosody to act on the segment level in order to modulate word or sentence meaning. The specific role of top-down effects in terms of either linguistically or affectively oriented attention on lateralization of stimulus processing is not clear and requires further investigations.

The impact of input fluctuations on the frequency-current relationships of layer 5 pyramidal neurons in the rat medial prefrontal cortex

The role of irregular cortical firing in neuronal computation is still debated, and it is unclear how signals carried by fluctuating synaptic potentials are decoded by downstream neurons. We examined in vitro frequency versus current (f-I) relationships of layer 5 (L5) pyramidal cells of the rat medial prefrontal cortex (mPFC) using fluctuating stimuli. Studies in the somatosensory cortex show that L5 neurons become insensitive to input fluctuations as input mean increases and that their f-I response becomes linear. In contrast, our results show that mPFC L5 pyramidal neurons retain an increased sensitivity to input fluctuations, whereas their sensitivity to the input mean diminishes to near zero. This implies that the discharge properties of L5 mPFC neurons are well suited to encode input fluctuations rather than input mean in their firing rates, with important consequences for information processing and stability of persistent activity at the network level.

Unattended emotional intonations modulate linguistic prosody processing

Prosody or speech melody subserves linguistic (e.g., question intonation) and emotional functions in speech communication. Findings from lesion studies and imaging experiments suggest that, depending on function or acoustic stimulus structure, prosodic speech components are differentially processed in the right and left hemispheres. This direct current (DC) potential study investigated the linguistic processing of digitally manipulated pitch contours of sentences that carried an emotional or neutral intonation. Discrimination of linguistic prosody was better for neutral stimuli as compared to happily as well as fearfully spoken sentences. Brain activation was increased during the processing of happy sentences as compared to neutral utterances. Neither neutral nor emotional stimuli evoked lateralized processing in the left or right hemisphere, indicating bilateral mechanisms of linguistic processing for pitch direction. Acoustic stimulus analysis suggested that prosodic components related to emotional intonation, such as pitch variability, interfered with linguistic processing of pitch course direction.

An integrated approach for reconstructing surface models of the proximal femur from sparse input data for surgical navigation

A patient-specific surface model of the proximal femur plays an important role in planning and supporting various computer-assisted surgical procedures including total hip replacement, hip resurfacing, and osteotomy of the proximal femur. The common approach to derive 3D models of the proximal femur is to use imaging techniques such as computed tomography (CT) or magnetic resonance imaging (MRI). However, the high logistic effort, the extra radiation (CT-imaging), and the large quantity of data to be acquired and processed make them less functional. In this paper, we present an integrated approach using a multi-level point distribution model (ML-PDM) to reconstruct a patient-specific model of the proximal femur from intra-operatively available sparse data. Results of experiments performed on dry cadaveric bones using dozens of 3D points are presented, as well as experiments using a limited number of 2D X-ray images, which demonstrate promising accuracy of the present approach.

Study of accelerometer assisted single key positioning user input systems

New designs of user input systems have resulted from the developing technologies and specialized user demands. Conventional keyboard and mouse input devices still dominate the input speed, but other input mechanisms are demanded in special application scenarios. Touch screen and stylus input methods have been widely adopted by PDAs and smartphones. Reduced keypads are necessary for mobile phones. A new design trend is exploring the design space in applications requiring single-handed input, even with eyes-free on small mobile devices. This requires as few keys on the input device to make it feasible to operate. But representing many characters with fewer keys can make the input ambiguous. Accelerometers embedded in mobile devices provide opportunities to combine device movements with keys for input signal disambiguation. Recent research has explored its design space for text input. In this dissertation an accelerometer assisted single key positioning input system is developed. It utilizes input device tilt directions as input signals and maps their sequences to output characters and functions. A generic positioning model is developed as guidelines for designing positioning input systems. A calculator prototype and a text input prototype on the 4+1 (5 positions) positioning input system and the 8+1 (9 positions) positioning input system are implemented using accelerometer readings on a smartphone. Users use one physical key to operate and feedbacks are audible. Controlled experiments are conducted to evaluate the feasibility, learnability, and design space of the accelerometer assisted single key positioning input system. This research can provide inspiration and innovational references for researchers and practitioners in the positioning user input designs, applications of accelerometer readings, and new development of standard machine readable sign languages.

High-resolution computer simulation of the dynamics of isoelectric focusing: in quest of more realistic input parameters for carrier ampholytes

The impact of the systematic variation of either DeltapK(a) or mobility of 140 biprotic carrier ampholytes on the conductivity profile of a pH 3-10 gradient was studied by dynamic computer simulation. A configuration with the greatest DeltapK(a) in the pH 6-7 range and uniform mobilities produced a conductivity profile consistent with that which is experimentally observed. A similar result was observed when the neutral (pI = 7) ampholyte is assigned the lowest mobility and mobilities of the other carriers are systematically increased as their pI's recede from 7. When equal DeltapK(a) values and mobilities are assigned to all ampholytes a conductivity plateau in the pH 5-9 region is produced which does not reflect what is seen experimentally. The variation in DeltapK(a) values is considered to most accurately reflect the electrochemical parameters of commercially available mixtures of carrier ampholytes. Simulations with unequal mobilities of the cationic and anionic species of the carrier ampholytes show either cathodic (greater mobility of the cationic species) or anodic (greater mobility of the anionic species) drifts of the pH gradient. The simulated cationic drifts compare well to those observed experimentally in a capillary in which the focusing of three dyes was followed by whole column optical imaging. The cathodic drift flattens the acidic portion of the gradient and steepens the basic part. This phenomenon is an additional argument against the notion that focused zones of carrier ampholytes have no electrophoretic flux.