FPGA Implementation of a Pipelined Gaussian Calculation for HMM-Based Large Vocabulary Speech Recognition

A scalable large vocabulary, speaker independent speech recognition system is being developed using Hidden Markov Models (HMMs) for acoustic modeling and a Weighted Finite State Transducer (WFST) to compile sentence, word, and phoneme models. The system comprises a software backend search and an FPGA-based Gaussian calculation which are covered here. In this paper, we present an efficient pipelined design implemented both as an embedded peripheral and as a scalable, parallel hardware accelerator. Both architectures have been implemented on an Alpha Data XRC-5T1, reconfigurable computer housing a Virtex 5 SX95T FPGA. The core has been tested and is capable of calculating a full set of Gaussian results from 3825 acoustic models in 9.03 ms which coupled with a backend search of 5000 words has provided an accuracy of over 80%. Parallel implementations have been designed with up to 32 cores and have been successfully implemented with a clock frequency of 133?MHz.

Neurobiological model of visuo-spatial cognition in young Williams Syndrome children: measures of dorsal-stream and frontal function

We examine hypotheses for the neural basis of the profile of visual cognition in young children with Williams syndrome (WS). These are: (a) that it is a consequence of anomalies in sensory visual processing; (b) that it is a deficit of the dorsal relative to the ventral cortical stream; (c) that it reflects deficit of frontal function, in particular of fronto-parietal interaction; (d) that it is related to impaired function in the right hemisphere relative to the left. The tests reported here are particularly relevant to (b) and (c). They form part of a more extensive programme of investigating visual, visuospatial, and cognitive function in large group of children with WS children, aged 8 months to 15 years. To compare performance across tests, avoiding floor and ceiling effects, we have measured performance in children with WS in terms of the ‘age equivalence’ for typically developing children. In this paper the relation between dorsal and ventral function was tested by motion and form coherence thresholds respectively. We confirm the presence of a subgroup of children with WS who perform particularly poorly on the motion (dorsal) task. However, such performance is also characteristic of normally developingchildren up to 5 years: thus the WS performance may reflect an overall persisting immaturity of visuospatial processing which is particularly evident in the dorsal stream. Looking at the performance on the global coherence tasks of the entire WS group, we find that there is also a subgroup who have both high form and motion coherence thresholds, relative to the performance of children of the same chronological age and verbal age on the BPVS, suggesting a more general global processing deficit. Frontal function was tested by a counterpointing task, ability to retrieve a ball from a ‘detour box’, and the Stroop-like ‘day-night’ task, all of which require inhibition of a familiar response. When considered in relation to overall development as indexed by vocabulary, the day-night task shows little specific impairment, the detour box shows a significant delay relative to controls, and the counterpointing task shows a marked and persistent deficit in many children. We conclude that frontal control processes show most impairment in WS when they are associated with spatially directed responses, reflecting a deficit of fronto-parietal processing. However, children with WS may successfully reduce the effect of this impairment by verbally mediated strategies. On all these tasks we find a range of difficulties across individual children and a small subset of WS who show very good performance, equivalent to chronological age norms of typically developing children. Neurobiological models of visuo-spatial cognition in children with WS p.4 Overall, we conclude that children with WS have specific processing difficulties with tasks involving frontoparietal circuits within the spatial domain. However, some children with WS can achieve similar performance to typically developing children on some tasks involving the dorsal stream, although the strategies and processing may be different in the two groups.

The Voice as Transcursive Inscriber: The Relation of Body and Instrument Understood through the Workings of a Machine

This article examines the relationship of the body with a musical instrument; specifically it looks at the vital threshold conditions that occur during the interplay of voice and instrument. By examining the work ‘IKAS’ (1982) for solo saxophone by German composer Hans-Joachim Hespos, the unusual timbral relationships created between vocal and instrumental sounds are exposed. I argue that this particular work highlights the performer/instrument relation as one marked by Gilles Deleuze’s notion of the workings of a machine and a machine’s relation to a ‘flow’, in particular a machine’s function with view to the break in the flow. By turning towards Deleuze’s concept of the machine, this article offers a slightly different vocabulary for music analysis, one that more easily encompasses certain works of the twentieth century, specifically those that are more timbre- than pitch-based.

Probed serial recall in Williams syndrome: Lexical influences on phonological short-term memory

Williams syndrome is a genetic disorder that, it has been claimed, results in an unusual pattern of linguistic strengths and weaknesses. The current study investigated the hypothesis that there is a reduced influence of lexical knowledge on phonological short-term memory in Williams syndrome. Fourteen children with Williams syndrome and 2 vocabulary la matched control groups, 20 typically developing children and 13 children with learning difficulties, were tested on 2 probed serial-recall tasks. On the basis of previous findings, it was predicted that children with Williams syndrome would demonstrate (a) a reduced effect of lexicality on the recall of list items, (b) relatively poorer recall of list items compared with recall of serial order, and (c) a reduced tendency to produce lexicalization errors in the recall of nonwords. in fact, none of these predictions were supported. Alternative explanations for previous findings and implications for accounts of language development in Williams syndrome are discussed.

Basic auditory processing skills and phonological awareness in low-IQ readers and typically developing controls

We explore the relationships between basic auditory processing, phonological awareness, vocabulary, and word reading in a sample of 95 children, 55 typically developing children, and 40 children with low IQ. All children received nonspeech auditory processing tasks, phonological processing and literacy measures, and a receptive vocabulary task. Compared to age-matched controls, the children with low IQ and low reading skills were significantly impaired in auditory and phonological processing, whereas the children with low IQ and preserved reading skills were not. There were also significant predictive relations between auditory processing and single word reading. Poor auditory processing was not dependent on low IQ, as auditory processing was age appropriate in the low-IQ children who were good readers.

Evocative Listening : Mediated Practices in Everyday Life

The history of sonic arts is charged with transgressive practices that seek to expose the social, aural and cultural thresholds across various listening experiences, posing new questions in terms of the dialogue between listener and place. Recent work in sonic art exposes the need for an experiential understanding of listening that foregrounds the use of new personal technologies, environmental philosophy and the subject–object relationship. This paper aims to create a vocabulary that better contextualises recent installations and performances produced within the context of everyday life, by researchers and artists at the Sonic Arts Research Centre at Queen's University Belfast.

Motor Skills in Children Aged 7–10 Years, Diagnosed with Autism Spectrum Disorder

This study used the Movement Assessment Battery for Children (M-ABC2) to assess the level of motor skill in children aged 7-10 years with autism (n=18) and compared their performance to two groups of age-matched typically developing children; a receptive vocabulary matched group (n=19) and a nonverbal IQ matched group (n=22). Although the results support previous work, as indicated by a significant general motor impairment in the group with autism, a sub-analysis of the M-ABC2 revealed that there were only 2 out of 8 subcomponent skills which showed universally significant specific deficits for the autism group; namely catching a ball and static balance. These results suggest that motor skill deficits associated with autism may not be pervasive but more apparent in activities demanding complex, interceptive actions or core balance ability.

CLOSE—A Data-Driven Approach to Speech Separation

This paper studies single-channel speech separation, assuming unknown, arbitrary temporal dynamics for the speech signals to be separated. A data-driven approach is described, which matches each mixed speech segment against a composite training segment to separate the underlying clean speech segments. To advance the separation accuracy, the new approach seeks and separates the longest mixed speech segments with matching composite training segments. Lengthening the mixed speech segments to match reduces the uncertainty of the constituent training segments, and hence the error of separation. For convenience, we call the new approach Composition of Longest Segments, or CLOSE. The CLOSE method includes a data-driven approach to model long-range temporal dynamics of speech signals, and a statistical approach to identify the longest mixed speech segments with matching composite training segments. Experiments are conducted on the Wall Street Journal database, for separating mixtures of two simultaneous large-vocabulary speech utterances spoken by two different speakers. The results are evaluated using various objective and subjective measures, including the challenge of large-vocabulary continuous speech recognition. It is shown that the new separation approach leads to significant improvement in all these measures.

The Contemporary Urban Condition: Understanding the Globalizing City as Informal, Contested, and Anchored.

In attempting to expand the vocabulary of urban description and understanding, and to offer a new composite conceptual framework for a more integrated urban planning and policy, this essay addresses the informal, contested, and anchored dimensions of the urban in turn; second, it seeks to increasingly link the three within the new global context; and finally, it attempts to draw these strands together in a proposed reconceptualization of the contemporary city within a world where the global is urbanizing and the urban is globalizing.

Optimization of Weighted Finite State Transducer for Speech Recognition

There is considerable interest in creating embedded, speech recognition hardware using the weighted finite state transducer (WFST) technique but there are performance and memory usage challenges. Two system optimization techniques are presented to address this; one approach improves token propagation by removing the WFST epsilon input arcs; another one-pass, adaptive pruning algorithm gives a dramatic reduction in active nodes to be computed. Results for memory and bandwidth are given for a 5,000 word vocabulary giving a better practical performance than conventional WFST; this is then exploited in an adaptive pruning algorithm that reduces the active nodes from 30,000 down to 4,000 with only a 2 percent sacrifice in speech recognition accuracy; these optimizations lead to a more simplified design with deterministic performance.

Cognitive and task-related EEG correlates of arithmetic performance in adolescents

Cognitive and neurophysiological correlates of arithmetic calculation, concepts, and applications were examined in 41 adolescents, ages 12-15 years. Psychological and task-related EEG measures which correctly distinguished children who scored low vs. high (using a median split) in each arithmetic subarea were interpreted as indicative of processes involved. Calculation was related to visual-motor sequencing, spatial visualization, theta activity measured during visual-perceptual and verbal tasks at right- and left-hemisphere locations, and right-hemisphere alpha activity measured during a verbal task. Performance on arithmetic word problems was related to spatial visualization and perception, vocabulary, and right-hemisphere alpha activity measured during a verbal task. Results suggest a complex interplay of spatial and sequential operations in arithmetic performance, consistent with processing model concepts of lateralized brain function.