Robust speech recognition using speech enhancement

Automatic Speech Recognition (ASR) has matured into a technology which is becoming more common in our everyday lives, and is emerging as a necessity to minimise driver distraction when operating in-car systems such as navigation and infotainment. In “noise-free” environments, word recognition performance of these systems has been shown to approach 100%, however this performance degrades rapidly as the level of background noise is increased. Speech enhancement is a popular method for making ASR systems more ro- bust. Single-channel spectral subtraction was originally designed to improve hu- man speech intelligibility and many attempts have been made to optimise this algorithm in terms of signal-based metrics such as maximised Signal-to-Noise Ratio (SNR) or minimised speech distortion. Such metrics are used to assess en- hancement performance for intelligibility not speech recognition, therefore mak- ing them sub-optimal ASR applications. This research investigates two methods for closely coupling subtractive-type enhancement algorithms with ASR: (a) a computationally-efficient Mel-filterbank noise subtraction technique based on likelihood-maximisation (LIMA), and (b) in- troducing phase spectrum information to enable spectral subtraction in the com- plex frequency domain. Likelihood-maximisation uses gradient-descent to optimise parameters of the enhancement algorithm to best fit the acoustic speech model given a word se- quence known a priori. Whilst this technique is shown to improve the ASR word accuracy performance, it is also identified to be particularly sensitive to non-noise mismatches between the training and testing data. Phase information has long been ignored in spectral subtraction as it is deemed to have little effect on human intelligibility. In this work it is shown that phase information is important in obtaining highly accurate estimates of clean speech magnitudes which are typically used in ASR feature extraction. Phase Estimation via Delay Projection is proposed based on the stationarity of sinusoidal signals, and demonstrates the potential to produce improvements in ASR word accuracy in a wide range of SNR. Throughout the dissertation, consideration is given to practical implemen- tation in vehicular environments which resulted in two novel contributions – a LIMA framework which takes advantage of the grounding procedure common to speech dialogue systems, and a resource-saving formulation of frequency-domain spectral subtraction for realisation in field-programmable gate array hardware. The techniques proposed in this dissertation were evaluated using the Aus- tralian English In-Car Speech Corpus which was collected as part of this work. This database is the first of its kind within Australia and captures real in-car speech of 50 native Australian speakers in seven driving conditions common to Australian environments.

Porcine bone marrow stromal cell differentiation on heparin-adsorbed poly (e-caprolactone)-tricalcium phosphate-collagen scaffolds

We evaluate the potential of heparin as a substrate component for the fabrication of bone tissue engineering constructs using poly(e- caprolactone)–tricalcium phosphate–collagen type I (PCL–TCP–Col) three-dimensional (3-D) scaffolds. First we explored the ability of porcine bone marrow precursor cells (MPCs) to differentiate down both the adipogenic and osteogenic pathways within 2-D culture systems, with positive results confirmed by Oil-Red-O and Alizarin Red staining, respectively. Secondly, we examined the influence of heparin on the interaction and behaviour of MPCs when seeded onto PCL–TCP–Col 3-D scaffolds, followed by their induction into the osteogenic lineage. Our 3-D findings suggest that cell metabolism and proliferation increased between days 1 and 14, with deposition of extracellular matrix also observed up to 28 days. However, no noticeable difference could be detected in the extent of osteogenesis for PCL–TCP–Col scaffolds groups with the addition of heparin compared to identical control scaffolds without the addition of heparin.

Cherbourg time : young black and deadly art 2003-2007

Art is most often at the margins of community life, seen as a distraction or entertainment only; an individual’s whim. It is generally seen as without a useful role to play in that community. This is a perception of grown-ups; children seem readily to accept an engagement with art making. Our research has shown that when an individual is drawn into a crafted art project where they have an actual involvement with the direction and production of the art work, then they become deeply engaged on multiple levels. This is true of all age groups. Artists skilled in community collaboration are able to produce art of value that transcends the usual judgements of worth. It gives people a licence to unfetter their imagination and then cooperatively be drawn back to a reachable visual solution. If you engage with children in a community, you engage the extended family at some point. The primary methodology was to produce a series of educationally valid projects at the Cherbourg State School that had a resonance into that community, then revisit and refine them where necessary and develop a new series that extended all of the positive aspects of them. This was done over a period of five years. The art made during this time is excellent. The children know it, as do their families, staff at the school, members of the local community and the others who have viewed it in exhibitions in far places like Brisbane and Melbourne. This art and the way it has been made has been acknowledged as useful by the children, teachers and the community, in educational and social terms. The school is a better place to be. This has been acknowledged by the children, teachers and the community The art making of the last five years has become an integral part of the way the school now operates and the influence of that has begun to seep into other parts of the community. Art needs to be taken from the margins and put to work at the centre.

Speech recognition using ad-hoc microphone arrays

While close talking microphones give the best signal quality and produce the highest accuracy from current Automatic Speech Recognition (ASR) systems, the speech signal enhanced by microphone array has been shown to be an effective alternative in a noisy environment. The use of microphone arrays in contrast to close talking microphones alleviates the feeling of discomfort and distraction to the user. For this reason, microphone arrays are popular and have been used in a wide range of applications such as teleconferencing, hearing aids, speaker tracking, and as the front-end to speech recognition systems. With advances in sensor and sensor network technology, there is considerable potential for applications that employ ad-hoc networks of microphone-equipped devices collaboratively as a virtual microphone array. By allowing such devices to be distributed throughout the users’ environment, the microphone positions are no longer constrained to traditional fixed geometrical arrangements. This flexibility in the means of data acquisition allows different audio scenes to be captured to give a complete picture of the working environment. In such ad-hoc deployment of microphone sensors, however, the lack of information about the location of devices and active speakers poses technical challenges for array signal processing algorithms which must be addressed to allow deployment in real-world applications. While not an ad-hoc sensor network, conditions approaching this have in effect been imposed in recent National Institute of Standards and Technology (NIST) ASR evaluations on distant microphone recordings of meetings. The NIST evaluation data comes from multiple sites, each with different and often loosely specified distant microphone configurations. This research investigates how microphone array methods can be applied for ad-hoc microphone arrays. A particular focus is on devising methods that are robust to unknown microphone placements in order to improve the overall speech quality and recognition performance provided by the beamforming algorithms. In ad-hoc situations, microphone positions and likely source locations are not known and beamforming must be achieved blindly. There are two general approaches that can be employed to blindly estimate the steering vector for beamforming. The first is direct estimation without regard to the microphone and source locations. An alternative approach is instead to first determine the unknown microphone positions through array calibration methods and then to use the traditional geometrical formulation for the steering vector. Following these two major approaches investigated in this thesis, a novel clustered approach which includes clustering the microphones and selecting the clusters based on their proximity to the speaker is proposed. Novel experiments are conducted to demonstrate that the proposed method to automatically select clusters of microphones (ie, a subarray), closely located both to each other and to the desired speech source, may in fact provide a more robust speech enhancement and recognition than the full array could.

Physiological investigation of periosteum structure and its application in periosteum tissue engineering

Although many different materials, techniques and methods, including artificial or engineered bone substitutes, have been used to repair various bone defects, the restoration of critical-sized bone defects caused by trauma, surgery or congenital malformation is still a great challenge to orthopedic surgeons. One important fact that has been neglected in the pursuit of resolutions for large bone defect healing is that most physiological bone defect healing needs the periosteum and stripping off the periosteum may result in non-union or non-healed bone defects. Periosteum plays very important roles not only in bone development but also in bone defect healing. The purpose of this project was to construct a functional periosteum in vitro using a single stem cell source and then test its ability to aid the repair of critical-sized bone defect in animal models. This project was designed with three separate but closely-linked parts which in the end led to four independent papers. The first part of this study investigated the structural and cellular features in periostea from diaphyseal and metaphyseal bone surfaces in rats of different ages or with osteoporosis. Histological and immunohistological methods were used in this part of the study. Results revealed that the structure and cell populations in periosteum are both age-related and site-specific. The diaphyseal periosteum showed age-related degeneration, whereas the metaphyseal periosteum is more destructive in older aged rats. The periosteum from osteoporotic bones differs from normal bones both in terms of structure and cell populations. This is especially evident in the cambial layer of the metaphyseal area. Bone resorption appears to be more active in the periosteum from osteoporotic bones, whereas bone formation activity is comparable between the osteoporotic and normal bone. The dysregulation of bone resorption and formation in the periosteum may also be the effect of the interaction between various neural pathways and the cell populations residing within it. One of the most important aspects in periosteum engineering is how to introduce new blood vessels into the engineered periosteum to help form vascularized bone tissues in bone defect areas. The second part of this study was designed to investigate the possibility of differentiating bone marrow stromal cells (BMSCs) into the endothelial cells and using them to construct vascularized periosteum. The endothelial cell differentiation of BMSCs was induced in pro-angiogenic media under both normoxia and CoCl2 (hypoxia-mimicking agent)-induced hypoxia conditions. The VEGF/PEDF expression pattern, endothelial cell specific marker expression, in vitro and in vivo vascularization ability of BMSCs cultured in different situations were assessed. Results revealed that BMSCs most likely cannot be differentiated into endothelial cells through the application of pro-angiogenic growth factors or by culturing under CoCl2-induced hypoxic conditions. However, they may be involved in angiogenesis as regulators under both normoxia and hypoxia conditions. Two major angiogenesis-related growth factors, VEGF (pro-angiogenic) and PEDF (anti-angiogenic) were found to have altered their expressions in accordance with the extracellular environment. BMSCs treated with the hypoxia-mimicking agent CoCl2 expressed more VEGF and less PEDF and enhanced the vascularization of subcutaneous implants in vivo. Based on the findings of the second part, the CoCl2 pre-treated BMSCs were used to construct periosteum, and the in vivo vascularization and osteogenesis of the constructed periosteum were assessed in the third part of this project. The findings of the third part revealed that BMSCs pre-treated with CoCl2 could enhance both ectopic and orthotopic osteogenesis of BMSCs-derived osteoblasts and vascularization at the early osteogenic stage, and the endothelial cells (HUVECs), which were used as positive control, were only capable of promoting osteogenesis after four-weeks. The subcutaneous area of the mouse is most likely inappropriate for assessing new bone formation on collagen scaffolds. This study demonstrated the potential application of CoCl2 pre-treated BMSCs in the tissue engineering not only for periosteum but also bone or other vascularized tissues. In summary, the structure and cell populations in periosteum are age-related, site-specific and closely linked with bone health status. BMSCs as a stem cell source for periosteum engineering are not endothelial cell progenitors but regulators, and CoCl2-treated BMSCs expressed more VEGF and less PEDF. These CoCl2-treated BMSCs enhanced both vascularization and osteogenesis in constructed periosteum transplanted in vivo.

Sensitivity of the lane change test as a measure of in-vehicle system demand

The Lane Change Test (LCT) is one of the growing number of methods developed to quantify driving performance degradation brought about by the use of in-vehicle devices. Beyond its validity and reliability, for such a test to be of practical use, it must also be sensitive to the varied demands of individual tasks. The current study evaluated the ability of several recent LCT lateral control and event detection parameters to discriminate between visual-manual and cognitive surrogate In-Vehicle Information System tasks with different levels of demand. Twenty-seven participants (mean age 24.4 years) completed a PC version of the LCT while performing visual search and math problem solving tasks. A number of the lateral control metrics were found to be sensitive to task differences, but the event detection metrics were less able to discriminate between tasks. The mean deviation and lane excursion measures were able to distinguish between the visual and cognitive tasks, but were less sensitive to the different levels of task demand. The other LCT metrics examined were less sensitive to task differences. A major factor influencing the sensitivity of at least some of the LCT metrics could be the type of lane change instructions given to participants. The provision of clear and explicit lane change instructions and further refinement of its metrics will be essential for increasing the utility of the LCT as an evaluation tool.

Comparison of human alveolar osteoblasts cultured on polymer-ceramic composite scaffolds and tissue culture plates

The effects of medical grade polycaprolactone–tricalcium phosphate (mPCL–TCP) (80:20) scaffolds on primary human alveolar osteoblasts (AOs) were compared with standard tissue-culture plates. Of the seeded AOs, 70% adhered to and proliferated on the scaffold surface and within open and interconnected pores; they formed multi-layered sheets and collagen fibers with uniform distribution within 28 days. Elevation of alkaline phosphatase activity occurred in scaffold–cell constructs independent of osteogenic induction. AO proliferation rate increased and significant decrease in calcium concentration of the medium for both scaffolds and plates under induction conditions were seen. mPCL–TCP scaffolds significantly influenced the AO expression pattern of osterix and osteocalcin (OCN). Osteogenic induction down-regulated OCN at both RNA and protein level on scaffolds (3D) by day 7, and up-regulated OCN in cell-culture plates (2D) by day 14, but OCN levels on scaffolds were higher than on cell-culture plates. Immunocytochemical signals for type I collagen, osteopontin and osteocalcin were detected at the outer parts of scaffold–cell constructs. More mineral nodules were found in induced than in non-induced constructs. Only induced 2D cultures showed nodule formation. mPCL–TCP scaffolds appear to stimulate osteogenesis in vitro by activating a cellular response in AO's to form mineralized tissue. There is a fundamental difference between culturing AOs on 2D and 3D environments that should be considered when studying osteogenesis in vitro.

Investigating the effects of preinduction on human adipose-derived precursor cells in an athymic rat model

The osteogenic potential of human adipose-derived precursor cells seeded on medical-grade polycaprolactone-tricalcium phosphate scaffolds was investigated in this in vivo study. Three study groups were investigated: (1) induced—stimulated with osteogenic factors only after seeding into scaffold; (2) preinduced—induced for 2 weeks before seeding into scaffolds; and (3) uninduced—cells without any introduced induction. For all groups, scaffolds were implanted subcutaneously into the dorsum of athymic rats. The scaffold/cell constructs were harvested at the end of 6 or 12 weeks and analyzed for osteogenesis. Gross morphological examination using scanning electron microscopy indicated good integration of host tissue with scaffold/cell constructs and extensive tissue infiltration into the scaffold interior. Alizarin Red histology and immunostaining showed a heightened level of mineralization and an increase in osteonectin, osteopontin, and collagen type I protein expression in both the induced and preinduced groups compared with the uninduced groups. However, no significant differences were observed in these indicators when compared between the induced and preinduced groups.

The effect of rhBMP-2 on canine osteoblasts seeded onto 3D bioactive polycaprolactone scaffolds

Our strategy entails investigating the influence of varied concentrations (0, 10, 100 and 1000 ng/ml) of human recombinant bone morphogenetic protein-2 (rhBMP-2) on the osteogenic expression of canine osteoblasts, seeded onto poly-caprolactone 20% tricalcium phosphate (PCL-TCP) scaffolds in vitro. Biochemical assay revealed that groups with rhBMP-2 displayed an initial burst in cell growth that was not dose-dependent. However, after 13 days, cell growth declined to a value similar to control. Significantly less cell growth was observed for construct with 1000 ng/ml of rhBMP-2 from 20 days onwards. Confocal microscopy confirmed viability of osteoblasts and at day 20, groups seeded with rhBMP-2 displayed heightened cell death as compared to control. Phase contrast and scanning electron microscopy revealed that osteoblasts heavily colonized surfaces, rods and pores of the PCL-TCP scaffolds. This was consistent for all groups. Finally, Von Kossa and osteocalcin assays demonstrated that cells from all groups maintained their osteogenic phenotype throughout the experiment. Calcification was observed as early as four days after stimulation for groups seeded with rhBMP-2. In conclusion, rhBMP-2 seems to enhance the differentiated function of canine osteoblasts in a non-dose dependent manner. This resulted in accelerated mineralization, followed by death of osteoblasts as they underwent terminal differentiation. Notably, PCL-TCP scaffolds seeded only with canine osteoblasts could sustain excellent osteogenic expression in vitro. Hence, the synergy of PCL with bioactive TCP and rhBMP-2 in a novel composite scaffold, could offer an exciting approach for bone regeneration.

Low-cost hardware speech enhancement for improved speech recognition in automotive environments

Voice recognition is one of the key enablers to reduce driver distraction as in-vehicle systems become more and more complex. With the integration of voice recognition in vehicles, safety and usability are improved as the driver’s eyes and hands are not required to operate system controls. Whilst speaker independent voice recognition is well developed, performance in high noise environments (e.g. vehicles) is still limited. La Trobe University and Queensland University of Technology have developed a low-cost hardware-based speech enhancement system for automotive environments based on spectral subtraction and delay–sum beamforming techniques. The enhancement algorithms have been optimised using authentic Australian English collected under typical driving conditions. Performance tests conducted using speech data collected under variety of vehicle noise conditions demonstrate a word recognition rate improvement in the order of 10% or more under the noisiest conditions. Currently developed to a proof of concept stage there is potential for even greater performance improvement.

Driver distractions: Characteristics underlying drivers' risk perceptions

Driver distraction is a research area that continues to receive considerable research interest but the drivers’ perspective is less well documented. The current research focuses on how drivers perceive the risks associated with a range of driver distractions with the aim of identifying features that contribute to their risk perception judgements. Multidimensional scaling analysis was employed to better understand drivers’ risk perceptions for 15 in-vehicle and external distractions. Results identify both salient qualitative characteristics that underpin drivers’ risk perceptions, such as the probability of a crash, as well as identify other features inherent in the distractions that may also contribute to risk perceptions. The implications of the results are discussed for better understanding drivers’ perceptions of distractions and the potential for improving road safety messages related to distracted driving.

Recognising audio-visual speech in vehicles using the AVICAR database

Interacting with technology within a vehicle environment using a voice interface can greatly reduce the effects of driver distraction. Most current approaches to this problem only utilise the audio signal, making them susceptible to acoustic noise. An obvious approach to circumvent this is to use the visual modality in addition. However, capturing, storing and distributing audio-visual data in a vehicle environment is very costly and difficult. One current dataset available for such research is the AVICAR [1] database. Unfortunately this database is largely unusable due to timing mismatch between the two streams and in addition, no protocol is available. We have overcome this problem by re-synchronising the streams on the phone-number portion of the dataset and established a protocol for further research. This paper presents the first audio-visual results on this dataset for speaker-independent speech recognition. We hope this will serve as a catalyst for future research in this area.

Ovine cortical osteoblasts outperform bone marrow cells in an ectopic bone assay

Reviewing the available literature, one could conclude that marrow-derived mesenchymal stem cells (BMSCs) are the ‘gold standard’ source for bone tissue engineering applications, due to their multilineage differentiation potential and easy accessibility. However, comprehensive studies comparing their osteogenic potential with bone-derived osteoblasts (OBs) to justify the preferred application of BMSCs based on performance are few. To address these shortfalls, in the present study, ovine BMSCs and OBs seeded onto scaffolds were characterized in vitro and transplanted subcutaneously into NOD/SCID mice in combination with and without recombinant human bone morphogenetic protein 7 (rhBMP-7). It was hypothesized that cell origin, ossification type and degree of vascularization and ossification depends on the nature and commitment of transplanted cells and stimulating growth factors, such as rhBMP-7. After retrieval, specimens were analysed by biomechanical testing, µCT analysis, scanning electron microscopy/energy-dispersive X-ray spectroscopy and histo- and immunohistochemistry for osteocalcin, type II collagen and BrdU. The results showed a high degree of cell survival and proliferation ectopically, resulting in active contribution to endochondral osteogenesis. When compared to BMSCs, OBs showed a higher degree of bone deposition while OB-derived bone was of higher maturation. Stimulation with rhBMP-7 increased the rate of bone synthesis for both BMSCs and OBs, additionally promoting neovascularization and osteoclast activity. These results suggest that the origin and commitment of transplanted cells highly influence the type and degree of ossification, that rhBMP-7 represents a powerful adjuvant for bone tissue-engineering applications, and that mature bone is an adequate alternative cell source for bone tissue-engineering applications.

Enhancing vascularized bone formation using tissue engineered periosteum

Objectives: The periosteum plays an indispensable role in both bone formation and bone defect healing. The aim of this project is to produce tissue engineered periosteum for bone defect treatment. Methods: In this study we constructed an artificial in vitro periosteum by incorporating osteogenic differentiated bone marrow stromal cells (BMSCs) and cobalt chloride (CoCl2)-treated BMSCs. The engineered periostea were implanted both subcutaneously and into skull bone defects in SCID mice to investigate ectopic and orthotopic osteogenesis and vascularisation. After two weeks in subcutaneous and four weeks in bone defect areas, the implanted constructs were assessed for ectopic and orthotopic osteogenesis and vascularisation by micro-CT, histomorphometrical and immunohistochemical methods. Results: The results showed that CoCl2 pre-treated BMSCs induced higher degree of vascularisation and enhanced osteogenesis within the implants in both ectopic and orthotopic areas. Conclusion: This study provided a novel approach using BMSCs sourced from the same patient for both osteogenic and pro-angiogenic purposes in constructing tissue engineered periosteum to enhance vascularized osteogenesis.

Limitations and challenges in MSC delivery for bone regeneration

Objective: Regeneration of osseous defects by tissue-engineering or cell delivery approach provides a novel means of treatment utilizing cell biology, materials sciences, and molecular biology. The concept of in vitro explanted mesenchymal stem cells (MSCs) with an ability to induce new bone formation has been demonstrated in some small animal models. However, contradictory results have been reported regarding the regenerative capacity of MSCs after ex vivo expansion due to the lack of the understanding of microenvironment for MSC differentiation in vivo. ----- ----- Methods: In our laboratory tissue-derived and bone marrow-derived MSCs have been investigated in their osteogenesis. Cell morphology and proliferation were studied by microscopy, confocal microscopy, FACS and cell counting. Cell differentiation and matrix formation were analysed by matrix staining, quantitative PCR, and immunohistochemistry. A SCID skull defect model was used for cell transplantation studies.----- ----- Results: It was noted that tissue-derived and bone marrow-derived MSCs showed similar characteristics in cell surface marker expression, mesenchymal lineage differentiation potential, and cell population doubling. MSCs from both sources could initiate new bone formation in bone defects after delivery into a critical size defects. The bone forming cells were from both transplanted cells and endogenous cells from the host. Interestingly, the majority of in vitro osteogenic differentiated cells did not form new bone directly even though mineralized matrix was synthesized in vitro by MSCs. Furthermore, no new bone formation was detected when MSCs were transplanted subcutaneously.----- ----- Conclusion: This study unveiled the limitations of MSC delivery in bone regeneration and proposed that in vivo microenvironment needs to be optimized for MSC delivery in osteogenesis.