The use of speech and lip modalities for robust speaker verification under adverse conditions

Investigates the use of lip information, in conjunction with speech information, for robust speaker verification in the presence of background noise. We have previously shown (Int. Conf. on Acoustics, Speech and Signal Proc., vol. 6, pp. 3693-3696, May 1998) that features extracted from a speaker's moving lips hold speaker dependencies which are complementary with speech features. We demonstrate that the fusion of lip and speech information allows for a highly robust speaker verification system which outperforms either subsystem individually. We present a new technique for determining the weighting to be applied to each modality so as to optimize the performance of the fused system. Given a correct weighting, lip information is shown to be highly effective for reducing the false acceptance and false rejection error rates in the presence of background noise

Effects of utterance length on lip kinematics in aphasia

Most existing models of language production and speech motor control do not explicitly address how language requirements affect speech motor functions, as these domains are usually treated as separate and independent from one another. This investigation compared lip movements during bilabial closure between five individuals with mild aphasia and five age and gender-matched control speakers when the linguistic characteristics of the stimuli were varied by increasing the number of syllables. Upper and lower lip movement data were collected for mono-, bi- and tri-syllabic nonword sequences using an AG 100 EMMA system. Each task was performed under both normal and fast rate conditions. Single articulator kinematic parameters (peak velocity, amplitude, duration,and cyclic spatio-temporal index) were measured to characterize lip movements. Results revealed that compared to control speakers, individuals with aphasia showed significantly longer movement duration and lower movement stability for longer items (bi- and tri-syllables). Moreover, utterance length affected the lip kinematics, in that the monosyllables had smaller peak velocities, smaller amplitudes and shorter durations compared to bi- and trisyllables, and movement stability was lowest for the trisyllables. In addition, the rate-induced changes (smaller amplitude and shorter duration with increased rate) were most prominent for the short items (i.e., monosyllables). These findings provide further support for the notion that linguistic changes have an impact on the characteristics of speech movements, and that individuals with aphasia are more affected by such changes than control speakers.

Speech-like and non-speech lip kinematics and coordination in aphasia

Background and aims: In addition to the well-known linguistic processing impairments in aphasia, oro-motor skills and articulatory implementation of speech segments are reported to be compromised to some degree in most types of aphasia. This study aimed to identify differences in the characteristics and coordination of lip movements in the production of a bilabial closure gesture between speech-like and nonspeech tasks in individuals with aphasia and healthy control subjects. Method and procedure: Upper and lower lip movement data were collected for a speech-like and a nonspeech task using an AG 100 EMMA system from five individuals with aphasia and five age and gender matched control subjects. Each task was produced at two rate conditions (normal and fast), and in a familiar and a less-familiar manner. Single articulator kinematic parameters (peak velocity, amplitude, duration, and cyclic spatio-temporal index) and multi-articulator coordination indices (average relative phase and variability of relative phase) were measured to characterize lip movements. Outcome and results: The results showed that when the two lips had similar task goals (bilabial closure) in speech-like versus nonspeech task, kinematic and coordination characteristics were not found to be different. However, when changes in rate were imposed on the bilabial gesture, only speech-like task showed functional adaptations, indicated by a greater decrease in amplitude and duration at fast rates. In terms of group differences, individuals with aphasia showed smaller amplitudes and longer movement durations for upper lip, higher spatio-temporal variability for both lips, and higher variability in lip coordination than the control speakers. Rate was an important factor in distinguishing the two groups, and individuals with aphasia were limited in implementing the rate changes. Conclusion and implications: The findings support the notion of subtle but robust differences in motor control characteristics between individuals with aphasia and the control participants, even in the context of producing bilabial closing gestures for a relatively simple speech-like task. The findings also highlight the functional differences between speech-like and nonspeech tasks, despite a common movement coordination goal for bilabial closure.

Evaluation of Patients' Perceptions of Alterations After Chin Bone Graft Harvesting

Objective: To evaluate patients' perceptions of alterations occurring after chin bone harvesting.Materials and Methods: Thirty patients were evaluated subjectively by visual analog scale-related sensitivity, facial aesthetics, eating, speaking, and lower lip movement, during 12 months. Objective analysis used the static light touch neurosensorial test. The statistical analysis was executed with Friedman test with P < 0.05 for both samples.Results: Subjective analysis revealed no alterations (1) to facial aesthetics, eating, speaking or lower lip movement but sensitivity of the mental region went from a lot of alteration initially (5) to little at the end of the study (3). Objective analysis results showed normal sensitivity (1) in the region after 12 months.Conclusion: The discrepancy between subjective and objective analyses may be indicative of the limited precision of clinical testing for subjective impressions assessment. (Implant Dent 2012;21:411-414)

Target Selection by Frontal Cortex During Coordinated Saccadic and Smooth Pursuit Eye Movement

Oculomotor tracking of moving objects is an important component of visually based cognition and planning. Such tracking is achieved by a combination of saccades and smooth pursuit eye movements. In particular, the saccadic and smooth pursuit systems interact to often choose the same target, and to maximize its visibility through time. How do multiple brain regions interact, including frontal cortical areas, to decide the choice of a target among several competing moving stimuli? How is target selection information that is created by a bias (e.g., electrical stimulation) transferred from one movement system to another? These saccade-pursuit interactions are clarified by a new computational neural model, which describes interactions among motion processing areas MT, MST, FPA, DLPN; saccade specification, selection, and planning areas LIP, FEF, SNr, SC; the saccadic generator in the brain stem; and the cerebellum. Model simulations explain a broad range of neuroanatomical and neurophysiological data. These results are in contrast with the simplest parallel model with no interactions between saccades and pursuit than common-target selection and recruitment of shared motoneurons. Actual tracking episodes in primates reveal multiple systematic deviations from predictions of the simplest parallel model, which are explained by the current model.

Correlation between morphology and function of the upper lip: a longitudinal evaluation

In order to evaluate the relationship between the morphology of the upper lip and muscle activity in a sample of 38 subjects (17 males and 21 females) with Angle Class II division 1 malocclusions, cephalometric and electromyographic analyses were conducted. The sample was subdivided into either predominantly nose or mouth breathers. The individuals were evaluated at two different periods, with a 2 year interval. At the first observation, the subjects were 11 years to 14 years 11 months of age and at the second observation, 13 years 4 months to 16 years 6 months of age. Height and thickness of the upper lip were measured on lateral cephalograms with the aid of a digital pachymeter. For each individual, electromyographic records were obtained of the orbicularis oris superior muscle at rest and in a series of 12 movements. The electromyographic data were normalized as a function of amplitude, for achievement of the percentage value of each movement. Pearson and Spearman correlation tests were applied.The results showed some correlation between morphology and muscle function (at a confidence level of 95 per cent). However, as the values of the correlation coefficient (r) were too low to establish associations between variables, it was concluded that the dimensions of the upper lip are not correlated with muscle activity.

Alveolar Bone Morphology in Patients With Bilateral Complete Cleft Lip and Palate in the Mixed Dentition: Cone Beam Computed Tomography Evaluation

Objectives: To verify the thickness and level of alveolar bone around the teeth adjacent to the cleft by means of cone beam computed tomography (CBCT) in patients with complete bilateral cleft lip and palate prior to bone graft surgery and orthodontic intervention. Method: The sample comprised 10 patients with complete bilateral cleft lip and palate (five boys and five girls) in the mixed dentition. The mean age was 9.5 years, and all subjects showed a G3 interarch relationship according to the Bauru index. The thickness of alveolar bone surrounding the maxillary incisors and the maxillary canines was measured in CBCT axial section using the software iCAT Xoran System. The distance between the alveolar bone crest and the cement-enamel junction (CEJ) was measured in cross sections. Results: The tomography images showed a thin alveolar bone plate around teeth adjacent to clefts. No bone dehiscence was observed in teeth adjacent to clefts during the mixed dentition. A slight increase in the distance between the alveolar bone crest and the CEJ was observed in the mesial and lingual aspects of canines adjacent to cleft. Conclusion: In patients with BCLP in the mixed dentition, teeth adjacent to the alveolar cleft are covered by a thin alveolar bone plate. However, the level of alveolar bone crest around these teeth seems to be normal, and no bone dehiscence was identified at this age.

Quantitative assessment of oral orbicular muscle deformation after cleft lip reconstruction: an ultrasound elastography study

Reconstruction of a cleft lip leads inevitably to scar tissue formation. Scar tissue within the restored oral orbicular muscle might be assessed by quantification of the local contractility of this muscle. Furthermore, information about the contraction capability of the oral orbicular muscle is crucial for planning the revision surgery of an individual patient. We used ultrasound elastography to determine the local deformation (strain) of the upper lip and to differentiate contracting muscle from passive scar tissue. Raw ultrasound data (radio-frequency format; rf-) were acquired, while the lips were brought from normal state into a pout condition and back in normal state, in three patients and three normal individuals. During this movement, the oral orbicular muscle contracts and, consequently, thickens in contrast to scar tissue that will not contract, or even expand. An iterative coarse-to-fine strain estimation method was used to calculate the local tissue strain. Analysis of the raw ultrasound data allows estimation of tissue strain with a high precision. The minimum strain that can be assessed reproducibly is 0.1%. In normal individuals, strain of the orbicular oral muscle was in the order of 20%. Also, a uniform strain distribution in the oral orbicular muscle was found. However, in patients deviating values were found in the region of the reconstruction and the muscle tissue surrounding that. In two patients with a successful reconstruction, strain was reduced by 6% in the reconstructed region with respect to the normal parts of the muscle (from 22% to 16% and from 25% to 19%). In a patient with severe aesthetical and functional disability, strain decreased from 30% in the normal region to 5% in the reconstructed region. With ultrasound elastography, the strain of the oral orbicular muscle can be quantified. In healthy subjects, the strain profiles and maximum strain values in all parts of the muscle were similar. The maximum strain of the muscle during pout was 20% +/- 1%. In surgically repaired cleft lips, decreased deformation was observed.

Three dimensional study to quantify the relationship between facial hard and soft tissue movement as a result of orthognathic surgery

Introduction Prediction of soft tissue changes following orthognathic surgery has been frequently attempted in the past decades. It has gradually progressed from the classic “cut and paste” of photographs to the computer assisted 2D surgical prediction planning; and finally, comprehensive 3D surgical planning was introduced to help surgeons and patients to decide on the magnitude and direction of surgical movements as well as the type of surgery to be considered for the correction of facial dysmorphology. A wealth of experience was gained and numerous published literature is available which has augmented the knowledge of facial soft tissue behaviour and helped to improve the ability to closely simulate facial changes following orthognathic surgery. This was particularly noticed following the introduction of the three dimensional imaging into the medical research and clinical applications. Several approaches have been considered to mathematically predict soft tissue changes in three dimensions, following orthognathic surgery. The most common are the Finite element model and Mass tensor Model. These were developed into software packages which are currently used in clinical practice. In general, these methods produce an acceptable level of prediction accuracy of soft tissue changes following orthognathic surgery. Studies, however, have shown a limited prediction accuracy at specific regions of the face, in particular the areas around the lips. Aims The aim of this project is to conduct a comprehensive assessment of hard and soft tissue changes following orthognathic surgery and introduce a new method for prediction of facial soft tissue changes.   Methodology The study was carried out on the pre- and post-operative CBCT images of 100 patients who received their orthognathic surgery treatment at Glasgow dental hospital and school, Glasgow, UK. Three groups of patients were included in the analysis; patients who underwent Le Fort I maxillary advancement surgery; bilateral sagittal split mandibular advancement surgery or bimaxillary advancement surgery. A generic facial mesh was used to standardise the information obtained from individual patient’s facial image and Principal component analysis (PCA) was applied to interpolate the correlations between the skeletal surgical displacement and the resultant soft tissue changes. The identified relationship between hard tissue and soft tissue was then applied on a new set of preoperative 3D facial images and the predicted results were compared to the actual surgical changes measured from their post-operative 3D facial images. A set of validation studies was conducted. To include: • Comparison between voxel based registration and surface registration to analyse changes following orthognathic surgery. The results showed there was no statistically significant difference between the two methods. Voxel based registration, however, showed more reliability as it preserved the link between the soft tissue and skeletal structures of the face during the image registration process. Accordingly, voxel based registration was the method of choice for superimposition of the pre- and post-operative images. The result of this study was published in a refereed journal. • Direct DICOM slice landmarking; a novel technique to quantify the direction and magnitude of skeletal surgical movements. This method represents a new approach to quantify maxillary and mandibular surgical displacement in three dimensions. The technique includes measuring the distance of corresponding landmarks digitized directly on DICOM image slices in relation to three dimensional reference planes. The accuracy of the measurements was assessed against a set of “gold standard” measurements extracted from simulated model surgery. The results confirmed the accuracy of the method within 0.34mm. Therefore, the method was applied in this study. The results of this validation were published in a peer refereed journal. • The use of a generic mesh to assess soft tissue changes using stereophotogrammetry. The generic facial mesh played a major role in the soft tissue dense correspondence analysis. The conformed generic mesh represented the geometrical information of the individual’s facial mesh on which it was conformed (elastically deformed). Therefore, the accuracy of generic mesh conformation is essential to guarantee an accurate replica of the individual facial characteristics. The results showed an acceptable overall mean error of the conformation of generic mesh 1 mm. The results of this study were accepted for publication in peer refereed scientific journal. Skeletal tissue analysis was performed using the validated “Direct DICOM slices landmarking method” while soft tissue analysis was performed using Dense correspondence analysis. The analysis of soft tissue was novel and produced a comprehensive description of facial changes in response to orthognathic surgery. The results were accepted for publication in a refereed scientific Journal. The main soft tissue changes associated with Le Fort I were advancement at the midface region combined with widening of the paranasal, upper lip and nostrils. Minor changes were noticed at the tip of the nose and oral commissures. The main soft tissue changes associated with mandibular advancement surgery were advancement and downward displacement of the chin and lower lip regions, limited widening of the lower lip and slight reversion of the lower lip vermilion combined with minimal backward displacement of the upper lip were recorded. Minimal changes were observed on the oral commissures. The main soft tissue changes associated with bimaxillary advancement surgery were generalized advancement of the middle and lower thirds of the face combined with widening of the paranasal, upper lip and nostrils regions. In Le Fort I cases, the correlation between the changes of the facial soft tissue and the skeletal surgical movements was assessed using PCA. A statistical method known as ’Leave one out cross validation’ was applied on the 30 cases which had Le Fort I osteotomy surgical procedure to effectively utilize the data for the prediction algorithm. The prediction accuracy of soft tissue changes showed a mean error ranging between (0.0006mm±0.582) at the nose region to (-0.0316mm±2.1996) at the various facial regions.