Perceptual Evaluation of Video-Realistic Speech

abstract With many visual speech animation techniques now available, there is a clear need for systematic perceptual evaluation schemes. We describe here our scheme and its application to a new video-realistic (potentially indistinguishable from real recorded video) visual-speech animation system, called Mary 101. Two types of experiments were performed: a) distinguishing visually between real and synthetic image- sequences of the same utterances, ("Turing tests") and b) gauging visual speech recognition by comparing lip-reading performance of the real and synthetic image-sequences of the same utterances ("Intelligibility tests"). Subjects that were presented randomly with either real or synthetic image-sequences could not tell the synthetic from the real sequences above chance level. The same subjects when asked to lip-read the utterances from the same image-sequences recognized speech from real image-sequences significantly better than from synthetic ones. However, performance for both, real and synthetic, were at levels suggested in the literature on lip-reading. We conclude from the two experiments that the animation of Mary 101 is adequate for providing a percept of a talking head. However, additional effort is required to improve the animation for lip-reading purposes like rehabilitation and language learning. In addition, these two tasks could be considered as explicit and implicit perceptual discrimination tasks. In the explicit task (a), each stimulus is classified directly as a synthetic or real image-sequence by detecting a possible difference between the synthetic and the real image-sequences. The implicit perceptual discrimination task (b) consists of a comparison between visual recognition of speech of real and synthetic image-sequences. Our results suggest that implicit perceptual discrimination is a more sensitive method for discrimination between synthetic and real image-sequences than explicit perceptual discrimination.

Association Behavior of Biotinylated and Non-Biotinylated PolyEthylene Oxide-b-Poly(2-(Diethylamino)Ethyl Methacrylate)

Biotinylated and non-biotinylated copolymers of ethylene oxide (EO) and 2-(diethylamino)ethyl methacrylate (DEAEMA) were synthesized by the atom transfer radical polymerization technique (ATRP). The chemical compositions of the copolymers as determined by NMR are represented by PEO₁₁₃PDEAEMA₇₀ and biotin-PEO₁₀₄PDEAEMA₉₃ respectively. The aggregation behavior of these polymers in aqueous solutions at different pHs and ionic strengths was studied using a combination of potentiometric titration, dynamic light scattering (DLS), static light scattering (SLS), and transmission electron microscopy (TEM). Both PEO-b-PDEAEMA and biotin-PEO-b-PDEAEMA diblock copolymers form micelles at high pH with hydrodynamic radii (Rh) of about 19 and 23 nm, respectively. At low pH, the copolymers are dispersed as unimers in solution with Rh of about 6-7 nm. However, at a physiological salt concentration (cs) of about 0.16M NaCl and a pH of 7-8, the copolymers form large loosely packed Guassian chains, which were not present at the low cs of 0.001M NaCl. The critical micelle concentrations (CMC) and the cytotoxicity of the copolymers were investigated to determine a suitable polymer concentration range for future biological applications. Both PEO-b-PDEAEMA and biotin-PEO-b-PDEAEMA diblock copolymers possess identical CMC values of about 0.0023 mg/g, while the cytotoxicity test indicated that the copolymers are not toxic up to 0.05mg/g (> 83% cell survival at this concentration).