Automatic Detection of Relevant Head Gestures in American Sign Language Communication

An automated system for detection of head movements is described. The goal is to label relevant head gestures in video of American Sign Language (ASL) communication. In the system, a 3D head tracker recovers head rotation and translation parameters from monocular video. Relevant head gestures are then detected by analyzing the length and frequency of the motion signal's peaks and valleys. Each parameter is analyzed independently, due to the fact that a number of relevant head movements in ASL are associated with major changes around one rotational axis. No explicit training of the system is necessary. Currently, the system can detect "head shakes." In experimental evaluation, classification performance is compared against ground-truth labels obtained from ASL linguists. Initial results are promising, as the system matches the linguists' labels in a significant number of cases.

Facial Feature Tracking and Occlusion Recovery in American Sign Language

Facial features play an important role in expressing grammatical information in signed languages, including American Sign Language(ASL). Gestures such as raising or furrowing the eyebrows are key indicators of constructions such as yes-no questions. Periodic head movements (nods and shakes) are also an essential part of the expression of syntactic information, such as negation (associated with a side-to-side headshake). Therefore, identification of these facial gestures is essential to sign language recognition. One problem with detection of such grammatical indicators is occlusion recovery. If the signer's hand blocks his/her eyebrows during production of a sign, it becomes difficult to track the eyebrows. We have developed a system to detect such grammatical markers in ASL that recovers promptly from occlusion. Our system detects and tracks evolving templates of facial features, which are based on an anthropometric face model, and interprets the geometric relationships of these templates to identify grammatical markers. It was tested on a variety of ASL sentences signed by various Deaf native signers and detected facial gestures used to express grammatical information, such as raised and furrowed eyebrows as well as headshakes.

An investigation of how foreign language departments at American colleges and universities view American Sign Language

Corwin and Wilcox (1985) sent surveys to more than 100 American colleges and universities to determine the policies on the matter of accepting American Sign Language (ASL) as a foreign language. Their results indicated that 81% of those surveyed rejected ASL as a foreign/modern language equivalent. The most frequently stated opposition to ASL was that it lacked a culture. Some of the other objections to ASL were: ASL is not foreign; there is no written form and therefore no original body of literature; it is a derivative of English; and it is indigenous to the United States and hence not foreign. Based on the work of Corwin and Wilcox this study sent surveys to 222 American colleges and universities. Noting an expanding cognizance and social awareness of ASL and deafness (as seen in the increasing number of movies, plays, television programs, the Americans with Disabilities Act, and related news stories), this study sought to find out if ASL was now considered an acceptable foreign language equivalent. The hypothesis of this study was that change has occurred since the 1985 study: that a significant percent of post secondary schools accepting ASL as a foreign/modern language equivalent has increased. The 165 colleges and universities that responded to this author's survey confirmed there has been a significant shift towards the acceptance of ASL. Only 50% of the respondents objected to ASL as a foreign language equivalent, a significant decrease from the 1985 findings. Of those who objected to granting ASL foreign language credit, the reasons were similar to those of the Corwin and Wilcox study, except that the belief in an absence of a Deaf culture dropped from the top reason listed, to the fifth. That ASL is not foreign was listed as the most frequent objection in this study. One important change which may account for increased acceptance of ASL, is that 16 states (compared to 10 in 1985) now have policies stating that ASL is acceptable as a foreign language equivalent. Two-year colleges, in this study, were more likely to accept ASL than were four-year colleges and universities. Neither two- nor four-year colleges and universities are likely to include ASL in their foreign language departments, and most schools that have foreign language entrance requirements are unlikely to accept ASL. In colleges and universities where ASL was already offered in some department within the system, there was a significantly higher likelihood that foreign language credit was given for ASL. Respondents from states with laws governing the inclusion of ASL did not usually know their state had a policy. Most respondents, 84%, indicated their knowledge on the topic of ASL was fair to poor. ^

The effects of American Sign Language on general self-efficacy and anxiety among mothers in a residential rehabilitation facility for drug addiction and substance abuse

Globally, approximately 208 million people aged 15 and older used illicit drugs at least once in the last 12 months; 2 billion consumed alcohol and tobacco consumption affected 25% (World Drug Report, 2008). In the United States, 20.1 million (8.0%) people aged 12 and older were illicit drug users, 129 million (51.6%) abused alcohol and 70.9 million (28.4%) used tobacco (SAMHSA/OAS, 2008).Usually considered a problem specific to men (Lynch, 2002), 5.2% of pregnant women aged 15 to 44 are also illicit drug and substance abusers (SAMHSA/OAS, 2007). During pregnancy, illicit drugs and substance abuse (ID/SA) can significantly affect a woman and her infant contributing to developmental and communication delays for the infant and influencing parenting abilities (Budden, 1996; March of Dimes, 2006b; Rossetti, 2000). Feelings of guilt and shame and stressful experiences influence approaches to parenting (Ashley, Marsden, & Brady, 2003; Brazelton, & Greenspan, 2000; Ehrmin, 2000; Johnson, & Rosen, 1990; Kelley, 1998; Rossetti, 2000; Velez et al., 2004; Zickler, 1999). Parenthood is an expanded role that can be a trying time for those lacking a sense of self-efficacy and creates a high vulnerability to stress (Bandura, 1994). Residential treatment programs for ID/SA mothers and their children provide an excellent opportunity for effective interventions (Finkelstein, 1994; Social Care Institute for Excellence, 2005). This experimental study evaluated whether teaching American Sign Language (ASL) to mothers living with their infants/children at an ID/SA residential treatment program increased the mothers’ self-efficacy and decreased their anxiety. Quantitative data were collected using the General Self-Efficacy Scale and the State-Trait Anxiety Inventory showing there was both a significant increase in self efficacy and decrease in anxiety for the mothers. This research adds to the knowledge base concerning ID/SA mothers’ caring for their infants/children. By providing a simple low cost program, easily incorporated into existing rehabilitation curricula, the study helps educators and healthcare providers better understand the needs of the ID/SA mothers. This study supports Bandura’s theory that parents who are secure in their efficacy can navigate through the various phases of their child’s development and are less vulnerable to stress (Bandura, 1994).

The Effects of American Sign Language on General Self- Efficacy and Anxiety Among Mothers in a Residential Rehabilitation Facility for Drug Addiction and Substance Abuse

Globally, approximately 208 million people aged 15 and older used illicit drugs at least once in the last 12 months; 2 billion consumed alcohol and tobacco consumption affected 25% (World Drug Report, 2008). In the United States, 20.1 million (8.0%) people aged 12 and older were illicit drug users, 129 million (51.6%) abused alcohol and 70.9 million (28.4%) used tobacco (SAMHSA/OAS, 2008).Usually considered a problem specific to men (Lynch, 2002), 5.2% of pregnant women aged 15 to 44 are also illicit drug and substance abusers (SAMHSA/OAS, 2007). During pregnancy, illicit drugs and substance abuse (ID/SA) can significantly affect a woman and her infant contributing to developmental and communication delays for the infant and influencing parenting abilities (Budden, 1996; March of Dimes, 2006b; Rossetti, 2000). Feelings of guilt and shame and stressful experiences influence approaches to parenting (Ashley, Marsden, & Brady, 2003; Brazelton, & Greenspan, 2000; Ehrmin, 2000; Johnson, & Rosen, 1990; Kelley, 1998; Rossetti, 2000; Velez et al., 2004; Zickler, 1999). Parenthood is an expanded role that can be a trying time for those lacking a sense of self-efficacy and creates a high vulnerability to stress (Bandura, 1994). Residential treatment programs for ID/SA mothers and their children provide an excellent opportunity for effective interventions (Finkelstein, 1994; Social Care Institute for Excellence, 2005). This experimental study evaluated whether teaching American Sign Language (ASL) to mothers living with their infants/children at an ID/SA residential treatment program increased the mothers’ self-efficacy and decreased their anxiety. Quantitative data were collected using the General Self-Efficacy Scale and the State-Trait Anxiety Inventory showing there was both a significant increase in self efficacy and decrease in anxiety for the mothers. This research adds to the knowledge base concerning ID/SA mothers’ caring for their infants/children. By providing a simple low cost program, easily incorporated into existing rehabilitation curricula, the study helps educators and healthcare providers better understand the needs of the ID/SA mothers. This study supports Bandura’s theory that parents who are secure in their efficacy can navigate through the various phases of their child’s development and are less vulnerable to stress (Bandura, 1994).

An alignment based similarity measure for hand detection in cluttered sign language video

Locating hands in sign language video is challenging due to a number of factors. Hand appearance varies widely across signers due to anthropometric variations and varying levels of signer proficiency. Video can be captured under varying illumination, camera resolutions, and levels of scene clutter, e.g., high-res video captured in a studio vs. low-res video gathered by a web cam in a user’s home. Moreover, the signers’ clothing varies, e.g., skin-toned clothing vs. contrasting clothing, short-sleeved vs. long-sleeved shirts, etc. In this work, the hand detection problem is addressed in an appearance matching framework. The Histogram of Oriented Gradient (HOG) based matching score function is reformulated to allow non-rigid alignment between pairs of images to account for hand shape variation. The resulting alignment score is used within a Support Vector Machine hand/not-hand classifier for hand detection. The new matching score function yields improved performance (in ROC area and hand detection rate) over the Vocabulary Guided Pyramid Match Kernel (VGPMK) and the traditional, rigid HOG distance on American Sign Language video gestured by expert signers. The proposed match score function is computationally less expensive (for training and testing), has fewer parameters and is less sensitive to parameter settings than VGPMK. The proposed detector works well on test sequences from an inexpert signer in a non-studio setting with cluttered background.

Effects of real -time captioning and sign language interpreting on the learning of college students who are deaf or hard of hearing

College personnel are required to provide accommodations for students who are deaf and hard of hearing (D/HoH), but few empirical studies have been conducted on D/HoH students as they learn under the various accommodation conditions (sign language interpreting, SLI, real-time captioning, RTC, and both). Guided by the experiences of students who are D/HoH at Miami-Dade College (MDC) who requested RTC in addition to SLI as accommodations, the researcher adopted Merten’s transformative-emancipatory theoretical framework that values perceptions and voice of students who are D/HoH. A mixed methods design addressed two research questions: Did student learning differ for each accommodation? What did students experience while learning through accommodations? Participants included 30 students who were D/HoH (60% women). They represented MDC’s majority minority population: 10% White (non-Hispanic), 20% Black (non-Hispanic, including Haitian/Caribbean), 67% Hispanic, and 3% other. Hearing loss, ranged from severe-profound (70%) to mild-moderate (30%). All were able to communicate with American Sign Language: Learning was measured while students who were D/HoH viewed three lectures under three accommodation conditions (SLI, RTC, SLI+RTC). The learning measure was defined as the difference in pre- and post-test scores on tests of the content presented in the lectures. Using repeated measure ANOVA and ANCOVA, confounding variables of fluency in American Sign Language and literacy skills were treated as covariates. Perceptions were obtained through interviews and verbal protocol analysis that were signed, videotaped, transcribed, coded, and examined for common themes and metacognitive strategies. No statistically significant differences were found among the three accommodations on the learning measure. Students who were D/HoH expressed thoughts about five different aspects of their learning while they viewed lectures: (a) comprehending the information, (b) feeling a part of the classroom environment, (c) past experiences with an accommodation, (d) individual preferences for an accommodation, (e) suggestions for improving an accommodation. They exhibited three metacognitive strategies: (a) constructing knowledge, (b) monitoring comprehension, and (c) evaluating information. No patterns were found in the types of metacognitive strategies used for any particular accommodation. The researcher offers recommendations for flexible applications of the standard accommodations used with students who are D/HoH.

Validation of an Australian sign language instrument of outcome measurement for adults in mental health settings

Objective: There are currently no adult mental health outcome measures that have been translated into Australian sign language (Auslan). Without a valid and reliable Auslan outcome measure, empirical research into the efficacy of mental health interventions for sign language users is unattainable. To address this research problem the Outcome Rating Scale (ORS), a measure of general functioning, was translated into Auslan and recorded on to digital video disk for use in clinical settings. The purpose of the present study was therefore to examine the reliability, validity and acceptability of an Auslan version of the ORS (ORS-Auslan). Method: The ORS-Auslan was administered to 44 deaf people who use Auslan as their first language and who identify as members of a deaf community (termed ‘Deaf’ people) on their first presentation to a mental health or counselling facility and to 55 Deaf people in the general community. The community sample also completed an Auslan version of the Depression Anxiety Stress Scale-21 (DASS-21). Results: t-Tests indicated significant differences between the mean scores for the clinical and community sample. Internal consistency was acceptable given the low number of items in the ORS-Auslan. Construct validity was established by significant correlations between total scores on the DASS-21-Auslan and ORS-Auslan. Acceptability of ORS-Auslan was evident in the completion rate of 93% compared with 63% for DASS-21-Auslan. Conclusions: This is the only Auslan outcome measure available that can be used across a wide variety of mental health and clinical settings. The ORS-Auslan provides mental health clinicians with a reliable and valid, brief measure of general functioning that can significantly distinguish between clinical and non-clinical presentations for members of the Deaf community.

Digging into signs: Developing standard annotation practices for cross-linguistic, quantitative analysis of sign language data. Final Report.

For sign languages used by deaf communities, linguistic corpora have until recently been unavailable, due to the lack of a writing system and a written culture in these communities, and the very recent advent of digital video. Recent improvements in video and computer technology have now made larger sign language datasets possible; however, large sign language datasets that are fully machine-readable are still elusive. This is due to two challenges. 1. Inconsistencies that arise when signs are annotated by means of spoken/written language. 2. The fact that many parts of signed interaction are not necessarily fully composed of lexical signs (equivalent of words), instead consisting of constructions that are less conventionalised. As sign language corpus building progresses, the potential for some standards in annotation is beginning to emerge. But before this project, there were no attempts to standardise these practices across corpora, which is required to be able to compare data crosslinguistically. This project thus had the following aims: 1. To develop annotation standards for glosses (lexical/word level) 2. To test their reliability and validity 3. To improve current software tools that facilitate a reliable workflow Overall the project aimed not only to set a standard for the whole field of sign language studies throughout the world but also to make significant advances toward two of the world’s largest machine-readable datasets for sign languages – specifically the BSL Corpus (British Sign Language, http://bslcorpusproject.org) and the Corpus NGT (Sign Language of the Netherlands, http://www.ru.nl/corpusngt).

The role of syllables in sign language production

The aim of the present study was to investigate the functional role of syllables in sign language and how the different phonological combinations influence sign production. Moreover, the influence of age of acquisition was evaluated. Deaf signers (native and non-native) of Catalan Signed Language (LSC) were asked in a picture-sign interference task to sign picture names while ignoring distractor-signs with which they shared two phonological parameters (out of three of the main sign parameters: Location, Movement, and Handshape). The results revealed a different impact of the three phonological combinations. While no effect was observed for the phonological combination Handshape-Location, the combination Handshape-Movement slowed down signing latencies, but only in the non-native group. A facilitatory effect was observed for both groups when pictures and distractors shared Location-Movement. Importantly, linguistic models have considered this phonological combination to be a privileged unit in the composition of signs, as syllables are in spoken languages. Thus, our results support the functional role of syllable units during phonological articulation in sign language production.

Sign language in Spanish television. Study on reception

The present article analyses the preferences of the deaf who use sign language and are users of the TV interpretation service to sign language, as well as the characteristics with which TV channels provide that service in television in Spain. The objective is to establish whether the way in which the aforementioned accessibility service is provided matches the preferences of users or differ from them. The analysis presents the opinion on this service of the deaf that use the Spanish sign language as their first language for communication. A study has also been conducted on the programmes broadcast with sign language during week 10-16/03/2014. The main data collected reveal that the deaf are dissatisfied with broadcasting times. They ask for news programmes with sign language, they would rather have the interpretation carried out by deaf people who use sign language and they prefer that the interpreter is the main image on screen. Concerning the analysis of the programmes broadcast, the study shows that the majority of programmes with sign language are broadcast at night, they are entertainment programmes, the interpretation is carried out by hearing people who use sign language and that their image is displayed in a corner of the screen.

The sight of silence : the conceptualisation of silence in the visual cultures of sign language communities

Deaf people are perceived by hearing people as living in a silent world. Yet, silence cannot exist without sound, so if sound is not heard, can there be silence? From a linguistic point of view silence is the absence of, or intermission in, communication. Silence can be communicative or noncommunicative. Thus, silence must exist in sign languages as well. Sign languages are based on visual perception and production through movement and sight. Silence must, therefore, be visually perceptible; and, if there is such a thing as visual silence, how does it look? The paper will analyse the topic of silence from a Deaf perspective. The main aspects to be explored are the perception and evaluation of acoustic noise and silence by Deaf people; the conceptualisation of silence in visual languages, such as sign languages; the qualities of visual silence; the meaning of silence as absence of communication (particularly between hearing and Deaf people); social rules for silence; and silencing strategies.