Cultural influence and learning to teach: Beginning teachers' perceptions of teacher preparation programs and school support systems

Beginning teachers in the field of English Language Arts and Reading are responsible for providing literacy instruction to students. Teachers need a broad background in teaching reading, writing, listening, speaking, and viewing, as well as critical thinking. In secondary schools in particular, beginning English Language Arts and Reading teachers are also faced with the challenge of preparing students to be proficient enough readers and writers to meet required State standards. Beginning teachers must navigate compelling challenges that exist during the first years of teaching. The school support systems available to new teachers are an integral part of their educational development. ^ This qualitative study was conceptualized as an in-depth examination of the experiences and perceptions of eight beginning teachers. They represented different racial/ethnic groups, attended different teacher preparation programs, and taught in different school cultures. The data were collected through formal and informal interviews and classroom observations. A qualitative system of data analysis was used to examine the patterns relating to the interrelationship between teacher preparation programs and school support systems. ^ The experiences of the beginning teachers in this study indicated that teacher education programs should provide preservice teachers with a critical knowledge base for teaching literature, language, and composition. A liberal arts background in English, followed by an extensive program focusing on pedagogy, seems to provide a thorough level of curriculum and instructional practices needed for teaching in 21st century classrooms. The data further suggested that a school support system should pair beginning teachers with mentor teachers and provide a caring, professional environment that seeks to nurture the teacher as she/he develops during the first years of teaching. ^

Effects of Family, Child, and Teacher Demographics on Prekindergarten Children's Access to and Use of Numeracy and Spatial Materials in the Early Education Setting

Florida’s Voluntary Pre-Kindergarten program (VPK) aims to ensure that all 4-year-olds are prepared to excel in K-12 mathematics. Early numeracy/spatial skills are predictive of success in K–12 mathematics. No research has examined whether VPK classrooms are equipped with the materials necessary to teach numeracy/spatial skill. The Pre-Kindergarten Numeracy and Spatial Environment Survey was created to examine the frequency of access to and use of numeracy/spatial materials in VPK classrooms. The 69-item survey was completed by the lead educator from a sample of 62 pre-kindergarten classrooms in Miami-Dade County. Regression analysis results suggest the location of the pre-kindergarten center, the sex distribution of the children in the classrooms or the number of years of experience that the educator has as a lead teacher along with the extra training courses undertaken by the teachers does not affect the access to or the use of, numeracy and spatial materials in the classrooms.

Perceptions of beginning teachers in Florida regarding their preparation as it relates to the Florida Essential Generic Competencies

The purpose of the study is to investigate how beginning teachers in the state of Florida perceive their preparation to demonstrate the 27 Florida Essential Generic Competencies.^ The basic research question of this study was: How do beginning teachers perceive their level of preparation regarding their implementation of the Florida Essential Generic Competencies? This study identified and categorized the perceived degree of preparation for each of the competencies. Also, elementary, middle, and high school beginning teachers were compared to find significant differences and similarities in their perception of their preparation. A comparison was also done for graduates from in-state versus out-of-state and private versus public institutions.^ A survey developed in collaboration with the Department of Education, Florida State University, members of the Professional Orientation Program (POP) Coordinators, and the Project Director of Program Review in the College of Education at the University of South Florida, was sent to 5,076 beginning teachers. A total of 1,995 returned the survey in February of 1993. The Multivariate Analysis of Variance (MANOVA) procedure was used (Alpha =.05). Statistical analysis of the data involved a comparison of the different groups of beginning teachers by school level and kind of graduating institutions. The dependent variables analyzed were the responses to all items representing the generic competencies.^ The study identified and categorized the degree of preparation for each competency. The competencies receiving the lowest ratings for degree of preparation were: integrate computers in instruction; manage situations involving child abuse and/or neglect; severe emotional stress; alcohol and drug abuse.^ The Wilkes lambda and the Hotellings multivariate tests of significance were used to examine the differences among the groups. The competency items were further analyzed by a univariate F test. Results indicated that: (1) significant differences were found in nine competency items in which elementary teachers felt better prepared than middle and high school beginning teachers, (2) graduates from a Florida teacher education program felt they were better prepared in demonstrating the competencies than those from out-of-state schools, and (3) no significant difference was found in the perceptions of those who graduated from public versus private institutions.^ Based on the findings of this study, the following recommendations are made: (1) Florida's institutions responsible for teacher preparation programs need to focus on those competencies receiving the lowest ratings, (2) Districts should provide an orientation program for out-of-state beginning teachers, and (3) The survey instrument should be used annually to evaluate teacher education programs. ^

The relationship between the teacher's experience, the teacher's college major, and the teacher's level of education in predicting classroom attitudes in high school science students

A review of the literature reveals few research has attempted to demonstrate if a relationship exists between the type of teacher training a science teacher has received and the perceived attitudes of his/her students. Some of the teacher preparation factors examined in this study include the college major chosen by the science teacher, the highest degree earned, the number of years of teaching experience, the type of science course taught, and the grade level taught by the teacher. This study examined how the various factors mentioned, could influence the behaviors which are characteristic of the teacher, and how these behaviors could be reflective in the classroom environment experienced by the students.^ The instrument used in the study was the Classroom Environment Scale (CES), Real Form. The measured classroom environment was broken down into three separate dimensions, with three components within each dimension in the CES. Multiple Regression statistical analyses examined how components of the teachers' education influenced the perceived dimensions of the classroom environment from the students.^ The study occurred in Miami-Dade County Florida, with a predominantly urban high school student population. There were 40 secondary science teachers involved, each with an average of 30 students. The total number of students sampled in the study was 1200. The teachers who participated in the study taught the entire range of secondary science courses offered at this large school district. All teachers were selected by the researcher so that a balance would occur in the sample between teachers who were education major versus science major. Additionally, the researcher selected teachers so that a balance occurred in regards to the different levels of college degrees earned among those involved in the study.^ Several research questions sought to determine if there was significant difference between the type of the educational background obtained by secondary science teachers and the students' perception of the classroom environment. Other research questions sought to determine if there were significant differences in the students' perceptions of the classroom environment for secondary science teachers who taught biological content, or non-biological content sciences. An additional research question sought to evaluate if the grade level taught would affect the students' perception of the classroom environment. (Abstract shortened by UMI.) ^

Teacher efficacy of special education teachers of English language learners with disabilities

This research examined the perceived teacher efficacy of special education teachers of English Language Learners (ELLs) with educational disabilities by surveying 202 elementary special education teachers using the EXCEL Teacher Inventory. EXCEL consists of 20 teacher efficacy items, three open-ended questions, and participant demographic items. ^ Overall participant teacher efficacy scores were high. Of the variables assessed, a statistically significant difference in perceived efficacy was found with self-reported proficiency in the language of the target students. No statistically significant differences in teacher efficacy scores were found for (a) levels of teacher preparation; (b) number of years of teaching experience; or (c) socioeconomic status of the students. A multiple regression analysis indicated that, of the variables listed above, proficiency in the language of the target students accounted for significant variance in predicting the level of teachers' perceived efficacy. ^ Responses to the open-ended questions about what was most helpful when working with ELLs with disabilities yielded two major themes: organizational issues and teacher issues. Participants wrote numerous comments about the value of support from educational professionals and parents. Many participants recommended individuals in preservice programs take ESOL content specific courses. ^ The results demonstrate the positive correlation between proficiency in the language of the target students and teacher efficacy. This suggests that teachers of ELLs with disabilities have proficiency in the ELLs' native language (or have support from others who are language proficient) that allows them to distinguish between language difference and language disability and provide instruction in the native language when needed. Further, results from open-ended questions suggest that special education teacher preparation programs should include courses related specifically to strategies for teaching ELLs with disabilities, not just ELLs. ^

A comparison of the teacher efficacy and performance of traditionally and alternatively certified first -year teachers

The purpose of this study was to compare the efficacy and performance evaluations of alternatively certified first-year teachers to traditionally certified first-year teachers. The participants were 25 first-year teachers in the Broward County Public School District (FL) who completed the Transition to Teaching alternative certification program and a comparison group of 32 first-year teachers in the same school district who completed a traditional university teacher preparation program. ^ The study was a mixed methods design (Creswell, 2003; Tashakkori & Teddlie, 1998). The quantitative data were collected during the 2002–2003 school year using the Teachers' Sense of Efficacy Scale (Tschannen-Moran & Hoy, 2001) and the Florida Performance Measurement System formative and summative instruments. The qualitative data consisted of focus group interviews that were conducted at the end of the 2002–2003 school year. ^ Data were analyzed using independent samples t tests to compare the means of the two populations on their efficacy scores and performance evaluations. Paired samples t tests and analysis of covariance (ANCOVA) were used to compare the efficacy scores for each certification type at the beginning of the school year to the efficacy scores at the end of the school year. A repeated measures analysis of variance (ANOVA) was used to compare the change in the efficacy scores of the teachers from the beginning of the school year to the end of the school year. Focus group interviews were conducted and transcribed, and the content was analyzed and categorized based on the four sources of self-efficacy described by Bandura (1986, 1997). ^ The results of this study revealed that no statistically significant differences existed between the two groups of teachers in their teacher efficacy or performance evaluations and that they reported similar sources of their efficacy. These findings add to the research base that supports alternative certification as a viable and effective pathway into teaching. ^

The relationship between the secondary mathematics curriculum, college persistence, and success at an urban community college

According to Venezia, Kirst, and Antonio (2003) and Barth’s 2002 Thinking K16 Ticket to Nowhere report, the disconnect between K-12 and postsecondary education was a contributing factor to high attrition rates. Since mathematics emerged as a primary concern for college readiness, Barth (2002) called for improving student transitions from K-12 to postsecondary institutions through the use of state or local data. The purpose of the present study was to analyze mathematics course-taking patterns of secondary students in a local context and to evaluate high school characteristics in order to explore their relationships with Associate degree attainment or continuous enrollment at an urban community college. Also, this study extended a national study conducted by Clifford Adelman (The Toolbox Revisited, 2006) as it specifically focused on community college students that were not included his study. Furthermore, this study used the theoretical framework that human capital, social capital, and cultural capital influence habitus—an individual’s or a group’s learned inclination to behave within the parameters of the imposed prevailing culture and norms. Specifically, the school embedded culture as it relates to tracking worked as a reproduction tool of ultimate benefit for the privileged group (Oakes, 1994). ^ Using multilevel analysis, this ex post facto study examined non-causal relationships between math course-taking patterns and college persistence of public high school graduates who enrolled at the local community college for up to 6 years. One school-level variable (percent of racial/ethnic minorities) and 7 student-level variables (community college math proportion, remedial math attempts, race, gender, first-year credits earned, socioeconomic status, and summer credits earned) emerged as predictors for college persistence. Study results indicated that students who enter higher education at the community college may have had lower opportunities to learn and therefore needed higher levels of remediation, which was shown to detract students from degree completion. Community college leaders are called to partner with local high schools with high percentages of racial/ethnic minorities to design academic programs aimed at improving the academic preparation of high school students in mathematics and promote student engagement during the first year and summers of college. ^

The relationship between the teacher's experience, the teacher's college major, and the teacher's level of education in predicting classroom attitudes in high school science students

A review of the literature reveals few research has attempted to demonstrate if a relationship exists between the type of teacher training a science teacher has received and the perceived attitudes of his/her students. Considering that a great deal of time and energy has been devoted by university colleges, school districts, and educators towards refining the teacher education process, it would be more efficient for all parties involved, if research were available that could discern if certain pathways in achieving that education, would promote the tendency towards certain teacher behaviors occurring in the classroom, while other pathways would lead towards different behaviors. Some of the teacher preparation factors examined in this study include the college major chosen by the science teacher, the highest degree earned, the number of years of teaching experience, the type of science course taught, and the grade level taught by the teacher. This study examined how the various factors mentioned, could influence the behaviors which are characteristic of the teacher, and how these behaviors could be reflective in the classroom environment experienced by the students. The instrument used in the study was the Classroom Environment Scale (CES), Real Form. The measured classroom environment was broken down into three separate dimensions, with three components within each dimension in the CES. Multiple Regression statistical analyses examined how components of the teachers' education influenced the perceived dimensions of the classroom environment from the students. The study occurred in Miami-Dade County Florida, with a predominantly urban high school student population. There were 40 secondary science teachers involved, each with an average of 30 students. The total number of students sampled in the study was 1200. The teachers who participated in the study taught the entire range of secondary science courses offered at this large school district. All teachers were selected by the researcher so that a balance would occur in the sample between teachers who were education major versus science major. Additionally, the researcher selected teachers so that a balance occurred in regards to the different levels of college degrees earned among those involved in the study. Several research questions sought to determine if there was significant difference between the type of the educational background obtained by secondary science teachers and the students' perception of the classroom environment. Other research questions sought to determine if there were significant differences in the students' perceptions of the classroom environment for secondary science teachers who taught biological content, or non-biological content sciences. An additional research question sought to evaluate if the grade level taught would affect the students' perception of the classroom environment. Analysis of the multiple regression were run for each of four scores from the CES, Real Form. For score 1, involvement of students, the results showed that teachers with the highest number of years of experience, with masters or masters plus degrees, who were education majors, and who taught twelfth grade students, had greater amounts of students being attentive and interested in class activities, participating in discussions, and doing additional work on their own, as compared with teachers who had lower experience, a bachelors degree, were science majors, and who taught a grade lower than twelfth. For score 2, task orientation, which emphasized completing the required activities and staying on-task, the results showed that teachers with the highest and intermediate experience, a science major, and with the highest college degree, showed higher scores as compared with the teachers indicating lower experiences, education major and a bachelors degree. For Score 3, competition, which indicated how difficult it was to achieve high grades in the class, the results showed that teachers who taught non-biology content subjects had the greatest effect on the regression. Teachers with a masters degree, low levels of experience, and who taught twelfth grade students were also factored into the regression equation. For Score 4, innovation, which indicated the extent in which the teachers used new and innovative techniques to encourage diverse and creative thinking included teachers with an education major as the first entry into the regression equation. Teachers with the least experience (0 to 3 years), and teachers who taught twelfth and eleventh grade students were also included into the regression equation.

Perceptions of beginning teachers in Florida regarding their preparation as it relates to the Florida essential generic competencies

The purpose of the study is to investigate how beginning teachers in the state of Florida perceive their preparation to demonstrate the 27 Florida Essential Generic Competencies. The basic research question of this study was: How do beginning teachers perceive their level of preparation regarding their implementation of the Florida Essential Generic Competencies? This study identified and categorized the perceived degree of preparation for each of the competencies. Also, elementary, middle, and high school beginning teachers were compared to find significant differences and similarities in their perception of their preparation. A comparison was also done for graduates from in-state versus out-of-state and private versus public institutions. A survey developed in collaboration with the Department of Education, Florida State University, members of the Professional Orientation Program (POP) Coordinators, and the Project Director of Program Review in the College of Education at the University of South Florida, was sent to 5,076 beginning teachers. A total of 1,995 returned the survey in February of 1993. The Multivariate Analysis of Variance (MANOVA) procedure was used (Alpha = .05). Statistical analysis of the data involved a comparison of the different groups of beginning teachers by school level and kind of graduating institutions. The dependent variables analyzed were the responses to all items representing the generic competencies. The study identified and categorized the degree of preparation for each competency. The competencies receiving the lowest ratings for degree of preparation were: integrate computers in instruction; manage situations involving child abuse and/or neglect; severe emotional stress; alcohol and drug abuse. The Wilkes lambda and the Hotellings multivariate tests of significance were used to examine the differences among the groups. The competency items were further analyzed by a univariate F test. Results indicated that: (1) significant differences were found in nine competency items in which elementary teachers felt better prepared than middle and high school beginning teachers, (2) graduates from a Florida teacher education program felt they were better prepared in demonstrating the competencies than those from out-of-state schools, and (3) no significant difference was found in the perceptions of those who graduated from public versus private institutions. Based on the findings of this study, the following recommendations are made: (1) Florida's institutions responsible for teacher preparation programs need to focus on those competencies receiving the lowest ratings, (2) Districts should provide an orientation program for out-of-state beginning teachers, and (3) The survey instrument should be used annually to evaluate teacher education programs.

Engagement experiences of Hispanic Generation 1.5 English language learners at a Massachusetts community college

Hispanic Generation 1.5 students are foreign-born, U.S. high school graduates who are socialized in the English dominant K-12 school system while still maintaining the native language and culture at home (Allison, 2006; Blumenthal, 2002; Harklau, Siegal, & Losey, 1999; Rumbault & Ima, 1988). When transitioning from high school to college, these students sometimes assess into ESL courses based on their English language abilities, and because of this ESL placement, Hispanic Generation 1.5 students might have different engagement experiences than their mainstream peers. Engagement is a critical factor in student success and long-term retention because students’ positive and negative engagement experiences affect their membership and sense of belonging at the institution. The purpose of this study was to describe the engagement and membership experiences of Hispanic Generation 1.5 students’ at a Massachusetts community college. This study employed naturalistic inquiry within an embedded descriptive case study design that included three units of analysis: the students’ engagement experiences in (a) ESL courses, (b) developmental courses, and (c) mainstream courses. The main source of data was in-depth interviews with Hispanic Generation 1.5 students at Commonwealth of Massachusetts Community College. Criterion sampling was used to select the interview participants, ensuring that all participants were native Spanish speakers and were taking or had taken at least one ESL course at the institution. The study findings show that these Hispanic Generation 1.5 students at the college did not perceive peer engagement as critical to academic success. Most times the participants avoided peer engagement outside of the classroom, especially with fellow Hispanic students, who they felt would deter them from their English language development and general academic work. Engagement with ESL faculty and ESL academic support staff played the most critical role in the participants’ sense of belonging and success, and students who were required to engage with faculty and academic support staff outside of the classroom were the most satisfied with their educational experiences. While the participants were all disappointed with some aspect of their ESL placement, they valued the ESL engagement experiences more than the engagement experiences while completing developmental and credit coursework.

Swimming against the tide: A study of a youth enrichment program seeking to empower inner-city Black youth

Serious inequities in our K-12 public education system, particularly in regard to the quality of education in predominately Black inner-city schools, are well-documented in the literature (Freeman, 1998; Ross, 1998). Moreover, there is general agreement that the most effective means of ameliorating that situation is through well-thought-out after-school programs and partnership initiatives (Beck, 1993; Gardner et al., 2001). ^ The purpose of this qualitative study was to examine the programmatic interventions of a youth enrichment program for inner-city Black youth currently in place at the Overtown Youth Center (OYC) in Miami, Florida, in order to: (a) discern those factors that support its claim that it is making a difference in students’ lives, (b) explore how any such factors are implemented, and (c) determine whether its interventions have served to equalize the playing field for these youth. ^ Two primary methods of data collection were used for this study. The first was participant observation conducted over the course of two years through a partnership initiative established and led by this author. The second was through in-depth interviews of the Center’s founder, staff, and students. Secondary methods used were the recording of informal conversations and the analysis of written documents. ^ Analysis of the data yielded four features of the Center that are indispensible to the students’ growth. The center provides the youth with (a) physical and psychological safety, (b) supportive relationships, (c) exposure to cultural and educational opportunities, and (d) assistance in building self-esteem. ^ The most significant finding of the study was that OYC has been successful at making a difference in students’ lives and at increasing their aspirations to attend college. By addressing the full spectrum of their needs, the Center has given them many of the necessary tools with which to compete and thereby helped equalize their opportunities to succeed in school and in life. ^ The study also noted a number of challenges for the Center to examine. The main issues that need to be addressed more seriously are staff turnover, staff indifference, nepotism, inconsistent student attendance, and insufficient focus on racial issues and African-American-centered education. Meeting those challenges would engender even greater positive outcomes.^

Using LatCrit, Autoethnography, and Counterstory to Teach About and Resist Latina/o Nihilism

Nihilism caused by inequalities and injustices hurts students of color. Educators can help these students with Critical Race theory and storytelling. Latina/o students also face nihilism but there is no clear solution. This study explores a way to use LatCrit in the K-12 classroom to fight for justice and equality.

The relationship of instructor technical literacy to the academic performance of students in career academies

Career Academy instructors' technical literacy is vital to the academic success of students. This nonexperimental ex post facto study examined the relationships between the level of technical literacy of instructors in career academies and student academic performance. It was also undertaken to explore the relationship between the pedagogical training of instructors and the academic performance of students. ^ Out of a heterogeneous population of 564 teachers in six targeted schools, 136 teachers (26.0 %) responded to an online survey. The survey was designed to gather demographic and teaching experience data. Each demographic item was linked by researchers to teachers' technology use in the classroom. Student achievement was measured by student learning gains as assessed by the reading section of the FCAT from the previous to the present school year. ^ Linear and hierarchical regressions were conducted to examine the research questions. To clarify the possibility of teacher gender and teacher race/ethnic group differences by research variable, a series of one-way ANOVAs were conducted. As revealed by the ANOVA results, there were not statistically significant group differences in any of the research variables by teacher gender or teacher race/ethnicity. Greater student learning gains were associated with greater teacher technical expertise integrating computers and technology into the classroom, even after controlling for teacher attitude towards computers. Neither teacher attitude toward technology integration nor years of experience in integrating computers into the curriculum significantly predicted student learning gains in the regression models. ^ Implications for HRD theory, research, and practice suggest that identifying teacher levels of technical literacy may help improve student academic performance by facilitating professional development strategies and new parameters for defining highly qualified instructors with 21st century skills. District professional development programs can benefit by increasing their offerings to include more computer and information communication technology courses. Teacher preparation programs can benefit by including technical literacy as part of their curriculum. State certification requirements could be expanded to include formal surveys to assess teacher use of technology.^

The Effect of Mobile Technology as an Active Student Response System on the Acquisition of U.S. History Content of Secondary Students with Specific Learning Disabilities

Students with specific learning disabilities (SLD) typically learn less history content than their peers without disabilities and show fewer learning gains. Even when they are provided with the same instructional strategies, many students with SLD struggle to grasp complex historical concepts and content area vocabulary. Many strategies involving technology have been used in the past to enhance learning for students with SLD in history classrooms. However, very few studies have explored the effectiveness of emerging mobile technology in K-12 history classrooms. This study investigated the effects of mobile devices (iPads) as an active student response (ASR) system on the acquisition of U.S. history content of middle school students with SLD. An alternating treatments single subject design was used to compare the effects of two interventions. There were two conditions and a series of pretest probesin this study. The conditions were: (a) direct instruction and studying from handwritten notes using the interactive notebook strategy and (b) direct instruction and studying using the Quizlet App on the iPad. There were three dependent variables in this study: (a) percent correct on tests, (b) rate of correct responses per minute, and (c) rate of errors per minute. A comparative analysis suggested that both interventions (studying from interactive notes and studying using Quizlet on the iPad) had varying degrees of effectiveness in increasing the learning gains of students with SLD. In most cases, both interventions were equally effective. During both interventions, all of the participants increased their percentage correct and increased their rate of correct responses. Most of the participants decreased their rate of errors. The results of this study suggest that teachers of students with SLD should consider a post lesson review in the form of mobile devices as an ASR system or studying from handwritten notes paired with existing evidence-based practices to facilitate students’ knowledge in U.S. history. Future research should focus on the use of other interactive applications on various mobile operating platforms, on other social studies subjects, and should explore various testing formats such as oral question-answer and multiple choice.

The effect of mobile technology as an active student response system on the acquisition of U.S. history content of secondary students with specific learning disabilities

Students with specific learning disabilities (SLD) typically learn less history content than their peers without disabilities and show fewer learning gains. Even when they are provided with the same instructional strategies, many students with SLD struggle to grasp complex historical concepts and content area vocabulary. Many strategies involving technology have been used in the past to enhance learning for students with SLD in history classrooms. However, very few studies have explored the effectiveness of emerging mobile technology in K-12 history classrooms. ^ This study investigated the effects of mobile devices (iPads) as an active student response (ASR) system on the acquisition of U.S. history content of middle school students with SLD. An alternating treatments single subject design was used to compare the effects of two interventions. There were two conditions and a series of pretest probesin this study. The conditions were: (a) direct instruction and studying from handwritten notes using the interactive notebook strategy and (b) direct instruction and studying using the Quizlet App on the iPad. There were three dependent variables in this study: (a) percent correct on tests, (b) rate of correct responses per minute, and (c) rate of errors per minute. ^ A comparative analysis suggested that both interventions (studying from interactive notes and studying using Quizlet on the iPad) had varying degrees of effectiveness in increasing the learning gains of students with SLD. In most cases, both interventions were equally effective. During both interventions, all of the participants increased their percentage correct and increased their rate of correct responses. Most of the participants decreased their rate of errors. ^ The results of this study suggest that teachers of students with SLD should consider a post lesson review in the form of mobile devices as an ASR system or studying from handwritten notes paired with existing evidence-based practices to facilitate students’ knowledge in U.S. history. Future research should focus on the use of other interactive applications on various mobile operating platforms, on other social studies subjects, and should explore various testing formats such as oral question-answer and multiple choice. ^