Fourth generation evaluation revisited: Testing a revised pause model

This research provides data which investigates the feasibility of using fourth generation evaluation during the process of instruction. A semester length course entitled "Multicultural Communications", (PUR 5406/4934) was designed and used in this study, in response to the need for the communications profession to produce well-trained culturally sensitive practitioners for the work force and the market place. A revised pause model consisting of three one-on-one indepth interviews conducted outside of the class, three reflections periods during the class and a self-reflective essay prepared one week before the end of the course was analyzed. Narrative and graphic summaries of participant responses produced significant results. The revised pause model was found to be an effective evaluation method for use in multicultural education under certain conditions as perceived by the participants in the study. participant self-perceived behavior change and knowledge acquisition was identified through use of the revised pause model. Study results suggest that by using the revised pause model of evaluation, instructors teaching multicultural education in schools of journalism and mass communication is yet another way of enhancing their ability to become both the researcher and the research subject. In addition, the introduction of a qualitative model has been found to be a more useful way of generating participant involvement and introspection. Finally, the instructional design of the course used in the study provides communication educators with a practical way of preparing their students be effective communicators in a multicultural world.

Assessing the effectiveness of five-year mechanical engineering technology programs of junior colleges in Taiwan, R.O.C.: An application of the CIPP evaluation model

The purpose of this study was to evaluate the mechanical engineering technology curriculum effectiveness at the junior college in Taiwan by using the CIPP evaluation model. The study concerned the areas of the curriculum, curriculum materials, individualized instruction, support services, teaching effectiveness, student achievement, and job performance. A descriptive survey method was used with questionnaires for data collection from faculty, students, graduates, and employers.^ All categories of respondents tended to agree that the curriculum provides appropriate occupational knowledge and skills. Students, graduates, and faculty tended to be satisfied with the curriculum; faculty tended to be satisfied with student achievement; graduates tended to be satisfied with their job preparation; and employers were most satisfied with graduates' job performance.^ Conclusions were drawn in the context, input, process, and product of the CIPP model. In Context area: Students were dissatisfied with curriculum flexibility in students characteristics. Graduates were dissatisfied with curriculum design for student's adaptability in new economic and industrial conditions; practicum flexibility in student characteristics; and course overlap. Both students and graduates were dissatisfied with practicum credit hours. Both faculty and students were dissatisfied with the number of required courses.^ In Input area: Students, faculty, and graduates perceived audiovisuals and manipulative aids positively. Faculty and students perceive CAI implementation positively. Students perceived textbooks negatively.^ In Process area: Faculty, students, and graduates perceived all support service negatively. Faculty tended to perceive the ratios of graduates who enter advanced study and related occupation, and who passed the professional skills certification, negatively. Students tended to perceive teaching effectiveness in terms of instructional strategies, the quality of instruction, overall suitability, and receivable, negatively. Graduates also tended to identify the instructional strategies as a negative perception. Faculty and students perceived curriculum objectives and practicum negatively. Both faculty and students felt that instructors should be more interested in making the courses a useful learning experience.^ In Product area: Employers were satisfied with graduates' academic preparation and job performance, adaptability, punctuality, and their ability to communicate, cooperate, and meet organization needs. Graduates were weak in terms of equipment familiarity and supervisory ability.^ In sum, the curriculum of the five-year mechanical engineering technology programs of junior college in Taiwan has served adequately up to this time in preparing a work force to enter industry. It is now time to look toward the future and adapt the curriculum and instruction for the future needs of this high-tech society. ^

Problems faced by beginning principals

The job of a principal is becoming more demanding and more critical each year. Principals are asked to undertake huge challenges and to succeed regardless of what obstacles lie ahead. The purpose of this study was to identify which Administrative Task Areas and Specific Task Areas caused the most difficulties for first- and second-year principals.^ A survey was taken of first- and second-year principals in Dade County, Florida. These beginning principals rated their level of proficiency for each administrative task area and each specific task within those areas. Participants rated their perceptions on a scale from one to four. The data were analyzed based on frequency distributions, percentages, means, and standard deviations.^ Beginning principals perceived themselves as least proficient in the administrative task areas of management and personnel duties. They believed their strongest areas were curriculum and instruction and school-community relations. Within these areas, the specific administrative task areas identified as most problematic were identifying proper procedures for construction in the schools, visiting classrooms to help teachers improve instruction, awareness of issues related to school law, establishing accounting procedures for the school's internal funds, and procedures for dismissing incompetent staff members.^ Many beginning principals surveyed volunteered to make recommendations for future beginning principals. Of these recommendations, the most popular responses addressed obtaining more experience with the budget and internal funds prior to becoming a principal. In addition, there was a strong need for more training dealing with school personnel and the importance of networking with a veteran principal.^ The principal training programs for five of the largest school districts in Florida were reviewed. These programs were found to incorporate a vast amount of the recommendations included in the literature. Florida is moving in the right direction toward excellence in the public schools. ^

A curricular analysis of the servicing of students who are hearing impaired in Dade County, Florida

Deafness is an invisible handicap which makes education difficult due to its effect on language acquisition and development, speech acquisition, and ability to communicate with others. Teachers of students who are hearing impaired have been at odds for more than a century as to the best method of communication to use in teaching students who are hearing impaired, and in providing these students with communication systems that will enable them to be effective communicators. This dissertation utilized qualitative research methods to analyze whether the Dade County Public Schools Procedures for Providing Special Education for Exceptional Students-Hearing Impaired (DCPS), (1976-77; 1992-93) show evidence of an appropriate curriculum and instructional program that is responsive to the conditions facing exceptional education students identified as hearing impaired. Results indicate that many of the curriculum and instructional program requirements are not identified nor described when analyzed by Tyler's "Rationale" for Curriculum and Stufflebeam's Improvement-Oriented Evaluation Model, better known as Stufflebeam's CIPP Model. Recommendations to improve and enhance programs for students who are hearing impaired are offered based on this analysis. ^

Profile of planning: A study of a three-year project on the implementation of collaborative library media programs

The implementation of collaborative planning and teaching models in ten flexibly scheduled elementary and middle school library media centers was studied to determine which factors facilitated the collaborative planning process and to learn what occurs when library media specialists (LMSs) and classroom teachers (CTs) plan together. In this qualitative study, 61 principals, CTs, and LMSs were interviewed on a range of topics including the principal's role, school climate, the value of team planning, the importance of information literacy instruction, and the ideal learning environment. Other data sources were observations, videotapes of planning sessions, and documents. This three-year school reform effort was funded by the Library Power Project to improve library programs, to encourage collaborative planning, and to increase curricular integration of information literacy skills instruction. ^ The findings included a description of typical planning sessions and the identification of several major factors which impacted the success of collaborative planning: the individuals involved, school climate, time for planning, the organization of the school, the facility and collection, and training. Of these factors, the characteristics and actions of the people involved were most critical to the implementation of the innovation. The LMS was the pivotal player and, in the views of CTs, principals, and LMSs themselves, must be knowledgeable about curriculum, the library collection, and instructional design and delivery; must be open and welcoming to CTs and use good interpersonal skills; and must be committed to information literacy instruction and willing to act as a change agent. The support of the principal was vital; in schools with successful programs, the principal served as an advocate for collaborative planning and information literacy instruction, provided financial support for the library program including clerical staff, and arranged for LMSs and CTs to have time during the school day to plan together. ^ CTs involved in positive planning partnerships with LMSs were flexible, were open to change, used a variety of instructional materials, expected students to be actively involved in their own learning, and were willing to team teach with LMSs. Most CTs planning with LMSs made lesson plans in advance and preferred to plan with others. Also, most CTs in this study planned with grade level or departmental groups, which expedited the delivery of information literacy instruction and the effective use of planning time. ^ Implications of the findings of this research project were discussed for individual schools, for school districts, and for colleges and universities training LMSs, CTs, and administrators. Suggestions for additional research were also included. ^

Middle school teachers perspectives on inclusion: A qualitative study

Historically, research has placed considerable emphasis on developing a systematic body of knowledge about education in which little voice has been given to teachers themselves. The critical role that teachers play in this generative process such as reflecting, acting and theorizing upon practices that shape life in the classroom has largely been ignored in favor of technical innovation and organizational procedure. As schools struggle to reform and restructure, an understanding of how teachers interpret their practices in context and how the culture of schools influence, constrain, or encourage these practices become critical aspects of school success or failure. ^ This study examined the perspectives on inclusion of seven middle school teachers as they attempted to include exceptional students in regular classes. The study utilized three forms of data collection: observations were made of participant interactions as they led their everyday school lives; document analysis was used as a means to gain an understanding of programs affecting exceptional students, and interviews were used to give voice to teacher's perceptions regarding inclusion, allowing description in their own words rather than those imposed by an outside inquirer. Data collection and analysis sought to identify emerging themes, categories and patterns, allowing for the creation of substantive theory grounded in empirical data. ^ The key issues that emerged in the study were considered in terms of three general categories. The first, teaching and learning, revealed stark contrasts in opinions regarding the type of human support thought necessary for successful inclusion. Regular educators clung to the traditional notion of solitary teachers directing all class activity, while exceptional educators preferred a more team-oriented approach. The second, school structure, revealed that highly collaborative structures were only partially successful in creating additional conversation between regular and exceptional educators. Collegiality was affected by lack of staff experience with the process as well as its implementation in a top-down fashion. The third, school culture and climate, revealed that regular educators believed the school was prepared for a limited amount of inclusion. Although exceptional educators acknowledged school readiness, they did not believe that inclusion was an important item on the school's reform agenda. ^

The effects of using an alternative method for teaching badminton to post secondary level students in Taiwan

The effect of teaching method in physical education is an important issue and has been a concern of the expert teacher. Teachers are expected to create a model of teaching in their field; therefore, it is reasonable to question what is the effect of an alternative teaching method on student performance in physical education. This study explores whether teaching methods with advanced planning, behavior and belief in high enthusiasm, use of instructional strategies and evaluation, together termed a systematic teaching approach, used in a physical education activity would provide an effective environment for learning which supports student achievement in the psychomotor, cognitive, and affective domains. This study also investigated whether there was a difference in performance between students who were taught with a systematic teaching approach and students who were taught with the traditional teaching model. Information was collected using two performance skills, a written test, and one questionnaire. The 68 participants were randomly assigned into either an experimental group or a control group. Two teachers were assigned to either the experimental group or the control group. The teaching experiment took place at Tamsui Oxford University College in Taiwan and lasted eight weeks. ^ Research questions were analyzed using the t-test. Results indicated that a significant difference in students' performance was found between the experimental group and the control group on both the skill tests and the paper test. Analysis of student attitude toward their teacher and their course on the questionnaire indicated a significant difference between the experimental group and the control group. ^ The findings of this study imply that students who were taught with a systematic teaching style were significantly superior to students who were taught with the traditional model on these measures. This finding supports the contention that effective teaching in physical education is related to advanced planning, high enthusiasm, instructional strategy and evaluation and that all physical education teachers should implement these planning elements in the development of the teaching strategies. ^

A case study of a liberal Jewish day school's middle school transition

The Jacobson Sinai Academy is a Liberal Reform Jewish Day School, in North Miami Beach, Florida. When the Academy was started over 18 years ago it was designed as a K–6 school. This was in keeping with the existing model for Reform day schools at the time and met the needs and desires of the early founders. The philosophy of the school addressed meeting the needs of the individual child as well as the fostering of Judaic values and traditions in an academically nurturing and experiential setting. Upon graduation, students moved from the Academy to a variety of public and private options, all of which served the needs of the families at the time. In recent years, due to numerous factors within the community, parents voiced concerns as to where their children would continue their education during the critical middle school years. As a result of these concerns, and through the efforts of a dedicated group of parents and lay leaders, the decision was made to add an upper school component to the existing elementary configuration. This study is a qualitative case study which chronicles the organizational change effort that was undertaken for this purpose to determine facilitating conditions and impediments leading to the change. The analysis serves to inform others wishing to advance such an undertaking. ^ Results of the study indicated that certain conditions are necessary for the successful implementation of any change effort. The culture of the organization must be acknowledged and is a primary factor to be considered when advancing change. Collaboration with those committed to the enterprise must occur, and this in turn can lead to an agreed upon philosophy which expresses the diversity of needs and values of all of those involved. Resistance, while expected from certain individuals within the organization, can be overcome through the efforts of key players who assume leadership positions that are transformational in nature. Additionally, the rationale for middle schools, and the need for this one in particular, are factors which led to the success of this initiative. ^

Effects of phonetic/phonics instruction on reading pronunciation (French level I)

Pronunciation training has been traditionally viewed as of limited importance in a communicatively oriented foreign language curriculum (Pennington & Richards, 1986). Many language instructors seemingly deny the usefulness of phonetic training and rely on a listen-and-repeat method with the use of audiotapes (Bate, 1989; Callamand & Pedoya, 1984; Jones, 1997). Beginners in French classes face the challenge of mastering a complex sound and grapheme-phoneme correspondence system without the benefit of specific instruction. Their pronunciation errors develop mostly from bad habits while decoding from print to sound (Dansereau, 1995). ^ The purpose of this study was to investigate the effectiveness of basic phonetic/phonics instruction on reading pronunciation accuracy in a French I language course. ^ The sample consisted of two groups of French I students from Florida International University, who received the same instruction in French language and culture during the fall semester of 1999. Only the experimental group received additional phonetic/phonics training. ^ The instrument consisted of three recorded reading tasks: isolated familiar words, isolated unfamiliar words, and dialogue. Research questions were analyzed using a one-way multivariate analysis of variance. Significant differences were found between the two groups on scores for each of the three sections of the instrument, and on the total scores. These findings support the hypothesis of the study and reveal the effectiveness of phonetic/phonics training for beginners of French. ^ The findings imply that beginning language students should receive the minimum knowledge they need to master the French phoneme-grapheme (sound-spelling) system. ^

The efficacy of the Ellison model as a retention initiative for first semester freshmen

The freshman year is the most critical year of matriculation for students in higher education. One in four freshman students drops out of higher education after the first year. In fact, the first two to six weeks of college represent a very critical transition period when students make the decision to persist or depart from the institution. Many students leave because they are unable to make a connection with the institution. Retention is often profoundly affected by student involvement in the academic environment, satisfaction with the campus climate and the institution's response to diversity. Therefore, the purpose of this study was to examine and evaluate an effective institutional response that promotes freshman retention and academic success. The tenets (diversity training, conflict management, and community building) of a mentoring model were applied to the freshman experience seminar class (experimental group) as a pedagogical method of instruction to determine its efficacy as a retention initiative when compared with the traditional freshman experience seminar class (comparison group). ^ The quantitative study employed a quasi-experimental research design based on Astin's (1993) I-E-O model. The model examined the relationships between the characteristics students bring with them to college, called inputs, their experiences in the environment during college, and the outcomes students achieved during matriculation. Fifty-two students enrolled in the freshman seminar class participated in the study. ^ Demographic data and input variables between groups were analyzed using chi-square, t-tests and multivariate analyses. Overall, students in the experimental group had significantly higher satisfaction (campus climate) scores than the comparison group. An analysis of the students' willingness to interact with others from diverse groups indicated a significant difference between groups, with the experimental group scoring higher than the comparison group. Students in the experimental group were significantly more involved in campus activities than students in the comparison group. No significant differences were found between groups relative to the mean grade point average and re-enrollment for fall semester 2001. ^ While the mentoring model did not directly affect re-enrollment of students, the model did promote student satisfaction with the institution, an appreciation for diversity of contact and it encouraged involvement in the campus community. These are all essential outcomes of a quality retention program. ^

An analysis of teachers' perceptions of informal science professional development

Science professional development, which is fundamental to science education improvement, has been described as being weak and fragmentary. The purpose of this study was to investigate teachers' perceptions of informal science professional development to gain an in-depth understanding of the essence of the phenomenon and related science-teaching dispositions. Based on the frameworks of phenomenology, constructivism, and adult learning theory, the focus was on understanding how the phenomenon was experienced within the context of teachers' everyday world. ^ Data were collected from eight middle-school teachers purposefully selected because they had participated in informal programs during Project TRIPS (Teaching Revitalized Through Informal Programs in Science), a collaboration between the Miami-Dade school district, government agencies (including NASA), and non-profit organizations (including Audubon of Florida). In addition, the teachers experienced hands-on labs offered through universities (including the University of Arizona), field sites, and other agencies. ^ The study employed Seidman's (1991) three-interview series to collect the data. Several methods were used to enhance the credibility of the research, including using triangulation of the data. The interviews were transcribed, color-coded and organized into six themes that emerged from the data. The themes included: (a) internalized content knowledge, (b) correlated hands-on activities, (c) enhanced science-teaching disposition, (d) networking/camaraderie, (e) change of context, and (f) acknowledgment as professionals. The teachers identified supportive elements and constraints related to each theme. ^ The results indicated that informal programs offering experiential learning opportunities strengthened understanding of content knowledge. Teachers implemented hands-on activities that were explicitly correlated to their curriculum. Programs that were conducted in a relaxed context enhanced teachers' science-teaching dispositions. However, a lack of financial and administrative support, perceived safety risks, insufficient reflection time, and unclear itineraries impeded program implementation. The results illustrated how informal educators can use this cohesive model as they develop programs that address the supports and constraints to teachers' science instruction needs. This, in turn, can aid teachers as they strive to provide effective science instruction to students; notions embedded in reforms. Ultimately, this can affect how learners develop the ability to make informed science decisions that impact the quality of life on a global scale. ^

Making the grade: The perceived impact of Florida's A+ Plan on the learning environment of one elementary school

The purpose of this study was to ascertain the perceptions of educators at one elementary school regarding the changes in the teaching and learning environment and their related effects following the implementation of Florida's A+ high-stakes accountability system. This study also assessed whether these changes were identified by participants as meaningful and enduring, in terms of the definition by Lieberman and Miller (1999). Twenty-one educators, including 17 teachers and four administrators, at Blue Ribbon Elementary school were interviewed. Data were inductively coded and categorized into four major themes: (a) teaching and learning environment consistency, (b) changes in the teaching and learning environment since the implementation of A+, (c) effects of the changes, and (d) significant and enduring change. Findings fell into three categories (a) identified changes since A+ implementation, (b) effects of changes, and (c) what participants believed was significant and long term change, which included those characteristics of the school that had been identified as consistent in the teaching and learning environment. Statements of the participants explained their perceptions about what instructional decisions where made in response to the A+ Plan including the modification of curriculum, the addition or omission of subject matter taught, and the positive or negative impact these decisions had on the teaching and learning environment. It was found that study participants felt all changes and their effects were a direct result of the A+ Plan and viewed many of the changes as being neither significant nor long term Analysis of the educators' perceptions of the changes they experienced revealed the overall feeling that the changes were not indicative of what was necessary to make a school successful. For the participants, the changes lacked the characteristics that they had described as vital in what constituted success. This led to the conclusion that, by Lieberman and Miller's definition, the majority of changes and effects that were implemented at the school as a result of the mandated A+ Plan, were not meaningful and enduring for effective school reform. ^

The effect of a reform on a school organizational culture after receiving a failing Florida Comprehensive Assessment Test rating

The purpose of this research was to explore the effects of a reform that took place in an elementary school during 2000/2001 as a result of a failure rating on the Florida Comprehensive Assessment Test on the structure and the personnel of the organization. ^ The exploration took place over a period of 10 months starting in August 2000 until June 2001. It focused on the effect of the failure rating on the: (a) structure and operation of the school; (b) morale, beliefs, behaviors, and daily lives of teachers and the principal; and (c) the effect of the reform effort on the leadership style of the principal, whether she became a transactional or a transformative leader. ^ The researcher assumed the role of a participant observer. Data sources were her personal recollections of major events that took place during the year of the reform, interviews, observations, and school documents. The sample included 15 teachers present during the time of the reform. Ten taught second through fifth grade. The remaining five participants were the music teacher, the counselor, and the writing, reading and technology specialists. Together they represented the instructional team or represented special education areas. ^ The findings indicated that the reform effort had an effect on the structure and the operation of the school. The changes included reorganization of the physical set up, changes in curriculum and instruction, changes in the means of communication among the staff, and the addition of new staff members including an official agent of change. The reform had a greater effect on the daily lives of teachers and their morale than on their beliefs and behaviors. Teachers reported that during the effort their daily lives were stressful and their morale very low due to the enormous expectations that they had to meet. On the other hand, the reform effort had a positive effect on the daily life, morale, beliefs, and behaviors of the principal. It energized her. She spoke positively about the change. She functioned as an effective, positive, resilient transactional leader who did what was necessary in order to enable the teachers to cope with the complex situation. ^

The predictive power of homework assignments on student achievement in grade three

Homework has been a controversial issue in education for the past century. Research has been scarce and has yielded results at both ends of the spectrum. This study examined the relationship between homework performance (percent of homework completed and percent of homework correct), student characteristics (SAT-9 score, gender, ethnicity, and socio-economic status), perceptions, and challenges and academic achievement determined by the students' average score on weekly tests and their score on the FCAT NRT mathematics assessment. ^ The subjects for this study consisted of 143 students enrolled in Grade 3 at a suburban elementary school in Miami, Florida. Pearson's correlations were used to examine the associations of the predictor variables with average test scores and FCAT NRT scores. Additionally, simultaneous regression analyses were carried out to examine the influence of the predictor variables on each of the criterion variables. Hierarchical regression analyses were performed on the criterion variables from the predictor variables. ^ Homework performance was significantly correlated with average test score. Controlling for the other variables homework performance was highly related to average test score and FCAT NRT score. ^ This study lends support to the view that homework completion is highly related to student academic achievement at the lower elementary level. It is suggested that at the elementary level more consideration be given to the amount of homework completed by students and to utilize the information in formulating intervention strategies for student who may not be achieving at the appropriate levels. ^

Teachers' perceptions of the national board certification process: Developing a sense of professionalism

This study describes and explains the experiences and perceptions of six public school teachers who had undergone the National Board for Professional Teaching Standards national certification process as a vehicle for promoting a teacher's sense of professionalism. Of these six participants, two achieved National Board certification, two did not achieve National Board certification, and two are awaiting results of their certification status. The study took place over a period of eleven months and focused on the participants' perceptions regarding the National Board certification process as it affected their sense of (a) efficacy and (b) professionalism. Data for this collective case study were gathered from interviews, portfolios and videotapes, and artifacts. Using case analysis, this study's participants' responses gathered through the interview process were examined. ^ The findings indicated that participants had concerns about the National Board certification process in the following areas: process, sense of efficacy, and sense of professionalism. All participants reported the process to be overwhelmingly demanding. Analysis of the data also reveals that those who were successful in achieving National Board certification had a greater sense of efficacy than those who did not. A disappointing finding was that the National Board process impacting participants' sense of professionalism could not be sustained; however, the participants in this study suggested the process was a step towards providing opportunities for collaboration, collegiality, and reflective practice. This study raises the question as to whether or not the espoused purposes of National Board certification are achieved via the certification process. ^