976 resultados para high-stakes assessment


Relevância:

80.00% 80.00%

Publicador:

Resumo:

As it is defined in ATM 2000+ Strategy (Eurocontrol 2001), the mission of the Air Traffic Management (ATM) System is: “For all the phases of a flight, the ATM system should facilitate a safe, efficient, and expedite traffic flow, through the provision of adaptable ATM services that can be dimensioned in relation to the requirements of all the users and areas of the European air space. The ATM services should comply with the demand, be compatible, operate under uniform principles, respect the environment and satisfy the national security requirements.” The objective of this paper is to present a methodology designed to evaluate the status of the ATM system in terms of the relationship between the offered capacity and traffic demand, identifying weakness areas and proposing solutions. The first part of the methodology relates to the characterization and evaluation of the current system, while a second part proposes an approach to analyze the possible development limit. As part of the work, general criteria are established to define the framework in which the analysis and diagnostic methodology presented is placed. They are: the use of Air Traffic Control (ATC) sectors as analysis unit, the presence of network effects, the tactical focus, the relative character of the analysis, objectivity and a high level assessment that allows assumptions on the human and Communications, Navigation and Surveillance (CNS) elements, considered as the typical high density air traffic resources. The steps followed by the methodology start with the definition of indicators and metrics, like the nominal criticality or the nominal efficiency of a sector; scenario characterization where the necessary data is collected; network effects analysis to study the relations among the constitutive elements of the ATC system; diagnostic by means of the “System Status Diagram”; analytical study of the ATC system development limit; and finally, formulation of conclusions and proposal for improvement. This methodology was employed by Aena (Spanish Airports Manager and Air Navigation Service Provider) and INECO (Spanish Transport Engineering Company) in the analysis of the Spanish ATM System in the frame of the Spanish airspace capacity sustainability program, although it could be applied elsewhere.

Relevância:

80.00% 80.00%

Publicador:

Resumo:

This monograph begins with a case study that provides a means for analyzing the complexity of organizational leadership in the contemporary security environment. As such, it presents a high stakes problem-set that required an operational adaptation by a cavalry squadron conducting combat operations in Baghdad. This problematic reality triggered the struggle to find a creative response to a very deadly problem, while cultural norms served as barriers that prevented the rejection of previously accepted solutions that had proven successful in the past, even though those successful solutions no longer fit in the context of the reality of the present. The case study highlights leaders who were constrained by deeply-held assumptions that inhibited their ability to adapt quickly to a changed environment. The case study then moves on to provide an example of a successful application of adaptive leadership and adaptive work that was performed by the organization after a period of reflection and the willingness to experiment and assume risk. The case study serves as a microcosm of the challenges facing the U.S. Army, and the corresponding leadership framework presented in this monograph can be used as a model for the Army as it attempts to move forward in its effort to make adaptation an institutional imperative. The paper presents a more holistic approach to leadership where the leader transcends that of simply being an authority figure and becomes a real leader who provides a safe and creative learning environment where the organization can tackle and solve adaptive challenges. The paper concludes by recommending that U.S. Army leaders apply Harvard Professor Dean Williams's theory to the challenges confronting the Army's leader development process thereby fostering a culture of adaptive leaders.

Relevância:

80.00% 80.00%

Publicador:

Resumo:

Thesis (Ph.D.)--University of Washington, 2016-06

Relevância:

80.00% 80.00%

Publicador:

Resumo:

Little research has been undertaken into high stakes deception, and even less into high stakes deception in written text. This study addresses that gap. In this thesis, I present a new approach to detecting deception in written narratives based on the definition of deception as a progression and focusing on identifying deceptive linguistic strategy rather than individual cues. I propose a new approach for subdividing whole narratives into their constituent episodes, each of which is linguistically profiled and their progression mapped to identify authors’ deceptive strategies based on cue interaction. I conduct a double blind study using qualitative and quantitative analysis in which linguistic strategy (cue interaction and progression) and overall cue presence are used to predict deception in witness statements. This results in linguistic strategy analysis correctly predicting 85% of deceptive statements (92% overall) compared to 54% (64% overall) with cues identified on a whole statement basis. These results suggest that deception cues are not static, and that the value of individual cues as deception predictors is linked to their interaction with other cues. Results also indicate that in certain cue combinations, individual self-references (I, Me and My), previously believed to be indicators of truthfulness, are effective predictors of deceptive linguistic strategy at work

Relevância:

80.00% 80.00%

Publicador:

Resumo:

The present research represents a coherent approach to understanding the root causes of ethnic group differences in ability test performance. Two studies were conducted, each of which was designed to address a key knowledge gap in the ethnic bias literature. In Study 1, both the LR Method of Differential Item Functioning (DIF) detection and Mixture Latent Variable Modelling were used to investigate the degree to which Differential Test Functioning (DTF) could explain ethnic group test performance differences in a large, previously unpublished dataset. Though mean test score differences were observed between a number of ethnic groups, neither technique was able to identify ethnic DTF. This calls into question the practical application of DTF to understanding these group differences. Study 2 investigated whether a number of non-cognitive factors might explain ethnic group test performance differences on a variety of ability tests. Two factors – test familiarity and trait optimism – were able to explain a large proportion of ethnic group test score differences. Furthermore, test familiarity was found to mediate the relationship between socio-economic factors – particularly participant educational level and familial social status – and test performance, suggesting that test familiarity develops over time through the mechanism of exposure to ability testing in other contexts. These findings represent a substantial contribution to the field’s understanding of two key issues surrounding ethnic test performance differences. The author calls for a new line of research into these performance facilitating and debilitating factors, before recommendations are offered for practitioners to ensure fairer deployment of ability testing in high-stakes selection processes.

Relevância:

80.00% 80.00%

Publicador:

Resumo:

The purpose of this study was to ascertain the perceptions of educators at one elementary school regarding the changes in the teaching and learning environment and their related effects following the implementation of Florida's A+ high-stakes accountability system. This study also assessed whether these changes were identified by participants as meaningful and enduring, in terms of the definition by Lieberman and Miller (1999). Twenty-one educators, including 17 teachers and four administrators, at Blue Ribbon Elementary school were interviewed. Data were inductively coded and categorized into four major themes: (a) teaching and learning environment consistency, (b) changes in the teaching and learning environment since the implementation of A+, (c) effects of the changes, and (d) significant and enduring change. Findings fell into three categories (a) identified changes since A+ implementation, (b) effects of changes, and (c) what participants believed was significant and long term change, which included those characteristics of the school that had been identified as consistent in the teaching and learning environment. Statements of the participants explained their perceptions about what instructional decisions where made in response to the A+ Plan including the modification of curriculum, the addition or omission of subject matter taught, and the positive or negative impact these decisions had on the teaching and learning environment. It was found that study participants felt all changes and their effects were a direct result of the A+ Plan and viewed many of the changes as being neither significant nor long term Analysis of the educators' perceptions of the changes they experienced revealed the overall feeling that the changes were not indicative of what was necessary to make a school successful. For the participants, the changes lacked the characteristics that they had described as vital in what constituted success. This led to the conclusion that, by Lieberman and Miller's definition, the majority of changes and effects that were implemented at the school as a result of the mandated A+ Plan, were not meaningful and enduring for effective school reform. ^

Relevância:

80.00% 80.00%

Publicador:

Resumo:

This study explores factors related to the prompt difficulty in Automated Essay Scoring. The sample was composed of 6,924 students. For each student, there were 1-4 essays, across 20 different writing prompts, for a total of 20,243 essays. E-rater® v.2 essay scoring engine developed by the Educational Testing Service was used to score the essays. The scoring engine employs a statistical model that incorporates 10 predictors associated with writing characteristics of which 8 were used. The Rasch partial credit analysis was applied to the scores to determine the difficulty levels of prompts. In addition, the scores were used as outcomes in the series of hierarchical linear models (HLM) in which students and prompts constituted the cross-classification levels. This methodology was used to explore the partitioning of the essay score variance.^ The results indicated significant differences in prompt difficulty levels due to genre. Descriptive prompts, as a group, were found to be more difficult than the persuasive prompts. In addition, the essay score variance was partitioned between students and prompts. The amount of the essay score variance that lies between prompts was found to be relatively small (4 to 7 percent). When the essay-level, student-level-and prompt-level predictors were included in the model, it was able to explain almost all variance that lies between prompts. Since in most high-stakes writing assessments only 1-2 prompts per students are used, the essay score variance that lies between prompts represents an undesirable or "noise" variation. Identifying factors associated with this "noise" variance may prove to be important for prompt writing and for constructing Automated Essay Scoring mechanisms for weighting prompt difficulty when assigning essay score.^

Relevância:

80.00% 80.00%

Publicador:

Resumo:

The purpose of this study was to analyze the evolution of Florida state level policy efforts and to assess the responding educational policy development and implementation at the local school district level. The focus of this study was the secondary language arts curriculum in Miami-Dade County Public Schools. ^ Data was collected using document analysis as a source of meaning making out of the language sets proffered by agencies at each level. A matrix was created based on Klein's levels of curriculum decision-making and Functional Process Theory categories of policy formation. The matrix allowed the researcher to code and classify specific information in terms accountability/high-stakes testing; authority; outside influences; and operational/structural organization. ^ Federal policy documents provided a background and impetus for much of what originated at the State level. The State then produced policy directives which were accepted by the District and specific policy directives and guidelines for practice. No evidence was found indicating the involvement of any other agencies in the development, transmission or implementation of the State level initiated policies. ^ After analyzing the evolutionary process, it became clear that state policy directives were never challenged or discussed. Rather, they were accepted as standards to be met and as such, school districts complied. Policy implementation is shown to be a top-down phenomenon. No evidence was found indicating a dialogue between state and local systems, rather the state, as the source of authority, issued specifically worded policy directives and the district complied. Finally, this study recognizes that outside influences play an important role in shaping the education reform policy in the state of Florida. The federal government, through NCLB and other initiatives created a climate which led almost naturally to the creation of the Florida A+ Plan. Similarly, the concern of the business community, always interested in the production of competent workers, continued to support efforts at raising the minimum skill level of Florida high school graduates. ^ Suggestions are made for future research including the examination of local school sites in order to assess the overall nature of the school experience rather than rely upon performance indicators mandated by state policy. ^

Relevância:

80.00% 80.00%

Publicador:

Resumo:

High-stakes testing and accountability have infiltrated the education system in the United States; the top priority for all teachers must be student progress on standardized tests. This has resulted in the predominance of reading for test-taking, (efferent reading), in the English, language arts, and reading classrooms. Authentic uses of print activities, like aesthetic reading, that encourage students to engage individually with a text, have been pushed aside. ^ During a 3-week time period, regular level, English 3/American literature students in a Title I magnet high school, participated in this quasi-experimental study (N = 62). It measured the effects of an intervention of reading American literature texts aesthetically and writing aesthetically-evoked reader responses on students' self-efficacy beliefs regarding their comprehension of American literature. One trained teacher and the researcher participated in the study: student participants were pre- and post- tested using the Confidence in Reading American Literature Survey which examined their self-efficacy beliefs regarding their comprehension of American literature. Several statistical analyses were performed. The results of the linear regression analyses partially supported a positive relationship between aesthetically-evoked reader responses and students' self-efficacy beliefs regarding their comprehension of American literature. Additionally, the results of the 2 (sex) x 2 (treatment) ANCOVAs conducted to test group differences in self-efficacy beliefs regarding the comprehension of American literature between treatment and control groups indicated a main effect for treatment (but not sex; nor was there a significant sex x treatment interaction), suggesting the treatment was partially effective in increasing students' self-efficacy beliefs. Seven of the twelve ANCOVAs indicated a statistically significant increase in the treatment group's adjusted group mean self-efficacy belief scores as a result of being exposed to the intervention. In six of these seven analyses, increases in self-efficacy beliefs occurred in tasks that required three or more higher-order levels of thinking/learning. The results are discussed in terms of theoretical, empirical and practical significance. Future research is recommended to extend the intervention beyond the narrow confines of a Title I magnet school to settings where the intervention could be tested longitudinally, e. g., honors and gifted students, elementary and middle schools.^

Relevância:

80.00% 80.00%

Publicador:

Resumo:

The purpose of this study was to analyze the evolution of Florida state level policy efforts and to assess the responding educational policy development and implementation at the local school district level. The focus of this study was the secondary language arts curriculum in Miami-Dade County Public Schools. Data was collected using document analysis as a source of meaning making out of the language sets proffered by agencies at each level. A matrix was created based on Klein's levels of curriculum decision-making and Functional Process Theory categories of policy formation. The matrix allowed the researcher to code and classify specific information in terms accountability/high-stakes testing; authority; outside influences; and operational/structural organization. Federal policy documents provided a background and impetus for much of what originated at the State level. The State then produced policy directives which were accepted by the District and specific policy directives and guidelines for practice. No evidence was found indicating the involvement of any other agencies in the development, transmission or implementation of the State level initiated policies. After analyzing the evolutionary process, it became clear that state policy directives were never challenged or discussed. Rather, they were accepted as standards to be met and as such, school districts complied. Policy implementation is shown to be a top-down phenomenon. No evidence was found indicating a dialogue between state and local systems, rather the state, as the source of authority, issued specifically worded policy directives and the district complied. Finally, this study recognizes that outside influences play an important role in shaping the education reform policy in the state of Florida. The federal government, through NCLB and other initiatives created a climate which led almost naturally to the creation of the Florida A+ Plan. Similarly, the concern of the business community, always interested in the production of competent workers, continued to support efforts at raising the minimum skill level of Florida high school graduates. Suggestions are made for future research including the examination of local school sites in order to assess the overall nature of the school experience rather than rely upon performance indicators mandated by state policy.

Relevância:

80.00% 80.00%

Publicador:

Resumo:

The purpose of this study was to ascertain the perceptions of educators at one elementary school regarding the changes in the teaching and learning environment and their related effects following the implementation of Florida's A+ high-stakes accountability system. This study also assessed whether these changes were identified by participants as meaningful and enduring, in terms of the definition by Lieberman and Miller (1999). Twenty-one educators, including 17 teachers and four administrators, at Blue Ribbon Elementary school were interviewed. Data were inductively coded and categorized into four major themes: (a) teaching and learning environment consistency, (b) changes in the teaching and learning environment since the implementation of A+, (c) effects of the changes, and (d) significant and enduring change. Findings fell into three categories (a) identified changes since A+ implementation, (b) effects of changes, and (c) what participants believed was significant and long term change, which included those characteristics of the school that had been identified as consistent in the teaching and learning environment. Statements of the participants explained their perceptions about what instructional decisions where made in response to the A+ Plan including the modification of curriculum, the addition or omission of subject matter taught, and the positive or negative impact these decisions had on the teaching and learning environment. It was found that study participants felt all changes and their effects were a direct result of the A+ Plan and viewed many of the changes as being neither significant nor long term Analysis of the educators' perceptions of the changes they experienced revealed the overall feeling that the changes were not indicative of what was necessary to make a school successful. For the participants, the changes lacked the characteristics that they had described as vital in what constituted success. This led to the conclusion that, by Lieberman and Miller's definition, the majority of changes and effects that were implemented at the school as a result of the mandated A+ Plan, were not meaningful and enduring for effective school reform.

Relevância:

80.00% 80.00%

Publicador:

Resumo:

High-stakes testing and accountability have infiltrated the education system in the United States; the top priority for all teachers must be student progress on standardized tests. This has resulted in the predominance of reading for test-taking, (efferent reading), in the English, language arts, and reading classrooms. Authentic uses of print activities, like aesthetic reading, that encourage students to engage individually with a text, have been pushed aside. During a 3-week time period, regular level, English 3/American literature students in a Title I magnet high school, participated in this quasi-experimental study (N = 62). It measured the effects of an intervention of reading American literature texts aesthetically and writing aesthetically-evoked reader responses on students’ self-efficacy beliefs regarding their comprehension of American literature. One trained teacher and the researcher participated in the study: student participants were pre- and post- tested using the Confidence in Reading American Literature Survey which examined their self-efficacy beliefs regarding their comprehension of American literature. Several statistical analyses were performed. The results of the linear regression analyses partially supported a positive relationship between aesthetically-evoked reader responses and students’ self-efficacy beliefs regarding their comprehension of American literature. Additionally, the results of the 2 (sex) x 2 (treatment) ANCOVAs conducted to test group differences in self-efficacy beliefs regarding the comprehension of American literature between treatment and control groups indicated a main effect for treatment (but not sex; nor was there a significant sex x treatment interaction), suggesting the treatment was partially effective in increasing students’ self-efficacy beliefs. Seven of the twelve ANCOVAs indicated a statistically significant increase in the treatment group’s adjusted group mean self-efficacy belief scores as a result of being exposed to the intervention. In six of these seven analyses, increases in self-efficacy beliefs occurred in tasks that required three or more higher-order levels of thinking/learning. The results are discussed in terms of theoretical, empirical and practical significance. Future research is recommended to extend the intervention beyond the narrow confines of a Title I magnet school to settings where the intervention could be tested longitudinally, e. g., honors and gifted students, elementary and middle schools.

Relevância:

80.00% 80.00%

Publicador:

Resumo:

ABSTRACT Title of Document: AN ANALYSIS OF THE IMPLEMENTATION AND PERCEIVED EFFECTIVENESS OF THE SCHOOLMAX FAMILY PORTAL Warren Wesley Watts, Doctor of Education, 2015 Directed By: Margaret J. McLaughlin, Ph.D. Department of Counseling, Higher Education and Special Education School districts have spent millions of dollars implementing student information systems that offer family portals with web-based access to parents and students. One of the main purposes of these systems is to improve school-to-home communication. Research has shown that when school-to-home communication is implemented effectively, parent involvement improves and student achievement increases (Epstein, 2001). The purpose of the study was to (a) understand why parents used or refrained from using the family portal and (b) determine what barriers to use might exist. To this end, this descriptive study identified the information parent users accessed in the SchoolMAX family portal, determined how frequently parents accessed the portal, and ascertained whether parents perceived an increase in communication with their children about academic matters after they began accessing the portal. Finally, the study sought to identify whether barriers existed that prevented parents from using the family portal. The inquiry employed three data sources to answer the aforementioned queries. These sources included (a) a survey sent electronically to 19,108 parents who registered online for the SchoolMAX family portal; (b) SchoolMAX portal usage data from the student information system for system usage between January 1, 2015 and June 30, 2015; and (c) a paper survey sent to 691 parents of students that had never used the SchoolMAX family portal in one elementary school, one middle school and one high school that were representative of other schools in the district. Survey results indicated that parents at all grade levels used the family portal. Usage data also confirmed that approximately 19% of the students had parents who monitored their progress through the family portal. Usage data also showed that parents were monitoring approximately 25% of students in secondary schools (6th – 12th grade) and 16% of students in elementary schools. Of the wide menu of resources available through the SchoolMAX family portal, parents used three areas most frequently: attendance, daily grades, and report cards. Approximately 70% of parents responded that their communication had improved with their children about academic matters since they started using the SchoolMAX family portal, and 90% of parents responded that the SchoolMAX family portal was an effective or somewhat effective tool. Parents also expressed interest in the addition of additional information to the SchoolMAX family portal. Specifically, the top three additions parents wanted to see included homework assignments, high stakes test scores, and graduation requirements. Parents also reported that 92% of them spoke to their children at least 2 to 3 times per week about academics. Due to the low response rate of the parent non-user survey, potential barriers to using the SchoolMAX family portal could not be addressed in this study. However, this issue may be a useful research topic in a future study. Keywords: school to home communication, student information systems, family portal, parent portal

Relevância:

80.00% 80.00%

Publicador:

Resumo:

This study positioned the federal No Child Left Behind (NCLB) Act of 2002 as a reified colonizing entity, inscribing its hegemonic authority upon the professional identity and work of school principals within their school communities of practice. Pressure on educators and students intensifies each year as the benchmark for Adequate Yearly Progress under the NCLB policy is raised, resulting in standards-based reform, scripted curriculum and pedagogy, absence of elective subjects, and a general lack of autonomy critical to the work of teachers as they approach each unique class and student (Crocco & Costigan, 2007; Mabry & Margolis, 2006). Emphasis on high stakes standardized testing as the indicator for student achievement (Popham, 2005) affects educators’ professional identity through dramatic pedagological and structural changes in schools (Day, Flores, & Viana, 2007). These dramatic changes to the ways our nation conducts schooling must be understood and thought about critically from school leaders’ perspectives as their professional identity is influenced by large scale NCLB school reform. The author explored the impact No Child Left Behind reform had on the professional identity of fourteen, veteran Illinois principals leading in urban, small urban, suburban, and rural middle and elementary schools. Qualitative data were collected during semi-structured interviews and focus groups and analyzed using a dual theoretical framework of postcolonial and identity theories. Postcolonial theory provided a lens from which the author applied a metaphor of colonization to principals’ experiences as colonized-colonizers in a time of school reform. Principal interview data illustrated many examples of NCLB as a colonizing authority having a significant impact on the professional identity of school leaders. This framework was used to interpret data in a unique and alternative way and contributed to the need to better understand the ways school leaders respond to district-level, state-level, and national-level accountability policies (Sloan, 2000). Identity theory situated principals as professionals shaped by the communities of practice in which they lead. Principals’ professional identity has become more data-driven as a result of NCLB and their role as instructional leaders has intensified. The data showed that NCLB has changed the work and professional identity of principals in terms of use of data, classroom instruction, Response to Intervention, and staffing changes. Although NCLB defines success in terms of meeting or exceeding the benchmark for Adequate Yearly Progress, principals’ view AYP as only one measurement of their success. The need to meet the benchmark for AYP is a present reality that necessitates school-wide attention to reading and math achievement. At this time, principals leading in affluent, somewhat homogeneous schools typically experience less pressure and more power under NCLB and are more often labeled “successful” school communities. In contrast, principals leading in schools with more heterogeneity experience more pressure and lack of power under NCLB and are more often labeled “failing” school communities. Implications from this study for practitioners and policymakers include a need to reexamine the intents and outcomes of the policy for all school communities, especially in terms of power and voice. Recommendations for policy reform include moving to a growth model with multi-year assessments that make sense for individual students rather than one standardized test score as the measure for achievement. Overall, the study reveals enhancements and constraints NCLB policy has caused in a variety of school contexts, which have affected the professional identity of school leaders.

Relevância:

80.00% 80.00%

Publicador:

Resumo:

Previous research found personality test scores to be inflated on average among individuals who were motivated to present themselves in a desirable fashion in high stakes situations, such as during the employee selection process. One apparently effective way to reduce the undesirable test score inflation in such situations was to warn participants against faking. This research set out to investigate whether warning against faking would indeed affect personality test scores in the theoretically expected fashion. Contrary to expectations, the results did not support the hypothesized causal chain. Results across three studies show that while a warning may lower test scores in participants motivated to respond desirably (i.e., to fake), the effect of warning on test scores was not fully mediated by: a reduction in motivation to do well and self-reports of exaggerated responses in the personality test. Theoretical and practical implications are discussed.