703 resultados para Formative Construct Validity
Resumo:
This thesis begins with a review of the literature on wisdom models, theories of wise leadership, and existing wisdom measures. It continues with a review of how the concept of wisdom may add value to existing leadership models, highlighting the need to empirically identify the characteristics of wise leaders and develop a wise leadership measure. A nomological framework for wise leadership is then presented. Based on a review of the wisdom and leadership paradigms, a mixed-methods research design is described for three studies to define the characteristics of wise leadership in organisations; identify specific leadership challenges that might require wise responses; and to develop the wise leadership measure comprising of vignettes. The first study involves critical incident interviews with 26 nominated wise leaders and 23 of their nominators, which led to the identification of nine wise leadership dimensions which include Strong Ethical Code, Strong Judgement, Optimising Positive Outcomes, Managing Uncertainty, Strong Legacy, Leading with Purpose, Humanity, Humility, and Self-Awareness. The second study includes critical incident interviews with 20 leaders about organisational challenges associated with the nine dimensions, to elucidate the wise leadership measure. The third study includes the design of 45 vignettes based on organisational challenges that measure the nine wise leadership dimensions. The measure is then administered to 250 organisational leaders to establish its construct validity, leading to the selection of 18 vignettes forming the final wise leadership measure. Theoretical, methodological and practical implications of this research are then discussed with recommendations for future research.
Resumo:
The purpose of this study was to develop an instrument to measure high school students’ perspectives on global awareness and attitudes toward social issues. The research questions that guided this study were: (a) Can acceptable validity and reliability estimates be established for an instrument developed to measure high schools students' global awareness? (b) Can acceptable validity and reliability estimates be established for an instrument developed to measure high schools students' attitudes towards global social issues? (c) What is the relationship between high school students’ GPA, race/ethnicity, gender, socio-economic status, parents’ education, getting the news, reading and listening habits, the number of classes taken in the social sciences, whether they speak a second language, and have experienced living in or visiting other countries, and their perception of global awareness and attitudes toward global social issues. ^ An ex post facto research design was used and the data were collected using a 4-part Likert-type survey. It was administered to 14 schools in the Miami-Dade County, Florida area to 704 students. A factor analysis with an orthogonal varimax rotation was vii used to select the factors that best represented the three constructs – global education, global citizenship, and global workforce. This was done to establish construct validity. Cronbach’s alpha was used to determine the reliability of the instrument. Descriptive statistics and a hierarchical multiple regression were used for the demographics to establish their relationship, if any, to the findings. ^ Key findings of the study were that reliable and valid estimates can be developed for the instrument. The multiple regression analysis for model 1 and 2 accounted for a variance of 3% and 5% for self-perceptions of global awareness (factor 1). The regression model also accounted for a 5% and 13% variance in the two models for attitudes toward global social issues (factor 2). The demographics that were statistically significant were: ethnicity, gender, SES, parents’ education, listening to music, getting the news, speaking a second language, GPA, classes taken in the social sciences, and visiting other countries. An important finding for the study was those attending public schools (as opposed to private schools) had more positive attitudes towards global social issues (factor 2) The statistics indicated that these students had taken history, economics, and social studies – a curriculum infused with global perspectives.^
Resumo:
Context: Research suggests internships, mentorship, and specialized school programs positively influence career selection; however, little data exists specific to athletic training. Objective: We identified high school (HS) experiences influencing career choice in college athletic training students (ATS). Design: Our survey included 35 Likert-type close-ended questions, which were reviewed by a panel of faculty and peers to establish content and construct validity. Setting: Participants completed an online questionnaire at their convenience. Participants: 217 college ATS (153 female, 64 male) from a random selection of accredited programs on the east coast. We excluded minors, freshmen, and undecided majors from the study. Informed consent was implied by proceeding to the questionnaire. Data Collection and Analysis: We used descriptive statistics to analyze the data collected via a secure website. Results: Mentors were most influential in the decision of career path (62.4%;n=131/210) with 85.2% (n=138/162) reporting mentors were readily available to answer questions regarding career options and 53.1% (n=86/162) counseled them regarding HS electives. Of participants involved in an internship (41.0%;n=86/210), most developed such opportunities independently (66.3%;n=57/86). Respondents who attended traditional HS suggested providing diverse electives (71.9%;n=133/185), additional internship (53.5%;n=99/185), and mentorship (33.0%;n=61/185) opportunities to effectively educate students regarding career options. Conclusions: College ATS that gained internship experience during HS report the opportunity positively influenced their career selection. Mentors support HS students by offering insight and expertise in guiding students’ career choices. Participants suggested HS afford diverse electives with internship and mentorship opportunities to positively influence interested students towards pursuing a career in athletic training.
Resumo:
The purpose of this study is to validate the Study Behavior Inventory-High School, an instrument designed to measure study behaviors of high school students and to determine the stability of its scores across populations and across grades. Numerous studies have shown the relationship between the level of students' use of appropriate study behaviors and their levels of academic achievement and this is particularly relevant at a time of increasing demands for school and teacher accountability for their students' academic achievement. ^ The instrument was administered to 3,336 students in grades 9 through 12 in four high schools in diverse parts of the United States. Factor analysis yielded a four factor structure for the instrument and evidence for its construct validity was obtained using convergent and discriminant methods. The four factors include academic self-perception and feelings of low self-efficacy, academic preparation behaviors, time management, and the social nature of taking tests and studying. Internal consistency reliability for the scores on each of the four factors was calculated and found to range between .68 and .87. Finally, confirmatory factor analysis indicated acceptable levels of fit between the factor structure obtained in this study and an earlier one obtained during a pilot study using 800 participants. ^ The SBI-HS appears to be a valid and reliable instrument for the measure of study behaviors in high school students. ^
Resumo:
This thesis extends previous research on critical decision making and problem-solving by refining and validating a self-report measure designed to assess the use of critical decision making and problem solving in making life choices. The analysis was conducted by performing two studies, and therefore collecting two sets of data on the psychometric properties of the measure. Psychometric analyses included: item analysis, internal consistency reliability, interrater reliability, and an exploratory factor analysis. This study also included regression analysis with the Wonderlic, an established measure of general intelligence, to provide preliminary evidence for the construct validity of the measure.
Resumo:
The theoretical construct of control has been defined as necessary (Etzioni, 1965), ubiquitous (Vickers, 1967), and on-going (E. Langer, 1983). Empirical measures, however, have not adequately given meaning to this potent construct, especially within complex organizations such as schools. Four stages of theory-development and empirical testing of school building managerial control using principals and teachers working within the nation's fourth largest district are presented in this dissertation as follows: (1) a review and synthesis of social science theories of control across the literatures of organizational theory, political science, sociology, psychology, and philosophy; (2) a systematic analysis of school managerial activities performed at the building level within the context of curricular and instructional tasks; (3) the development of a survey questionnaire to measure school building managerial control; and (4) initial tests of construct validity including inter-item reliability statistics, principal components analyses, and multivariate tests of significance. The social science synthesis provided support of four managerial control processes: standards, information, assessment, and incentives. The systematic analysis of school managerial activities led to further categorization between structural frequency of behaviors and discretionary qualities of behaviors across each of the control processes and the curricular and instructional tasks. Teacher survey responses (N=486) reported a significant difference between these two dimensions of control, structural frequency and discretionary qualities, for standards, information, and assessments, but not for incentives. The descriptive model of school managerial control suggests that (1) teachers perceive structural and discretionary managerial behaviors under information and incentives more clearly than activities representing standards or assessments, (2) standards are primarily structural while assessments are primarily qualitative, (3) teacher satisfaction is most closely related to the equitable distribution of incentives, (4) each of the structural managerial behaviors has a qualitative effect on teachers, and that (5) certain qualities of managerial behaviors are perceived by teachers as distinctly discretionary, apart from school structure. The variables of teacher tenure and school effectiveness reported significant effects on school managerial control processes, while instructional levels (elementary, junior, and senior) and individual school differences were not found to be significant for the construct of school managerial control.
Resumo:
Scientific reading research has produced substantial evidence linking specific reading components to a range of constructs including phonological awareness (PA), morphological awareness, orthographic processing (OP), rapid automatized naming, working memory and vocabulary. There is a paucity of research on Arabic, although 420 million people around the world (Gordon, 2005) speak Arabic. As a Semitic language, Arabic differs in many ways from Indo-European languages. Over the past three decades, literacy research has begun to elucidate the importance of morphological awareness (MA) in reading. Morphology is a salient aspect of Arabic word structure. This study was designed to (a) examine the dimensions underlying MA in Arabic; (b) determine how well MA predicts reading; (c) investigate the role of the standard predictors in different reading outcomes; and (d) investigate the construct of reading in Arabic. This study was undertaken in two phases. In Phase I, 10 MA measures and two reading measures were developed, and tested in a sample of 102 Grade 3 Arabic-speaking children. Factor analysis of the 10 MA tasks yielded one predominant factor supporting the construct validity of MA in Arabic. Hierarchical regression analyses, controlling for age and gender, indicated that the MA factor solution accounted for 41– 43% of the variance in reading. In Phase II, the widely studied predictor measures were developed for PA and OP in addition to one additional measure of MA (root awareness), and three reading measures In Phase II, all measures were administered to another sample of 201 Grade 3 Arabic-speaking children. The construct of reading in Arabic was examined using factor analysis. The joint and unique effects of all standard predictors were examined using different sets of hierarchical regression analyses. Results of Phase II showed that: (a) all five reading measures loaded on one factor; (b) MA consistently accounted for unique variance in reading, particularly in comprehension, above and beyond the standard predictors; and (c) the standard predictors had differential contributions. These findings underscore the contribution of MA to all components of Arabic reading. The need for more emphasis on including morphology in Arabic reading instruction and assessment is discussed.
Resumo:
ABSTRACT The purpose of this study was to examine the technical adequacy of the Developmental Reading Assessment (Beaver & Carter, 2004). Internal consistency analysis, factor analysis, and linear regression analyses were used to test whether the DRA is a statistically reliable measuring of reading comprehension for Grades 7 and 8 students. Correlational analyses, decision consistency analyses, and a focus group of experienced Intermediate (Grades 7 and 8) teachers examined whether there is evidence that the results from the DRA provide valid interpretations regarding students’ reading skills and comprehension. Results indicated that, as currently scored, internal consistency is low and skewness of distribution is high. Factor analyses did not replicate those cited by the DRA developers to prove construct validity. Two-way contingency analyses determined that decision consistency did not vary greatly between the DRA, EQAO, scores and report card marks. Views expressed during the focus group echoed many of the challenges to validity found in the statistical analysis. The teachers found that the DRA was somewhat useful, as there were limited alternative reading assessments available for the classroom, but did not endorse it strongly. The study found little evidence that the DRA provides valid interpretations regarding Intermediate students’ reading skills. Indicated changes to the structure and administration procedures of the DRA may ameliorate some of these issues.
Resumo:
Background: Primary care is the sector of health care in which patients first establish contact with the health system, are provided person-focused care over time for all new or common needs, and receive coordinated integrated health services provided elsewhere by other members of the health care team. Registered Nurses (RNs) in Canada provide care within this sector in varying roles. The extent to which RNs enact their full scope of practice in primary care settings in Canada is not known. The Actual Scope of Practice questionnaire (ASCOP) is a 26 item Likert scale questionnaire developed by researchers in Canada and validated in the acute care setting to measure the extent to which RNs apply the knowledge, skills and competencies of the professional full scope of practice. Similar to the acute care setting, there is a need to measure scope of practice enactment in the primary care setting. Objectives: The overall aim of this thesis was to measure scope of practice enactment in the primary care setting. Two research objectives were addressed: (1) to revise and adapt the ASCOP questionnaire for use in the primary care setting, and (2) to determine internal consistency, construct validity, and sensitivity of the modified instrument, the ASCOP-PC. Methods: To address the first objective, a narrative literature review and synthesis and an expert panel review was conducted. To address the second objective a cross-sectional survey of 178 RNs working in primary care organizations in Ontario was conducted Results: The ASCOP, with few modifications, addressed key attributes of nursing scope of practice in the primary care setting. The ASCOP-PC yielded acceptable alpha coefficients ranging from 0.66 to 0.91 and explained variances from 44.2 to 62.6. Total mean score of 5.16 suggests that RNs within these models of care almost always engage in activities reflected in the ASCOP-PC. Interpretation: Findings from this study support the use of a the modified ASCOP questionnaire as a reliable and valid measure of scope of practice enactment among primary care nurses in the primary care setting.
Resumo:
Background and Objectives: Mobility limitations are a prevalent issue in older adult populations, and an important determinant of disability and mortality. Neighborhood conditions are key determinants of mobility and perception of safety may be one such determinant. Women have more mobility limitations than men, a phenomenon known as the gender mobility gap. The objective of this work was to validate a measure of perception of safety, examine the relationship between neighborhood perception of safety and mobility limitations in seniors, and explore if these effects vary by gender. Methods: This study was cross-sectional, using questionnaire data collected from community-dwelling older adults from four sites in Canada, Colombia, and Brazil. The exposure variable was the neighborhood aggregated Perception of Safety (PoS) scale, derived from the Physical and Social Disorder (PSD) scale by Sampson and Raudenbush. Its construct validity was verified using factor analyses and correlation with similar measures. The Mobility Assessment Tool – short form (MAT-sf), a video-based measure validated cross-culturally in the studied populations, was used to assess mobility limitations. Based on theoretical models, covariates were included in the analysis, both at the neighborhood level (SES, social capital, and built environment) and the individual level (age, gender, education, income, chronic illnesses, depression, cognitive function, BMI, and social participation). Multilevel modeling was used in order to account for neighborhood clustering. Gender specific analyses were carried out. SAS and M-plus were used in this study. Results: PoS was validated across all sites. It loaded in a single factor, after excluding two items, with a Cronbach α value of approximately 0.86. Mobility limitations were present in 22.08% of the sample, 16.32% among men and 27.41% among women. Neighborhood perception of safety was significantly associated with mobility limitations when controlling for all covariates, with an OR of 0.84 (CI 95%: 0.73-0.96), indicating lower odds of having mobility limitations as neighborhood perception of safety improves. Gender did not affect this relationship despite women being more likely to have mobility limitations and live in neighborhoods with poor perception of safety. Conclusion: Neighborhood perception of safety affected the prevalence of mobility limitations in older adults in the studied population.
Resumo:
Objective: To determine the psychometric properties of two scales designed to examine attitudes regarding palliative care: Comfort Scale in Palliative Care (CSPC, Pereira et al.) and Tanatophobia Scale (TS, Merrill et al.)Method: Seventy-seven students who completed an online course on psychosocial aspects of palliative care offered by the Latin American Association of Palliative Care participated in the study. They also completed the scales before and after the course. Construct validity and reliability of the CSPC and the TS were assessed using a Principal Components Analysis, internal reliability coefficient and test-retest reliability. Further, comparative statistics between the pre-course and post-course results were obtained in order to determine changes in attitudes.Results: The Principal Components Analysis showed satisfactory fit to the data. 3 components were extracted: two for the CSPC and one for the TS, which explained 55.37% of the variance. Internal consistency coefficients were satisfactory in all cases and Cronbach´s Alphas were satisfactory for all the scales, particularly for the CSPC. Test-retest reliability in t1 and t2 was found to be non significant, indicating that measures were not related in time. Regarding pre-course/post-course comparisons, significant changes in comfort assisting patients (p = 0.004) and comfort assisting families (p = 0.001) following the course were identified, but changes in thanatophobia were non significant (p > 0.05).Conclusions: both scales are valid and reliable. Attitudes regarding the practice of palliative care and how they change, particularly regarding psychosocial issues, can be accurately measured using the examined scales.
Resumo:
Students reflect more on their learning in course subjects when they participate in managing their teaching–learning environment. As a form of guided participation, peer assessment serves the following purposes: (a) it improves the student’s understanding of previously established learning objectives; (b) it is a powerful metacognitive tool; (c) it transfers to the student part of the responsibility for assessing learning, which means deciding which learning activities are important and choosing the degree of effort a course subject will require; (d) it emphasizes the collective aspect of the nature of knowledge; and (e) the educational benefits derived from peer assessment clearly justify the efforts required to implement activities. This paper reports on the relative merits of a learning portfolio compiled during fine arts-related studies in which peer assessment played an important role. The researchers analyzed the student work load and the final marks students received for compulsory art subjects. They conclude that the use of a closed learning portfolio with a well-structured, sequential and analytical design can have a positive effect on student learning and that, although implementing peer assessment may be complex and students need to become familiar with it, its use is not only feasible but recommendable.
Resumo:
The article presents a study of a CEFR B2-level reading subtest that is part of the Slovenian national secondary school leaving examination in English as a foreign language, and compares the test-taker actual performance (objective difficulty) with the test-taker and expert perceptions of item difficulty (subjective difficulty). The study also analyses the test-takers’ comments on item difficulty obtained from a while-reading questionnaire. The results are discussed in the framework of the existing research in the fields of (the assessment of) reading comprehension, and are addressed with regard to their implications for item-writing, FL teaching and curriculum development.
Resumo:
Die Fähigkeit, geschriebene Texte zu verstehen, d.h. eine kohärente mentale Repräsentation von Textinhalten zu erstellen, ist eine notwendige Voraussetzung für eine erfolgreiche schulische und außerschulische Entwicklung. Es ist daher ein zentrales Anliegen des Bildungssystems Leseschwierigkeiten frühzeitig zu diagnostizieren und mithilfe zielgerichteter Interventionsprogramme zu fördern. Dies erfordert ein umfassendes Wissen über die kognitiven Teilprozesse, die dem Leseverstehen zugrunde liegen, ihre Zusammenhänge und ihre Entwicklung. Die vorliegende Dissertation soll zu einem umfassenden Verständnis über das Leseverstehen beitragen, indem sie eine Auswahl offener Fragestellungen experimentell untersucht. Studie 1 untersucht inwieweit phonologische Rekodier- und orthographische Dekodierfertigkeiten zum Satz- und Textverstehen beitragen und wie sich beide Fertigkeiten bei deutschen Grundschüler(inne)n von der 2. bis zur 4. Klasse entwickeln. Die Ergebnisse legen nahe, dass beide Fertigkeiten signifikante und eigenständige Beiträge zum Leseverstehen leisten und dass sich ihr relativer Beitrag über die Klassenstufen hinweg nicht verändert. Darüber hinaus zeigt sich, dass bereits deutsche Zweitklässler(innen) den Großteil geschriebener Wörter in altersgerechten Texten über orthographische Vergleichsprozesse erkennen. Nichtsdestotrotz nutzen deutsche Grundschulkinder offenbar kontinuierlich phonologische Informationen, um die visuelle Worterkennung zu optimieren. Studie 2 erweitert die bisherige empirische Forschung zu einem der bekanntesten Modelle des Leseverstehens—der Simple View of Reading (SVR, Gough & Tunmer, 1986). Die Studie überprüft die SVR (Reading comprehension = Decoding x Comprehension) mithilfe optimierter und methodisch stringenter Maße der Modellkonstituenten und überprüft ihre Generalisierbarkeit für deutsche Dritt- und Viertklässler(innen). Studie 2 zeigt, dass die SVR einer methodisch stringenten Überprüfung nicht standhält und nicht ohne Weiteres auf deutsche Dritt- und Viertklässler(innen) generalisiert werden kann. Es wurden nur schwache Belege für eine multiplikative Verknüpfung von Dekodier- (D) und Hörverstehensfertigkeiten (C) gefunden. Der Umstand, dass ein beachtlicher Teil der Varianz im Leseverstehen (R) nicht durch D und C aufgeklärt werden konnte, deutet darauf hin, dass das Modell nicht vollständig ist und ggf. durch weitere Komponenten ergänzt werden muss. Studie 3 untersucht die Verarbeitung positiv-kausaler und negativ-kausaler Kohärenzrelationen bei deutschen Erst- bis Viertklässler(inne)n und Erwachsenen im Lese- und Hörverstehen. In Übereinstimmung mit dem Cumulative Cognitive Complexity-Ansatz (Evers-Vermeul & Sanders, 2009; Spooren & Sanders, 2008) zeigt Studie 3, dass die Verarbeitung negativ-kausaler Kohärenzrelationen und Konnektoren kognitiv aufwändiger ist als die Verarbeitung positiv-kausaler Relationen. Darüber hinaus entwickelt sich das Verstehen beider Kohärenzrelationen noch über die Grundschulzeit hinweg und ist für negativ-kausale Relationen am Ende der vierten Klasse noch nicht abgeschlossen. Studie 4 zeigt und diskutiert die Nützlichkeit prozess-orientierter Lesetests wie ProDi- L (Richter et al., in press), die individuelle Unterschiede in den kognitiven Teilfertigkeiten des Leseverstehens selektiv erfassen. Hierzu wird exemplarisch die Konstruktvalidität des ProDi-L-Subtests ‚Syntaktische Integration’ nachgewiesen. Mittels explanatorischer Item- Repsonse-Modelle wird gezeigt, dass der Test Fertigkeiten syntaktischer Integration separat erfasst und Kinder mit defizitären syntaktischen Fertigkeiten identifizieren kann. Die berichteten Befunde tragen zu einem umfassenden Verständnis der kognitiven Teilfertigkeiten des Leseverstehens bei, das für eine optimale Gestaltung des Leseunterrichts, für das Erstellen von Lernmaterialien, Leseinstruktionen und Lehrbüchern unerlässlich ist. Darüber hinaus stellt es die Grundlage für eine sinnvolle Diagnose individueller Leseschwierigkeiten und für die Konzeption adaptiver und zielgerichteter Interventionsprogramme zur Förderung des Leseverstehens bei schwachen Leser(inne)n dar.
Resumo:
Aims. To validate the Swedish version of the Sheffield Care Environment Assessment Matrix (S-SCEAM). The instrument’s items measure environmental elements important for supporting the needs of older people, and conceptualized within eight domains. Methods. Item relevance was assessed by a group of experts and measured using content validity index (CVI). Test-retest and inter-rater reliability tests were performed. The domain structure was assessed by the inter-rater agreement of a second group of experts, and measured using Fleiss kappa. Results. All items attained a CVI above 0.78, the suggested criteria for excellent content validity. Test-retest reliability showed high stability (96% and 95% for two independent raters respectively), and inter-rater reliability demonstrated high levels of agreement (95% and 94% on two separate rating occasions). Kappa values were very good for test-retest (κ = 0.903 and 0.869) and inter-rater reliability (κ = 0.851 and 0.832). Domain structure was good, Fleiss’ kappa was 0.63 (range 0.45 to 0.75). Conclusion. The S-SCEAM of 210 items and eight domains showed good content validity and construct validity. The instrument is suggested for use in measuring of the quality of the physical environment in residential care facilities for older persons.