3 resultados para Reliability measure
em Digital Commons at Florida International University
Resumo:
The purpose of this study was to develop an instrument to measure high school students’ perspectives on global awareness and attitudes toward social issues. The research questions that guided this study were: (a) Can acceptable validity and reliability estimates be established for an instrument developed to measure high schools students' global awareness? (b) Can acceptable validity and reliability estimates be established for an instrument developed to measure high schools students' attitudes towards global social issues? (c) What is the relationship between high school students’ GPA, race/ethnicity, gender, socio-economic status, parents’ education, getting the news, reading and listening habits, the number of classes taken in the social sciences, whether they speak a second language, and have experienced living in or visiting other countries, and their perception of global awareness and attitudes toward global social issues. ^ An ex post facto research design was used and the data were collected using a 4-part Likert-type survey. It was administered to 14 schools in the Miami-Dade County, Florida area to 704 students. A factor analysis with an orthogonal varimax rotation was vii used to select the factors that best represented the three constructs – global education, global citizenship, and global workforce. This was done to establish construct validity. Cronbach’s alpha was used to determine the reliability of the instrument. Descriptive statistics and a hierarchical multiple regression were used for the demographics to establish their relationship, if any, to the findings. ^ Key findings of the study were that reliable and valid estimates can be developed for the instrument. The multiple regression analysis for model 1 and 2 accounted for a variance of 3% and 5% for self-perceptions of global awareness (factor 1). The regression model also accounted for a 5% and 13% variance in the two models for attitudes toward global social issues (factor 2). The demographics that were statistically significant were: ethnicity, gender, SES, parents’ education, listening to music, getting the news, speaking a second language, GPA, classes taken in the social sciences, and visiting other countries. An important finding for the study was those attending public schools (as opposed to private schools) had more positive attitudes towards global social issues (factor 2) The statistics indicated that these students had taken history, economics, and social studies – a curriculum infused with global perspectives.^
Resumo:
Higher education institutions across the United States have developed global learning initiatives to support student achievement of global awareness and global perspective, but assessment options for these outcomes are extremely limited. A review of research for a global learning initiative at a large, Hispanic-serving, urban, public, research university in South Florida found a lack of instruments designed to measure global awareness and global perspective in the context of an authentic performance assessment. This quasi-experimental study explored the development of two rubrics for the global learning initiative and the extent to which evidence supported the rubrics' validity and reliability. One holistic rubric was developed to measure students' global awareness and the second to measure their global perspective. The study utilized a pretest/posttest nonequivalent group design. Multiple linear regression was used to ascertain the rubrics' ability to discern and compare average learning gains of undergraduate students enrolled in two global learning courses and students enrolled in two non-global learning courses. Parallel pretest/posttest forms of the performance task required students to respond to two open-ended questions, aligned with the learning outcomes, concerning a complex case narrative. Trained faculty raters read responses and used the rubrics to measure students' global awareness and perspective. Reliability was tested by calculating the rates of agreement among raters. Evidence supported the finding that the global awareness and global perspective rubrics yielded scores that were highly reliable measures of students' development of these learning outcomes. Chi-square tests of frequency found significant rates of inter-rater agreement exceeding the study's .80 minimum requirement. Evidence also supported the finding that the rubrics yielded scores that were valid measures of students' global awareness and global perspective. Regression analyses found little evidence of main effects; however, post hoc analyses revealed a significant interaction between global awareness pretest scores and the treatment, the global learning course. Significant interaction was also found between global perspective pretest scores and the treatment. These crossover interactions supported the finding that the global awareness and global perspective rubrics could be used to detect learning differences between the treatment and control groups as well as differences within the treatment group.
Resumo:
Objective: Establish intra- and inter-examiner reliability of glenohumeral range of motion (ROM) measures taken by a single-clinician using a mechanical inclinometer. Design: A single-session, repeated-measure, randomized, counterbalanced design. Setting: Athletic Training laboratory. Participants: Ten college-aged volunteers (9 right-hand dominant; 4 males, 6 females; age=23.2±2.4y, mass=73±16kg, height=170±8cm) without shoulder or neck injuries within one year. Interventions: Two Certified Athletic Trainers separately assessed passive glenohumeral (GH) internal (IR) and external (ER) rotation bilaterally. Each clinician secured the inclinometer to each subject’s distal forearm using elastic straps. Clinicians followed standard procedures for assessing ROM, with the participants supine on a standard treatment table with 90° of elbow flexion. A second investigator recorded the angle. Clinicians measured all shoulders once to assess inter-clinician reliability and eight shoulders twice to assess intra-clinician reliability. We used SPSS 14.0 (SPSS Inc., Chicago, IL) to calculate standard error of measure (SEM) and Intraclass Correlation Coefficients (ICC) to evaluate intra- and inter-clinician reliability. Main Outcome Measures: Dependent variables were degrees of IR, ER, glenohumeral internal rotation deficit (GIRD) and total arc of rotation. We calculated GIRD as the bilateral difference in IR (nondominant–dominant) and total arc for each shoulder (IR+ER). Results: Intra-clinician reliability for each examiner was excellent (ICC[1,1] range=0.90-0.96; SEM=2.2°-2.5°) for all measures. Examiners displayed excellent inter-clinician reliability (ICC[2,1] range=0.79-0.97; SEM=1.7°-3.0°) for all measures except nondominant IR which had good reliability(0.72). Conclusions: Results suggest that clinicians can achieve reliable measures of GH rotation and GIRD using a single-clinician technique and an inexpensive, readily available mechanical inclinometer.