An Examination of the Validity of English Language Achievement Test Scores in a LEP Student Population

Approximately 1,700 limited English proficient (LEP) and recently exited LEP students in grades 4 and 10 were tested using both an English and a comparable Spanish language achievement test. Many LEP and former LEP students performed better in math taking the test in Spanish compared to taking it in English.

Participation in a positive youth development program and multi -problem alternative high school students' transformative goals: An investigation of the theoretical and methodological utility and validity of the Transformative Goal Attainment (TGAS)

There is a growing body of literature that provides evidence for the efficacy of positive youth development programs in general and preliminary empirical support for the efficacy of the Changing Lives Program (CLP) in particular. This dissertation sought to extend previous efforts to develop and preliminarily examine the Transformative Goal Attainment Scale (TGAS) as a measure of participant empowerment in the promotion of positive development. Consistent with recent advances in the use of qualitative research methods, this dissertation sought to further investigate the utility of Relational Data Analysis (RDA) for providing categorizations of qualitative open-ended response data. In particular, a qualitative index of Transformative Goals, TG, was developed to complement the previously developed quantitative index of Transformative Goal Attainment (TGA), and RDA procedures for calculating reliability and content validity were refined. Second, as a Stage I pilot/feasibility study this study preliminarily examined the potentially mediating role of empowerment, as indexed by the TGAS, in the promotion of positive development. ^ Fifty-seven participants took part in this study, forty CLP intervention participants and seventeen control condition participants. All 57 participants were administered the study's measures just prior to and just following the fall 2003 semester. This study thus used a short-term longitudinal quasi-experimental research design with a comparison control group. ^ RDA procedures were refined and applied to the categorization of open-ended response data regarding participants' transformative goals (TG) and future possible selves (PSQ-QE). These analyses revealed relatively strong, indirect evidence for the construct validity of the categories as well as their theoretically meaningful structural organization, thereby providing sufficient support for the utility of RDA procedures in the categorization of qualitative open-ended response data. ^ In addition, transformative goals (TG) and future possible selves (PSQ-QE), and the quantitative index of perceived goal attainment (TGA) were evaluated as potential mediators of positive development by testing their relationships to other indices of positive intervention outcome within a four-step method involving both analysis of variance (ANOVA and RMANOVAs) and regression analysis. Though more limited in scope than the efforts at the development and refinement of the measures of these mediators, the results were also promising. ^

Examining the validity of the GRE General Test scores and undergraduate GPA for predicting success in graduate school at a large racially and ethnically diverse public university in Southeast Florida

The purpose of the study was to determine the degree of relationships among GRE scores, undergraduate GPA (UGPA), and success in graduate school, as measured by first year graduate GPA (FGPA), cumulative graduate GPA, and degree attainment status. A second aim of the study was to determine whether the relationships between the composite predictor (GRE scores and UGPA) and the three success measures differed by race/ethnicity and sex. A total of 7,367 graduate student records (masters, 5,990; doctoral: 1,377) from 2000 to 2010 were used to evaluate the relationships among GRE scores, UGPA and the three success measures. Pearson's correlation, multiple linear and logistic regression, and hierarchical multiple linear and logistic regression analyses were performed to answer the research questions. The results of the correlational analyses differed by degree level. For master's students, the ETS proposed prediction that GRE scores are valid predictors of first year graduate GPA was supported by the findings from the present study; however, for doctoral students, the proposed prediction was only partially supported. Regression and correlational analyses indicated that UGPA was the variable that consistently predicted all three success measures for both degree levels. The hierarchical multiple linear and logistic regression analyses indicated that at master's degree level, White students with higher GRE Quantitative Reasoning Test scores were more likely to attain a degree than Asian Americans, while International students with higher UGPA were more likely to attain a degree than White students. The relationships between the three predictors and the three success measures were not significantly different between men and women for either degree level. Findings have implications both for practice and research. They will provide graduate school administrators with institution-specific validity data for UGPA and the GRE scores, which can be referenced in making admission decisions, while they will provide empirical and professionally defensible evidence to support the current practice of using UGPA and GRE scores for admission considerations. In addition, new evidence relating to differential predictions will be useful as a resource reference for future GRE validation researchers.

Assessing the relative validity of the Scottish Collaborative Group Food Frequency Questionnaire for measuring dietary intake in adults

Peer reviewed

The development and validity of a functional assessment instrument for persons with major mental disorders

Thèse numérisée par la Direction des bibliothèques de l'Université de Montréal.

Peripheral refraction validity of the Shin-Nippon SRW5000 autorefractor

PURPOSE: To investigate the operation of the Shin-Nippon/Grand Seiko autorefractor and whether higher-order aberrations affect its peripheral refraction measurements. METHODS: Information on instrument design, together with parameters and equations used to obtain refraction, was obtained from a patent. A model eye simulating the operating principles was tested with an optical design program. Effects of induced defocus and astigmatism on the retinal image were used to calibrate the model eye to match the patent equations. Coma and trefoil were added to assess their effects on the image. Peripheral refraction of a physical model eye was measured along four visual field meridians with the Shin-Nippon/Grand Seiko autorefractor SRW-5000 and a Hartmann-Shack aberrometer, and simulated autorefractor peripheral refraction was derived using the Zernike coefficients from the aberrometer. RESULTS: In simulation, the autorefractor's square image was changed in size by defocus, into rectangles or parallelograms by astigmatism, and into irregular shapes by coma and trefoil. In the presence of 1.0 D oblique astigmatism, errors in refraction were proportional to the higher-order aberrations, with up to 0.8 D sphere and 1.5 D cylinder for ±0.6 μm of coma or trefoil coefficients with a 5-mm-diameter pupil. For the physical model eye, refraction with the aberrometer was similar in all visual field meridians, but refraction with the autorefractor changed more quickly along one oblique meridian and less quickly along the other oblique meridian than along the horizontal and vertical meridians. Simulations predicted that higher-order aberrations would affect refraction in oblique meridians, and this was supported by the experimental measurements with the physical model eye. CONCLUSIONS: The autorefractor's peripheral refraction measurements are valid for horizontal and vertical field meridians, but not for oblique field meridians. Similar instruments must be validated before being adopted outside their design scope.

The development and validity of a functional assessment instrument for persons with major mental disorders

Thèse numérisée par la Direction des bibliothèques de l'Université de Montréal.

The Validity of Broad and Narrow Personality Traits For Predicting Job Performance: The Differential Effects of Time

Research into the dynamicity of job performance criteria has found evidence suggesting the presence of rank-order changes to job performance scores across time as well as intraindividual trajectories in job performance scores across time. These findings have influenced a large body of research into (a) the dynamicity of validities of individual differences predictors of job performance and (b) the relationship between individual differences predictors of job performance and intraindividual trajectories of job performance. In the present dissertation, I addressed these issues within the context of the Five Factor Model of personality. The Five Factor Model is arranged hierarchically, with five broad higher-order factors subsuming a number of more narrowly tailored personality facets. Research has debated the relative merits of broad versus narrow traits for predicting job performance, but the entire body of research has addressed the issue from a static perspective -- by examining the relative magnitude of validities of global factors versus their facets. While research along these lines has been enlightening, theoretical perspectives suggest that the validities of global factors versus their facets may differ in their stability across time. Thus, research is needed to not only compare the relative magnitude of validities of global factors versus their facets at a single point in time, but also to compare the relative stability of validities of global factors versus their facets across time. Also necessary to advance cumulative knowledge concerning intraindividual performance trajectories is research into broad vs. narrow traits for predicting such trajectories. In the present dissertation, I addressed these issues using a four-year longitudinal design. The results indicated that the validities of global conscientiousness were stable across time, while the validities of conscientiousness facets were more likely to fluctuate. However, the validities of emotional stability and extraversion facets were no more likely to fluctuate across time than those of the factors. Finally, while some personality factors and facets predicted performance intercepts (i.e., performance at the first measurement occasion), my results failed to indicate a significant effect of any personality variable on performance growth. Implications for research and practice are discussed.

The Responsiveness, Content Validity, and Convergent Validity of the Measure Yourself Concerns and Wellbeing (MYCaW) Patient-Reported Outcome Measure

Objective Measure Yourself Concerns and Wellbeing (MYCaW) is a patient-centred questionnaire that allows cancer patients to identify and quantify the severity of their ‘Concerns’ and Wellbeing, as opposed to using a pre-determined list. MYCaW administration is brief and aids in prioritising treatment approaches. Our goal was to assess the convergent validity and responsiveness of MYCaW scores over time, the generalisability of the existing qualitative coding framework in different complementary and integrative healthcare settings and content validity. Methods Baseline and 6-week follow-up data (n=82) from MYCaW and FACIT-SpEx questionnaires were collected for a service evaluation of the ‘Living Well With The Impact of Cancer’ course at Penny Brohn Cancer Care. MYCaW construct validity was determined using Spearman's Rank Correlation test, and responsiveness indices assessed score changes over time. The existing qualitative coding framework was reviewed using a new dataset (n=158) and coverage of concern categories compared to items of existing outcome measures. Results Good correlation between MYCaW and FACIT-SpEx score changes were achieved (r= -0.57, p≥0.01). MYCaW Profile and Concern scores were highly responsive to change: SRM=1.02 and 1.08; effect size=1.26 and 1.22. MYCaW change scores showed the anticipated gradient of change according to clinically relevant degrees of change. Categories including ‘Spirituality’, ‘weight change’ and ‘practical concerns’ were added to the coding framework to improve generalisability. Conclusions MYCaW scores were highly responsive to change, allowing personalized patient outcomes to be quantified; the qualitative coding framework is generalisable across different oncology settings and has broader coverage of patient-identified concerns compared with existing cancer-related patient-reported outcome measures.

The Reliability and Validity of a Child and Adolescent Participation in Decision Making Questionnaire

Background
There is a growing impetus across the research, policy and practice communities for children and young people to participate in decisions that affect their lives. Furthermore, there is a dearth of general instruments that measure children and young people’s views on their participation in decision making. This paper presents the reliability and validity of the Child and Adolescent Participation in Decision Making Questionnaire (CAP-DMQ) and specifically looks at a population of looked-after children where a lack of participation in decision making is an acute issue.
Methods
The participants were 151 looked after children and adolescents between 10-23 years of age who completed the 10 item CAP-DMQ. Of the participants 113 were in receipt of an advocacy service that had an aim of increasing participation in decision-making with the remaining participants not having received this service.
Results
The results showed that the CAP-DMQ had good reliability (Cronbach’s alpha = .94) and showed promising uni-dimensional construct validity through an exploratory factor analysis. The items in the CAP-DMQ also demonstrated good content validity by overlapping with prominent models of child and adolescent participation (Lundy 2007) and decision making (Halpern 2014). A regression analysis showed that age and gender were not significant predictors of CAP-DMQ scores but receipt of advocacy was a significant predictor of scores (effect size d=.88), thus showing appropriate discriminant criterion validity.
Conclusion
Overall, the CAP-DMQ showed good reliability and validity. Therefore, the measure has excellent promise for theoretical investigation in the area of child and adolescent participation in decision making and equally shows empirical promise for use as a measure in evaluating services which have increasing the participation of children and adolescents in decision making as an intended outcome.

The reliability and factorial validity of the Adolescent Alcohol Involvement Scale in a large sample in the United Kingdom

The assessment of adolescent drinking behavior is a complex task, complicated by variability in drinking patterns, the transitory and developmental nature of the behavior and the reliance (for large scale studies) on self-report questionnaires. The Adolescent Alcohol Involvement Scale (Mayer & Filstead, 1979) is a 14-item screening tool designed to help to identify alcohol misusers or more problematic drinkers. The present study utilized a large sample (n = 4066) adolescents from Northern Ireland. Results of Confirmatory Factor Analyses and reliability estimates revealed that the 14-items share sufficient common variance that scores can be considered to be reliable and that the 14 items can be scored to provide a composite alcohol use score.

Discussion about the validity of virtual practices in subjects in the radioccomunication area. Results of the educational experience

[EN]Nowadays we are living a virtual learning boom. Mainly, it is due to two facts: first, easy spreading of the knowledge and second, virtual learning is cheaper than classic instrumentation laboratories. This cost is even bigger in radiocommunication and high frequency area. In fact, time and time again there are more universities that give up offering the realization of laboratory practice. In the present report we propose a discussion about the increase of virtual practices when contact with instrumentation and circuits is basic. The experience of seven lecturers of the Communications Engineering Group (GIC) will be exposed.

Validity of shape memory NiTi colon ring BioDynamix ColonRing™ (or NiTi CAR 27™) to prevent anastomotic colorectal strictures. Preliminary results

Purpose. Anastomotic strictures occur in 3-30% of colorectal anastomosis and one of the main causes may be a reaction to the presence of the metal staples used for suturing. The aim of this study was to evaluate the efficacy of a compression anastomosis ring using the memoryshaped device in initial, i.e. nickel-titanium alloy (NiTi) for the prevention of colorectal anastomotic strictures. Patients and methods. A compression anastomosis ring device (NiTi CAR 27™) was used to perform compression anastomosis in 20 patients underwent left hemicolectomy and anterior resection of the rectum for carcinoma. An endoscopic check of the anastomosis was carried out at one month and at six months after surgery. Results. In 2 patients (10%) a dehiscence of the anastomosis occurred on the fifth and the eighth postoperative day. No anastomotic strictures were observed in any of the other 18 patients at six months follow-up after surgery. Conclusion. Our preliminary results suggest that the use of a compression anastomosis ring might well be a valid method of preventing anastomotic strictures in colorectal surgery. Further studies involving a larger number of patients are needed in order to confirm these preliminary results.

Don’t expect me to vote for you just because I like you, even if you do make me feel warm inside: a comparison of the validity of non-ipsative measures of party support

The inclusion of non-ipsative measures of party preference (in essence ratings for each of the parties of a political system) has become established practice in mass surveys conducted for election studies. They exist in different forms, known as thermometer ratings or feeling scores, likes and dislikes scores, or support propensities. Usually only one of these is included in a single survey, which makes it difficult to assess the relative merits of each. The questionnaire of the Irish National Election Study 2002 (INES2002) contained three different batteries of non-ipsative party preferences. This paper investigates some of the properties of these different indicators. We focus in particular on two phenomena. First, the relationship between non-ipsative preferences and the choices actually made on the ballot. In Ireland this relationship is more revealing than in most other countries owing to the electoral system (STV) which allows voters to cast multiple ordered votes for candidates from different parties. Second, we investigate the latent structure of each of the batteries of party preferences and the relationships between them. We conclude that the three instruments are not interchangeable, that they measure different orientations, and that one –the propensity to vote for a party– is by far preferable if the purpose of the study is the explanation of voters’ actual choice behaviour. This finding has important ramifications for the design of election study questionnaires.

EVIDENCE OF VALIDITY OF THE LSB-50: CROSS-VALIDATION, FACTORIAL INVARIANCE AND EXTERNAL CRITERION ANALYSIS

The aim of this paper was to obtain evidence of the validity of the LSB-50 (de Rivera & Abuín, 2012), a screening measure of psychopathology, in Argentinean adolescents. The sample consisted of 1002 individuals (49.7% male; 50.3% female) between 12 and 18 years-old (M = 14.98; SD = 1.99). A cross-validation study and factorial invariance studies were performed in samples divided by sex and age to test if a seven-factor structure that corresponds to seven clinical scales (Hypersensitivity, Obsessive-Compulsive, Anxiety, Hostility, Somatization, Depression, and Sleep disturbance) was adequate for the LSB-50. The seven-factor structure proved to be suitable for all the subsamples. Next, the fit of the seven-factor structure was studied simultaneously? in the aforementioned subsamples through hierarchical models that imposed different constrains of equivalency?. Results indicated the invariance of the seven clinical dimensions of the LSB-50. Ordinal alphas showed good internal consistency for all the scales. Finally, the correlations with a diagnostic measure of psychopathology (PAI-A) indicated moderate convergence. It is concluded that the analyses performed provide robust evidence of construct validity for the LSB-50