Evaluating the external validity of comorbid disorders in youth using rating scales and behavior observations

To evaluate the theoretical underpinnings of current categorical approaches to classify childhood psychopathological conditions, this dissertation examined whether children with a single diagnosis of an anxiety disorder (ANX only) and children with an anxiety diagnosis comorbid with other diagnoses (i.e., anxiety + anxiety disorder [ANX + ANX], anxiety + depressive disorder [ANX + DEP], and anxiety + disruptive disorder [ANX + EXT]) could be differentiated using external validation criteria of clinical phenomenology (i.e., levels of anxiety, depression, and internalizing, externalizing and total behavior problems). This study further examined whether the four groups could be differentiated in terms of their interaction patterns with their parents and peers, respectively. The sample consisted of 129 youth and their parents who presented to the Child Anxiety and Phobia Program (CAPP) housed within the Child and Family Psychosocial Research Center at Florida International University, Miami. Youth were between the ages of 8 and 14 years old. A battery of questionnaires was used to assess participants' clinical presentation in terms of levels of anxiety, depression, and internalizing and externalizing symptoms. Family and peer interaction were evaluated through rating scales and through behavior observation tasks. Statistics based on the parameter estimates of the structured equation models indicated that all the comorbid groups were significantly different from the pure anxiety disorder group when it came to depression indices of clinical phenomenology. Further, significant differences appeared mainly in terms of the ANX + DEP comorbid group relative to the other comorbid groups. In terms of Parent-child interaction the ANX + EXT and the ANX + DEP comorbid groups were differentiated from the pure anxiety disorder and ANX + ANX comorbid group when it came to the appraisal of the parent/child relationship by the parent, and the acceptance subscale according to the mother report. In terms of peer-child interaction the ANX + EXT and the ANX + DEP comorbid groups were statistically significantly different from the pure anxiety disorder only when it came to the positive interactions and the social skills as rated by mother. Limitations and future research recommendations are discussed.

Evaluation of the internal structural validity of the Diagnostic and Statistical Manual of Mental Disorders (Fourth Edition) anxiety disorders in children and adolescents

The purpose of the present dissertation was to evaluate the internal validity of symptoms of four common anxiety disorders included in the Diagnostic and Statistical Manual of Mental Disorders fourth edition (text revision) (DSM-IV-TR; American Psychiatric Association, 2000), namely, separation anxiety disorder (SAD), social phobia (SOP), specific phobia (SP), and generalized anxiety disorder (GAD), in a sample of 625 youth (ages 6 to 17 years) referred to an anxiety disorders clinic and 479 parents. Confirmatory factor analyses (CFAs) were conducted on the dichotomous items of the SAD, SOP, SP, and GAD sections of the youth and parent versions of the Anxiety Disorders Interview Schedule for DSM-IV (ADIS-IV: C/P; Silverman & Albano, 1996) to test and compare a number of factor models including a factor model based on the DSM. Contrary to predictions, findings from CFAs showed that a correlated model with five factors of SAD, SOP, SP, GAD worry, and GAD somatic distress, provided the best fit of the youth data as well as the parent data. Multiple group CFAs supported the metric invariance of the correlated five factor model across boys and girls. Thus, the present study’s finding supports the internal validity of DSM-IV SAD, SOP, and SP, but raises doubt regarding the internal validity of GAD.^

The development of rubrics to measure undergraduate students' global awareness and global perspective: A validity study

Higher education institutions across the United States have developed global learning initiatives to support student achievement of global awareness and global perspective, but assessment options for these outcomes are extremely limited. A review of research for a global learning initiative at a large, Hispanic-serving, urban, public, research university in South Florida found a lack of instruments designed to measure global awareness and global perspective in the context of an authentic performance assessment. This quasi-experimental study explored the development of two rubrics for the global learning initiative and the extent to which evidence supported the rubrics' validity and reliability. One holistic rubric was developed to measure students' global awareness and the second to measure their global perspective. The study utilized a pretest/posttest nonequivalent group design. Multiple linear regression was used to ascertain the rubrics' ability to discern and compare average learning gains of undergraduate students enrolled in two global learning courses and students enrolled in two non-global learning courses. Parallel pretest/posttest forms of the performance task required students to respond to two open-ended questions, aligned with the learning outcomes, concerning a complex case narrative. Trained faculty raters read responses and used the rubrics to measure students' global awareness and perspective. Reliability was tested by calculating the rates of agreement among raters. Evidence supported the finding that the global awareness and global perspective rubrics yielded scores that were highly reliable measures of students' development of these learning outcomes. Chi-square tests of frequency found significant rates of inter-rater agreement exceeding the study's .80 minimum requirement. Evidence also supported the finding that the rubrics yielded scores that were valid measures of students' global awareness and global perspective. Regression analyses found little evidence of main effects; however, post hoc analyses revealed a significant interaction between global awareness pretest scores and the treatment, the global learning course. Significant interaction was also found between global perspective pretest scores and the treatment. These crossover interactions supported the finding that the global awareness and global perspective rubrics could be used to detect learning differences between the treatment and control groups as well as differences within the treatment group.

An Examination of the Validity of English Language Achievement Test Scores in a LEP Student Population

Approximately 1,700 limited English proficient (LEP) and recently exited LEP students in grades 4 and 10 were tested using both an English and a comparable Spanish language achievement test. Many LEP and former LEP students performed better in math taking the test in Spanish compared to taking it in English.

Participation in a positive youth development program and multi -problem alternative high school students' transformative goals: An investigation of the theoretical and methodological utility and validity of the Transformative Goal Attainment (TGAS)

There is a growing body of literature that provides evidence for the efficacy of positive youth development programs in general and preliminary empirical support for the efficacy of the Changing Lives Program (CLP) in particular. This dissertation sought to extend previous efforts to develop and preliminarily examine the Transformative Goal Attainment Scale (TGAS) as a measure of participant empowerment in the promotion of positive development. Consistent with recent advances in the use of qualitative research methods, this dissertation sought to further investigate the utility of Relational Data Analysis (RDA) for providing categorizations of qualitative open-ended response data. In particular, a qualitative index of Transformative Goals, TG, was developed to complement the previously developed quantitative index of Transformative Goal Attainment (TGA), and RDA procedures for calculating reliability and content validity were refined. Second, as a Stage I pilot/feasibility study this study preliminarily examined the potentially mediating role of empowerment, as indexed by the TGAS, in the promotion of positive development. ^ Fifty-seven participants took part in this study, forty CLP intervention participants and seventeen control condition participants. All 57 participants were administered the study's measures just prior to and just following the fall 2003 semester. This study thus used a short-term longitudinal quasi-experimental research design with a comparison control group. ^ RDA procedures were refined and applied to the categorization of open-ended response data regarding participants' transformative goals (TG) and future possible selves (PSQ-QE). These analyses revealed relatively strong, indirect evidence for the construct validity of the categories as well as their theoretically meaningful structural organization, thereby providing sufficient support for the utility of RDA procedures in the categorization of qualitative open-ended response data. ^ In addition, transformative goals (TG) and future possible selves (PSQ-QE), and the quantitative index of perceived goal attainment (TGA) were evaluated as potential mediators of positive development by testing their relationships to other indices of positive intervention outcome within a four-step method involving both analysis of variance (ANOVA and RMANOVAs) and regression analysis. Though more limited in scope than the efforts at the development and refinement of the measures of these mediators, the results were also promising. ^

Examining the validity of the GRE General Test scores and undergraduate GPA for predicting success in graduate school at a large racially and ethnically diverse public university in Southeast Florida

The purpose of the study was to determine the degree of relationships among GRE scores, undergraduate GPA (UGPA), and success in graduate school, as measured by first year graduate GPA (FGPA), cumulative graduate GPA, and degree attainment status. A second aim of the study was to determine whether the relationships between the composite predictor (GRE scores and UGPA) and the three success measures differed by race/ethnicity and sex. A total of 7,367 graduate student records (masters, 5,990; doctoral: 1,377) from 2000 to 2010 were used to evaluate the relationships among GRE scores, UGPA and the three success measures. Pearson's correlation, multiple linear and logistic regression, and hierarchical multiple linear and logistic regression analyses were performed to answer the research questions. The results of the correlational analyses differed by degree level. For master's students, the ETS proposed prediction that GRE scores are valid predictors of first year graduate GPA was supported by the findings from the present study; however, for doctoral students, the proposed prediction was only partially supported. Regression and correlational analyses indicated that UGPA was the variable that consistently predicted all three success measures for both degree levels. The hierarchical multiple linear and logistic regression analyses indicated that at master's degree level, White students with higher GRE Quantitative Reasoning Test scores were more likely to attain a degree than Asian Americans, while International students with higher UGPA were more likely to attain a degree than White students. The relationships between the three predictors and the three success measures were not significantly different between men and women for either degree level. Findings have implications both for practice and research. They will provide graduate school administrators with institution-specific validity data for UGPA and the GRE scores, which can be referenced in making admission decisions, while they will provide empirical and professionally defensible evidence to support the current practice of using UGPA and GRE scores for admission considerations. In addition, new evidence relating to differential predictions will be useful as a resource reference for future GRE validation researchers.

Validity of the portable piko-6 spirometer used for screening obstructive airway diseases in community pharmacy practice

Background: Obstructive airway diseases (OADs) are among the leading causes of morbidity and mortality worldwide. Shortness of breath (SOB) is the main symptom associated with OADs. International guidelines from the Global Initiative for Chronic Lung Disease (GOLD) and the Global Initiative for Asthma (GINA) have recommended spirometry as an indispensable tool for the diagnosis of asthma and chronic obstructive pulmonary diseases (COPD), but spirometry is rarely used in family practice. Simple and reliable diagnostic tools are necessary for screening community patients with onset of OADs for timely management. Purpose: This thesis examined screening utility of the PiKo-6 forced expiratory volume in one second (pFEV₁) , in six second (pFEV₆), and the pRatio ( pFEV₁/pFEV₆) in SOB patients for OADs in community pharmacy settings. FEV₆ has recently been suggested an excellent surrogate for Forced Vital Capacity (FVC), which requires maximum exhalation of the lungs. Methods: Patients with SOB symptoms who were prescribed pulmonary inhalers, by their family physicians, were recruited via community pharmacies. Trained pharmacists collected two PiKo-6 tests to assess the repeatability of the PiKo-6 device. All patients performed laboratory spirometry ( FEV₁, FVC and FEV₁/FVC) to obtain physician diagnosis of their OADs. The results of the PiKo-6 spirometer and laboratory spirometer were compared. In addition, the PiKo-6 pRatio and laboratory FEV₁/FVC were assessed against physician diagnosed COPD. Results: Sixty three patients volunteered to perform the PiKo-6 spirometry. Of these, 52.4 % were men (age 53.9 ± 15.3 years; BMI 31.9 ± 7.40 kg/m2). Repeated testing with pFEV₁, pFEV6 and pRatio correlated significantly (within correlation, r = 0.835, p-Value≤ 0.05 ; 0.872, p- Value≤ 0.05; and 0.664, p-Value≤ 0.05). In addition, pFEV₁, pFEV6 and pRatio correlated significantly with FEV₁, FVC and FEV₁/FVC, respectively (between correlation = 0.630, p- Value≤ 0.05 ; 0.660, p-Value≤ 0.05 and 0.580, p-Value≤ 0.05). The cut-off value corresponding to the greatest sum of sensitivity and specificity of pRatio for physician-diagnosed COPD was <0.80, the sensitivity and specificity were 84 % and 50%, respectively. Conclusions The portable PiKo-6 correlates moderately well with the standard spirometry, when delivered by community pharmacists to patients with OADs. The PiKo-6 spirometer may play a role in screening patients suspected of having an OAD in community pharmacies that may benefit from early physician diagnosis and appropriate management.

Assessing the relative validity of the Scottish Collaborative Group Food Frequency Questionnaire for measuring dietary intake in adults

Peer reviewed

The development and validity of a functional assessment instrument for persons with major mental disorders

Thèse numérisée par la Direction des bibliothèques de l'Université de Montréal.

Peripheral refraction validity of the Shin-Nippon SRW5000 autorefractor

PURPOSE: To investigate the operation of the Shin-Nippon/Grand Seiko autorefractor and whether higher-order aberrations affect its peripheral refraction measurements. METHODS: Information on instrument design, together with parameters and equations used to obtain refraction, was obtained from a patent. A model eye simulating the operating principles was tested with an optical design program. Effects of induced defocus and astigmatism on the retinal image were used to calibrate the model eye to match the patent equations. Coma and trefoil were added to assess their effects on the image. Peripheral refraction of a physical model eye was measured along four visual field meridians with the Shin-Nippon/Grand Seiko autorefractor SRW-5000 and a Hartmann-Shack aberrometer, and simulated autorefractor peripheral refraction was derived using the Zernike coefficients from the aberrometer. RESULTS: In simulation, the autorefractor's square image was changed in size by defocus, into rectangles or parallelograms by astigmatism, and into irregular shapes by coma and trefoil. In the presence of 1.0 D oblique astigmatism, errors in refraction were proportional to the higher-order aberrations, with up to 0.8 D sphere and 1.5 D cylinder for ±0.6 μm of coma or trefoil coefficients with a 5-mm-diameter pupil. For the physical model eye, refraction with the aberrometer was similar in all visual field meridians, but refraction with the autorefractor changed more quickly along one oblique meridian and less quickly along the other oblique meridian than along the horizontal and vertical meridians. Simulations predicted that higher-order aberrations would affect refraction in oblique meridians, and this was supported by the experimental measurements with the physical model eye. CONCLUSIONS: The autorefractor's peripheral refraction measurements are valid for horizontal and vertical field meridians, but not for oblique field meridians. Similar instruments must be validated before being adopted outside their design scope.

The development and validity of a functional assessment instrument for persons with major mental disorders

Thèse numérisée par la Direction des bibliothèques de l'Université de Montréal.

The Validity of Broad and Narrow Personality Traits For Predicting Job Performance: The Differential Effects of Time

Research into the dynamicity of job performance criteria has found evidence suggesting the presence of rank-order changes to job performance scores across time as well as intraindividual trajectories in job performance scores across time. These findings have influenced a large body of research into (a) the dynamicity of validities of individual differences predictors of job performance and (b) the relationship between individual differences predictors of job performance and intraindividual trajectories of job performance. In the present dissertation, I addressed these issues within the context of the Five Factor Model of personality. The Five Factor Model is arranged hierarchically, with five broad higher-order factors subsuming a number of more narrowly tailored personality facets. Research has debated the relative merits of broad versus narrow traits for predicting job performance, but the entire body of research has addressed the issue from a static perspective -- by examining the relative magnitude of validities of global factors versus their facets. While research along these lines has been enlightening, theoretical perspectives suggest that the validities of global factors versus their facets may differ in their stability across time. Thus, research is needed to not only compare the relative magnitude of validities of global factors versus their facets at a single point in time, but also to compare the relative stability of validities of global factors versus their facets across time. Also necessary to advance cumulative knowledge concerning intraindividual performance trajectories is research into broad vs. narrow traits for predicting such trajectories. In the present dissertation, I addressed these issues using a four-year longitudinal design. The results indicated that the validities of global conscientiousness were stable across time, while the validities of conscientiousness facets were more likely to fluctuate. However, the validities of emotional stability and extraversion facets were no more likely to fluctuate across time than those of the factors. Finally, while some personality factors and facets predicted performance intercepts (i.e., performance at the first measurement occasion), my results failed to indicate a significant effect of any personality variable on performance growth. Implications for research and practice are discussed.

The Responsiveness, Content Validity, and Convergent Validity of the Measure Yourself Concerns and Wellbeing (MYCaW) Patient-Reported Outcome Measure

Objective Measure Yourself Concerns and Wellbeing (MYCaW) is a patient-centred questionnaire that allows cancer patients to identify and quantify the severity of their ‘Concerns’ and Wellbeing, as opposed to using a pre-determined list. MYCaW administration is brief and aids in prioritising treatment approaches. Our goal was to assess the convergent validity and responsiveness of MYCaW scores over time, the generalisability of the existing qualitative coding framework in different complementary and integrative healthcare settings and content validity. Methods Baseline and 6-week follow-up data (n=82) from MYCaW and FACIT-SpEx questionnaires were collected for a service evaluation of the ‘Living Well With The Impact of Cancer’ course at Penny Brohn Cancer Care. MYCaW construct validity was determined using Spearman's Rank Correlation test, and responsiveness indices assessed score changes over time. The existing qualitative coding framework was reviewed using a new dataset (n=158) and coverage of concern categories compared to items of existing outcome measures. Results Good correlation between MYCaW and FACIT-SpEx score changes were achieved (r= -0.57, p≥0.01). MYCaW Profile and Concern scores were highly responsive to change: SRM=1.02 and 1.08; effect size=1.26 and 1.22. MYCaW change scores showed the anticipated gradient of change according to clinically relevant degrees of change. Categories including ‘Spirituality’, ‘weight change’ and ‘practical concerns’ were added to the coding framework to improve generalisability. Conclusions MYCaW scores were highly responsive to change, allowing personalized patient outcomes to be quantified; the qualitative coding framework is generalisable across different oncology settings and has broader coverage of patient-identified concerns compared with existing cancer-related patient-reported outcome measures.

The Reliability and Validity of a Child and Adolescent Participation in Decision Making Questionnaire

Background
There is a growing impetus across the research, policy and practice communities for children and young people to participate in decisions that affect their lives. Furthermore, there is a dearth of general instruments that measure children and young people’s views on their participation in decision making. This paper presents the reliability and validity of the Child and Adolescent Participation in Decision Making Questionnaire (CAP-DMQ) and specifically looks at a population of looked-after children where a lack of participation in decision making is an acute issue.
Methods
The participants were 151 looked after children and adolescents between 10-23 years of age who completed the 10 item CAP-DMQ. Of the participants 113 were in receipt of an advocacy service that had an aim of increasing participation in decision-making with the remaining participants not having received this service.
Results
The results showed that the CAP-DMQ had good reliability (Cronbach’s alpha = .94) and showed promising uni-dimensional construct validity through an exploratory factor analysis. The items in the CAP-DMQ also demonstrated good content validity by overlapping with prominent models of child and adolescent participation (Lundy 2007) and decision making (Halpern 2014). A regression analysis showed that age and gender were not significant predictors of CAP-DMQ scores but receipt of advocacy was a significant predictor of scores (effect size d=.88), thus showing appropriate discriminant criterion validity.
Conclusion
Overall, the CAP-DMQ showed good reliability and validity. Therefore, the measure has excellent promise for theoretical investigation in the area of child and adolescent participation in decision making and equally shows empirical promise for use as a measure in evaluating services which have increasing the participation of children and adolescents in decision making as an intended outcome.

The reliability and factorial validity of the Adolescent Alcohol Involvement Scale in a large sample in the United Kingdom

The assessment of adolescent drinking behavior is a complex task, complicated by variability in drinking patterns, the transitory and developmental nature of the behavior and the reliance (for large scale studies) on self-report questionnaires. The Adolescent Alcohol Involvement Scale (Mayer & Filstead, 1979) is a 14-item screening tool designed to help to identify alcohol misusers or more problematic drinkers. The present study utilized a large sample (n = 4066) adolescents from Northern Ireland. Results of Confirmatory Factor Analyses and reliability estimates revealed that the 14-items share sufficient common variance that scores can be considered to be reliable and that the 14 items can be scored to provide a composite alcohol use score.