Assessing the construct validity and reliability of the parental perception on antibiotics (PAPA) scales

Background: The overuse of antibiotics is becoming an increasing concern. Antibiotic resistance, which increases both the burden of disease, and the cost of health services, is perhaps the most profound impact of antibiotics overuse. Attempts have been made to develop instruments to measure the psychosocial constructs underlying antibiotics use, however, none of these instruments have undergone thorough psychometric validation. This study evaluates the psychometric properties of the Parental Perceptions on Antibiotics (PAPA) scales. The PAPA scales attempt to measure the factors influencing parental use of antibiotics in children. Methods: 1111 parents of children younger than 12 years old were recruited from primary schools’ parental meetings in the Eastern Province of Saudi Arabia from September 2012 to January 2013. The structure of the PAPA instrument was validated using Confirmatory Factor Analysis (CFA) with measurement model fit evaluated using the raw and scaled χ2, Goodness of Fit Index, and Root Mean Square Error of Approximation. Results: A five-factor model was confirmed with the model showing good fit. Constructs in the model include: Knowledge and Beliefs, Behaviors, Sources of information, Adherence, and Awareness about antibiotics resistance. The instrument was shown to have good internal consistency, and good discriminant and convergent validity. Conclusion: The availability of an instrument able to measure the psychosocial factors underlying antibiotics usage allows the risk factors underlying antibiotic use and overuse to now be investigated.

VOCATIONAL INTERESTS: CONSTRUCT VALIDITY AND MEASUREMENT

This dissertation addressed several questions relevant to vocational interests and personality characteristics, examining (a) the roles of personality, vocational interests, and sexual fantasies in defining a general factor of Masculinity/Femininity (M/F) (Study 1), (b) the validity of a new measure of vocational interests (Study 2), and (c) the individual difference characteristics that discriminate between students in various academic majors, and that predict academic outcomes (Study 3). In Study 1, vocational interests, personality, and sexual fantasies were examined to find whether these variables would yield a general Masculinity/Femininity (M/F) factor, and whether that factor would still emerge when controlling for participant sex. The results of Study 1 revealed that a general factor of M/F did emerge. When sex was removed, the loadings of vocational interests decreased from high to very low, suggesting that the link of vocational interests with other indicators of M/F is mainly due to sex differences in these variables. The purpose of Study 2 was to validate the Oregon Vocational Interest Scales (ORVIS), a new public domain vocational interests questionnaire designed to measure eight vocational interest scales. ORVIS scores obtained in a college and community sample were compared with those of two personality measures and two cognitive ability tests. Results from this study showed that the ORVIS scales were reliable and showed good construct validity. The purpose of Study 3, using the ORVIS along with the HEXACO-PI and tests of cognitive ability, was to examine the individual difference characteristics of students in different academic majors, and to use the congruence between a student's academic major and vocational interests as a predictor of academic outcomes, such as GPA, academic major change, and satisfaction with major. The results of Study 3 revealed that students in different academic majors show theoretically meaningful differences in personality, abilities, and interests. Conscientiousness and math ability were found to be the best predictors of academic outcomes. However, congruence between major and interests did not add significant predictive validity to any of these outcomes beyond personality and ability. Together, these three studies show the role of vocational interests in defming MlF and in predicting various academic outcomes.

Assessment of construct validity and reliability of the inventory of masculinity and femininity in adolescents and young adults Colombian

This study evaluated the construct validity and reliability of Femininity and Masculinity Inventory-Imafe (Lara, 1993), and calculated standardized punctuations for Colombian teenagers and young adults. Participants were 1527 male and female, between 15 and 42. The general and scale reliability was evaluated through Alfa and Guttmann coefficients, and the factor analysis was used to estimate the construct validity. Standardized punctuations were obtained for gender, since there were statistically significant differences for sex in the six scales of the instrument. The inventory presented reliability values that oscillated between .76 and .88, and the factorial analysis showed three factors coherent with the factors found in its original validation. Correlacional inter-scales analysis and sex-differences were theoretically consistent.

Construct validity of a figure rating scale for Brazilian adolescents

Background: Figure rating scales were developed as a tool to determine body dissatisfaction in women, men, and children. However, it lacks in the literature the validation of the scale for body silhouettes previously adapted. We aimed to obtain evidence for construct validity of a figure rating scale for Brazilian adolescents.Methods: The study was carried out with adolescent students attending three public schools in an urban region of the municipality of Florianopolis in the State of Santa Catarina (SC). The sample comprised 232 10-19-year-old students, 106 of whom are boys and 126 girls, from the 5th series (i.e. year) of Primary School to the 3rd year of Secondary School. Data-gathering involved the application of an instrument containing 8 body figure drawings representing a range of children's and adolescents' body shapes, ranging from very slim (contour 1) to obese (contour 8). Weights and heights were also collected, and body mass index (BMI) was calculated later. BMI was analyzed as a continuous variable, using z-scores, and as a dichotomous categorical variable, representing a diagnosis of nutritional status (normal and overweight including obesity).Results: Results showed that both males and females with larger BMI z-scores chose larger body contours. Girls with higher BMI z-scores also show higher values of body image dissatisfaction.Conclusion: We provided the first evidence of validity for a figure rating scale for Brazilian adolescents.

Construct validity of behavioral models of anxiety: where experimental psychopathology meets ecology and evolution

In experimental psychopathology, construct validity is usually enhanced by addressing theories from other fields in its nomological network. In the field of anxiety research, this construct is related to antipredator behavior, conserved across phylogeny in its functions and neural basis, but not necessarily on its topography. Even though the relations between behavioral models of anxiety and statements from behavioral ecology and evolutionary biology are commonly made in anxiety research, these are rarely tested, at least explicitly. However, in order to increase construct validity in experimental anxiety, testing predictions from those theories is highly desirable. This article discusses these questions, suggesting a few ways in which behavioral ecological and evolutionary hypotheses of anxiety-like behavior may be tested.

Reliability and construct validity of the karate-specific aerobic test

Chaabene, H, Hachana, Y, Franchini, E, Mkaouer, B, Montassar, M, and Chamari, K. Reliability and construct validity of the karate-specific aerobic test. J Strength Cond Res 26(12): 3454-3460, 2012-The aim of this study was to examine absolute and relative reliabilities and external responsiveness of the Karate-specific aerobic test (KSAT). This study comprised 43 male karatekas, 19 of them participated in the first study to establish test-retest reliability and 40, selected on the bases of their karate experience and level of practice, participated in the second study to identify external responsiveness of the KSAT. The latter group was divided into 2 categories: national-level group (G(n)) and regional-level group (Gr). Analysis showed excellent test-retest reliability of time to exhaustion (TE), with intraclass correlation coefficient ICC(3,1) >0.90, standard error of measurement (SEM) <5%: (3.2%) and mean difference (bias) +/- the 95% limits of agreement: -9.5 +/- 78.8 seconds. There was a significant difference between test-retest session in peak lactate concentration (Peak [La]) (9.12 +/- 2.59 vs. 8.05 +/- 2.67 mmol.L-1; p < 0.05) but not in peak heart rate (HRpeak) and rating of perceived exertion (RPE) (196 +/- 9 vs. 194 +/- 9 b.min(-1) and 7.6 +/- 0.93 vs. 7.8 +/- 1.15; p > 0.05), respectively. National-level karate athletes (1,032 +/- 101 seconds) were better than regional level (841 +/- 134 seconds) on TE performance during KSAT (p < 0.001). Thus, KSAT provided good external responsiveness. The area under the receiver operator characteristics curve was >0.70 (0.86; confidence interval 95%: 0.72-0.95). Significant difference was detected in Peak [La] between national- (6.09 +/- 1.78 mmol.L-1) and regional-level (8.48 +/- 2.63 mmol.L-1) groups, but not in HRpeak (194 +/- 8 vs. 195 +/- 8 b.min(-1)) and RPE (7.57 +/- 1.15 vs. 7.42 +/- 1.1), respectively. The result of this study indicates that KSAT provides excellent absolute and relative reliabilities. The KSAT can effectively distinguish karate athletes of different competitive levels. Thus, the KSAT may be suitable for field assessment of aerobic fitness of karate practitioners.

Face, content and construct validity of a novel robotic surgery simulator

We evaluated the face, content and construct validity of the novel da Vinci® Skills Simulator™ using the da Vinci Si™ Surgeon Console as the surgeon interface.

Construct Validity of the Pig Intestine Model in the Simulation of Laparoscopic Urethrovesical Anastomosis

Introduction: Laparoscopic training models are increasingly important in urology to allow trainees to improve their laparoscopic skills prior to going to the operating room. For a training model to be valid, it must correlate with performance in a real case. The model must also discriminate between experienced and inexperienced subjects. [See PDF for complete abstract]

An examination of the cross-cultural reliability and construct validity of a measure of loneliness

Loneliness is a pervasive, rather common experience in American culture, particularly notable among adolescents. However, the phenomenon is not well documented in the cross-cultural psychiatric literature. For psychiatric epidemiology to encompass a wide array of psychopathologic phenomena, it is important to develop useful measures to characterize and classify both non-clinical and clinical dysfunction in diverse subgroups and cultures.^ The goal of this research was to examine the cross-cultural reliability and construct validity of a scale designed to measure loneliness. The Roberts Loneliness Scale (RLS-8) was administered to 4,060 adolescents ages 10-19 years enrolled in high schools along either side of the Texas-Tamaulipas border region between the U.S. and Mexico. Data collected in 1988 from a study focusing on substance use and psychological distress among adolescents in these regions were used to examine the operating characteristics of the RLS-8. A sample stratified by nationality and language, age, gender, and grade was used for analysis.^ Results indicated that in general the RLS-8 has moderate reliability in the U.S. sample, but not in the Mexican sample. Validity analyses demonstrated that there was evidence for convergent validity of the RLS-8 in the U.S. sample, but none in the Mexican sample. Discriminant validity of the measures in neither sample could be established. Based on the factor structure of the RLS-8, two subscales were created and analyzed for construct validity. Evidence for convergent validity was established for both subscales in both national samples. However, the discriminant validity of the measure remains unsubstantiated in both national samples. Also, the dimensionality of the scale is unresolved.^ One primary goal for future cross-cultural research would be to develop and test better defined culture-specific models of loneliness within the two cultures. From such scientific endeavor, measures of loneliness can be developed or reconstructed to classify the phenomenon in the same manner across cultures. Since estimates of prevalence and incidence are contingent upon reliable and valid screening or diagnostic measures, this objective would serve as an important foundation for future psychiatric epidemiologic inquiry into loneliness. ^

Mistreatment and self-neglect in community dwelling older adults: Studies of construct validity, measurement invariance and latent classes

Mistreatment and self-neglect significantly increase the risk of dying in older adults. It is estimated that 1 to 2 million older adults experience elder mistreatment and self-neglect every year in the United States. Currently, there are no elder mistreatment and self-neglect assessment tools with construct validity and measurement invariance testing and no studies have sought to identify underlying latent classes of elder self-neglect that may have differential mortality rates. Using data from 11,280 adults with Texas APS substantiated elder mistreatment and self-neglect 3 studies were conducted to: (1) test the construct validity and (2) the measurement invariance across gender and ethnicity of the Texas Adult Protective Services (APS) Client Assessment and Risk Evaluation (CARE) tool and (3) identify latent classes associated with elder self-neglect. Study 1 confirmed the construct validity of the CARE tool following adjustments to the initial hypothesized CARE tool. This resulted in the deletion of 14 assessment items and a final assessment with 5 original factors and 43 items. Cross-validation for this model was achieved. Study 2 provided empirical evidence for factor loading and item-threshold invariance of the CARE tool across gender and between African-Americans and Caucasians. The financial status domain of the CARE tool did not function properly for Hispanics and thus, had to be deleted. Subsequent analyses showed factor loading and item-threshold invariance across all 3 ethnic groups with the exception of some residual errors. Study 3 identified 4-latent classes associated with elder self-neglect behaviors which included individuals with evidence of problems in the areas of (1) their environment, (2) physical and medical status, (3) multiple domains and (4) finances. Overall, these studies provide evidence supporting the use of APS CARE tool for providing unbiased and valid investigations of mistreatment and neglect in older adults with different demographic characteristics. Furthermore, the findings support the underlying notion that elder self-neglect may not only occur along a continuum, but that differential types may exist. All of which, have very important potential implications for social and health services distributed to vulnerable mistreated and neglected older adults.^

Face, content, and construct validity of the EndoViS training system for objective assessment of psychomotor skills of laparoscopic surgeons

Background The aim of this study is to present face, content, and constructs validity of the endoscopic orthogonal video system (EndoViS) training system and determines its efficiency as a training and objective assessment tool of the surgeons’ psychomotor skills. Methods Thirty-five surgeons and medical students participated in this study: 11 medical students, 19 residents, and 5 experts. All participants performed four basic skill tasks using conventional laparoscopic instruments and EndoViS training system. Subsequently, participants filled out a questionnaire regarding the design, realism, overall functionality, and its capabilities to train hand–eye coordination and depth perception, rated on a 5-point Likert scale. Motion data of the instruments were obtained by means of two webcams built into a laparoscopic physical trainer. To identify the surgical instruments in the images, colored markers were placed in each instrument. Thirteen motion-related metrics were used to assess laparoscopic performance of the participants. Statistical analysis of performance was made between novice, intermediate, and expert groups. Internal consistency of all metrics was analyzed with Cronbach’s α test. Results Overall scores about features of the EndoViS system were positives. Participants agreed with the usefulness of tasks and the training capacities of EndoViS system (score >4). Results presented significant differences in the execution of three skill tasks performed by participants. Seven metrics showed construct validity for assessment of performance with high consistency levels. Conclusions EndoViS training system has been successfully validated. Results showed that EndoViS was able to differentiate between participants of varying laparoscopic experience. This simulator is a useful and effective tool to objectively assess laparoscopic psychomotor skills of the surgeons.

A comparison of the Yale-Brown obsessive compulsive scale for "Heavy drinking" with a single item craving measure: Construct validity and clinical utility

The measurement of alcohol craving began with single-item scales. Multifactorial scales developed with the intention to capture more fully the phenomenon of craving. This study examines the construct validity of a multifactorial scale, the Yale-Brown Obsessive Compulsive Scale for heavy drinking (Y-BOCS-hd). The study compares its clinical utility with a single item visual-analogue craving scale. The study includes 212 alcohol dependent subjects (127 males, 75 females) undertaking an outpatient treatment program between 1999-2001. Subjects completed the Y-BOCS-hd and a single item visual-analogue scale, in addition to alcohol consumption and dependence severity measures. The Y-BOCS-hd had strong construct validity. Both the visual-analogue alcohol craving scale and Y-BOCS-hd were weakly associated with pretreatment dependence severity. There was a significant association between pretreatment alcohol consumption and the visual-analogue craving scale. Neither craving measure was able to predict total program abstinence or days abstinent. The relationship between obsessive-compulsive behavior in alcohol dependence and craving remains unclear.

Assessing the construct validity of a measure of learning agility

This study examined the construct validity of the Choices questionnaire that purported to support the theory of Learning Agility. Specifically, Learning Agility attempts to predict an individual's potential performance in new tasks. The construct validity will be measured by examining the convergent/discriminant validity of the Choices Questionnaire against a cognitive ability measure and two personality measures. The Choices Questionnaire did tap a construct that is unique to the cognitive ability and the personality measures, thus suggesting that this measure may have considerable value in personnel selection. This study also examined the relationship of this pew measure to job performance and job promotability. Results of this study found that the Choices Questionnaire predicted job performance and job promotability above and beyond cognitive ability and personality. Data from 107 law enforcement officers, along with two of their co-workers and a supervisor resulted in a correlation of .08 between Learning Agility and cognitive ability. Learning Agility correlated .07 with Learning Goal Orientation and. 17 with Performance Goal Orientation. Correlations with the Big Five Personality factors ranged from −.06 to. 13 with Conscientiousness and Openness to Experience, respectively. Learning Agility correlated .40 with supervisory ratings of job promotability and correlated .3 7 with supervisory ratings of overall job performance. Hierarchical regression analysis found incremental validity for Learning Agility over cognitive ability and the Big Five factors of personality for supervisory ratings of both promotability and overall job performance. A literature review was completed to integrate the Learning Agility construct into a nomological net of personnel selection research. Additionally, practical applications and future research directions are discussed. ^

Reliability, construct and criterion validity of the KIDSCREEN-10 score: a short measure for children and adolescents' well-being and health-related quality of life

Background To assess the criterion and construct validity of the KIDSCREEN-10 well-being and health-related quality of life (HRQoL) score, a short version of the KIDSCREEN-52 and KIDSCREEN-27 instruments. Methods The child self-report and parent report versions of the KIDSCREEN-10 were tested in a sample of 22,830 European children and adolescents aged 8–18 and their parents (n = 16,237). Correlation with the KIDSCREEN-52 and associations with other generic HRQoL measures, physical and mental health, and socioeconomic status were examined. Score differences by age, gender, and country were investigated. Results Correlations between the 10-item KIDSCREEN score and KIDSCREEN-52 scales ranged from r = 0.24 to 0.72 (r = 0.27–0.72) for the self-report version (proxy-report version). Coefficients below r = 0.5 were observed for the KIDSCREEN-52 dimensions Financial Resources and Being Bullied only. Cronbach alpha was 0.82 (0.78), test–retest reliability was ICC = 0.70 (0.67) for the self- (proxy-)report version. Correlations between other children self-completed HRQoL questionnaires and KIDSCREEN-10 ranged from r = 0.43 to r = 0.63 for the KIDSCREEN children self-report and r = 0.22–0.40 for the KIDSCREEN parent proxy report. Known group differences in HRQoL between physically/mentally healthy and ill children were observed in the KIDSCREEN-10 self and proxy scores. Associations with self-reported psychosomatic complaints were r = −0.52 (−0.36) for the KIDSCREEN-10 self-report (proxy-report). Statistically significant differences in KIDSCREEN-10 self and proxy scores were found by socioeconomic status, age, and gender. Conclusions Our results indicate that the KIDSCREEN-10 provides a valid measure of a general HRQoL factor in children and adolescents, but the instrument does not represent well most of the single dimensions of the original KIDSCREEN-52. Test–retest reliability was slightly below a priori defined thresholds.