On the validity of subjective measures of company performance

Subjective measures of company performance are widely used in research and typically are interpreted as equivalent to objective measures. Yet, the assumption of equivalence is open to challenge. We compared the use of both types of measure in 3 separate samples. Findings were consistent in showing that: (a) subjective and objective measures of company performance were positively associated (convergent validity); (b) those relationships were stronger than those between measures of differing aspects of performance using the same method (discriminant validity); and (c) the relationships of subjective and objective company performance measures with a range of independent variables were equivalent (construct validity).

Participation in a positive youth development program and multi -problem alternative high school students' transformative goals: An investigation of the theoretical and methodological utility and validity of the Transformative Goal Attainment (TGAS)

There is a growing body of literature that provides evidence for the efficacy of positive youth development programs in general and preliminary empirical support for the efficacy of the Changing Lives Program (CLP) in particular. This dissertation sought to extend previous efforts to develop and preliminarily examine the Transformative Goal Attainment Scale (TGAS) as a measure of participant empowerment in the promotion of positive development. Consistent with recent advances in the use of qualitative research methods, this dissertation sought to further investigate the utility of Relational Data Analysis (RDA) for providing categorizations of qualitative open-ended response data. In particular, a qualitative index of Transformative Goals, TG, was developed to complement the previously developed quantitative index of Transformative Goal Attainment (TGA), and RDA procedures for calculating reliability and content validity were refined. Second, as a Stage I pilot/feasibility study this study preliminarily examined the potentially mediating role of empowerment, as indexed by the TGAS, in the promotion of positive development. ^ Fifty-seven participants took part in this study, forty CLP intervention participants and seventeen control condition participants. All 57 participants were administered the study's measures just prior to and just following the fall 2003 semester. This study thus used a short-term longitudinal quasi-experimental research design with a comparison control group. ^ RDA procedures were refined and applied to the categorization of open-ended response data regarding participants' transformative goals (TG) and future possible selves (PSQ-QE). These analyses revealed relatively strong, indirect evidence for the construct validity of the categories as well as their theoretically meaningful structural organization, thereby providing sufficient support for the utility of RDA procedures in the categorization of qualitative open-ended response data. ^ In addition, transformative goals (TG) and future possible selves (PSQ-QE), and the quantitative index of perceived goal attainment (TGA) were evaluated as potential mediators of positive development by testing their relationships to other indices of positive intervention outcome within a four-step method involving both analysis of variance (ANOVA and RMANOVAs) and regression analysis. Though more limited in scope than the efforts at the development and refinement of the measures of these mediators, the results were also promising. ^

The Responsiveness, Content Validity, and Convergent Validity of the Measure Yourself Concerns and Wellbeing (MYCaW) Patient-Reported Outcome Measure

Objective Measure Yourself Concerns and Wellbeing (MYCaW) is a patient-centred questionnaire that allows cancer patients to identify and quantify the severity of their ‘Concerns’ and Wellbeing, as opposed to using a pre-determined list. MYCaW administration is brief and aids in prioritising treatment approaches. Our goal was to assess the convergent validity and responsiveness of MYCaW scores over time, the generalisability of the existing qualitative coding framework in different complementary and integrative healthcare settings and content validity. Methods Baseline and 6-week follow-up data (n=82) from MYCaW and FACIT-SpEx questionnaires were collected for a service evaluation of the ‘Living Well With The Impact of Cancer’ course at Penny Brohn Cancer Care. MYCaW construct validity was determined using Spearman's Rank Correlation test, and responsiveness indices assessed score changes over time. The existing qualitative coding framework was reviewed using a new dataset (n=158) and coverage of concern categories compared to items of existing outcome measures. Results Good correlation between MYCaW and FACIT-SpEx score changes were achieved (r= -0.57, p≥0.01). MYCaW Profile and Concern scores were highly responsive to change: SRM=1.02 and 1.08; effect size=1.26 and 1.22. MYCaW change scores showed the anticipated gradient of change according to clinically relevant degrees of change. Categories including ‘Spirituality’, ‘weight change’ and ‘practical concerns’ were added to the coding framework to improve generalisability. Conclusions MYCaW scores were highly responsive to change, allowing personalized patient outcomes to be quantified; the qualitative coding framework is generalisable across different oncology settings and has broader coverage of patient-identified concerns compared with existing cancer-related patient-reported outcome measures.

The Reliability and Validity of a Child and Adolescent Participation in Decision Making Questionnaire

Background
There is a growing impetus across the research, policy and practice communities for children and young people to participate in decisions that affect their lives. Furthermore, there is a dearth of general instruments that measure children and young people’s views on their participation in decision making. This paper presents the reliability and validity of the Child and Adolescent Participation in Decision Making Questionnaire (CAP-DMQ) and specifically looks at a population of looked-after children where a lack of participation in decision making is an acute issue.
Methods
The participants were 151 looked after children and adolescents between 10-23 years of age who completed the 10 item CAP-DMQ. Of the participants 113 were in receipt of an advocacy service that had an aim of increasing participation in decision-making with the remaining participants not having received this service.
Results
The results showed that the CAP-DMQ had good reliability (Cronbach’s alpha = .94) and showed promising uni-dimensional construct validity through an exploratory factor analysis. The items in the CAP-DMQ also demonstrated good content validity by overlapping with prominent models of child and adolescent participation (Lundy 2007) and decision making (Halpern 2014). A regression analysis showed that age and gender were not significant predictors of CAP-DMQ scores but receipt of advocacy was a significant predictor of scores (effect size d=.88), thus showing appropriate discriminant criterion validity.
Conclusion
Overall, the CAP-DMQ showed good reliability and validity. Therefore, the measure has excellent promise for theoretical investigation in the area of child and adolescent participation in decision making and equally shows empirical promise for use as a measure in evaluating services which have increasing the participation of children and adolescents in decision making as an intended outcome.

Validity and reliability of a pictorial instrument for assessing perceived motor competence in Portuguese children

It is important to assess young children's perceived Fundamental Movement Skill (FMS) competence in order to examine the role of perceived FMS competence in motivation toward physical activity. Children's perceptions of motor competence may vary according to the culture/country of origin; therefore, it is also important to measure perceptions in different cultural contexts. The purpose was to assess the face validity, internal consistency, test–retest reliability and construct validity of the 12 FMS items in the Pictorial Scale for Perceived Movement Skill Competence for Young Children (PMSC) in a Portuguese sample. Methods Two hundred one Portuguese children (girls, n = 112), 5 to 10 years of age (7.6 ± 1.4), participated. All children completed the PMSC once. Ordinal alpha assessed internal consistency. A random subsamples (n = 47) were reassessed one week later to determine test–retest reliability with Bland–Altman method. Children were asked questions after the second administration to determine face validity. Construct validity was assessed on the whole sample with a Bayesian Structural Equation Modelling (BSEM) approach. The hypothesized theoretical model used the 12 items and two hypothesized factors: object control and locomotor skills. Results The majority of children correctly identified the skills and could understand most of the pictures. Test–retest reliability analysis was good, with an agreement ration between 0.99 and 1.02. Ordinal alpha values ranged from acceptable (object control 0.73, locomotor 0.68) to good (all FMS 0.81). The hypothesized BSEM model had an adequate fit. Conclusions The PMSC can be used to investigate perceptions of children's FMS competence. This instrument can also be satisfactorily used among Portuguese children.

EVIDENCE OF VALIDITY OF THE LSB-50: CROSS-VALIDATION, FACTORIAL INVARIANCE AND EXTERNAL CRITERION ANALYSIS

The aim of this paper was to obtain evidence of the validity of the LSB-50 (de Rivera & Abuín, 2012), a screening measure of psychopathology, in Argentinean adolescents. The sample consisted of 1002 individuals (49.7% male; 50.3% female) between 12 and 18 years-old (M = 14.98; SD = 1.99). A cross-validation study and factorial invariance studies were performed in samples divided by sex and age to test if a seven-factor structure that corresponds to seven clinical scales (Hypersensitivity, Obsessive-Compulsive, Anxiety, Hostility, Somatization, Depression, and Sleep disturbance) was adequate for the LSB-50. The seven-factor structure proved to be suitable for all the subsamples. Next, the fit of the seven-factor structure was studied simultaneously? in the aforementioned subsamples through hierarchical models that imposed different constrains of equivalency?. Results indicated the invariance of the seven clinical dimensions of the LSB-50. Ordinal alphas showed good internal consistency for all the scales. Finally, the correlations with a diagnostic measure of psychopathology (PAI-A) indicated moderate convergence. It is concluded that the analyses performed provide robust evidence of construct validity for the LSB-50

Validity and reliability of the international fItness scale (IFIS) in a population-based sample of schoolchildren in Bogota, Colombia: The FUPRECOL study

The International FItness Scale (IFIS) is a self-reported measure of physical fitness that could easily. This scale has been validated in children, adolescents, and young adults; however, it is unknown whether the IFIS represents a valid and reliable estimate of physical fitness in Latino-American youth population. In the present study we aimed to examine the validity and reliability of the IFIS on a population-based sample of schoolchildren in Bogota, Colombia. Participants were 1,875 Colombian youth (56.2% girls) aged 9 to 17.9 years old. We measured adiposity markers (body fat, waist-to-height ratio, skinfold thicknesses and BMI), blood pressure, lipids profile, fasting glucose, and physical fitness level (self reported and measured). Also, a validated cardiometabolic risk index was used. An age- and sex-matched sample of 229 Schoolchildren originally not included in the study sample fulfilled IFIS twice for reliability purposes. Our data suggest that both measured and self-reported overall fitness were associated inversely with adiposity indicators and a cardiometabolic risk score. Overall, schoolchildren who self-reported “good” and “very good” fitness had better measured fitness than those who reported “very poor” and “poor” fitness (all p<0.001). Test–retest reliability of IFIS items was also good, with an average weighted Kappa of 0.811. Therefore, our findings suggest that self-reported fitness, as assessed by IFIS, is a valid, reliable, and health-related measure, and it can be a good alternative for future use in large studies with Latin-schoolchildren from Colombia.

Psychometric Properties Evaluation Of A New Ergonomics-related Job Factors Questionnaire Developed For Nursing Workers.

The objectives of this study were to develop a questionnaire that evaluates the perception of nursing workers to job factors that may contribute to musculoskeletal symptoms, and to evaluate its psychometric properties. Internationally recommended methodology was followed: construction of domains, items and the instrument as a whole, content validity, and pre-test. Psychometric properties were evaluated among 370 nursing workers. Construct validity was analyzed by the factorial analysis, known-groups technique, and convergent validity. Reliability was assessed through internal consistency and stability. Results indicated satisfactory fit indices during confirmatory factor analysis, significant difference (p < 0.01) between the responses of nursing and office workers, and moderate correlations between the new questionnaire and Numeric Pain Scale, SF-36 and WRFQ. Cronbach's alpha was close to 0.90 and ICC values ranged from 0.64 to 0.76. Therefore, results indicated that the new questionnaire had good psychometric properties for use in studies involving nursing workers.

[pediatric Patient Classification System: Improvement Of An Instrument].

Improve the content validity of the instrument for classification of pediatric patients and evaluate its construct validity. A descriptive exploratory study in the measurement of the content validity index, and correlational design for construct validation through exploratory factor analysis. The content validity index for indicators was 0.99 and it was 0.97 for graded situations. Three domains were extracted in the construct validation, namely: patient, family and therapeutic procedures, with 74.97% of explained variance. The instrument showed evidences of content and construct validity. The validation of the instrument occurred under the approach of family-centered care, and allowed incorporating some essential needs of childhood such as playing, interaction and affection in the content of the instrument.

Relações entre as dimensões da Imagem Corporal : um estudo em homens brasileiros

Universidade Estadual de Campinas . Faculdade de Educação Física

Validade e confiabilidade da versão brasileira do Índice de Capacidade para o Trabalho

OBJETIVO: Avaliar a validade e a confiabilidade da versão brasileira de índice de capacidade para o trabalho. MÉTODOS:Estudo transversal com amostra de 475 trabalhadores de empresa do setor elétrico no estado de São Paulo (dez municípios em Campinas e região), realizado em 2005. Foram avaliados os seguintes aspectos da versão brasileira do Índice de Capacidade para o Trabalho: validade de construto, por meio de análise fatorial confirmatória e da capacidade discriminante; validade de critério, correlacionado o escore do índice com medidas de saúde auto-referidas; e confiabilidade, por meio da análise da consistência interna utilizando o coeficiente alfa de Cronbach. RESULTADOS: A análise fatorial indicou três fatores do construto capacidade para o trabalho: questões relativas aos "recursos mentais" (20,6% da variância), à autopercepção da capacidade para o trabalho (18,9% da variância) e à presença de doenças e limitações decorrentes do estado de saúde (18,4% da variância). O índice discriminou os trabalhadores segundo nível de absenteísmo, identificando média estatisticamente significativa (p<0,001) entre aqueles com absenteísmo elevado (37,2 pontos) e baixo (42,3 pontos). A análise de critério mostrou correlação do índice com todas as dimensões do estado de saúde analisadas (p<0,0001). O índice apresentou boa confiabilidade com coeficiente alfa de Cronbach (0,72). CONCLUSÕES: A versão brasileira do Índice de Capacidade para o Trabalho mostrou propriedades psicométricas satisfatórias quanto à validade de construto, de critério e de confiabilidade, representando uma opção adequada para avaliação da capacidade para o trabalho em abordagens individuais e inquéritos populacionais.

Does Training Laparoscopic Skills in a Virtual Reality Simulator Improve Surgical Performance?

Background and Purpose: Several different methods of teaching laparoscopic skills have been advocated, with virtual reality surgical simulation (VRSS) being the most popular. Its effectiveness in improving surgical performance is not a consensus yet, however. The purpose of this study was to determine whether practicing surgical skills in a virtual reality simulator results in improved surgical performance. Materials and Methods: Fifteen medical students recruited for the study were divided into three groups. Group I (control) did not receive any VRSS training. For 10 weeks, group II trained basic laparoscopic skills (camera handling, cutting skill, peg transfer skill, and clipping skill) in a VRSS laparoscopic skills simulator. Group III practiced the same skills and, in addition, performed a simulated cholecystectomy. All students then performed a cholecystectomy in a swine model. Their performance was reviewed by two experienced surgeons. The following parameters were evaluated: Gallbladder pedicle dissection time, clipping time, time for cutting the pedicle, gallbladder removal time, total procedure time, and blood loss. Results: With practice, there was improvement in most of the evaluated parameters by each of the individuals. There were no statistical differences in any of evaluated parameters between those who did and did not undergo VRSS training, however. Conclusion: VRSS training is assumed to be an effective tool for learning and practicing laparoscopic skills. In this study, we could not demonstrate that VRSS training resulted in improved surgical performance. It may be useful, however, in familiarizing surgeons with laparoscopic surgery. More effective methods of teaching laparoscopic skills should be evaluated to help in improving surgical performance.

Psychometric properties of the Child Health Assessment Questionnaire (CHAQ) applied to children and adolescents with cerebral palsy

Background: Cerebral palsy (CP) patients have motor limitations that can affect functionality and abilities for activities of daily living (ADL). Health related quality of life and health status instruments validated to be applied to these patients do not directly approach the concepts of functionality or ADL. The Child Health Assessment Questionnaire (CHAQ) seems to be a good instrument to approach this dimension, but it was never used for CP patients. The purpose of the study was to verify the psychometric properties of CHAQ applied to children and adolescents with CP. Methods: Parents or guardians of children and adolescents with CP, aged 5 to 18 years, answered the CHAQ. A healthy group of 314 children and adolescents was recruited during the validation of the CHAQ Brazilian-version. Data quality, reliability and validity were studied. The motor function was evaluated by the Gross Motor Function Measure (GMFM). Results: Ninety-six parents/guardians answered the questionnaire. The age of the patients ranged from 5 to 17.9 years (average: 9.3). The rate of missing data was low(< 9.3%). The floor effect was observed in two domains, being higher only in the visual analogue scales (<= 35.5%). The ceiling effect was significant in all domains and particularly high in patients with quadriplegia (81.8 to 90.9%) and extrapyramidal (45.4 to 91.0%). The Cronbach alpha coefficient ranged from 0.85 to 0.95. The validity was appropriate: for the discriminant validity the correlation of the disability index with the visual analogue scales was not significant; for the convergent validity CHAQ disability index had a strong correlation with the GMFM (0.77); for the divergent validity there was no correlation between GMFM and the pain and overall evaluation scales; for the criterion validity GMFM as well as CHAQ detected differences in the scores among the clinical type of CP (p < 0.01); for the construct validity, the patients' disability index score (mean: 2.16; SD: 0.72) was higher than the healthy group ( mean: 0.12; SD: 0.23)(p < 0.01). Conclusion: CHAQ reliability and validity were adequate to this population. However, further studies are necessary to verify the influence of the ceiling effect on the responsiveness of the instrument.

Assessing flow in physical activity: The Flow State Scale-2 and Dispositional Flow Scale-2

The Flow State Scale-2 (FSS-2) and Dispositional Flow Scale-2 (DFS-2) are presented as two self-report instruments designed to assess flow experiences in physical activity. Item modifications were made to the original versions of these scales in order to improve the measurement of some of the flow dimensions. Confirmatory factor analyses of an item identification and a cross-validation sample demonstrated a good fit of the new scales. There was support for both a 9-first-order factor model and a higher order model with a global flow factor. The item identification sample yielded mean item loadings on the first-order factor of .78 for the FSS-2 and .77 for the DFS-2. Reliability estimates ranged from .80 to .90 for the FSS-2, and .81 to .90 for the DFS-2. In the cross-validation sample, mean item loadings on the first-order factor were .80 for the FSS-2, and .73 for the DFS-2. Reliability estimates ranged between .80 to .92 for the FSS-2 and .78 to .86 for the DFS-2. The scales are presented as ways of assessing flow experienced within a particular event (FSS-2) or the frequency of flow experiences in chosen physical activity in general (DFS-2).

Assessing perceived need for mental health care in a community survey: development of the Perceived Need for Care Questionnaire (PNCQ)

Background: The Perceived Need for Care Questionnaire (PNCQ) was designed for the Australian National Survey of Mental Health and Wellbeing. The PNCQ complemented collection of data on diagnosis and disability with the survey participants' perceptions of their needs for mental health care and the meeting of those needs. The four-stage design of the PNCQ mimics a conversational exploration of the topic of perceived needs. Five categories of perceived need are each assigned to one of four levels of perceived need (no need, unmet need, partially met need and met need). For unmet need and partially met need, information on barriers to care is collected, Methods: Inter-rater reliabilities of perceived needs assessed by the PNCQ were examined in a study of 145 anxiety clinic attenders. Construct validity of these items was tested, using a multi-trait multi-method approach and hypotheses regarding extreme groups, in a study with a sample of 51 general practice and community psychiatric service patients. Results: The instrument is brief to administer and has proved feasible for use in various settings. Inter-rater reliabilities for major categories, measured by the kappa statistic, exceeded 0.60 in most cases; for the summary category of all perceived needs, inter-rater reliability was 0.62. The multi-trait multi-method approach lent support to the construct validity of the instrument, as did findings in extreme groups. Conclusions: The PNCQ shows acceptable feasibility, reliability and validity, adding to the range of assessment tools available for epidemiological and health services research.