Reliability, construct and criterion validity of the KIDSCREEN-10 score: a short measure for children and adolescents' well-being and health-related quality of life

Background To assess the criterion and construct validity of the KIDSCREEN-10 well-being and health-related quality of life (HRQoL) score, a short version of the KIDSCREEN-52 and KIDSCREEN-27 instruments. Methods The child self-report and parent report versions of the KIDSCREEN-10 were tested in a sample of 22,830 European children and adolescents aged 8–18 and their parents (n = 16,237). Correlation with the KIDSCREEN-52 and associations with other generic HRQoL measures, physical and mental health, and socioeconomic status were examined. Score differences by age, gender, and country were investigated. Results Correlations between the 10-item KIDSCREEN score and KIDSCREEN-52 scales ranged from r = 0.24 to 0.72 (r = 0.27–0.72) for the self-report version (proxy-report version). Coefficients below r = 0.5 were observed for the KIDSCREEN-52 dimensions Financial Resources and Being Bullied only. Cronbach alpha was 0.82 (0.78), test–retest reliability was ICC = 0.70 (0.67) for the self- (proxy-)report version. Correlations between other children self-completed HRQoL questionnaires and KIDSCREEN-10 ranged from r = 0.43 to r = 0.63 for the KIDSCREEN children self-report and r = 0.22–0.40 for the KIDSCREEN parent proxy report. Known group differences in HRQoL between physically/mentally healthy and ill children were observed in the KIDSCREEN-10 self and proxy scores. Associations with self-reported psychosomatic complaints were r = −0.52 (−0.36) for the KIDSCREEN-10 self-report (proxy-report). Statistically significant differences in KIDSCREEN-10 self and proxy scores were found by socioeconomic status, age, and gender. Conclusions Our results indicate that the KIDSCREEN-10 provides a valid measure of a general HRQoL factor in children and adolescents, but the instrument does not represent well most of the single dimensions of the original KIDSCREEN-52. Test–retest reliability was slightly below a priori defined thresholds.

Development and Criterion Validity of Differentiated and Elevated Vocational Interests in Adolescence

Interest differentiation and elevation are supposed to provide important information about a person’s state of interest development, yet little is known about their development and criterion validity. The present study explored these constructs among a group of Swiss adolescents. Study 1 applied a cross-sectional design with 210 students in 11th grade. Study 2 applied a 1-year longitudinal design with 289 students in 7th to 8th grade. gender, personality traits, and career exploration were significant predictors of state and development of differentiation and elevation. Increase in differentiation predicted increase in career decidedness above traits. elevation could not predict increase in exploration behavior over traits. The results provide support for differentiation and elevation as important aspects of adolescents’ vocational interests.

Comprehensive assessment of gesture production: a new test of upper limb apraxia (TULIA)

BACKGROUND: Only few standardized apraxia scales are available and they do not cover all domains and semantic features of gesture production. Therefore, the objective of the present study was to evaluate the reliability and validity of a newly developed test of upper limb apraxia (TULIA), which is comprehensive and still short to administer. METHODS: The TULIA consists of 48 items including imitation and pantomime domain of non-symbolic (meaningless), intransitive (communicative) and transitive (tool related) gestures corresponding to 6 subtests. A 6-point scoring method (0-5) was used (score range 0-240). Performance was assessed by blinded raters based on videos in 133 stroke patients, 84 with left hemisphere damage (LHD) and 49 with right hemisphere damage (RHD), as well as 50 healthy subjects (HS). RESULTS: The clinimetric findings demonstrated mostly good to excellent internal consistency, inter- and intra-rater (test-retest) reliability, both at the level of the six subtests and at individual item level. Criterion validity was evaluated by confirming hypotheses based on the literature. Construct validity was demonstrated by a high correlation (r = 0.82) with the De Renzi-test. CONCLUSION: These results show that the TULIA is both a reliable and valid test to systematically assess gesture production. The test can be easily applied and is therefore useful for both research purposes and clinical practice.

Predictive ability of a modified Örebro Musculoskeletal Pain Questionnaire in an acute/subacute low back pain working population

The original 'Örebro Musculoskeletal Pain Questionnaire' (original-ÖMPQ) has been shown to have limitations in practicality, factor structure, face and content validity. This study addressed these concerns by modifying its content producing the 'Örebro Musculoskeletal Screening Questionnaire' (ÖMSQ). The ÖMSQ and original-ÖMPQ were tested concurrently in acute/subacute low back pain working populations (pilot n = 44, main n = 106). The ÖMSQ showed improved face and content validity, which broadened potential application, and improved practicality with two-thirds less missing responses. High reliability (0.975, p < 0.05, ICC: 2.1), criterion validity (Spearman's r = 0.97) and internal consistency (α = 0.84) were achieved, as were predictive ability cut-off scores from ROC curves (112-120 ÖMSQ-points), statistically different ÖMSQ scores (p < 0.001) for each outcome trait, and a strong correlation with recovery time (Spearman's, r = 0.71). The six-component factor structure reflected the constructs originally proposed. The ÖMSQ can be substituted for the original-ÖMPQ in this population. Further research will assess its applicability in broader populations.

The Lower Limb Functional Index: development and clinimetric properties

Background Existing lower-limb, region-specific, patient-reported outcome measures have clinimetric limitations, including limitations in psychometric characteristics (eg, lack of internal consistency, lack of responsiveness, measurement error) and the lack of reported practical and general characteristics. A new patient-reported outcome measure, the Lower Limb Functional Index (LLFI), was developed to address these limitations. Objective The purpose of this study was to overcome recognized deficiencies in existing lower-limb, region-specific, patient-reported outcome measures through: (1) development of a new lower-extremity outcome scale (ie, the LLFI) and (2) evaluation of the clinimetric properties of the LLFI using the Lower Extremity Functional Scale (LEFS) as a criterion measure. Design This was a prospective observational study. Methods The LLFI was developed in a 3-stage process of: (1) item generation, (2) item reduction with an expert panel, and (3) pilot field testing (n=18) for reliability, responsiveness, and sample size requirements for a larger study. The main study used a convenience sample (n=127) from 10 physical therapy clinics. Participants completed the LLFI and LEFS every 2 weeks for 6 weeks and then every 4 weeks until discharge. Data were used to assess the psychometric, practical, and general characteristics of the LLFI and the LEFS. The characteristics also were evaluated for overall performance using the Measurement of Outcome Measures and Bot clinimetric assessment scales. Results The LLFI and LEFS demonstrated a single-factor structure, comparable reliability (intraclass correlation coefficient [2,1]=.97), scale width, and high criterion validity (Pearson r=.88, with 95% confidence interval [CI]). Clinimetric performance was higher for the LLFI compared with the LEFS on the Measurement of Outcome Measures scale (96% and 95%, respectively) and the Bot scale (100% and 83%, respectively). The LLFI, compared with the LEFS, had improved responsiveness (standardized response mean=1.75 and 1.64, respectively), minimal detectable change with 90% CI (6.6% and 8.1%, respectively), and internal consistency (α=.91 and .95, respectively), as well as readability with reduced user error and completion and scoring times. Limitations Limitations of the study were that only participants recruited from outpatient physical therapy clinics were included and that no specific conditions or diagnostic subgroups were investigated. Conclusion The LLFI demonstrated sound clinimetric properties. There was lower response error, efficient completion and scoring, and improved responsiveness and overall performance compared with the LEFS. The LLFI is suitable for assessment of lower-limb function.

The KIDSCREEN-27 quality of life measure for children and adolescents: psychometric results from a cross-cultural survey in 13 European countries

OBJECTIVE: To assess the construct and criterion validity of the KIDSCREEN-27 health-related quality of life (HRQoL) questionnaire, a shorter version of the KIDSCREEN-52. METHODS: The five-dimensional KIDSCREEN-27 was tested in a sample of 22,827. For criterion validity the correlation with and the percentage explained variance of the scores of the KIDSCREEN-52 instrument were examined. Construct validity was assessed by testing a priori expected associations with other generic HRQoL measures (YQOL-S, PedsQL, CHIP), indicators of physical and mental health, and socioeconomic status. Age and gender differences were investigated. RESULTS: Correlation with corresponding scales of the KIDSCREEN-52 ranged from r = 0.63 to r = 0.96, and r2 ranged from 0.39 to 0.92. Correlations between other HRQoL questionnaires and KIDSCREEN-27 dimensions were moderate to high for those assessing similar constructs (r = 0.36 to 0.63). Statistically significant and sizeable differences between physically and mentally healthy and ill children were found in all KIDSCREEN-27 dimensions together with strong associations with psychosomatic complaints (r = -0.52). Most of the KIDSCREEN-27 dimensions showed a gradient according to socio-economic status, age and gender. CONCLUSIONS: The KIDSCREEN-27 seems to be a valid measure of HRQoL in children and adolescents. Further research is needed to assess longitudinal validity and sensitivity to change.

A semi-structured interview to assess visual hallucinations in older people

OBJECTIVE: Visual hallucinations are under-reported by patients and are often undiscovered by health professionals. There is no gold standard available to assess hallucinations. Our objective was to develop a reliable, valid, semi-structured interview for identifying and assessing visual hallucinations in older people with eye disease and cognitive impairment. METHODS: We piloted the North-East Visual Hallucinations Interview (NEVHI) in 80 older people with visual and/or cognitive impairment (patient group) and 34 older people without known risks of hallucinations (control group). The informants of 11 patients were interviewed separately. We established face validity, content validity, criterion validity, inter-rater agreement and the internal consistency of the NEVHI, and assessed the factor structure for questions evaluating emotions, cognitions, and behaviours associated with hallucinations. RESULTS: Recurrent visual hallucinations were common in the patient group (68.8%) and absent in controls (0%). The criterion, face and content validities were good and the internal consistency of screening questions for hallucinations was high (Cronbach alpha: 0.71). The inter-rater agreements for simple and complex hallucinations were good (Kappa 0.72 and 0.83, respectively). Four factors associated with experiencing hallucinations (perceived control, pleasantness, distress and awareness) were identified and explained a total variance of 73%. Informants gave more 'don't know answers' than patients throughout the interview (p = 0.008), especially to questions evaluating cognitions and emotions associated with hallucinations (p = 0.02). CONCLUSIONS: NEVHI is a comprehensive assessment tool, helpful to identify the presence of visual hallucinations and to quantify cognitions, emotions and behaviours associated with hallucinations.

Psychoendocrine validation of a short measure for assessment of perceived stress management skills in different non-clinical populations

BACKGROUND: We investigated the psychometric properties of a short questionnaire for combined assessment of different perceived stress management skills in the general population and tested whether scores relate to physiological stress reactivity. METHODS: For psychometric evaluation, we determined the factor structure of the questionnaire and investigated its measurement invariance in the participant groups and over time in three different independent samples representing the general population (total N=332). Reliability was tested by estimating test-retest reliability, internal consistency, and item reliabilities. We examined convergent and criterion validity using selected criterion variables. For endocrine validation, 35 healthy non-smoking and medication-free men in a laboratory study and 35 male and female employees in a workplace study underwent an acute standardized psychosocial stress task. We assessed stress management skills and measured salivary cortisol before and several times up to 60 min (workplace study) and 120 min (laboratory study) after stress. Potential confounders were controlled. RESULTS: The factor structure of the questionnaire consists of five scales reflecting acceptably distinct stress management skills such as cognitive strategies, use of social support, relaxation strategies, anger regulation, and perception of bodily tension. This factor structure was stable across participant groups and over time. Internal consistencies, item reliabilities, and test-retest reliabilities met established statistical requirements. Convergent and criterion validity were also established. In both endocrine validation studies, higher stress management skills were independently associated with lower cortisol stress reactivity (p's<.029). CONCLUSIONS: Our findings suggest that the questionnaire has good psychometric properties and that it relates to subjective psychological and objective physiological stress indicators. Therefore, the instrument seems a suitable measure for differential assessment of stress management skills in the general population.

Konstruktion und erste Validierung eines Fragebogens zur umfassenden Erfassung von Achtsamkeit: Das Comprehensive Inventory of Mindfulness Experiences

In der vorliegenden Arbeit werden Entwicklung und Validierung eines Fragebogens zur umfassenden Erfassung der Achtsamkeit, des Comprehensive Inventory of Mindfulness Experiences (CHIME), beschrieben. An einer Allgemeinbevölkerungs-Stichprobe (N = 298) und einer Stichprobe von TeilnehmerInnen an MBSR-Kursen (N = 161) wurde die Faktorenstruktur des CHIME ermittelt und seine Reliabilität und Validität geprüft. Faktorenanalytische Verfahren ergaben eine achtfaktorielle Struktur. Die Struktur wurde in einer zusätzlichen konfirmatorischen Stichprobe (N = 202) überprüft. Der Fragebogen sowie seine Unterskalen weisen gute Reliabilitätswerte auf (interne Konsistenz und Retest-Reliabilität). Analysen zur Messinvarianz der einzelnen Items über Gruppen, die sich bezüglich Meditationserfahrung, Alter, Geschlecht und Symptombelastung unterschieden, zeigten keine systematischen Unterschiede im Verständnis der Items. Die Kennwerte zur Konstrukt-, Kriterium-, und inkrementellen Validität sowie zur Veränderungssensitivität waren alle mindestens zufriedenstellend. Mit dem CHIME steht somit ein Fragebogen mit guten psychometrischen Eigenschaften zur Selbsteinschätzung der Achtsamkeit zur Verfügung. Der CHIME basiert auf allen in den aktuellen Instrumenten enthaltenen Aspekten des Achtsamkeitskonstrukts.

Self-Reported Psychotic-Like Experiences Are a Poor Estimate of Clinician-Rated Attenuated and Frank Delusions and Hallucinations

Background: One reason for the decision to delay the introduction of an Attenuated Psychosis Syndrome in the main text of the fifth edition of the American Psychiatric Association's Diagnostic and Statistical Manual of Mental Disorders was the concern that attenuated psychotic symptoms (APS) might in fact be common features in adolescents and young adults from the general population of no psychopathological significance in themselves. This concern was based on reports of high prevalence rates of psychotic-like experiences (PLEs) in the general population and the assumption that PLEs are a good estimate of APS. Although the criterion validity of self-reported PLEs had already been studied with respect to clinician-rated psychotic symptoms and found insufficient, it had been argued that PLEs might in fact be more comparable with mild, subclinical expressions of psychotic symptoms and, therefore, with APS. The present paper is the first to specifically study this assumption. Sampling and Methods: The sample consisted of 123 persons seeking help at a service for the early detection of psychosis, of whom 54 had an at-risk mental state or psychosis, 55 had a nonpsychotic mental disorder and 14 had no full-blown mental disorder. PLEs were assessed with the Peters Delusion Inventory and the revised Launay-Slade Hallucination Scale, and psychotic symptoms and APS were assessed with the Structured Interview for Prodromal Syndromes. Results: At a level of agreement between the presence of any PLE (in 98.4% of patients) and any APS (in 40.7%) just exceeding chance (κ = 0.022), the criterion validity of PLEs for APS was insufficient. Even if additional qualifiers (high agreement or distress, preoccupation and conviction) were considered, PLEs (in 52.8%) still tended to significantly overestimate APS, and agreement was only fair (κ = 0.340). Furthermore, the group effect on PLE prevalence was, at most, moderate (Cramer's V ≤ 0.382). Conclusions: The prevalence of APS cannot be deduced from studies of PLEs. Thus, the high population prevalence rate of PLEs does not allow the conclusion that APS are common features of no pathological significance and would lack clinical validity as an Attenuated Psychosis Syndrome in the Diagnostic and Statistical Manual of Mental Disorders, 5th edition. Rather, the population prevalence rate of APS has to be assumed to be largely unknown at present but is likely lower than indicated by epidemiological studies of PLEs. Therefore, dedicated studies are warranted, in which APS are assessed in a way that equates to their clinical evaluation.

Assessing Calling in Chinese College Students: Development of a Measure and Its Relation to Hope

Research suggests that perceiving a calling towards a particular career is relatively frequent among college students in Western cultures. However, little is known about how this applies to other cultural contexts. This study assessed the perception of career as a calling in the Chinese culture. Study 1 reports the development of the Chinese Calling Scale (CCS), based on a sample of 788 Chinese college students, and identifies three dimensions of a calling: Altruism, Guiding Force, and Meaning and Purpose. Measurement invariance across gender is supported by the CCS. In Study 2, the convergent and criterion validity of the CSS is examined based on a sample of 387 college students. The CCS is strongly related to an existing calling measure and moderately related to life meaning and life satisfaction. Study 3 examines the relation between calling, hope, life meaning, life satisfaction, and career decidedness among 518 college students. The findings reveal that hope significantly mediated the relation of calling with career decidedness, life meaning, and life satisfaction. In summary, this study provides a new scale to assess calling in Chinese culture and is the first to explore how calling relates to dispositional hope.

Construction and first validation of the comprehensive inventory of mindfulness (CHIME)

Introduction: Measuring trait mindfulness and change in mindfulness may be a crucial prerequisite for the evaluation and further development of mindfulness based interventions for the treatment of mental disorders. This endeavour is nontrivial as current measures cover varying aspects and mindfulness and may have problems regarding validity. This presentation describes the development and validation of a questionnaire for the comprehensive assessment of mindfulness: the Comprehensive Inventory of Mindfulness Experiences (CHIME). Method: The factor structure, reliability, and validity of the CHIME were established in a community sample (N = 298) and a sample of MBSR group participants (N = 161). Results: Factor-analytical procedures supported an eight-factor structure. The structure was tested in a further confirmatory sample (N = 202). The questionnaire and its subscales exhibited good reliability (internal consistency and retest-reliability). Analysis of the measurement invariance of the single items over groups differing in age, gender, meditation experience, and symptom load pointed to the absence of systematic differences in the items' semantic understanding. Parameters reflecting construct validity, criterion validity, and incremental validity as well as change sensitivity were all at least satisfactory. Conclusions: The CHIME is a self-report measure with favorable psychometric properties based on all aspects of mindfulness that are included in current mindfulness scales. This scale may be helpful in the evaluation and further development of mindfulness based interventions.

Coaches` subjective talent criteria in top-level soccer

Introduction: In professional soccer, talent selection relies on the subjective judgment of scouts and coaches. To date, little is known about coaches´ “eye for talent” (Christensen, 2009, p. 379) and the nature of the subjective criteria they use to identify those players with the greatest potential to achieve peak performance in adulthood (Williams & Reilly, 2000). Drawing on a constructivist approach (Kelly, 1991), this study explores coaches´ subjective talent criteria. It is assumed that coaches are able to verbalise and specify their talent criteria, and that these are related to their talent selection decisions based on instinct. Methods: Participants and generation of data. Five national youth soccer coaches (Mage = 55.6; SD = 5.03) were investigated at three appointments: (1) talent selection decision based on instinct, (2) semi-structured inductive interview to elicit each coaches´ talent criteria in detail, (3) communicative validation and evaluation of the players by each coach using the repertory grid technique (Fromm, 2004). Data Analysis: Interviews were transcribed and summarized with regard to each specified talent criterion. Each talent criterion was categorized using a bottom-up-approach (meaning categorization, Kvale, 1996). The repertory grid data was analysed using descriptive statistics and correlation analysis. Results and Discussion: For each coach, six to nine talent criteria were elicited and specified. The subjective talent criteria include aspects of personality, cognitive perceptual skills, motor abilities, development, technique, social environment and physical constitution, which shows that the coaches use a multi-dimensional concept of talent. However, more than half of all criteria describe personality characteristics, in particular achievement motivation, volition and self-confidence. In contrast to Morris (2000), this result shows that coaches have a differentiated view of the personality characteristics required to achieve peak performance. As an indication of criterion validity, moderate to high correlations (.57 ≤ r ≤ .81) are found between the evaluations of the players according to the coaches´ talent criteria and their talent selection decision. The study shows that coaches are able to specify their subject talent criteria and that those criteria are strongly related to their instinctive selection decisions. References: Christensen, M. K. (2009). "An Eye for Talent": Talent Identification and the "Practical Sense" of Top-Level Soccer Coaches. Sociology of Sport Journal, 26, 365–382. Fromm, M. (2004). Introduction to the Repertory Grid Interview. Münster: Waxmann. Kelly, G. A. (1991). The Psychology of Personal Constructs: Volume One: Theory and personality. London: Routledge. Kvale, S. (1996). InterViews: An introduction to Qualitative Research Interviewing. Thousand Oaks: Sage. Morris, T. (2000). Psychological characteristics and talent identification in soccer. Journal of Sports Sciences, 18, 715–726. Williams, A. M., & Reilly, T. (2000). Talent identification and development in soccer. Journal of Sports Sciences, 18, 657–667.

Measuring Intensity of End of Life Care: A Systematic Review.

BACKGROUND Many studies have measured the intensity of end of life care. However, no summary of the measures used in the field is currently available. OBJECTIVES To summarise features, characteristics of use and reported validity of measures used for evaluating intensity of end of life care. METHODS This was a systematic review according to PRISMA guidelines. We performed a comprehensive literature search in Ovid Medline, Embase, The Cochrane Library of Systematic Reviews and reference lists published between 1990-2014. Two reviewers independently screened titles, abstracts, full texts and extracted data. Studies were eligible if they used a measure of end of life care intensity, defined as all quantifiable measures describing the type and intensity of medical care administered during the last year of life. RESULTS A total of 58 of 1590 potentially eligible studies met our inclusion criteria and were included. The most commonly reported measures were hospitalizations (n = 44), intensive care unit admissions (n = 39) and chemotherapy use (n = 27). Studies measured intensity of care in different timeframes ranging from 48 hours to 12 months. The majority of studies were conducted in cancer patients (n = 31). Only 4 studies included information on validation of the measures used. None evaluated construct validity, while 3 studies considered criterion and 1 study reported both content and criterion validity. CONCLUSIONS This review provides a synthesis to aid in choosing intensity of end of life care measures based on their previous use but simultaneously highlights the crucial need for more validation studies and consensus in the field.

Validity of the Adult ADHD Self-Report Scale (ASRS) as a screener for adult ADHD in treatment seeking substance use disorder patients

Background: To detect attention deficit hyperactivity disorder (ADHD) in treatment seeking substance use disorders (SUD) patients, a valid screening instrument is needed. Objectives: To test the performance of the Adult ADHD Self-Report Scale V 1.1(ASRS) for adult ADHD in an international sample of treatment seeking SUD patients for DSM-IV-TR; for the proposed DSM-5 criteria; in different subpopulations, at intake and 1–2 weeks after intake; using different scoring algorithms; and different externalizing disorders as external criterion (including adult ADHD, bipolar disorder, antisocial and borderline personality disorder). Methods: In 1138 treatment seeking SUD subjects, ASRS performance was determined using diagnoses based on Conner's Adult ADHD Diagnostic Interview for DSM-IV (CAADID) as gold standard. Results: The prevalence of adult ADHD was 13.0% (95% CI: 11.0–15.0%). The overall positive predictive value (PPV) of the ASRS was 0.26 (95% CI: 0.22–0.30), the negative predictive value (NPV) was 0.97 (95% CI: 0.96–0.98). The sensitivity (0.84, 95% CI: 0.76–0.88) and specificity (0.66, 95% CI: 0.63–0.69) measured at admission were similar to the sensitivity (0.88, 95% CI: 0.83–0.93) and specificity (0.67, 95% CI: 0.64–0.70) measured 2 weeks after admission. Sensitivity was similar, but specificity was significantly better in patients with alcohol compared to (illicit) drugs as the primary substance of abuse (0.76 vs. 0.56). ASRS was not a good screener for externalizing disorders other than ADHD. Conclusions: The ASRS is a sensitive screener for identifying possible ADHD cases with very few missed cases among those screening negative in this population.