Face, content and construct validity of a novel robotic surgery simulator

We evaluated the face, content and construct validity of the novel da Vinci® Skills Simulator™ using the da Vinci Si™ Surgeon Console as the surgeon interface.

Reliability, construct and criterion validity of the KIDSCREEN-10 score: a short measure for children and adolescents' well-being and health-related quality of life

Background To assess the criterion and construct validity of the KIDSCREEN-10 well-being and health-related quality of life (HRQoL) score, a short version of the KIDSCREEN-52 and KIDSCREEN-27 instruments. Methods The child self-report and parent report versions of the KIDSCREEN-10 were tested in a sample of 22,830 European children and adolescents aged 8–18 and their parents (n = 16,237). Correlation with the KIDSCREEN-52 and associations with other generic HRQoL measures, physical and mental health, and socioeconomic status were examined. Score differences by age, gender, and country were investigated. Results Correlations between the 10-item KIDSCREEN score and KIDSCREEN-52 scales ranged from r = 0.24 to 0.72 (r = 0.27–0.72) for the self-report version (proxy-report version). Coefficients below r = 0.5 were observed for the KIDSCREEN-52 dimensions Financial Resources and Being Bullied only. Cronbach alpha was 0.82 (0.78), test–retest reliability was ICC = 0.70 (0.67) for the self- (proxy-)report version. Correlations between other children self-completed HRQoL questionnaires and KIDSCREEN-10 ranged from r = 0.43 to r = 0.63 for the KIDSCREEN children self-report and r = 0.22–0.40 for the KIDSCREEN parent proxy report. Known group differences in HRQoL between physically/mentally healthy and ill children were observed in the KIDSCREEN-10 self and proxy scores. Associations with self-reported psychosomatic complaints were r = −0.52 (−0.36) for the KIDSCREEN-10 self-report (proxy-report). Statistically significant differences in KIDSCREEN-10 self and proxy scores were found by socioeconomic status, age, and gender. Conclusions Our results indicate that the KIDSCREEN-10 provides a valid measure of a general HRQoL factor in children and adolescents, but the instrument does not represent well most of the single dimensions of the original KIDSCREEN-52. Test–retest reliability was slightly below a priori defined thresholds.

Ecological validity of virtual reality daily living activities screening for early dementia: longitudinal study

Background: Dementia is a multifaceted disorder that impairs cognitive functions, such as memory, language, and executive functions necessary to plan, organize, and prioritize tasks required for goal-directed behaviors. In most cases, individuals with dementia experience difficulties interacting with physical and social environments. The purpose of this study was to establish ecological validity and initial construct validity of a fire evacuation Virtual Reality Day-Out Task (VR-DOT) environment based on performance profiles as a screening tool for early dementia. Objective: The objectives were (1) to examine the relationships among the performances of 3 groups of participants in the VR-DOT and traditional neuropsychological tests employed to assess executive functions, and (2) to compare the performance of participants with mild Alzheimer’s-type dementia (AD) to those with amnestic single-domain mild cognitive impairment (MCI) and healthy controls in the VR-DOT and traditional neuropsychological tests used to assess executive functions. We hypothesized that the 2 cognitively impaired groups would have distinct performance profiles and show significantly impaired independent functioning in ADL compared to the healthy controls. Methods: The study population included 3 groups: 72 healthy control elderly participants, 65 amnestic MCI participants, and 68 mild AD participants. A natural user interface framework based on a fire evacuation VR-DOT environment was used for assessing physical and cognitive abilities of seniors over 3 years. VR-DOT focuses on the subtle errors and patterns in performing everyday activities and has the advantage of not depending on a subjective rating of an individual person. We further assessed functional capacity by both neuropsychological tests (including measures of attention, memory, working memory, executive functions, language, and depression). We also evaluated performance in finger tapping, grip strength, stride length, gait speed, and chair stands separately and while performing VR-DOTs in order to correlate performance in these measures with VR-DOTs because performance while navigating a virtual environment is a valid and reliable indicator of cognitive decline in elderly persons. Results: The mild AD group was more impaired than the amnestic MCI group, and both were more impaired than healthy controls. The novel VR-DOT functional index correlated strongly with standard cognitive and functional measurements, such as mini-mental state examination (MMSE; rho=0.26, P=.01) and Bristol Activities of Daily Living (ADL) scale scores (rho=0.32, P=.001). Conclusions: Functional impairment is a defining characteristic of predementia and is partly dependent on the degree of cognitive impairment. The novel virtual reality measures of functional ability seem more sensitive to functional impairment than qualitative measures in predementia, thus accurately differentiating from healthy controls. We conclude that VR-DOT is an effective tool for discriminating predementia and mild AD from controls by detecting differences in terms of errors, omissions, and perseverations while measuring ADL functional ability.

Comprehensive assessment of gesture production: a new test of upper limb apraxia (TULIA)

BACKGROUND: Only few standardized apraxia scales are available and they do not cover all domains and semantic features of gesture production. Therefore, the objective of the present study was to evaluate the reliability and validity of a newly developed test of upper limb apraxia (TULIA), which is comprehensive and still short to administer. METHODS: The TULIA consists of 48 items including imitation and pantomime domain of non-symbolic (meaningless), intransitive (communicative) and transitive (tool related) gestures corresponding to 6 subtests. A 6-point scoring method (0-5) was used (score range 0-240). Performance was assessed by blinded raters based on videos in 133 stroke patients, 84 with left hemisphere damage (LHD) and 49 with right hemisphere damage (RHD), as well as 50 healthy subjects (HS). RESULTS: The clinimetric findings demonstrated mostly good to excellent internal consistency, inter- and intra-rater (test-retest) reliability, both at the level of the six subtests and at individual item level. Criterion validity was evaluated by confirming hypotheses based on the literature. Construct validity was demonstrated by a high correlation (r = 0.82) with the De Renzi-test. CONCLUSION: These results show that the TULIA is both a reliable and valid test to systematically assess gesture production. The test can be easily applied and is therefore useful for both research purposes and clinical practice.

Back related outcome assessment instruments

A literature review of the most widely used condition specific, self administered assessment questionnaires for low back pain had been undertaken. General and historic aspects, reliability, responsiveness and minimum clinically important difference, external validity, floor and ceiling effects, and available languages were analysed. These criteria, however, are only part of the consideration. Of similar importance are the content, wording of questions and answers in each of the six questionnaires and an analysis of the different score results. The issue of score bias is discussed and suggestions are given in order to increase the construct validity in the practical use of the individual questionnaires.

The KIDSCREEN-27 quality of life measure for children and adolescents: psychometric results from a cross-cultural survey in 13 European countries

OBJECTIVE: To assess the construct and criterion validity of the KIDSCREEN-27 health-related quality of life (HRQoL) questionnaire, a shorter version of the KIDSCREEN-52. METHODS: The five-dimensional KIDSCREEN-27 was tested in a sample of 22,827. For criterion validity the correlation with and the percentage explained variance of the scores of the KIDSCREEN-52 instrument were examined. Construct validity was assessed by testing a priori expected associations with other generic HRQoL measures (YQOL-S, PedsQL, CHIP), indicators of physical and mental health, and socioeconomic status. Age and gender differences were investigated. RESULTS: Correlation with corresponding scales of the KIDSCREEN-52 ranged from r = 0.63 to r = 0.96, and r2 ranged from 0.39 to 0.92. Correlations between other HRQoL questionnaires and KIDSCREEN-27 dimensions were moderate to high for those assessing similar constructs (r = 0.36 to 0.63). Statistically significant and sizeable differences between physically and mentally healthy and ill children were found in all KIDSCREEN-27 dimensions together with strong associations with psychosomatic complaints (r = -0.52). Most of the KIDSCREEN-27 dimensions showed a gradient according to socio-economic status, age and gender. CONCLUSIONS: The KIDSCREEN-27 seems to be a valid measure of HRQoL in children and adolescents. Further research is needed to assess longitudinal validity and sensitivity to change.

Family satisfaction in the intensive care unit: cross-cultural adaptation of a questionnaire

PURPOSE: Family needs and expectations are often unmet in the intensive care unit (ICU), leading to dissatisfaction. This study assesses cross-cultural adaptability of an instrument evaluating family satisfaction in the ICU. MATERIALS AND METHODS: A Canadian instrument on family satisfaction was adapted for German language and central European culture and then validated for feasibility, validity, internal consistency, reliability, and sensitivity. RESULTS: Content validity of a preliminary translated version was assessed by staff, patients, and next of kin. After adaptation, content and comprehensibility were considered good. The adapted translation was then distributed to 160 family members. The return rate was 71.8%, and 94.4% of questions in returned forms were clearly answered. In comparison with a Visual Analogue Scale, construct validity was good for overall satisfaction with care (Spearman rho = 0.60) and overall satisfaction with decision making (rho = 0.65). Cronbach alpha was .95 for satisfaction with care and .87 for decision-making. Only minor differences on repeated measurements were found for interrater and intrarater reliability. There was no floor or ceiling effect. CONCLUSIONS: A cross-cultural adaptation of a questionnaire on family satisfaction in the ICU can be feasible, valid, internally consistent, reliable, and sensitive.

Assessment of quality of life in patients with uncontrolled vs. controlled acromegaly using the Acromegaly Quality of Life Questionnaire (AcroQoL)

Acromegaly is a chronic disease with an important impact on quality of life. An acromegaly disease-generated quality of life questionnaire (AcroQoL) has recently been developed. We aimed to confirm reliability, construct validity and disease-specificity of the AcroQoL questionnaire. Second, we investigated the effect of remission status on health-related quality of life (HRQoL) in patients with acromegaly.

The Getting-Out-of-Bed (GoB) scale: a measure of motivation and life outlook in older adults with cancer

OBJECTIVE: To develop and evaluate the psychometric properties of a measure of motivation and life outlook (Getting-Out-of-Bed [GoB]). DESIGN: Secondary analysis of baseline and 6-month data from a longitudinal follow-up study of older breast cancer survivors. PARTICIPANTS: Women (N = 660) diagnosed with primary breast cancer stage I-IIIA disease, age >or=65 years, and permission to contact from an attending physician in four geographic regions in the United States (city-based Los Angeles, California; statewide in Minnesota, North Carolina, and Rhode Island). MEASUREMENT: Data were collected over 6-months of follow-up from consenting patients' medical records and telephone interviews with patients. Data collected included the 4-item GoB, health-related quality of life (HRQoL), breast cancer, sociodemographic, and health-related characteristics. RESULTS: Factor analysis produced, as hypothesized, one principal component with eigen values of 2.74(baseline) and 2.91(6-months) which explained 68.6%(baseline) and 72.7%(6-months) of total variance. In further psychometric analyses, GoB exhibited good construct validity (divergent: low nonstatistically significant correlations with unrelated constructs; convergent: moderate statistically significant correlations with related constructs; discriminant: distinguished high HRQoL groups with a high level of significance), excellent internal reliability (Cronbach's alpha 0.84(baseline), 0.87(6-months)), and produced stable measurements over 6-months. Women with GoB scores >or=50 at baseline were more likely at 6-months to have good HRQoL, good self-perceived health, and report regular exercise, indicating good predictive ability. CONCLUSION: GoB demonstrated overall good psychometric properties in this sample of older breast cancer survivors, suggestive of a promising tool for assessing motivation and life outlook in older adults. Nevertheless, because it was developed and initially evaluated in a select sample, using measures with similar but not exact content overlap further evaluation is needed before it can be recommended for widespread use.

Validation of a paradigm to measure instrumental aggression (iap) on a sample of male adolescents with adjustment problems

Aggressive behavior can be classified in hostile and instrumental aggressions (anderson & bushman, 2002). this classification is mostly synonymously used with reactive and proactive aggression, whereas the differences between hostile and instrumental aggression lie on three dimensions, the primary goal, amount of anger and planning and calculation(bushman & anderson, 2001). although there are rating instruments and experimental paradigms to measure hostile aggression, there is no instrument to measure instrumental aggression. the following study will present an account to measure instrumental aggression with an experimental laboratory paradigm. the instrument was firstly tested on two samples of normal young adolescents (n1 = 100; amage. = 19.14; n2 = 60; amage. = 21.46). the first study revealed a strong correlation with a laboratory aggression paradigm measuring hostile aggression, but no correlations with self-reported aggression in the buss and perry questionnaire. these results were replicated in a second study, revealing an additional correlation with aggressive but not adaptive assertiveness. secondly the instrument was part of the evaluation of the reasoning and rehabilitation program r&r2 (ross, hilborn & lidell, 1984) in an institution for male adolescents with adjustment problems in switzerland. the r&r2 is a cognitive behavioral group therapy to reduce antisocial and promote prosocial cognitions and behavior. the treatment group (n= 16; rangeage = 15-17) is compared to a no treatment control group (n=24; rangeage = 17-19) preand post- treatment. further aggressive behavior was surveyed and experimentally measured. hostile rumination, aggressive and adaptive assertiveness, emotional and social competence were included in the measurement to estimate construct validity.

Die Kurzversion der NMR Skala (NMR-SF) zur Erfassung der selbsteingeschätzten Fähigkeit zur Regulation negativer Stimmungen: Überblick und Konstruktvalidierung

Die NMR-SF ist die Kurzversion der NMR Skala. Die NMR-SF misst die selbsteingeschätze Fähigkeit zur Regulation negativer Stimmungen. Das von der NMR-SF erfasste Konstrukt spielt in der Ätiologie und Psychotherapie psychischer Störungen eine wichtige Rolle. Die vorliegende Studie untersucht die Konstruktvalidität des Verfahrens in 2 nicht-klinischen und einer depressiven Stichprobe. Die NMR-SF korreliert positiv mit funktionalen Strategien zum Umgang mit negativen Stimmungen und negativ mit dysfunktionalen Strategien. Hohe Werte in der NMR-SF gehen weiterhin mit weniger psychischen Beschwerden einher. Die NMR-SF korreliert leicht positiv mit sozialer Erwünschtheit. Die Ergebnisse der aktuellen Studie unterstützen die Kon­struktvalidität der NMR-SF. Die NMR-SF stellt sich als ein psychometrisch gutes Verfahren zur Messung von NMR-Erwartungen dar. Aufgrund ihrer Ökonomie empfiehlt sich die NMR-SF für die Anwendung in klinischen Stichproben, insbesondere im Rahmen von Verlaufsmessungen.

Konstruktion und erste Validierung eines Fragebogens zur umfassenden Erfassung von Achtsamkeit: Das Comprehensive Inventory of Mindfulness Experiences

In der vorliegenden Arbeit werden Entwicklung und Validierung eines Fragebogens zur umfassenden Erfassung der Achtsamkeit, des Comprehensive Inventory of Mindfulness Experiences (CHIME), beschrieben. An einer Allgemeinbevölkerungs-Stichprobe (N = 298) und einer Stichprobe von TeilnehmerInnen an MBSR-Kursen (N = 161) wurde die Faktorenstruktur des CHIME ermittelt und seine Reliabilität und Validität geprüft. Faktorenanalytische Verfahren ergaben eine achtfaktorielle Struktur. Die Struktur wurde in einer zusätzlichen konfirmatorischen Stichprobe (N = 202) überprüft. Der Fragebogen sowie seine Unterskalen weisen gute Reliabilitätswerte auf (interne Konsistenz und Retest-Reliabilität). Analysen zur Messinvarianz der einzelnen Items über Gruppen, die sich bezüglich Meditationserfahrung, Alter, Geschlecht und Symptombelastung unterschieden, zeigten keine systematischen Unterschiede im Verständnis der Items. Die Kennwerte zur Konstrukt-, Kriterium-, und inkrementellen Validität sowie zur Veränderungssensitivität waren alle mindestens zufriedenstellend. Mit dem CHIME steht somit ein Fragebogen mit guten psychometrischen Eigenschaften zur Selbsteinschätzung der Achtsamkeit zur Verfügung. Der CHIME basiert auf allen in den aktuellen Instrumenten enthaltenen Aspekten des Achtsamkeitskonstrukts.

Coloured Letters and Numbers (CLaN): A reliable factor-analysis based synaesthesia questionnaire

Synaesthesia is a heterogeneous phenomenon, even when considering one particular sub-type. The purpose of this study was to design a reliable and valid questionnaire for grapheme-colour synaesthesia that captures this heterogeneity. By the means of a large sample of 628 synaesthetes and a factor analysis, we created the Coloured Letters and Numbers (CLaN) questionnaire with 16 items loading on 4 different factors (i.e., localisation, automaticity/attention, deliberate use, and longitudinal changes). These factors were externally validated with tests which are widely used in the field of synaesthesia research. The questionnaire showed good test–retest reliability and construct validity (i.e., internally and externally). Our findings are discussed in the light of current theories and new ideas in synaesthesia research. More generally, the questionnaire is a useful tool which can be widely used in synaesthesia research to reveal the influence of individual differences on various performance measures and will be useful in generating new hypotheses.

The Coin Rotation Task: A Valid Test for Manual Dexterity in Multiple Sclerosis

BACKGROUND: Impaired manual dexterity is frequent and disabling in patients with multiple sclerosis (MS). Therefore, convenient, quick and validated tests for manual dexterity in MS patients are needed. OBJECTIVE: The aim of this study was to validate the Coin Rotation task (CRT) to examine manual dexterity in patients with MS. DESIGN: Cross-sectional study. METHODS: 101 outpatients with MS were assessed with the CRT, the Expanded Disability Status Scale (EDSS), the Scale for the assessment and rating of ataxia (SARA), the Modified Ashworth Scale (MAS), and their muscle strength and sensory deficits of the hands were noted. Concurrent validity and diagnostic accuracy of the CRT were determined by comparison with the Nine Hole Peg Test (9HPT). Construct validity was determined by comparison with a valid dexterity questionnaire. Multiple regression analysis was done to explore correlations of the CRT with the EDSS, SARA, MAS, muscle strength and sensory deficits. RESULTS: The CRT correlated significantly with the 9HPT (r=.73, p<.0001) indicating good concurrent validity. The cut-off values for the CRT relative to the 9HPT were 18.75 seconds for the dominant (sensitivity: 81.5%; specificity 80.0%) and 19.25 seconds for the non-dominant hand (sensitivity: 90.3%; specificity: 81.8%) demonstrating good diagnostic accuracy. Furthermore, the CRT correlated significantly with the dexterity questionnaire (r=-.49, p<.0001) indicating moderate construct validity. Multiple regression analyses revealed that the EDSS was the strongest predictor for impaired dexterity. LIMITATIONS: Mostly relapsing-remitting MS patients with an EDSS up to 7 were examined. CONCLUSIONS: This study validates the CRT as a test that can be used easily and quickly to evaluate manual dexterity in patients with MS.

BMZI-HEA. Adaption des Berner Motiv- und Zielinventars im Freizeit- und Gesundheitssport für Menschen im höheren Erwachsenenalter

Die Förderung regelmäßiger Bewegungs- und Sportaktivitäten bei älteren Menschen gewinnt zunehmend an Bedeutung. Für eine effiziente Bewegungs- und Sportförderung werden zielgruppenspezifische Maßnahmen gefordert. Sportbezogene Motive und Ziele von Älteren werden aktuell selten systematisch in die Konzeption von Interventionen miteinbezogen, wenngleich sie für das Wohlbefinden und die Aufrechterhaltung des Sportverhaltens eine zentrale Rolle einnehmen. Das bereits bestehende BMZI ermöglicht die Individualdiagnose von Motiven und Zielen im Freizeit- und Gesundheitssport bei Personen im mittleren Erwachsenenalter. Der vorliegende Beitrag zielt auf eine Adaption des Fragebogens für Menschen im höheren Erwachsenenalter. Das BMZI-HEA deckt mit insgesamt 27 Items folgende Motive und Ziele ab: Figur/Aussehen, Kontakt, Wettkampf/Leistung, Alltagskompetenz/Gesundheit, Positive Bewegungserfahrungen, Kognitive Funktionsfähigkeit, Stimmungsregulation. Der Fragebogen wurde an drei Stichproben explorativ und konfirmatorisch überprüft. Der globale Modell-Fit des BMZI-HEA ist als zufriedenstellend zu beurteilen. Die erwartungskonformen Zusammenhänge mit der Selbstkonkordanz verweisen auf eine gute Konstruktvalidität des Instruments. Das BMZI-HEA empfiehlt sich als ökonomisches Instrument für die Individualdiagnose der psychischen Handlungsvoraussetzungen für das Sporttreiben von Menschen im höheren Erwachsenenalter.