Working Alliance Inventory-Short Revised (WAI-SR): psychometric properties in outpatients and inpatients

The Working Alliance Inventory-Short Revised (WAI-SR) is a recently refined measure of the therapeutic alliance that assesses three key aspects of the therapeutic alliance: (a) agreement on the tasks of therapy, (b) agreement on the goals of therapy and (c) development of an affective bond. The WAI-SR demonstrated good psychometric properties in an initial validation in psychotherapy outpatients in the USA. The generalizability of these findings is limited because in some countries a substantial portion of individual psychotherapy is delivered in inpatient settings. This study investigated and compared the psychometric properties of the WAI-SR in German outpatients (N = 88) and inpatients (N = 243). In both samples reliability (alpha > 0.80) and convergent validity with the Helping Alliance Questionnaire were good (r > 0.64). Confirmatory factor analysis showed acceptable to good model fit for the proposed Bond-Task-Goal model in both samples. Multi-group analysis demonstrated that the same constructs were measured across settings. Alliance ratings of outpatients and inpatients differed regarding the overlap of alliance components and the magnitude of the alliance ratings: The differentiation of the alliance components was poorer in inpatients and they reported lower alliances. Unique aspects of the alliance in inpatient treatment are discussed and a need for further research on the alliance in inpatient settings is pointed out. Overall, the WAI-SR can be recommended for alliance assessment in both settings.

Psychometric properties of the MacNew heart disease health-related quality of life instrument in patients with heart failure

RATIONALE, AIMS AND OBJECTIVES: Heart failure (HF) is a severe chronic disease and impairs health-related quality of life (HRQL). While validated specific HRQL instruments are required for evaluation of treatment and rehabilitation in patients with HF, a single validated measure to document changes in HRQL for patients with different heart disease diagnoses would be invaluable. The purpose of this analysis was the psychometric analysis of the German MacNew Heart Disease Questionnaire (MacNew) in HF patients, which has previously been shown to be reliable and valid in patients with myocardial infarction, angina pectoris and arrhythmia. METHODS: We recruited 89 patients (61.7+/-11.5 years; 84.3% male) in two Austrian and one Swiss cardiology department with documented HF (effect sizes 28.9+/-10.1%). The self-administered MacNew, the Short Form-36 (SF-36) and the Hospital Anxiety and Depression Scale were completed. Internal consistency reliability (Cronbach's alpha), discriminative and evaluative validity were assessed. RESULTS: Cronbach's alpha exceeded 0.80. Each MacNew scale differentiated between patients with and without anxiety (3.9+/-1.0 vs. 5.3+/-0.8, all P<0.001), with and without depression (4.2+/-1.2 vs. 5.2+/-0.9 all P<0.03) and by the SF-36 health transition item (deteriorate=4.39, no change=4.95, improve=5.45, all P<0.02). Evaluative validity was demonstrated with effect sizes >0.70 for a subsample attending a 12-week outpatient rehabilitation programme. CONCLUSIONS: The German language version of the MacNew demonstrates consistently acceptable psychometric properties of reliability, validity and responsiveness in patients with documented HF. Together with previous documentation of reliability, validity and responsive, these findings strengthen the argument for the MacNew as a potential 'core' HRQL measure, at least in the German language.

The self-administered 24-item geriatric pain measure (GPM-24-SA): psychometric properties in three European populations of community-dwelling older adults

OBJECTIVE: To explore the feasibility and psychometric properties of a self-administered version of the 24-item Geriatric Pain Measure (GPM-24-SA). DESIGN: Secondary analysis of baseline data from the Prevention in Older People-Assessment in Generalists' practices trial, an international multi-center study of a health-risk appraisal system. PARTICIPANTS: One thousand seventy-two community dwelling nondisabled older adults self-reporting pain from London, UK; Hamburg, Germany; and Solothurn, Switzerland. OUTCOME MEASURES: GPM-24-SA as part of a multidimensional Health Risk Appraisal Questionnaire including self-reported demographic and health-related information. RESULTS: Among the 1,072 subjects, 655 had complete GPM-24-SA data, 404 had 30% missing GPM-24-SA data. In psychometric analyses across the three European populations with complete GPM-24-SA data, the measure exhibited stable internal consistency, good convergent, divergent and discriminant validity, and produced stable pain measurements. However, factor analysis indicated differences in the GPM-24-SA across sites with discrepancies mainly related to items of a single subscale that failed to load appropriately. Analyses including imputation for subjects with psychometric properties comparable to complete data analyses suggesting that imputation in cases with psychometric evaluation of the GPM-24-SA is needed before it could be recommended for widespread use.

Psychometric properties of the Swiss version of the Nursing Home Survey on Patient Safety Culture

The Nursing Home Survey on Patient Safety Culture (NHSPSC) was specifically developed for nursing homes to assess a facility’s safety climate and it consists of 12 dimensions. After its pilot testing, however, no fur- ther psychometric analyses were performed on the instrument. For this study of safety climate in Swiss nursing home units, the NHSPSC was linguistically adapted to the Swiss context and to address the unit as well as facility level, with the aim of testing aspects of the validity and reliability of the Swiss version before its use in Swiss nursing home units. Psychometric analyses were performed on data from 367 nurs- ing personnel from nine nursing homes in the German-speaking part of Switzerland (response rate = 66%), and content validity (CVI) examined. The statistical influence of unit membership on respondents’ answers, and on their agreement concerning their units’ safety climate, was tested using intraclass corre- lation coefficients (ICCs) and the rWG(J) interrater agreement index. A multilevel exploratory factor analysis (MEFA) with oblimin rotation was applied to examine the questionnaire’s dimensionality. Cronbach’s alpha and Raykov’s rho were calculated to assess factor reliability. The relationship of safety climate dimensions with clinical outcomes was explored. Expert feedback confirmed the relevance of the instru- ment’s items (CVI = 0.93). Personnel showed strong agreement in their perceptions in three dimensions of the questionnaire. ICCs supported a multilevel analysis. MEFA produced nine factors at the within-level (in comparison to 12 in the original version) and two factors at the between-level with satisfactory fit statis- tics. Raykov’s Rho for the single level factors ranged between 0.67 and 0.86. Some safety climate dimen- sions show moderate, but non-significant correlations with the use of bedrails, physical restraint use, and fall-related injuries. The Swiss version of the NHSPSC needs further refinement and testing before its use can be recommended in Swiss nursing homes: its dimensionality needs further clarification, particularly to distinguish items addressing the unit-level safety climate from those at the facility level.

Psychometric properties of the Trauma and Distress Scale, TADS, in an adult community sample in Finland

BACKGROUND: There is increasing evidence that a history of childhood abuse and neglect is not uncommon among individuals who experience mental disorder and that childhood trauma experiences are associated with adult psychopathology. Although several interview and self-report instruments for retrospective trauma assessment have been developed, many focus on sexual abuse (SexAb) rather than on multiple types of trauma or adversity. METHODS: Within the European Prediction of Psychosis Study, the Trauma and Distress Scale (TADS) was developed as a new self-report assessment of multiple types of childhood trauma and distressing experiences. The TADS includes 43 items and, following previous measures including the Childhood Trauma Questionnaire, focuses on five core domains: emotional neglect (EmoNeg), emotional abuse (EmoAb), physical neglect (PhyNeg), physical abuse (PhyAb), and SexAb.This study explores the psychometric properties of the TADS (internal consistency and concurrent validity) in 692 participants drawn from the general population who completed a mailed questionnaire, including the TADS, a depression self-report and questions on help-seeking for mental health problems. Inter-method reliability was examined in a random sample of 100 responders who were reassessed in telephone interviews. RESULTS: After minor revisions of PhyNeg and PhyAb, internal consistencies were good for TADS totals and the domain raw score sums. Intra-class coefficients for TADS total score and the five revised core domains were all good to excellent when compared to the interviewed TADS as a gold standard. In the concurrent validity analyses, the total TADS and its all core domains were significantly associated with depression and help-seeking for mental problems as proxy measures for traumatisation. In addition, robust cutoffs for the total TADS and its domains were calculated. CONCLUSIONS: Our results suggest the TADS as a valid, reliable, and clinically useful instrument for assessing retrospectively reported childhood traumatisation.

The eight-item modified Medical Outcomes Study Social Support Survey: psychometric evaluation showed excellent performance

Evaluation and validation of the psychometric properties of the eight-item modified Medical Outcomes Study Social Support Survey (mMOS-SS).

Self-Reported Capabilities Among Young Male Adults in Switzerland: Translation and Psychometric Evaluation of a German, French and Italian Version of a Closed Survey Instrument

There is a shortage of empirical applications of the capability approach that employ closed survey instruments to assess self-reported capabilities. However, for those few instruments that have been designed and administered through surveys until now, no psychometric properties (reliability, validity, and factor structure) were reported. The purpose of this study is the assessment of the psychometric properties of three new language versions (German, French, and Italian) of an established (English) set of eight self-reported capability items. The set of items is taken from a previously published British study by Anand and van Hees (J Soc Econ 35(2):268–284, 2006). Our sample consists of 17,152 young male adults aged 18–25 years from the three major language regions in Switzerland. The results indicate good reliability of the three language versions. The results from the exploratory factor analyses suggest a one-dimensional factor structure for seven domain specific items. Furthermore, the results from multiple regression analyses suggest that a global summary item on overall capabilities represents a measurement alternative to the set of seven domain specific capability items. Finally, the results confirm the applicability of the closed capability instrument in a large scale survey questionnaire and represent the first attempt to measure self-reported capabilities in Switzerland.

Unresolved Problems with the "I", the "A" and the "T": Logical and Psychometric Critique of the Implicit Association Test (IAT)

The Implicit Association Test (IAT) had already gained the status of a prominent assessment procedure before its psychometric properties and underlying task structure were understood. The present critique addresses five major problems that arise when the IAT is used for diagnostic inferences: (1) the asymmetry of causal and diagnostic inferences; (2) the viability of the underlying association model; (3) the lack of a testable model underlying IAT-based inferences; (4) the difficulties of interpreting difference scores; and (5) the susceptibility of the IAT to deliberate faking and strategic processing. Based on a theoretical reflection of these issues, and a comprehensive survey of published IAT studies, it is concluded that a number of uncontrolled factors can produce (or reduce) significant IAT scores independently of the personality attribute that is supposed to be captured by the IAT procedure.

The dementia cognitive fluctuation scale, a new psychometric test for clinicians to identify cognitive fluctuations in people with dementia.

OBJECTIVES Cognitive fluctuation (CF) is a common feature of dementia and a core diagnostic symptom for dementia with Lewy bodies (DLB). CF remains difficult to accurately and reliably detect clinically. This study aimed to develop a psychometric test that could be used by clinicians to facilitate the identification of CF and improve the recognition and diagnosis of DLB and Parkinson disease, and to improve differential diagnosis of other dementias. METHODS We compiled a 17-item psychometric test for identifying CF and applied this measure in a cross-sectional design. Participants were recruited from the North East of England, and assessments were made in individuals' homes. We recruited people with four subtypes of dementia and a healthy comparison group, and all subjects were administered this pilot scale together with other standard ratings. The psychometric properties of the scale were examined with exploratory factor analysis. We also examined the ability of individual items to identify CF to discriminate between dementia subtypes. The sensitivity and specificity of discriminating items were explored along with validity and reliability analyses. RESULTS Participants comprised 32 comparison subjects, 30 people with Alzheimer disease, 30 with vascular dementia, 29 with DLB, and 32 with dementia associated with Parkinson disease. Four items significantly discriminated between dementia groups and showed good levels of sensitivity (range: 78.6%-80.3%) and specificity (range: 73.9%-79.3%). The scale had very good levels of test-retest (Cronbach's alpha: 0.82) and interrater (0.81) reliabilities. The four items loaded onto three different factors. These items were: 1) marked differences in functioning during the daytime; 2) daytime somnolence; 3) daytime drowsiness; and 4) altered levels of consciousness during the day. CONCLUSIONS We identified four items that provide valid, sensitive, and specific questions for reliably identifying CF and distinguishing the Lewy body dementias from other major causes of dementia (Alzheimer disease and vascular dementia).

Family satisfaction with critical care: measurements and messages

PURPOSE OF REVIEW: Family satisfaction in the ICU reflects the extent to which perceived needs and expectations of family members of critically ill patients are met by healthcare professionals. Here, we present recently developed tools to assess family satisfaction, with a special focus on their psychometric properties. Assessing family satisfaction, however, is not of much use if it is not followed by interpretation of the results and, if needed, consecutive measures to improve care of the patients and their families, or improvement in communication and decision-making. Accordingly, this review will outline recent findings in this field. Finally, possible areas of future research are addressed. RECENT FINDINGS: To assess family satisfaction in the ICU, several domains deserve attention. They include, among others, care of the patient, counseling and emotional support of family members, information and decision-making. Overall, communication between physicians or nurses and members of the family remains a key topic, and there are many opportunities to improve. They include not only communication style, timing and appropriate wording but also, for example, assessments to see if information was adequately received and also understood. Whether unfulfilled needs of individual members of the family or of the family as a social system result in negative long-term sequels remains an open question. SUMMARY: Assessing and analyzing family satisfaction in the ICU ultimately will support healthcare professionals in their continuing effort to improve care of critically ill patients and their families.

Measurement issues in trials of pediatric acute diarrheal diseases: a systematic review

BACKGROUND: Worldwide, diarrheal diseases rank second among conditions that afflict children. Despite the disease burden, there is limited consensus on how to define and measure pediatric acute diarrhea in trials. OBJECTIVES: In RCTs of children involving acute diarrhea as the primary outcome, we documented (1) how acute diarrhea and its resolution were defined, (2) all primary outcomes, (3) the psychometric properties of instruments used to measure acute diarrhea and (4) the methodologic quality of included trials, as reported. METHODS: We searched CENTRAL, Embase, Global Health, and Medline from inception to February 2009. English-language RCTs of children younger than 19 years that measured acute diarrhea as a primary outcome were chosen. RESULTS: We identified 138 RCTs reporting on 1 or more primary outcomes related to pediatric acute diarrhea/diseases. Included trials used 64 unique definitions of diarrhea, 69 unique definitions of diarrhea resolution, and 46 unique primary outcomes. The majority of included trials evaluated short-term clinical disease activity (incidence and duration of diarrhea), laboratory outcomes, or a composite of these end points. Thirty-two trials used instruments (eg, single and multidomain scoring systems) to support assessment of disease activity. Of these, 3 trials stated that their instrument was valid; however, none of the trials (or their citations) reported evidence of this validity. The overall methodologic quality of included trials was good. CONCLUSIONS: Even in what would be considered methodologically sound clinical trials, definitions of diarrhea, primary outcomes, and instruments employed in RCTs of pediatric acute diarrhea are heterogeneous, lack evidence of validity, and focus on indices that may not be important to participants.

Factor Structure of the Neck Disability Index

BACKGROUND CONTEXT: The Neck Disability Index frequently is used to measure outcomes of the neck. The statistical rigor of the Neck Disability Index has been assessed with conflicting outcomes. To date, Confirmatory Factor Analysis of the Neck Disability Index has not been reported for a suitably large population study. Because the Neck Disability Index is not a condition-specific measure of neck function, initial Confirmatory Factor Analysis should consider problematic neck patients as a homogenous group. PURPOSE: We sought to analyze the factor structure of the Neck Disability Index through Confirmatory Factor Analysis in a symptomatic, homogeneous, neck population, with respect to pooled populations and gender subgroups. STUDY DESIGN: This was a secondary analysis of pooled data. PATIENT SAMPLE: A total of 1,278 symptomatic neck patients (67.5% female, median age 41 years), 803 nonspecific and 475 with whiplash-associated disorder. OUTCOME MEASURES: The Neck Disability Index was used to measure outcomes. METHODS: We analyzed pooled baseline data from six independent studies of patients with neck problems who completed Neck Disability Index questionnaires at baseline. The Confirmatory Factor Analysis was considered in three scenarios: the full sample and separate sexes. Models were compared empirically for best fit. RESULTS: Two-factor models have good psychometric properties across both the pooled and sex subgroups. However, according to these analyses, the one-factor solution is preferable from both a statistical perspective and parsimony. The two-factor model was close to significant for the male subgroup (p<.07) where questions separated into constructs of mental function (pain, reading headaches and concentration) and physical function (personal care, lifting, work, driving, sleep, and recreation). CONCLUSIONS: The Neck Disability Index demonstrated a one-factor structure when analyzed by Confirmatory Factor Analysis in a pooled, homogenous sample of neck problem patients. However, a two-factor model did approach significance for male subjects where questions separated into constructs of mental and physical function. Further investigations in different conditions, subgroup and sex-specific populations are warranted.

German validation of the Conners Adult ADHD Rating Scales (CAARS) II: reliability, validity, diagnostic sensitivity and specificity

The German version of the Conners Adult ADHD Rating Scales (CAARS) has proven to show very high model fit in confirmative factor analyses with the established factors inattention/memory problems, hyperactivity/restlessness, impulsivity/emotional lability, and problems with self-concept in both large healthy control and ADHD patient samples. This study now presents data on the psychometric properties of the German CAARS-self-report (CAARS-S) and observer-report (CAARS-O) questionnaires.

Validity and reliability of the German version of the short understanding of substance abuse scale

This paper presents the German version of the Short Understanding of Substance Abuse Scale (SUSS) [Humphreys et al.: Psychol Addict Behav 1996;10:38-44], the Verstandnis von Storungen durch Substanzkonsum (VSS), and evaluates its psychometric properties. The VSS assesses clinicians' beliefs about the nature and treatment of substance use disorders, particularly their endorsement of psychosocial and disease orientation. The VSS was administered to 160 treatment staff members at 12 substance use disorder treatment programs in the German-speaking part of Switzerland. Because the confirmatory factor analysis of the VSS did not completely replicate the factorial structure of the SUSS, an exploratory factor analysis was undertaken. This analysis identified two factors: the Psychosocial model factor and a slightly different Disease model factor. The VSS Disease and Psychosocial subscales showed convergent and discriminant validity, as well as sufficient reliability.