Development and psychometric properties of the DCDDaily: a new test for clinical assessment of capacity in activities of daily living in children with developmental coordination disorder

Objective To develop the DCDDaily, an instrument for objective and standardized clinical assessment of capacity in activities of daily living (ADL) in children with developmental coordination disorder (DCD), and to investigate its usability, reliability, and validity. Subjects Five to eight-year-old children with and without DCD. Main measures The DCDDaily was developed based on thorough review of the literature and extensive expert involvement. To investigate the usability (assessment time and feasibility), reliability (internal consistency and repeatability), and validity (concurrent and discriminant validity) of the DCDDaily, children were assessed with the DCDDaily and the Movement Assessment Battery for Children-2 Test, and their parents filled in the Movement Assessment Battery for Children-2 Checklist and Developmental Coordination Disorder Questionnaire. Results 459 children were assessed (DCD group, n = 55; normative reference group, n = 404). Assessment was possible within 30 minutes and in any clinical setting. For internal consistency, Cronbach’s α = 0.83. Intraclass correlation = 0.87 for test–retest reliability and 0.89 for inter-rater reliability. Concurrent correlations with Movement Assessment Battery for Children-2 Test and questionnaires were ρ = −0.494, 0.239, and −0.284, p < 0.001. Discriminant validity measures showed significantly worse performance in the DCD group than in the control group (mean (SD) score 33 (5.6) versus 26 (4.3), p < 0.001). The area under curve characteristic = 0.872, sensitivity and specificity were 80%. Conclusions The DCDDaily is a valid and reliable instrument for clinical assessment of capacity in ADL, that is feasible for use in clinical practice.

The psychometric properties of the Kessler Psychological Distress Scale (K6) in a general population sample of adolescents

The 6-item Kessler Psychological Distress Scale (K6; Kessler et al., 2002) is a screener for psychological distress that has robust psychometric properties among adults. Given that a significant proportion of adolescents experience mental illness, there is a need for measures that accurately and reliably screen for mental disorders in this age group. This study examined the psychometric properties of the K6 in a large general population sample of adolescents (N = 4,434; mean age = 13.5 years; 44.6% male). Factor analyses were conducted to examine the dimensionality of the K6 in adolescents and to investigate sex-based measurement invariance. This study also evaluated the K6 as a predictor of scores on the Strengths and Difficulties Questionnaire (SDQ; Goodman, 1997). The K6 demonstrated high levels of internal consistency, with the 6 items loading primarily on 1 factor. Consistent with previous research, females reported higher mean levels of psychological distress when compared with males. The identification of sex-based measurement noninvariance in the item thresholds indicated that these mean differences most likely represented reporting bias in the K6 items rather than true differences in the underlying psychological distress construct. The K6 was a fair to good predictor of abnormal scores on the SDQ, but predictive utility was relatively low among males. Future research needs to focus on refining and augmenting the K6 scale to maximize its utility in adolescents. (PsycINFO Database Record (c) 2015 APA, all rights reserved)

Development and psychometric evaluation of the spirituality instrument (SpI-27) in a sample of people with chronic illness

Background: Spirituality is fundamental to all human beings, existing within a person, and developing until death. This research sought to operationalise spirituality in a sample of individuals with chronic illness. A review of the conceptual literature identified three dimensions of spirituality: connectedness, transcendence, and meaning in life. A review of the empirical literature identified one instrument that measures the three dimensions together. Yet, recent appraisals of this instrument highlighted issues with item formulation and limited evidence of reliability and validity. Aim: The aim of this research was to develop a theoretically-grounded instrument to measure spirituality – the Spirituality Instrument-27 (SpI-27). A secondary aim was to psychometrically evaluate this instrument in a sample of individuals with chronic illness (n=249). Methods: A two-phase design was adopted. Phase one consisted of the development of the SpI-27 based on item generation from a concept analysis, a literature review, and an instrument appraisal. The second phase established the psychometric properties of the instrument and included: a qualitative descriptive design to establish content validity; a pilot study to evaluate the mode of administration; and a descriptive correlational design to assess the instrument’s reliability and validity. Data were analysed using SPSS (Version 18). Results: Results of exploratory factor analysis concluded a final five-factor solution with 27 items. These five factors were labelled: Connectedness with Others, Self-Transcendence, Self-Cognisance, Conservationism, and Connectedness with a Higher Power. Cronbach’s alpha coefficients ranged from 0.823 to 0.911 for the five factors, and 0.904 for the overall scale, indicating high internal consistency. Paired-sample t-tests, intra-class correlations, and weighted kappa values supported the temporal stability of the instrument over 2 weeks. A significant positive correlation was found between the SpI-27 and the Spirituality Index of Well-Being, providing evidence for convergent validity. Conclusion: This research addresses a call for a theoretically-grounded instrument to measure spirituality.

The development and psychometric properties of the HIV and Abuse Related Shame Inventory (HARSI).

Shame has been shown to predict sexual HIV transmission risk behavior, medication non-adherence, symptomatic HIV or AIDS, and symptoms of depression and PTSD. However, there remains a dearth of tools to measure the specific constructs of HIV-related and sexual abuse-related shame. To ameliorate this gap, we present a 31-item measure that assesses HIV and sexual abuse-related shame, and the impact of shame on HIV-related health behaviors. A diverse sample of 271 HIV-positive men and women who were sexually abused as children completed the HIV and Abuse Related Shame Inventory (HARSI) among other measures. An exploratory factor analysis supported the retention of three-factors, explaining 56.7% of the sample variance. These internally consistent factors showed good test-retest reliability, and sound convergent and divergent validity using eight well-established HIV specific and general psychosocial criterion measures. Unlike stigma or discrimination, shame is potentially alterable through individually-focused interventions, making the measurement of shame clinically meaningful.

Measuring the psychosocial characteristics of family caregivers of palliative care patients:psychometric properties of nine self-report instruments

Researchers and clinicians have experienced substantial difficulties locating measures that are suitable for use within palliative care settings. This article details the psychometric properties of nine instruments designed to assess the following psychosocial characteristics of family caregivers: competence, mastery, self-efficacy, burden, optimism, preparedness, social support, rewards, and mutuality. Results are based on the responses of 106 primary family caregivers caring for relatives dying of cancer. Principal components extraction with varimax rotation was used to explore the underlying structure of each measure. Following the exclusion of complex variables, suggested components for most measures comprised relatively homogenous items, which were good to excellent measures of each component. Some components comprised only two items; however, Cronbach's alphas typically indicated moderate to high levels of internal consistency. Overall, the results of this study suggest that most of the measures analyzed, excepting the mastery and mutuality scales, can be recommended to examine the family caregiver experience and test supportive interventions.

The design and psychometric assessment of a TPB-based questionnaire suitable for use with primary school children

Despite the popularity of the Theory of Planned Behaviour (TPB) a lack of research assessing the efficacy of the model in understanding the health behaviour of children exists, with those studies that have been conducted reporting problems with questionnaire formulation and low to moderate internal consistencies for TPB constructs. The aim of this study was to develop and test a TPB-based measure suitable for use with primary school children aged 9 to 10 years. A mixed method sequential design was employed. In Stage 1, 7 semi-structured focus group discussions (N=56) were conducted to elicit the underlying beliefs specific to tooth brushing. Using content thematic analysis the beliefs were identified and a TPB measure was developed. A repeated measures design was employed in Stage 2 using test re-test reliability analysis in order to assess its psychometric properties. In all, 184 children completed the questionnaire. Test-retest reliabilities support the validity and reliability of the TPB measure for assessing the tooth brushing beliefs of children. Pearson’s product moment correlations were calculated for all of the TPB beliefs, achieving substantial to almost perfect agreement levels. Specifically, a significant relationship between all 10 of the direct and indirect TPB constructs at the 0.01 level was achieved. This paper will discuss the design and development of the measure so could serve as a guide to fellow researchers and health psychologists interested in using theoretical models to investigate the health and well-being of children.

Abstract: Psychometric properties of two self-report clinical competence scales for nursing students.

Abstract: Psychometric properties of two self-report clinical competence scales for nursing students.
Background: It is important to assess the clinical competence of nursing students to gauge their professional development and educational needs. This can be measured by self-assessment tools. Anema and McCoy (2010) contended that the currently available measures need further psychometric testing.
Aim: To test the psychometric properties of Nursing Competencies Questionnaire (NCQ) and Self-Efficacy in Clinical Performance (SECP) clinical competence scales.

Method: A non-randomly selected sample of n=248 2nd year nursing students completed NCQ, SECP and demographic questionnaires (June and September 2013). Mokken Scaling Analysis (MSA) was used to test the structural validity and scale properties, convergent and discriminant validity and reliability were subsequently tested.

Results: The NCQ provided evidence of a unidimensional scale which had strong scale scalability coefficients Hs =0.581; but limited evidence of item rankability HT =0.367. MSA undertaken with the SECP scale identified two potential unidimensional scales the SECP28 and SECP7, each with adequate evidence of good/reasonable scalablity psychometric properties as a summed scale but no/very limited evidence of scale rankability (SECP28: Hs = 0.55, HT=0.211; SECP7: Hs = 0.61, HT=0.049). Analysis of between cohort differences and NCQ/ SECP scale scores produced evidence of convergent and discriminant validity and good internal reliability: NCQ α = 0.93, SECP28 α = 0.96, and SECP7 α=0.89.

Discussion: The NCQ was verified to have evidence of reliability and validity; however, as the SECP findings are new, and the sample small, with reference to Straat and colleagues (2014), the SECP results should be interpreted with caution and verified on a second sample.

Conclusions: Measurement of perceived self-competence could inform the development of nursing competence and could start early in a nursing programme. Further testing of the NCQ and SECP scales with larger samples and from different years is indicated.


References:
Anema, M., G and McCoy, JK. (2010) Competency-Based Nursing Education: Guide to Achieving Outstanding Learner Outcomes. New York: Springer.
Straat, JH., van der Ark, LA and Sijtsma, K. (2014) Minimum Sample Size Requirements for Mokken Scale Analysis Educational and Psychological Measurement 74 (5), 809-822.

Portuguese version of the Tilburg Frailty Indicator: Transcultural adaptation and psychometric validation

Artigo científico disponível actualmente em Early View (Online Version of Record published before inclusion in an issue)

Assessing the psychometric properties of dream content questionnaires

The present study was the first of its kind to systematically explore the psychometric properties of dream content questionnaires as measures of dream experience. One hundred and six University students filled out the Dream Content Questionnaire (DCQ) and kept a 14-day dream diary on two separate occasions, in addition to filling out the NEO-PI-R and Multidimensional Personality Questionnaire and measures of spatial ability and imaginativeness. The DCQ's reliability was acceptable, as was its discriminant and construct validity. Six of eight predicted relationships between trait personality and DCQ reported dream content were significant. In contrast, dream diaries showed instability over time and were unrelated to personality traits. The DCQ's concurrent validity could not be adequately appraised due to the inconsistency in dream diary content over time. The results suggest that questionnaires may be used to measure dream experience; however, the precise utility of dream questionnaires remains unclear. The findings raise important questions concerning measures of dream experience.

The risk-taking and self-harm inventory for adolescents: Development and psychometric evaluation

In this study, we report on the development and psychometric evaluation of the Risk-Taking (RT) and Self-Harm (SH) Inventory for Adolescents (RTSHIA), a self-report measure designed to assess adolescent RT and SH in community and clinical settings. 651 young people from secondary schools in England ranging in age from 11.6 years to 18.7 years and 71 young people referred to mental health services for SH behavior in London between the ages of 11.9 years and 17.5 years completed the RTSHIA along with standardized measures of adolescent psychopathology. Two factors emerged from the principal axis factoring, and RT and SH were further validated by a confirmatory factor analysis as related, but different, constructs, rather than elements of a single continuum. Inter-item and test–retest reliabilities were high for both components (Cronbach's α = .85, rtt = .90; Cronbach's α .93, rtt = .87), and considerable evidence emerged in support of the measure's convergent, concurrent, and divergent validity. The findings are discussed with regard to potential usefulness of the RTSHIA for research and clinical purposes with adolescents.

The Cognitive Behaviour Therapy Scale for Children and Young People (CBTS-CYP): development and psychometric properties

Background: There is increased interest in developing training in cognitive behaviour therapy (CBT) with children and young people. However, the assessment of clinical competence has relied upon the use of measures such as the Cognitive Therapy Scale-Revised (CTSR: Blackburn et al., 2001) which has been validated to assess competence with adults. The appropriateness of this measure to assess competence when working with children and young people has been questioned. Aim: This paper describes the development and initial evaluation of the Cognitive Behaviour Therapy Scale for Children and Young People (CBTSCYP) developed specifically to assess competence in CBT with children and young people. Method: A cross section of child CBT practitioners (n = 61) were consulted to establish face validity. Internal reliability, convergent validity and discriminative ability were assessed in two studies. In the first, 12 assessors independently rated a single video using both the Cognitive Behaviour Therapy Scale for Children and Young People (CBTS-CYP) and Cognitive Therapy Scale-Revised (CTS-Revised: Blackburn et al., 2001). In the second, 48 different recordings of CBT undertaken with children and young people were rated on both the CBTS-CYP and CTS-R. Results: Face validity and internal reliability of the CBTS-CYP were high, and convergent validity with the CTS-R was good. The CBTS-CYP compared well with the CTSR in discriminative ability. Conclusion: The CBTS-CYP provides an appropriate way of assessing competence in using CBT with children and young people. Further work is required to assess robustness with younger children and the impact of group training in reducing interrater variations.

Psychometric properties of the Swedish version of the Fear of Complications Questionnaire

Objectives: To translate and evaluate the psychometric properties of the Swedish version of the Fear of Complications Questionnaire. Design: Cross-sectional study design and scale development. Settings: Totally, 469 adults (response rate 63.5%) with Type 1 diabetes completed the questionnaires. Participants were recruited from two university hospitals in Sweden. Participants: Eligible patients were those who met the following inclusion criteria: diagnosed with Type 1 diabetes, diabetes duration of at least 1 year and aged at least 18 years. Methods: The Fear of Complications Questionnaire was translated using the forward-backward translation method. Factor analyses of the questionnaire were performed in two steps using both exploratory and confirmatory factor analysis. Convergent validity was examined using the Hospital Anxiety and Depression Scale and the Fear of Hypoglycaemia Fear Survey. Internal consistency was estimated using Cronbach’s alpha.Results: Exploratory factor analysis supported a two-factor solution. One factor contained three items having to do with fear of kidney-related complications and one factor included the rest of items concerning fear of other diabetes-related complications, as well as fear of complications in general. Internal consistency was high Cronbach’s alpha 0.96. The findings also gave support for convergent validity, with significant positive correlations between measures (r = 0.51 to 0.54). Conclusion: The clinical relevance of the identified two-factor model with a structure of one dominant subdomain may be considered. We suggest, however a one-factor model covering all the items as a relevant basis to assess fear of complications among people with Type 1 diabetes.

Psychometric Properties of the Oral Health Impact Profile and New Methodological Approach

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)

Psychometric properties of the Spanish version of the mindful attention awareness scale (MAAS) in patients with fibromyalgia

Background Mindful-based interventions improve functioning and quality of life in fibromyalgia (FM) patients. The aim of the study is to perform a psychometric analysis of the Spanish version of the Mindful Attention Awareness Scale (MAAS) in a sample of patients diagnosed with FM. Methods The following measures were administered to 251 Spanish patients with FM: the Spanish version of MAAS, the Chronic Pain Acceptance Questionnaire, the Pain Catastrophising Scale, the Injustice Experience Questionnaire, the Psychological Inflexibility in Pain Scale, the Fibromyalgia Impact Questionnaire and the Euroqol. Factorial structure was analysed using Confirmatory Factor Analyses (CFA). Cronbach's α coefficient was calculated to examine internal consistency, and the intraclass correlation coefficient (ICC) was calculated to assess the test-retest reliability of the measures. Pearson’s correlation tests were run to evaluate univariate relationships between scores on the MAAS and criterion variables. Results The MAAS scores in our sample were low (M = 56.7; SD = 17.5). CFA confirmed a two-factor structure, with the following fit indices [sbX2 = 172.34 (p < 0.001), CFI = 0.95, GFI = 0.90, SRMR = 0.05, RMSEA = 0.06. MAAS was found to have high internal consistency (Cronbach’s α = 0.90) and adequate test-retest reliability at a 1–2 week interval (ICC = 0.90). It showed significant and expected correlations with the criterion measures with the exception of the Euroqol (Pearson = 0.15). Conclusion Psychometric properties of the Spanish version of the MAAS in patients with FM are adequate. The dimensionality of the MAAS found in this sample and directions for future research are discussed.

Psychometric properties of the Beck Depression Inventory-II: a comprehensive review

OBJECTIVE: To review the psychometric properties of the Beck Depression Inventory-II (BDI-II) as a self-report measure of depression in a variety of settings and populations. METHODS: Relevant studies of the BDI-II were retrieved through a search of electronic databases, a hand search, and contact with authors. Retained studies (k = 118) were allocated into three groups: non-clinical, psychiatric/institutionalized, and medical samples. RESULTS: The internal consistency was described as around 0.9 and the retest reliability ranged from 0.73 to 0.96. The correlation between BDI-II and the Beck Depression Inventory (BDI-I) was high and substantial overlap with measures of depression and anxiety was reported. The criterion-based validity showed good sensitivity and specificity for detecting depression in comparison to the adopted gold standard. However, the cutoff score to screen for depression varied according to the type of sample. Factor analysis showed a robust dimension of general depression composed by two constructs: cognitive-affective and somatic-vegetative. CONCLUSIONS: The BDI-II is a relevant psychometric instrument, showing high reliability, capacity to discriminate between depressed and non-depressed subjects, and improved concurrent, content, and structural validity. Based on available psychometric evidence, the BDI-II can be viewed as a cost-effective questionnaire for measuring the severity of depression, with broad applicability for research and clinical practice worldwide.