An examination of the psychometric properties of the Rosenberg Self-Esteem Scale (RSES) in Chinese acute coronary syndrome (ACS) patients

The psychometric properties of the Rosenberg Self-Esteem Scale (RSES) as a clinical research instrument for acute coronary syndrome (ACS) patients were investigated in a translated Chinese version of the instrument. A confirmatory factor analysis was conducted on the RSES to establish its psychometric properties in 128 ACS patients over two observation points (within 1 week and 6 months post-admission for ACS). Internal and test - retest reliability of the RSES-TOT (all-items) and RSES-POS sub-scale (positively valenced items) were found to be acceptable. The RSES-NEG sub-scale (negatively valenced items) lacked acceptable internal reliability. The underlying factor structure of the RSES comprised two distinct but related factors, though there was inconsistency in best model fit indices at the 1-week observation point. The use of the RSES as two sub-scales (RSES-POS and RSES-NEG) may be clinically useful in evaluating the influence of this important psychological construct on the health outcomes of patients with ACS. Directions for future research are indicated.

The psychometric properties of a psychosis screen in a correctional setting

Many people who go to gaol are mentally ill. Remandees, prisoner receptions or people in jails have a substantially higher rate of severe mental disorder than other prisoners and the general population. There are no completely satisfactory ways to screen for psychosis and few existing screening questionnaires are available for use in correctional establishments. The Screening Instrument for Psychosis (PS) was developed in the context of the Australian Mental Health Survey: Study of Low Prevalence Disorders. It can help indicate whether a person should be referred to mental health professional for a diagnostic evaluation and possible treatment and/or diversion. We trialled the PS in a high security remand and reception centre. Measures of validity and reliability are reported. (c) 2006 Published by Elsevier Inc.

The Psychometric Properties of the Developmental Reading Assessment

ABSTRACT The purpose of this study was to examine the technical adequacy of the Developmental Reading Assessment (Beaver & Carter, 2004). Internal consistency analysis, factor analysis, and linear regression analyses were used to test whether the DRA is a statistically reliable measuring of reading comprehension for Grades 7 and 8 students. Correlational analyses, decision consistency analyses, and a focus group of experienced Intermediate (Grades 7 and 8) teachers examined whether there is evidence that the results from the DRA provide valid interpretations regarding students’ reading skills and comprehension. Results indicated that, as currently scored, internal consistency is low and skewness of distribution is high. Factor analyses did not replicate those cited by the DRA developers to prove construct validity. Two-way contingency analyses determined that decision consistency did not vary greatly between the DRA, EQAO, scores and report card marks. Views expressed during the focus group echoed many of the challenges to validity found in the statistical analysis. The teachers found that the DRA was somewhat useful, as there were limited alternative reading assessments available for the classroom, but did not endorse it strongly. The study found little evidence that the DRA provides valid interpretations regarding Intermediate students’ reading skills. Indicated changes to the structure and administration procedures of the DRA may ameliorate some of these issues.

Psychometric properties of the Drive for Muscularity Scale in Malay men

The Drive for Muscularity Scale (DMS) is a widely used measure in studies of men’s body image, but few studies have examined its psychometric properties outside English-speaking samples. Here, we assessed the factor structure of a Malay translation of the DMS. A community sample of 159 Malay men from Kuala Lumpur, Malaysia, completed the DMS, along with measures of self-esteem, body appreciation, and muscle discrepancy. Exploratory factor analysis led to the extraction of two factors, differentiating attitudes from behaviours, which mirrors the parent scale. Both factors also loaded on to a higher-order drive for muscularity factor. The subscales of the Malay DMS had adequate internal consistencies and good convergent validity, insofar as significant relationships were reported with self-esteem, body appreciation,muscle discrepancy, and body mass index. These results indicate that the Malay DMS has acceptable psychometric properties and can be used to assess body image concerns in Malay men.

Testing the psychometric properties of two self-report clinical competence scales for nursing students.

Background: It is important to assess the clinical competence of nursing students to gauge their educational needs. Competence can be measured by self-assessment tools; however, Anema and McCoy (2010) contend that currently available measures should be further psychometrically tested.
Aim: To test the psychometric properties of Nursing Competencies Questionnaire (NCQ) and Self-Efficacy in Clinical Performance (SECP) clinical competence scales.
Method: A non-randomly selected sample of n=248 2nd year nursing students completed NCQ, SECP and demographic questionnaires (June and September 2013). Mokken Scaling Analysis (MSA) was used to investigate structural validity and scale properties; convergent and discriminant validity and reliability were also tested for each scale.
Results: MSA analysis identified that the NCQ is a unidimensional scale with strong scale scalability coefficients Hs =0.581; but limited item rankability HT =0.367. The SECP scale MSA suggested that the scale could be potentially split into two unidimensional scales (SECP28 and SECP7), each with good/reasonable scalablity psychometric properties as summed scales but negligible/very limited scale rankability (SECP28: Hs = 0.55, HT=0.211; SECP7: Hs = 0.61, HT=0.049). Analysis of between cohort differences and NCQ/SECP scores produced evidence of discriminant and convergent validity; good internal reliability was also found: NCQ α = 0.93, SECP28 α = 0.96 and SECP7 α=0.89.

Discussion: In line with previous research further evidence of the NCQ’s reliability and validity was demonstrated. However, as the SECP findings are new and the sample small with reference to Straat and colleagues (2014), the SECP results should be interpreted with caution and verified on a second sample.
Conclusions: Measurement of perceived self-competence could start early in a nursing programme to support students’ development of clinical competence. Further testing of the SECP scale with larger nursing student samples from different programme years is indicated.

References:
Anema, M., G and McCoy, JK. (2010) Competency-Based Nursing Education: Guide to Achieving Outstanding Learner Outcomes. New York: Springer.
Straat, JH., van der Ark, LA and Sijtsma, K. (2014) Minimum Sample Size Requirements for Mokken Scale Analysis Educational and Psychological Measurement 74 (5), 809-822.

Testing the psychometric properties of Kidscreen-27 with Irish children of low socio-economic status

Background

Kidscreen-27 was developed as part of a cross-cultural European Union-funded project to standardise the measurement of children’s health-related quality of life. Yet, research has reported mixed evidence for the hypothesised 5-factor model, and no confirmatory factor analysis (CFA) has been conducted on the instrument with children of low socio-economic status (SES) across Ireland (Northern and Republic).

Method

The data for this study were collected as part of a clustered randomised controlled trial. A total of 663 (347 male, 315 female) 8–9-year-old children (M = 8.74, SD = .50) of low SES took part. A 5- and modified 7-factor CFA models were specified using the maximum likelihood estimation. A nested Chi-square difference test was conducted to compare the fit of the models. Internal consistency and floor and ceiling effects were also examined.

Results

CFA found that the hypothesised 5-factor model was an unacceptable fit. However, the modified 7-factor model was supported. A nested Chi-square difference test confirmed that the fit of the 7-factor model was significantly better than that of the 5-factor model. Internal consistency was unacceptable for just one scale. Ceiling effects were present in all but one of the factors.

Conclusions

Future research should apply the 7-factor model with children of low socio-economic status. Such efforts would help monitor the health status of the population.

Development and preliminary psychometric properties of the Care Experience Feedback Improvement Tool (CEFIT).

Objective To develop a structurally valid and reliable, yet brief measure of patient experience of hospital quality of care, the Care Experience Feedback Improvement Tool (CEFIT). Also, to examine aspects of utility of CEFIT. Background Measuring quality improvement at the clinical interface has become a necessary component of healthcare measurement and improvement plans, but the effectiveness of measuring such complexity is dependent on the purpose and utility of the instrument used. Methods CEFIT was designed from a theoretical model, derived from the literature and a content validity index (CVI) procedure. A telephone population surveyed 802 eligible participants (healthcare experience within the previous 12 months) to complete CEFIT. Internal consistency reliability was tested using Cronbach's α. Principal component analysis was conducted to examine the factor structure and determine structural validity. Quality criteria were applied to judge aspects of utility. Results CVI found a statistically significant proportion of agreement between patient and practitioner experts for CEFIT construction. 802 eligible participants answered the CEFIT questions. Cronbach's α coefficient for internal consistency indicated high reliability (0.78). Interitem (question) total correlations (0.28–0.73) were used to establish the final instrument. Principal component analysis identified one factor accounting for 57.3% variance. Quality critique rated CEFIT as fair for content validity, excellent for structural validity, good for cost, poor for acceptability and good for educational impact. Conclusions CEFIT offers a brief yet structurally sound measure of patient experience of quality of care. The briefness of the 5-item instrument arguably offers high utility in practice. Further studies are needed to explore the utility of CEFIT to provide a robust basis for feedback to local clinical teams and drive quality improvement in the provision of care experience for patients. Further development of aspects of utility is also required.

The psychometric properties of the brief Other as Shamer Scale for Children (OAS‐C) : preliminary validation studies in a sample of Portuguese children

Shame is a social emotion with adaptive functions involved in human be-havior and social interactions. This emotion is regarded as an involuntary response associated with increased self-awareness, loss of status and self-devaluation (Gilbert, 1998), that may render individuals more prone to psychopathology (Gilbert, 1998; Pinto-Gouveia & Matos, 2011). Thus, identifying and assessing feelings of shame in childhood is essential in addressing the actual impact of shame on individual’s developmental trajectory. The Other As Shamer Scale (OAS; Goss, Gilbert & Allan, 1994) is a widely used measure of external shame, adapted and translated to several languages — including Portuguese (Matos, Pinto-Gouveia, Gilbert, Duarte & Figueiredo, 2015) — to adult and to adolescent populations (OASB-A - Other As Shamer Brief for adolescents; translated and adapted by Cunha, Xavier, Cherpe & Pinto-Gouveia, 2014). The current study aims to adapt and to explore the psychometric proper-ties of the brief OAS in a sample of Portuguese children attending to elementary schools.

Psychometric properties of the Spanish version of the Coping Strategies Inventory (CSI) in older people

The aim of this study was to evaluate the psychometric properties of the Coping Strategies Inventory (CSI) in a sample of 243 people aged 55 to 99 years old. The first order factorial structure was similar to the structure of the original version of the CSI and to the Spanish adaptation with general population. Furthermore, high levels of internal consistency and of convergent validity were observed in the different primary scales. Nevertheless, the problem avoidance scale did not surpass the validity and reliability tests. Due to it we propose to delete two of the items of this scale. On the other hand, in this study we confirmed the secondary and tertiary structure obtained in the original version of the inventory that was neither confirmed in the Spanish adaptation study nor the other studies on the psychometric properties of the Spanish version of the CSI.

Glasgow Psychosis Screening tool for use in adults with Intellectual Disabilities (GPS-ID): development and psychometric properties

Background: Prevalence of psychosis is known to be higher in adults with intellectual disabilities (ID) than in the general adult population. However, there have been no attempts to develop a psychosis screening tool specifically for the adult ID population. The present study describes the development and preliminary evaluation of a new measure, the Glasgow Psychosis Screening tool for use in Adults with Intellectual Disabilities (GPS-ID). Method: An item pool was generated following: 1) focus groups with adults with ID and psychosis, and their carers and/or workers; 2) expert input from clinicians. A draft scale was compiled and refined following expert feedback. The new scale, along with the Psychotic Symptom Rating Scales was administered to 20 adults with ID (10 with and 10 without psychosis) and their relative or carers. Results: The GPS-ID total score, self-report subscale and informant rating-subscale differentiated psychosis and non-psychosis groups. The tool had good internal consistency (Cronbach’s α=0.91), and a cut-off score ≥4 yielded high sensitivity (90%) and specificity (100%). The method of tool development supports face and content validity. Criterion validity was not supported. Conclusions: Preliminary investigation of the tool’s psychometric properties is positive, although further investigation is required. The tool is accessible to adults with mild to moderate ID and can be completed in 15-30 minutes. The GPS-ID is not a diagnostic tool, therefore any adult exceeding the cut-off score of ≥4 should receive further assessment.

Children's Separation Anxiety Scale (CSAS): Psychometric Properties

This study describes the psychometric properties of the Children's Separation Anxiety Scale (CSAS), which assesses separation anxiety symptoms in childhood. Participants in Study 1 were 1,908 schoolchildren aged between 8 and 11. Exploratory factor analysis identified four factors: worry about separation, distress from separation, opposition to separation, and calm at separation, which explained 46.91% of the variance. In Study 2, 6,016 children aged 8–11 participated. The factor model in Study 1 was validated by confirmatory factor analysis. The internal consistency (α = 0.82) and temporal stability (r = 0.83) of the instrument were good. The convergent and discriminant validity were evaluated by means of correlations with other measures of separation anxiety, childhood anxiety, depression and anger. Sensitivity of the scale was 85% and its specificity, 95%. The results support the reliability and validity of the CSAS.

Psychometric properties of the oral health impact profile and new methodological approach

Objective: Evaluate the validity, reliability, and factorial invariance of the complete Portuguese version of the Oral Health Impact Profile (OHIP) and its short version (OHIP-14). Methods: A total of 1,162 adults enrolled in the Faculty of Dentistry of Araraquara/UNESP participated in the study; 73.1% were women; and the mean age was 40.7 ± 16.3 yr. We conducted a confirmatory factor analysis, where χ2/df, comparative fit index, goodness of fit index, and root mean square error of approximation were used as indices of goodness of fit. The convergent validity was judged from the average variance extracted and the composite reliability, and the internal consistency was estimated by Cronbach standardized alpha. The stability of the models was evaluated by multigroup analysis in independent samples (test and validation) and between users and nonusers of dental prosthesis. Results: We found best-fitting models for the OHIP-14 and among dental prosthesis users. The convergent validity was below adequate values for the factors “functional limitation” and “physical pain” for the complete version and for the factors “functional limitation” and “psychological discomfort” for the OHIP-14. Values of composite reliability and internal consistency were below adequate in the OHIP-14 for the factors “functional limitation” and “psychological discomfort.” We detected strong invariance between test and validation samples of the full version and weak invariance for OHIP-14. The models for users and nonusers of dental prosthesis were not invariant for both versions. Conclusion: The reduced version of the OHIP was parsimonious, reliable, and valid to capture the construct “impact of oral health on quality of life,” which was more pronounced in prosthesis users.