A psychometric evaluation of the Gudjonsson Suggestibility Scales : problems associated with measuring suggestibility as a difference score composite

The current paper provides a detailed examination of the psychometric properties of the Gudjonsson Suggestibility Scales (Gudjonsson, 1997) which have been widely used to measure individual suggestibility. Several fundamental problems associated with the Shift and Total Suggestibility subscales are identified and discussed. Two arguably more conceptually coherent methods of scoring the Shift subscale (‘Shift-positive’ and ‘Shift-negative’) are introduced. A confirmatory factor analytic model based on two oblique factors and relative answering regression effects between corresponding items was tested and supported based on a sample of 220 children. Based on a latent variable estimation approach, the internal consistency reliabilities associated with the Shift subscale scores were found to be unacceptably low. Consequently, we propose that until the problems associated with Shift-standard and Total Suggestibility is addressed successfully, use of the GSS should be limited to the Yield subscale.

A psychometric evaluation of the Learning Styles Questionnaire : 40-item version

Sixty-six English-speaking postgraduate distance-education medical students completed the Learning Styles Questionnaire (LSQ: 40-item version). This was completed while attending a residential workshop at the beginning of the semester, and 44 of these students completed the same LSQ questionnaire 5 months later at the completion of the semester. The psychometric properties of the LSQ were assessed using Cronbach’s alpha (internal consistency), test-retest, correlational analyses and factor analysis. The results indicated that the LSQ (40-item version) has poor reliability and validity, and therefore requires further development and psychometric evaluation.

Assessment of proximal outcomes of self-management programs : translation and psychometric evaluation of a German version of the Health Education Impact Questionnaire (heiQtm)

Purpose This paper describes the translation, cultural adaption, and psychometric evaluation of a German version of the Health Education Impact Questionnaire (heiQ™), a widely used generic instrument assessing a wide range of proximal outcomes of self-management programs.

Methods The translation was carried out according to international standards and included forward and backward translations. Comprehensibility and content validity were tested using cognitive interviews with 10 rehabilitation inpatients. Psychometric properties were examined in rehabilitation inpatients (n = 1,202) with a range of chronic conditions. Factorial validity was assessed using confirmatory factor analysis; concurrent validity was explored by correlations with comparator scales.

Results The items of the German heiQ™ were well understood by rehabilitation inpatients. The structure of the eight heiQ™ scales was replicated after minor adjustment. heiQ™ scales had higher correlations with comparator scales with similar constructs, particularly mental health concepts than with physical health. Moreover, all heiQ™ scales differentiated between individuals across different levels of depression.

Conclusion The German heiQ™ is comprehensible for German-speaking patients suffering from different types of chronic conditions; it assesses relevant outcomes of self-management programs in a reliable and valid manner. Further studies involving its practical application are warranted.

The eight-item modified Medical Outcomes Study Social Support Survey: psychometric evaluation showed excellent performance

Evaluation and validation of the psychometric properties of the eight-item modified Medical Outcomes Study Social Support Survey (mMOS-SS).

Self-Reported Capabilities Among Young Male Adults in Switzerland: Translation and Psychometric Evaluation of a German, French and Italian Version of a Closed Survey Instrument

There is a shortage of empirical applications of the capability approach that employ closed survey instruments to assess self-reported capabilities. However, for those few instruments that have been designed and administered through surveys until now, no psychometric properties (reliability, validity, and factor structure) were reported. The purpose of this study is the assessment of the psychometric properties of three new language versions (German, French, and Italian) of an established (English) set of eight self-reported capability items. The set of items is taken from a previously published British study by Anand and van Hees (J Soc Econ 35(2):268–284, 2006). Our sample consists of 17,152 young male adults aged 18–25 years from the three major language regions in Switzerland. The results indicate good reliability of the three language versions. The results from the exploratory factor analyses suggest a one-dimensional factor structure for seven domain specific items. Furthermore, the results from multiple regression analyses suggest that a global summary item on overall capabilities represents a measurement alternative to the set of seven domain specific capability items. Finally, the results confirm the applicability of the closed capability instrument in a large scale survey questionnaire and represent the first attempt to measure self-reported capabilities in Switzerland.

The Health Behavior Change Competency Checklist (HBCCC): Instrument development and psychometric evaluation.

More than half of morbidity and mortality in the United States can be attributed to behavior-related disease, such as tobacco use, physical inactivity, poor diet and alcohol consumption. Given the increased prevalence of behaviorally related medical health concerns, physician competence in the implementation of effective behavior change strategies is quickly becoming an essential skill. However, only recently have primary care residency programs begun to systematically teach and evaluate motivational interviewing skills critical to influencing health behavior, and use of standardized, objective assessment tools to assess skillfulness has been largely absent. This paper reports the development of a checklist, the Health Behavior Change Competency Checklist (HBCCC). The instrument captures the theoretical model of behavior change, motivational interviewing, in a practical and versatile manner. Psychometric evaluation demonstrated moderate efficacy. Namely, results indicated the HBCCC possesses good reliability, as evidenced by high internal consistency, and adequate construct validity. It also displayed considerable utility and practical application. While these results provide several reasons for confidence in the HBCCC, item revision and additional testing are required in order to establish it as a meaningful and valuable instrument.

+Psychometric evaluation of the MacDQoL individualised measure of the impact of macular degeneration on quality of life

Background: The MacDQoL is an individualised measure of the impact of macular degeneration (MD) on quality of life (QoL). There is preliminary evidence of its psychometric properties and sensitivity to severity of MD. The aim of this study was to carry out further psychometric evaluation with a larger sample and investigate the measure's sensitivity to MD severity. Methods: Patients with MD (n = 156: 99 women, 57 men, mean age 79 ± 13 years), recruited from eye clinics (one NHS, one private) completed the MacDQoL by telephone interview and later underwent a clinic vision assessment including near and distance visual acuity (VA), comfortable near VA, contrast sensitivity, colour recognition, recovery from glare and presence or absence of distortion or scotoma in the central 10° of the visual field. Results: The completion rate for the MacDQoL items was 99.8%. Of the 26 items, three were dropped from the measure due to redundancy. A fourth was retained in the questionnaire but excluded when computing the scale score. Principal components analysis and Cronbach's alpha (0.944) supported combining the remaining 22 items in a single scale. Lower MacDQoL scores, indicating more negative impact of MD on QoL, were associated with poorer distance VA (better eye r = -0.431 p < 0.001; worse eye r = -0.350 p < 0.001; binocular vision r = -0.419 p < 0.001) and near VA (better eye r -0.326 p < 0.001; worse eye r = -0.226 p < 0.001; binocular vision r = -0.326 p < 0.001). Poorer MacDQoL scores were associated with poorer contrast sensitivity (better eye r = 0.392 p < 0.001; binocular vision r = 0.423 p < 0.001), poorer colour recognition (r = 0.417 p < 0.001) and poorer comfortable near VA (r = -0.283, p < 0.001). The MacDQoL differentiated between those with and without binocular scotoma (U = 1244 p < 0.001). Conclusion: The MacDQoL 22-item scale has excellent internal consistency reliability and a single-factor structure. The measure is acceptable to respondents and the generic QoL item, MD-specific QoL item and average weighted impact score are related to several measures of vision. The MacDQoL demonstrates that MD has considerable negative impact on many aspects of QoL, particularly independence, leisure activities, dealing with personal affairs and mobility. The measure may be valuable for use in clinical trials and routine clinical care. © 2005 Mitchell et al; licensee BioMed Central Ltd.

Development and psychometric evaluation of a new team effectiveness scale for all types of community adult mental health teams:a mixed-methods approach

Defining 'effectiveness' in the context of community mental health teams (CMHTs) has become increasingly difficult under the current pattern of provision required in National Health Service mental health services in England. The aim of this study was to establish the characteristics of multi-professional team working effectiveness in adult CMHTs to develop a new measure of CMHT effectiveness. The study was conducted between May and November 2010 and comprised two stages. Stage 1 used a formative evaluative approach based on the Productivity Measurement and Enhancement System to develop the scale with multiple stakeholder groups over a series of qualitative workshops held in various locations across England. Stage 2 analysed responses from a cross-sectional survey of 1500 members in 135 CMHTs from 11 Mental Health Trusts in England to determine the scale's psychometric properties. Based on an analysis of its structural validity and reliability, the resultant 20-item scale demonstrated good psychometric properties and captured one overall latent factor of CMHT effectiveness comprising seven dimensions: improved service user well-being, creative problem-solving, continuous care, inter-team working, respect between professionals, engagement with carers and therapeutic relationships with service users. The scale will be of significant value to CMHTs and healthcare commissioners both nationally and internationally for monitoring, evaluating and improving team functioning in practice.

Prosocial Behaviour in Palliative Nurses: Psychometric Evaluation of the Prosociality Scale

Aim: The aim of this study was to examine the psychometric properties of a prosociality scale within the palliative nursing context, and then examine the impact of prosocial behaviour in relation to job and educational satisfaction among palliative nurses. Methods: An online cross-sectional survey was conducted in 25 Italian palliative care centres, with a total of 107 nurses completing the prosociality scale by Caprara et al (2005). Exploratory and confirmatory factor analyses were examined to evaluate a multidimensional model of prosociality. Results: A three-factor solution with a second order factor fitted the data well. The three dimensions extracted were labelled as helping, empathy, and sharing. Participants reported high levels of prosociality. In addition, prosociality was positively associated with job and educational satisfaction. Conclusions: The prosociality scale was valid and reliable when tested with palliative nurses. Although prosociality may be embedded in nurses’ personalities, this quality should be actively promoted to expand and improve the culture and the ethics of nursing.

Preliminary Development and Psychometric Evaluation of the ACL Scale: Factor Structure, Measurement Invariance, Reliability, and Validity

Thesis (Master's)--University of Washington, 2016-08

Development and psychometric evaluation of the basic electrocardiogram interpretation self-efficacy scale

Purpose: Research suggests that nurses and nursing students lack competence in basic electrocardiogram (ECG) interpretation. Self-efficacy is considered to be paramount in the development of one's competence. The aim of this study was to develop and psychometrically evaluate a scale to assess self-efficacy of nursing students in basic ECG interpretation. Materials and methods: Observational cross-sectional study with a convenience sample of 293 nursing students. The basic ECG interpretation self-efficacy scale (ECG-SES) was developed and psychometrically tested in terms of reliability (internal consistency and temporal stability) and validity (content, criterion and construct). The ECG-SES’ internal consistency was explored by calculating the Cronbach's alpha coefficient (α); its temporal stability was investigated by calculating the Pearson correlation coefficient (r) between the participants’ results on a test–retest separated by a 4-week interval. The content validity index of the items (I-CVI) and the scale (S-CVI) was calculated based on the reviews of a panel of 16 experts. Criterion validity was explored by correlating the participants’ results on the ECG-SES with their results on the New General Self-Efficacy Scale (NGSE). 1 Construct validity was investigated by performing Principal Component Analysis (PCA) and known-group analysis. Results: The excellent reliability of the ECG-SES was evidenced by its internal consistency (α = 0.98) and its temporal stability at the 4-week re-test (r = 0.81; p < 0.01). The ECG-SES’ content validity was also excellent (all items’ I-CVI = 0.94–1; S-CVI = 0.99). A strong, significant correlation between the NGSE and the ECG-SES (r = 0.70; p < 0.01) showed its criterion validity. Corroborating the ECG-SES’ construct validity, PCA revealed that all its items loaded on a single factor that explained 74.6% of the total variance found. Furthermore, known-groups analysis showed the ECG-SES’ ability to detect expected differences in self-efficacy between groups with different training experiences (p < 0.01). Conclusion: The ECG-SES showed excellent psychometric properties for measuring the self-efficacy of nursing students in basic ECG interpretation.

Self-neglect: development and evaluation of a self-neglect (SN-37) measurement instrument

Aim: To develop and evaluate the psychometric properties of an instrument for the measurement of self-neglect (SN).Conceptual Framework: An elder self-neglect (ESN) conceptual framework guided the literature review and scale development. The framework has two key dimensions physical/psycho-social and environmental and seven sub dimensions which are representative of the factors that can contribute to intentional and unintentional SN. Methods: A descriptive cross-sectional design was adopted to achieve the research aim. The study was conducted in two phases. Phase 1 involved the development of the questionnaire content and structure. Phase 2 focused on establishing the psychometric properties of the instrument. Content validity was established by a panel of 8 experts and piloted with 9 health and social care professionals. The instrument was subsequently posted with a stamped addressed envelope to 566 health and social care professionals who met specific eligibility criteria across the four HSE areas. A total of 341 questionnaires were returned, a response rate of 60% and 305 (50%) completed responses were included in exploratory factor analysis (EFA). Item and factor analyses were performed to elicit the instruments underlying factor structure and establish preliminary construct validity. Findings: Item and factor analyses resulted in a logically coherent, 37 items, five factor solution, explaining 55.6% of the cumulative variance. The factors were labelled: ‘Environment’, ‘Social Networks’, ‘Emotional and Behavioural Liability’, ‘Health Avoidance’ and ‘Self-Determinism’. The factor loadings were >0.40 for all items on each of the five subscales. Preliminary construct validity was supported by findings. Conclusion: The main outcome of this research is a 37 item Self-Neglect (SN-37) measurement instrument that was developed by EFA and underpinned by an ESN conceptual framework. Preliminary psychometric evaluation of the instrument is promising. Future work should be directed at establishing the construct and criterion related validity of the instrument.

An evaluation of self-report measures of cognitive distortions and empathy among Australian sex offenders

The modification of deviant cognitions and the enhancement of victim empathy are central components in many treatment programs for sex offenders. There appear to be three broad problems with self-report measures of these factors: variations in the psychometric evaluation of measures; the transparency of items and thus the likely influence of social desirability; and the difficulty of determining which measures are specific to particular types of sex offenders. The aim of this study was to investigate these three issues among child molesters (CMs), and men convicted of sex offences against adults (ASOs). Data were collected from 36 CMs and 31 ASOs and from two comparison groups (33 men convicted of nonsexual offences and 40 nonoffenders from the community), to assess the reliability (internal and test-retest) and validity (discriminant, construct, and face) of measures, the influence of sexual social desirability on responding and the specificity of measures to both sex offender groups. Collectively, the results raise issues related to the assessment of sex offenders that require further investigation. They also have theoretical implications about the relationship between cognitive and emotive processes among sex offenders.