Assessing the needs of informal caregivers to cancer survivors: a review of the instruments

Objective: Cancer may impact negatively on an informal caregiver's health long after treatment has ended. This review identifies the self-report measures currently in use to measure caregivers need for support and determines their scientific soundness and clinical utility.

Method: A systematic electronic database search of Medline, CINAHL, PsychINFO, BNI ProQuest was conducted. The psychometric properties and clinical utility of needs assessment tools for caregivers of cancer survivors (excluding advanced disease) were extracted and summarised.

Results: Seven cancer survivor caregiver needs assessment tools were identified. Data on instrument development was well reported, although variability was noted in their structure and content. The majority demonstrated some degree of reliability and validity; only two were evaluated for test–retest reliability (CaSPUN and SPUNS) with only the SPUNS showing a high degree of reliability over time. The Health Care Needs Survey (HCNS), Needs Assessment of Family Caregivers-Cancer (NAFC-C) and Cancer Caregiving Tasks Consequences and Needs Questionnaire (CaTCoN) have been validated at various stages of the cancer continuum. Minimal data was available on responsiveness.

Conclusion: All assessment tools identified require further psychometric analysis. For research purposes, the use of the SPUNS (with its acceptable test–retest reliability) appears most appropriate; although its length may be of concern for clinical use; therefore, the shorter SCNS-P&C is likely to be more suitable for use clinically. At present, the NAFC-C demonstrates a great potential in both the research and clinical environments; however, it requires further psychometric testing before it can be fully recommended. Further analysis is necessary on ideal response formats and the meaning of a total needs score.

Psychometric evaluation of the Student Authorship Questionnaire: a confirmatory factor analysis approach

This research provides new insights into the measurement of students’ authorial identity and its potential for minimising the incidence of unintentional plagiarism by providing evidence about the psychometric properties of the Student Authorship Questionnaire (SAQ). Exploratory and confirmatory factor analyses (EFA and CFA) are employed to investigate the measurement properties of the scales which comprise the SAQ using data collected from accounting students. The results provide limited psychometric support in favour of the factorial structure of the SAQ and raise a number of questions regarding the instrument’s robustness and generalisability across disciplines. An alternative model derived from the EFA outperforms the SAQ model with regard to its psychometric properties. Explanations for these findings are proffered and avenues for future research suggested.

Generic, disease-specific and individualised approaches to measuring health-related quality of life among people with heart disease - a comparative analysis.

Increasing emphasis is being placed on the evaluation of health-related quality of life. However, there is no consensus on the definition of this concept and as a result there are a plethora of existing measurement instruments. Head-to-head comparisons of the psychometric properties of existing instruments are necessary to facilitate evidence-based decisions about which instrument should be chosen for routine use. Therefore, an individualised instrument (the modified Patient Generated Index), a generic instrument (the Short Form 36) and a disease-specific instrument (the Quality of Life after Myocardial Infarction questionnaire) were administered to patients with ischaemic heart disease (n=117) and the evidence for the validity, reliability and sensitivity of each instrument was examined and compared. The modified Patient Generated Index compared favourably with the other instruments but none of the instruments examined provided sound evidence for sensitivity to change. Therefore, any recommendation for the use of the individualised approach in the routine collection of health-related quality of life data in clinical practice must be conditional upon the submission of further evidence to support the sensitivity of such instruments.

The student experience in Objective Structured Clinical Examinations (OSCEs): phenomenological analysis

Background and purpose
The dominant psychometric discourse of OSCEs may lead to unexpected problems, such as a checklist-based student performance1 which under emphasises the clinical relationship with student and standardised patient (SP). Such encounters can be dehumanising for SPs2 and have implications for what students learn about relational skills through the assessment process. In this study we explore medical students’ experiences of undertaking OSCEs using a phenomenological frame.
Methodology
Interpretative phenomenological analysis is a form of qualitative methodology which has strong resonance with existentialism and focuses on the lived experience without significant reference to external political or discursive
forces.
Six 4th year undergraduate medical students from Queen’s University Belfast were recruited in December 2013. Maximum variation sampling was used. Students were interviewed by a researcher in the week prior to the
OSCE and then again in the week following the OSCE in Jan 2014. Interviews were minimally structured in order to be open to respondents, rather than adhering to a fixed topic guide, but focussed on participants’ experiences, thoughts and feelings about taking part in OSCEs. Interviews were audio-recorded and
transcribed. Students were also asked to complete a short diary entry in the days prior to the OSCEs and another immediately following. Diary entries were written, emailed or audio-recorded at student’s preference.
Results
Transcripts are currently being analysed by interpretative phenomenological analysis. Preliminary analysis has demonstrated the significance of students’ relationships within the OSCE triad (student, SP and examiner); the effect of the immediate examination environment; realism versus roleplay; students’ perceptions of the purpose of assessment; and coping mechanisms.
Full results will be available by the time of the conference.
Conclusion and Discussion
Understanding the student experience in OSCEs is a crucial step in understanding the complex construction of relationships within the OSCE triad. The focus in OSCEs is typically on standardisation and reliability, but in exploring social interactions we may refocus attention on their inherent potential for learning and effects on both students and patients.
References
1. Hodges B. Medical education and the maintenance of incompetence. Med Teach 2006;28(8):690-6
2. Johnston JL, Lundy G, McCullough M, Gormley GJ. The view from over there: reframing the OSCE through the experience of standardised patient
raters. Med Educ 2013;47(9):899-909

The design and psychometric assessment of a TPB-based questionnaire suitable for use with primary school children

Despite the popularity of the Theory of Planned Behaviour (TPB) a lack of research assessing the efficacy of the model in understanding the health behaviour of children exists, with those studies that have been conducted reporting problems with questionnaire formulation and low to moderate internal consistencies for TPB constructs. The aim of this study was to develop and test a TPB-based measure suitable for use with primary school children aged 9 to 10 years. A mixed method sequential design was employed. In Stage 1, 7 semi-structured focus group discussions (N=56) were conducted to elicit the underlying beliefs specific to tooth brushing. Using content thematic analysis the beliefs were identified and a TPB measure was developed. A repeated measures design was employed in Stage 2 using test re-test reliability analysis in order to assess its psychometric properties. In all, 184 children completed the questionnaire. Test-retest reliabilities support the validity and reliability of the TPB measure for assessing the tooth brushing beliefs of children. Pearson’s product moment correlations were calculated for all of the TPB beliefs, achieving substantial to almost perfect agreement levels. Specifically, a significant relationship between all 10 of the direct and indirect TPB constructs at the 0.01 level was achieved. This paper will discuss the design and development of the measure so could serve as a guide to fellow researchers and health psychologists interested in using theoretical models to investigate the health and well-being of children.

Abstract: Psychometric properties of two self-report clinical competence scales for nursing students.

Abstract: Psychometric properties of two self-report clinical competence scales for nursing students.
Background: It is important to assess the clinical competence of nursing students to gauge their professional development and educational needs. This can be measured by self-assessment tools. Anema and McCoy (2010) contended that the currently available measures need further psychometric testing.
Aim: To test the psychometric properties of Nursing Competencies Questionnaire (NCQ) and Self-Efficacy in Clinical Performance (SECP) clinical competence scales.

Method: A non-randomly selected sample of n=248 2nd year nursing students completed NCQ, SECP and demographic questionnaires (June and September 2013). Mokken Scaling Analysis (MSA) was used to test the structural validity and scale properties, convergent and discriminant validity and reliability were subsequently tested.

Results: The NCQ provided evidence of a unidimensional scale which had strong scale scalability coefficients Hs =0.581; but limited evidence of item rankability HT =0.367. MSA undertaken with the SECP scale identified two potential unidimensional scales the SECP28 and SECP7, each with adequate evidence of good/reasonable scalablity psychometric properties as a summed scale but no/very limited evidence of scale rankability (SECP28: Hs = 0.55, HT=0.211; SECP7: Hs = 0.61, HT=0.049). Analysis of between cohort differences and NCQ/ SECP scale scores produced evidence of convergent and discriminant validity and good internal reliability: NCQ α = 0.93, SECP28 α = 0.96, and SECP7 α=0.89.

Discussion: The NCQ was verified to have evidence of reliability and validity; however, as the SECP findings are new, and the sample small, with reference to Straat and colleagues (2014), the SECP results should be interpreted with caution and verified on a second sample.

Conclusions: Measurement of perceived self-competence could inform the development of nursing competence and could start early in a nursing programme. Further testing of the NCQ and SECP scales with larger samples and from different years is indicated.


References:
Anema, M., G and McCoy, JK. (2010) Competency-Based Nursing Education: Guide to Achieving Outstanding Learner Outcomes. New York: Springer.
Straat, JH., van der Ark, LA and Sijtsma, K. (2014) Minimum Sample Size Requirements for Mokken Scale Analysis Educational and Psychological Measurement 74 (5), 809-822.

Reducing child conduct disordered behaviour and improving parent mental health in disadvantaged families: a 12 month follow-up and cost analysis of a parenting intervention

The effectiveness of the Incredible Years Basic parent programme (IYBP) in reducing child conduct problems and improving parent competencies and mental health was examined in a 12-month follow-up. Pre- to post-intervention service use and related costs were also analysed. A total of 103 families and their children (aged 32–88 months), who previously participated in a randomised controlled trial of the IYBP, took part in a 12-month follow-up assessment. Child and parent behaviour and well-being were measured using psychometric and observational measures. An intention-to-treat analysis was carried out using a one-way repeated measures ANOVA. Pairwise comparisons were subsequently conducted to determine whether treatment outcomes were sustained 1 year post-baseline assessment. Results indicate that post-intervention improvements in child conduct problems, parenting behaviour and parental mental health were maintained. Service use and associated costs continued to decline. The results indicate that parent-focused interventions, implemented in the early years, can result in improvements in child and parent behaviour and well-being 12 months later. A reduced reliance on formal services is also indicated.

Exploring the effects of a universal classroom management training programme on teacher and child behaviour: a group randomised controlled trial and cost analysis

Teachers frequently struggle to cope with conduct problems in the classroom. The aim of this study was to assess the effectiveness of the Incredible Years Teacher Classroom Management Training Programme for improving teacher competencies and child adjustment. The study involved a group randomised controlled trial which included 22 teachers and 217 children (102 boys and 115 girls). The average age of children included in the study was 5.3 years (standard deviation = 0.89). Teachers were randomly allocated to an intervention group (n = 11 teachers; 110 children) or a waiting-list control group (n = 11; 107 children). The sample also included 63 ‘high-risk’ children (33 intervention; 30 control), who scored above the cut-off (>12) on the Strengths and Difficulties Questionnaire for abnormal socioemotional and behavioural difficulties. Teacher and child behaviours were assessed at baseline and 6 months later using psychometric and observational measures. Programme delivery costs were also analysed. Results showed positive changes in teachers’ self-reported use of positive classroom management strategies (effect size = 0.56), as well as negative classroom management strategies (effect size = −0.43). Teacher reports also highlight improvements in the classroom behaviour of the high-risk group of children, while the estimated cost of delivering the Incredible Years Teacher Classroom Management Training Programme was modest. However, analyses of teacher and child observations were largely non-significant. A need for further research exploring the effectiveness and cost-effectiveness of the Incredible Years Teacher Classroom Management Training Programme is indicated.

Testing the psychometric properties of two self-report clinical competence scales for nursing students.

Background: It is important to assess the clinical competence of nursing students to gauge their educational needs. Competence can be measured by self-assessment tools; however, Anema and McCoy (2010) contend that currently available measures should be further psychometrically tested.
Aim: To test the psychometric properties of Nursing Competencies Questionnaire (NCQ) and Self-Efficacy in Clinical Performance (SECP) clinical competence scales.
Method: A non-randomly selected sample of n=248 2nd year nursing students completed NCQ, SECP and demographic questionnaires (June and September 2013). Mokken Scaling Analysis (MSA) was used to investigate structural validity and scale properties; convergent and discriminant validity and reliability were also tested for each scale.
Results: MSA analysis identified that the NCQ is a unidimensional scale with strong scale scalability coefficients Hs =0.581; but limited item rankability HT =0.367. The SECP scale MSA suggested that the scale could be potentially split into two unidimensional scales (SECP28 and SECP7), each with good/reasonable scalablity psychometric properties as summed scales but negligible/very limited scale rankability (SECP28: Hs = 0.55, HT=0.211; SECP7: Hs = 0.61, HT=0.049). Analysis of between cohort differences and NCQ/SECP scores produced evidence of discriminant and convergent validity; good internal reliability was also found: NCQ α = 0.93, SECP28 α = 0.96 and SECP7 α=0.89.

Discussion: In line with previous research further evidence of the NCQ’s reliability and validity was demonstrated. However, as the SECP findings are new and the sample small with reference to Straat and colleagues (2014), the SECP results should be interpreted with caution and verified on a second sample.
Conclusions: Measurement of perceived self-competence could start early in a nursing programme to support students’ development of clinical competence. Further testing of the SECP scale with larger nursing student samples from different programme years is indicated.

References:
Anema, M., G and McCoy, JK. (2010) Competency-Based Nursing Education: Guide to Achieving Outstanding Learner Outcomes. New York: Springer.
Straat, JH., van der Ark, LA and Sijtsma, K. (2014) Minimum Sample Size Requirements for Mokken Scale Analysis Educational and Psychological Measurement 74 (5), 809-822.

Testing the psychometric properties of Kidscreen-27 with Irish children of low socio-economic status

Background

Kidscreen-27 was developed as part of a cross-cultural European Union-funded project to standardise the measurement of children’s health-related quality of life. Yet, research has reported mixed evidence for the hypothesised 5-factor model, and no confirmatory factor analysis (CFA) has been conducted on the instrument with children of low socio-economic status (SES) across Ireland (Northern and Republic).

Method

The data for this study were collected as part of a clustered randomised controlled trial. A total of 663 (347 male, 315 female) 8–9-year-old children (M = 8.74, SD = .50) of low SES took part. A 5- and modified 7-factor CFA models were specified using the maximum likelihood estimation. A nested Chi-square difference test was conducted to compare the fit of the models. Internal consistency and floor and ceiling effects were also examined.

Results

CFA found that the hypothesised 5-factor model was an unacceptable fit. However, the modified 7-factor model was supported. A nested Chi-square difference test confirmed that the fit of the 7-factor model was significantly better than that of the 5-factor model. Internal consistency was unacceptable for just one scale. Ceiling effects were present in all but one of the factors.

Conclusions

Future research should apply the 7-factor model with children of low socio-economic status. Such efforts would help monitor the health status of the population.