Is it painful or not?:Discriminant validity of the Behavioral Indicators of Infant Pain (BIIP) scale

To evaluate the ability of the Behavioral Indicators of Infant Pain (BIIP) scale to discriminate between skin-breaking and nonskin breaking procedures, and to identify sensitized pain responses in preterm infants in the neonatal intensive care unit (NICU).

Predicting IQ of biologically "at risk" children from age 3 to school entry:sensitivity and specificity of the Stanford-Binet Intelligence Scale IV

Predictive validity of the Stanford-Binet Intelligence Scale Fourth Edition (S-B IV) from age 3 years to ages 4-5 years was evaluated with biologically "at risk" children without major sensory or motor impairments (n = 236). Using the standard scoring, children with full scale IQ <or = 84 on the Wechsler Preschool and Primary Scale of Intelligence at age 4-5 years were poorly identified (sensitivity 54%) from the composite S-B IV score at age 3. However, sensitivity improved greatly to 78% by including as a predictor the number of subtests the child was actually able to perform at age 3 years. Measures from the Home Screening Questionnaire and ratings of mother-child interaction further improved sensitivity to 83%. The standard method for calculating the composite score on the S-B IV excludes subtests with a raw score of 0, which overestimates cognitive functioning in young biologically high risk children. Accuracy of early identification was improved significantly by considering the number of subtests the child did not perform at age 3 years.

Assessing family members' satisfaction with information sharing and communication during Hospital care at the end of life

Context: Despite the fact that most deaths occur in hospital, problems remain with how patients and families experience care at the end of life when a death occurs in a hospital. Objectives: (1) assess family member satisfaction with information sharing and communication, and (2) examine how satisfaction with information sharing and communication is associated with patient factors. Methods: Using a cross-sectional survey, data were collected from family members of adult patients who died in an acute care organization. Correlation and factor analysis were conducted, and internal consistency assessed using Cronbach's alpha. Linear regression was performed to determine the relationship among patient variables and satisfaction on the Information Sharing and Communication (ISC) scale. Results: There were 529 questionnaires available for analysis. Following correlation analysis and the dropping of redundant and conceptually irrelevant items, seven items remained for factor analysis. One factor was identified, described as information sharing and communication, that explained 76.3% of the variance. The questionnaire demonstrated good content and reliability (Cronbach's alpha 0.96). Overall, family members were satisfied with information sharing and communication (mean total satisfaction score 3.9, SD 1.1). The ISC total score was significantly associated with patient gender, the number of days in hospital before death, and the hospital program where the patient died. Conclusions: The ISC scale demonstrated good content validity and reliability. The ISC scale offers acute care organizations a means to assess the quality of information sharing and communication that transpires in care at the end of life. © Copyright 2013, Mary Ann Liebert, Inc.

Examining the Neurocognitive Validity of Commercially Available, Smartphone-Based Puzzle Games

Cognitive assessment typically involves assessing a person’s cognitive performance in unfamiliar and ar-guably unnatural clinical surroundings. User-centred approaches to assessment and monitoring, driven by issues such as enjoyability and familiarity, are largely absent. Everyday technologies, for example, smartphones represent an opportunity to obtain an objective assessment of a person’s cognitive capabili-ties in a non-threatening, discreet and familiar way, e.g. by everyday puzzle games undertaken as a leisure activity at home. We examined the strength of relationships that exist between performance on common puzzle games and standard measures of neuropsychological performance. Twenty-nine participants, aged 50 - 65 years, completed a comprehensive neuropsychological test battery and played three smart-phone-based puzzle games in triplicate: a picture puzzle [Matches Plus], a word puzzle [Jumbline] and a number puzzle [Sudoku]. As anticipated, a priori, significant correlations were observed between scores on a picture puzzle and visual memory test (r = 0.49; p = 0.007); a word puzzle and estimated verbal IQ (r = 0.53; p = 0.003) and verbal learning (r = 0.30; p = 0.039) tests; and a number puzzle and reason-ing/problem solving test (r = 0.42; p = 0.023). Further analyses making allowance for multiple compari-sons identified a significant unanticipated correlation (r = 0.49; p = 0.007) between number puzzle scores and a measure of nonverbal working memory. Performance on these smartphone-based games was in-dicative of relative cognitive ability across several cognitive domains at a fixed time point. Smart-phone-based, everyday puzzle games may offer a valid, portable measure of assessing and monitoring cognition in older adults.

A scaling method for modelling the crashworthiness of novel roadside barrier designs

In this paper, a novel method for modelling a scaled vehicle–barrier crash test similar to the 20◦ angled barrier test specified in EN 1317 is reported. The intended application is for proof-of-concept evaluation of novel roadside barrier designs, and as a cost-effective precursor to full-scale testing or detailed computational modelling. The method is based on the combination of the conservation of energy law and the equation of motion of a spring mass system representing the impact, and shows, for the first time, the feasibility of applying classical scaling theories to evaluation of roadside barrier design. The scaling method is used to set the initial velocity of the vehicle in the scaled test and to provide scaling factors to convert the measured vehicle accelerations in the scaled test to predicted full-scale accelerations. These values can then be used to calculate the Acceleration Severity Index score of the barrier for a full-scale test. The theoretical validity of the method is demonstrated by comparison to numerical simulations of scaled and full-scale angled barrier impacts using multibody analysis implemented in the crash simulation software MADYMO. Results show a maximum error of 0.3% ascribable to the scaling method.

Assessing the needs of informal caregivers to cancer survivors: a review of the instruments

Objective: Cancer may impact negatively on an informal caregiver's health long after treatment has ended. This review identifies the self-report measures currently in use to measure caregivers need for support and determines their scientific soundness and clinical utility.

Method: A systematic electronic database search of Medline, CINAHL, PsychINFO, BNI ProQuest was conducted. The psychometric properties and clinical utility of needs assessment tools for caregivers of cancer survivors (excluding advanced disease) were extracted and summarised.

Results: Seven cancer survivor caregiver needs assessment tools were identified. Data on instrument development was well reported, although variability was noted in their structure and content. The majority demonstrated some degree of reliability and validity; only two were evaluated for test–retest reliability (CaSPUN and SPUNS) with only the SPUNS showing a high degree of reliability over time. The Health Care Needs Survey (HCNS), Needs Assessment of Family Caregivers-Cancer (NAFC-C) and Cancer Caregiving Tasks Consequences and Needs Questionnaire (CaTCoN) have been validated at various stages of the cancer continuum. Minimal data was available on responsiveness.

Conclusion: All assessment tools identified require further psychometric analysis. For research purposes, the use of the SPUNS (with its acceptable test–retest reliability) appears most appropriate; although its length may be of concern for clinical use; therefore, the shorter SCNS-P&C is likely to be more suitable for use clinically. At present, the NAFC-C demonstrates a great potential in both the research and clinical environments; however, it requires further psychometric testing before it can be fully recommended. Further analysis is necessary on ideal response formats and the meaning of a total needs score.

Measuring math anxiety in Italian college and high school students: Validity, reliability and gender invariance of the Abbreviated Math Anxiety Scale (AMAS)

Given that the ability to manage numbers is essential in a modern society, mathematics anxiety – which has been demonstrated to have unfortunate consequences in terms of mastery of math – has become a subject of increasing interest, and the need to accurately measure it has arisen. One of the widely employed scales to measure math anxiety is the Abbreviated Math Anxiety Scale (AMAS) (Hopko, Mahadevan, Bare & Hunt, 2003). The first aim of the present paper was to confirm the factor structure of the AMAS when administered to Italian high school and college students, and to test the invariance of the scale across educational levels. Additionally, we assessed the reliability and validity of the Italian version of the scale. Finally, we tested the invariance of the AMAS across genders. The overall findings provide evidence for the validity and reliability of the AMAS when administered to Italian students.

"...and they won land among the Picts by friendly treaty or the sword": How a re-examination of early historical sources and an analysis of early medieval settlement in north Co. Antrim confirms the validity of traditional accounts of Dál Riatic migration to Scotland from Ulster

Much recent scholarship has been critical of the concept of a Dál Riatic migration to, or colonisation of, Argyll. Scepticism of the accuracy of the early medieval accounts of this population movement, arguing that these are late amendments to early sources, coupled with an apparent lack of archaeological evidence for such a migration have led to its rejection. It is argued here, however, that this rejection has been based on too narrow a reading of historical sources and that there are several early accounts which, while differing in detail, agree on one point of substance, that the origin of Scottish Dál Riata lies in Ireland. Also, the use of archaeological evidence to suggest no migration to Argyll by the Dál Riata is flawed, misunderstanding the nature of early migrations and how they might be archaeologically identified, and it's proposed that there is actually quite a lot of evidence for migration to Argyll by the Dál Riata, in the form of settlement and artefactural evidence, but that it is to be found in Ireland through the mechanism of counterstream migration, rather than in Scotland.

Dimensionality, Reliability and Validity of the InterRAI Depression Rating Scale in a Canadian Palliative Care Population

A reliable and valid instrument is needed to screen for depression in palliative patients. The interRAI Depression Rating Scale (DRS) is based on seven items in the interRAI Palliative Care instrument. This study is the first to explore the dimensionality, reliability and validity of the DRS in a palliative population. Palliative home care patients (n = 5,175) residing in Ontario (Canada) were assessed with the interRAI Palliative Care instrument. Exploratory factor analysis and Mokken scale analysis were used to identify candidate conceptual models and evaluate scale homogeneity/performance. Confirmatory factor analysis compared models using standard goodness-of-fit indices. Convergent and divergent validity were investigated by examining polychoric correlations between the DRS and other items. The “known groups” test determined if the DRS meaningfully distinguished among client subgroups. The non-hierarchical two factor model showed acceptable fit with the data, and ordinal alpha coefficients of 0.83 and 0.82 were observed for the two DRS subscales. Omega hierarchical (ωh) was 0.78 for the bifactor model, with the general factor explaining three quarters of the common variance. Despite the multidimensionality evident in the factor analyses, bifactor modelling and the Mokken homogeneity coefficient (0.34) suggest that the DRS is a coherent scale that captures important information on sub-constructs of depression (e.g., somatic symptoms). Higher correlations were seen between the DRS and mood and psychosocial well-being items, and lower correlations with functional status and demographic variables. The DRS distinguished in the expected manner for known risk factors (e.g., social support, pain). The results suggest that the DRS is primarily unidimensional and reliable for use in screening for depression in palliative care patients.

Validity of the Global Physical Activity Questionnaire (GPAQ) in assessing levels and change in moderate-vigorous physical activity and sedentary behaviour

Background

Feasible, cost-effective instruments are required for the surveillance of moderate-to-vigorous physical activity (MVPA) and sedentary behaviour (SB) and to assess the effects of interventions. However, the evidence base for the validity and reliability of the World Health Organisation-endorsed Global Physical Activity Questionnaire (GPAQ) is limited. We aimed to assess the validity of the GPAQ, compared to accelerometer data in measuring and assessing change in MVPA and SB.

Participants (n = 101) were selected randomly from an on-going research study, stratified by level of physical activity (low, moderate or highly active, based on the GPAQ) and sex. Participants wore an accelerometer (Actigraph GT3X) for seven days and completed a GPAQ on Day 7. This protocol was repeated for a random sub-sample at a second time point, 3–6 months later. Analysis involved Wilcoxon-signed rank tests for differences in measures, Bland-Altman analysis for the agreement between measures for median MVPA and SB mins/day, and Spearman’s rho coefficient for criterion validity and extent of change.

95 participants completed baseline measurements (44 females, 51 males; mean age 44 years, (SD 14); measurements of change were calculated for 41 (21 females, 20 males; mean age 46 years, (SD 14). There was moderate agreement between GPAQ and accelerometer for MVPA mins/day (r = 0.48) and poor agreement for SB (r = 0.19). The absolute mean difference (self-report minus accelerometer) for MVPA was −0.8 mins/day and 348.7 mins/day for SB; and negative bias was found to exist, with those people who were more physically active over-reporting their level of MVPA: those who were more sedentary were less likely to under-report their level of SB. Results for agreement in change over time showed moderate correlation (r = 0.52, p = 0.12) for MVPA and poor correlation for SB (r = −0.024, p = 0.916).

Levels of agreement with objective measurements indicate the GPAQ is a valid measure of MVPA and change in MVPA but is a less valid measure of current levels and change in SB. Thus, GPAQ appears to be an appropriate measure for assessing the effectiveness of interventions to promote MVPA.

A quantum measurement paradigm for educational predicates: Implications for validity in educational measurement

The outcomes of educational assessments undoubtedly have real implications for students, teachers, schools and education in the widest sense. Assessment results are, for example, used to award qualifications that determine future educational or vocational pathways of students. The results obtained by students in assessments are also used to gauge individual teacher quality, to hold schools to account for the standards achieved by their students, and to compare international education systems. Given the current high-stakes nature of educational assessment, it is imperative that the measurement practices involved have stable philosophical foundations. However, this paper casts doubt on the theoretical underpinnings of contemporary educational measurement models. Aspects of Wittgenstein’s later philosophy and Bohr’s philosophy of quantum theory are used to argue that a quantum theoretical rather than a Newtonian model is appropriate for educational measurement, and the associated implications for the concept of validity are elucidated. Whilst it is acknowledged that the transition to a quantum theoretical framework would not lead to the demise of educational assessment, it is argued that, where practical, current high-stakes assessments should be reformed to become as ‘low-stakes’ as possible. The paper also undermines some of the pro high-stakes testing rhetoric that has a tendency to afflict education.