Measurement of affect during simulation-based training

Training designed to support and strengthen higher-order mental abilities now often involves immersion in Virtual Reality where dangerous real world scenarios can be safely replicated. However despite the growing popularity of advanced training simulations, methods for evaluating their use rely heavily on subjective measures or analysis of final outcomes. Without dynamic, objective performance measures the outcome of training in terms of impact on cognitive skills and ability to transfer newly acquired skills to the real world is unknown. The relationship between affective intensity and cognitive learning provides a potential new approach to ensure the processing of cognitions which occur prior to final outcomes, such as problem-solving and decision-making, are adequately evaluated. This paper describes the technical aspects of pilot work recently undertaken to develop a new measurement tool designed to objectively track individual affect levels during simulation-based training.

Measurement and correlates of caregiver self-efficacy amongst family caregivers of persons with dementia living in Shanghai, China

Background: Caring for family members with dementia can be a long-term, burdensome task resulting in physical and emotional distress and impairment. Research has demonstrated significantly lower levels of selfefficacy among family caregivers of people with dementia (CGs) than caregivers of relatives with non-dementia diseases. Intervention studies have also suggested that the mental and physical health of dementia CGs could be improved through the enhancement of their self-efficacy. However, studies are limited in terms of the influences of caregiver self-efficacy on caregiver behaviour, subjective burden and health-related quality of life. Of particular note is that there are no studies on the applicability of caregiver self-efficacy in the social context of China. Objective: The purpose of this thesis was to undertake theoretical exploration using Bandura’s (1997) self-efficacy theory to 1) revise the Revised Caregiving Self-Efficacy Scale (C-RCSES) (Steffen, McKibbin, Zeiss, Gallagher-Thompson, & Bandura, 2002), and 2) explore determinants of caregiver self-efficacy and the role of caregiver self-efficacy and other conceptual constructs (including CGs’ socio-demographic characteristics, CRs’ impairment and CGs’ social support) in explaining and predicting caregiver behaviour, subjective burden and health-related quality of life among CGs in China. Methodology: Two studies were undertaken: a qualitative elicitation study with 10 CGs; and a cross-sectional survey with 196 CGs. In the first study, semi-structured interviews were conducted to explore caregiver behaviours and corresponding challenges for their performance. The findings of the study assisted in the development of the initial items and domains of the Chinese version of the Revised Caregiving Self-Efficacy Scale (C-RCSES). Following changes to items in the scale, the second study, a cross-sectional survey with 196 CGs was conducted to evaluate the psychometric properties of C-RCSES and to test a hypothesised self-efficacy model of family caregiving adapted from Bandura’s theory (1997). Results: 35 items were generated from the qualitative data. The content validity of the C-RCSES was assessed and ensured in Study One before being used for the cross-sectional survey. Eight items were removed and five subscales (caregiver self-efficacy for gathering information about treatment, symptoms and health care; obtaining support; responding to problematic behaviours; management of household, personal and medical care; and controlling upsetting thoughts about caregiving) were identified after principal component factor analysis on the cross-sectional survey data. The reliability of the scale is acceptable: the Cronbach’s alpha coefficients for the whole scale and for each subscale were all over .80; and the fourweek test-retest reliabilities for the whole scale and for each subscale ranged from .64 to .85. The concurrent, convergent and divergent validity were also acceptable. CGs reported moderate levels of caregiver self-efficacy. Furthermore, the level of self-efficacy for management of household, personal and medical care was relatively high in comparison to those of the other four domains of caregiver self-efficacy. Caregiver self-efficacy was also significantly influenced by CGs’ socio-demographic characteristics and the caregiving external factors (CR impairment and social support that CGs obtained). The level of caregiver behaviour that CGs reported was higher than that reported in other Chinese research. CGs’ socio-demographics significantly influenced caregiver behaviour, whereas caregiver self-efficacy did not influence caregiver behaviour. Regarding the two external factors, CGs who cared for highly impaired relatives reported high levels of caregiver behaviour, but social support did not influence caregiver behaviour. Regarding caregiver subjective burden and health-related quality of life, CGs reported moderate levels of subjective burden, and their level of healthrelated quality of life was significantly lower than that of the general population in China. The findings also indicated that CGs’ subjective burden and health-related quality of life were influenced by all major factors in the hypothesised model, including CGs’ socio-demographics, CRs’ impairment, social support that CGs obtained, caregiver self-efficacy and caregiver behaviour. Of these factors, caregiver self-efficacy and social support significantly improved their subjective burden and health-related quality of life; whereas caregiver behaviour and CRs’ impairment were detrimental to CGs, such as increasing subjective burden and worsening health-related quality of life. Conclusion: While requiring further exploration, the qualitative study was the first qualitative research conducted in China to provide an in-depth understanding of CGs’ caregiving experience, including their major caregiver behaviours and the corresponding challenges. Meanwhile, although the C-RCSES needs further psychometric testing, it is a useful tool for assessing caregiver self-efficacy in Chinese populations. Results of the qualitative and quantitative study provide useful information for future studies regarding the explanatory power of caregiver self-efficacy to caregiver behaviour, subjective burden and health-related quality of life. Additionally, integrated with Bandura’s theory, the findings from the quantitative study also suggested a further study exploring the role of outcome expectations in caregiver behaviour, subjective burden and healthrelated quality of life.

Subjective and Objective Indicators of Recovery in Severe Mental Illness: a Cross-Sectional Study

Background: This study aimed to determine whether subjective dimensions of recovery such as empowerment are associated with self-report of more objective indicators such as level of participation in the community and income from employment. A secondary aim was to investigate the extent to which diagnosis or other consumer characteristics mediated any relationship between these variables. Methods: The Community Integration Measure, the Empowerment Scale, the Recovery Assessment Scale, and the Camberwell Assessment of Needs Short Appraisal Schedule were administered to a convenience sample of 161 consumers with severe mental illness. Results: The majority of participants had a primary diagnosis of schizophreniform, anxiety/depression or bipolar affective disorder. The Empowerment Scale was quite strongly correlated with the Recovery Assessment Scale and the Community Integration Measure. Participants with a diagnosis of bipolar affective disorder had signifi cantly higher recovery and empowerment scores than participants with schizophrenia or depression. Both empowerment and recovery scores were significantly higher for people engaged in paid employment than for those receiving social security benefits. Conclusions: The measurement of subjective dimensions of recovery such as empowerment has validity in evaluation of global recovery for people with severe mental illness. A diagnosis of bipolar disorder is associated with higher scores on subjective and objective indicators of recovery.

Reliability of ultrasonographic measurement of the architecture of the vastus lateralis and gastrocnemius medialis muscles in older adults

Objective To determine the test-retest reliability of measurements of thickness, fascicle length (Lf) and pennation angle (θ) of the vastus lateralis (VL) and gastrocnemius medialis (GM) muscles in older adults. Participants Twenty-one healthy older adults (11 men and ten women; average age 68·1 ± 5·2 years) participated in this study. Methods Ultrasound images (probe frequency 10 MHz) of the VL at two sites (VL site 1 and 2) were obtained with participants seated with knee at 90º flexion. For GM measures, participants lay prone with ankle fixed at 15º dorsiflexion. Measures were taken on two separate occasions, 7 days apart (T1 and T2). Results The ICCs (95% CI) were: VL site 1 thickness = 0·96(0·90–0·98); VL site 2 thickness = 0·96(0·90–0·98), VL θ = 0·87(0·68–0·95), VL Lf = 0·80(0·50–0·92), GM thickness = 0·97(0·92–0·99), GM θ = 0·85(0·62–0·94) and GM Lf =0·90(0·75–0·96). The 95% ratio limits of agreement (LOAs) for all measures, calculated by multiplying the standard deviation of the ratio of the results between T1 and T2 by 1·96, ranged from 10·59 to 38·01%. Conclusion The ability of these tests to determine a real change in VL and GM muscle architecture is good on a group level but problematic on an individual level as the relatively large 95% ratio LOAs in the current study may encompass the changes in architecture observed in other training studies. Therefore, the current findings suggest that B-mode ultrasonography can be used with confidence by researchers when investigating changes in muscle architecture in groups of older adults, but its use is limited in showing changes in individuals over time.

Reliability of clinical measurement for assessing spinal fusion: An experimental sheep study

Study Design. A sheep study designed to compare the accuracy of static radiographs, dynamic radiographs, and computed tomographic (CT) scans for the assessment of thoracolumbar facet joint fusion as determined by micro-CT scanning. Objective. To determine the accuracy and reliability of conventional imaging techniques in identifying the status of thoracolumbar (T13-L1) facet joint fusion in a sheep model. Summary of Background Data. Plain radiographs are commonly used to determine the integrity of surgical arthrodesis of the thoracolumbar spine. Many previous studies of fusion success have relied solely on postoperative assessment of plain radiographs, a technique lacking sensitivity for pseudarthrosis. CT may be a more reliable technique, but is less well characterized. Methods. Eleven adult sheep were randomized to either attempted arthrodesis using autogenous bone graft and internal fixation (n = 3) or intentional pseudarthrosis (IP) using oxidized cellulose and internal fixation (n = 8). After 6 months, facet joint fusion was assessed by independent observers, using (1) plain static radiography alone, (2) additional dynamic radiographs, and (3) additional reconstructed spiral CT imaging. These assessments were correlated with high-resolution micro-CT imaging to predict the utility of the conventional imaging techniques in the estimation of fusion success. Results. The capacity of plain radiography alone to correctly predict fusion or pseudarthrosis was 43% and was not improved using plain radiography and dynamic radiography with also a 43% accuracy. Adding assessment by reformatted CT imaging to the plain radiography techniques increased the capacity to predict fusion outcome to 86% correctly. The sensitivity, specificity, and accuracy of static radiography were 0.33, 0.55, and 0.43, respectively, those of dynamic radiography were 0.46, 0.40, and 0.43, respectively, and those of radiography plus CT were 0.88, 0.85, and 0.86, respectively. Conclusion. CT-based evaluation correlated most closely with high-resolution micro-CT imaging. Neither plain static nor dynamic radiographs were able to predict fusion outcome accurately. © 2012 Lippincott Williams & Wilkins.

Practical physical activity measurement in youth : a review of contemporary approaches

Background: The accurate evaluation of physical activity levels amongst youth is critical for quantifying physical activity behaviors and evaluating the effect of physical activity interventions. The purpose of this review is to evaluate contemporary approaches to physical activity evaluation amongst youth. Data sources: The literature from a range of sources was reviewed and synthesized to provide an overview of contemporary approaches for measuring youth physical activity. Results: Five broad categories are described: self-report, instrumental movement detection, biological approaches, direct observation, and combined methods. Emerging technologies and priorities for future research are also identified. Conclusions: There will always be a trade-off between accuracy and available resources when choosing the best approach for measuring physical activity amongst youth. Unfortunately, cost and logistical challenges may prohibit the use of "gold standard" physical activity measurement approaches such as doubly labelled water. Other objective methods such as heart rate monitoring, accelerometry, pedometry, indirect calorimetry, or a combination of measures have the potential to better capture the duration and intensity of physical activity, while self-reported measures are useful for capturing the type and context of activity.

Prostate gland and extra-capsular tissue 3D reconstruction and measurement

Currently there are little objective parameters that can quantify the success of one form of prostate surgical removal over another. Accordingly, at Old Dominion University (ODU) we have been developing a process resulting in the use of software algorithms to assess the coverage and depth of extra-capsular soft tissue removed with the prostate by the various surgical approaches. Parameters such as the percent of capsule that is bare of soft tissue and where present the depth and extent of coverage have been assessed. First, visualization methods and tools are developed for images of prostate slices that are provided to ODU by the Pathology Department at Eastern Virginia Medical School (EVMS). The visualization tools interpolate and present 3D models of the prostates. Measurement algorithms are then applied to determine statistics about extra-capsular tissue coverage. This paper addresses the modeling, visualization, and analysis of prostate gland tissue to aid in quantifying prostate surgery success. Particular attention is directed towards the accuracy of these measurements and is addressed in the analysis discussions.

Measurement as legitimacy versus legitimacy of measures : Performance evaluation of social enterprise

Purpose The purpose of this paper is to review the growing emphasis on quantifiable performance measures such as social return on investment (SROI) in third sector organisations – specifically, social enterprise – through a legitimacy theory lens. It then examines what social enterprises value (i.e. consider important) in terms of performance evaluation, using a case study approach. Design/methodology/approach Case studies involving interviews, documentary analysis, and observation, of three social enterprises at different life-cycle stages with different funding structures, were constructed to consider “what measures matter” from a practitioner's perspective. Findings Findings highlight a priority on quality outcomes and impacts in primarily qualitative terms to evaluate performance. Further, there is a noticeable lack of emphasis on financial measures other than basic access to financial resources to continue pursuing social goals. Social implications The practical challenges faced by social enterprises – many of which are small to medium sized – in evaluating performance and by implication organisational legitimacy are contrasted with measures such as SROI which are resource intensive and have inherent methodological limitations. Hence, findings suggest the limited and valuable resources of social enterprises would be better allocated towards documenting the actual outcomes and impacts as a first step, in order to evaluate social and financial performance in terms appropriate to each objective, in order to demonstrate organisational legitimacy. Originality/value Findings distinguish between processes which may hold symbolic legitimacy for select stakeholder groups, and processes which hold substantive, cognitive legitimacy for stakeholders more broadly, in the under-researched context of social enterprise.

The Child Behavior Checklist and Youth Self-Report in adolescents with epilepsy : testing measurement invariance of the Attention and Thought Problems subscales

The objective of this study was to test for the measurement invariance of the Attention and Thought Problems subscales of the Child Behavior Checklist (CBCL) and Youth Self-Report (YSR) in a population-based sample of adolescents with and without epilepsy. Data were obtained from the 14-year follow-up of the Mater University Study of Pregnancy in which 33 adolescents with epilepsy and 1068 healthy controls were included for analysis. Confirmatory factor analysis was used to test for measurement invariance between adolescents with and without epilepsy. Structural equation modeling was used to test for group differences in attention and thought problems as measured with the CBCL and YSR. Measurement invariance was demonstrated for the original CBCL Attention Problems and YSR Thought Problems. After the removal of ambiguous items (“confused” and “daydreams”),measurement invariance was established for the YSR Attention Problems. The original and reduced CBCL Thought Problems were noninvariant. Adolescents with epilepsy had significantly more symptoms of behavioral problems on the CBCL Attention Problems, β = 0.51, p = 0.002, compared with healthy controls. In contrast, no significant differences were found for the YSR Attention and Thought Problems, β = −0.11, p = 0.417 and β = −0.20, p = 0.116, respectively. In this population-based sample of adolescents with epilepsy, the CBCL Attention Problems and YSR Thought Problems appear to be valid measures of behavioral problems, whereas the YSR Attention Problems was valid only after the removal of ambiguous items. Replication of these findings in clinical samples of adolescents with epilepsy that overcome the limitations of the current study is warranted.

Development of hospital disaster resilience : conceptual framework and potential measurement

Objective Despite ‘hospital resilience’ gaining prominence in recent years, it remains poorly defined. This article aims to define hospital resilience, build a preliminary conceptual framework and highlight possible approaches to measurement. Methods Searches were conducted of the commonly used health databases to identify relevant literature and reports. Search terms included ‘resilience and framework or model’ or ‘evaluation or assess or measure and hospital and disaster or emergency or mass casualty and resilience or capacity or preparedness or response or safety’. Articles were retrieved that focussed on disaster resilience frameworks and the evaluation of various hospital capacities. Result A total of 1480 potentially eligible publications were retrieved initially but the final analysis was conducted on 47 articles, which appeared to contribute to the study objectives. Four disaster resilience frameworks and 11 evaluation instruments of hospital disaster capacity were included. Discussion and conclusion Hospital resilience is a comprehensive concept derived from existing disaster resilience frameworks. It has four key domains: hospital safety; disaster preparedness and resources; continuity of essential medical services; recovery and adaptation. These domains were categorised according to four criteria, namely, robustness, redundancy, resourcefulness and rapidity. A conceptual understanding of hospital resilience is essential for an intellectual basis for an integrated approach to system development. This article (1) defines hospital resilience; (2) constructs conceptual framework (including key domains); (3) proposes comprehensive measures for possible inclusion in an evaluation instrument, and; (4) develops a matrix of critical issues to enhance hospital resilience to cope with future disasters.

Clinical use of objective measures of physical activity

With measurement of physical activity becoming more common in clinical practice, it is imperative that healthcare professionals become more knowledgeable about the different methods available to objectively measure physical activity behaviour. Objective measures do not rely on information provided by the patient, but instead measure and record the biomechanical or physiological consequences of performing physical activity, often in real time. As such, objective measures are not subject to the reporting bias or recall problems associated with self-report methods. The purpose of this article was to provide an overview of the different methods used to objectively measure physical activity in clinical practice. The review was delimited to heart rate monitoring, accelerometers and pedometers since their small size, low participant burden and relatively low cost make these objective measures appropriate for use in clinical practice settings. For each measure, strengths and weakness were discussed; and whenever possible, literature-based examples of implementation were provided.

Calibration and evaluation of an objective measure of physical activity in pre-school children

Background The purposes of this study were 1) to establish accelerometer count cutoffs to categorize activity intensity of 3 to 5-y old-children and 2) to evaluate the accelerometer as a measure of children’s physical activity in preschool settings. Methods While wearing an ActiGraph accelerometer, 16 preschool children performed five, 3-min structured activities. Receiver Operating Characteristic (ROC) curve analyses identified count cutoffs for four physical activity intensities. In 9 preschools, 281 children wore an ActiGraph during observations performed by three trained observers (interobserver reli-ability = 0.91 to 0.98). Results Separate count cutoffs for 3, 4, and 5-y olds were established. Sensitivity and specificity for the count cutoffs ranged from 86.7% to 100.0% and 66.7% to 100.0%, respectively. ActiGraph counts/15 s were different among all activities (P < 0.05) except the two sitting activities. Correlations between observed and ActiGraph intensity categorizations at the preschools ranged from 0.46 to 0.70 (P < 0.001). Conclusions The ActiGraph count cutoffs established and validated in this study can be used to objectively categorize the time that preschool-age children spend in different physical activity intensity levels.

State of the art reviews : measurement of physical activity in children and adolescents

To date, a wide range of methods has been used to measure physical activity in children and adolescents. These include self-report methods such as questionnaires, activity logs, and diaries as well as objective measures of physical activity such as direct observation, doubly labeled water, heart rate monitoring, accelerometers, and pedometers. The purpose of this review is to overview the methods currently being used to measure physical activity in children and adolescents. For each measurement approach, new developments and/or innovations are identified and discussed. Particular attention is given to the use of accelerometers and the calibration of accelerometer output to units of energy expenditure to developing children.

Common values in assessing health outcomes from disease and injury: Disability weights measurement study for the Global Burden of Disease Study 2010

BACKGROUND Measurement of the global burden of disease with disability-adjusted life-years (DALYs) requires disability weights that quantify health losses for all non-fatal consequences of disease and injury. There has been extensive debate about a range of conceptual and methodological issues concerning the definition and measurement of these weights. Our primary objective was a comprehensive re-estimation of disability weights for the Global Burden of Disease Study 2010 through a large-scale empirical investigation in which judgments about health losses associated with many causes of disease and injury were elicited from the general public in diverse communities through a new, standardised approach. METHODS We surveyed respondents in two ways: household surveys of adults aged 18 years or older (face-to-face interviews in Bangladesh, Indonesia, Peru, and Tanzania; telephone interviews in the USA) between Oct 28, 2009, and June 23, 2010; and an open-access web-based survey between July 26, 2010, and May 16, 2011. The surveys used paired comparison questions, in which respondents considered two hypothetical individuals with different, randomly selected health states and indicated which person they regarded as healthier. The web survey added questions about population health equivalence, which compared the overall health benefits of different life-saving or disease-prevention programmes. We analysed paired comparison responses with probit regression analysis on all 220 unique states in the study. We used results from the population health equivalence responses to anchor the results from the paired comparisons on the disability weight scale from 0 (implying no loss of health) to 1 (implying a health loss equivalent to death). Additionally, we compared new disability weights with those used in WHO's most recent update of the Global Burden of Disease Study for 2004. FINDINGS 13,902 individuals participated in household surveys and 16,328 in the web survey. Analysis of paired comparison responses indicated a high degree of consistency across surveys: correlations between individual survey results and results from analysis of the pooled dataset were 0·9 or higher in all surveys except in Bangladesh (r=0·75). Most of the 220 disability weights were located on the mild end of the severity scale, with 58 (26%) having weights below 0·05. Five (11%) states had weights below 0·01, such as mild anaemia, mild hearing or vision loss, and secondary infertility. The health states with the highest disability weights were acute schizophrenia (0·76) and severe multiple sclerosis (0·71). We identified a broad pattern of agreement between the old and new weights (r=0·70), particularly in the moderate-to-severe range. However, in the mild range below 0·2, many states had significantly lower weights in our study than previously. INTERPRETATION This study represents the most extensive empirical effort as yet to measure disability weights. By contrast with the popular hypothesis that disability assessments vary widely across samples with different cultural environments, we have reported strong evidence of highly consistent results.

Young drivers’ responses to anti-speeding advertisements: Comparison of self-report and objective measures of persuasive processing and outcomes

Objective Self-report measures are typically used to assess the effectiveness of road safety advertisements. However, psychophysiological measures of persuasive processing (i.e., skin conductance response [SCR]) and objective driving measures of persuasive outcomes (i.e., in-vehicle GPS devices) may provide further insights into the effectiveness of these advertisements. This study aimed to explore the persuasive processing and outcomes of two anti-speeding advertisements by incorporating both self-report and objective measures of speeding behaviour. In addition, this study aimed to compare the findings derived from these different measurement approaches. Methods Young drivers (N = 20, Mage = 21.01 years) viewed either a positive or negative emotion-based anti-speeding television advertisement. Whilst viewing the advertisement, SCR activity was measured to assess ad-evoked arousal responses. The RoadScout® GPS device was then installed into participants’ vehicles for one week to measure on-road speed-related driving behaviour. Self-report measures assessed persuasive processing (emotional and arousal responses) and actual driving behaviour. Results There was general correspondence between the self-report measures of arousal and the SCR and between the self-report measure of actual driving behaviour and the objective driving data (as assessed via the GPS devices). Conclusions This study provides insights into how psychophysiological and GPS devices could be used as objective measures in conjunction with self-report measures to further understand the persuasive processes and outcomes of emotion-based anti-speeding advertisements.