Reliability and criterion-related validity with a smartphone used in timed-up-and-go test

Background The capacity to diagnosys, quantify and evaluate movement beyond the general confines of a clinical environment under effectiveness conditions may alleviate rampant strain on limited, expensive and highly specialized medical resources. An iPhone 4® mounted a three dimensional accelerometer subsystem with highly robust software applications. The present study aimed to evaluate the reliability and concurrent criterion-related validity of the accelerations with an iPhone 4® in an Extended Timed Get Up and Go test. Extended Timed Get Up and Go is a clinical test with that the patient get up from the chair and walking ten meters, turn and coming back to the chair. Methods A repeated measure, cross-sectional, analytical study. Test-retest reliability of the kinematic measurements of the iPhone 4® compared with a standard validated laboratory device. We calculated the Coefficient of Multiple Correlation between the two sensors acceleration signal of each subject, in each sub-stage, in each of the three Extended Timed Get Up and Go test trials. To investigate statistical agreement between the two sensors we used the Bland-Altman method. Results With respect to the analysis of the correlation data in the present work, the Coefficient of Multiple Correlation of the five subjects in their triplicated trials were as follows: in sub-phase Sit to Stand the ranged between r = 0.991 to 0.842; in Gait Go, r = 0.967 to 0.852; in Turn, 0.979 to 0.798; in Gait Come, 0.964 to 0.887; and in Turn to Stand to Sit, 0.992 to 0.877. All the correlations between the sensors were significant (p < 0.001). The Bland-Altman plots obtained showed a solid tendency to stay at close to zero, especially on the y and x-axes, during the five phases of the Extended Timed Get Up and Go test. Conclusions The inertial sensor mounted in the iPhone 4® is sufficiently reliable and accurate to evaluate and identify the kinematic patterns in an Extended Timed Get and Go test. While analysis and interpretation of 3D kinematics data continue to be dauntingly complex, the iPhone 4® makes the task of acquiring the data relatively inexpensive and easy to use.

Validity of the geriatric depression scale and the collateral source version of the geriatric depression scale in nursing homes

Background Depression is a common psychiatric disorder in older people. The study aimed to examine the screening accuracy of the Geriatric Depression Scale (GDS) and the Collateral Source version of the Geriatric Depression Scale (CS-GDS) in the nursing home setting. Methods Eighty-eight residents from 14 nursing homes were assessed for depression using the GDS and the CS-GDS, and validated against clinician diagnosed depression using the Semi-structured Clinical Diagnostic Interview for DSM-IV-TR Axis I Disorders (SCID) for residents without dementia and the Provisional Diagnostic Criteria for Depression in Alzheimer Disease (PDCdAD) for those with dementia. The screening performances of five versions of the GDS (30-, 15-, 10-, 8-, and 4-item) and two versions of the CS-GDS (30- and 15-item) were analyzed using receiver operating characteristic (ROC) curves. Results Among residents without dementia, both the self-rated (AUC = 0.75–0.79) and proxy-rated (AUC = 0.67) GDS variations performed significantly better than chance in screening for depression. However, neither instrument adequately identified depression among residents with dementia (AUC between 0.57 and 0.70). Among the GDS variations, the 4- and 8-item scales had the highest AUC and the optimal cut-offs were >0 and >3, respectively. Conclusions The validity of the GDS in detecting depression requires a certain level of cognitive functioning. While the CS-GDS is designed to remedy this issue by using an informant, it did not have adequate validity in detecting depression among residents with dementia. Further research is needed on informant selection and other factors that can potentially influence the validity of proxy-based measures in the nursing home setting.

Cross-cultural adaptation and validation of the Foot Function Index to Spanish

Background The purpose of this study was to adapt and validate the Foot Function Index to the Spanish (FFI-Sp) following the guidelines of the American Academy of Orthopaedic Surgeons. Methods A cross-sectional study 80 participants with some foot pathology. A statistical analysis was made, including a correlation study with other questionnaires (the Foot Health Status Questionnaire, EuroQol 5-D, Visual Analogue Pain Scale, and the Short Form SF-12 Health Survey). Data analysis included reliability, construct and criterion-related validity and factor analyses. Results The principal components analysis with varimax rotation produced 3 principal factors that explained 80% of the variance. The confirmatory factor analysis showed an acceptable fit with a comparative fit index of 0.78. The FFI-Sp demonstrated excellent internal consistency on the three subscales: pain 0.95; disability 0.96; and activity limitation 0.69, the subscale that scored lowest. The correlation between the FFI-Sp and the other questionnaires was high to moderate. Conclusions The Spanish version of the Foot Function Index (FFI-Sp) is a tool that is a valid and reliable tool with a very good internal consistency for use in the assessment of pain, disability and limitation of the function of the foot, for use both in clinic and research.

Commentary on the article by Swanenburg et al. ‘Validity and reliability of a German version of the Neck Disability Index (NDI-G)’

We commend Swanenburg et al. (2013) on translation, development, and clinimetric analysis of the NDI-G. However, the dual-factor structure with factor analysis and the high level of internal consistency (IC) highlighted in their discussion were not emphasized in the abstract or conclusion. These points may imply some inconsistencies with the final conclusions since determination of stable point estimates with the study's small sample are exceedingly difficult.

Validity of BMI as a measure of obesity in Australian white Caucasian and Australian Sri Lankan children

Background: Body mass index (BMI) is used to diagnose obesity. However, its ability to predict the percentage fat mass (%FM) reliably is doubtful. Therefore validity of BMI as a diagnostic tool of obesity is questioned. Aim: This study is focused on determining the ability of BMI-based cut-off values in diagnosing obesity among Australian children of white Caucasian and Sri Lankan origin. Subjects and methods: Height and weight was measured and BMI (W/H2) calculated. Total body water was determined by deuterium dilution technique and fat free mass and hence fat mass derived using age- and gender-specific constants. A %FM of 30% for girls and 20% for boys was considered as the criterion cut-off level for obesity. BMI-based obesity cut-offs described by the International Obesity Task Force (IOTF), CDC/NCHS centile charts and BMI-Z were validated against the criterion method. Results: There were 96 white Caucasian and 42 Sri Lankan children. Of the white Caucasians, 19 (36%) girls and 29 (66%) boys, and of the Sri Lankans 7 (46%) girls and 16 (63%) boys, were obese based on %FM. The FM and BMI were closely associated in both Caucasians (r = 0.81, P<0.001) and Sri Lankans (r = 0.92, P<0.001). Percentage FM and BMI also had a lower but significant association. Obesity cut-off values recommended by IOTF failed to detect a single case of obesity in either group. However, NCHS and BMI-Z cut-offs detected cases of obesity with low sensitivity. Conclusions: BMI is a poor indicator of percentage fat and the commonly used cut-off values were not sensitive enough to detect cases of childhood obesity in this study. In order to improve the diagnosis of obesity, either BMI cut-off values should be revised to increase the sensitivity or the possibility of using other indirect methods of estimating the %FM should be explored.

Validity of currently used cutoff values of body mass index as a measure of obesity in Sri Lankan children

The aim of the study was to determine the reliability of body mass index based (BMI) cutoff values in diagnosing obesity among Sri Lankan children. Height, weight, waist circumference (WC) and hip circumference (HC) in 282 children were measured. Total body water was determined by deuterium dilution and fat mass (FM) derived using age and gender specific constants. A percentage FM of 30% for girls and 25% for boys were considered as cutoff levels for obesity. Two hundred and eighty two children (M/F: 158/124) were studied and 99 (80%) girls and 72 (45.5%) boys were obese based on % body fat. Eight (6.4%) girls and nine (5.7%) boys were obese based on International Obesity Task Force (IOTF) cutoff values. Percentage FM and WC centile charts were able to diagnose a significant proportion of children as true obese children. The FM and BMI were closely associated in both girls (r = 0.82, p < 0.001) and boys (r = 0.87, p < 0.001). Percentage FM and BMI had a very low but significant association; girls (r = 0.32, p < 0.001) and boys (r = 0.68, p < 0.001). FM had a significant association with WC and HC. BMI based cutoff values had a specificity of 100% but a very low sensitivity, varying between 8% and 23.6%. BMI is a poor indicator of the percentage fat and the commonly used cutoff values were not sensitive to detect cases of childhood obesity in Sri Lankan children.

Development of the dimensions of adult mastery motivation questionnaire

Mastery motivation is an important developmental construct that has implications for development across the lifespan. Research to date has focused predominantly on infants and children, with the Dimensions of Mastery Questionnaire (DMQ) being the most widely used measure of mastery motivation. This paper reports on the development and initial validation of an adult measure: the Dimensions of Adult Mastery Motivation Questionnaire (DAMMQ). Six hundred and twenty-eight adults (68 % female) aged 18 to 90 years completed the questionnaire. Factor analysis produced 24 items that represented five factors: task persistence, preference for challenge, task related pleasure, task absorption and competence/self-efficacy. The DAMMQ was found to have good internal consistency, test-retest reliability and concurrent validity. Within group differences for age, gender and education are reported. The development of the DAMMQ paves the way for future research about mastery motivation in adult populations.

Career adaptability predicts subjective career success above and beyond personality traits and core self-evaluations

The Career Adapt-Abilities Scale (CAAS) measures career adaptability as a higher-order construct that integrates four psychosocial resources of employees for managing their career development: concern, control, curiosity, and confidence. The goal of the present study was to investigate the validity of the CAAS with regard to its effects on two indicators of subjective career success (career satisfaction and self-rated career performance) above and beyond the effects of employees' Big Five personality traits and core self-evaluations. Data came from a large and heterogeneous sample of employees in Australia (N=1723). Results showed that overall career adaptability positively predicted career satisfaction and self-rated career performance above and beyond the Big Five personality traits and core self-evaluations. In addition, concern and confidence positively predicted the two indicators of subjective career success. The findings provide further support for the incremental validity of the CAAS.

Is stereotype threat a useful construct for organizational psychology research and practice?

Stereotypes about different groups persist in organizations. Employees from such groups may experience stereotype threat, or the concern that they are being judged on the basis of demeaning stereotypes about groups to which they belong. The goal of this focal article is to discuss whether stereotype threat is a useful construct for organizational psychology research and practice. To this end, we focus on consequences other than acute performance deficits in laboratory settings. In particular, we examine studies that highlight the effects of stereotype threat on intrapersonal outcomes (e.g., job attitudes), interpersonal outcomes (e.g., negotiation), and on the relationship between employees and their organization. The research reviewed suggests that stereotype threat is a potentially important phenomenon in organizations, but it also highlights the paucity of research in an organizational context. We provide suggestions for future research directions as well as for the prevention and amelioration of stereotype threat in the workplace.

Reliability and validity of objective measures of physical activity in youth with cerebral palsy who are ambulatory

BACKGROUND Physical therapy for youth with cerebral palsy (CP) who are ambulatory includes interventions to increase functional mobility and participation in physical activity (PA). Thus, reliable and valid measures are needed to document PA in youth with CP. OBJECTIVE The purpose of this study was to evaluate the inter-instrument reliability and concurrent validity of 3 accelerometer-based motion sensors with indirect calorimetry as the criterion for measuring PA intensity in youth with CP. METHODS Fifty-seven youth with CP (mean age=12.5 years, SD=3.3; 51% female; 49.1% with spastic hemiplegia) participated. Inclusion criteria were: aged 6 to 20 years, ambulatory, Gross Motor Function Classification System (GMFCS) levels I through III, able to follow directions, and able to complete the full PA protocol. Protocol activities included standardized activity trials with increasing PA intensity (resting, writing, household chores, active video games, and walking at 3 self-selected speeds), as measured by weight-relative oxygen uptake (in mL/kg/min). During each trial, participants wore bilateral accelerometers on the upper arms, waist/hip, and ankle and a portable indirect calorimeter. Intraclass coefficient correlations (ICCs) were calculated to evaluate inter-instrument reliability (left-to-right accelerometer placement). Spearman correlations were used to examine concurrent validity between accelerometer output (activity and step counts) and indirect calorimetry. Friedman analyses of variance with post hoc pair-wise analyses were conducted to examine the validity of accelerometers to discriminate PA intensity across activity trials. RESULTS All accelerometers exhibited excellent inter-instrument reliability (ICC=.94-.99) and good concurrent validity (rho=.70-.85). All accelerometers discriminated PA intensity across most activity trials. LIMITATIONS This PA protocol consisted of controlled activity trials. CONCLUSIONS Accelerometers provide valid and reliable measures of PA intensity among youth with CP.

Validity of the OMNI rating of perceived exertion scale for children and adolescents with cerebral palsy

Aim This study evaluated the validity of the OMNI Walk/Run Rating of Perceived Exertion (OMNI-RPE) scores with heart rate and oxygen consumption (VO2) for children and adolescents with cerebral palsy (CP). Method Children and adolescents with CP, aged 6 to 18 years and Gross Motor Function Classification System (GMFCS) levels I to III completed a physical activity protocol with seven trials ranging in intensity from sedentary to moderate-to-vigorous. VO2 and heart rate were recorded during the physical activity trials using a portable indirect calorimeter and heart rate monitor. Participants reported OMNI-RPE scores for each trial. Concurrent validity was assessed by calculating the average within-subject correlation between OMNI-RPE ratings and the two physiological indices. Results For the correlational analyses, 48 participants (22 males, 26 females; age 12y 6mo, SD 3y 4mo) had valid bivariate data for VO2 and OMNI-RPE, while 40 participants (21 males, 19 females; age 12y 5mo, SD 2y 9mo) had valid bivariate data for heart rate and OMNI-RPE. VO2 (r=0.80; 95% CI 0.66–0.88) and heart rate (r=0.83; 95% CI 0.70–0.91) were moderately to highly correlated to OMNI-RPE scores. No difference was found for the correlation of physiological data and OMNI-RPE scores across the three GMFCS levels. The OMNI-RPE scores increased significantly in a dose-response manner (F6,258=116.1, p<0.001) as exercise intensity increased from sedentary to moderate-to-vigorous. Interpretation OMNI-RPE is a clinically feasible option to monitor exercise intensity in ambulatory children and adolescents with CP.

Validity of a self-report recall tool for estimating sedentary behaviour in adults

BACKGROUND Sedentary behavior is continuing to emerge as an important target for health promotion. The purpose of this study was to determine the validity of a self-report use of time recall tool, the Multimedia Activity Recall for Children and Adults (MARCA) in estimating time spent sitting/lying, compared with a device-based measure. METHODS Fifty-eight participants (48% female, [mean±standard deviation] 28±7.4 years of age, 23.9±3.05 kg/m2) wore an activPAL device for 24-h and the following day completed the MARCA. Pearson correlation coefficients (r) were used to analyse convergent validity of the adult MARCA compared with activPAL estimates of total sitting/lying time. Agreement was examined using Bland-Altman plots. RESULTS According to activPAL estimates, participants spent 10.4 hr/day [standard deviation (SD)=2.06] sitting or lying down while awake. The correlation between MARCA and activPAL estimates of total sit/lie time was r=0.77 (95% confidence interval = 0.64-0.86; p<0.001). Bland-Altman analyses revealed a mean bias of +0.59 hr/day with moderately wide limits of agreement (-2.35 hours to +3.53 hr/day). CONCLUSIONS This study found a moderate to strong agreement between the adult MARCA and the activPAL, suggesting that the MARCA is an appropriate tool for the measurement of time spent sitting or lying down in an adult population.

The validity of the GENEActiv wrist-worn accelerometer for measuring adult sedentary time in free living

OBJECTIVES Based on self-reported measures, sedentary time has been associated with chronic disease and mortality. This study examined the validity of the wrist-worn GENEactiv accelerometer for measuring sedentary time (i.e. sitting and lying) by posture classification, during waking hours in free living adults. DESIGN Fifty-seven participants (age=18-55 years 52% male) were recruited using convenience sampling from a large metropolitan Australian university. METHODS Participants wore a GENEActiv accelerometer on their non-dominant wrist and an activPAL device attached to their right thigh for 24-h (00:00 to 23:59:59). Pearson's Correlation Coefficient was used to examine the convergent validity of the GENEActiv and the activPAL for estimating total sedentary time during waking hours. Agreement was illustrated using Bland and Altman plots, and intra-individual agreement for posture was assessed with the Kappa statistic. RESULTS Estimates of average total sedentary time over 24-h were 623 (SD 103) min/day from the GENEActiv, and 626 (SD 123) min/day from the activPAL, with an Intraclass Correlation Coefficient of 0.80 (95% confidence intervals 0.68-0.88). Bland and Altman plots showed slight underestimation of mean total sedentary time for GENEActiv relative to activPAL (mean difference: -3.44min/day), with moderate limits of agreement (-144 to 137min/day). Mean Kappa for posture was 0.53 (SD 0.12), indicating moderate agreement for this sample at the individual level. CONCLUSIONS The estimation of sedentary time by posture classification of the wrist-worn GENEActiv accelerometer was comparable to the activPAL. The GENEActiv may provide an alternative, easy to wear device based measure for descriptive estimates of sedentary time in population samples

Past-day recall of sedentary time: Validity of a self-reported measure of sedentary time in a university population

Background Sedentary behaviour is associated with several deleterious health consequences. Although device-based measures of sedentary time are available, they are costly and do not provide a measure of domain specific sedentary time. High quality self-report measures are necessary to accurately capture domain specific sedentary time, and to provide an alternative to devices when cost is an issue. In this study, the Past-day Adults’ Sedentary Time (PAST) questionnaire, previously shown to have acceptable validity and reliability in a sample of breast cancer survivors, was modified for a university sample and validity of the modified questionnaire was examined compared with activPAL. Methods Participants (n = 58, age = 18–55 years, 48% female, 66% students) were recruited from the University of Queensland (students and staff). They answered the PAST questionnaire, which asked about time spent sitting or lying down for work, study, travel, television viewing, leisure-time computer use, reading, eating, socialising and other purposes, during the previous day. Time reported for these questions was summed to provide a measure of total sedentary time. Participants also wore an activPAL device for the full day prior to completing the questionnaire and recorded their wake and sleep times in an activity log. Total waking sedentary time derived from the activPAL was used as the criterion measure. Correlation (Pearson's r) and agreement (Bland–Altman plots) between PAST and activPAL sedentary time were examined. Results Participants were sedentary (activPAL-determined) for approximately 66% of waking hours. The correlation between PAST and activPAL sedentary time for the whole sample was r = 0.50 [95% confidence interval (CI) = 0.28–0.67]; and higher for non-students (r = 0.63, 95% CI = 0.26–0.84) than students (r = 0.46, 95% CI = 0.16–0.68). Bland–Altman plots revealed that the mean difference between the two measures was 19 min although limits of agreement were wide (95% limits of agreement −4.1 to 4.7 h). Discussion The PAST questionnaire provides an acceptable measure of sedentary time in this population, which included students and adults with high workplace sitting. These findings support earlier research that questionnaires employing past-day recall of sedentary time provide a viable alternative to existing sedentary behaviour questionnaires.

The Feeding Practices and Structure Questionnaire (FPSQ-28): A parsimonious version validated for longitudinal use from 2-5 years

Prospective studies and intervention evaluations that examine change over time assume that measurement tools measure the same construct at each occasion. In the area of parent-child feeding practices, longitudinal measurement properties of the questionnaires used are rarely verified. To ascertain that measured change in feeding practices reflects true change rather than change in the assessment, structure, or conceptualisation of the constructs over time, this study examined longitudinal measurement invariance of the Feeding Practices and Structure Questionnaire (FPSQ) subscales (9 constructs; 40 items) across 3 time points. Mothers participating in the NOURISH trial reported their feeding practices when children were aged 2, 3.7, and 5 years (N = 404). Confirmatory Factor Analysis (CFA) within a structural equation modelling framework was used. Comparisons of initial cross-sectional models followed by longitudinal modelling of subscales, resulted in the removal of 12 items, including two redundant or poorly performing subscales. The resulting 28-item FPSQ-28 comprised 7 multi-item subscales: Reward for Behaviour, Reward for Eating, Persuasive Feeding, Overt Restriction, Covert Restriction, Structured Meal Setting and Structured Meal Timing. All subscales showed good fit over 3 time points and each displayed at least partial scalar (thresholds equal) longitudinal measurement invariance. We recommend the use of a separate single item indicator to assess the family meal setting. This is the first study to examine longitudinal measurement invariance in a feeding practices questionnaire. Invariance was established, indicating that the subscales of the shortened FPSQ-28 can be used with mothers to validly assess change in 7 feeding constructs in samples of children aged 2-5 years of age.