Reliability and criterion-related validity with a smartphone used in timed-up-and-go test

Background The capacity to diagnosys, quantify and evaluate movement beyond the general confines of a clinical environment under effectiveness conditions may alleviate rampant strain on limited, expensive and highly specialized medical resources. An iPhone 4® mounted a three dimensional accelerometer subsystem with highly robust software applications. The present study aimed to evaluate the reliability and concurrent criterion-related validity of the accelerations with an iPhone 4® in an Extended Timed Get Up and Go test. Extended Timed Get Up and Go is a clinical test with that the patient get up from the chair and walking ten meters, turn and coming back to the chair. Methods A repeated measure, cross-sectional, analytical study. Test-retest reliability of the kinematic measurements of the iPhone 4® compared with a standard validated laboratory device. We calculated the Coefficient of Multiple Correlation between the two sensors acceleration signal of each subject, in each sub-stage, in each of the three Extended Timed Get Up and Go test trials. To investigate statistical agreement between the two sensors we used the Bland-Altman method. Results With respect to the analysis of the correlation data in the present work, the Coefficient of Multiple Correlation of the five subjects in their triplicated trials were as follows: in sub-phase Sit to Stand the ranged between r = 0.991 to 0.842; in Gait Go, r = 0.967 to 0.852; in Turn, 0.979 to 0.798; in Gait Come, 0.964 to 0.887; and in Turn to Stand to Sit, 0.992 to 0.877. All the correlations between the sensors were significant (p < 0.001). The Bland-Altman plots obtained showed a solid tendency to stay at close to zero, especially on the y and x-axes, during the five phases of the Extended Timed Get Up and Go test. Conclusions The inertial sensor mounted in the iPhone 4® is sufficiently reliable and accurate to evaluate and identify the kinematic patterns in an Extended Timed Get and Go test. While analysis and interpretation of 3D kinematics data continue to be dauntingly complex, the iPhone 4® makes the task of acquiring the data relatively inexpensive and easy to use.

Social Skills and Psychological Disorders: Converging and Criterion-Related Validity for YSR and IHSA-Del-Prette in Adolescents at Risk

This study evaluated indexes of converging and criterion-related validity for the Social Skills Inventory for Adolescents (IHSA-Del-Prette) and the Youth Self-Report (YSR) in two samples: one referring to clinical service (CLIN), with 28 adolescents (64.3% boys), 11 through 17 years old (M = 13.75; SD = 1.74), and the other referring to a psycho-educational program (PME = 46.2%), mainly composed of boys (91.7%) aged 13 through 17 (M = 15.33; SD = 1.47). Both samples completed the two inventories. Results showed a high incidence of psychological disorders in both samples (between 4% and 79% in the borderline or clinical range on YSR scales) and accentuated deficits in the general and subscale scores of IHSA-Del-Prette, especially on the frequency scale (25% to 58%). The correlations between the instruments in the two groups supported criterion-related and converging validity. Some issues concerning the differences between the samples and about the construct of social competence, underlying these inventories, are discussed. Key words authors:

Criterion-related validity of the short form of the international physical activity questionnaire in adults who are Deaf

Background: To implement appropriate programs for promoting physical activity (PA) in people who are Deaf, it is important to have valid instruments for assessing PA in this population. Objective: The main purpose of this study was to examine the criterion validity of the short form of the International Physical Activity Questionnaire (IPAQ-S) in Deaf adults. Method: This study included 44 adults (18e65 years) of both genders (63.6% were females) who met the inclusion criteria. Objective measures of PAwere collected using accelerometers, which were worn by each participant during one week. After using the accelerometer, the IPAQ-S was applied to assess participants’ physical activity during the last 7 days. Results: There was no significant correlation between the average time spent in moderate to vigorous physical activity (MVPA) as measured by the accelerometer (40.1 6 24.5 min/day) and by the IPAQ-S (41.3 6 57.5 min/day). The IPAQ-S significantly underestimated the time spent in sedentary behavior (7.6 6 2.7 h/day vs. 10.1 6 1.6 h/day). Sedentary behavior and MVPA as measured by the accelerometer and the IPAQ-S showed limited agreement. Conclusions: Our results show some limitations on the use of IPAQ-S for quantifying PA among adults who are Deaf. The IPAQ-S tends to overestimate the MVPA and to underestimate sedentary behavior in adults who are Deaf.

Contextual effects of power differentials: Construct validation and concurrent validity of the Power Differential Scale

Power distance can produce contextual effects that surpass the cultural level of analysis, allowing predicting how the assimilation of these cultural values impacts individuals motivations to attain power positions and behaviors towards authorities. Power distance value can be conceived both at a micro and macro level of analysis. However existing measures used at a cultural level have been the object of several critics, and others applied at the individual level need further study in terms of their psychometric properties. This article presents the main psychometric properties of the Earley and Erez (1997) Power Differential Scale. This scale measures the acceptability of power and status differences both at micro and macro level. Two studies analyse the scale’s construct validity and its factorial invariance across groups of participants (Study 1); and its predictive validity at an individual level (Study 2). The results obtained support the proposed unidimensionality of the scale. Furthermore, it demonstrated predictive power by showing the role of power distance in the prediction of individual motivations to attain power and to respond to power situations using withdrawal or confrontational strategies. Future research is discussed, specifically the impact of power differential construct in individual attitudes and behavior.

The psychometric properties of the Spanish version of the Foot Health Status Questionnaire

Purpose: Clinical studies suggest that foot pain may be problematic in one-third of patients in early disease. The Foot Health Status Questionnaire (FHSQ) was developed and validated to evaluate the effectiveness of conservative (orthoses, taping, stretching) and surgery interventions. Despite this fact, there are few validated instruments that measure foot health status in Spanish. Thus, the primary aim of the current study was to translate and evaluate psychometrically a Spanish version of FHSQ. Methods: A cross-sectional study was designed in a university community-based podiatric clinic located in south of Spain. All participants (n = 107) recruited consecutively completed a Spanish version of FHSQ and EuroQoL Health Questionnaire 5 dimensions, and 29 participants repeated these same measures 48 h later. Data analysis included test–retest reliability, construct and criterion-related validity and factor analyses. Results: Construct validity was appropriate with moderate-to-high corrected item–subscale correlations (α = ≥0.739) for all subscales. Test–retest reliability was satisfactory (ICC > 0.932). Factor analysis revealed four dimensions with 86.6 % of the common variance explained. The confirmatory factor analysis findings demonstrated that the proposed structure was well supported (comparative fit index = 0.92, standardized root mean square = 0.09). The Spanish EuroQoL 5D score negatively correlated with the FHSQ pain (r = −0.445) and positively with general foot health and function (r = 0.261 − 0.579), confirming criterion-related validity. Conclusion: The clinimetric properties of the Spanish version of FHSQ were satisfactory.

Is the clinical Queensland High Risk Foot Form valid or reliable for research?

Background High-risk foot complications such as neuropathy, ischaemia, deformity, infections, ulcers and amputations consume considerable health care resources and typically result from chronic diseases. This study aimed to develop and test the validity and reliability of a Queensland High Risk Foot Form (QHRFF) tool. Methods Phase one involved developing a QHRFF using an existing diabetes high-risk foot tool, literature search, expert panel and several state-wide stakeholder groups. Phase two tested the criterion-related validity along with inter- and intra-rater reliability of the final QHRFF. Three cohorts of patients (n = 94) and four clinicians, representing different levels of expertise, were recruited. Validity was determined by calculating sensitivity, specificity and positive predictive values (PPV). Kappa and intra-class correlation (ICC) statistics were used to establish reliability. Results A QHRFF tool containing 46-items across seven domains was developed and endorsed. The majority of QHRFF items achieved moderate-to-perfect validity (PPV = 0.71 – 1) and reliability (Kappa/ICC = 0.41 – 1). Items with weak validity and/or reliability included those identifying health professionals previously attending the patient, other (non-listed) co-morbidity, previous foot ulcer, foot deformity, optimum offloading and optimum footwear. Conclusions The QHRFF had moderate-to-perfect validity and reliability across the majority of items, particularly identifying individual co-morbidities and foot complications. Items with weak validity or reliability need to be re-defined or removed. Overall, the QHRFF appears to be a valid and reliable tool to assess, collect and measure clinical data pertaining to high-risk foot complications for clinical or research purposes.

Development of the child abuse and neglect reporting self-efficacy questionnaire for nurses

Taiwan nurses are mandated to report known or suspected child abuse and neglect (CAN), and self-efficacy is known to have an important influence on professional behaviors. The aim of this study was to develop and test the CAN reporting self-efficacy (CANRSE) scale as a measure of nurses’ self-efficacy to report CAN. A sample of 496 nurses from Southern Taiwanese hospitals used the CANRSE scale. The psychometric evaluation of the scale included content validity, exploratory and confirmatory factor analyses, convergent validity, as well as Cronbach’s α and test−retest reliability. Satisfactory internal consistency (Cronbach’s α = 0.92) and test−retest reliability were demonstrated. Confirmatory factor analysis supported the proposed models as having acceptable model fit. Exploratory factor analysis and regression analyses showed that the CANRSE scale had good construct validity and criterion-related validity, respectively. Convergent validity was tested using the general self-efficacy scale and was found to be satisfactory (r = 0.53). The results indicate the CANRSE is reliable and valid, and further testing of its predictive validity is recommended. It can be used to examine the influence of professional self-efficacy in recognizing and reporting CAN cases and to evaluate the impact of training programs aimed at improving CAN reporting.

Psychometric properties of the modified RESIDE physical activity questionnaire among low-income overweight women

Objectives This study explored the criterion-related validity and test-retest reliability of the modified RESIDential Environment physical activity questionnaire and whether the instrument's validity varied by body mass index, education, race/ethnicity, or employment status. Design Validation study using baseline data collected for randomized trial of a weight loss intervention. Methods Participants recruited from health departments wore an ActiGraph accelerometer and self-reported non-occupational walking, moderate and vigorous physical activity on the modified RESIDential Environment questionnaire. We assessed validity (n = 152) using Spearman correlation coefficients, and reliability (n = 57) using intraclass correlation coefficients. Results When compared to steps, moderate physical activity, and bouts of moderate/vigorous physical activity measured by accelerometer, these questionnaire measures showed fair evidence for validity: recreational walking (Spearman correlation coefficients 0.23–0.36), total walking (Spearman correlation coefficients 0.24–0.37), and total moderate physical activity (Spearman correlation coefficients 0.18–0.36). Correlations for self-reported walking and moderate physical activity were higher among unemployed participants and women with lower body mass indices. Generally no other variability in the validity of the instrument was found. Evidence for reliability of RESIDential Environment measures of recreational walking, total walking, and total moderate physical activity was substantial (intraclass correlation coefficients 0.56–0.68). Conclusions Evidence for questionnaire validity and reliability varied by activity domain and was strongest for walking measures. The questionnaire may capture physical activity less accurately among women with higher body mass indices and employed participants. Capturing occupational activity, specifically walking at work, may improve questionnaire validity.

Cross-cultural adaptation and validation of the Foot Function Index to Spanish

Background The purpose of this study was to adapt and validate the Foot Function Index to the Spanish (FFI-Sp) following the guidelines of the American Academy of Orthopaedic Surgeons. Methods A cross-sectional study 80 participants with some foot pathology. A statistical analysis was made, including a correlation study with other questionnaires (the Foot Health Status Questionnaire, EuroQol 5-D, Visual Analogue Pain Scale, and the Short Form SF-12 Health Survey). Data analysis included reliability, construct and criterion-related validity and factor analyses. Results The principal components analysis with varimax rotation produced 3 principal factors that explained 80% of the variance. The confirmatory factor analysis showed an acceptable fit with a comparative fit index of 0.78. The FFI-Sp demonstrated excellent internal consistency on the three subscales: pain 0.95; disability 0.96; and activity limitation 0.69, the subscale that scored lowest. The correlation between the FFI-Sp and the other questionnaires was high to moderate. Conclusions The Spanish version of the Foot Function Index (FFI-Sp) is a tool that is a valid and reliable tool with a very good internal consistency for use in the assessment of pain, disability and limitation of the function of the foot, for use both in clinic and research.

The Piper Fatigue Scale-Revised: Translation and psychometric evaluation in Spanish-speaking breast cancer survivors

Background Cancer-related fatigue (CRF) is the most common and distressing symptom reported by breast cancer survivors. The primary aim of this study was to translate and evaluate psychometrically for the first time a Spanish version of the Piper Fatigue Scale-Revised (S-PFS-R). Methods One hundred and eleven women with stage I–IIIA breast cancer who had completed their primary cancer therapy in the previous 6 months with the exception of hormone therapy completed the S-PFS-R, the Profile of Mood States (POMS) Fatigue (POMS-F) and Vigor subscales (POMS-V), and bilateral force handgrip testing. Data analysis included test–retest reliability, construct validity, criterion-related validity, and exploratory factor analyses. Results Test–retest reliability was satisfactory (r > 0.86), and all subscales showed moderate to high construct validity estimates [corrected item-subscale correlations (Pearson r = ≥ 0.65)]. The exploratory factor analysis revealed four dimensions with 75.5 % of the common variance explained. The S-PFS-R total score positively correlated with the POMS-F subscale (r = 0.50–0.78) and negatively with the POMS-V subscale (r = −0.13 to −0.44) confirming criterion-related validity. Negative correlations among force handgrip testing, subscales, and total scores were weak (r = −0.26 to −0.29). Conclusions The Spanish version of PFS-R shows satisfactory psychometric properties in a sample of breast cancer survivors. This is the first study to translate the PFS-R into Spanish and further testing is warranted.

The ASAS criteria for axial spondyloarthritis: Strengths, weaknesses, and proposals for a way forward

Classification criteria should facilitate selection of similar patients for clinical and epidemiologic studies, therapeutic trials, and research on etiopathogenesis to enable comparison of results across studies from different centers. We critically appraise the validity and performance of the Assessment of SpondyloArthritis international Society (ASAS) classification criteria for axial spondyloarthritis (axSpA). It is still debatable whether all patients fulfilling these criteria should be considered as having true axSpA. Patients with radiographically evident disease by the ASAS criteria are not necessarily identical with ankylosing spondylitis (AS) as classified by the modified New York criteria. The complex multi-arm selection design of the ASAS criteria induces considerable heterogeneity among patients so classified, and applying them in settings with a low prevalence of axial spondyloarthritis (SpA) greatly increases the proportion of subjects falsely classified as suffering from axial SpA. One of the unmet needs in non-radiographic form of axial SpA is to have reliable markers that can identify individuals at risk for progression to AS and thereby facilitate early intervention trials designed to prevent such progression. We suggest needed improvements of the ASAS criteria for axSpA, as all criteria sets should be regarded as dynamic concepts open to modifications or updates as our knowledge advances.

Spanish version of the screening Orebro Musculoskeletal Pain Questionnaire: A cross-cultural adaptation and validation

Background Spanish is one of the five most spoken languages in the world. There is currently no published Spanish version of the Örebro Musculoskeletal Pain Questionnaire (OMPQ). The aim of the present study is to describe the process of translating the OMPQ into Spanish and to perform an analysis of reliability, internal structure, internal consistency and concurrent criterion-related validity. Methods Design: Translation and psychometric testing. Procedure: Two independent translators translated the OMPQ into Spanish. From both translations a consensus version was achieved. A backward translation was made to verify and resolve any semantic or conceptual problems. A total of 104 patients (67 men/37 women) with a mean age of 53.48 (±11.63), suffering from chronic musculoskeletal disorders, twice completed a Spanish version of the OMPQ. Statistical analysis was performed to evaluate the reliability, the internal structure, internal consistency and concurrent criterion-related validity with reference to the gold standard questionnaire SF-12v2. Results All variables except “Coping” showed a rate above 0.85 on reliability. The internal structure calculation through exploratory factor analysis indicated that 75.2% of the variance can be explained with six components with an eigenvalue higher than 1 and 52.1% with only three components higher than 10% of variance explained. In the concurrent criterion-related validity, several significant correlations were seen close to 0.6, exceeding that value in the correlation between general health and total value of the OMPQ. Conclusions The Spanish version of the screening questionnaire OMPQ can be used to identify Spanish patients with musculoskeletal pain at risk of developing a chronic disability.

Career Adapt-Abilities Scale—Iran Form: Psychometric properties and relationships with career satisfaction and entrepreneurial intentions

This study examined the psychometric properties of a Persian translation of the Career Adapt-Abilities Scale (CAAS—Iran Form) and its relationships with career satisfaction, business opportunity identification, and entrepreneurial intentions. It was hypothesized that career adaptability relates positively to these three outcomes, even when controlling for demographic and employment characteristics. Data were provided by 204 workers from Iran. Results showed that the overall CAAS score and sub-dimension scores (concern, control, curiosity, and confidence) were highly reliable. Moreover, confirmatory factor analyses indicated that the CAAS—Iran Form measures four distinct dimensions that can be combined into a higher-order career adaptability factor. Findings also demonstrated criterion-related validity of the scale with regard to career satisfaction and entrepreneurial intentions. In contrast, overall career adaptability was not significantly related to opportunity identification, while concern related positively, and control related negatively to opportunity identification. Overall, the CAAS—Iran Form has very good psychometric properties and predicts important career outcomes, suggesting that it can be used for career counseling and future research with Persian-speaking workers.

Psychometric evaluation and experimental validation of the statistics anxiety rating scale.

The Statistics Anxiety Rating Scale (STARS) was adapted into German to examine its psychometric properties (n = 400). Two validation studies (n = 66, n = 96) were conducted to examine its criterion-related validity. The psychometric properties of the questionnaire were very similar to those previously reported for the original English version in various countries and other language versions. Confirmatory factor analysis indicated 2 second-order factors: One was more closely related to anxiety and the other was more closely related to negative attitudes toward statistics. Predictive validity of the STARS was shown both in an experimental exam-like situation in the laboratory and during a real examination situation. Taken together, the findings indicate that statistics anxiety as assessed by the STARS is a useful construct that is more than just an expression of a more general disposition to anxiety.