Evaluation of cervial range of motion and isometric nech muscle strngth: reliability and validity

Objective: To examine the test–retest reliability and construct validity of cervical active range of motion and isometric neck muscle strength as measured by the Multi Cervical Rehabilitation Unit (Hanoun Medical Inc., Ontario).
Design: A cross-sectional study.
Setting: Institutional practice.
Subjects: Twenty-one patients with neck pain and 25 healthy volunteers.
Methods: After a trial-run session, active range of motion (AROM) was measured in the subsequent two sessions, with 2–3 days in between. During each session, three measurements were taken for each direction (flexion, extension, lateral flexions and rotations). The measurement of isometric strength was after a 15-minute break following completion of the measurement of AROM. Three measurements were made for each of the six directions (flexion, extension, lateral flexions, protraction and retraction). The software of the Multi Cervical Rehabilitation Unit automatically recorded and calculated the maximum AROM and isometric strength.
Results: There was a good to high level of reliability in the measurement of AROM for both groups of subjects, with intraclass correlation coefficients (ICCs) ranging from 0.81 to 0.96. Results also demonstrated very good to excellent reliability in isometric strength measurement (ICCs ranged from 0.92 to 0.99). Moreover, there was a significant difference in isometric neck muscle strength (p = 0.001) and in AROM (p = 0.034) between the two groups.
Conclusions: The Multi Cervical Rehabilitation Unit was found to be reliable and valid for testing the cervical active range of motion and isometric neck muscle strength for both normal and patient subjects.

Examination of the validity and usefulness of the video suggestibility scale for children

The Video Suggestibility Scale for Children (VSSC) was developed by Scullin and colleagues (Scullin & Ceci, 2000; Scullin & Hembrooke, 1998) as a tool for discriminating between children who have different levels of suggestibility. The scale requires children to view a 5-minute video about a birthday party, and to subsequently participate in an interview consisting of 18 yes/no questions. The VSSC consists of two main subscales; Yield (a measure of children's willingness to respond affirmatively to misleading questions about the video) and Shift (a measure of the children's tendency to change their responses after negative feedback from the interviewer). Preliminary research by Scullin and colleagues suggested that the scale possesses satisfactory internal consistency and that children's scores on the VSSC can predict their performance in another suggestibility paradigm. This thesis presents two studies, which further examine the validity and usefulness of the VSSC in an Australian sample of 3- to-5-year-old children. In Study One, children's performance on the VSSC (N = 77) was compared to their performance using other measures of suggestibility. These measures included children's willingness to assent to a false event as well as the number of false interviewer suggestions and new false details that the children provided in their accounts about an independent true-biased and an independent false (non-experienced) event. An independent samples t-test revealed that those children who assented to the false activity generated higher scores on the Yield measure. This pattern was also observed for the Shift subscale although it was not significant. Hierarchical regression analyses revealed that Yield was a significant predictor of the number of false details reported about the false activity, but not the true-biased activity. There was no significant relationship between the Shift Vlll subscale and any of the dependent variables. Overall this study provided partial support for the construct validity of the VSSC. However, it indicated that children's performance on this scale may not be generalisable across different contexts and interview paradigms, and that the Yield subscale is more generalisable than the Shift subscale. Study Two examined whether various group and individual factors that have previously been shown to relate suggestibility (i.e., age, IQ, memory, socio-economic status, gender, temperament) could predict suggestibility as measured by the VSSC. Two hundred and twenty children were recruited from kindergartens, and were divided into two broad socio-economic categories (based predominantly on income). Hierarchical regression analyses revealed that age, intelligence and memory inversely predicted children's Yield suggestibility. Further, children of low socio-economic backgrounds were more suggestible than children of high socio-economic background, and boys were more suggestible than girls on the Yield measure. Although shyness and other internalised and externalised characteristics were explored, no reliable significant relationships were found with Yield. With regard to the Shift subscale, no reliable relationships were found for any of the independent variables except for SES. Overall, results of Study 2 indicated that the VSSC is a potentially useful measure for discriminating between children's suggestibility on the basis on their individual characteristics, although benefits were observed mainly in relation to the Yield subscale. With reference to the findings of these two studies, the potential contribution of the VSSC for research and applied forensic contexts was discussed.

The quality-of-relationship construct in IT outsourcing

This paper reports on the conceptualization and measurement of an important management controllable factor affecting the success of an information technology outsourcing (ITO) arrangement, namely Quality of Relationship (QoR). Attributes of the construct were identified from an analysis of the literature, and key attributes selected based on interviews with 29 managers in four pairs of client and supplier organizations. Construct validity of the resultant measure is assessed through comparison with qualitative interview data, and through tests of association between our measure and perceived overall ITO success. The results suggest that the ten indicators identified in the paper provide a valid measure of the quality of relationship that can be used by both client and supplier managers, and researchers, in assessing the health of an ITO relationship.

Reliability and validity of a reactive agility test for Australian football

Purpose: The aim of this study was to test the reliability and construct validity of a reactive agility test (RAT), designed for Australian Football (AF).

Methods: Study I tested the reliability of the RAT, with 20 elite junior AF players (17.44 ± 0.55 y) completing the test on two occasions separated by 1 wk. Study II tested its construct validity by comparing the performance of 60 participants (16.60 ± 0.50 y) spread over three aged-matched population groups: 20 athletes participating in a State Under-18 AF league who had represented their state at national competitions (elite), 20 athletes participating in the same league who had not represented their state (subelite), and 20 healthy males who did not play AF (controls).

Results: Test-retest reliability reported a strong correlation (0.91), with no significant difference (P = .22) between the mean results (1.74 ± 0.07 s and 1.76 ± 0.07 s) obtained (split 2+3). Nonparametric tests (Kruskal-Wallis and Mann-Whitney) revealed both AF groups performed significantly faster on all measures than the control group (ranging from P = .001 to .005), with significant differences also reported between the two AF groups (ranging from P = .001 to .046). Stepwise discriminant analyses found total time discriminated between the groups, correctly classifying 75% of the participants.

Conclusions: The RAT used within this study demonstrates evidence of reliability and construct validity. It further suggests the ability of a reactive component within agility test designs to discriminate among athletes of different competition levels, highlighting its importance within training activities.

Competency measurements : testing convergent validity for two measures

Aim.  This paper is a report of a study to investigate whether the Australian National Competency Standards for Registered Nurses demonstrate correlations with the Finnish Nurse Competency Scale. Background.  Competency assessment has become popular as a key regulatory requirement and performance indicator. The term competency, however, does not have a globally accepted definition and this has the potential to create controversy, ambiguity and confusion. Variations in meaning and definitions adopted in workplaces and educational settings will affect the interpretation of research findings and have implications for the nursing profession. Method.  A non-experimental cross-sectional survey design was used with a convenience sample of 116 new graduate nurses in 2005. The second version of the Australian National Competency Standards and the Nurse Competency Scale was used to elicit responses to self-assessed competency in the transitional year (first year as a Registered Nurse). Findings.  Correlational analysis of self-assessed levels of competence revealed a relationship between the Australian National Competency Standards (ANCI) and the Nurse Competency Scale (NCS). The correlational relation between ANCI domains and NCS factors suggests that these scales are indeed used to measure related dimensions. A statistically significant relationship (r = 0·75) was found between the two competency measures. Conclusion.  Although the finding of convergent validity is insufficient to establish construct validity for competency as used in both measures in this study, it is an important step towards this goal. Future studies on relationships between competencies must take into account the validity and reliability of the tools.

Reliability, validity, and responsiveness of the Western Ontario and McMaster Universities osteoarthritis index for elderly patients with a femoral neck fracture

Background: The Western Ontario and McMaster Universities Osteoarthritis Index (WOMAC) has been extensively evaluated in groups of patients with osteoarthritis, yet not in patients with a femoral neck fracture. This study aimed to determine the reliability, construct validity, and responsiveness of the WOMAC compared with the Short Form-12 (SF-12) and the EuroQol 5D (EQ-5D) questionnaires for the assessment of elderly patients with a femoral neck fracture.

Methods: Reliability was tested by assessing the Cronbach alpha. Construct validity was determined with the Pearson correlation coefficient. Change scores were calculated from ten weeks to twelve months of follow-up. Standardized response means and floor and ceiling effects were determined. Analyses were performed to compare the results for patients less than eighty years old with those for patients eighty years of age or older.

Results: The mean WOMAC total score was 89 points before the fracture in the younger patients and increased from 70 points at ten weeks to 81 points at two years postoperatively. In the older age group, these scores were 86, 75, and 78 points. The mean WOMAC pain scores before the fracture and at ten weeks and two years postoperatively were 92, 76, and 87 points, respectively, in the younger age group and 92, 84, and 93 points in the older age group. Function scores were 89, 68, and 79 points for the younger age group and 84, 71, and 73 points for the older age group. The Cronbach alpha for pain, stiffness, function, and the total scale ranged from 0.83 to 0.98 for the younger age group and from 0.79 to 0.97 for the older age group. Construct validity was good, with 82% and 79% of predefined hypotheses confirmed in the younger and older age groups, respectively. Responsiveness was moderate. No floor effects were found. Moderate to large ceiling effects were found for pain and stiffness scales at ten weeks and twelve months in younger patients (18% to 36%) and in the older age group (38% to 53%).

Conclusions: The WOMAC showed good reliability, construct validity, and responsiveness in both age groups of elderly patients with a femoral neck fracture who had been physically and mentally fit before the fracture. The instrument is suitable for use in future clinical studies in these populations.

Validity and reliability of field-based measures for assessing movement skill competency in lifelong physical activities: a systematic review

Background: It has been suggested that young people should develop competence in a variety of ‘lifelong physical activities’ to ensure that they can be active across the lifespan. Objective: The primary aim of this systematic review is to report the methodological properties, validity, reliability, and test duration of field-based measures that assess movement skill competency in lifelong physical activities. A secondary aim was to clearly define those characteristics unique to lifelong physical activities. Data Sources: A search of four electronic databases (Scopus, SPORTDiscus, ProQuest, and PubMed) was conducted between June 2014 and April 2015 with no date restrictions. Study Selection: Studies addressing the validity and/or reliability of lifelong physical activity tests were reviewed. Included articles were required to assess lifelong physical activities using process-oriented measures, as well as report either one type of validity or reliability. Study Appraisal and Synthesis Methods: Assessment criteria for methodological quality were adapted from a checklist used in a previous review of sport skill outcome assessments. Results: Movement skill assessments for eight different lifelong physical activities (badminton, cycling, dance, golf, racquetball, resistance training, swimming, and tennis) in 17 studies were identified for inclusion. Methodological quality, validity, reliability, and test duration (time to assess a single participant), for each article were assessed. Moderate to excellent reliability results were found in 16 of 17 studies, with 71 % reporting inter-rater reliability and 41 % reporting intra-rater reliability. Only four studies in this review reported test–retest reliability. Ten studies reported validity results; content validity was cited in 41 % of these studies. Construct validity was reported in 24 % of studies, while criterion validity was only reported in 12 % of studies. Limitations: Numerous assessments for lifelong physical activities may exist, yet only assessments for eight lifelong physical activities were included in this review. Generalizability of results may be more applicable if more heterogeneous samples are used in future research. Conclusion: Moderate to excellent levels of inter- and intra-rater reliability were reported in the majority of studies. However, future work should look to establish test–retest reliability. Validity was less commonly reported than reliability, and further types of validity other than content validity need to be established in future research. Specifically, predictive validity of ‘lifelong physical activity’ movement skill competency is needed to support the assertion that such activities provide the foundation for a lifetime of activity.

Developing a primary care patient measure of safety (PC PMOS): a modified Delphi process and face validity testing

BACKGROUND: Patients are a valuable source of information about ways to prevent harm in primary care and are in a unique position to provide feedback about the factors that contribute to safety incidents. Unlike in the hospital setting, there are currently no tools that allow the systematic capture of this information from patients. The aim of this study was to develop a quantitative primary care patient measure of safety (PC PMOS). METHODS: A two-stage approach was undertaken to develop questionnaire domains and items. Stage 1 involved a modified Delphi process. An expert panel reached consensus on domains and items based on three sources of information (validated hospital PMOS, previous research conducted by our study team and literature on threats to patient safety). Stage 2 involved testing the face validity of the questionnaire developed during stage 1 with patients and primary care staff using the 'think aloud' method. Following this process, the questionnaire was revised accordingly. RESULTS: The PC PMOS was received positively by both patients and staff during face validity testing. Barriers to completion included the length, relevance and clarity of questions. The final PC PMOS consisted of 50 items across 15 domains. The contributory factors to safety incidents centred on communication, access to care, patient-related factors, organisation and care planning, task performance and information flow. DISCUSSION: This is the first tool specifically designed for primary care settings, which allows patients to provide feedback about factors contributing to potential safety incidents. The PC PMOS provides a way for primary care organisations to learn about safety from the patient perspective and make service improvements with the aim of reducing harm in this setting. Future research will explore the reliability and construct validity of the PC PMOS.

The Gambling Urge Scale : reliability and validity in a clinical population

The aim of this study was to establish reliability and validity of the Gambling Urge Scale (GUS) in a clinical population of problem gamblers. This cohort study was conducted in South Australia between March 2008 and March 2009. Participants were problem gamblers aged ≥18 years (n = 158) who were seeking treatment from a range of gambling help services. Measures included gambling urge, problem gambling screening, gambling behaviour and problems caused by gambling, such as personal health and relationships. The psychometric properties investigated were internal reliability, criterion-related validity, concurrent validity and construct validity. Results showed high internal consistency for GUS (α = 0.93) and significant item-rest correlations ranging from 0.72 to 0.86. For criterion-related validity, a GUS cut score of three correctly classified 81.13% of participants as problem gambling with sensitivity 84.75% and specificity 76.6%. Concurrent validity was significant with a number of gambling-related symptoms and problems including psychological disturbance, work and social functioning and gambling-related cognitions (p < 0.001). An insignificant correlation was found between gambling urge and sensation seeking traits (p = 0.663). When controlling for gender and age the instrument was shown to have significant predictive properties for different levels of gambling severity (p < 0.001). A principal component analysis for the one component showed an overall explained variance of 75.54%. These findings indicate that GUS is a valid and reliable instrument for problem gambling screening, to measure treatment outcomes and may predict relapse in problem gambling.

Validity and reliability of a pictorial instrument for assessing perceived motor competence in Portuguese children

BACKGROUND: It is important to assess young children's perceived Fundamental Movement Skill (FMS) competence in order to examine the role of perceived FMS competence in motivation toward physical activity. Children's perceptions of motor competence may vary according to the culture/country of origin; therefore, it is also important to measure perceptions in different cultural contexts. The purpose was to assess the face validity, internal consistency, test-retest reliability and construct validity of the 12 FMS items in the Pictorial Scale for Perceived Movement Skill Competence for Young Children (PMSC) in a Portuguese sample.

METHODS: Two hundred one Portuguese children (girls, n = 112), 5 to 10 years of age (7.6 ± 1.4), participated. All children completed the PMSC once. Ordinal alpha assessed internal consistency. A random subsamples (n = 47) were reassessed one week later to determine test-retest reliability with Bland-Altman method. Children were asked questions after the second administration to determine face validity. Construct validity was assessed on the whole sample with a Bayesian Structural Equation Modelling (BSEM) approach. The hypothesized theoretical model used the 12 items and two hypothesized factors: object control and locomotor skills.

RESULTS: The majority of children correctly identified the skills and could understand most of the pictures. Test-retest reliability analysis was good, with an agreement ration between 0.99 and 1.02. Ordinal alpha values ranged from acceptable (object control 0.73, locomotor 0.68) to good (all FMS 0.81). The hypothesized BSEM model had an adequate fit.

CONCLUSIONS: The PMSC can be used to investigate perceptions of children's FMS competence. This instrument can also be satisfactorily used among Portuguese children.

Psychometric evaluation of the body change inventory: an assessment instrument for adolescent boys and girls

A new instrument, the Body Change Inventory, was developed to provide an assessment of body change strategies that are used by both adolescent girls and boys. The novel aspect of this instrument is that it evaluates strategies to increase body size and increase muscle size, as well strategies to decrease body size. Independent samples of adolescent girls and boys aged between 11 and 17 years (N=1732) participated in four studies. The revised instrument consisted of three body change scales—Strategies to Decrease Body Size, Strategies to Increase Body Size, and Strategies to Increase Muscle Size. The studies demonstrated content validity, construct validity, internal consistency, and concurrent and discriminant validity for the new scales. The new scales provide a valuable addition in the literature for assessing three global body change strategies among adolescent girls and boys. They are needed in order to examine further the normative development of different kinds of body change strategies and how these may lead to behavioural problems such as disordered eating, exercise dependence, and steroid use.

The development of the nutrition and activity knowledge scale for use with people with an intellectual disability

Background Obesity is an increasing health problem for many Australians, no less so among people with an intellectual disability. Behaviour change aimed at improving nutritional intake and increasing levels of physical activity is a requirement for the reduction of obesity. An essential part of this process is to first ascertain the level of knowledge and beliefs people with an intellectual disability have about these behaviours.

Methods The aim of this study was to develop and psychometrically evaluate a scale to assess levels of nutritional and physical activity knowledge among people with an intellectual disability.

Results Seventy-three people with an intellectual disability completed the interview-rated scale at time 1 and 66 of them completed it again at a 3-week re-test.

Conclusions The scale demonstrated strong factorial construct validity, high internal consistency and good temporal stability. The applications of this scale in future research and in intervention programmes are discussed.

The development and validation of the impact of multiple sclerosis scale and the symptoms of multiple sclerosis scale

Objective

To develop and validate the Impact of Multiple Sclerosis Scale (IMSS) and the Symptoms of Multiple Sclerosis Scale (SMSS) using the Extended Disability Status Scale (EDSS) for construct validity.
Design

Panel design involving test-retest over 4 months.
Setting

A mailed survey.
Participants

Volunteers with a diagnosis of multiple sclerosis (MS) recruited from an MS support service in Australia: 193 people (mean age, 39y) and 150 people participated at time 1 and time 2, respectively.
Interventions

Not applicable.
Main Outcome Measures

Principal components analyses, the Cronbach α, and descriptive statistics for the 2 scales; correlations for construct validity with the EDSS and retest; and confirmatory factor analysis to test the stability of IMSS and SMSS components over time.
Results

The IMSS yielded 5 independent and reliable components; the SMSS yielded 3 components; both component structures were stable over time. These scales showed convergent validity with the EDSS.
Conclusions

The IMSS and SMSS are psychometrically sound scales suitable for clinical and research purposes to assess the symptoms and impact of MS.

The health and well-being of adolescents: a school-based population study of the self-report child health questionnaire

Purpose: To evaluate a new generic measure of adolescent health status, the self-report version of the Child Health Questionnaire (CHQ), and provide population-based data. Furthermore, we aimed to examine the impact of common adolescent illness and health concerns on their health and well-being.

Methods: A stratified, two-stage, random cluster sampling design was used to obtain a cross-sectional sample of subjects through schools. A written questionnaire included the 80-item 12-scale self-report CHQ and items measuring health concerns, illnesses/health conditions, and sociodemographics.

Results: A total of 2361 adolescents participated (response rate of 70%). Reliability was high: Tests of internal consistency and discriminant validity reported 90% of item-scale correlations >.4; all scales had Cronbach alpha coefficients >.7. Adolescents with illnesses/conditions or health concerns reported lower scores and larger differences for content-related scales, supporting content and construct validity. Statistically significant age and gender trends were observed for Mental Health, Self-Esteem, General Health, and Family Cohesion scales. Health status worsened as health concerns increased (X2 linear trend, p = .00) with deterioration in health of 5–20% on all scales for emotional health concerns (40% of sample).

Conclusions: The self-report CHQ is a reliable and seemingly valid measure of health and well-being for adolescent health research, although additional measures may be required where scales have high ceiling values. The significantly lower scores reported by adolescents with illness and/or health concerns lend support to the use of standardized health measures and longitudinal research to further examine the impact of adolescent comorbidities and their causal determinants.

The VISA-A questionnaire: a valid and reliable index of the clinical severity of Achilles tendinoplasty

Background: There is no disease specific, reliable, and valid clinical measure of Achilles tendinopathy. Objective: To develop and test a questionnaire based instrument that would serve as an index of severity of Achilles tendinopathy. Methods: Item generation, item reduction, item scaling, and pretesting were used to develop a questionnaire to assess the severity of Achilles tendinopathy. The final version consisted of eight  questions that measured the domains of pain, function in daily living, and sporting activity. Results range from 0 to 100, where 100 represents the perfect score. Its validity and reliability were then tested in a population of non-surgical patients with Achilles tendinopathy (n = 45), presurgical patients with Achilles tendinopathy (n = 14), and two normal control populations (total n = 87). Results: The VISA-A questionnaire had good test-retest (r = 0.93), intrarater (three tests, r = 0.90), and interrater (r = 0.90) reliability as well as good stability when compared one week apart (r = 0.81). The mean (95% confidence interval) VISA-A score in the non-surgical patients was 64 (59–69), in presurgical patients 44 (28–60), and in control subjects it exceeded 96 (94–99). Thus the VISA-A score was higher in non-surgical than presurgical patients (p = 0.02) and higher in control subjects than in both patient populations (p<0.001). Conclusions: The VISA-A questionnaire is reliable and displayed construct validity when means were compared in patients with a range of severity of Achilles tendinopathy and control subjects. The continuous numerical result of the VISA-A questionnaire has the potential to provide utility in both the clinical setting and research. The test is not designed to be diagnostic. Further studies are needed to determine whether the VISA-A score predicts prognosis.