Distinguishing between task and contextual performance for nurses : development of a job performance scale

Aim. This paper is a report of a development and validation of a new job performance scale based on an established job performance model. Background. Previous measures of nursing quality are atheoretical and fail to incorporate the complete range of behaviours performed. Thus, an up-to-date measure of job performance is required for assessing nursing quality. Methods. Test construction involved systematic generation of test items using focus groups, a literature review, and an expert review of test items. A pilot study was conducted to determine the multidimensional nature of the taxonomy and its psychometric properties. All data were collected in 2005. Findings. The final version of the nursing performance taxonomy included 41 behaviours across eight dimensions of job performance. Results from preliminary psychometric investigations suggest that the nursing performance scale has good internal consistency, good convergent validity and good criterion validity. Conclusion. The findings give preliminary support for a new job performance scale as a reliable and valid tool for assessing nursing quality. However, further research using a larger sample and nurses from a broader geographical region is required to cross-validate the measure. This scale may be used to guide hospital managers regarding the quality of nursing care within units and to guide future research in the area.

Developing a multidimensional scale of customer-oriented deviance (COD)

Although frontline employees' bending of organizational rules and norms for customers is an important phenomenon, marketing scholars to date only broadly describe over-servicing behaviors and provide little distinction among deviant behavioral concepts. Drawing on research on pro-social and pro-customer behaviors and on studies of positive deviance, this paper develops and validates a multi-faceted, multi-dimensional construct term customer-oriented deviance. Results from two samples totaling 616 frontline employees (FLEs) in the retail and hospitality industries demonstrate that customer-oriented deviance is a four-dimensional construct with sound psychometric properties. Evidence from a test of a theoretical model of key antecedents establishes nomological validity with empathy/perspective-taking, risk-taking propensity, role conflict, and job autonomy as key predictors. Results show that the dimensions of customer-oriented deviance are distinct and have significant implications for theory and practice.

The validity and reliability of the Parent Fever Management Scale: A study from Palestine

Background Parental fever phobia and overuse of antipyretics to control fever is increasing. Little is known about childhood fever management among Arab parents. No scales to measure parents’ fever management practices in Palestine are available. Aims The aims of this study were to translate and examine the psychometric properties of the Arabic version of the Parent Fever Management Scale (PFMS). Methods A standard “forward–backward” procedure was used to translate PFMS into Arabic language. It was then validated on a convenience sample of 402 parents between July and October 2012. Descriptive statistics were used, and instrument reliability was assessed for internal consistency using Cronbach's alpha coefficient. Validity was confirmed using convergent and known group validation. Results Applying the recommended scoring method, the median (interquartile range) score of the PFMS was 26 (23-30). Acceptable internal consistency was found (Cronbach’s alpha = 0.733) and the test–retest reliability value was 0.92 (P < 0.001). The chi-squared (χ2) test showed a significant relationship between PFMS groups and frequent daily administration of antipyretic groups (χ2 = 52.86; P < 0.001). The PFMS sensitivity and specificity were 77.67% and 57.75%, respectively. The positive and negative predictive values were 67.89% and 32.11%, respectively. Conclusions The findings of this validation study indicate that the Arabic version of the PFMS is a reliable and valid measure which can be used as a useful tool for health professionals to identify parents’ fever management practices and thus provide targeted education to reduce the unnecessary burden of care they place on themselves when concerned for a febrile child.

Cross cultural adaptation and validation of a Spanish version of the lower limb functional index

Background: The Lower Limb Functional Index (LLFI) is a relatively recently published regional outcome measure. The development article showed the LLFI had robust and valid clinimetric properties with sound psychometric and practical characteristics when compared to the Lower Limb Extremity Scale (LEFS) criterion standard. Objective: The purpose of this study was cross cultural adaptation and validation of the LLFI Spanish-version (LLFI-Sp) in a Spanish population. Methods: A two stage observational study was conducted. The LLFI was initially cross-culturally adapted to Spanish through double forward and single backward translation; then subsequently validated for the psychometric characteristics of validity, internal consistency, reliability, error score and factor structure. Participants (n = 136) with various lower limb conditions of >12 weeks duration completed the LLFI-Sp, Western Ontario and McMaster University Osteoarthritis Index (WOMAC) and the Euroqol Health Questionnaire 5 Dimensions (EQ-5D-3 L). The full sample was employed to determine internal consistency, concurrent criterion validity, construct validity and factor structure; a subgroup (n = 45) determined reliability at seven days concurrently completing a global rating of change scale. Results: The LLFI-Sp demonstrated high but not excessive internal consistency (α = 0.91) and high reliability (ICC = 0.96). The factor structure was one-dimensional which supported the construct validity. Criterion validity with the WOMAC was strong (r = 0.77) and with the EQ-5D-3 L fair and inversely correlated (r = -0.62). The study limitations included the lack of longitudinal data and the determination of responsiveness. Conclusions: The LLFI-Sp supports the findings of the original English version as being a valid lower limb regional outcome measure. It demonstrated similar psychometric properties for internal consistency, validity, reliability, error score and factor structure.

Development and validation of the ankle fracture outcome of rehabilitation measure (A-FORM)

Study Design Delphi panel and cohort study. Objective To develop and refine a condition-specific, patient-reported outcome measure, the Ankle Fracture Outcome of Rehabilitation Measure (A-FORM), and to examine its psychometric properties, including factor structure, reliability, and validity, by assessing item fit with the Rasch model. Background To our knowledge, there is no patient-reported outcome measure specific to ankle fracture with a robust content foundation. Methods A 2-stage research design was implemented. First, a Delphi panel that included patients and health professionals developed the items and refined the item wording. Second, a cohort study (n = 45) with 2 assessment points was conducted to permit preliminary maximum-likelihood exploratory factor analysis and Rasch analysis. Results The Delphi panel reached consensus on 53 potential items that were carried forward to the cohort phase. From the 2 time points, 81 questionnaires were completed and analyzed; 38 potential items were eliminated on account of greater than 10% missing data, factor loadings, and uniqueness. The 15 unidimensional items retained in the scale demonstrated appropriate person and item reliability after (and before) removal of 1 item (anxious about footwear) that had a higher-than-ideal outfit statistic (1.75). The “anxious about footwear” item was retained in the instrument, but only the 14 items with acceptable infit and outfit statistics (range, 0.5–1.5) were included in the summary score. Conclusion This investigation developed and refined the A-FORM (Version 1.0). The A-FORM items demonstrated favorable psychometric properties and are suitable for conversion to a single summary score. Further studies utilizing the A-FORM instrument are warranted. J Orthop Sports Phys Ther 2014;44(7):488–499. Epub 22 May 2014. doi:10.2519/jospt.2014.4980

Cross-cultural adaptation, reliability and validity of the Spanish version of the upper limb functional index

Background The Upper Limb Functional Index (ULFI) is an internationally widely used outcome measure with robust, valid psychometric properties. The purpose of study is to develop and validate a ULFI Spanish-version (ULFI-Sp). Methods A two stage observational study was conducted. The ULFI was cross-culturally adapted to Spanish through double forward and backward translations, the psychometric properties were then validated. Participants (n = 126) with various upper limb conditions of >12 weeks duration completed the ULFI-Sp, QuickDASH and the Euroqol Health Questionnaire 5 Dimensions (EQ-5D-3 L). The full sample determined internal consistency, concurrent criterion validity, construct validity and factor structure; a subgroup (n = 35) determined reliability at seven days. Results The ULFI-Sp demonstrated high internal consistency (α = 0.94) and reliability (r = 0.93). Factor structure was one-dimensional and supported construct validity. Criterion validity with the EQ-5D-3 L was fair and inversely correlated (r = −0.59). The QuickDASH data was unavailable for analysis due to excessive missing responses. Conclusions The ULFI-Sp is a valid upper limb outcome measure with similar psychometric properties to the English language version.

Differential susceptibility to performance degradation across categories of facial emotion - a model confirmation

Patients with a number of psychiatric and neuropathological conditions demonstrate problems in recognising facial expressions of emotion. Research indicating that patients with schizophrenia perform more poorly in the recognition of negative valence facial stimuli than positive valence stimuli has been interpreted as evidence of a negative emotion specific deficit. An alternate explanation rests in the psychometric properties of the stimulus materials. This model suggests that the pattern of impairment observed in schizophrenia may reflect initial discrepancies in task difficulty between stimulus categories, which are not apparent in healthy subjects because of ceiling effects. This hypothesis is tested, by examining the performance of healthy subjects in a facial emotion categorisation task with three levels of stimulus resolution. Results confirm the predictions of the model, showing that performance degrades differentially across emotion categories, with the greatest deterioration to negative valence stimuli. In the light of these results, a possible methodology for detecting emotion specific deficits in clinical samples is discussed.

Factors influencing the provision of end-of-life care in critical care settings : development and testing of a survey instrument

Aim. To develop and psychometrically test a survey instrument to identify the factors influencing the provision of end-of-life care by critical care nurses. Background. Following a decision to withdraw life-sustaining treatment, critical care nurses remain with the patient and their family providing end-of-life care. Identification of factors influencing the provision of this care can give evidence to inform practice development and support nurses. Design. A cross-sectional survey of critical care nurses. Method. An online survey was developed, reviewed by an expert panel and pilot tested to obtain preliminary evidence of its reliability and validity. In May 2011, a convenience sample of critical care nurses (n = 392, response rate 25%) completed the survey. The analytical approach to data obtained from the 58 items measured on a Likert scale included exploratory factor analysis and descriptive statistics. Results. Exploratory factor analysis identified eight factors influencing the provision of end-of-life care: emotional support for nurses, palliative values, patient and family preferences, resources, organizational support, care planning, knowledge and preparedness. Internal consistency of each latent construct was deemed satisfactory. The results of descriptive statistics revealed a strong commitment to the inclusion of families in end-of-life care and the value of this care in the critical care setting. Conclusion. This paper reports preliminary evidence of the psychometric properties of a new survey instrument. The findings may inform practice development opportunities to support critical care nurses in the provision of endof- life care and improve the care that patients and their families receive.

Arabic translation, adaptation and modification of the dialysis symptom index for chronic kidney disease stages four and five

Background Symptom burden in chronic kidney disease (CKD) is poorly understood. To date, the majority of research focuses on single symptoms and there is a lack of suitable multidimensional symptom measures. The purpose of this study was to modify, translate, cross-culturally adapt and psychometrically analyse the Dialysis Symptom Index (DSI). Methods The study methods involved four phases: modification, translation, pilot-testing with a bilingual non-CKD sample and then psychometric testing with the target population. Content validity was assessed using an expert panel. Inter-rater agreement, test-retest reliability and Cronbach’s alpha coefficient were calculated to demonstrate reliability of the modified DSI. Discriminative and convergent validity were assessed to demonstrate construct validity. Results Content validity index during translation was 0.98. In the pilot study with 25 bilingual students a moderate to perfect agreement (Kappa statistic = 0.60-1.00) was found between English and Arabic versions of the modified DSI. The main study recruited 433 patients CKD with stages 4 and 5. The modified DSI was able to discriminate between non-dialysis and dialysis groups (p < 0.001) and demonstrated convergent validity with domains of the Kidney Disease Quality of Life short form. Excellent test-retest and internal consistency (Cronbach’s α = 0.91) reliability were also demonstrated. Conclusion The Arabic version of the modified DSI demonstrated good psychometric properties, measures the multidimensional nature of symptoms and can be used to assess symptom burden at different stages of CKD. The modified instrument, renamed the CKD Symptom Burden Index (CKD-SBI), should encourage greater clinical and research attention to symptom burden in CKD.

Cross-cultural adaptation, reliability and validity of the Turkish version of the spine functional index

Background The Spine Functional Index (SFI) is a patient reported outcome measure with sound clinimetric properties and clinical viability for the determination of whole-spine impairment. To date, no validated Turkish version is available. The purpose of this study is to cross-culturally adapted the SFI for Turkish-speaking patients (SFI-Tk) and determine the psychometric properties of reliability, validity and factor structure in a Turkish population with spine musculoskeletal disorders. Methods The SFI English version was culturally adapted and translated into Turkish using a double forward and backward method according to established guidelines. Patients (n = 285, cervical = l29, lumbar = 151, cervical and lumbar region = 5, 73% female, age 45 ± 1) with spine musculoskeletal disorders completed the SFI-Tk at baseline and after a seven day period for test-retest reliability. For criterion validity the Turkish version of the Functional Rating Index (FRI) was used plus the Neck Disability Index (NDI) for cervical patients and the Oswestry Disability Index (ODI) for back patients. Additional psychometric properties were determined for internal consistency (Chronbach’s α), criterion validity and factor structure. Results There was a high degree of internal consistency (α = 0.85, item range 0.80-0.88) and test-retest reliability (r = 0.93, item range = 0.75-0.95). The factor analysis demonstrated a one-factor solution explaining 24.2% of total variance. Criterion validity with the ODI was high (r = 0.71, p < 0.001) while the FRI and NDI were fair (r = 0.52 and r = 0.58, respectively). The SFI-Tk showed no missing responses with the ‘half-mark’ option used in 11.75% of total responses by 77.9% of participants. Measurement error from SEM and MDC90 were respectively 2.96% and 7.12%. Conclusions The SFI-Tk demonstrated a one-factor solution and is a reliable and valid instrument. The SFI-Tk consists of simple and easily understood wording and may be used to assess spine region musculoskeletal disorders in Turkish speaking patients.

Confirmatory factory analysis of the Neck Disability Index in a general problematic neck population indicates a one-factor model

BACKGROUND CONTEXT: The Neck Disability Index frequently is used to measure outcomes of the neck. The statistical rigor of the Neck Disability Index has been assessed with conflicting outcomes. To date, Confirmatory Factor Analysis of the Neck Disability Index has not been reported for a suitably large population study. Because the Neck Disability Index is not a condition-specific measure of neck function, initial Confirmatory Factor Analysis should consider problematic neck patients as a homogenous group. PURPOSE: We sought to analyze the factor structure of the Neck Disability Index through Confirmatory Factor Analysis in a symptomatic, homogeneous, neck population, with respect to pooled populations and gender subgroups. STUDY DESIGN: This was a secondary analysis of pooled data. PATIENT SAMPLE: A total of 1,278 symptomatic neck patients (67.5% female, median age 41 years), 803 nonspecific and 475 with whiplash-associated disorder. OUTCOME MEASURES: The Neck Disability Index was used to measure outcomes. METHODS: We analyzed pooled baseline data from six independent studies of patients with neck problems who completed Neck Disability Index questionnaires at baseline. The Confirmatory Factor Analysis was considered in three scenarios: the full sample and separate sexes. Models were compared empirically for best fit. RESULTS: Two-factor models have good psychometric properties across both the pooled and sex subgroups. However, according to these analyses, the one-factor solution is preferable from both a statistical perspective and parsimony. The two-factor model was close to significant for the male subgroup (p<.07) where questions separated into constructs of mental function (pain, reading headaches and concentration) and physical function (personal care, lifting, work, driving, sleep, and recreation). CONCLUSIONS: The Neck Disability Index demonstrated a one-factor structure when analyzed by Confirmatory Factor Analysis in a pooled, homogenous sample of neck problem patients. However, a two-factor model did approach significance for male subjects where questions separated into constructs of mental and physical function. Further investigations in different conditions, subgroup and sex-specific populations are warranted.

Validation and reliability of a Spanish version of Simple Shoulder Test (SST-Sp)

Background: The Simple Shoulder Test (SST-Sp) is a widely used outcome measure. Objective: The purpose of this study was to develop and validate a Spanish-version SST (SST-Sp). Methods: A two-stage observational study was conducted. The SST was initially cross-culturally adapted to Spanish through double forward and backward translation and then validated for its psychometric characteristics. Participants (n = 66) with several shoulder disorders completed the SST-Sp, DASH, VAS and SF-12. The full sample was employed to determine factor structure, internal consistency and concurrent criterion validity. Reliability was determined in the first 24–48 h in a subsample of 21 patients. Results: The SST-Sp showed three factors that explained the 56.1 % of variance, and the internal consistency for each factor was α = 0.738, 0.723 and 0.667, and reliability was ICC = 0.687–0.944. The factor structure was three-dimensional and supported construct validity. Criterion validity determined from the relationship between the SST-Sp and DASH was strong (r = −0.73; p < 0.001) and fair for VAS (r = −0.537; p < 0.001). Relationships between SST-Sp and SF-12 were weak for both physical (r = −0.47; p < 0.001) and mental (r = −0.43; p < 0.001) dimensions. Conclusions: The SST-Sp supports the findings of the original English version as being a valid shoulder outcome measure with similar psychometric properties to the original English version.

Validation of a Spanish version of the Spine Functional Index

Background The Spine Functional Index (SFI) is a recently published, robust and clinimetrically valid patient reported outcome measure. Objectives The purpose of this study was the adaptation and validation of a Spanish-version (SFI-Sp) with cultural and linguistic equivalence. Methods A two stage observational study was conducted. The SFI was cross-culturally adapted to Spanish through double forward and backward translation then validated for its psychometric characteristics. Participants (n = 226) with various spine conditions of >12 weeks duration completed the SFI-Sp and a region specific measure: for the back, the Roland Morris Questionnaire (RMQ) and Backache Index (BADIX); for the neck, the Neck Disability Index (NDI); for general health the EQ-5D and SF-12. The full sample was employed to determine internal consistency, concurrent criterion validity by region and health, construct validity and factor structure. A subgroup (n = 51) was used to determine reliability at seven days. Results The SFI-Sp demonstrated high internal consistency (α = 0.85) and reliability (r = 0.96). The factor structure was one-dimensional and supported construct validity. Criterion specific validity for function was high with the RMQ (r = 0.79), moderate with the BADIX (r = 0.59) and low with the NDI (r = 0.46). For general health it was low with the EQ-5D and inversely correlated (r = −0.42) and fair with the Physical and Mental Components of the SF-12 and inversely correlated (r = −0.56 and r = −0.48), respectively. The study limitations included the lack of longitudinal data regarding other psychometric properties, specifically responsiveness. Conclusions The SFI-Sp was demonstrated as a valid and reliable spine-regional outcome measure. The psychometric properties were comparable to and supported those of the English-version, however further longitudinal investigations are required.

Use of objective psychomotor tests in health professionals

Evaluation of psychomotor skills is undertaken in a number of broad contexts. This includes testing of health professional populations as a measure of innate ability, to evaluate skill acquisition, or to compare professions. However, the use of psychomotor tests is frequently confounded by a lack of understanding of a particular tool's psychometric properties, strengths, and weaknesses. To identify and appraise the most commonly used tests on health professional populations, 86 articles were reviewed and the top nine tests identified. Few tests have had sufficient validity or reliability testing on health professionals. Based on the evidence available, use of the Grooved Pegboard Test, the Purdue Pegboard Test, or the Finger Tapping Test is recommended for the evaluation of dexterity in a health professional population; however, this choice may be dependent on the task(s) to which findings are generalised. More rigorous evaluation of validity and other psychometric properties is required.

Evaluation of a skin self examination attitude scale using an item response theory model approach

Introduction The Skin Self-Examination Attitude Scale (SSEAS) is a brief measure that allows for the assessment of attitudes in relation to skin self-examination. This study evaluated the psychometric properties of the SSEAS using Item Response Theory (IRT) methods in a large sample of men ≥ 50 years in Queensland, Australia. Methods A sample of 831 men (420 intervention and 411 control) completed a telephone assessment at the 13-month follow-up of a randomized-controlled trial of a video-based intervention to improve skin self-examination (SSE) behaviour. Descriptive statistics (mean, standard deviation, item–total correlations, and Cronbach’s alpha) were compiled and difficulty parameters were computed with Winsteps using the polytomous Rasch Rating Scale Model (RRSM). An item person (Wright) map of the SSEAS was examined for content coverage and item targeting. Results The SSEAS have good psychometric properties including good internal consistency (Cronbach’s alpha = 0.80), fit with the model and no evidence for differential item functioning (DIF) due to experimental trial grouping was detected. Conclusions The present study confirms the SSEA scale as a brief, useful and reliable tool for assessing attitudes towards skin self-examination in a population of men 50 years or older in Queensland, Australia. The 8-item scale shows unidimensionality, allowing levels of SSE attitude, and the item difficulties, to be ranked on a single continuous scale. In terms of clinical practice, it is very important to assess skin cancer self-examination attitude to identify people who may need a more extensive intervention to allow early detection of skin cancer.