Face, content, and construct validity of the EndoViS training system for objective assessment of psychomotor skills of laparoscopic surgeons

Background The aim of this study is to present face, content, and constructs validity of the endoscopic orthogonal video system (EndoViS) training system and determines its efficiency as a training and objective assessment tool of the surgeons’ psychomotor skills. Methods Thirty-five surgeons and medical students participated in this study: 11 medical students, 19 residents, and 5 experts. All participants performed four basic skill tasks using conventional laparoscopic instruments and EndoViS training system. Subsequently, participants filled out a questionnaire regarding the design, realism, overall functionality, and its capabilities to train hand–eye coordination and depth perception, rated on a 5-point Likert scale. Motion data of the instruments were obtained by means of two webcams built into a laparoscopic physical trainer. To identify the surgical instruments in the images, colored markers were placed in each instrument. Thirteen motion-related metrics were used to assess laparoscopic performance of the participants. Statistical analysis of performance was made between novice, intermediate, and expert groups. Internal consistency of all metrics was analyzed with Cronbach’s α test. Results Overall scores about features of the EndoViS system were positives. Participants agreed with the usefulness of tasks and the training capacities of EndoViS system (score >4). Results presented significant differences in the execution of three skill tasks performed by participants. Seven metrics showed construct validity for assessment of performance with high consistency levels. Conclusions EndoViS training system has been successfully validated. Results showed that EndoViS was able to differentiate between participants of varying laparoscopic experience. This simulator is a useful and effective tool to objectively assess laparoscopic psychomotor skills of the surgeons.

A comparison of the Yale-Brown obsessive compulsive scale for "Heavy drinking" with a single item craving measure: Construct validity and clinical utility

The measurement of alcohol craving began with single-item scales. Multifactorial scales developed with the intention to capture more fully the phenomenon of craving. This study examines the construct validity of a multifactorial scale, the Yale-Brown Obsessive Compulsive Scale for heavy drinking (Y-BOCS-hd). The study compares its clinical utility with a single item visual-analogue craving scale. The study includes 212 alcohol dependent subjects (127 males, 75 females) undertaking an outpatient treatment program between 1999-2001. Subjects completed the Y-BOCS-hd and a single item visual-analogue scale, in addition to alcohol consumption and dependence severity measures. The Y-BOCS-hd had strong construct validity. Both the visual-analogue alcohol craving scale and Y-BOCS-hd were weakly associated with pretreatment dependence severity. There was a significant association between pretreatment alcohol consumption and the visual-analogue craving scale. Neither craving measure was able to predict total program abstinence or days abstinent. The relationship between obsessive-compulsive behavior in alcohol dependence and craving remains unclear.

Assessing the construct validity of a measure of learning agility

This study examined the construct validity of the Choices questionnaire that purported to support the theory of Learning Agility. Specifically, Learning Agility attempts to predict an individual's potential performance in new tasks. The construct validity will be measured by examining the convergent/discriminant validity of the Choices Questionnaire against a cognitive ability measure and two personality measures. The Choices Questionnaire did tap a construct that is unique to the cognitive ability and the personality measures, thus suggesting that this measure may have considerable value in personnel selection. This study also examined the relationship of this pew measure to job performance and job promotability. Results of this study found that the Choices Questionnaire predicted job performance and job promotability above and beyond cognitive ability and personality. Data from 107 law enforcement officers, along with two of their co-workers and a supervisor resulted in a correlation of .08 between Learning Agility and cognitive ability. Learning Agility correlated .07 with Learning Goal Orientation and. 17 with Performance Goal Orientation. Correlations with the Big Five Personality factors ranged from −.06 to. 13 with Conscientiousness and Openness to Experience, respectively. Learning Agility correlated .40 with supervisory ratings of job promotability and correlated .3 7 with supervisory ratings of overall job performance. Hierarchical regression analysis found incremental validity for Learning Agility over cognitive ability and the Big Five factors of personality for supervisory ratings of both promotability and overall job performance. A literature review was completed to integrate the Learning Agility construct into a nomological net of personnel selection research. Additionally, practical applications and future research directions are discussed. ^

Reliability, construct and criterion validity of the KIDSCREEN-10 score: a short measure for children and adolescents' well-being and health-related quality of life

Background To assess the criterion and construct validity of the KIDSCREEN-10 well-being and health-related quality of life (HRQoL) score, a short version of the KIDSCREEN-52 and KIDSCREEN-27 instruments. Methods The child self-report and parent report versions of the KIDSCREEN-10 were tested in a sample of 22,830 European children and adolescents aged 8–18 and their parents (n = 16,237). Correlation with the KIDSCREEN-52 and associations with other generic HRQoL measures, physical and mental health, and socioeconomic status were examined. Score differences by age, gender, and country were investigated. Results Correlations between the 10-item KIDSCREEN score and KIDSCREEN-52 scales ranged from r = 0.24 to 0.72 (r = 0.27–0.72) for the self-report version (proxy-report version). Coefficients below r = 0.5 were observed for the KIDSCREEN-52 dimensions Financial Resources and Being Bullied only. Cronbach alpha was 0.82 (0.78), test–retest reliability was ICC = 0.70 (0.67) for the self- (proxy-)report version. Correlations between other children self-completed HRQoL questionnaires and KIDSCREEN-10 ranged from r = 0.43 to r = 0.63 for the KIDSCREEN children self-report and r = 0.22–0.40 for the KIDSCREEN parent proxy report. Known group differences in HRQoL between physically/mentally healthy and ill children were observed in the KIDSCREEN-10 self and proxy scores. Associations with self-reported psychosomatic complaints were r = −0.52 (−0.36) for the KIDSCREEN-10 self-report (proxy-report). Statistically significant differences in KIDSCREEN-10 self and proxy scores were found by socioeconomic status, age, and gender. Conclusions Our results indicate that the KIDSCREEN-10 provides a valid measure of a general HRQoL factor in children and adolescents, but the instrument does not represent well most of the single dimensions of the original KIDSCREEN-52. Test–retest reliability was slightly below a priori defined thresholds.

Contextual effects of power differentials: Construct validation and concurrent validity of the Power Differential Scale

Power distance can produce contextual effects that surpass the cultural level of analysis, allowing predicting how the assimilation of these cultural values impacts individuals motivations to attain power positions and behaviors towards authorities. Power distance value can be conceived both at a micro and macro level of analysis. However existing measures used at a cultural level have been the object of several critics, and others applied at the individual level need further study in terms of their psychometric properties. This article presents the main psychometric properties of the Earley and Erez (1997) Power Differential Scale. This scale measures the acceptability of power and status differences both at micro and macro level. Two studies analyse the scale’s construct validity and its factorial invariance across groups of participants (Study 1); and its predictive validity at an individual level (Study 2). The results obtained support the proposed unidimensionality of the scale. Furthermore, it demonstrated predictive power by showing the role of power distance in the prediction of individual motivations to attain power and to respond to power situations using withdrawal or confrontational strategies. Future research is discussed, specifically the impact of power differential construct in individual attitudes and behavior.

Validity And Reliability Of A Pediatric Patient Classification Instrument.

to assess the construct validity and reliability of the Pediatric Patient Classification Instrument. correlation study developed at a teaching hospital. The classification involved 227 patients, using the pediatric patient classification instrument. The construct validity was assessed through the factor analysis approach and reliability through internal consistency. the Exploratory Factor Analysis identified three constructs with 67.5% of variance explanation and, in the reliability assessment, the following Cronbach's alpha coefficients were found: 0.92 for the instrument as a whole; 0.88 for the Patient domain; 0.81 for the Family domain; 0.44 for the Therapeutic procedures domain. the instrument evidenced its construct validity and reliability, and these analyses indicate the feasibility of the instrument. The validation of the Pediatric Patient Classification Instrument still represents a challenge, due to its relevance for a closer look at pediatric nursing care and management. Further research should be considered to explore its dimensionality and content validity.

Construct and concurrent validation of omni-kayak rating of perceived exertion scale

This study tested the concurrent and construct validity of a newly developed OMNI-Kayak Scale, testing 8 male kayakers who performed a flatwater load-incremented ""shuttle"" test over a 500-m course and 3 estimation-production trials over a 1,000-m course. Velocity, blood lactate concentration, heart rate, and rating of perceived exertion (RPE), using the OMNI-Kayak RPE Scale and the Borg 6-20 Scale were recorded. OMNI-Kayak Scale RPE was highly correlated with velocity, the Borg 6-20 Scale RPE, blood lactate, and heart rate for both load-incremented test (rs=.87-.96), and estimation trials (rs=.75-.90). There were no significant differences among velocities, heart rate and blood lactate concentration between estimation and production trials. The OMNI-Kayak RPE Scale showed concurrent and construct validity in assessing perception of effort in flatwater kayaking and is a valid tool for self-regulation of exercise intensity.

Reliability and validity of the Impact of Event Scale (IES): version for Brazilian burn victims

Aims. The aims of this study were to assess the internal reliability (internal consistency), construct validity, sensitivity and ceiling and floor effects of the Brazilian-Portuguese version of the Impact of Event Scale (IES). Design. Methodological research design. Method. The Brazilian-Portuguese version of the IES was applied to a group of 91 burned patients at three times: the first week after the burn injury (time one), between the fourth and the sixth months (time two) and between the ninth and the 12th months (time three). The internal consistency, construct validity (convergent and dimensionality), sensitivity and ceiling and floor effects were tested. Results. Cronbach`s alpha coefficients showed high internal consistency for the total scale (0 center dot 87) and for the domains intrusive thoughts (0 center dot 87) and avoidance responses (0 center dot 76). During the hospitalisation (time one), the scale showed low and positive correlations with pain measures immediately before (r = 0 center dot 22; p < 0 center dot 05) and immediately after baths and dressings (r = 0 center dot 21; p < 0 center dot 05). After the discharge, we found strong and negative correlations with self-esteem (r = -0 center dot 52; p < 0 center dot 01), strong and positive with depression (r = 0 center dot 63; p < 0 center dot 01) and low and negative with the Bodily pain (r = -0 center dot 24; p < 0 center dot 05), Social functioning (r = -0 center dot 34; p < 0 center dot 01) and Mental health (r = -0 center dot 27; p < 0 center dot 05) domains of the SF-36 at time two. Regarding the sensitivity, no statistically significant differences were observed between mean scale scores according to burned body surface (p = 0 center dot 21). The floor effect was observed in most of the IES items. Conclusion. The adapted version of the scale showed to be reliable and valid to assess postburn reactions on the impact of the event in the group of patients under analysis. Relevance to clinical practice. The Impact of Event Scale can be used in research and clinical practice to assess nursing interventions aimed at decreasing stress during rehabilitation.

Reliability and validity of the Brazilian-Portuguese version of the Burns Specific Pain Anxiety Scale (BSPAS)

Background: Pain and anxiety are a common problem in all recovery phases after a burn. The Burns Specific Pain Anxiety Scale (BSPAS) was proposed to assess anxiety in burn patients related to painful procedures. Objectives: To assess internal consistency, discriminative construct validity, dimensionality and convergent construct validity of the Brazilian-Portuguese version of the Burns Specific Pain Anxiety Scale. Design: In this cross-sectional study, the original version of the BSPAS, adapted into Brazilian Portuguese, was tested for internal consistency (Cronbach`s Alpha), discriminative validity (related to total body surface area burned and sex), dimensionality (through factor analysis), and convergent construct validity (applying the Visual Analogue Scale for pain and State-Anxiety-STAI) in a group of 91 adult burn patients. Results: The adapted version of the BSPAS displayed a moderate and positive correlation with pain assessments: immediately before baths and dressings (r = 0.32; p < 0.001), immediately after baths and dressings (r = 0.31; p < 0.001) and during the relaxation period (r= 0.31; p < 0.001) and with anxiety assessments (r = 0.34; p < 0.001). No statistically significant differences were observed when comparing the mean of the adapted version of the BSPAS scores with sex (p = 0.194) and total body surface area burned (p = 0.162) (discriminative validity). The principal components analysis applied to our sample seems to confirm anxiety as one single domain of the Brazilian-Portuguese version of the BSPAS. Cronbach`s Alpha showed high internal consistency of the adapted version of the scale (0.90). Conclusion: The Brazilian-Portuguese version of the BSPAS 9-items has shown statically acceptable levels of reliability and validity for pain-related anxiety evaluation in burn patients. This scale can be used to assess nursing interventions aimed at decreasing pain and anxiety related to the performance of painful procedures. (c) 2010 Elsevier Ltd. All rights reserved.

Clinical Validity of the Protocol for Multi-Professional Centers for the Determination of Signs and Symptoms of Temporomandibular Disorders. Part II

The aims of this study were to analyze the criterion and construct validity of Part II of the protocol for multi-professional centers for the determination of signs and symptoms of temporomandibular disorders (ProTMDMulti) as a measure of TMD severity. The study was conducted on eight asymptomatic subjects (CG) and 30 subjects with articular TMD (TMDG), according to the Research Diagnostic Criteria for TMD (RDC/TMD). The ProTMDMulti-Part II was validated using the Helkimo Clinical Dysfunction Index (Di). The construct validity was tested using the analysis of the ability of ProTMDMulti-part II to differentiate the CG from the TMDG and to measure the changes that occurred in the TMDG between the period before and after TMD treatment. Correlations between the Di and the ProTMDMulti-Part II scores were calculated using the Spearman test. Inter- and intragroup comparisons were made (p<0.05). There was a statistically significant correlation between the Helkimo Clinical Dysfunction Index (Di) and the severity scores of the ProTMDMulti-Part II. There was a significant difference between TMDG and CG regarding the severity of signs and symptoms. The present study provides statistical evidence of the clinical validity of the ProTMDmulti-Part II as a measure of the severity of TMD symptoms.

Climacteric symptoms and quality of life: validity of women's health questionnaire

OBJECTIVE: To evaluate the reliability and validity of the Portuguese version of the Women's Health Questionnaire. METHODS: In order to evaluate the Women's Health Questionnaire (WHQ), an analytical cross-sectional study was carried out at the women's menopause outpatient clinic of a university hospital in São Paulo, Brazil. There were studied 87 women in perimenopause or menopause, defined as experiencing at least one year's absence of menstrual flow. The following variables were collected: demographic data, clinical variables (Kupperman index and correlate numeric scale) and quality of life indexes (SF-36 and utility). RESULTS: The WHQ proved to be a questionnaire easily translated into Portuguese and well-adjusted to Brazilian women. The internal consistency of the overall WHQ was excellent (Cronbach alpha =0.83; 95% CI: 0.71-0.91). Test-retest reliability was also excellent (intraclass correlation coefficient [ICC]=0.92; 95% IC: 0.86-0.96) and had good absolute agreement (0.84; 95% CI: 0.71-0.92). A satisfactory clinical validity was observed. The construct validity was corroborated by clear associations with others scales. A good index of responsiveness after the intervention was reached. CONCLUSIONS: The Portuguese version of the WHQ is of easy and fast administration and understanding. Its measuring properties were related, allowing its use in the evaluation of Brazilian climacteric women's quality of life for various purposes.

The hospital survey on patient safety culture in Portuguese hospitals: instrument validity and reliability

Purpose – Quantitative instruments to assess patient safety culture have been developed recently and a few review articles have been published. Measuring safety culture enables healthcare managers and staff to improve safety behaviours and outcomes for patients and staff. The study aims to determine the AHRQ Hospital Survey on Patient Safety Culture (HSPSC) Portuguese version's validity and reliability. Design/methodology/approach – A missing-value analysis and item analysis was performed to identify problematic items. Reliability analysis, inter-item correlations and inter-scale correlations were done to check internal consistency, composite scores. Inter-correlations were examined to assess construct validity. A confirmatory factor analysis was performed to investigate the observed data's fit to the dimensional structure proposed in the AHRQ HSPSC Portuguese version. To analyse differences between hospitals concerning composites scores, an ANOVA analysis and multiple comparisons were done. Findings – Eight of 12 dimensions had Cronbach's alphas higher than 0.7. The instrument as a whole achieved a high Cronbach's alpha (0.91). Inter-correlations showed that there is no dimension with redundant items, however dimension 10 increased its internal consistency when one item is removed. Originality/value – This study is the first to evaluate an American patient safety culture survey using Portuguese data. The survey has satisfactory reliability and construct validity.

Cross-cultural validity of the demand-control questionnaire: Swedish and Brazilian workers

OBJECTIVE To evaluate the cross-cultural validity of the Demand-Control Questionnaire, comparing the original Swedish questionnaire with the Brazilian version. METHODS We compared data from 362 Swedish and 399 Brazilian health workers. Confirmatory and exploratory factor analyses were performed to test structural validity, using the robust weighted least squares mean and variance-adjusted (WLSMV) estimator. Construct validity, using hypotheses testing, was evaluated through the inspection of the mean score distribution of the scale dimensions according to sociodemographic and social support at work variables. RESULTS The confirmatory and exploratory factor analyses supported the instrument in three dimensions (for Swedish and Brazilians): psychological demands, skill discretion and decision authority. The best-fit model was achieved by including an error correlation between work fast and work intensely (psychological demands) and removing the item repetitive work (skill discretion). Hypotheses testing showed that workers with university degree had higher scores on skill discretion and decision authority and those with high levels of Social Support at Work had lower scores on psychological demands and higher scores on decision authority. CONCLUSIONS The results supported the equivalent dimensional structures across the two culturally different work contexts. Skill discretion and decision authority formed two distinct dimensions and the item repetitive work should be removed.

Validity and reliability of the Questionnaire for Compliance with Standard Precaution

ABSTRACT OBJECTIVE : To evaluate the validity and reliability of the Questionnaire for Compliance with Standard Precaution for nurses. METHODS : This methodological study was conducted with 121 nurses from health care facilities in Sao Paulo's countryside, who were represented by two high-complexity and by three average-complexity health care facilities. Internal consistency was calculated using Cronbach's alpha and stability was calculated by the intraclass correlation coefficient, through test-retest. Convergent, discriminant, and known-groups construct validity techniques were conducted. RESULTS : The questionnaire was found to be reliable (Cronbach's alpha: 0.80; intraclass correlation coefficient: (0.97) In regards to the convergent and discriminant construct validity, strong correlation was found between compliance to standard precautions, the perception of a safe environment, and the smaller perception of obstacles to follow such precautions (r = 0.614 and r = 0.537, respectively). The nurses who were trained on the standard precautions and worked on the health care facilities of higher complexity were shown to comply more (p = 0.028 and p = 0.006, respectively). CONCLUSIONS : The Brazilian version of the Questionnaire for Compliance with Standard Precaution was shown to be valid and reliable. Further investigation must be conducted with nurse samples that are more representative of the Brazilian reality. The use of the questionnaire may support the creation of educational measures considering the possible gaps that can be identified, focusing on the workers' health and on the patients' safety.

Validity and reliability of a questionnaire on knowledge of cardiovascular risk factors for use in Brazil

Using a sample of patients with coronary artery disease, this methodological study aimed to conduct a cross-cultural adaptation and validation of a questionnaire on knowledge of cardiovascular risk factors (Q-FARCS), lifestyle changes, and treatment adherence for use in Brazil. The questionnaire has three scales: general knowledge of risk factors (RFs); specific knowledge of these RFs; and lifestyle changes achieved. Cross-cultural adaptation included translation, synthesis, back-translation, expert committee review, and pretesting. Face and content validity, reliability, and construct validity were measured. Cronbach’s alpha for the total sample (n = 240) was 0.75. Assessment of psychometric properties revealed adequate face and content validity, and the construct revealed seven components. It was concluded that the Brazilian version of Q-FARCS had adequate reliability and validity for the assessment of knowledge of cardiovascular RFs.