Brief DISCERN, six questions for the evaluation of evidence-based content of health-related websites.

OBJECTIVE: To extract and to validate a brief version of the DISCERN which could identify mental health-related websites with good content quality. METHOD: The present study is based on the analysis of data issued from six previous studies which used DISCERN and a standardized tool for the evaluation of content quality (evidence-based health information) of 388 mental health-related websites. After extracting the Brief DISCERN, several psychometric properties (content validity through a Factor analysis, internal consistency by the Cronbach's alpha index, predictive validity through the diagnostic tests, concurrent validity by the strength of association between the Brief DISCERN and the original DISCERN scores) were investigated to ascertain its general applicability. RESULTS: A Brief DISCERN composed of two factors and six items was extracted from the original 16 items version of the DISCERN. Cronbach's alpha coefficients were more than acceptable for the complete questionnaire (alpha=0.74) and for the two distinct domains: treatments information (alpha=0.87) and reliability (alpha=0.83). Sensibility and specificity of the Brief DISCERN cut-off score > or =16 in the detection of good content quality websites were 0.357 and 0.945, respectively. Its predictive positive and negative values were 0.98 and 0.83, respectively. A statistically significant linear correlation was found between the total scores of the Brief DISCERN and those of the original DISCERN (r=0.84 and p<0.0005). CONCLUSION: The Brief DISCERN seems to be a reliable and valid instrument able to discriminate between websites with good and poor content quality. PRACTICE IMPLICATIONS: The Brief DISCERN is a simple tool which could facilitate the identification of good information on the web by patients and general consumers.

Validity and reliability of the Portuguese version of Mandibular Function Impairment Questionnaire

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)

Design and validity of a questionnaire to assess sexuality in pregnant women

Background. A review of validated methods for assessing female sexual dysfunction and a review of male and female sexual dysfunction did not refer to any specific questionnaire for evaluating sexuality during pregnancy. A study was performed at the Obstetrics and Gynecology Department of Botucatu Medical School, São Paulo State University, Brazil to design and validate a pregnancy sexuality questionnaire, the Pregnancy Sexual Response Inventory (PSRI). Methods. Women with a singleton pregnancy between 10 and 35 weeks of gestation were randomly recruited. There were five phases in the development of the PSRI: (1) item selection; (2) item development; (3) determination of internal consistency, reliability and convergence; (4) content validity; and (5) determination of inter-interviewer reliability. Internal consistency and reliability were evaluated using Cronbach's alpha. Inter-interviewer reliability was assessed by evaluating the responses of 18 academics at various institutions, using Kappa Index and Student t test. Results. Good internal consistency and reliability were obtained (Cronbach's alpha coefficient = 0.79). Among the 18 academics, 13 totally agreed (K = 1.0), three partially agreed (K = 0.67) and two disagreed (K = 0.33) with the proposed questions. Comparisons of the mean PSRI domain scores made between the primary investigators and the other interviewers showed no significant differences in all domains (p > 0.05). Conclusion. PSRI is a new validated instrument for evaluating sexuality and sexual activity and related health concerns during pregnancy. © 2009 Rudge et al; licensee BioMed Central Ltd.

Reliability and validity of spirituality questionnaire by Parsian and Dunning in the Spanish version

The aim of this methodological study was to translate, culturally adapt and assess the internal consistency and validity of the Spanish version of the "Spirituality Questionnaire". The sample comprised 204 young people between 18 and 25 years of age from two universities in Bogota. Cronbach's Alpha was used for reliability, while groups of experts and young people were used for construct validity. The reliability score of the total instrument was 0.88. The overall index of content validity corresponded to 0.90. Exploratory factor analysis showed that four factors explain 52.60% of the variance. The originally proposed theoretical model was confirmed and, in two dimensions, a different structure was proposed. In conclusion, the instrument "Spirituality Questionnaire" by Parsian and Dunning is reliable and valid in the Spanish version.

Validity evidence and reliability of a Simulated Patient Feedback Instrument

In the training of healthcare professionals, one of the advantages of communication training with simulated patients (SPs) is the SP's ability to provide direct feedback to students after a simulated clinical encounter. The quality of SP feedback must be monitored, especially because it is well known that feedback can have a profound effect on student performance. Due to the current lack of valid and reliable instruments to assess the quality of SP feedback, our study examined the validity and reliability of one potential instrument, the 'modified Quality of Simulated Patient Feedback Form' (mQSF). Methods Content validity of the mQSF was assessed by inviting experts in the area of simulated clinical encounters to rate the importance of the mQSF items. Moreover, generalizability theory was used to examine the reliability of the mQSF. Our data came from videotapes of clinical encounters between six simulated patients and six students and the ensuing feedback from the SPs to the students. Ten faculty members judged the SP feedback according to the items on the mQSF. Three weeks later, this procedure was repeated with the same faculty members and recordings. Results All but two items of the mQSF received importance ratings of > 2.5 on a four-point rating scale. A generalizability coefficient of 0.77 was established with two judges observing one encounter. Conclusions The findings for content validity and reliability with two judges suggest that the mQSF is a valid and reliable instrument to assess the quality of feedback provided by simulated patients.

Item validity of the physical demands from the Dictionary of Occupational Titles for the functional capacity evaluation of clients with chronic back pain

This study assessed the item validity of 15 of the physical demands from the Dictionary of Occupational Titles (DOT), as evaluated in a new approach to functional capacity evaluation (FCE) for clients with chronic back pain, the Gibson Approach to FCE (GAPP FCE). Fifty-two occupational therapists were sent the specifications of the items in the GAPP FCE procedures and were asked to rate the items in terms of item-objective congruence, relevance and difficulty. A response rate of 59.2% was obtained. The majority of the therapists agreed that most of the items were congruent with the objectives based on the definition of the physical demands from the DOT. The items evaluating Balancing and Pushing and Pulling had the lowest item-objective congruence. The evaluation of Balancing and the Lifting, Carrying and Pushing and Pulling of loads greater than light-medium weight (10–16 kg) were not considered significantly relevant. Concerns were raised about the difficulty and safety of the evaluation of Lifting, Carrying and Pushing and Pulling with clients with chronic back pain, particularly if the therapist evaluates the manual handling of medium to heavy loads. These results may have implications for other FCEs, particularly those which are based on the DOT, or when assessing clients with chronic back pain.

Measuring mobility in frail older people: reliability and validity of the Physical Mobility Scale

Objectives: The study was designed to show the validity and reliability of scoring the Physical Mobility Scale (PMS). PMS was developed by physiotherapists working in residential aged care to specifically show resident functional mobility and to provide information regarding each resident's need for supervision or assistance from one or two staff members and equipment during position changes, transfers, mobilising and personal care. Methods: Nineteen physiotherapists of varying backgrounds and experience scored the performances of nine residents of care facilities from video recordings. The performances were compared to scores on two 'gold standard' assessment tools. Four of the physiotherapists repeated the evaluations. Results: The PAIS showed excellent content validity and reliability. Conclusions: The PAIS provides graded performance of physical mobility, including level of dependency on staff and equipment. This is a major advantage over existing functional assessment tools. There is no need for specific training for physiotherapists to use the tool.

Participation in a positive youth development program and multi -problem alternative high school students' transformative goals: An investigation of the theoretical and methodological utility and validity of the Transformative Goal Attainment (TGAS)

There is a growing body of literature that provides evidence for the efficacy of positive youth development programs in general and preliminary empirical support for the efficacy of the Changing Lives Program (CLP) in particular. This dissertation sought to extend previous efforts to develop and preliminarily examine the Transformative Goal Attainment Scale (TGAS) as a measure of participant empowerment in the promotion of positive development. Consistent with recent advances in the use of qualitative research methods, this dissertation sought to further investigate the utility of Relational Data Analysis (RDA) for providing categorizations of qualitative open-ended response data. In particular, a qualitative index of Transformative Goals, TG, was developed to complement the previously developed quantitative index of Transformative Goal Attainment (TGA), and RDA procedures for calculating reliability and content validity were refined. Second, as a Stage I pilot/feasibility study this study preliminarily examined the potentially mediating role of empowerment, as indexed by the TGAS, in the promotion of positive development. ^ Fifty-seven participants took part in this study, forty CLP intervention participants and seventeen control condition participants. All 57 participants were administered the study's measures just prior to and just following the fall 2003 semester. This study thus used a short-term longitudinal quasi-experimental research design with a comparison control group. ^ RDA procedures were refined and applied to the categorization of open-ended response data regarding participants' transformative goals (TG) and future possible selves (PSQ-QE). These analyses revealed relatively strong, indirect evidence for the construct validity of the categories as well as their theoretically meaningful structural organization, thereby providing sufficient support for the utility of RDA procedures in the categorization of qualitative open-ended response data. ^ In addition, transformative goals (TG) and future possible selves (PSQ-QE), and the quantitative index of perceived goal attainment (TGA) were evaluated as potential mediators of positive development by testing their relationships to other indices of positive intervention outcome within a four-step method involving both analysis of variance (ANOVA and RMANOVAs) and regression analysis. Though more limited in scope than the efforts at the development and refinement of the measures of these mediators, the results were also promising. ^

The Reliability and Validity of a Child and Adolescent Participation in Decision Making Questionnaire

Background
There is a growing impetus across the research, policy and practice communities for children and young people to participate in decisions that affect their lives. Furthermore, there is a dearth of general instruments that measure children and young people’s views on their participation in decision making. This paper presents the reliability and validity of the Child and Adolescent Participation in Decision Making Questionnaire (CAP-DMQ) and specifically looks at a population of looked-after children where a lack of participation in decision making is an acute issue.
Methods
The participants were 151 looked after children and adolescents between 10-23 years of age who completed the 10 item CAP-DMQ. Of the participants 113 were in receipt of an advocacy service that had an aim of increasing participation in decision-making with the remaining participants not having received this service.
Results
The results showed that the CAP-DMQ had good reliability (Cronbach’s alpha = .94) and showed promising uni-dimensional construct validity through an exploratory factor analysis. The items in the CAP-DMQ also demonstrated good content validity by overlapping with prominent models of child and adolescent participation (Lundy 2007) and decision making (Halpern 2014). A regression analysis showed that age and gender were not significant predictors of CAP-DMQ scores but receipt of advocacy was a significant predictor of scores (effect size d=.88), thus showing appropriate discriminant criterion validity.
Conclusion
Overall, the CAP-DMQ showed good reliability and validity. Therefore, the measure has excellent promise for theoretical investigation in the area of child and adolescent participation in decision making and equally shows empirical promise for use as a measure in evaluating services which have increasing the participation of children and adolescents in decision making as an intended outcome.

Psychometric Properties Evaluation Of A New Ergonomics-related Job Factors Questionnaire Developed For Nursing Workers.

The objectives of this study were to develop a questionnaire that evaluates the perception of nursing workers to job factors that may contribute to musculoskeletal symptoms, and to evaluate its psychometric properties. Internationally recommended methodology was followed: construction of domains, items and the instrument as a whole, content validity, and pre-test. Psychometric properties were evaluated among 370 nursing workers. Construct validity was analyzed by the factorial analysis, known-groups technique, and convergent validity. Reliability was assessed through internal consistency and stability. Results indicated satisfactory fit indices during confirmatory factor analysis, significant difference (p < 0.01) between the responses of nursing and office workers, and moderate correlations between the new questionnaire and Numeric Pain Scale, SF-36 and WRFQ. Cronbach's alpha was close to 0.90 and ICC values ranged from 0.64 to 0.76. Therefore, results indicated that the new questionnaire had good psychometric properties for use in studies involving nursing workers.

[pediatric Patient Classification System: Improvement Of An Instrument].

Improve the content validity of the instrument for classification of pediatric patients and evaluate its construct validity. A descriptive exploratory study in the measurement of the content validity index, and correlational design for construct validation through exploratory factor analysis. The content validity index for indicators was 0.99 and it was 0.97 for graded situations. Three domains were extracted in the construct validation, namely: patient, family and therapeutic procedures, with 74.97% of explained variance. The instrument showed evidences of content and construct validity. The validation of the instrument occurred under the approach of family-centered care, and allowed incorporating some essential needs of childhood such as playing, interaction and affection in the content of the instrument.

[construction Of Measurement Instruments In The Area Of Health].

Measurement instruments are an integral part of clinical practice, health evaluation and research. These instruments are only useful and able to present scientifically robust results when they are developed properly and have appropriate psychometric properties. Despite the significant increase of rating scales, the literature suggests that many of them have not been adequately developed and validated. The scope of this study was to conduct a narrative review on the process of developing new measurement instruments and to present some tools which can be used in some stages of the development process. The steps described were: I-The establishment of a conceptual framework, and the definition of the objectives of the instrument and the population involved; II-Development of the items and of the response scales; III-Selection and organization of the items and structuring of the instrument; IV-Content validity, V-Pre-test. This study also included a brief discussion on the evaluation of the psychometric properties due to their importance for the instruments to be accepted and acknowledged in both scientific and clinical environments.

Escala de autoaceitação para pessoas com cegueira congênita ou precoce : desenvolvimento e investigação psicométrica = Self-acceptance acale for people with congenital or early blindness : development and psychometric analysis

Universidade Estadual de Campinas . Faculdade de Educação Física

Evaluation of biologic occupational risk control practices: Quality indicators development and validation

Background: There is growing demand for the adoption of qualification systems for health care practices. This study is aimed at describing the development and validation of indicators for evaluation of biologic occupational risk control programs. Methods: The study involved 3 stages: (1) setting up a research team, (2) development of indicators, and (3) validation of the indicators by a team of specialists recruited to validate each attribute of the developed indicators. The content validation method was used for the validation, and a psychometric scale was developed for the specialists` assessment. A consensus technique was used, and every attribute that obtained a Content Validity Index of at least 0.75 was approved. Results: Eight indicators were developed for the evaluation of the biologic occupational risk prevention program, with emphasis on accidents caused by sharp instruments and occupational tuberculosis prevention. The indicators included evaluation of the structure, process, and results at the prevention and biologic risk control levels. The majority of indicators achieved a favorable consensus regarding all validated attributes. Conclusion: The developed indicators were considered validated, and the method used for construction and validation proved to be effective.

Adolescent reputation enhancement: Differentiating delinquent, nondelinquent, and at-risk youths

This research reports the findings of two studies conducted to measure and then investigate differences between delinquent, nondelinquent, and at-risk youths' orientations towards reputation enhancement. In the first study, concerning item selection and scale development, the factor structure and content validity of a potential Reputation Enhancement Scale were tested by examining the item responses of the scale completed by 230 high-school students. In the second study, the scale was validated by comparing the item responses of 80 delinquent, 90 at-risk, and 90 nondelinquent adolescents with the responses of the original students. The instrument was found to be reliable (alphas from .64 to .92), indicating that the factors are dependable across different samples, and the coefficients of congruence were sufficiently high to investigate meaningful group differences. Three second-order factors (Conforming Reputation, Nonconforming Reputation, Self-presentation) were derived from the 15 first-order factors. Although multivariate analyses revealed significant differences between the reputational orientations of delinquent, at-risk, and nondelinquent participants, the self-presentation second-order factor did not differentiate the three groups.