Content validity and reliability of test of gross motor development in Chilean children

ABSTRACT OBJECTIVE To validate a Spanish version of the Test of Gross Motor Development (TGMD-2) for the Chilean population. METHODS Descriptive, transversal, non-experimental validity and reliability study. Four translators, three experts and 92 Chilean children, from five to 10 years, students from a primary school in Santiago, Chile, have participated. The Committee of Experts has carried out translation, back-translation and revision processes to determine the translinguistic equivalence and content validity of the test, using the content validity index in 2013. In addition, a pilot implementation was achieved to determine test reliability in Spanish, by using the intraclass correlation coefficient and Bland-Altman method. We evaluated whether the results presented significant differences by replacing the bat with a racket, using T-test. RESULTS We obtained a content validity index higher than 0.80 for language clarity and relevance of the TGMD-2 for children. There were significant differences in the object control subtest when comparing the results with bat and racket. The intraclass correlation coefficient for reliability inter-rater, intra-rater and test-retest reliability was greater than 0.80 in all cases. CONCLUSIONS The TGMD-2 has appropriate content validity to be applied in the Chilean population. The reliability of this test is within the appropriate parameters and its use could be recommended in this population after the establishment of normative data, setting a further precedent for the validation in other Latin American countries.

Content validation of the dimensions constituting non-adherence to treatment of arterial hypertension

The objective of the study was to validate the content of the dimensions that constituted nonadherence to treatment of arterial systemic hypertension. It was a methodological study of content validation. Initially an integrative review was conducted that demonstrated four dimensions of nonadherence: person, disease/treatment, health service, and environment. Definitions of these dimensions were evaluated by 17 professionals, who were specialists in the area, including: nurses, pharmacists and physicians. The Content Validity Index was calculated for each dimension (IVCi) and the set of the dimensions (IVCt), and the binomial test was conducted. The results permitted the validation of the dimensions with an IVCt of 0.88, demonstrating reasonable systematic comprehension of the phenomena of nonadherence.

Pediatric patient classification system: improvement of an instrument

Objective Improve the content validity of the instrument for classification of pediatric patients and evaluate its construct validity. Method A descriptive exploratory study in the measurement of the content validity index, and correlational design for construct validation through exploratory factor analysis. Results The content validity index for indicators was 0.99 and it was 0.97 for graded situations. Three domains were extracted in the construct validation, namely: patient, family and therapeutic procedures, with 74.97% of explained variance. The instrument showed evidences of content and construct validity. Conclusion The validation of the instrument occurred under the approach of family-centered care, and allowed incorporating some essential needs of childhood such as playing, interaction and affection in the content of the instrument.


Development and validating an educational booklet for childbirth companions

Objective The article describes the steps in producing and validating an educational booklet for childbirth companions. Method Methodological study conducted in 2011 consisting of the following steps: situational assessment; establishing brochure content; content selection and referencing; drafting the text; design of illustrations; layout; consultation of specialists; consultation of target audience; amendments; proofreading; evaluation using the Flesch Reading Ease Formula. The topics portrayed the sequence of events involving support from gestation to the postpartum period. Results The concordance rate among companions was greater than or equal to 81.8% for the topics organisation, writing style, presentation and motives. The overall Content Validity Index of the booklet was 0.94. The booklet was classified as easy reading or very easy reading according to the results of the Flesch Reading Ease Formula. Conclusion The presentation and content of the manual were validated for use with the target audience by the specialists and representatives of the target audience.

Instrument for evaluating care given by undergraduate nursing students to people with wounds

OBJECTIVE The aim of this study was to present the process of construction and validation of an instrument for evaluating the care provided to people with wounds, to be used with undergraduate nursing students. METHOD Methodological study, with quantitative approach, using the Delphi technique in two rounds, the first with 30 judges and the second with 18. The analysis was made with Kappa coefficient ≥0.80, and content validity index greater than >0.80, also using the Wilcoxon test for comparison of the indices between the rounds. RESULTS It was found that of the 20 categories of the instrument, 18 presented better scores in the second Delphi round. Scores were greater in the second round in seven of the ten evaluation categories. CONCLUSION Based on the evaluation by the judges, a version of the instrument was defined with adequate indices of agreement and validity, which will be able to help in evaluating care of people with cutaneous injury given by undergraduate nursing students.

Instrument for assessing the quality of mobile emergency pre-hospital care: content validation

OBJECTIVES To validate an instrument to assess quality of mobile emergency pre-hospital care. METHOD A methodological study where 20 professionals gave their opinions on the items of the proposed instrument. The analysis was performed using Kappa test (K) and Content Validity Index (CVI), considering K> 0.80 and CVI ≥ 0.80. RESULTS Three items were excluded from the instrument: Professional Compensation; Job Satisfaction and Services Performed. Items that obtained adequate K and CVI indexes and remained in the instrument were: ambulance conservation status; physical structure; comfort in the ambulance; availability of material resources; user/staff safety; continuous learning; safety demonstrated by the team; access; welcoming; humanization; response time; costumer privacy; guidelines on care; relationship between professionals and costumers; opportunity for costumers to make complaints and multiprofessional conjunction/actuation. CONCLUSION The instrument to assess quality of care has been validated and may contribute to the evaluation of pre-hospital care in mobile emergency services.

Cross-cultural adaptation of the Caregiver Reaction Assessment for use in Brazil with informal caregivers of the elderly

This study aimed to carry out the cross-cultural adaptation of the Caregiver Reaction Assessment CRA for use in Brazil with informal caregivers of dependent elderly METHOD A methodological study, of five steps: initial translation, synthesis of translations, retro-translation, evaluation by a judge committee and a pre-test, with 30 informal caregivers of older persons in Fortaleza, Brazil. Content validity was assessed by five experts in gerontology and geriatrics. The cross-cultural adaptation was rigorously conducted, allowing for inferring credibility. RESULTS The Brazilian version of the CRA had a simple and fast application (ten minutes), easily understood by the target audience. It is semantically, idiomatically, experimentally and conceptually equivalent to the original version, with valid content to assess the burden of informal caregivers for the elderly (Content Validity Index = 0.883). CONCLUSION It is necessary that other psychometric properties of validity and reliability are tested before using in care practice and research.

Adherence to best care practices in normal birth: construction and validation of an instrument

Abstract OBJECTIVE To describe the stages of construction and validation of an instrument in order to analyze the adherence to best care practices during labour and birth. METHOD Methodological research, carried out in three steps: construction of dimensions and items, face and content validity and semantic analysis of the items. RESULTS The face and content validity was carried out by 10 judges working in healthcare, teaching and research. Items with Content Validity Index (CVI) ≥ 0.9 were kept in full or undergone revisions as suggested by the judges. Semantic analysis, performed twice, indicated that there was no difficulty in understanding the items. CONCLUSION The instrument with three dimensions (organization of healthcare network to pregnancy and childbirth, evidence-based practices and work processes) followed the steps recommended in the literature, concluded with 50 items and total CVI of 0.98.

Development and validation of an instrument for evaluating the ludicity of games in health education

Abstract OBJECTIVE Developing and validating an instrument to evaluate the playfulness of games in health education contexts. METHODOLOGY A methodological, exploratory and descriptive research, developed in two stages: 1. Application of an open questionnaire to 50 graduate students, with content analysis of the answers and calculation of Kappa coefficient for defining items; 2. Procedures for construction of scales, with content validation by judges and analysis of the consensus estimate byContent Validity Index(CVI). RESULTS 53 items regarding the restless character of the games in the dimensions of playfulness, the formative components of learning and the profiles of the players. CONCLUSION Ludicity can be assessed by validated items related to the degree of involvement, immersion and reinvention of the subjects in the game along with the dynamics and playability of the game.

Reliability and convergent validity of the Childhood Anxiety Sensitivity Index in children and adolescents

OBJECTIVE: The purpose of this study was to examine the reliability and the convergent validity of the Children Anxiety Sensitivity Index (CASI) with DSM-IV anxiety disorder symptoms, by comparison with the Screen for Child Anxiety Related Emotional Disorders (SCARED), in a community sample of Brazilian children and adolescents. METHODS: Children and adolescents from five schools were selected from a larger study that aimed to assess different aspects of childhood anxiety disorders. All participants completed the CASI and the SCARED. RESULTS: This study supported the reliability of the CASI total score. Girls reported higher total anxiety sensitivity scores than boys and there were no differences in total anxiety sensitivity scores between children and adolescents. This study showed moderate to high correlations between the CASI scores with SCARED scores, all correlations coefficients being positive and significant. CONCLUSIONS: Our findings demonstrate an appropriate reliability and evidence of convergent validity in the CASI in a sample of Brazilian children and adolescents.

Validity of the Katz Index to assess activities of daily living by informants in neuropathological studies

Abstract OBJECTIVE To analyze the evidences of construct validity of the Katz Index for the retrospective assessment of activities of daily living (ADL) by informants, to assist neuropathological studies in the elderly. METHOD A cross-sectional study analyzed the functional ability of ADL measure by the Katz Index, of 650 cases randomly selected from the Brazilian Brain Bank of the Ageing Brain Study Group (BBBABSG) database. Sample was divided in two subsamples for the analysis (N=325, each) and then stratified according to cognitive decline assessed by the Clinical Dementia Rating Scale (CDR). Factor analyses with calculations of internal consistency and invariance were performed. RESULTS Factor analysis evidenced a unidimensional instrument with optimal internal consistency, in all subgroups. Goodness of fit indices were obtained after two treatments of covariance, indicating adequacy of the scale for assessing ADL by informants. The scale is invariant to cognitive decline meaning that it can be used for subjects with or without cognitive impairment. CONCLUSION Katz Index is valid for the retrospective assessment of basic ADL by informants, with optimal reliability.

Validity of self-reported weight: a study of urban brazilian adults

In order to evaluate the validity of self-reported weight for use in obesity prevalence surveys, self-reported weight was compared to measured weight for 659 adults living in the Porto Alegre county, RS Brazil in 1986-87, both weights being obtained by a technician in the individual's home on the same visit. The mean difference between self-reported and measured weight was small (-0.06 +/- 3.16 kg; mean +/- standard deviation), and the correlation between reported and measured weight was high (r=0.97). Sixty-two percent of participants reported their weight with an error of < 2 kg, 87% with an error of < 4 kg, and 95% with an error of < 6 kg. Underweight individuals overestimated their weight, while obese individuals underestimated theirs (p<0.05). Men tended to overestimate their weight and women underestimate theirs, this difference between sexes being statistically significant (p=0.04). The overall prevalence of underweight (body mass index < 20) by reported weight was 11%, by measured weight 13%; the overall prevalence of obesity (body mass index > 30) by reported weight was 10%, by measured weight 11%. Thus, the validity of reported weight is acceptable for surveys of the prevalence of ponderosity in similar settings.

Climacteric symptoms and quality of life: validity of women's health questionnaire

OBJECTIVE: To evaluate the reliability and validity of the Portuguese version of the Women's Health Questionnaire. METHODS: In order to evaluate the Women's Health Questionnaire (WHQ), an analytical cross-sectional study was carried out at the women's menopause outpatient clinic of a university hospital in São Paulo, Brazil. There were studied 87 women in perimenopause or menopause, defined as experiencing at least one year's absence of menstrual flow. The following variables were collected: demographic data, clinical variables (Kupperman index and correlate numeric scale) and quality of life indexes (SF-36 and utility). RESULTS: The WHQ proved to be a questionnaire easily translated into Portuguese and well-adjusted to Brazilian women. The internal consistency of the overall WHQ was excellent (Cronbach alpha =0.83; 95% CI: 0.71-0.91). Test-retest reliability was also excellent (intraclass correlation coefficient [ICC]=0.92; 95% IC: 0.86-0.96) and had good absolute agreement (0.84; 95% CI: 0.71-0.92). A satisfactory clinical validity was observed. The construct validity was corroborated by clear associations with others scales. A good index of responsiveness after the intervention was reached. CONCLUSIONS: The Portuguese version of the WHQ is of easy and fast administration and understanding. Its measuring properties were related, allowing its use in the evaluation of Brazilian climacteric women's quality of life for various purposes.

Validity of self-reported hearing loss in adults: performance of three single questions

OBJECTIVE: To estimate the validity of three single questions used to assess self-reported hearing loss as compared to pure-tone audiometry in an adult population. METHODS: A validity study was performed with a random sub-sample of 188 subjects aged 30 to 65 years, drawn from the fourth wave of a population-based cohort study carried out in Salvador, Northeastern Brazil. Data were collected in household visits using questionnaires. Three questions were used to separately assess self-reported hearing loss: Q1, "Do you feel you have a hearing loss?"; Q2, "In general, would you say your hearing is 'excellent,' 'very good,' 'good,' 'fair,' 'poor'?"; Q3, "Currently, do you think you can hear 'the same as before', 'less than before only in the right ear', 'less than before only in the left ear', 'less than before in both ears'?". Measures of accuracy were estimated through seven measures including Youden index. Responses to each question were compared to the results of pure-tone audiometry to estimate accuracy measures. RESULTS: The estimated sensitivity and specificity were 79.6%, 77.4% for Q1; 66.9%, 85.1% for Q2; and 81.5%, 76.4% for Q3, respectively. The Youden index ranged from 51.9% (Q2) to 57.0% (Q1) and 57.9% (Q3). CONCLUSIONS: Each of all three questions provides responses accurate enough to support their use to assess self-reported hearing loss in epidemiological studies with adult populations when pure-tone audiometry is not feasible.

Validity and reliability of a health care service evaluation instrument for tuberculosis

OBJECTIVE To evaluate the validity and reliability of an instrument that evaluates the structure of primary health care units for the treatment of tuberculosis.METHODS This cross-sectional study used simple random sampling and evaluated 1,037 health care professionals from five Brazilian municipalities (Natal, state of Rio Grande do Norte; Cabedelo, state of Paraíba; Foz do Iguaçu, state of Parana; Sao José do Rio Preto, state of Sao Paulo, and Uberaba, state of Minas Gerais) in 2011. Structural indicators were identified and validated, considering different methods of organization of the health care system in the municipalities of different population sizes. Each structure represented the organization of health care services and contained the resources available for the execution of health care services: physical resources (equipment, consumables, and facilities); human resources (number and qualification); and resources for maintenance of the existing infrastructure and technology (deemed as the organization of health care services). The statistical analyses used in the validation process included reliability analysis, exploratory factor analysis, and confirmatory factor analysis.RESULTS The validation process indicated the retention of five factors, with 85.9% of the total variance explained, internal consistency between 0.6460 and 0.7802, and quality of fit of the confirmatory factor analysis of 0.995 using the goodness-of-fit index. The retained factors comprised five structural indicators: professionals involved in the care of tuberculosis patients, training, access to recording instruments, availability of supplies, and coordination of health care services with other levels of care. Availability of supplies had the best performance and the lowest coefficient of variation among the services evaluated. The indicators of assessment of human resources and coordination with other levels of care had satisfactory performance, but the latter showed the highest coefficient of variation. The performance of the indicators “training” and “access to recording instruments” was inferior to that of other indicators.CONCLUSIONS The instrument showed feasibility of application and potential to assess the structure of primary health care units for the treatment of tuberculosis.