970 resultados para validity testing
Resumo:
Objectives: To develop and test preliminary reliability and validity of a Self-Efficacy Questionnaire for Chinese Family Caregivers (SEQCFC). Methods: A cross-sectional survey of 196 family caregivers (CGs) of people with dementia (CGs) was conducted to determine the factor structure of a SEQCFC of people with dementia. Following factor analyses, preliminary testing was performed, including internal consistency, 4-week test retest reliability, and construct and convergent validity. Results: Factor analyses with direct oblimin rotation were performed. Eight items were removed and five subscales(selfefficacy for gathering information about treatment, symptoms and health care; obtaining support; responding to behaviour disturbances; managing household, personal and medical care; and managing distress associated with caregiving) were identified. The Cronbach’s alpha coefficients for the whole scale and for each subscale were all over 0.80. The 4-week testretest reliabilities for the whole scale and for each subscale ranged from 0.64 to 0.85. The convergent validity was acceptable. Conclusions: Evidence for the preliminary testing of the SEQCFC was encouraging. A future follow-up study using confirmatory factor analysis with a new sample from different recruitment centres in Shanghai will be conducted. Future psychometric property testings of the questionnaire will be required for CGs from other regions of mainland China.
Resumo:
Accessing vaginal pH is fundamental during gynaecological visit for the detection of abnormal vaginal flora (AVF), but use of pH strips may be time-consuming and difficult to interpret. The aim of this study was to evaluate the VS-SENSE test (Common Sense Ltd, Caesarea, Israel) as a tool for the diagnosis of AVF and its correlation with abnormal pH and bacterial vaginosis (BV). The study population consisted of 45 women with vaginal pH ≥ 4.5 and 45 women with normal pH. Vaginal samples were evaluated by VS-SENSE test, microscopy and microbiologic cultures. Comparing with pH strips results, VS-SENSE test specificity was 97.8% and sensitivity of 91%. All severe cases of BV and aerobic vaginitis (AV) were detected by the test. Only one case with normal pH had an unclear result. Concluding, VS-SENSE test is easy to perform, and it correlates with increased pH, AVF, and the severe cases of BV and AV. Copyright © 2010 Gilbert G. G. Donders et al.
Resumo:
Background. At present, prostate cancer screening (PCS) guidelines require a discussion of risks, benefits, alternatives, and personal values, making decision aids an important tool to help convey information and to help clarify values. Objective: The overall goal of this study is to provide evidence of the reliability and validity of a PCS anxiety measure and the Decisional Conflict Scale (DCS). Methods. Using data from a randomized, controlled PCS decision aid trial that measured PCS anxiety at baseline and DCS at baseline (T0) and at two-weeks (T2), four psychometric properties were assessed: (1) internal consistency reliability, indicated by factor analysis intraclass correlations and Cronbach's α; (2) construct validity, indicated by patterns of Pearson correlations among subscales; (3) discriminant validity, indicated by the measure's ability to discriminate between undecided men and those with a definite screening intention; and (4) factor validity and invariance using confirmatory factor analyses (CFA). Results. The PCS anxiety measure had adequate internal consistency reliability and good construct and discriminant validity. CFAs indicated that the 3-factor model did not have adequate fit. CFAs for a general PCS anxiety measure and a PSA anxiety measure indicated adequate fit. The general PCS anxiety measure was invariant across clinics. The DCS had adequate internal consistency reliability except for the support subscale and had adequate discriminate validity. Good construct validity was found at the private clinic, but was only found for the feeling informed subscale at the public clinic. The traditional DCS did not have adequate fit at T0 or at T2. The alternative DCS had adequate fit at T0 but was not identified at T2. Factor loadings indicated that two subscales, feeling informed and feeling clear about values, were not distinct factors. Conclusions. Our general PCS anxiety measure can be used in PCS decision aid studies. The alternative DCS may be appropriate for men eligible for PCS. Implications: More emphasis needs to be placed on the development of PCS anxiety items relating to testing procedures. We recommend that the two DCS versions be validated in other samples of men eligible for PCS and in other health care decisions that involve uncertainty. ^
Resumo:
Purpose: The aim of this paper was to review the clinical literature on the Resonance frequency analysis (RFA) and Periotest techniques in order to assess the validity and prognostic value of each technique to detect implants at risk for failure. Material and methods: A search was made using the PubMed database to find clinical studies using the RFA and/or Periotest techniques. Results: A limited number of clinical reports were found. No randomized-controlled clinical trials or prospective cohort studies could be found for validity testing of the techniques. Consequently, only a narrative review was prepared to cover general aspects of the techniques, factors influencing measurements and the clinical relevance of the techniques. Conclusions: Factors such as bone density, upper or lower jaw, abutment length and supracrestal implant length seem to influence both RFA and Periotest measurements. Data suggest that high RFA and low Periotest values indicate successfully integrated implants and that low/decreasing RFA and high/increasing Periotest values may be signs of ongoing disintegration and/or marginal bone loss. However, single readings using any of the techniques are of limited clinical value. The prognostic value of the RFA and Periotest techniques in predicting loss of implant stability has yet to be established in prospective clinical studies. To cite this article: Aparicio C, Lang N P, Rangert B. Validity and clinical significance of biomechanical testing of implant/bone interface. Clin. Oral Imp. Res., 17 (Suppl. 2), 2006; 2-7.
Resumo:
A cross-sectional survey was conducted, and the construct validity and reliability of the Brisbane Practice Environment Measure in an Australian sample of registered nurses were examined. Nurses were randomly selected from the database of an Australian nursing organization. The original 33 items of the Brisbane Practice Environment Measure were utilized to inform the psychometric properties using confirmatory factor analysis. The Cronbach's alpha was 0.938 for the total scale and ranged 0.657–0.887 for the subscales. A five-factor structure of the measure was confirmed, χ2 = 944.622, (P < 0.01), χ2/d.f. ratio = 2.845, Tucker Lewis Index 0.929, Root Mean Square Error = 0.061 and Comparative Fit Index = 0.906. The selected 28 items of the measure proved reliable and valid in measuring effects of the practice environment upon Australian nurses. The implications are that regular measurement of the practice environment using these 28 items might assist in the development of strategies which might improve job satisfaction and retention of registered nurses in Australia.
Resumo:
Background Feeding practices are commonly examined as potentially modifiable determinants of children’s eating behaviours and weight status. Although a variety of questionnaires exist to assess different feeding aspects, many lack thorough reliability and validity testing. The Feeding Practices and Structure Questionnaire (FPSQ) is a tool designed to measure early feeding practices related to non-responsive feeding and structure of the meal environment. Face validity, factorial validity, internal reliability and cross-sectional correlations with children’s eating behaviours have been established in mothers with 2-year-old children. The aim of the present study was to further extend the validity of the FPSQ by examining factorial, construct and predictive validity, and stability. Methods Participants were from the NOURISH randomised controlled trial which evaluated an intervention with first-time mothers designed to promote protective feeding practices. Maternal feeding practices (FP) and child eating behaviours were assessed when children were aged 2 years and 3.7 years (n=388). Confirmatory Factor analysis, group differences, predictive relationships, and stability were tested. Results The original 9-factor structure was confirmed when children were aged 3.7±0.3 years. Cronbach’s alpha was above the recommended 0.70 cut-off for all factors except Structured Meal Timing, Over Restriction and Distrust in Appetite which were 0.58, 0.67 and 0.66 respectively. Allocated group differences reflected behaviour consistent with intervention content and all feeding practices were stable across both time points (range of r= 0.45-0.70). There was some evidence for the predictive validity of factors with 2 FP showing expected relationships, 2 FP showing expected and unexpected relationships and 5 FP showing no relationship. Conclusions Reliability and validity was demonstrated for most subscales of the FPSQ. Future validation is warranted with culturally diverse samples and with fathers and other caregivers. The use of additional outcomes to further explore predictive validity is recommended as well as testing construct validity and test-retest reliability of the questionnaire.
Resumo:
Results of neuropsychological examinations depend on valid data. Whereas clinicians previously believed that clinical skill was sufficient to identify non-credible performance by examinees on standard tests, research demonstrates otherwise. Consequently, studies on measures to detect suspect effort in adults have received tremendous attention in the previous twenty years, and incorporation of validity indicators into neuropsychological examinations is now seen as integral. Few studies exist that validate methods appropriate for the measurement of effort in pediatric populations. Of extant studies, most evaluate standalone measures originally developed for use with adults. The present study examined the utility of indices from the California Verbal Learning Test – Children's Version (CVLT-C) as embedded validity indicators in a pediatric sample. Participants were 225 outpatients aged 8 to 16 years old referred for clinical assessment after mild traumatic brain injury (mTBI). Non-credible performance (n = 39) was defined as failure of the Medical Symptom Validity Test (MSVT). Logistic regression demonstrated that only the Recognition Discriminability index was predictive of MSVT failure (OR = 2.88, p < .001). A cutoff of z ≤ -1.0 was associated with sensitivity of 51% and specificity of 91%. In the current study, CVLT-C Recognition Discriminability was useful in the identification of non-credible performance in a sample of relatively high-functioning pediatric outpatients with mTBI. Thus, this index can be added to the short list of embedded validity indicators appropriate for pediatric neuropsychological assessment.
Resumo:
OBJECTIVE The aim of this research project was to obtain an understanding of the barriers to and facilitators of providing palliative care in neonatal nursing. This article reports the first phase of this research: to develop and administer an instrument to measure the attitudes of neonatal nurses to palliative care. METHODS The instrument developed for this research (the Neonatal Palliative Care Attitude Scale) underwent face and content validity testing with an expert panel and was pilot tested to establish temporal stability. It was then administered to a population sample of 1285 neonatal nurses in Australian NICUs, with a response rate of 50% (N 645). Exploratory factor-analysis techniques were conducted to identify scales and subscales of the instrument. RESULTS Data-reduction techniques using principal components analysis were used. Using the criteria of eigenvalues being 1, the items in the Neonatal Palliative Care Attitude Scale extracted 6 factors, which accounted for 48.1% of the variance among the items. By further examining the questions within each factor and the Cronbach’s of items loading on each factor, factors were accepted or rejected. This resulted in acceptance of 3 factors indicating the barriers to and facilitators of palliative care practice. The constructs represented by these factors indicated barriers to and facilitators of palliative care practice relating to (1) the organization in which the nurse practices, (2) the available resources to support a palliative model of care, and (3) the technological imperatives and parental demands. CONCLUSIONS The subscales identified by this analysis identified items that measured both barriers to and facilitators of palliative care practice in neonatal nursing. While establishing preliminary reliability of the instrument by using exploratory factor-analysis techniques, further testing of this instrument with different samples of neonatal nurses is necessary using a confirmatory factor-analysis approach.
Resumo:
This article focuses on mental health assessment of refugees in clinical, educational and administrative-legal settings in order to synthesise research and practice designed to enhance and promote further development of culturally appropriate clinical assessment services during the refugee resettlement process. It specifically surveys research published over the last 25 years into the development, reliability measurement and validity testing of assessment instruments, which have been used with children, adolescents and adults from refugee backgrounds, prior to or following their arrival in a resettlement country, to determine whether the instruments meet established crosscultural standards of conceptual, functional, linguistic, technical and normative equivalence. The findings suggest that, although attempts have been made to develop internally reliable, appropriately normed tests for use with refugees from diverse cultural and linguistic backgrounds, matters of conceptual and linguistic equivalence and test–retest reliability are often overlooked. Implications of these oversights for underreporting refugees' mental health needs are considered. Efforts should also be directed towards development of culturally comparable, valid and reliable measures of refugee children's mental health and of refugee children's and adults' psychoeducational, neuropsychological and applied memory capabilities.
Resumo:
Academic pressure among adolescents is a major risk factor for poor mental health and suicide and other harmful behaviours. While this is a worldwide phenomenon, it appears to be especially pronounced in China and other East Asian countries. Despite a growing body of research into adolescent mental health in recent years, the multiple constructs within the ‘educational stress’ phenomenon have not been clearly articulated in Chinese contexts. Further, the individual, family, school and peer influencing factors for educational stress and its associations with adolescent mental health are not well understood. An in-depth investigation may provide important information for the ongoing educational reform in Mainland China with a special focus on students’ mental health and wellbeing. The primary goal of this study was to examine the relative contribution of educational stress to poor mental health, in comparison to other well-known individual, family, school and peer factors. Another important task was to identify significant risk factors for educational stress. In addition, due to the lack of a culturally suitable instrument for educational stress in this population, a new tool – the Educational Stress Scale for Adolescents (ESSA) was initially developed in this study and tested for reliability and validity. A self-administered questionnaire was used to collect information from convenient samples of secondary school students in Shandong, China. The pilot survey was conducted with 347 students (grades 8 and 11) to test the psychometric properties of the ESSA and other scales or questions in the questionnaire. Based on factor analysis and reliability and validity testing, the 16-item scale (the ESSA) with five factors showed adequate to good internal consistency, 2-week test-retest reliability, and satisfactory concurrent and predictive validity. Its factor structure was further demonstrated in the main survey with a confirmatory factor analysis illustrating a good fit of the proposed model based on a confirmatory factor analysis. The reliabilities of other scales and questions were also adequate to be used in this study. The main survey was subsequently conducted with a sample of 1627 secondary school (grades 7-12) students to examine the influencing factors of educational stress and its associations with mental health outcomes, including depression, happiness and suicidal behaviours. A wide range of individual, family, school and peer factors were found to have a significant association with the total ESSA and subscale scores. Most of the strong factors for academic stress were school or study-related, including rural school location, low school connectedness, perceived poor academic grades and frequent emotional conflicts with teachers and peers. Unexpectedly, family and parental factors, such as parental bonding, family connectedness and conflicts with parents were found to have little or no association with educational stress. Educational stress was the most predictive variable for depression, but was not strongly associated with happiness. It had a strong association with suicide ideation but not with suicide attempts. Among five subscales of the ESSA, ‘Study despondency’ score had the strongest associations with these mental health measures. Surprising, two subscales, ‘Self-expectation’ and ‘Worry about grades’ showed a protective effect on suicidal behaviours. An additional analysis revealed that although academic pressure was the most commonly reported reason for suicidal thinking, the occurrence of problems in peer relationships such as peer teasing and bullying, and romantic problems had a much stronger relationship with actual attempts. This study provides some insights into the nature and health implications of educational stress among Chinese adolescents. Findings in this study suggest that interventions on educational stress should focus on school environment and academic factors. Intervention programs focused on educational stress may have a high impact on the prevalence of common mental disorders such as depression. Efforts to increase perceived happiness however should cover a wider range of individual, family and school factors. The importance of healthy peer relationships should be adequately emphasised in suicide prevention. In addition, the newly developed scale (the ESSA) demonstrates sound psychometric properties and is expected to be used in future research into academic-related stress among secondary school adolescents.
Resumo:
Purpose This paper develops and estimates a model to measure consumer perceptions of trade show effectiveness. Design/methodology/approach Data were collected at three separate B2C trade shows. Study 1 (n=47) involved field interviews with data subjected to qualitative item generation and content analysis. Study 2 data (n=147) were subjected to exploratory factor analysis and item-total correlation to identify a preliminary factor structure for the effectiveness construct and to test for reliability. In Study 3 (n=592), confirmatory factor analysis was undertaken to more rigorously test the factor structure and generalise across industries. Validity testing was also performed. Findings A three-dimensional factor structure for assessing consumer visitors’ perceptions of trade show effectiveness was produced incorporating research, operational, and entertainment components. Research limitations/implications Data were collected in Australia and results may not generalise across cultural boundaries. Practical implications The resulting measurement model may be used as a reliable post-hoc diagnostic tool to identify areas of trade show effectiveness where specific performance improvements are needed. Results indicate that exhibitors and organisers of B2C trade shows should consider effectiveness as a multidimensional phenomenon with entertainment, product / industry research, and the facilitation of purchase decision-making processes and problem resolution being key objectives for consumer attendees. These elements of effectiveness should each be addressed by exhibitors and organisers in planning their displays and events. Originality/value This is the first study to provide an empirically valid model for assessing trade show effectiveness from the consumer visitor’s perspective.
Resumo:
Engineers must have deep and accurate conceptual understanding of their field and Concept inventories (CIs) are one method of assessing conceptual understanding and providing formative feedback. Current CI tests use Multiple Choice Questions (MCQ) to identify misconceptions and have undergone reliability and validity testing to assess conceptual understanding. However, they do not readily provide the diagnostic information about students’ reasoning and therefore do not effectively point to specific actions that can be taken to improve student learning. We piloted the textual component of our diagnostic CI on electrical engineering students using items from the signals and systems CI. We then analysed the textual responses using automated lexical analysis software to test the effectiveness of these types of software and interviewed the students regarding their experience using the textual component. Results from the automated text analysis revealed that students held both incorrect and correct ideas for certain conceptual areas and provided indications of student misconceptions. User feedback also revealed that the inclusion of the textual component is helpful to students in assessing and reflecting on their own understanding.
Resumo:
La douleur est fréquente en milieu de soins intensifs et sa gestion est l'une des missions des infirmières. Son évaluation est une prémisse indispensable à son soulagement. Cependant lorsque le patient est incapable de signaler sa douleur, les infirmières doivent se baser sur des signes externes pour l'évaluer. Les guides de bonne pratique recommandent chez les personnes non communicantes l'usage d'un instrument validé pour la population donnée et basé sur l'observation des comportements. A l'heure actuelle, les instruments d'évaluation de la douleur disponibles ne sont que partiellement adaptés aux personnes cérébrolésées dans la mesure où ces personnes présentent des comportements qui leur sont spécifiques. C'est pourquoi, cette étude vise à identifier, décrire et valider des indicateurs, et des descripteurs, de la douleur chez les personnes cérébrolésées. Un devis d'étude mixte multiphase avec une dominante quantitative a été choisi pour cette étude. Une première phase consistait à identifier des indicateurs et des descripteurs de la douleur chez les personnes cérébrolésées non communicantes aux soins intensifs en combinant trois sources de données : une revue intégrative des écrits, une démarche consultative utilisant la technique du groupe nominal auprès de 18 cliniciens expérimentés (6 médecins et 12 infirmières) et les résultats d'une étude pilote observationnelle réalisée auprès de 10 traumatisés crâniens. Les résultats ont permis d'identifier 6 indicateurs et 47 descripteurs comportementaux, vocaux et physiologiques susceptibles d'être inclus dans un instrument d'évaluation de la douleur destiné aux personnes cérébrolésées non- communicantes aux soins intensifs. Une deuxième phase séquentielle vérifiait les propriétés psychométriques des indicateurs et des descripteurs préalablement identifiés. La validation de contenu a été testée auprès de 10 experts cliniques et 4 experts scientifiques à l'aide d'un questionnaire structuré qui cherchait à évaluer la pertinence et la clarté/compréhensibilité de chaque descripteur. Cette démarche a permis de sélectionner 33 des 47 descripteurs et valider 6 indicateurs. Dans un deuxième temps, les propriétés psychométriques de ces indicateurs et descripteurs ont été étudiés au repos, lors de stimulation non nociceptive et lors d'une stimulation nociceptive (la latéralisation du patient) auprès de 116 personnes cérébrolésées aux soins intensifs hospitalisées dans deux centres hospitaliers universitaires. Les résultats montrent d'importantes variations dans les descripteurs observés lors de stimulation nociceptive probablement dues à l'hétérogénéité des patients au niveau de leur état de conscience. Dix descripteurs ont été éliminés, car leur fréquence lors de la stimulation nociceptive était inférieure à 5% ou leur fiabilité insuffisante. Les descripteurs physiologiques ont tous été supprimés en raison de leur faible variabilité et d'une fiabilité inter juge problématique. Les résultats montrent que la validité concomitante, c'est-à-dire la corrélation entre l'auto- évaluation du patient et les mesures réalisées avec les descripteurs, est satisfaisante lors de stimulation nociceptive {rs=0,527, p=0,003, n=30). Par contre la validité convergente, qui vérifiait l'association entre l'évaluation de la douleur par l'infirmière en charge du patient et les mesures réalisés avec les descripteurs, ainsi que la validité divergente, qui vérifiait si les indicateurs discriminent entre la stimulation nociceptive et le repos, mettent en évidence des résultats variables en fonction de l'état de conscience des patients. Ces résultats soulignent la nécessité d'étudier les descripteurs de la douleur chez des patients cérébrolésés en fonction du niveau de conscience et de considérer l'hétérogénéité de cette population dans la conception d'un instrument d'évaluation de la douleur pour les personnes cérébrolésées non communicantes aux soins intensifs. - Pain is frequent in the intensive care unit (ICU) and its management is a major issue for nurses. The assessment of pain is a prerequisite for appropriate pain management. However, pain assessment is difficult when patients are unable to communicate about their experience and nurses have to base their evaluation on external signs. Clinical practice guidelines highlight the need to use behavioral scales that have been validated for nonverbal patients. Current behavioral pain tools for ICU patients unable to communicate may not be appropriate for nonverbal brain-injured ICU patients, as they demonstrate specific responses to pain. This study aimed to identify, describe and validate pain indicators and descriptors in brain-injured ICU patients. A mixed multiphase method design with a quantitative dominant was chosen for this study. The first phase aimed to identify indicators and descriptors of pain for nonverbal brain- injured ICU patients using data from three sources: an integrative literature review, a consultation using the nominal group technique with 18 experienced clinicians (12 nurses and 6 physicians) and the results of an observational pilot study with 10 traumatic brain injured patients. The results of this first phase identified 6 indicators and 47 behavioral, vocal and physiological descriptors of pain that could be included in a pain assessment tool for this population. The sequential phase two tested the psychometric properties of the list of previously identified indicators and descriptors. Content validity was tested with 10 clinical and 4 scientific experts for pertinence and comprehensibility using a structured questionnaire. This process resulted in 33 descriptors to be selected out of 47 previously identified, and six validated indicators. Then, the psychometric properties of the descriptors and indicators were tested at rest, during non nociceptive stimulation and nociceptive stimulation (turning) in a sample of 116 brain-injured ICLI patients who were hospitalized in two university centers. Results showed important variations in the descriptors observed during the nociceptive stimulation, probably due to the heterogeneity of patients' level of consciousness. Ten descriptors were excluded, as they were observed less than 5% of the time or their reliability was insufficient. All physiologic descriptors were deleted as they showed little variability and inter observer reliability was lacking. Concomitant validity, testing the association between patients' self report of pain and measures performed using the descriptors, was acceptable during nociceptive stimulation (rs=0,527, p=0,003, n=30). However, convergent validity ( testing for an association between the nurses' pain assessment and measures done with descriptors) and divergent validity (testing for the ability of the indicators to discriminate between rest and a nociceptive stimulation) varied according to the level of consciousness These results highlight the need to study pain descriptors in brain-injured patients with different level of consciousness and to take into account the heterogeneity of this population forthe conception of a pain assessment tool for nonverbal brain-injured ICU patients.
Resumo:
BACKGROUND: In Switzerland approximately 8% of infants are born prematurely. Some of them undergo mechanical ventilation including endotracheal suctioning (ETS). ETS is one of the most frequently performed interventions and is linked to stress and pain, but its treatment is controversial. In Switzerland there is a lack of standardisation in pain relief for ETS. AIMS: To test the hypothesis that an intermittent dose of morphine reduces pain during ETS and that subsequent multisensorial stimulation (MSS), as a non pharmacological comforting intervention, helps infants to recover from experienced pain. METHOD: A randomized placebo controlled trial in two tertiary neonatal intensive care units (NICU) with a sample of 30 mechanically ventilated preterm infants was conducted. Pain was measured by three pain assessment tools (Bernese Pain Scale for Neonates, Premature Infant Pain Profile and Visual Analogue Scale) RESULTS: Morphine did not lead to any pain relief from ETS as measured by three pain scales. Nor did the comforting intervention of MSS show any effect. Repeated-measure analysis of variance for the within and between groups comparison showed no statistical significance. CONCLUSIONS: The administration of morphine for pain relief in ventilated preterm neonates during ETS remains questionable and the use of MSS as a comforting intervention after painful stimulus cannot be recommended. The validity testing of the instruments for this patient population should undergo a systematic validation trajectory. Future research should focus on options among non pharmacological interventions for relieving pain during ETS.