72 resultados para reliability and validity
Resumo:
Background and Objective: Estimates of dietary folate intake are currently of considerable interest, but no rapid tools are available to assess dietary intake of folate that are well suited to everyday health promotion activities, We developed and tested the reliability and validity of two prototypes of a rapid dietary assessment tool (a folate intake tool, FIT) to determine dietary intake of folate. Study Design and Setting: Five hundred and sixty eight men and women aged 33-93 years from Perth, Western Australia. Completed one of the two prototypes of the tool and gave a fasting blood sample for measurement of serum folate. A subset (n - 277) of participants completed the same tool on a second occasion 3-6 weeks later. Results: The Pearson correlations (r) between folate score from the tool and serum folate were moderately high for both prototypes (FIT-A r = 0.54-, FIT-B r = 0.49). The folate scores for the two prototypes were similar on repeat testing and correlated strongly (FIT-A r = 0.75; FIT-B r = 0.68). Conclusions: The rapid dietary assessment tool described here, FIT, provides a valid and reliable measurement of dietary intake of folate for both men and women. (c) 2005 Elsevier Inc. All rights reserved.
Resumo:
Background and Objectives: This paper reports on historical changes in assessment culminating in the experience of one discipline with negotiated student feedback that has helped design and modify assessment to cater for the requirements of both students and teachers. The standard of assessment required to pass Obstetrics and Gynaecology in the four year graduate entry program in the School of Medicine at The University of Queensland, Brisbane, Australia has become less formalised and more collaborative. Changes in assessment in this discipline over the last 20 years reflect the development of an understanding of the educational principles associated with adult teaching and learning. Assessment has evolved from being teacher focussed, with questionable reliability, validity, and emphasis on outcomes, to being focussed on learning and the student. Multiplechoice examinations, combined with a collaborative approach to the reliability and validity of questions and answers and a debrief or feedback session have been found to provide an assessment format that is art acceptable measure oflearning for both teachers and students. Changes in assessment reflect a collaborative process between teachers and students based on principles of adult learning and involving negotiated student feedback. Our experience with this form of negotiated outcome for assessment is presented together with suggestions for improvement and is contrasted with assessment methods used in this department over the last 20 years. Change and refinement will continue as medical programs strive to meet the learning needs of students and assessment outcomes that are acceptable to its teachers.
Resumo:
Test-retest reliabilities and practice affects of measures from the Rapid Screen of Concussion (RSC), in addition to the Digit Symbol Substitution Test (Digit Symbol), were examined. Twenty five male participants were tested three times; each testing session scheduled a week apart. The test-retest reliability estimates for most measures were reasonably good, ranging from .79 to .97. An exception was the delayed word recall test, which has had a reliability estimate of .66 for the first retest, and .59 for the second retest. Practice effects were evident from Times 1 to 2 on the sentence comprehension and delayed recall subtests of the RSC, Digit Symbol and a composite score. There was also a practice effect of the same magnitude found from Time 2 to Time 3 on Digit Symbol, delayed recall and the composite score. Statistics on measures for both the first and second retest intervals, with associated practice affects, are presented to enable the calculation of reliable change indices (RCI). The RCI may be used to assess any improvement in cognitive functioning after mild Traumatic Brain Injury.
Resumo:
This paper describes the development and evaluation of a new instrument – the Clinician Suicide Risk Assessment Checklist (CSRAC). The instrument assesses the clinician’s competency in three areas: clinical interviewing, assessment of specific suicide risk factors, and formulating a management plan. A draft checklist was constructed by integrating information from 1) literature review 2) expert clinician focus group and 3) consultation with experts. It was utilised in a simulated clinical scenario with clinician trainees and a trained actor in order to test for inter-rater agreement. Agreement was calculated and the checklist was re-drafted with the aim of maximising agreement. A second phase of simulated clinical scenarios was then conducted and inter-rater agreement was calculated for the revised checklist. In the first phase of the study, 18 of 35 items had inadequate inter-rater agreement (60%>), while in the second phase, using the revised version, only 3 of 39 items failed to achieve adequate inter-rater agreement. Further evidence of reliability and validity are required. Continued development of the CSRAC will be necessary before it can be utilised to assess the effectiveness of risk assessment training programs.
Resumo:
Community-based treatment and care of people with psychiatric disabilities has meant that they are now more likely to engage in the parenting role. This has led to the development of programs designed to enhance the parenting skills of people with psychiatric disabilities. Evaluation of these programs has been hampered by a paucity of evaluation tools. This study's aim was to develop and trial a tool that examined the parent-child interaction within a group setting, was functional and easy to use, required minimum training and equipment, and had acceptable levels of reliability and validity. The revised tool yielded a single scale with acceptable reliability. It had discriminative validity and concurrent validity with non-independent global ratings of parenting. Sensitivity to change was not investigated. The findings suggest that this method of evaluating parenting is likely to have both clinical and research utility and further investigation of the psychometric properties of the tool is warranted.
Resumo:
Grid computing is an emerging technology for providing the high performance computing capability and collaboration mechanism for solving the collaborated and complex problems while using the existing resources. In this paper, a grid computing based framework is proposed for the probabilistic based power system reliability and security analysis. The suggested name of this computing grid is Reliability and Security Grid (RSA-Grid). Then the architecture of this grid is presented. A prototype system has been built for further development of grid-based services for power systems reliability and security assessment based on probabilistic techniques, which require high performance computing and large amount of memory. Preliminary results based on prototype of this grid show that RSA-Grid can provide the comprehensive assessment results for real power systems efficiently and economically.
Resumo:
Background: The Perceived Need for Care Questionnaire (PNCQ) was designed for the Australian National Survey of Mental Health and Wellbeing. The PNCQ complemented collection of data on diagnosis and disability with the survey participants' perceptions of their needs for mental health care and the meeting of those needs. The four-stage design of the PNCQ mimics a conversational exploration of the topic of perceived needs. Five categories of perceived need are each assigned to one of four levels of perceived need (no need, unmet need, partially met need and met need). For unmet need and partially met need, information on barriers to care is collected, Methods: Inter-rater reliabilities of perceived needs assessed by the PNCQ were examined in a study of 145 anxiety clinic attenders. Construct validity of these items was tested, using a multi-trait multi-method approach and hypotheses regarding extreme groups, in a study with a sample of 51 general practice and community psychiatric service patients. Results: The instrument is brief to administer and has proved feasible for use in various settings. Inter-rater reliabilities for major categories, measured by the kappa statistic, exceeded 0.60 in most cases; for the summary category of all perceived needs, inter-rater reliability was 0.62. The multi-trait multi-method approach lent support to the construct validity of the instrument, as did findings in extreme groups. Conclusions: The PNCQ shows acceptable feasibility, reliability and validity, adding to the range of assessment tools available for epidemiological and health services research.
Resumo:
Telemedicine promises to revolutionize medical care delivery in rural and remote areas. The ability to accurately evaluate physical impairment via the Internet is important to the possible future provision of Internet-based physiotherapy. This study evaluated the reliability and validity of assessing knee range of motion via the Internet. Two therapists evaluated knee angle on a single subject via two methods of assessment: the Internet and the traditional method (face-to-face). Nine random positions of the knee were chosen with the principal examiner performing 20 face-to-face and two sets of 20 Internet measures in each position (n=540). The secondary therapist performed Internet assessments only. The Internet connection was established at a readily available speed of 17 kbit/s. The Internet-based goniometer was found to be a valid tool for measuring both knee flexion and extension angles. It was shown to possess both high intra and inter-rater reliability. Difference average plots of the scores verified the consistency of measurement between both modes of assessment. The successful evaluation of the physical outcome measure of knee range of motion via the Internet assists the further development of Internet-based physiotherapy applications. (C) 2003 Elsevier Science Ltd. All rights reserved.