The inter-rater reliability of the Risk Instrument for Screening in the Community

Predicting risk of adverse healthcare outcomes is important to enable targeted delivery of interventions. The Risk Instrument for Screening in the Community (RISC), designed for use by public health nurses (PHNs), measures the one-year risk of hospitalisation, institutionalisation and death in community-dwelling older adults according to a five-point global risk score: from low (score 1,2), medium (3) and high (4,5). We examined the inter-rater reliability (IRR) of the RISC between student PHNs (n=32) and expert raters using six cases (two low, medium and high-risk), scored before and after RISC training. Correlations increased for each adverse outcome, statistically significantly for institutionalisation (r=0.72 to 0.80,p=0.04) and hospitalisation, (r=0.51 to 0.71,p<0.01) but not death. Training improved accuracy for low-risk but not all high-risk cases. Overall, the RISC showed good IRR, which increased after RISC training. That reliability reduced for some high-risk cases suggests that the training programme requires adjustment to further improve IRR.

Validation and reliability of the Japanese version of the Food Allergy Quality of Life Questionnaire - Parent Form

Background: Food allergy (FA) is a heavy burden for patients and their families and can significantly reduce the quality of life (QoL) of both. To provide adequate support, qualitative and quantitative evaluation of the parents' QoL may be helpful. The objective of this study is to develop and validate a Japanese version of the Food Allergy QoL QuestionnaireeParent Form (FAQLQ-PF-J), an internationally validated disease-specific QoL measurement of the parental burden of having a child with FA. Methods: The FAQLQ-PF and the Food Allergy Independent Measure (FAIM), an instrument to test the construct validity of the FAQLQ-PF-J, were translated into Japanese. After language validation, the questionnaires were administered to parents of FA children aged 0e12 years and those of age-matched healthy (without FA) children. Internal consistency (by Cronbach's a) and test-retest reliability were evaluated. Construct validity and discriminant validity were also examined. Results: One hundred twenty-seven parents of children with FA and 48 parents of healthy children filled out the questionnaire. The FAQLQ-PF-J showed excellent internal consistency (Cronbach's a > 0.77) and test-retest reliability. Good construct validity was demonstrated by significant correlations between the FAQLQ-PF-J and FAIM-J scores. It discriminated parents of children with FA from those without. The scores were significantly higher (lower QoL) for parents of FA children with a history of anaphylaxis than those without, for those with >6 FA-related symptoms experienced than those with less FA-related symptoms. Conclusions: The FAQLQ-PF-J is a reliable and valid measure of the parental burden of FA in children.

Vein measurement by peripherally inserted central catheter nurses using ultrasound: A reliability study

Background Peripherally inserted central catheters (PICCs) are increasingly inserted by trained registered nurses, necessitating the development of specialized skills such as the use of ultrasound. The selection of an adequately sized vein is an important factor in reducing adverse events such as deep vein thrombosis. However, PICC nurses may receive minimal training in the use of ultrasound for vein measurement. Objective We aimed to demonstrate the reliability of a vein measurement protocol using ultrasound by a PICC nurse trained in sonography. Methods The diameter of the basilic, brachial, and cephalic veins in the left arms of healthy participants (n = 12) were measured using ultrasound by a PICC nurse and a sonographer. A PICC nurse performed the measurement twice and the sonographer once; the PICC nurse's results were compared for intra-rater reliability and compared with the sonographer for inter-rater reliability. The results were analyzed using intraclass correlation coefficients (ICCs). Results Inter-rater reliability between the PICC nurse and the sonographer was adequate, the ICC for the brachial vein was 0.60 (95% confidence interval [CI], 0.06-0.87), basilic vein ICC was 0.87 (95% CI, 0.58-0.96) and cephalic vein ICC was 0.77 (95% CI, 0.39-0.93). Intra-rater reliability of the PICC nurse was higher; the ICC for the brachial vein was 0.80 (95% CI, 0.44-0.94), basilic vein ICC was 0.92 (95% CI, 0.67-0.98), and cephalic vein ICC was 0.78 (95% CI, 0.40-0.93). Conclusions Using a suitable protocol, a PICC nurse was able to measure vein diameter reliably when compared with a sonographer and consistently replicate these results.

Assuring virtual network reliability and resilience

A framework developed that uses reliability block diagrams and continuous-time Markov chains to model and analyse the reliability and availability of a Virtual Network Environment (VNE). In addition, to minimize the unpredicted failures and reduce the impact of failure on a virtual network, a dynamic solution proposed for detecting a failure before it occurs in the VNE. Moreover, to predict failure and establish a tolerable maintenance plan before failure occurs in the VNE, a failure prediction method for VNE can be used to minimise the unpredicted failures, reduce backup redundancy and maximise system performance.

An extended approach to adjust inconsistent minority peer- and self-assessment scores of teamwork using assessor’s reliability

Teamwork is generally assessed either solely by academic staff or by both academic staff andstudents themselves confidentially as well as collaboratively. Peer- and self-assessments have beenused primarily to assess teamwork process and teacher assessment to assess teamwork product.Peer- and self-assessments are useful to elicit team members’ contribution towards teamwork and toconvert team mark into individual marks, provided the scores are reliable (the extent to which thescores are consistent). However, not all peer- and self-assessment scores are reliable. Anecdotal andliterature evidence suggest that there are several cases of inconsistencies in these scores. Individualcontribution scores given by teammates to an assessee (including himself/herself) can sometimesvary significantly due to both intentional and unintentional reasons. Simply using total individual ratingscores without considering an assessor’s reliability to estimate individual contribution factors cansometime results unfair grades and becomes hindrance to learning through teamwork.PURPOSEThis study proposes an extended approach to adjust inconsistent and/or distorted minority peer andself-assessment scores of teamwork using standard normal probability concept.APPROACHIn order to adjust inconsistent and/or distorted minority peer-and self-assessment scores of teamwork,an extended approach has been proposed. The approach uses the reliability of assessor’s scores ofan assessee using standard normal probability curve. The evaluation of the extended approach isconducted by comparing with the existing approaches using two case examples of peer- and selfassessmentof teamwork where minority team members’ scores are inconsistent.RESULTSThe evaluation of the extended approach shows that the proposed method is superior to the availableapproaches in order to adjust inconsistent peer- and self-assessment scores for special cases wherescores of minority team members are inconsistent. The extended approach helps both to automaticallydetect such scoring anomalies and to adjust the scores so that the fairer contributions to the teamworkwould be obtained and utilised.CONCLUSIONSThe extended approach is useful in that it helps both to automatically detect scoring anomalies and todevise the methods to adjust them. However, the approach does not address the issue of scoringinconsistencies by majority of team members as it uses average score as a basis for identifyinginconsistencies. Moreover, the approach needs to be implemented in the real teamwork environmentin order to identify the impacts of these scoring adjustments in teamwork process and teamworkproduct.

Validity and reliability of the international fItness scale (IFIS) in a population-based sample of schoolchildren in Bogota, Colombia: The FUPRECOL study

The International FItness Scale (IFIS) is a self-reported measure of physical fitness that could easily. This scale has been validated in children, adolescents, and young adults; however, it is unknown whether the IFIS represents a valid and reliable estimate of physical fitness in Latino-American youth population. In the present study we aimed to examine the validity and reliability of the IFIS on a population-based sample of schoolchildren in Bogota, Colombia. Participants were 1,875 Colombian youth (56.2% girls) aged 9 to 17.9 years old. We measured adiposity markers (body fat, waist-to-height ratio, skinfold thicknesses and BMI), blood pressure, lipids profile, fasting glucose, and physical fitness level (self reported and measured). Also, a validated cardiometabolic risk index was used. An age- and sex-matched sample of 229 Schoolchildren originally not included in the study sample fulfilled IFIS twice for reliability purposes. Our data suggest that both measured and self-reported overall fitness were associated inversely with adiposity indicators and a cardiometabolic risk score. Overall, schoolchildren who self-reported “good” and “very good” fitness had better measured fitness than those who reported “very poor” and “poor” fitness (all p<0.001). Test–retest reliability of IFIS items was also good, with an average weighted Kappa of 0.811. Therefore, our findings suggest that self-reported fitness, as assessed by IFIS, is a valid, reliable, and health-related measure, and it can be a good alternative for future use in large studies with Latin-schoolchildren from Colombia.

Reliability of Tethered Swimming Evaluation in Age Group Swimmers

The aim of the present study was to examine the reliability of tethered swimming in the evaluation of age group swimmers. The sample was composed of 8 male national level swimmers with at least 4 years of experience in competitive swimming. Each swimmer performed two 30 second maximal intensity tethered swimming tests, on separate days. Individual force-time curves were registered to assess maximum force, mean force and the mean impulse of force. Both consistency and reliability were very strong, with Cronbach’s Alpha values ranging from 0.970 to 0.995. All the applied metrics presented a very high agreement between tests, with the mean impulse of force presenting the highest. These results indicate that tethered swimming can be used to evaluate age group swimmers. Furthermore, better comprehension of the swimmers ability to effectively exert force in the water can be obtained using the impulse of force. Key words: swimming, training and testing, propulsive force, front crawl.