Assessing childrens competence in computer interactions: Preliminary reliability and validity of the test of mouse proficiency

The Test of Mouse Proficiency (TOMP) was developed to assist occupational therapists and education professionals assess computer mouse competency skills in children from preschool to upper primary (elementary) school age. The preliminary reliability and validity of TOMP are reported in this paper. Methods used to examine the internal consistency, test-retest reliability, and criterion- and construct-related validity of the test are elaborated. In the continuing process of test refinement, these preliminary studies support to varying degrees the reliability and validity of TOMP. Recommendations for further validation of the assessment are discussed along with indications for potential clinical application.

Warranty and optimal reliability improvement through product development

For products sold with warranty, the warranty servicing cost can be reduced by improving product reliability through a development process. However, this increases the unit manufacturing cost. Optimal development must achieve a trade-off between these two costs. The outcome of the development process is uncertain and needs to be taken into account in the determination of the optimal development effort. The paper develops a model where this uncertainty is taken into account. (C) 2003 Elsevier Ltd. All rights reserved.

The tree cut and merge algorithm for estimation of network reliability

This article presents Monte Carlo techniques for estimating network reliability. For highly reliable networks, techniques based on graph evolution models provide very good performance. However, they are known to have significant simulation cost. An existing hybrid scheme (based on partitioning the time space) is available to speed up the simulations; however, there are difficulties with optimizing the important parameter associated with this scheme. To overcome these difficulties, a new hybrid scheme (based on partitioning the edge set) is proposed in this article. The proposed scheme shows orders of magnitude improvement of performance over the existing techniques in certain classes of network. It also provides reliability bounds with little overhead.

The reliability of video based time motion analysis

Time motion analysis is extensively used to assess the demands of team sports. At present there is only limited information on the reliability of measurements using this analysis tool. The aim of this study was to establish the reliability of an individual observer's time motion analysis of rugby union. Ten elite level rugby players were individually tracked in Southern Hemisphere Super 12 matches using a digital video camera. The video footage was subsequently analysed by a single researcher on two occasions one month apart. The test-retest reliability was quantified as the typical error of measurement (TEM) and rated as either good (10% TEM). The total time spent in the individual movements of walking, jogging, striding, sprinting, static exertion and being stationary had moderate to poor reliability (5.8-11.1% TEM). The frequency of individual movements had good to poor reliability (4.3-13.6% TEM), while the mean duration of individual movements had moderate reliability (7.1-9.3% TEM). For the individual observer in the present investigation, time motion analysis was shown to be moderately reliable as an evaluation tool for examining the movement patterns of players in competitive rugby. These reliability values should be considered when assessing the movement patterns of rugby players within competition.

Reliability of scores between stroke patients and significant others on the Reintegration to Normal Living (RNL) Index

Purpose: This study measured reliability between stroke patients' and significant others' scores on items on the Reintegration to Normal Living (RNL) Index and whether there were any scoring biases. Method The 11-item RNL Index was administered to 57 pairs of patients and significants six months after stroke rehabilitation. The index was scored using a 10-point visual analogue scale. Patient and significant other demographic information and data on patients' clinical, functional and cognitive status were collected. Reliability was measured using the intra-class correlation coefficient (ICC) and percent agreement. Results: Overall poor reliability was found for the RNL Index total score (ICC=.36, 95% CI. 07 to .59) and the daily functioning subscale (ICC=.24, 95% CI -.003 to .46) and moderate reliability was found for the perception of self subscale (ICC=.55, 95 % CI .28 to .73). There was a moderate bias for patients to rate themselves as achieving better reintegration than was indicated by significant others, although no demographic or clinical factors were associated with this bias. Exact match agreement was best for the subjective items and worse for items reflecting mobility around the community and participation in a work activity. Conclusions: Caution is needed when interpreting patient information reported by significant others on the RNL Index. The use of a shorter scale to rate the RNL Index requires investigation.

Reliability of electromyographic and torque measures during isometric axial rotation exertions of the trunk

Objective: The aim of the present study was to investigate the between-days reliability of electromyographic (EMG) measurement of 6 bilateral trunk muscles and also the torque output in 3 planes during isometric right and left axial rotation at different exertion levels. Methods: Ten healthy subjects performed isometric right and left axial rotation at 100, 70, 50 and 30% maximum voluntary contractions in two testing sessions at least 7 days apart. EMG amplitude and frequency analyses of the recorded surface EMG signals were performed for rectus abdominis, external oblique, internal oblique, latissimus dorsi, iliocostalis lumborum and multifidus bilaterally. The primary torque in the transverse plane and the coupling torques in sagittal and coronal planes were measured. Results: For both EMG amplitude and frequency values, good (intraclass correlation coefficient, ICC = 0.75-0.89) to excellent (ICC greater than or equal to 0.90) reliability was found in the 6 trunk muscles at different exertion levels during axial rotation. The reliability of both maximal isometric axial rotation torque and coupling torques in sagittal and coronal planes were found to be excellent (ICC greater than or equal to 0.93). Conclusions: Good to excellent reliability of EMG measures of trunk muscles and torque measurements during isometric axial rotation was demonstrated. This provides further confidence of using EMG and triaxial torque assessment as outcome measures in rehabilitation and in the evaluation of the human performance in the work place. (C) 2003 International Federation of Clinical Neurophysiology. Published by Elsevier Ireland Ltd. All rights reserved.

Reliability of moderate-intensity and vigorous physical activity stage of change measures for young adults

Background. The purpose of this study was to examine the reliability of stage of change (SOC) measures for moderate-intensity and vigorous physical activity in two separate samples of young adults. Staging measures have focused on vigorous exercise, but current public health guidelines emphasize moderate-intensity activity. Method. For college students in the USA (n = 105) and in Australia (n = 123), SOC was assessed separately on two occasions for moderate-intensity activity and for vigorous activity. Test-retest repeatability was determined, using Cohen's kappa coefficient. Results. In both samples, the reliability scores for the moderate-intensity physical activity staging measure were lower than the scores for the vigorous exercise staging measure. Weighted kappa values for the moderate-intensity staging measure were in the fair to good range for both studies (0.50 and 0.45); for the vigorous staging measure kappa values were excellent and fair to good (0.76 and 0.72). Conclusions. There is a need to standardize and improve methods for staging moderate-intensity activity, given that such measures are used in public health interventions targeting HEPA (health-enhancing physical activity). (C) 2003 American Health Foundation and Elsevier Science (USA). All rights reserved.

The need for standardized tests to evaluate the reliability of data transport in wireless medical systems

Wireless medical systems are comprised of four stages, namely the medical device, the data transport, the data collection and the data evaluation stages. Whereas the performance of the first stage is highly regulated, the others are not. This paper concentrates on the data transport stage and argues that it is necessary to establish standardized tests to be used by medical device manufacturers to provide comparable results concerning the communication performance of the wireless networks used to transport medical data. Besides, it suggests test parameters and procedures to be used to produce comparable communication performance results.

Reliability of self-reported weight and height among State bank employees

INTRODUCTION: Self-reported weight and height were compared with direct measurements in order to evaluate the agreement between the two sources. METHOD: Data were obtained from a cross-sectional study on health status from a probabilistic sample of 1,183 employees of a bank, in Rio de Janeiro State, Brazil. Direct measurements were made of 322 employees. Differences between the two sources were evaluated using mean differences, limits of agreement and intraclass correlation coefficient (ICC). RESULTS AND CONCLUSIONS: Men and women tended to underestimate their weight while differences between self-reported and measured height were insignificant. Body mass index (BMI) mean differences were smaller than those observed for weight. ICC was over 0.98 for weight and 0.95 for BMI, expressing close agreement. Combining a graphical method with ICC may be useful in pilot studies to detect populational groups capable of providing reliable information on weight and height, thus minimizing resources needed for field work.

Hybrid fuzzy Monte Carlo technique for reliability assessment in transmission power systems

This paper proposes a new methodology to reduce the probability of occurring states that cause load curtailment, while minimizing the involved costs to achieve that reduction. The methodology is supported by a hybrid method based on Fuzzy Set and Monte Carlo Simulation to catch both randomness and fuzziness of component outage parameters of transmission power system. The novelty of this research work consists in proposing two fundamentals approaches: 1) a global steady approach which deals with building the model of a faulted transmission power system aiming at minimizing the unavailability corresponding to each faulted component in transmission power system. This, results in the minimal global cost investment for the faulted components in a system states sample of the transmission network; 2) a dynamic iterative approach that checks individually the investment’s effect on the transmission network. A case study using the Reliability Test System (RTS) 1996 IEEE 24 Buses is presented to illustrate in detail the application of the proposed methodology.

Power systems reliability calculation based on fuzzy data mining

This paper presents a methodology supported on the data base knowledge discovery process (KDD), in order to find out the failure probability of electrical equipments’, which belong to a real electrical high voltage network. Data Mining (DM) techniques are used to discover a set of outcome failure probability and, therefore, to extract knowledge concerning to the unavailability of the electrical equipments such us power transformers and high-voltages power lines. The framework includes several steps, following the analysis of the real data base, the pre-processing data, the application of DM algorithms, and finally, the interpretation of the discovered knowledge. To validate the proposed methodology, a case study which includes real databases is used. This data have a heavy uncertainty due to climate conditions for this reason it was used fuzzy logic to determine the set of the electrical components failure probabilities in order to reestablish the service. The results reflect an interesting potential of this approach and encourage further research on the topic.

Reliability of nasal auscultation and their relation to middle ear condition – a clinical interest to pediatrics respiratory physiotherapy

Background: Acute respiratory infections are usual in children under three years old occurring in upper respiratory tract, having an impact on child and caregiver’s quality of life predisposing to otitis media or bronchiolitis. There are few valid and reliable measures to determine the child’s respiratory condition and to guide the physiotherapy intervention. Aim: To assess the intra and inter rater reliability of nasal auscultation, to analyze the relation between sounds’ classification and middle ear’s pressure and compliance as well as with the Clinical Severity Score. Methods: A cross-sectional observational study was composed by 125 nursery children aged up to three years old. Tympanometry, pulmonary and nasal auscultation and application of Clinical Severity Score were performed to each child. Nasal auscultation sounds’ were recorded and sent to 3 blinded experts, that classified, as “obstructed” and “unobstructed”, with a 48 hours interval, in order to analyze inter and intra rater reliability. Results: Nasal auscultation revealed a substantial inter and intra rater reliability (=0,749 and evaluator A - K= 0,691; evaluator B - K= 0,605 and evaluator C - K= 0,724, respectively). Both ears’ pressure was significantly lower in children with an "unobstructed" nasal sound when compared with an “obstructed” nasal sound (t=-3,599, p<0,001 in left ear; t=-2,258, p=0,026 in right ear). Compliance in both ears was significantly lower in children with an "obstructed" nasal sound when compared with “unobstructed” nasal sound (t=-2,728, p=0,007 in left ear; t=-3,830, p<0,001 in right ear). There was a statistically significant association between sounds’ classification and tympanograms types in both ear’s (=11,437, p=0,003 in left ear; =13,535, p=0,001 in right ear). There was a trend to children with an "unobstructed" nasal sound that had a lower clinical severity score when compared with “obstructed” children. Conclusion: It was observed a good intra and substantial inter reliability for nasal auscultation. Nasal auscultation sounds’ classification was related to middle ears’ pressure and compliance.

The hospital survey on patient safety culture in Portuguese hospitals: instrument validity and reliability

Purpose – Quantitative instruments to assess patient safety culture have been developed recently and a few review articles have been published. Measuring safety culture enables healthcare managers and staff to improve safety behaviours and outcomes for patients and staff. The study aims to determine the AHRQ Hospital Survey on Patient Safety Culture (HSPSC) Portuguese version's validity and reliability. Design/methodology/approach – A missing-value analysis and item analysis was performed to identify problematic items. Reliability analysis, inter-item correlations and inter-scale correlations were done to check internal consistency, composite scores. Inter-correlations were examined to assess construct validity. A confirmatory factor analysis was performed to investigate the observed data's fit to the dimensional structure proposed in the AHRQ HSPSC Portuguese version. To analyse differences between hospitals concerning composites scores, an ANOVA analysis and multiple comparisons were done. Findings – Eight of 12 dimensions had Cronbach's alphas higher than 0.7. The instrument as a whole achieved a high Cronbach's alpha (0.91). Inter-correlations showed that there is no dimension with redundant items, however dimension 10 increased its internal consistency when one item is removed. Originality/value – This study is the first to evaluate an American patient safety culture survey using Portuguese data. The survey has satisfactory reliability and construct validity.