Reliability of building embodied energy modelling: an analysis of 30 Melbourne case studies

Building design decisions are commonly based on issues pertaining to construction cost, and consideration of energy performance is made only within the context of the initial project budget. Even where energy is elevated to more importance, operating energy is seen as the focus and embodied energy is nearly always ignored. For the first time, a large sample of buildings has been assembled and analysed in a single study to improve the understanding of the relationship between energy and cost performance over their full life cycle. Thirty recently completed buildings in Melbourne, Australia have been studied to explore the accuracy of initial embodied energy prediction based on capital cost at various levels of model detail. The embodied energy of projects, elemental groups, elements and selected items of work are correlated against capital cost and the strength of the relationship is computed. The relationship between initial embodied energy and capital cost generally declines as the predictive model assumes more detail, although elemental modelling may provide the best solution on balance.

The reliability of performance of healthy adults on three visual perception tests

Problems with visual perceptual skills have been shown to have a negative impact on the daily living skills of individuals and are, therefore, commonly assessed by occupational therapists. The purpose of this study was to examine two types of reliability (internal consistency and test-retest reliability) of three newly revised or developed adult visual perception tests. The participants were 50 healthy adults, aged 18 to 55 years, from Melbourne, Victoria, Australia. The participants completed the Developmental Test of Visual Perception - Adolescent and Adult (DTVP-A), the Motor-Free Visual Perception Test - Third Edition (MVPT-3) and the Test of Visual Perceptual Skills (non-motor) - Third Edition (TVPS-3). Internal consistency was examined using Cronbach's alpha calculations and test-retest reliability was analysed using Spearman rho non-parametric correlation coefficients.

The results indicated that the DTVP-A, the MVPT-3 and the TVPS-3 had total scale internal consistency correlation scores of 0.60 or higher (0.60, 0.69 and 0.63 respectively). The majority of the subscales of each test had lower correlation coefficients than the overall scores (ranging from 0.22 to 0.49). For the DTVP-A, MVPT-3 and TVPS-3 total scale scores, the test-retest reliability correlation coefficients were statistically significant (rho = 0.46, p<0.05; rho = 0.62, p<0.01; and rho = 0.59, p<0.01, respectively). Overall, the three visual perceptual tests exhibited low to moderate levels of internal consistency and test-retest reliability.

Assessing the reliability of the sedation-agitation scale between nurses and doctors in a New Zealand ICU

The aim of the study was to determine whether nurses and doctors rate “real world” intensive care unit (ICU) patients similarly using the Sedation–Agitation Scale (SAS) in a generalist ICU context outside USA

The relative and absolute reliability of two balance performance measures in chronic stroke patients

Purpose. To examine the relative reliability and absolute reliability of the Berg Balance Scale (BBS) and the Postural Assessment Scale for Stroke Patients (PASS) in chronic stroke patients. Method. A total of 52 mild to moderate stroke patients, who had a stroke more than 6 months previously, participated in the study. Both balance measures were administered twice, seven days apart, to the patients. A relative reliability index (intra-class correlation coefficient, ICC2,1) was used to examine the level of agreement between test and retest. Absolute reliability indices, including the Bland and Altman method, the standard error of measurement (SEM), and the smallest real differences (SRD), were used to define the extent to which a balance score varies on test-retest measurements. Results. Test-retest agreements were high (ICC2,1: BBS = 0.98; PASS = 0.97), indicating excellent agreement from a relative perspective. The SEM of the BBS and PASS, representing the smallest change threshold that indicates a real improvement for a group of individuals, were 2.4 and 1.1, respectively. The SRD of the BBS and PASS were 6.7 and 3.2, respectively, exhibiting the smallest change threshold that indicates a real improvement for a single individual. Conclusions. The test-retest agreements of the BBS and PASS were high in mild to moderate chronic stroke patients. The thresholds of both measures to detect real change are acceptable in research and clinical settings.

Consensus scoring, correct responses and reliability of the MSCEIT V2

The scoring protocol adopted by the MSCEIT V2 has been criticised since its development. The present study raises questions regarding the value of consensus scoring by analysing responses within the categorical subscales of Changes and Blends using the Optimal Scaling technique within the Categorical Principal Components Analysis (CATPCA) via Statistical Package for the Social Sciences (SPSS), (n = 206). On a number of occasions, there was no clear agreement as to the ‘‘correct” response to items within these categorical subscales. Such an issue seems integral to the application of the MSCEIT V2 and one which deserves more attention. On a more positive note, improvements were made to the reliabilities of the subscales of Changes and Blends, using Optimal Scaling, but less so for Changes. Nevertheless, this raises the possibility of improving the reliabilities of other subscales in the MSCEIT V2 and in turn improving the power of subsequent statistical tests.

Validity and reliability of measures of television viewing time and other non-occupational sedentary behaviour of adults : a review

Time spent in non-occupational sedentary behaviours (particularly television viewing time) is associated with excess adiposity and an increased risk of metabolic disorders among adults; however, there are no reviews of the validity and reliability of assessing these behaviours. This paper aims to document measures used to assess adults' time spent in leisure-time sedentary behaviours and to review the evidence on their reliability and validity. Medline, CINAHL and Psych INFO databases and reference lists from published papers were searched to identify studies in which leisure-time sedentary behaviours had been measured in adults. Sixty papers reporting measurement of at least one type of leisure-time sedentary behaviour were identified. Television viewing time was the most commonly measured sedentary behaviour. The main method of data collection was by questionnaire. Nine studies examined reliability and three examined validity for the questionnaire method of data collection. Test–retest reliabilities were predominantly moderate to high, but the validity studies reported large differences in correlations of self-completion questionnaire data with the various referent measures used. To strengthen future epidemiological and health behaviour studies, the development of reliable and valid self-report instruments that cover the full range of leisure-time sedentary behaviour is a priority.

The validity and reliability of an instrument to assess children's outdoor play in various locations

The aim of this study was to develop and test the reliability and validity of survey items that examine the frequency with which primary school-aged children play in particular outdoor locations. Parents reported the number of days their child spent playing in specified outdoor locations (i.e., yard at home, own street/court/footpath, and park/playground) out-of-school hours on weekdays and weekend days during a typical week. To test the reliability of these items, the survey was administered on two occasions, 2 weeks apart, to a sample of 53 parents of children attending primary schools located in metropolitan Melbourne. The validity study involved the completion of a log book by 46 parents of primary school children over a 1-week period. Two weeks later, the same sample of parents completed the survey items. The test–retest reliability of individual items was determined using intra-class correlation coefficients (ICC). The kappa statistic and percent agreement between responses were used to assess validity by comparing the information provided in the log book with that provided in the survey. Results from the two studies suggest that the survey was generally a reliable and valid instrument for assessing the frequency with which children play in particular locations especially at home or in the street. Evidence of the reliability and validity of items assessing where children play is novel and important considering the need to promote children's physical activity in a variety of settings.

Reliability of surface EMG measurements of the quadriceps during maximal isometric contractions following water immersion

Background: The influence of water immersion on neuromuscular function is of importance to a number of disciplines; however, the reliability of surface electromyography (SEMG) following water immersion is not known. This study examined the reliability of SEMG amplitude during maximal voluntary isometric contractions (MVICs) of the vastus lateralis following water immersion.

Methods: Using a Biodex isokinetic dynamometer and in a randomized order, 12 healthy male subjects performed four MVICs at 60° knee flexion on both the dominant and nondominant kicking legs, and the SEMG was recorded. Each subject's dominant and nondominant kicking leg was then randomly assigned to have SEMG electrodes removed or covered during 15 min of water immersion (20°C–25°C). Following water immersion, subjects performed a further four MVICs.

Results: Intraclass correlation coefficient (ICC) and the relative standard error of measurement (%SEM) of SEMG amplitude showed moderate to high trial-to-trial reliability when electrodes were covered (0.93% and 2.79%) and removed (0.95% and 2.10%, respectively).

Conclusions: The results of the this study indicate that SEMG amplitude of the vastus lateralis may be accurately determined during maximal voluntary contractions following water immersion if electrodes are either removed or covered with water-resistive tape during the immersion.

Reliability of normalisation methods for EMG analysis of neck muscles

Acceptable reliability of normalisation contractions in electromyography (EMG) is paramount for testing conducted over a number of days or if normal laboratory strength testing equipment is unavailable. This study examined the reliability of maximal voluntary isometric contractions (MVIC) and sub-maximal (60%) isometric contractions for use in neck muscle EMG studies. Surface EMG was recorded bilaterally from eight sites around the neck at C4/5 level from five healthy male subjects. Subjects performed MVIC and sub-maximal normalisation contractions using an isokinetic dynamometer (ID) and a portable cable dynamometer with attached strain gauge (PCD) in addition to a MVIC against a manual resistance (MR). Subjects were tested in flexion, extension, left and right lateral bending and were retested by the same tester within a two-week period. Intra class correlation co-efficients (ICC) were calculated for each testing method and contraction direction and a mean ICC was calculated across all contraction directions. All normalisation methods produced excellent within-day reliability (mean ICC >0.80) but only the MVICs using the ID and PCD had acceptable reliability when assessed between-days. This study confirmed the validity of using MVICs elicited using the ID and PCD as reliable reference contractions for the normalisation of neck EMG.

A quantitative approach to analysing reliability of engagement responses to dance

Perhaps one of the most important end products of a dance work is how it  effects its observers (typically its audience, but also the dancers and choreographers). Of the many ways of discussing and analysing dance, one
approach in its infancy is quantification. Our research involves combining continuous response techniques and human response methods to see if we can tease out relationships between continuous, quantitative evaluative responses and the more qualitative choreographer intentions. The aim of this paper is to describe how evaluative responses can be quantified at all, then how they can be related to an unfolding dance work, and finally, how we can isolate ‘meaningful’ or ‘significant’ or ‘reliable’ evaluations of a dance work from those which are no more than a spurious set of not-very-useful numbers presented under the guise of a valid assessment.

Reliability of web services

This thesis explores the fault tolerance issues of web services computing and proposes a model for reliability of transaction-oriented web services applications.

Validity and reliability of instruments to assess potential mediators of children's physical activity : a systematic review

This paper aimed to (1) identify potential mediators reported in children's physical activity interventions; and (2) review the psychometric properties of measures of potential mediators included in such interventions. A systematic search of the literature was conducted and studies that reported potential mediators and/or the psychometric properties of measures of potential mediators were retrieved and reviewed. The studies were reviewed for the following psychometric properties: face/logical, construct, and criterion validity; and test–retest and internal consistency (factor analysis and Cronbach's α) reliability. Twenty-one potential mediators were identified from 24 published children's physical activity intervention studies; 17 individual, three social, and one physical environmental. Overall, there was considerable variation in the reporting of the psychometric properties of these measures. Reliability properties (specifically Cronbach's α) were more commonly reported than validity properties; however, for many potential mediators, the quality of these measures was low. Future studies should examine the psychometric properties of measures of potential mediators to ensure appropriate, valid and reliable instruments are used. This will assist in the ability to accurately determine the efficacy of physical activity interventions among children.

The reliability of two visual motor integration tests used with health adults

Occupational therapists often assess the visual motor integration (VMI) skills of children, adults, and the elderly, which are parts of the Body Functions and Structures of the International Classification of Functioning, Disability and Health. Objective. As it is imperative that therapists use tests and measures with strong psychometric properties, this study aims to examine the reliability of two VMI tests used with adults. Method. Sixty-one healthy adults, 18 males and 43 females, with an average age of 31.82 years, completed the Developmental Test of Visual Motor Integration (DTVMI) and the Full Range Test of Visual Motor Integration (FRTVMI). The Cronbach's alpha coefficient was used to examine the tests’ internal consistency, while the Spearman's rho correlation was used to evaluate the test–retest reliability, intrarater reliability, and interrater reliability of the two VMI tests. Results. The Cronbach's alpha coefficient for the DTVMI and FRTVMI was 0.66 and 0.80, respectively. The test–retest reliability coefficient was 0.77 (p < .001) for the DTVMI and 0.61 (p < .001) for the FRTVMI. The interrater reliability correlation was significant for both DTVMI at 0.79 (p < .001) and FRTVMI at 0.80 (p < .001). The DTVMI intrarater reliability correlation result was 0.95 (p < .001) and the FRTVMI at 0.87 (p < .001). Conclusion. Overall, the DTVMI and the FRTVMI exhibited moderate to high levels of reliability when used with a sample of healthy adults. Both VMI tests appear to exhibit reasonable levels of reliability and are recommended for use with adults and the elderly.

Reliability of a gymnastics vaulting feedback system

The current study assessed the intra- and inter-day reliability of a custom-built gymnastics vaulting feedback system. The system is a coach-friendly customized infra-red timing gate and contact timing mat system operated by the coach to augment the feedback provided to gymnasts on their vaulting performance during regular training practice. Thirteen Australian high performance gymnasts (eight males and five females) aged 11-23 years were assessed during two training sessions (Day 1 and Day 2) at their regular training centre. The approach velocity and board contact time measures were found to be reliable measures during vault training, with measures of pre-flight and table contact time less consistent. Future research should examine the validity of these measures as a tool for monitoring vault training.