Behaviour state analysis in Rett syndrome: Continuous data reliability measurement

Awareness of optimal behaviour states of children with profound intellectual disability has been reported in the literature as a potentially useful tool for planning intervention within this population. Some arguments have been raised, however, which question the reliability and validity of previously published work on behaviour state analysis. This article sheds light on the debate by presenting two stages of a study of behaviour state analysis for eight girls with Rett syndrome. The results support Mudford, Hogg, and Roberts' (1997, 1999) concerns with the pooling of participant data. The results of Stage 2 also suggest, however, that most categories of behaviour state can be reliably distinguished once definitions of behaviours for each state are clearly defined.

The State of our Toolbox: A Meta-analysis of Reliability Measurement Precision

My study investigated internal consistency estimates of psychometric surveys as an operationalization of the state of measurement precision of constructs in industrial and organizational (I/O) psychology. Analyses were conducted of samples used in research articles published in the Journal of Applied Psychology between 1975 and 2010 in five year intervals (K = 934) from 480 articles yielding 1427 coefficients. Articles and their respective samples were coded for test-taker characteristics (e.g., age, gender, and ethnicity), research settings (e.g., lab and field studies), and actual tests (e.g., number of items and scale anchor points). A reliability and inter-item correlations depository was developed for I/O variables and construct groups. Personality measures had significantly lower inter-item correlations than other construct groups. Also, internal consistency estimates and reporting practices were evaluated over time, demonstrating an improvement in measurement precision and missing data.

Measuring transit service reliability using data from web-based transit user survey : a case study at Brisbane, Australia

This paper reports an empirical study on measuring transit service reliability using the data from a Web-based passenger survey on a major transit corridor in Brisbane, Australia. After an introduction of transit service reliability measures, the paper presents the results from the case study including study area, data collection, and reliability measures obtained. This includes data exploration of boarding/arrival lateness, in-vehicle time variation, waiting time variation, and headway adherence. Impacts of peak-period effects and separate operation on service reliability are examined. Relationships between transit service characteristics and passenger waiting time are also discussed. A summary of key findings and an agenda of future research are offered in conclusions.

Validity and reliability of instruments designed to measure factors influencing the overuse of antibiotics

Background: Antibiotic overuse is a global public health issue that is influenced by several factors. The degree and prevalence of antibiotic overuse is difficult to measure directly. A more practical approach, such as the use of a psycho-social measurement instrument, might allow for the observation and assessment of patterns of antibiotic use. Study objective: The aim of this paper is to review the nature, validity, and reliability of measurement scales designed to measure factors associated with antibiotic misuse/overuse. Design: This study is descriptive and includes a systematic integration of the measurement scales used in the literature to measure factors associated with antibiotic misuse/overuse. The review included 70 international scientific publications from 1992 to 2010. Main results: Studies have presented scales to measure antibiotic misuse. However, the workup of these instruments is often not mentioned, or the scales are used with only early-phase validation, such as content or face validity. Other studies have discussed the reliability of these scales. However, the full validation process has not been discussed in any of the reviewed measurement scales. Conclusion: A reliable, fully validated measurement scale must be developed to assess the factors associated with the overuse of antibiotics. Identifying these factors will help to minimize the misuse of antibiotics.

Review of refugee mental health assessment: Best practices and recommendations

This article focuses on mental health assessment of refugees in clinical, educational and administrative-legal settings in order to synthesise research and practice designed to enhance and promote further development of culturally appropriate clinical assessment services during the refugee resettlement process. It specifically surveys research published over the last 25 years into the development, reliability measurement and validity testing of assessment instruments, which have been used with children, adolescents and adults from refugee backgrounds, prior to or following their arrival in a resettlement country, to determine whether the instruments meet established crosscultural standards of conceptual, functional, linguistic, technical and normative equivalence. The findings suggest that, although attempts have been made to develop internally reliable, appropriately normed tests for use with refugees from diverse cultural and linguistic backgrounds, matters of conceptual and linguistic equivalence and test–retest reliability are often overlooked. Implications of these oversights for underreporting refugees' mental health needs are considered. Efforts should also be directed towards development of culturally comparable, valid and reliable measures of refugee children's mental health and of refugee children's and adults' psychoeducational, neuropsychological and applied memory capabilities.

Basistests Suisse Sport Test Konzept: Validierung einer sportmotorischen Basistestbatterie für den Schul- und Nachwuchssport

Physical fitness can be evaluated in competitive and school sports with different field tests under different conditions and goals. To produce valid results, a field test must be practical and reach high standards of test criteria (objectivity, reliability, validity). The purpose of this study was to investigate the test criteria and the practicability of a group of field tests called «SUISSE Sport Test Konzept Basis Feldtestbatterie». For 20-m sprint, ventral trunk muscle test, standing long jump, 2-kg medicine ball shot, obstacle course and cooper-test, test quality and practicability were evaluated. 221 children and adolescents from competitive sports and different school levels took part in the study. According to school level, they were divided into 3 groups (P: 7–11.5 y, S1: 11.6–15.5 y, S2: 15.6–21.8 y). Objectivity was tested for time or distance measurement in all tests as well as for error rating in obstacle test. For reliability measurement, 162 subjects performed the field tests twice within a few weeks. For validity results of standing long jump were compared with counter movement jump performance on a force plate. Correlation analysis was performed and level of significance was set for p < 0.05. For accuracy standard error was calculated. All tests achieved sufficient to excellent objectiv - ity with correlation-coefficient (r) lying between 0.85 and 0.99. Reliability was very good (r = 0.84–0.97). In cooper- and trunk test, reliability was higher for athletes than for pupils (trunk test: r = 0.95 vs. r = 0.62, cooper-test: r = 0.90 vs. r = 0.78). In those tests the reliability decreases with increasing age (cooper-test: P: r = 0.84, S1: r = 0.69, S2: r = 0.52; trunk-test: P: r = 0.69, S1: r = 0.71; S2: r = 0.39). Validity for standing long jump was good (r = 0.75–0.86). The standard error of the mean was between 4–8%, with the exception for cooper-test (athletes: 6%, pupils: 11%) and trunk test (athletes: 14%, pupils: 46%). The results show that the evaluated group of field tests is a practicable, objective and reliable tool to determine physical skills in young athletes as well as in a scholar setting over a broad age range. Most of the tests achieved the test criteria with the grades good to excellent. The lower coefficient of reliability for cooper- and trunk test by the pupils could be explained by motivational problems in this setting. For up to 20 subjects, a tester can accomplish the tests within 3 h. Finally, age-dependent grades were elaborated

Qualidade de vida: o papel do estado nutricional e da percepção do relacionamento familiar de crianças do município de Indaiatuba/SP

Introdução: A importância da investigação da qualidade de vida de crianças está diretamente relacionada ao fato de que muitos problemas na vida adulta têm sua origem na infância. Objetivo: analisar a contribuição da percepção do relacionamento familiar e do estado nutricional sobre a qualidade de vida de crianças do município de Indaiatuba. Metodologia: Na etapa 1 foi realizado o estudo de validade do instrumento APGAR Familiar adaptado à crianças de 7 a 11 anos, utilizando como medida de confiabilidade a técnica do Teste-Reteste e para a avaliação da validade convergente foi utilizada a Escala de Avaliação de Qualidade de Vida Infantil. Na etapa 2 foram avaliados os determinantes da Qualidade de Vida de crianças sob aspectos familiares, estado nutricional e socioeconômicos e demográficos. Os dados foram analisados por meio de Regressão Linear Múltipla com método dos Mínimos Quadrados Ordinários. Resultados: Na etapa 1 a análise de confiabilidade obteve a correlação de 0,764 do coeficiente de Spearman-Brown. Na análise de Validade Convergente o coeficiente de correlação de Rô de Spearman entre os escores dos dois instrumentos foi de 0,570 (p<0,01). Na etapa 2 foi estimado um modelo dos determinantes da qualidade de vida a partir de uma amostra de 1028 crianças de 7 a 11 anos de ambos os sexos. As variáveis independentes foram capazes de explicar a Qualidade de Vida de crianças a uma significância de 1% (Z = 8,417), sendo o R² ajustado de 0,104. A idade da criança e a percepção do relacionamento familiar foram as variáveis estatisticamente significativas, ao passo que o estado nutricional, o tamanho da família, o sexo da criança, a classe social e a escolaridade do responsável, não foram estatisticamente significantes. Conclusão: O instrumento APGAR Familiar apresentou índices preliminares de validade e precisão; a idade e o relacionamento familiar foram as variáveis que explicaram a qualidade de vida percebida sob a perspectiva subjetiva de bem-estar.

Biomechanics of the trunk and lower limbs during gait in individuals with and without chronic low back pain

Combining information on kinetics and kinematics of the trunk during gait is important for both clinical and research purposes, since it can help in better understanding the mechanisms behind changes in movement patterns in chronic low back pain patients. Although three-dimensional gait analysis has been used to evaluate chronic low back pain and healthy individuals, the reliability and measurement error of this procedure have not been fully established. The main purpose of this thesis is to gain a better understanding about the differences in the biomechanics of the trunk and lower limbs during gait, in patients and healthy individuals. To achieve these aims, three studies were developed. The first two, adopted a prospective design and focused on the reliability and measurement error of gait analysis. In these test-retest studies, chronic low back pain and healthy individuals were submitted to a gait assessment protocol, with two distinct evaluation moments, separated by one week. Gait data was collected using a 13-camera opto-electronic system and three force platforms. Data analysis included the computation of time-distance parameters, as well as the peak values for lower limb and trunk joint angles/moments. The third study followed a cross sectional design, where gait in chronic low back pain individuals was compared with matched controls. Step-to-step variability of the thoracic, lumbar and hips was calculated, and step-to-step deviations of these segments from their average pattern (residual rotations) were correlated to each other. The reliability studies in this thesis show that three-dimensional gait analysis is a reliable and consistent procedure for both chronic low back pain and healthy individuals. The results suggest varied reliability indices for multi-segment trunk joint angles, joint moments and time-distance parameters during gait, together with an acceptable level of error (particularly regarding sagittal plane). Our findings also show altered stride-to-stride variability of lumbar and thoracic segments and lower trunk joint moments in patients. These kinematic and kinetic results lend support to the notion that chronic low back pain individuals exhibit a protective movement strategy.

Reliability of ultrasonographic measurement of the architecture of the vastus lateralis and gastrocnemius medialis muscles in older adults

Objective To determine the test-retest reliability of measurements of thickness, fascicle length (Lf) and pennation angle (θ) of the vastus lateralis (VL) and gastrocnemius medialis (GM) muscles in older adults. Participants Twenty-one healthy older adults (11 men and ten women; average age 68·1 ± 5·2 years) participated in this study. Methods Ultrasound images (probe frequency 10 MHz) of the VL at two sites (VL site 1 and 2) were obtained with participants seated with knee at 90º flexion. For GM measures, participants lay prone with ankle fixed at 15º dorsiflexion. Measures were taken on two separate occasions, 7 days apart (T1 and T2). Results The ICCs (95% CI) were: VL site 1 thickness = 0·96(0·90–0·98); VL site 2 thickness = 0·96(0·90–0·98), VL θ = 0·87(0·68–0·95), VL Lf = 0·80(0·50–0·92), GM thickness = 0·97(0·92–0·99), GM θ = 0·85(0·62–0·94) and GM Lf =0·90(0·75–0·96). The 95% ratio limits of agreement (LOAs) for all measures, calculated by multiplying the standard deviation of the ratio of the results between T1 and T2 by 1·96, ranged from 10·59 to 38·01%. Conclusion The ability of these tests to determine a real change in VL and GM muscle architecture is good on a group level but problematic on an individual level as the relatively large 95% ratio LOAs in the current study may encompass the changes in architecture observed in other training studies. Therefore, the current findings suggest that B-mode ultrasonography can be used with confidence by researchers when investigating changes in muscle architecture in groups of older adults, but its use is limited in showing changes in individuals over time.

Reliability of clinical measurement for assessing spinal fusion: An experimental sheep study

Study Design. A sheep study designed to compare the accuracy of static radiographs, dynamic radiographs, and computed tomographic (CT) scans for the assessment of thoracolumbar facet joint fusion as determined by micro-CT scanning. Objective. To determine the accuracy and reliability of conventional imaging techniques in identifying the status of thoracolumbar (T13-L1) facet joint fusion in a sheep model. Summary of Background Data. Plain radiographs are commonly used to determine the integrity of surgical arthrodesis of the thoracolumbar spine. Many previous studies of fusion success have relied solely on postoperative assessment of plain radiographs, a technique lacking sensitivity for pseudarthrosis. CT may be a more reliable technique, but is less well characterized. Methods. Eleven adult sheep were randomized to either attempted arthrodesis using autogenous bone graft and internal fixation (n = 3) or intentional pseudarthrosis (IP) using oxidized cellulose and internal fixation (n = 8). After 6 months, facet joint fusion was assessed by independent observers, using (1) plain static radiography alone, (2) additional dynamic radiographs, and (3) additional reconstructed spiral CT imaging. These assessments were correlated with high-resolution micro-CT imaging to predict the utility of the conventional imaging techniques in the estimation of fusion success. Results. The capacity of plain radiography alone to correctly predict fusion or pseudarthrosis was 43% and was not improved using plain radiography and dynamic radiography with also a 43% accuracy. Adding assessment by reformatted CT imaging to the plain radiography techniques increased the capacity to predict fusion outcome to 86% correctly. The sensitivity, specificity, and accuracy of static radiography were 0.33, 0.55, and 0.43, respectively, those of dynamic radiography were 0.46, 0.40, and 0.43, respectively, and those of radiography plus CT were 0.88, 0.85, and 0.86, respectively. Conclusion. CT-based evaluation correlated most closely with high-resolution micro-CT imaging. Neither plain static nor dynamic radiographs were able to predict fusion outcome accurately. © 2012 Lippincott Williams & Wilkins.

Reliability and validity of conjunctival ultraviolet autofluorescence measurement

BACKGROUND: Conjunctival ultraviolet autofluorescence (UVAF) photography was developed to detect and characterise pre-clinical sunlight-induced UV damage. The reliability of this measurement and its relationship to outdoor activity are currently unknown. METHODS: 599 people aged 16-85 years in the cross-sectional Norfolk Island Eye Study were included in the validation study. 196 UVAF individual photographs (49 people) and 60 UVAF photographs (15 people) of Norfolk Island Eye Study participants were used for intra- and inter-observer reliability assessment, respectively. Conjunctival UVAF was measured using UV photography. UVAF area was calculated using computerised methods by one grader on two occasions (intra-observer analysis) or two graders (inter-observer analysis). Outdoor activity category, during summer and winter separately, was determined with a UV questionnaire. Total UVAF equalled the area measured in four conjunctival areas (nasal/temporal conjunctiva of right and left eyes). RESULTS: Intra-observer (ρ_c=0.988, 95% CI 0.967 to 0.996, p<0.001), and inter-observer concordance correlation coefficients (ρ_c=0.924, 95% CI 0.870 to 0.956, p<0.001) of total UVAF exceeded 0.900. When grouped according to 10 mm(2) total UVAF increments, intra- and inter-observer reliability was very good (κ=0.81) and good (κ=0.71), respectively. Increasing time outdoors was strongly with increasing total UVAF in summer and winter (p(trend) <0.001). CONCLUSION: Intra- and inter-observer reliability of conjunctival UVAF is high. In this population, UVAF correlates strongly with the authors' survey-based assessment of time spent outdoors.

Entorhinal cortex volume in older adults: reliability and validity considerations for three published measurement protocols.

Measuring the entorhinal cortex (ERC) is challenging due to lateral border discrimination from the perirhinal cortex. From a sample of 39 nondemented older adults who completed volumetric image scans and verbal memory indices, we examined reliability and validity concerns for three ERC protocols with different lateral boundary guidelines (i.e., Goncharova, Dickerson, Stoub, & deToledo-Morrell, 2001; Honeycutt et al., 1998; Insausti et al., 1998). We used three novice raters to assess inter-rater reliability on a subset of scans (216 total ERCs), with the entire dataset measured by one rater with strong intra-rater reliability on each technique (234 total ERCs). We found moderate to strong inter-rater reliability for two techniques with consistent ERC lateral boundary endpoints (Goncharova, Honeycutt), with negligible to moderate reliability for the technique requiring consideration of collateral sulcal depth (Insausti). Left ERC and story memory associations were moderate and positive for two techniques designed to exclude the perirhinal cortex (Insausti, Goncharova), with the Insausti technique continuing to explain 10% of memory score variance after additionally controlling for depression symptom severity. Right ERC-story memory associations were nonexistent after excluding an outlier. Researchers are encouraged to consider challenges of rater training for ERC techniques and how lateral boundary endpoints may impact structure-function associations.