Disagreements in meta-analyses using outcomes measured on continuous or rating scales: observer agreement study

OBJECTIVE: To study the inter-observer variation related to extraction of continuous and numerical rating scale data from trial reports for use in meta-analyses. DESIGN: Observer agreement study. DATA SOURCES: A random sample of 10 Cochrane reviews that presented a result as a standardised mean difference (SMD), the protocols for the reviews and the trial reports (n=45) were retrieved. DATA EXTRACTION: Five experienced methodologists and five PhD students independently extracted data from the trial reports for calculation of the first SMD result in each review. The observers did not have access to the reviews but to the protocols, where the relevant outcome was highlighted. The agreement was analysed at both trial and meta-analysis level, pairing the observers in all possible ways (45 pairs, yielding 2025 pairs of trials and 450 pairs of meta-analyses). Agreement was defined as SMDs that differed less than 0.1 in their point estimates or confidence intervals. RESULTS: The agreement was 53% at trial level and 31% at meta-analysis level. Including all pairs, the median disagreement was SMD=0.22 (interquartile range 0.07-0.61). The experts agreed somewhat more than the PhD students at trial level (61% v 46%), but not at meta-analysis level. Important reasons for disagreement were differences in selection of time points, scales, control groups, and type of calculations; whether to include a trial in the meta-analysis; and data extraction errors made by the observers. In 14 out of the 100 SMDs calculated at the meta-analysis level, individual observers reached different conclusions than the originally published review. CONCLUSIONS: Disagreements were common and often larger than the effect of commonly used treatments. Meta-analyses using SMDs are prone to observer variation and should be interpreted with caution. The reliability of meta-analyses might be improved by having more detailed review protocols, more than one observer, and statistical expertise.

Body image rating scales to assess obesity

Obesity prevalence in the U.S. has increased during the last three decades with major impact on public health. Screening for obesity in a population with unknown weight status can be time- and resource-consuming, but the information is valuable for prioritizing and allocating scarce resources. The challenge remains to properly assess obesity with the available methods. Body Image Rating Scales (BIRS) have initially been developed to assess body image disturbances, but also seem useful as an alternative method in assessing obesity prevalence. Several different BIRS exists. In this project I reviewed the literature that exists regarding the use of BIRS, and its advantages and limitations for the assessment of obesity status with regards to BMI. The result yielded nine publications that examined eight different scales and their correlation with BMI, ranging from r=.59 for self-reported BMI to r=.94 for measured BMI. One concern is the lack of standardization of this method to assess obesity, given the range of different scales. While many methods for obesity assessment are available, the simplicity, ease of use and cost-effectiveness of BIRS make it very appealing. BIRS remain a potentially attractive option to assess the weight status of a large population with minimal requirements in assets and time, especially in situations where measuring instruments are not available, or when height or weight could not be recalled.^

The ISR and ESR scales : measures of the project manager-stakeholder relationship

In this paper, we develop two stakeholder relationships scales. These scales assess project managers’ perceived competence in establishing and maintaining high quality, effective relationships with people internal to the project as well as those stakeholders who are external to the project. We developed the scales using an online survey study of three hundred and seventy three complex project managers from a sub-set of the Australian Defence Industry. Both the internal stakeholder relationships’ scale and the external stakeholder relationships’ scale demonstrated validity and reliability. This research has implications for the interpersonal work relationships’ literature and the stakeholder management literature. We recommend future research tests these scales with multiple samples, across different project types and project industries. The stakeholder relationships’ scales should be versatile enough to be applied to project management generally but are best suited to large-scale complex project environments.

Condition monitoring and rating of bridge components in a rail or road network by using SHM systems within SRP

The safety and performance of bridges could be monitored and evaluated by Structural Health Monitoring (SHM) systems. These systems try to identify and locate the damages in a structure and estimate their severities. Current SHM systems are applied to a single bridge, and they have not been used to monitor the structural condition of a network of bridges. This paper propose a new method which will be used in Synthetic Rating Procedures (SRP) developed by the authors of this paper and utilizes SHM systems for monitoring and evaluating the condition of a network of bridges. Synthetic rating procedures are used to assess the condition of a network of bridges and identify their ratings. As an additional part of the SRP, the method proposed in this paper can continuously monitor the behaviour of a network of bridges and therefore it can assist to prevent the sudden collapses of bridges or the disruptions to their serviceability. The method could be an important part of a bridge management system (BMS) for managers and engineers who work on condition assessment of a network of bridges.

Growing length and time scales in glass-forming liquids

The glass transition, whereby liquids transform into amorphous solids at low temperatures, is a subject of intense research despite decades of investigation. Explaining the enormous increase in relaxation times of a liquid upon supercooling is essential for understanding the glass transition. Although many theories, such as the Adam-Gibbs theory, have sought to relate growing relaxation times to length scales associated with spatial correlations in liquid structure or motion of molecules, the role of length scales in glassy dynamics is not well established. Recent studies of spatially correlated rearrangements of molecules leading to structural relaxation, termed ``spatially heterogeneous dynamics,'' provide fresh impetus in this direction. A powerful approach to extract length scales in critical phenomena is finite-size scaling, wherein a system is studied for sizes traversing the length scales of interest. We perform finite-size scaling for a realistic glass-former, using computer simulations, to evaluate the length scale associated with spatially heterogeneous dynamics, which grows as temperature decreases. However, relaxation times that also grow with decreasing temperature do not exhibit standard finite-size scaling with this length. We show that relaxation times are instead determined, for all studied system sizes and temperatures, by configurational entropy, in accordance with the Adam-Gibbs relation, but in disagreement with theoretical expectations based on spin-glass models that configurational entropy is not relevant at temperatures substantially above the critical temperature of mode-coupling theory. Our results provide new insights into the dynamics of glass-forming liquids and pose serious challenges to existing theoretical descriptions.

Classification and rating of strong-motion earthquake records

Ninety-two strong-motion earthquake records from the California region, U.S.A., have been statistically studied using principal component analysis in terms of twelve important standardized strong-motion characteristics. The first two principal components account for about 57 per cent of the total variance. Based on these two components the earthquake records are classified into nine groups in a two-dimensional principal component plane. Also a unidimensional engineering rating scale is proposed. The procedure can be used as an objective approach for classifying and rating future earthquakes.

Interplay between multiple length and time scales in complex chemical systems

Processes in complex chemical systems, such as macromolecules, electrolytes, interfaces, micelles and enzymes, can span several orders of magnitude in length and time scales. The length and time scales of processes occurring over this broad time and space window are frequently coupled to give rise to the control necessary to ensure specificity and the uniqueness of the chemical phenomena. A combination of experimental, theoretical and computational techniques that can address a multiplicity of length and time scales is required in order to understand and predict structure and dynamics in such complex systems. This review highlights recent experimental developments that allow one to probe structure and dynamics at increasingly smaller length and time scales. The key theoretical approaches and computational strategies for integrating information across time-scales are discussed. The application of these ideas to understand phenomena in various areas, ranging from materials science to biology, is illustrated in the context of current developments in the areas of liquids and solvation, protein folding and aggregation and phase transitions, nucleation and self-assembly.

Modelling the influence of land-use changes on biophysical and biochemical interactions at regional and global scales

Land-use changes since the start of the industrial era account for nearly one-third of the cumulative anthropogenic CO2 emissions. In addition to the greenhouse effect of CO2 emissions, changes in land use also affect climate via changes in surface physical properties such as albedo, evapotranspiration and roughness length. Recent modelling studies suggest that these biophysical components may be comparable with biochemical effects. In regard to climate change, the effects of these two distinct processes may counterbalance one another both regionally and, possibly, globally. In this article, through hypothetical large-scale deforestation simulations using a global climate model, we contrast the implications of afforestation on ameliorating or enhancing anthropogenic contributions from previously converted (agricultural) land surfaces. Based on our review of past studies on this subject, we conclude that the sum of both biophysical and biochemical effects should be assessed when large-scale afforestation is used for countering global warming, and the net effect on global mean temperature change depends on the location of deforestation/afforestation. Further, although biochemical effects trigger global climate change, biophysical effects often cause strong local and regional climate change. The implication of the biophysical effects for adaptation and mitigation of climate change in agriculture and agroforestry sectors is discussed. center dot Land-use changes affect global and regional climates through both biochemical and biophysical process. center dot Climate effect from biophysical process depends on the location of land-use change. center dot Climate mitigation strategies such as afforestation/reforestation should consider the net effect of biochemical and biophysical processes for effective mitigation. center dot Climate-smart agriculture could use bio-geoengineering techniques that consider plant biophysical characteristics such as reflectivity and water use efficiency.

Threshold diversity and trans-scales sensitivity in a finite nonlinear evolution model of materials failure

We present a slice-sampling method and study the ensemble evolution of a large finite nonlinear system in order to model materials failure. There is a transitional region of failure probability. Its size effect is expressed by a slowly decaying scaling law. In a meso-macroscopic range (similar to 10(5)) in realistic failure, the diversity cannot be ignored. Sensitivity to mesoscopic details governs the phenomena. (C) 1997 Published by Elsevier Science B.V.

“Deborah Numbers”, Coupling Multiple Space and Time Scales and Governing Damage Evolution to Failure

Two different spatial levels are involved concerning damage accumulation to eventual failure. nucleation and growth rates of microdamage nN* and V*. It is found that the trans-scale length ratio c*/L does not directly affect the process. Instead, two independent dimensionless numbers: the trans-scale one * * ( V*)including the * **5 * N c V including mesoscopic parameters only, play the key role in the process of damage accumulation to failure. The above implies that there are three time scales involved in the process: the macroscopic imposed time scale tim = /a and two meso-scopic time scales, nucleation and growth of damage, (* *4) N N t =1 n c and tV=c*/V*. Clearly, the dimensionless number De*=tV/tim refers to the ratio of microdamage growth time scale over the macroscopically imposed time scale. So, analogous to the definition of Deborah number as the ratio of relaxation time over external one in rheology. Let De be the imposed Deborah number while De represents the competition and coupling between the microdamage growth and the macroscopically imposed wave loading. In stress-wave induced tensile failure (spallation) De* < 1, this means that microdamage has enough time to grow during the macroscopic wave loading. Thus, the microdamage growth appears to be the predominate mechanism governing the failure. Moreover, the dimensionless number D* = tV/tN characterizes the ratio of two intrinsic mesoscopic time scales: growth over nucleation. Similarly let D be the “intrinsic Deborah number”. Both time scales are relevant to intrinsic relaxation rather than imposed one. Furthermore, the intrinsic Deborah number D* implies a certain characteristic damage. In particular, it is derived that D* is a proper indicator of macroscopic critical damage to damage localization, like D* ∼ (10–3~10–2) in spallation. More importantly, we found that this small intrinsic Deborah number D* indicates the energy partition of microdamage dissipation over bulk plastic work. This explains why spallation can not be formulated by macroscopic energy criterion and must be treated by multi-scale analysis.

Investigations of cohesive zone properties of the interface between metal film and ceramic substrate at nano- and micro-scales

Cohesive zone characterizations of the interface between metal film and ceramic substrate at micro- and nano-scales are performed in the present research. At the nano-scale, a special potential for special material interface (Ag/MgO) is adopted to investigate the interface separation mechanism by using MD simulation, and stress-separation relationship will be obtained. At the micro-scale, peeling experiment is performed for the Al film/Al2O3 substrate system with an adhesive layer at the interface. Adhesive is a mixture of epoxy and polyimide with mass ratio 1:1, by which a brittle cohesive property is obtained. The relationships between energy release rate, the film thickness and the adhesive layer thickness are measured during the steady-state peeling. The experimental result has a similar trend as modeling result for a weak adhesion interface case.