The Total Deviation Index estimated by Tolerance Intervals to evaluate the concordance of measurement devices

Background In an agreement assay, it is of interest to evaluate the degree of agreement between the different methods (devices, instruments or observers) used to measure the same characteristic. We propose in this study a technical simplification for inference about the total deviation index (TDI) estimate to assess agreement between two devices of normally-distributed measurements and describe its utility to evaluate inter- and intra-rater agreement if more than one reading per subject is available for each device. Methods We propose to estimate the TDI by constructing a probability interval of the difference in paired measurements between devices, and thereafter, we derive a tolerance interval (TI) procedure as a natural way to make inferences about probability limit estimates. We also describe how the proposed method can be used to compute bounds of the coverage probability. Results The approach is illustrated in a real case example where the agreement between two instruments, a handle mercury sphygmomanometer device and an OMRON 711 automatic device, is assessed in a sample of 384 subjects where measures of systolic blood pressure were taken twice by each device. A simulation study procedure is implemented to evaluate and compare the accuracy of the approach to two already established methods, showing that the TI approximation produces accurate empirical confidence levels which are reasonably close to the nominal confidence level. Conclusions The method proposed is straightforward since the TDI estimate is derived directly from a probability interval of a normally-distributed variable in its original scale, without further transformations. Thereafter, a natural way of making inferences about this estimate is to derive the appropriate TI. Constructions of TI based on normal populations are implemented in most standard statistical packages, thus making it simpler for any practitioner to implement our proposal to assess agreement.

The single principle of compositional data analysis, continuing fallacies, confusionsand misunderstandings and some suggested remedies

In any discipline, where uncertainty and variability are present, it is important to haveprinciples which are accepted as inviolate and which should therefore drive statisticalmodelling, statistical analysis of data and any inferences from such an analysis.Despite the fact that two such principles have existed over the last two decades andfrom these a sensible, meaningful methodology has been developed for the statisticalanalysis of compositional data, the application of inappropriate and/or meaninglessmethods persists in many areas of application. This paper identifies at least tencommon fallacies and confusions in compositional data analysis with illustrativeexamples and provides readers with necessary, and hopefully sufficient, arguments topersuade the culprits why and how they should amend their ways

Validation of an instrument to evaluate quality of life in the aging population: WHOQOL-AGE.

BACKGROUND: There is a need for short, specific instruments that assess quality of life (QOL) adequately in the older adult population. The aims of the present study were to obtain evidence on the validity of the inferences that could be drawn from an instrument to measure QOL in the aging population (people 50+ years old), and to test its psychometric properties. METHODS: The instrument, WHOQOL-AGE, comprised 13 positive items, assessed on a five-point rating scale, and was administered to nationally representative samples (n = 9987) from Finland, Poland, and Spain. Cronbach's alpha was employed to assess internal consistency reliability, whereas the validity of the questionnaire was assessed by means of factor analysis, graded response model, Pearson's correlation coefficient and unpaired t-test. Normative values were calculated across countries and for different age groups. RESULTS: The satisfactory goodness-of-fit indices confirmed that the factorial structure of WHOQOL-AGE comprises two first-order factors. Cronbach's alpha was 0.88 for factor 1, and 0.84 for factor 2. Evidence supporting a global score was found with a second-order factor model, according to the goodness-of-fit indices: CFI = 0.93, TLI = 0.91, RMSEA = 0.073. Convergent validity was estimated at r = 0.75 and adequate discriminant validity was also found. Significant differences were found between healthy individuals (74.19 ± 13.21) and individuals with at least one chronic condition (64.29 ± 16.29), supporting adequate known-groups validity. CONCLUSIONS: WHOQOL-AGE has shown good psychometric properties in Finland, Poland, and Spain. Therefore, considerable support is provided to using the WHOQOL-AGE to measure QOL in older adults in these countries, and to compare the QOL of older and younger adults.