The SF36 Version 2: critical analyses of population weights, scoring algorithms and population norms

Background: The SF36 Version 2 (SF36V2) is a revision of the SF36 Version 1, and is a widely used health status measure. It is important that guidelines for interpreting scores are available.

Method: A population sample of Australians (n = 3015) weighted to achieve representativeness was administered the SF36V2. Comparisons between published US weights and sample derived weights were made, and Australian population norms computed and presented.

Major findings: Significant differences were observed on 7/8 scales and on the mental health summary scale. Possible causes of these findings may include different sampling and data collection procedures, demographic characteristics, differences in data collection time (1998 vs. 2004), differences in health status or differences in cultural perception of the meaning of health. Australian population norms by age cohort, gender and health status are reported by T-score as recommended by the instrument developers. Additionally, the proportions of cases within T-score deciles are presented and show there are important data distribution issues.

Principal conclusions: The procedures reported here may be used by other researchers where local effects are suspected. The population norms presented may be of interest. There are statistical artefacts associated with T-scores that have implications for how SF36V2 data are analysed and interpreted.

On the communal analysis suspicion scoring for identity crime in streaming credit applications

This paper describes a rapid technique: communal analysis suspicion scoring (CASS), for generating numeric suspicion scores on streaming credit applications based on implicit links to each other, over both time and space. CASS includes pair-wise communal scoring of identifier attributes for applications, definition of categories of suspiciousness for application-pairs, the incorporation of temporal and spatial weights, and smoothed k-wise scoring of multiple linked application-pairs. Results on mining several hundred thousand real credit applications demonstrate that CASS reduces false alarm rates while maintaining reasonable hit rates. CASS is scalable for this large data sample, and can rapidly detect early symptoms of identity crime. In addition, new insights have been observed from the relationships between applications.

Learning weights in the generalized OWA operators

This paper discusses identification of parameters of generalized ordered weighted averaging (GOWA) operators from empirical data. Similarly to ordinary OWA operators, GOWA are characterized by a vector of weights, as well as the power to which the arguments are raised. We develop optimization techniques which allow one to fit such operators to the observed data. We also generalize these methods for functional defined GOWA and generalized Choquet integral based aggregation operators.

Coronary artery stenoses: detection with calcium scoring, CT angiography, and both methods combined

PURPOSE: To investigate prospectively the relative accuracy of computed tomographic (CT) angiography, calcium scoring (CS), and both methods combined in demonstrating coronary artery stenoses by using conventional angiography as the reference standard. MATERIALS AND METHODS: The study was approved by the institutional review board Human Research Ethics Committee, and all patients completed written informed consent. Fifty patients (40 men, 10 women) aged 62 years ± 11 (± standard deviation) who were suspected of having coronary artery disease underwent both conventional coronary angiography and multisection coronary CT angiography with CS. Sensitivity and specificity of CS, CT angiography, and both methods combined in demonstrating luminal stenosis greater than or equal to 50% were determined for each arterial segment, coronary vessel, and patient. Receiver operating characteristic (ROC) curves were generated for CS prediction of significant stenosis, and the Mann-Whitney U test was used for comparison of CS between groups. RESULTS: When used with segment-specific electrocardiographic phase reconstructions, CT angiography demonstrated stenosed segments with 79% sensitivity and 95% specificity. Mean calcium score was greater in segments, vessels, and patients with stenoses than in segments, vessels, and patients without stenoses (P < .001 for all); nine (16%) of 56 stenosed segments, however, had a calcium score of 0. The patient calcium score correlated strongly with the number of stenosed arteries (Spearman {rho} = 0.75, P < .001). CS was more accurate in demonstrating stenosis in patients than in segments (areas under ROC curve were 0.88 and 0.74, respectively). CT angiography, however, was more accurate than CS in demonstrating stenosis in patients, vessels, and segments. The sensitivity and specificity of CS varied according to the threshold used, but when the calcium score cutoff (ie, >150) matched the specificity of CT angiography (95%), the sensitivity of CS in demonstrating stenosed segments was 29% (compared with 79% for CT angiography). Combining CT angiography with CS (at threshold of 400) improved the sensitivity of CT angiography (from 93% to 100%) in demonstrating significant coronary disease in patients, without a loss of specificity (85%); this finding, however, was not statistically significant. CONCLUSION: CT angiography is more accurate than CS in demonstrating coronary stenoses. A patient calcium score of greater than or equal to 400, however, can be used to potentially identify patients with significant coronary stenoses not detected at CT angiography.

Cross-national agreement on disability weights:the Eurpoean disability weights project

Background: Disability weights represent the relative severity of disease stages to be incorporated in summary measures of population health. The level of agreement on disability weights in Western European countries was investigated with different valuation methods.

Methods: Disability weights for fifteen disease stages were elicited empirically in panels of health care professionals or non-health care professionals with an academic background following a strictly standardised procedure. Three valuation methods were used: a visual analogue scale (VAS); the time trade-off technique (TTO); and the person trade-off technique (PTO). Agreement among England, France, the Netherlands, Spain, and Sweden on the three disability weight sets was analysed by means of an intraclass correlation coefficient (ICC) in the framework of generalisability theory. Agreement among the two types of panels was similarly assessed.

Results: A total of 232 participants were included. Similar rankings of disease stages across countries were found with all valuation methods. The ICC of country agreement on disability weights ranged from 0.56 [95% CI, 0.52–0.62] with PTO to 0.72 [0.70–0.74] with VAS and 0.72 [0.69–0.75] with TTO. The ICC of agreement between health care professionals and non-health care professionals ranged from 0.64 [0.58–0.68] with PTO to 0.73 [0.71–0.75] with VAS and 0.74 [0.72–0.77] with TTO.

Conclusions: Overall, the study supports a reasonably high level of agreement on disability weights in Western European countries with VAS and TTO methods, which focus on individual preferences, but a lower level of agreement with the PTO method, which focuses more on societal values in resource allocation.

Cross-national compartability of burden of disease estimates:the European disability weights project

Objective: To investigate the sources of cross-national variation in disability-adjusted life-years (DALYs) in the European Disability
Weights Project.

Methods: Disability weights for 15 disease stages were derived empirically in five countries by means of a standardized procedure and the cross-national differences in visual analogue scale (VAS) scores were analysed. For each country the burden of dementia in women, used as an illustrative example, was estimated in DALYs. An analysis was performed of the relative effects of cross-national variations in demography, epidemiology and disability weights on DALY estimates.

Findings: Cross-national comparison of VAS scores showed almost identical ranking orders. After standardization for population size and age structure of the populations, the DALY rates per 100 000 women ranged from 1050 in France to 1404 in the Netherlands. Because of uncertainties in the epidemiological data, the extent to which these differences reflected true variation between countries was difficult to estimate. The use of European rather than country-specific disability weights did not lead to a significant change in the burden of disease estimates for dementia.

Conclusions: Sound epidemiological data are the first requirement for burden of disease estimation and relevant between-countries comparisons. DALY estimates for dementia were relatively insensitive to differences in disability weights between European countries.

Identification of weights in aggregation operators

This chapter provides a review of various techniques for identification of weights in generalized mean and ordered weighted averaging aggregation operators, as well as identification of fuzzy measures in Choquet integral based operators. Our main focus is on using empirical data to compute the weights. We present a number of practical algorithms to identify the best aggregation operator that fits the data.

The use of scoring rubrics to determine clinical performance in the operating suite

Summary : This research evolved out of the need to examine the validity and inter-rater reliability of a set of performance-based scoring rubrics designed to measure competencies within the operating suite.

Method : Both holistic and analytical rubrics were developed aligned to the ACORN Standard [Australian College of Operating Room Nurses Standard NR4, 2004. ACORN Competency Standards for Perioperative Nurses: Standard NR4: The Instrument Nurse in the Perioperative Environment. Australian College of Operating Room Nurses Ltd, Adelaide] and underpinned by the Dreyfus model (1981). Three video clips that captured varying performance of nurses performing as instrument nurses in the operating suite were recorded and used as prompts by expert raters, who judged the performance using the rubrics.

Results : The study found that the holistic rubrics led to more consistent judgments than the analytical rubrics, yet the latter provided more diagnostic information for intervention purposes. Despite less consistency, the Analytical Observation Form had sufficient construct validity to satisfy the requirements of criterion referencing as determined by the Item Separation Index (Rasch, 1960), including high internal consistency and greater inter-rater reliability when average ratings were used.

Conclusion : The study was an empirical investigation of the use of concomitant Analytical and Holistic Rubrics to determine various levels of performance in the operating suite including inter-rater reliability. The methodology chosen was theoretically sound and sufficiently flexible to be used to develop other competencies within the operating suite.

Consensus scoring, correct responses and reliability of the MSCEIT V2

The scoring protocol adopted by the MSCEIT V2 has been criticised since its development. The present study raises questions regarding the value of consensus scoring by analysing responses within the categorical subscales of Changes and Blends using the Optimal Scaling technique within the Categorical Principal Components Analysis (CATPCA) via Statistical Package for the Social Sciences (SPSS), (n = 206). On a number of occasions, there was no clear agreement as to the ‘‘correct” response to items within these categorical subscales. Such an issue seems integral to the application of the MSCEIT V2 and one which deserves more attention. On a more positive note, improvements were made to the reliabilities of the subscales of Changes and Blends, using Optimal Scaling, but less so for Changes. Nevertheless, this raises the possibility of improving the reliabilities of other subscales in the MSCEIT V2 and in turn improving the power of subsequent statistical tests.

Computer-assisted image analysis of liver collagen: relationship to Ishak scoring and hepatic venous pressure gradient

Histopathological scoring of disease stage uses descriptive categories without measuring the amount of fibrosis. Collagen, the major component of fibrous tissue, can be quantified by computer-assisted digital image analysis (DIA) using histological sections. We determined relationships between DIA, Ishak stage, and hepatic venous pressure gradient (HVPG) reflecting severity of fibrosis. One hundred fifteen patients with hepatitis C virus (HCV) who had undergone transplantation had 250 consecutive transjugular liver biopsies combined with HVPG (median length, 22 mm; median total portal tracts, 12), evaluated using the Ishak system and stained with Sirus red for DIA. Liver collagen was expressed as collagen proportionate area (CPA). Median CPA was 6% (0.2-45), correlating with Ishak stage (stage 6 range, 13%-45%), and with HVPG (r = 0.62; P < 0.001). Median CPA was 4.1% when HVPG was less than 6 mm Hg and 13.8% when HVPG was 6 mm Hg or more (P < 0.0001) and 6% when HVPG was less than 10 mm Hg and 17.3% when HVPG was 10 mm Hg or higher (P < 0.0001). Only CPA, not Ishak stage/grade, was independently associated by logistic regression, with HVPG of 6 mm Hg or more [odds ratio, 1.206; 95% confidence interval (CI), 1.094-1.331; P < 0.001], or HVPG of 10 mm Hg or more (odds ratio, 1.105; 95% CI, 1.026-1.191; P = 0.009). CPA increased by 50% (3.6%) compared with 20% in HVPG (1 mm Hg) in 38 patients with repeated biopsies. Conclusion: CPA assessed by DIA correlated with Ishak stage scores and HVPG measured contemporaneously. CPA was a better histological correlate with HVPG than Ishak stage, had a greater numerical change when HVPG was low, and resulted in further quantitation of fibrosis in cirrhosis.

Assessing body condition and energy budget components by scoring abdominal profiles in free-ranging pink-footed geese Anser brachyrhynchus

An abdominal profile index (API) was developed for pink-footed geese Anser brachyrhynchus as a measure of body condition. On basis of carcass analysis of 56 adult geese with known API prior to collection, we found significant linear relationships between API against body mass, abdominal fat and total energy content. Hence, changes in API reflect net energy intake rates. As an example of the applicability of the calibration, we compared APIs of individually marked geese before and after long migration episodes and estimated the cost of flight at 8.9 kJ/km. In addition we estimated gain rates at three major staging sites along the spring flyway indicating an increase in fueling rates with latitude. Calibration of APIs and energy contents offers new opportunities for field studies of waterfowl energetics.