A combined score test for binary and ordinal endpoints from clinical trials

There is growing interest, especially for trials in stroke, in combining multiple endpoints in a single clinical evaluation of an experimental treatment. The endpoints might be repeated evaluations of the same characteristic or alternative measures of progress on different scales. Often they will be binary or ordinal, and those are the cases studied here. In this paper we take a direct approach to combining the univariate score statistics for comparing treatments with respect to each endpoint. The correlations between the score statistics are derived and used to allow a valid combined score test to be applied. A sample size formula is deduced and application in sequential designs is discussed. The method is compared with an alternative approach based on generalized estimating equations in an illustrative analysis and replicated simulations, and the advantages and disadvantages of the two approaches are discussed.

Equitability revisited: why the “equitable threat score” is not equitable

In the forecasting of binary events, verification measures that are “equitable” were defined by Gandin and Murphy to satisfy two requirements: 1) they award all random forecasting systems, including those that always issue the same forecast, the same expected score (typically zero), and 2) they are expressible as the linear weighted sum of the elements of the contingency table, where the weights are independent of the entries in the table, apart from the base rate. The authors demonstrate that the widely used “equitable threat score” (ETS), as well as numerous others, satisfies neither of these requirements and only satisfies the first requirement in the limit of an infinite sample size. Such measures are referred to as “asymptotically equitable.” In the case of ETS, the expected score of a random forecasting system is always positive and only falls below 0.01 when the number of samples is greater than around 30. Two other asymptotically equitable measures are the odds ratio skill score and the symmetric extreme dependency score, which are more strongly inequitable than ETS, particularly for rare events; for example, when the base rate is 2% and the sample size is 1000, random but unbiased forecasting systems yield an expected score of around −0.5, reducing in magnitude to −0.01 or smaller only for sample sizes exceeding 25 000. This presents a problem since these nonlinear measures have other desirable properties, in particular being reliable indicators of skill for rare events (provided that the sample size is large enough). A potential way to reconcile these properties with equitability is to recognize that Gandin and Murphy’s two requirements are independent, and the second can be safely discarded without losing the key advantages of equitability that are embodied in the first. This enables inequitable and asymptotically equitable measures to be scaled to make them equitable, while retaining their nonlinearity and other properties such as being reliable indicators of skill for rare events. It also opens up the possibility of designing new equitable verification measures.

Reactions of NO3 with the man-made emissions 2-methylpent-2-ene, (Z)-3-methylpent-2-ene, ethyl vinyl ether, and the stress-induced plant emission ethyl vinyl ketone

Rate coefficients for reactions of nitrate radicals (NO3) with the anthropogenic emissions 2-methylpent-2-ene, (Z)-3-methylpent-2-ene.. ethyl vinyl ether, and the stress-induced plant emission ethyl vinyl ketone (pent-1-en-3-one) were determined to be (9.3 +/- 1.1) x 10(-12), (9.3 +/- 3.2) x 10(-12), (1.7 +/- 1.3) x 10(-12) and (9.4 + 2.7) x 10(-17) cm(3) molecule(-1) s(-1). We performed kinetic experiments at room temperature and atmospheric pressure using a relative-rate technique with GC-FID analysis. Experiments with ethyl vinyl ether required a modification of our established procedure that might introduce additional uncertainties, and the errors suggested reflect these difficulties. Rate coefficients are discussed in terms of electronic and steric influences. Atmospheric lifetimes with respect to important oxidants in the troposphere were calculated. NO3-initiated oxidation is found to be the strongly dominating degradation route for 2-methylpent-2-ene, (Z)-3-methylpent-2-ene and ethyl vinyl ether. Atmospheric concentrations of the alkenes and their relative contribution to the total NMHC emissions from trucks can be expected to increase if plans for the introduction of particle filters for diesel engines are implemented on a global scale. Thus more kinetic data are required to better evaluate the impact of these emissions.

Gas-phase reactions of NO3 and N2O5 with (Z)-hex-4-en-1-ol, (Z)-hex-3-en-1-ol ('leaf alcohol'), (E)-hex-3-en-1-ol, (Z)-hex-2-en-1-ol and (E)-hex-2-en-1-ol

The night-time atmospheric chemistry of the biogenic volatile organic compounds (Z)-hex-4-en-1-ol, (Z)-hex-3-en-1-ol ('leaf alcohol'), (E)-hex-3-en-1-ol, (Z)-hex-2-en-1-ol and (E)-hex-2-en-1-ol, has been studied at room temperature. Rate coefficients for reactions of the nitrate radical (NO3) with these stress-induced plant emissions were measured using the discharge-flow technique. We employed off-axis continuous-wave cavity-enhanced absorption spectroscopy (CEAS) for the detection of NO3, which enabled us to work in excess of the hexenol compounds over NO3. The rate coefficients determined were (2.93 +/- 0.58) x 10(-13) cm(3) molecule(-1) s(-1), (2.67 +/- 0.42) x 10(-13) cm(3) molecule(-1) s(-1), (4.43 +/- 0.91) x 10(-13) cm(3) molecule(-1) s(-1), (1.56 +/- 0.24) x 10(-13) cm(3) molecule(-1) s(-1), and (1.30 +/- 0.24) x 10(-13) cm(3) molecule(-1) s(-1) for (Z)-hex-4-en-1-ol, (Z)-hex-3en-1-ol, (E)-hex-3-en-1-ol, (Z)-hex-2-en-1-ol and (E)-hex-2-en-1-ol. The rate coefficient for the reaction of NO3 with (Z)-hex-3-en-1-ol agrees with the single published determination of the rate coefficient using a relative method. The other rate coefficients have not been measured before and are compared to estimated values. Relative-rate studies were also performed, but required modification of the standard technique because N2O5 (used as the source of NO3) itself reacts with the hexenols. We used varying excesses of NO2 to determine simultaneously rate coefficients for reactions of NO3 and N2O5 with (E)-hex-3-en-1-ol of (5.2 +/- 1.8) x 10(-13) cm(3) molecule(-1) s(-1) and (3.1 +/- 2.3) x 10(-18) cm(3) molecule(-1) s(-1). Our new determinations suggest atmospheric lifetimes with respect to NO3-initiated oxidation of roughly 1-4 h for the hexenols, comparable with lifetimes estimated for the atmospheric degradation by OH and shorter lifetimes than for attack by O-3. Recent measurements of [N2O5] suggest that the gas-phase reactions of N2O5 with unsaturated alcohols will not be of importance under usual atmospheric conditions, but they certainly can be in laboratory systems when determining rate coefficients.

Gas-phase rate coefficients for the reactions of nitrate radicals with (Z)-pent-2-ene, (E)-pent-2-ene, (Z)-hex-2-ene, (E)-hex-2-ene, (Z)-hex-3-ene, (E)-hex-3-ene and (E)-3-methylpent-2-ene at room temperature

Rate coefficients for reactions of nitrate radicals (NO3) with (Z)-pent-2-ene, (E)-pent-2-ene, (Z)-hex-2-ene, (E)-hex-2-ene, (Z)-hex-3-ene, (E)-hex-3-ene and (E)-3-methylpent-2-ene were determined to be (6.55 +/- 0.78) x 10(-13) cm(3) molecule(-1) s(-1), (3.78 +/- 0.45) x 10(-13) cm(3) molecule(-1) s(-1), (5.30 +/- 0.73) x 10(-13) cm(3) molecule(-1) s(-1), (3.83 +/- 0.47) x 10(-13) cm(3) molecule(-1) s(-1), (4.37 +/- 0.49) x 10(-13) cm(3) molecule(-1) s(-1), (3.61 +/- 0.40) x 10(-13) cm(3) molecule(-1) s(-1) and (8.9 +/- 1.5) x 10(-12) cm(3) molecule(-1) s(-1), respectively. We performed kinetic experiments at room temperature and atmospheric pressure using a relative-rate technique with GC-FID analysis. The experimental results demonstrate a surprisingly large cis-trans (Z-E) effect, particularly in the case of the pent-2-enes, where the ratio of rate coefficients is ca. 1.7. Rate coefficients are discussed in terms of electronic and steric influences, and our results give some insight into the effects of chain length and position of the double bond on the reaction of NO3 with unsaturated hydrocarbons. Atmospheric lifetimes were calculated with respect to important oxidants in the troposphere for the alkenes studied, and NO3-initiated oxidation is found to be the dominant degradation route for (Z)-pent-2-ene, (Z)-hex-3-ene and (E)-3-methylpent-2-ene.

Night-time tropospheric chemistry of the unsaturated alcohols (Z)-pent-2-en-1-ol and pent-1-en-3-ol: Kinetic studies of reactions of NO3 and N2O5 with stress-induced plant emissions

The night-time tropospheric chemistry of two stress-induced volatile organic compounds (VOCs), (Z)-pent-2-en-1-ol and pent-1-en-3-ol, has been studied at room temperature. Rate coefficients for reactions of the nitrate radical (NO3) with these pentenols were measured using the discharge-flow technique. Because of the relatively low volatility of these compounds, we employed off-axis continuous-wave cavity-enhanced absorption spectroscopy for detection of NO3 in order to be able to work in pseudo first-order conditions with the pentenols in large excess over NO3. The rate coefficients were determined to be (1.53 +/- 0.23) x 10(-13) and (1.39 +/- 0.19) x 10(-14) cm(3) molecule(-1) s(-1) for reactions of NO3 with (Z)-pent-2-en-1-ol and pent-1-en-3-ol. An attempt to study the kinetics of these reactions with a relative-rate technique, using N2O5 as source of NO3 resulted in significantly higher apparent rate coefficients. Performing relative-rate experiments in known excesses of NO2 allowed us to determine the rate coefficients for the N2O5 reactions to be (5.0 +/- 2.8) x 10(-19) cm(3) molecule(-1) s(-1) for (Z)-pent-2-en-1-ol, and (9.1 +/- 5.8) x 10(-19) cm(3) molecule(-1) s(-1) for pent-1-en-3-ol. We show that these relatively slow reactions can indeed interfere with rate determinations in conventional relative-rate experiments.

Spectroscopic properties of alkenylferrocenes; crystal and molecular structure of (Z)-(1,2-diphenylethenyl)ferrocene

Studies of the 1H n.m.r. and electronic spectra of a series of alkenylferrocenes including (E) and (Z) stereoisomers of various styrylferrocenes, have provided methods of structure elucidation. Crystals of the title compound are monoclinic, space group P21/c with Z= 4 in a unit cell of dimensions a= 17.603(2), b= 10.218(2), c= 10.072 Å, β= 103.27(2)°. The structure has been determined by the heavy-atom method from diffractometer data and refind by full-matrix least-squares techniques to R= 0.043 for 2 219 unique reflections.

A method for the economic valuation of animal welfare benefits using a single welfare score

Unless the benefits to society of measures to protect and improve the welfare of animals are made transparent by means of their valuation they are likely to go unrecognised and cannot easily be weighed against the costs of such measures as required, for example, by policy-makers. A simple single measure scoring system, based on the Welfare Quality® index, is used, together with a choice experiment economic valuation method, to estimate the value that people place on improvements to the welfare of different farm animal species measured on a continuous (0-100) scale. Results from using the method on a survey sample of some 300 people show that it is able to elicit apparently credible values. The survey found that 96% of respondents thought that we have a moral obligation to safeguard the welfare of animals and that over 72% were concerned about the way farm animals are treated. Estimated mean annual willingness to pay for meat from animals with improved welfare of just one point on the scale was £5.24 for beef cattle, £4.57 for pigs and £5.10 for meat chickens. Further development of the method is required to capture the total economic value of animal welfare benefits. Despite this, the method is considered a practical means for obtaining economic values that can be used in the cost-benefit appraisal of policy measures intended to improve the welfare of animals.

Estimating reliability and resolution of probability forecasts through decomposition of the empirical score

References (20)Cited By (1)Export CitationAboutAbstract Proper scoring rules provide a useful means to evaluate probabilistic forecasts. Independent from scoring rules, it has been argued that reliability and resolution are desirable forecast attributes. The mathematical expectation value of the score allows for a decomposition into reliability and resolution related terms, demonstrating a relationship between scoring rules and reliability/resolution. A similar decomposition holds for the empirical (i.e. sample average) score over an archive of forecast–observation pairs. This empirical decomposition though provides a too optimistic estimate of the potential score (i.e. the optimum score which could be obtained through recalibration), showing that a forecast assessment based solely on the empirical resolution and reliability terms will be misleading. The differences between the theoretical and empirical decomposition are investigated, and specific recommendations are given how to obtain better estimators of reliability and resolution in the case of the Brier and Ignorance scoring rule.

Evaluating raw ensembles with the continuous ranked probability score

The continuous ranked probability score (CRPS) is a frequently used scoring rule. In contrast with many other scoring rules, the CRPS evaluates cumulative distribution functions. An ensemble of forecasts can easily be converted into a piecewise constant cumulative distribution function with steps at the ensemble members. This renders the CRPS a convenient scoring rule for the evaluation of ‘raw’ ensembles, obviating the need for sophisticated ensemble model output statistics or dressing methods prior to evaluation. In this article, a relation between the CRPS score and the quantile score is established. The evaluation of ‘raw’ ensembles using the CRPS is discussed in this light. It is shown that latent in this evaluation is an interpretation of the ensemble as quantiles but with non-uniform levels. This needs to be taken into account if the ensemble is evaluated further, for example with rank histograms.

'Score it upon my taille': the use (and abuse) of tallies by the medieval Exchequer

The paper traces the evolution of the tally from a receipt for cash payments into the treasury, to proof of payments made by royal officials outside of the treasury and finally to an assignment of revenue to be paid out by royal officials. Each of these processes is illustrated by examples drawn from the Exchequer records and explains their significance for royal finance and for historians working on the Exchequer records.