Protocol of the COSMIN study: consensus-based standards for the selection of health measurement instruments

Background: Choosing an adequate measurement instrument depends on the proposed use of the instrument, the concept to be measured, the measurement properties (e.g. internal consistency, reproducibility, content and construct validity, responsiveness, and interpretability), the requirements, the burden for subjects, and costs of the available instruments. As far as measurement properties are concerned, there are no sufficiently specific standards for the evaluation of measurement properties of instruments to measure health status, and also no explicit criteria for what constitutes good measurement properties. In this paper we describe the protocol for the COSMIN study, the objective of which is to develop a checklist that contains COnsensus-based Standards for the selection of health Measurement INstruments, including explicit criteria for satisfying these standards. We will focus on evaluative health related patient-reported outcomes (HR-PROs), i.e. patient-reported health measurement instruments used in a longitudinal design as an outcome measure, excluding health care related PROs, such as satisfaction with care or adherence. The COSMIN standards will be made available in the form of an easily applicable checklist.Method: An international Delphi study will be performed to reach consensus on which and how measurement properties should be assessed, and on criteria for good measurement properties. Two sources of input will be used for the Delphi study: (1) a systematic review of properties, standards and criteria of measurement properties found in systematic reviews of measurement instruments, and (2) an additional literature search of methodological articles presenting a comprehensive checklist of standards and criteria. The Delphi study will consist of four (written) Delphi rounds, with approximately 30 expert panel members with different backgrounds in clinical medicine, biostatistics, psychology, and epidemiology. The final checklist will subsequently be field-tested by assessing the inter-rater reproducibility of the checklist.Discussion: Since the study will mainly be anonymous, problems that are commonly encountered in face-to-face group meetings, such as the dominance of certain persons in the communication process, will be avoided. By performing a Delphi study and involving many experts, the likelihood that the checklist will have sufficient credibility to be accepted and implemented will increase.

The role of causal links in performance measurement models

Abstract Purpose: Several well-known managerial accounting performance measurement models rely on causal assumptions. Whilst users of the models express satisfaction and link them with improved organizational performance, academic research, of the realworld applications, shows few reliable statistical associations. This paper provides a discussion on the"problematic" of causality in a performance measurement setting. Design/methodology/approach: This is a conceptual study based on an analysis and synthesis of the literature from managerial accounting, organizational theory, strategic management and social scientific causal modelling. Findings: The analysis indicates that dynamic, complex and uncertain environments may challenge any reliance upon valid causal models. Due to cognitive limitations and judgmental biases, managers may fail to trace correct cause-and-effect understanding of the value creation in their organizations. However, even lacking this validity, causal models can support strategic learning and perform as organizational guides if they are able to mobilize managerial action. Research limitations/implications: Future research should highlight the characteristics necessary for elaboration of convincing and appealing causal models and the social process of their construction. Practical implications: Managers of organizations using causal models should be clear on the purposes of their particular models and their limitations. In particular, difficulties are observed in specifying detailed cause and effect relations and their potential for communicating and directing attention. They should therefore construct their models to suit the particular purpose envisaged. Originality/value: This paper provides an interdisciplinary and holistic view on the issue of causality in managerial accounting models.

Absolute and relative deprivation and the measurement of poverty

This paper develops the link between poverty and inequality by focussing on a class of poverty indices (some of them well-known) which aggregate normative concerns for absolute and relative deprivation. The indices are distinguished by a parameter that captures the ethical sensitivity of poverty measurement to ``exclusion'' or ``relative-deprivation'' aversion. We also show how the indices can be readily used to predict the impact of growth on poverty. An illustration using LIS data finds that he United States show more relative deprivation than Denmark and Belgium whatever the percentiles considered, but that overall deprivation comparisons of the four countries considered will generally necessarily depend on the intensity of the ethical concern for relative deprivation. The impact of growth on poverty is also seen to depend on the presence of and on the attention granted to concerns over relative deprivation. }

Regional income inequalities in Europe: an updated measurement and some decomposition results

In this paper well-known summary inequality indexes are used to explore interregional income inequalities in Europe. In particular, we mainly employ Theils’population-weighted index because of its appealing properties. Two decomposition analysis are applied. First, regional inequalities are decomposed by regional subgroups (countries). Second, intertemporal inequality changes are separated into income and population changes. The main results can be summarized as follows. First, data confirm a reduction in crossregional inequality during 1982-97. Second, this reduction is basically due to real convergence among countries. Third, currently the greater part of European interregional disparities is within-country by nature, which introduce an important challenge for the European policy. Fourth, inequality changes are due mainly to income variations, population changes playing a minor role.

The Measurement of social polarization in a multi-group context

Polarization indices presented up to now have only focused their attention on the distribution of income/wealth. However, in many circumstances income is not the only relevant dimension that might be the cause of social conflict, so it is very important to have a social polarization index able to cope with alternative dimensions. In this paper we present an axiomatic characterization of one of such indices: it has been obtained as an extension of the (income) polarization measure introduced in Duclos, Esteban and Ray (2004) to a wider domain. It turns out that the axiomatic structure introduced in that paper alone is not appropriate to obtain a fully satisfactory characterization of our measure, so additional axioms are proposed. As a byproduct, we present an alternative axiomatization of the aforementioned income polarization measure.

The causal relationship between Individual’s choice behavior and self-reported satisfaction: the case of residential mobility in the EU

One of the most persistent and lasting debates in economic research refers to whether the answers to subjective questions can be used to explain individuals’ economic behavior. Using panel data for twelve EU countries, in the present study we analyze the causal relationship between self-reported housing satisfaction and residential mobility. Our results indicate that: i) households unsatisfied with their current housing situation are more likely to move; ii) housing satisfaction raises after a move, and; iii) housing satisfaction increases with the transition from being a renter to becoming a homeowner. Some interesting cross-country differences are observed. Our findings provide evidence in favor of use of subjective indicators of satisfaction with certain life domains in the analysis of individuals’ economic conduct.

Individual Aspirations and Satisfaction:Quantifying the Importance of Homeownership

Residential satisfaction is often used as a barometer to assess the performance of public policy and programmes designed to raise individuals' well-being. However, the fact that responses elicited from residents might be biased by subjective, non-observable factors casts doubt on whether these responses can be taken as trustable indicators of the individuals' housing situation. Emotional factors such as aspirations or expectations might affect individuals' cognitions of their true residential situation. To disentangle this puzzle, we investigated whether identical residential attributes can be perceived differently depending on tenure status. Our results indicate that tenure status is crucial not only in determining the level of housing satisfaction, but also regarding how dwellers perceive their housing characteristics. Keywords: Housing satisfaction, subjective well-being, homeownership. JEL classification: D1, R2.

Mobility and Housing Satisfaction: An Empirical Analysis for Twelve EU Countries

Using panel data for twelve EU countries, we analyze the relationship between selfreported housing satisfaction and residential mobility. Our results indicate the existence of a positive link between the two variables and that housing satisfaction exerts a mediating effect between residential characteristics and dwellers' mobility propensities. Some interesting cross-country differences regarding the effect of other variables on mobility are also observed. Our results can be used in defining, implementing and evaluating housing and neighbourhood policies. Residential satisfaction is put forward as one of the most appropriate indicators of the success or failure of such policies. Keywords: Housing satisfaction, residential mobility JEL classification: R21, D19

Disentangling the Housing Satisfaction Puzzle: Does Homeownership Really Matter?

There is a general consensus that homeownership has beneficial effects for both individuals and society in many outcomes. However, research regarding the effect of homeownership on individuals' subjective well-being remains inconclusive. In this paper, for the first time, we provide empirical evidence for the link between homeownership and housing satisfaction using panel data. We use the eight waves of the European Community Household Panel (ECHP) covering the period 1994-2001. We observe that renters who become homeowners not only experience a significant increase in housing satisfaction, but also after changing their tenure status, they obtain a different utility from the same housing context. This evidence might provide support to the hypothesis that a share of the differences in the perceived utility derived from housing can be attributed to (un)fulfilled expectations or aspirations regarding homeownership. Keywords: Housing satisfaction, subjective well-being, homeownership, fixed-effects, housing aspirations JEL classification: D1, R2.

Contextualizing the impact of work organization on employee satisfaction

The paper assesses the relationship between the use of alternative workplace practices (AWP) and job satisfaction. Using a unique employeremployee data set with rich information on both firm and employee characteristics we test whether there is a positive impact of AWPs on job satisfaction (motivation hypothesis) or it is negative (intensification hypothesis). We expand a growing empirical literature focusing on small and medium size firms from a southern European area. Our results show an overall positive effect, depending on the specific practice considered. We also obtain some sort of time-dependence with the effects turning from negative to positive once the practice has been implemented for some time. Keywords: Job satisfaction, work organization, unobserved heterogeneity.

Decomposing the Tourist’s Satisfaction Gap: The Role of Expectations and Cognitions

In this paper we present an empirical methodology that allows the tourist’s satisfaction gap between two destinations to be decomposed into two components. One explains the role of differences in observed characteristics of the tourists and the stay (endowments). The other captures the share of the gap due to differences in the utility that tourists derive from those characteristics (cognitive). To illustrate the use of this method, we employ data coming from a sample of tourists visiting two touristic enclaves in Tarragona (Spain). Our results indicate that the cognitive component explains most of the satisfaction gap. Keywords: Satisfaction, expectations, cognition, touristic destination

Correcting Measurement Error Bias in Interaction Models with Small Samples

Several methods have been suggested to estimate non-linear models with interaction terms in the presence of measurement error. Structural equation models eliminate measurement error bias, but require large samples. Ordinary least squares regression on summated scales, regression on factor scores and partial least squares are appropriate for small samples but do not correct measurement error bias. Two stage least squares regression does correct measurement error bias but the results strongly depend on the instrumental variable choice. This article discusses the old disattenuated regression method as an alternative for correcting measurement error in small samples. The method is extended to the case of interaction terms and is illustrated on a model that examines the interaction effect of innovation and style of use of budgets on business performance. Alternative reliability estimates that can be used to disattenuate the estimates are discussed. A comparison is made with the alternative methods. Methods that do not correct for measurement error bias perform very similarly and considerably worse than disattenuated regression

The agreement between ipsative and normative questionnaires using compositional data analysis techniques

The main instrument used in psychological measurement is the self-report questionnaire. One of its majordrawbacks however is its susceptibility to response biases. A known strategy to control these biases hasbeen the use of so-called ipsative items. Ipsative items are items that require the respondent to makebetween-scale comparisons within each item. The selected option determines to which scale the weight ofthe answer is attributed. Consequently in questionnaires only consisting of ipsative items everyrespondent is allotted an equal amount, i.e. the total score, that each can distribute differently over thescales. Therefore this type of response format yields data that can be considered compositional from itsinception.Methodological oriented psychologists have heavily criticized this type of item format, since the resultingdata is also marked by the associated unfavourable statistical properties. Nevertheless, clinicians havekept using these questionnaires to their satisfaction. This investigation therefore aims to evaluate bothpositions and addresses the similarities and differences between the two data collection methods. Theultimate objective is to formulate a guideline when to use which type of item format.The comparison is based on data obtained with both an ipsative and normative version of threepsychological questionnaires, which were administered to 502 first-year students in psychology accordingto a balanced within-subjects design. Previous research only compared the direct ipsative scale scoreswith the derived ipsative scale scores. The use of compositional data analysis techniques also enables oneto compare derived normative score ratios with direct normative score ratios. The addition of the secondcomparison not only offers the advantage of a better-balanced research strategy. In principle it also allowsfor parametric testing in the evaluation

Moderating effects of management control systems and innovation on performance. Simple methods for correcting the effects of measurement error for interaction effects in small samples

In the accounting literature, interaction or moderating effects are usually assessed by means of OLS regression and summated rating scales are constructed to reduce measurement error bias. Structural equation models and two-stage least squares regression could be used to completely eliminate this bias, but large samples are needed. Partial Least Squares are appropriate for small samples but do not correct measurement error bias. In this article, disattenuated regression is discussed as a small sample alternative and is illustrated on data of Bisbe and Otley (in press) that examine the interaction effect of innovation and style of use of budgets on performance. Sizeable differences emerge between OLS and disattenuated regression

Ecological Footprint Inequality: A methodological review and some results

Scarcities of environmental services are no longer merely a remote hypothesis. Consequently, analysis of their inequalities between nations becomes of paramount importance for the achievement of sustainability in terms either of international policy, or of Universalist ethical principles of equity. This paper aims, on the one hand, at revising methodological aspects of the inequality measurement of certain environmental data and, on the other, at extending the scarce empirical evidence relating to the international distribution of Ecological Footprint (EF), by using a longer EF time series. Most of the techniques currently important in the literature are revised and then tested on EF data with interesting results. We look in depth at Lorenz dominance analyses and consider the underlying properties of different inequality indices. Those indices which fit best with environmental inequality measurements are CV2 and GE(2) because of their neutrality property, however a trade-off may occur when subgroup decompositions are performed. A weighting factor decomposition method is proposed in order to isolate weighting factor changes in inequality growth rates. Finally, the only non-ambiguous way of decomposing inequality by source is the natural decomposition of CV2, which additionally allows the interpretation of marginal term contributions. Empirically, this paper contributes to the environmental inequality measurement of EF: this inequality has been quite stable and its change over time is due to per capita vector changes rather than population changes. Almost the entirety of the EF inequality is explainable by differences in the means between the countries of the World Bank group. This finding suggests that international environmental agreements should be attempted on a regional basis in an attempt to achieve greater consensus between the parties involved. Additionally, source decomposition warns of the dangers of confining CO2 emissions reduction to crop-based energies because of the implications for basic needs satisfaction.