Data Envelopment Analysis and non-discretionary inputs : How to select the most suitable model using multi-criteria decision analysis

Within Data Envelopment Analysis, several alternative models allow for an environmental adjustment. The majority of them deliver divergent results. Decision makers face the difficult task of selecting the most suitable model. This study is performed to overcome this difficulty. By doing so, it fills a research gap. First, a two-step web-based survey is conducted. It aims (1) to identify the selection criteria, (2) to prioritize and weight the selection criteria with respect to the goal of selecting the most suitable model and (3) to collect the preferences about which model is preferable to fulfil each selection criterion. Second, Analytic Hierarchy Process is used to quantify the preferences expressed in the survey. Results show that the understandability, the applicability and the acceptability of the alternative models are valid selection criteria. The selection of the most suitable model depends on the preferences of the decision makers with regards to these criteria.

10

This contribution introduces Data Envelopment Analysis (DEA), a performance measurement technique. DEA helps decision makers for the following reasons: (1) By calculating an efficiency score, it indicates if a firm is efficient or has capacity for improvement; (2) By setting target values for input and output, it calculates how much input must be decreased or output increased in order to become efficient; (3) By identifying the nature of returns to scale, it indicates if a firm has to decrease or increase its scale (or size) in order to minimise the average total cost; (4) By identifying a set of benchmarks, it specifies which other firms' processes need to be analysed in order to improve its own practices. This contribution presents the essentials about DEA, alongside a case study to intuitively understand its application. It also introduces Win4DEAP, a software package that conducts efficiency analysis based on DEA methodology. The methodical background of DEA is presented for more demanding readers. Finally, four advanced topics of DEA are treated: adjustment to the environment, preferences, sensitivity analysis and time series data.

Prediction markets supporting technology assessment

In this thesis, we study the use of prediction markets for technology assessment. We particularly focus on their ability to assess complex issues, the design constraints required for such applications and their efficacy compared to traditional techniques. To achieve this, we followed a design science research paradigm, iteratively developing, instantiating, evaluating and refining the design of our artifacts. This allowed us to make multiple contributions, both practical and theoretical. We first showed that prediction markets are adequate for properly assessing complex issues. We also developed a typology of design factors and design propositions for using these markets in a technology assessment context. Then, we showed that they are able to solve some issues related to the R&D portfolio management process and we proposed a roadmap for their implementation. Finally, by comparing the instantiation and the results of a multi-criteria decision method and a prediction market, we showed that the latter are more efficient, while offering similar results. We also proposed a framework for comparing forecasting methods, to identify the constraints based on contingency factors. In conclusion, our research opens a new field of application of prediction markets and should help hasten their adoption by enterprises. Résumé français: Dans cette thèse, nous étudions l'utilisation de marchés de prédictions pour l'évaluation de nouvelles technologies. Nous nous intéressons plus particulièrement aux capacités des marchés de prédictions à évaluer des problématiques complexes, aux contraintes de conception pour une telle utilisation et à leur efficacité par rapport à des techniques traditionnelles. Pour ce faire, nous avons suivi une approche Design Science, développant itérativement plusieurs prototypes, les instanciant, puis les évaluant avant d'en raffiner la conception. Ceci nous a permis de faire de multiples contributions tant pratiques que théoriques. Nous avons tout d'abord montré que les marchés de prédictions étaient adaptés pour correctement apprécier des problématiques complexes. Nous avons également développé une typologie de facteurs de conception ainsi que des propositions de conception pour l'utilisation de ces marchés dans des contextes d'évaluation technologique. Ensuite, nous avons montré que ces marchés pouvaient résoudre une partie des problèmes liés à la gestion des portes-feuille de projets de recherche et développement et proposons une feuille de route pour leur mise en oeuvre. Finalement, en comparant la mise en oeuvre et les résultats d'une méthode de décision multi-critère et d'un marché de prédiction, nous avons montré que ces derniers étaient plus efficaces, tout en offrant des résultats semblables. Nous proposons également un cadre de comparaison des méthodes d'évaluation technologiques, permettant de cerner au mieux les besoins en fonction de facteurs de contingence. En conclusion, notre recherche ouvre un nouveau champ d'application des marchés de prédiction et devrait permettre d'accélérer leur adoption par les entreprises.

Essays on the measurement of school efficiency

Measuring school efficiency is a challenging task. First, a performance measurement technique has to be selected. Within Data Envelopment Analysis (DEA), one such technique, alternative models have been developed in order to deal with environmental variables. The majority of these models lead to diverging results. Second, the choice of input and output variables to be included in the efficiency analysis is often dictated by data availability. The choice of the variables remains an issue even when data is available. As a result, the choice of technique, model and variables is probably, and ultimately, a political judgement. Multi-criteria decision analysis methods can help the decision makers to select the most suitable model. The number of selection criteria should remain parsimonious and not be oriented towards the results of the models in order to avoid opportunistic behaviour. The selection criteria should also be backed by the literature or by an expert group. Once the most suitable model is identified, the principle of permanence of methods should be applied in order to avoid a change of practices over time. Within DEA, the two-stage model developed by Ray (1991) is the most convincing model which allows for an environmental adjustment. In this model, an efficiency analysis is conducted with DEA followed by an econometric analysis to explain the efficiency scores. An environmental variable of particular interest, tested in this thesis, consists of the fact that operations are held, for certain schools, on multiple sites. Results show that the fact of being located on more than one site has a negative influence on efficiency. A likely way to solve this negative influence would consist of improving the use of ICT in school management and teaching. Planning new schools should also consider the advantages of being located on a unique site, which allows reaching a critical size in terms of pupils and teachers. The fact that underprivileged pupils perform worse than privileged pupils has been public knowledge since Coleman et al. (1966). As a result, underprivileged pupils have a negative influence on school efficiency. This is confirmed by this thesis for the first time in Switzerland. Several countries have developed priority education policies in order to compensate for the negative impact of disadvantaged socioeconomic status on school performance. These policies have failed. As a result, other actions need to be taken. In order to define these actions, one has to identify the social-class differences which explain why disadvantaged children underperform. Childrearing and literary practices, health characteristics, housing stability and economic security influence pupil achievement. Rather than allocating more resources to schools, policymakers should therefore focus on related social policies. For instance, they could define pre-school, family, health, housing and benefits policies in order to improve the conditions for disadvantaged children.

A design science approach to support the assessment of disruptive technology : the Swiss mobile payment case

Abstract In this thesis we present the design of a systematic integrated computer-based approach for detecting potential disruptions from an industry perspective. Following the design science paradigm, we iteratively develop several multi-actor multi-criteria artifacts dedicated to environment scanning. The contributions of this thesis are both theoretical and practical. We demonstrate the successful use of multi-criteria decision-making methods for technology foresight. Furthermore, we illustrate the design of our artifacts using build and-evaluate loops supported with a field study of the Swiss mobile payment industry. To increase the relevance of this study, we systematically interview key Swiss experts for each design iteration. As a result, our research provides a realistic picture of the current situation in the Swiss mobile payment market and reveals previously undiscovered weak signals for future trends. Finally, we suggest a generic design process for environment scanning.

Adjusting for the environment in DEA: a comparison of alternative models based on empirical data

Due to the existence of free software and pedagogical guides, the use of Data Envelopment Analysis (DEA) has been further democratized in recent years. Nowadays, it is quite usual for practitioners and decision makers with no or little knowledge in operational research to run their own efficiency analysis. Within DEA, several alternative models allow for an environmental adjustment. Four alternative models, each user-friendly and easily accessible to practitioners and decision makers, are performed using empirical data of 90 primary schools in the State of Geneva, Switzerland. Results show that the majority of alternative models deliver divergent results. From a political and a managerial standpoint, these diverging results could lead to potentially ineffective decisions. As no consensus emerges on the best model to use, practitioners and decision makers may be tempted to select the model that is right for them, in other words, the model that best reflects their own preferences. Further studies should investigate how an appropriate multi-criteria decision analysis method could help decision makers to select the right model.

Prototype of a web-based participative decision support platform in natural hazards and risk management

This paper presents the current state and development of a prototype web-GIS (Geographic Information System) decision support platform intended for application in natural hazards and risk management, mainly for floods and landslides. This web platform uses open-source geospatial software and technologies, particularly the Boundless (formerly OpenGeo) framework and its client side software development kit (SDK). The main purpose of the platform is to assist the experts and stakeholders in the decision-making process for evaluation and selection of different risk management strategies through an interactive participation approach, integrating web-GIS interface with decision support tool based on a compromise programming approach. The access rights and functionality of the platform are varied depending on the roles and responsibilities of stakeholders in managing the risk. The application of the prototype platform is demonstrated based on an example case study site: Malborghetto Valbruna municipality of North-Eastern Italy where flash floods and landslides are frequent with major events having occurred in 2003. The preliminary feedback collected from the stakeholders in the region is discussed to understand the perspectives of stakeholders on the proposed prototype platform.

Criteria for establishing shielding of multi-detector computed tomography (MDCT) rooms.

The aim of this work is to compare two methods used for determining the proper shielding of computed tomography (CT) rooms while considering recent technological advances in CT scanners. The approaches of the German Institute for Standardisation and the US National Council on Radiation Protection and Measurements were compared and a series of radiation measurements were performed in several CT rooms at the Lausanne University Hospital. The following three-step procedure is proposed for assuring sufficient shielding of rooms hosting new CT units with spiral mode acquisition and various X-ray beam collimation widths: (1) calculate the ambient equivalent dose for a representative average weekly dose length product at the position where shielding is required; (2) from the maximum permissible weekly dose at the location of interest, calculate the transmission factor F that must be taken to ensure proper shielding and (3) convert the transmission factor into a thickness of lead shielding. A similar approach could be adopted to use when designing shielding for fluoroscopy rooms, where the basic quantity would be the dose area product instead of the load of current (milliampere-minute).

The First International Workshop on Warning Criteria for Active Slides: technical issues, problems and solutions for managing early warning systems

Early warning systems (EWSs) rely on the capacity to forecast a dangerous event with a certain amount of advance by defining warning criteria on which the safety of the population will depend. Monitoring of landslides is facilitated by new technologies, decreasing prices and easier data processing. At the same time, predicting the onset of a rapid failure or the sudden transition from slow to rapid failure and subsequent collapse, and its consequences is challenging for scientists that must deal with uncertainties and have limited tools to do so. Furthermore, EWS and warning criteria are becoming more and more a subject of concern between technical experts, researchers, stakeholders and decision makers responsible for the activation, enforcement and approval of civil protection actions. EWSs imply also a sharing of responsibilities which is often averted by technical staff, managers of technical offices and governing institutions. We organized the First International Workshop on Warning Criteria for Active Slides (IWWCAS) to promote sharing and networking among members from specialized institutions and relevant experts of EWS. In this paper, we summarize the event to stimulate discussion and collaboration between organizations dealing with the complex task of managing hazard and risk related to active slides.

The efficacy of melatonin for sleep problems in children with autism, fragile X syndrome, or autism and fragile X syndrome.

STUDY OBJECTIVE: To determine the efficacy of melatonin on sleep problems in children with autistic spectrum disorder (ASD) and fragile X syndrome (FXS). METHODS: A 4-week, randomized, double blind, placebo-controlled, crossover design was conducted following a 1-week baseline period. Either melatonin, 3 mg, or placebo was given to participants for 2 weeks and then alternated for another 2 weeks. Sleep variables, including sleep duration, sleep-onset time, sleep-onset latency time, and the number of night awakenings, were recorded using an Actiwatch and from sleep diaries completed by parents. All participants had been thoroughly assessed for ASD and also had DNA testing for the diagnosis of FXS. RESULTS: Data were successfully obtained from the 12 of 18 subjects who completed the study (11 males, age range 2 to 15.25 years, mean 5.47, SD 3.6). Five participants met diagnostic criteria for ASD, 3 for FXS alone, 3 for FXS and ASD, and 1 for fragile X premutation. Eight out of 12 had melatonin first. The conclusions from a nonparametric repeated-measures technique indicate that mean night sleep duration was longer on melatonin than placebo by 21 minutes (p = .02), mean sleep-onset latency was shorter by 28 minutes (p = .0001), and mean sleep-onset time was earlier by 42 minutes (p = .02). CONCLUSION: The results of this study support the efficacy and tolerability of melatonin treatment for sleep problems in children with ASD and FXS.

A multi-perspective approach to performance anxiety in music students

AbstractPerforming publicly has become increasingly important in a variety of professions. This condition is associated with performance anxiety in almost all performers. Whereas some performers successfully cope with this anxiety, for others it represents a major problem and even threatens their career. Musicians and especially music students were shown to be particularly affected by performance anxiety.Therefore, the goal of this PhD thesis was to gain a better understanding of performance anxiety in university music students. More precisely, the first part of this thesis aimed at increasing knowledge on the occurrence, the experience, and the management of performance anxiety (Article 1). The second part aimed at investigating the hypothesis that there is an underlying hyperventilation problem in musicians with a high level of anxiety before a performance. This hypothesis was addressed in two ways: firstly, by investigating the association between the negative affective dimension of music performance anxiety (MPA) and self-perceived physiological symptoms that are known to co-occur with hyperventilation (Article 2) and secondly, by analyzing this association on the physiological level before a private (audience-free) and a public performance (Article 3). Article 4 places some key variables of Article 3 in a larger context by jointly analyzing the phases before, during, and after performing.The main results of the self-report data show (a) that stage fright is experienced as a problem by one-third of the surveyed students, (b) that the students express a considerable need for more help to better cope with it, and (c) that there is a positive association between negative feelings of MPA and the self-reported hyperventilation complaints before performing. This latter finding was confirmed on the physiological level in a tendency of particularly high performance-anxious musicians to hyperventilate. Furthermore, the psycho-physiological activation increased from a private to a public performance, and was higher during the performances than before or after them. The physiological activation was mainly independent of the MPA score. Finally, there was a low response coherence between the actual physiological activation and the self-reports on the instantaneous anxiety, tension, and perceived physiological activation.Given the high proportion of music students who consider stage fright as a problem and given the need for more help to better cope with it, a better understanding of this phenomenon and its inclusion in the educational process is fundamental to prevent future occupational problems. On the physiological level, breathing exercises might be a good means to decrease - but also to increase - the arousal associated with a public performance in order to meet an optimal level of arousal needed for a good performance.

Variations régionales du recours aux soins: quelques problèmes méthodologiques. [Regional variations in health services: various methodological problems].

Many studies show strong variation of health consumption between regions, suggesting that theses variations are related to the uncertainty of medical practice or to other factors related to health services or patients attitude. However the statistical interpretation of these variations is far from easy: apart from usual and specific information bias, there are statistical problems when observing incidence of events like health care consumption: it is in fact a rare event, which is observed within small population, and among regions with unequal number of person. Therefore, most of the variation reported might be well explained by a purely statistical phenomenon. This paper presents some aspects of this variability for three common indicators of variation, and suggest the use of ad hoc simulation to get statistical criteria.

A Thematic Comparison of Eight Frameworks of Quality Criteria in Qualitative Health Research

Background: Despite the increasing incidences of the publication of assessment frameworks intending to establish the "standards" of the quality of qualitative research, the research conducted using such empirical methods are still facing difficulties in being published or recognised by funding agencies. Methods: We conducted a thematic content analysis of eight frameworks from psychology/psychiatry and general medicine. The frameworks and their criteria are then compared against each other. Findings: The results illustrated the difficulties in reaching consensus on the definition of quality criteria. This showed the differences between the frameworks from the point of views of the underlying epistemology and the criteria suggested. Discussion: The aforementioned differences reflect the diversity of paradigms implicitly referred to by the authors of the frameworks, although rarely explicitly mentioned in text. We conclude that the increase in qualitative research and publications has failed to overcome the difficulties in establishing shared criteria and the great heterogeneity of concepts raises methodological and epistemological problems.

Approche multidisciptinaire des coûts humains des lombalgies [Human cost of low back pain: a multi-disciplinary approach]

The valuation of human costs is a necessity, but this task poses many problems of method. A team made of a philosopher, a psychologist and a physician has been working with economist researchers in order to look into the meaning that the preferences announced at the time of the inquiries on human costs by QALY methods could assume. These methods are often used to obtain a valuation of the impact of a health attack on people's quality of life. The methods--in the frame of the argument assumed by the economic theory on well-being--hypothesize that people's choices depend mainly on cognitive work. The qualitative interviews show that the psychological construction process for the announced preferences largely overlap this frame. In this paper the authors hastily tackle the factors which have an effect on the preferences. They conclude that the QALY methods don't seem to be able to assess the quality of life nori to valuate the damage that the quality of life could include.