875 resultados para Evaluation methods
Resumo:
Evaluation and benchmarking in content-based image retrieval has always been a somewhat neglected research area, making it difficult to judge the efficacy of many presented approaches. In this paper we investigate the issue of benchmarking for colour-based image retrieval systems, which enable users to retrieve images from a database based on lowlevel colour content alone. We argue that current image retrieval evaluation methods are not suited to benchmarking colour-based image retrieval systems, due in main to not allowing users to reflect upon the suitability of retrieved images within the context of a creative project and their reliance on highly subjective ground-truths. As a solution to these issues, the research presented here introduces the Mosaic Test for evaluating colour-based image retrieval systems, in which test-users are asked to create an image mosaic of a predetermined target image, using the colour-based image retrieval system that is being evaluated. We report on our findings from a user study which suggests that the Mosaic Test overcomes the major drawbacks associated with existing image retrieval evaluation methods, by enabling users to reflect upon image selections and automatically measuring image relevance in a way that correlates with the perception of many human assessors. We therefore propose that the Mosaic Test be adopted as a standardised benchmark for evaluating and comparing colour-based image retrieval systems.
Resumo:
This paper summarizes the scientific work presented at the 32nd European Conference on Information Retrieval. It demonstrates that information retrieval (IR) as a research area continues to thrive with progress being made in three complementary sub-fields, namely IR theory and formal methods together with indexing and query representation issues, furthermore Web IR as a primary application area and finally research into evaluation methods and metrics. It is the combination of these areas that gives IR its solid scientific foundations. The paper also illustrates that significant progress has been made in other areas of IR. The keynote speakers addressed three such subject fields, social search engines using personalization and recommendation technologies, the renewed interest in applying natural language processing to IR, and multimedia IR as another fast-growing area.
Resumo:
This report examines the results of a pilot study, which used a method of evaluation called randomised control trials (RCTs) to see if a popular business support scheme called Creative Credits worked effectively. The pilot study, which began in Manchester in 2009, was structured so that vouchers, or 'Creative Credits', would be randomly allocated to small and medium-sized businesses applying to invest in creative projects such as developing websites, video production and creative marketing campaigns, to see if they had a real effect on innovation. The research found that the firms who were awarded Creative Credits enjoyed a short-term boost in their innovation and sales growth in the six months following completion of their creative projects. However, the positive effects were not sustained, and after 12 months there was no longer a statistically significant difference between the groups that received the credits and those that didn’t. The report argues that these results would have remained hidden using the normal evaluation methods used by government, and calls for RCTs to be used more widely when evaluating policies to support business growth.
Resumo:
A variety of content-based image retrieval systems exist which enable users to perform image retrieval based on colour content - i.e., colour-based image retrieval. For the production of media for use in television and film, colour-based image retrieval is useful for retrieving specifically coloured animations, graphics or videos from large databases (by comparing user queries to the colour content of extracted key frames). It is also useful to graphic artists creating realistic computer-generated imagery (CGI). Unfortunately, current methods for evaluating colour-based image retrieval systems have 2 major drawbacks. Firstly, the relevance of images retrieved during the task cannot be measured reliably. Secondly, existing methods do not account for the creative design activity known as reflection-in-action. Consequently, the development and application of novel and potentially more effective colour-based image retrieval approaches, better supporting the large number of users creating media for use in television and film productions, is not possible as their efficacy cannot be reliably measured and compared to existing technologies. As a solution to the problem, this paper introduces the Mosaic Test. The Mosaic Test is a user-based evaluation approach in which participants complete an image mosaic of a predetermined target image, using the colour-based image retrieval system that is being evaluated. In this paper, we introduce the Mosaic Test and report on a user evaluation. The findings of the study reveal that the Mosaic Test overcomes the 2 major drawbacks associated with existing evaluation methods and does not require expert participants. © 2012 Springer Science+Business Media, LLC.
Resumo:
Background: Coronary heart disease (CHD) is a public health priority in the UK. The National Service Framework (NSF) has set standards for the prevention, diagnosis and treatment of CHD, which include the use of cholesterol-lowering agents aimed at achieving targets of blood total cholesterol (TC) < 5.0 mmol/L and low density lipoprotein-cholesterol (LDL-C) < 3.0 mmol/L. In order to achieve these targets cost effectively, prescribers need to make an informed choice from the range of statins available. Aim: To estimate the average and relative cost effectiveness of atorvastatin, fluvastatin, pravastatin and simvastatin in achieving the NSF LDL-C and TC targets. Design: Model-based economic evaluation. Methods: An economic model was constructed to estimate the number of patients achieving the NSF targets for LDL-C and TC at each dose of statin, and to calculate the average drug cost and incremental drug cost per patient achieving the target levels. The population baseline LDL-C and TC, and drug efficacy and drug costs were taken from previously published data. Estimates of the distribution of patients receiving each dose of statin were derived from the UK national DIN-LINK database. Results: The estimated annual drug cost per 1000 patients treated with atorvastatin was £289 000, with simvastatin £315 000, with pravastatin £333 000 and with fluvastatin £167 000. The percentages of patients achieving target are 74.4%, 46.4%, 28.4% and 13.2% for atorvastatin, simvastatin, pravastatin and fluvastatin, respectively. Incremental drug cost per extra patient treated to LDL-C and TC targets compared with fluvastafin were £198 and £226 for atorvastatin, £443 and £567 for simvastatin and £1089 and £2298 for pravastatin, using 2002 drug costs. Conclusions: As a result of its superior efficacy, atorvastatin generates a favourable cost-effectiveness profile as measured by drug cost per patient treated to LDL-C and TC targets. For a given drug budget, more patients would achieve NSF LDL-C and TC targets with atorvastatin than with any of the other statins examined.
Resumo:
The article examines the main approaches to external evaluation and accreditation in higher education. It also presents COMPASS-OK: a social network for electronic evaluation and management of the quality of education, which utilizes mechanisms for management of documentation flows and supports tools for modeling of evaluation methods and procedures.
Resumo:
A hazai turizmus gyakorlatával kapcsolatos vizsgálatok tapasztalatai nyomán az egri Eszterházy Károly Főiskola (EKF) turizmusmenedzsment-kurzusának oktatói célszerűnek ítélték a témára vonatkozó tananyag fejlesztését. A cikk szerzői azt remélik azonban, hogy az utóbbi munka egyes megállapításai minden, a gazdasági földrajz, a turizmus (idegenforgalom), a térségfejlesztés valamely szegmensével foglalkozó szakembernek, kiemelten: vezetőnek – s több más gazdasági ág illetékeseinek – az érdeklődésére számot tarthatnak, ezért ezekről jelen cikkben is beszámolnak. _____ In this article the authors reviewed first the different types of tourist attractions (destinations) and they analysed the common evaluation methods of their attractiveness (e.g. the possibilities and limits of the tourism statistics). Then they tried to display the existing information on the main Hungarian attractions and their attractiveness. In this study revealed that there exist no generally recognized list of the most visited attractions, and the real measures of their attractiveness are not known either. The authors emphasize that shaping a comprehensive concept on the above mentioned issue would highly contribute to the elaboration of a successful and achievable tourism strategy, thus it would be of great importance.
Resumo:
Mathematics is rigidly classified as an academic discipline. This determines curriculum content and teaching and evaluation methods. These methods can give rise to negative views of mathematics, resulting in increased math anxiety. Educators, therefore, need to look beyond the discipline to provide a classroom environment that meets students’ needs.
Resumo:
Corporate executives closely monitor the accuracy of their hotels' occupancy fore- casts since important decisions are based upon these predictions. This study lists the criteria for selecting an appropriate error measure. It discusses several evaluation methods focusing on statistical significance tests and demonstrates the use of two adequate evaluation methods: Mincer- Zamowitz's efficiency test and Wilcoxon's Non-Parametric Matched-Pairs Signed- Ranks test.
Resumo:
This study aimed to construct and carry out a distance course of pedagogical training for health professional performing preceptorship functions in public health institutions. The preceptorship in health is a pedagogical practice that occurs in workplace, led by assistance professionals with teaching position or not, where the vast majority of these acts intuitively, reproducing their own training, confusing transmitting information with education. These preceptors often do not dominate the pedagogical knowledge, necessary for the organization of training activities, such as the various teaching-learning processes and the different assessment types. Student supervision is essential in the training process of students in the health field, and on the occasion of supervised internships that the teaching-learning process is based on practical experience with participation in real life situations and professional work. It was realized an exploratory study, descriptive with qualitative approach, with the development of tutoring teaching course in health as final product. Applied semi structured research instrument from may to july 2014. It were evaluated 162 health professionals who perform the preceptorship, which made it possible define the preceptor's profile and identify the educational requirements related to the educational process, which justified the construction of the program content and the professionals’ perception analysis about preceptorship through identification of three categories: clinic knowledge valuation; valuation of professional orientation and valuation of professional future. The course was available on distance mode through Moodle platform with forty hours of work load from October to November 2014. With the aim of capacitate the health professionals to development of necessary abilities and skills to tutoring performance through thoughts about tutoring concepts, professional training within the curricular guidelines and SUS precepts, the role of health professionals as educators, application of active teaching methodologies, and evaluation methods. The applications were done online through the provided link; 300 vacancies offered, 243 professionals applied, chosen 134 that works on tutoring, where 49 represented professionals that works on the location of the study. The course lasted 45 days, and counted with tutors responsible to interact and evaluate the students. 28 professionals joined the course, 12 concluded. Opportunities were identified to stimulate the involvement, however the professionals’ satisfaction shows that, make an investment on tutors education, starting from the Permanent Education precepts, will provide a bigger appropriation of the knowledge to the education and therefore the awareness of their role as an educator on work ambit, proportioning essential tools to tutors act while enabler of integration between theory and practice and result better teaching-learning process.
Resumo:
This dissertation presents a study and experimental research on asymmetric coding of stereoscopic video. A review on 3D technologies, video formats and coding is rst presented and then particular emphasis is given to asymmetric coding of 3D content and performance evaluation methods, based on subjective measures, of methods using asymmetric coding. The research objective was de ned to be an extension of the current concept of asymmetric coding for stereo video. To achieve this objective the rst step consists in de ning regions in the spatial dimension of auxiliary view with di erent perceptual relevance within the stereo pair, which are identi ed by a binary mask. Then these regions are encoded with better quality (lower quantisation) for the most relevant ones and worse quality (higher quantisation) for the those with lower perceptual relevance. The actual estimation of the relevance of a given region is based on a measure of disparity according to the absolute di erence between views. To allow encoding of a stereo sequence using this method, a reference H.264/MVC encoder (JM) has been modi ed to allow additional con guration parameters and inputs. The nal encoder is still standard compliant. In order to show the viability of the method subjective assessment tests were performed over a wide range of objective qualities of the auxiliary view. The results of these tests allow us to prove 3 main goals. First, it is shown that the proposed method can be more e cient than traditional asymmetric coding when encoding stereo video at higher qualities/rates. The method can also be used to extend the threshold at which uniform asymmetric coding methods start to have an impact on the subjective quality perceived by the observers. Finally the issue of eye dominance is addressed. Results from stereo still images displayed over a short period of time showed it has little or no impact on the proposed method.
Resumo:
The Amazon Basin plays key role in atmospheric chemistry, biodiversity and climate change. In this study we applied nanoelectrospray (nanoESI) ultra-high-resolution mass spectrometry (UHRMS) for the analysis of the organic fraction of PM2.5 aerosol samples collected during dry and wet seasons at a site in central Amazonia receiving background air masses, biomass burning and urban pollution. Comprehensive mass spectral data evaluation methods (e.g. Kendrick mass defect, Van Krevelen diagrams, carbon oxidation state and aromaticity equivalent) were used to identify compound classes and mass distributions of the detected species. Nitrogen- and/or sulfur-containing organic species contributed up to 60 % of the total identified number of formulae. A large number of molecular formulae in organic aerosol (OA) were attributed to later-generation nitrogen- and sulfur-containing oxidation products, suggesting that OA composition is affected by biomass burning and other, potentially anthropogenic, sources. Isoprene-derived organosulfate (IEPOX-OS) was found to be the most dominant ion in most of the analysed samples and strongly followed the concentration trends of the gas-phase anthropogenic tracers confirming its mixed anthropogenic–biogenic origin. The presence of oxidised aromatic and nitro-aromatic compounds in the samples suggested a strong influence from biomass burning especially during the dry period. Aerosol samples from the dry period and under enhanced biomass burning conditions contained a large number of molecules with high carbon oxidation state and an increased number of aromatic compounds compared to that from the wet period. The results of this work demonstrate that the studied site is influenced not only by biogenic emissions from the forest but also by biomass burning and potentially other anthropogenic emissions from the neighbouring urban environments.
Resumo:
This paper considers the analysis of data from randomized trials which offer a sequence of interventions and suffer from a variety of problems in implementation. In experiments that provide treatment in multiple periods (T>1), subjects have up to 2^{T}-1 counterfactual outcomes to be estimated to determine the full sequence of causal effects from the study. Traditional program evaluation and non-experimental estimators are unable to recover parameters of interest to policy makers in this setting, particularly if there is non-ignorable attrition. We examine these issues in the context of Tennessee's highly influential randomized class size study, Project STAR. We demonstrate how a researcher can estimate the full sequence of dynamic treatment effects using a sequential difference in difference strategy that accounts for attrition due to observables using inverse probability weighting M-estimators. These estimates allow us to recover the structural parameters of the small class effects in the underlying education production function and construct dynamic average treatment effects. We present a complete and different picture of the effectiveness of reduced class size and find that accounting for both attrition due to observables and selection due to unobservable is crucial and necessary with data from Project STAR
Resumo:
Harnessing solar energy to provide for the thermal needs of buildings is one of the most promising solutions to the global energy issue. Exploiting the additional surface area provided by the building’s façade can significantly increase the solar energy output. Developing a range of integrated and adaptable products that do not significantly affect the building’s aesthetics is vital to enabling the building integrated solar thermal market to expand and prosper. This work reviews and evaluates solar thermal facades in terms of the standard collector type, which they are based on, and their component make-up. Daily efficiency models are presented, based on a combination of the Hottel Whillier Bliss model and finite element simulation. Novel and market available solar thermal systems are also reviewed and evaluated using standard evaluation methods, based on experimentally determined parameters ISO 9806. Solar thermal collectors integrated directly into the facade benefit from the additional wall insulation at the back; displaying higher efficiencies then an identical collector offset from the facade. Unglazed solar thermal facades with high capacitance absorbers (e.g. concrete) experience a shift in peak maximum energy yield and display a lower sensitivity to ambient conditions than the traditional metallic based unglazed collectors. Glazed solar thermal facades, used for high temperature applications (domestic hot water), result in overheating of the building’s interior which can be reduced significantly through the inclusion of high quality wall insulation. For low temperature applications (preheating systems), the cheaper unglazed systems offer the most economic solution. The inclusion of brighter colour for the glazing and darker colour for the absorber shows the lowest efficiency reductions (<4%). Novel solar thermal façade solutions include solar collectors integrated into balcony rails, shading devices, louvers, windows or gutters.
Resumo:
On the aggravation of social problems and the shortage of resources, the improvement of evaluation methods and control of its application, requiring more efficiency, efficacy, effectiveness and participation in its management, has been growing. As a result, emerges the importance of studying and developing such methodologies. The overall goal of this dissertation is to know what are the difficults to incorporate the point of view of executers and beneficiaries in evaluation process. To do so, has been done a research characterized as qualitative, with a field strategy using the case study of two social projects called Petrobras Child Program, situated in the metropolitan region of Natal, and Content Analysis technique for analyze the data. The conclusions of this work can assist in improving the process of projects evaluation financed by Petrobras, contributing with its social role, besides the possibility of encouraging a greater participation of other society actors, such as beneficiaries, in the evaluation process