Development of a New Assessment System to Evaluate Students' English Communicative Capacities in China

The purpose of this study was to develop a new English assessment system to evaluate Chinese students' English communicative capacities. Since there is more interaction with people from English-speaking countries, Chinese people attach more importance to English oral skills, and a lot of Western English teaching methods were introduced into China to improve students' English communicative capacities. However, traditional paper-written examinations, like the English test of higher education entry examination, cannot evaluate it effectively. This study explored the perceptions of two Chinese English-language teachers and two Chinese students about English assessment system. A qualitative research method using telephone interviews was conducted in this study. The findings showed that the most possible ways to assess Chinese students' English communicative capacities were paper-written examination and person-machine conversations, although measures should be taken to improve these two models. On the other hand, the model of person-person conversation was the ideal assessment tool but was hard to achieve at the current stage.

Prototype of a Configurable Web-Based Assessment System

The MIT Prototype Educational Assessment System provides subjects and courses at MIT with the ability to perform online assessment. The system includes polices to handle harassment and electronic "flaming" while protecting privacy. Within these frameworks, individual courses and subjects can make their own policy decisions about such matters as to when assessments can occur, who can submit assessments, and how anonymous assessments are. By allowing assessment to take place continually and allowing both students and staff to participate, the system can provide a forum for the online discussion of subjects. Even in the case of scheduled assessments, the system can provide advantages over end-of-term assessment, since the scheduled assessments can occur several times during the semester, allowing subjects to identify and adjust those areas that could use improvement. Subjects can also develop customized questionnaires, perhaps in response to previous assessments, to suit their needs.

Development and illustrative outputs of the Community Integrated Assessment System (CIAS), a multi-institutional modular integrated assessment approach for modelling climate change.

This paper describes the development and first results of the “Community Integrated Assessment System” (CIAS), a unique multi-institutional modular and flexible integrated assessment system for modelling climate change. Key to this development is the supporting software infrastructure, SoftIAM. Through it, CIAS is distributed between the community of institutions which has each contributed modules to the CIAS system. At the heart of SoftIAM is the Bespoke Framework Generator (BFG) which enables flexibility in the assembly and composition of individual modules from a pool to form coupled models within CIAS, and flexibility in their deployment onto the available software and hardware resources. Such flexibility greatly enhances modellers’ ability to re-configure the CIAS coupled models to answer different questions, thus tracking evolving policy needs. It also allows rigorous testing of the robustness of IA modelling results to the use of different component modules representing the same processes (for example, the economy). Such processes are often modelled in very different ways, using different paradigms, at the participating institutions. An illustrative application to the study of the relationship between the economy and the earth’s climate system is provided.

Hygiene assessment system (HAS) scores: an analysis of the available data from English slaughterhouses

As control systems have developed and the implications of poor hygienic practices have become better known, the evaluation of the hygienic status of premises has become more critical. The assessment of the overall status of premises hygiene call provide useful management data indicating whether the premises are improving or whether, whilst still meeting legal requirements, they might be failing to maintain previously high standards. Since the creation, for the United Kingdom, of the meat hygiene service (MHS), one of the aims of the service was to monitor hygiene on different premises to provide a means of comparing standards and to identify and encourage improvements. This desire led to the implementation of a scoring system known as the hygiene assessment system (HAS). This paper analyses English slaughterhouses HAS scores between 1998 and 2005 outlining the main incidents throughout this period, Although rising initially, the later results displayed a clear decrease in the general hygiene scores. These revealing results coincide with the start of a new meat inspection system where, after several years of discussion, risk based inspection is finally coming to a reality within Europe. The paper considers the implications of these changes in the way hygiene standards will be monitored in the future.

The first five years of the EU Impact Assessment system: a risk economics perspective on gaps between rationale and practice

In 2003 the European Commission started using Impact Assessment (IA) as the main empirical basis for its major policy proposals. The aim was to systematically assess ex ante the economic, social and environmental impacts of EU policy proposals. In parallel, research proliferated in search for theoretical grounds for IAs and in an attempt to evaluate empirically the performance of the first sets of IAs produced by the European Commission. This paper combines conceptual and evaluative studies carried out in the first five years of EU IAs. It concludes that the great discrepancy between rationale and practice calls for a different theoretical focus and a higher emphasis on evaluating empirically crucial risk economics aspects of IAs, such as the value of statistical life, price of carbon, the integration of macroeconomic modelling and scenario analysis.

Evaluating the likelihood of the adoption of an animal welfare assessment system in European agri-food supply chains

Purpose – The purpose of this paper is to analyse the likelihood of adoption of a recently designed Welfare Assessment System in agri-food supply chains and the factors affecting the adoption decision. The application is carried out for pig and poultry chains. Design/methodology/approach – This research consisted of two main components: interviews with retailers in pig and poultry supply chains in eight different EU countries to explore their perceptions towards the adoption possibilities of the welfare assessment system; and a conjoint analysis designed to evaluate the perceived adoption likelihood of the assessment system by different Standards Formulating Organisations (SFOs). Findings – Stakeholders were found to be especially concerned about the costs of implementation of the system and how it could, or should, be merged with existing assurance schemes. Another conclusion of the study is that the presence of a strong third independent party supporting the implementation of the welfare assessment system would be the most important influence on the decision whether, or not, to adopt it. Originality/value – This research evaluates the adoption possibilities of a novel Welfare Assessment System and presents the views of different supply chain stakeholders on an adoption of such a system. The main factors affecting the adoption decision are identified and analysed. Contrary to expectations, the costs of adoption of a new welfare assessment system were not considered to be the most important factor affecting the decision of supply chain stakeholders about the adoption of this new welfare system.

Performance of fluorescence methods, radiographic examination and ICDAS II on occlusal surfaces in vitro

This study compared the performance of fluorescence-based methods, radiographic examination, and International Caries Detection and Assessment System (ICDAS) II on occlusal surfaces. One hundred and nineteen permanent human molars were assessed twice by 2 experienced dentists using the laser fluorescence (LF and LFpen) and fluorescence camera (FC) devices, ICDAS II and bitewing radiographs (BW). After measuring, the teeth were histologically prepared and assessed for caries extension. The sensitivities for dentine caries detection were 0.86 (FC), 0.78 (LFpen), 0.73 (ICDAS II), 0.51 (LF) and 0.34 (BW). The specificities were 0.97 (BW), 0.89 (LF), 0.65 (ICDAS II), 0.63 (FC) and 0.56 (LFpen). BW presented the highest values of likelihood ratio (LR)+ (12.47) and LR- (0.68). Rank correlations with histology were 0.53 (LF), 0.52 (LFpen), 0.41 (FC), 0.59 (ICDAS II) and 0.57 (BW). The area under the ROC curve varied from 0.72 to 0.83. Inter- and intraexaminer intraclass correlation values were respectively 0.90 and 0.85 (LF), 0.93 and 0.87 (LFpen) and 0.85 and 0.76 (FC). The ICDAS II kappa values were 0.51 (interexaminer) and 0.61 (intraexaminer). The BW kappa values were 0.50 (interexaminer) and 0.62 (intraexaminer). The Bland and Altman limits of agreement were 46.0 and 38.2 (LF), 55.6 and 40.0 (LFpen) and 1.12 and 0.80 (FC), for intra- and interexaminer reproducibilities. The posttest probability for dentine caries detection was high for BW and LF. In conclusion, LFpen, FC and ICDAS II presented better sensitivity and LF and BW better specificity. ICDAS II combined with BW showed the best performance and is the best combination for detecting caries on occlusal surfaces. Copyright (C) 2008 S. Karger AG, Basel.

In Vitro Evaluation of ICDAS and Radiographic Examination of Occlusal Surfaces and Their Association With Treatment Decisions

This in vitro study evaluated the performance of visual (International Caries Detection and Assessment System [ICDAS]) and radiographic (bitewing [BW]) examinations for occlusal caries detection and their associations with treatment decision (TD). Permanent teeth (n=104) with occlusal surfaces varying from sound to cavitated were selected. Sites were identified from 10x occlusal surface photographs. Standardized bitewing (BW) radiographs were taken. Four dentists with at least five years of experience scored all teeth twice (one-week interval) for ICDAS (0-6), BW (0=sound, 1=caries restricted to enamel, 2=caries in outer third dentin, 3=caries in inner third dentin), and TD (0=no treatment, 1=sealant, 2=microabrasion and sealant, 3=round bur sealant, 4a=resin, 4b=amalgam). Histological validation was performed by observation under a light microscope, with lesions classified on a five-point scale. Intraexaminer and inter-examiner repeatability were assessed using two-way tables and intraclass correlation coefficients (ICCs). Comparisons between percentage correct, specificity, sensitivity, and area under the receiver-operating characteristic (ROC) curve were performed using bootstrap analyses. ICCs for intraexaminer and interexaminer repeatability indicated good repeatability for each examiner, ranging from 0.78 to 0.88, and among examiners, ranging from 0.74 to 0.81. Correlation between ICDAS and TD was 0.85 and between BW and TD was 0.78. Correlation between the methods and histological scores was moderate (0.63 for ICDAS and 0.61 for BW). The area under the ROC curve was significantly greater for ICDAS than for BW (p<0.0001). ICDAS had significantly lower specificity than BW did (p=0.0269, 79% vs 94%); however, sensitivity was much higher for ICDAS than for BW (p<0.0001, 83% vs 44%). Data from this investigation suggested that the visual examination (ICDAS) showed better performance than radiographic examination for occlusal caries detection. The ICDAS was strongly associated with TD. Although the correlation between the ICDAS and BW was lower, it is still valuable in the clinical decision-making process.

Assessment of a new infrared laser transillumination technology (808nm) for the detection of occlusal caries-an in vitro study

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)

Laboratorial training of examiners for using a visual caries detection system in epidemiological surveys

Background: In epidemiological surveys, a good reliability among the examiners regarding the caries detection method is essential. However, training and calibrating those examiners is an arduous task because it involves several patients who are examined many times. To facilitate this step, we aimed to propose a laboratory methodology to simulate the examinations performed to detect caries lesions using the International Caries Detection and Assessment System (ICDAS) in epidemiological surveys. Methods: A benchmark examiner conducted all training sessions. A total of 67 exfoliated primary teeth, varying from sound to extensive cavitated, were set in seven arch models to simulate complete mouths in primary dentition. Sixteen examiners (graduate students) evaluated all surfaces of the teeth under illumination using buccal mirrors and ball-ended probe in two occasions, using only coronal primary caries scores of the ICDAS. As reference standard, two different examiners assessed the proximal surfaces by direct visual inspection, classifying them in sound, with non-cavitated or with cavitated lesions. After, teeth were sectioned in the bucco-lingual direction, and the examiners assessed the sections in stereomicroscope, classifying the occlusal and smooth surfaces according to lesion depth. Inter-examiner reproducibility was evaluated using weighted kappa. Sensitivities and specificities were calculated at two thresholds: all lesions and advanced lesions (cavitated lesions in proximal surfaces and lesions reaching the dentine in occlusal and smooth surfaces). Conclusion: The methodology purposed for training and calibration of several examiners designated for epidemiological surveys of dental caries in preschool children using the ICDAS is feasible, permitting the assessment of reliability and accuracy of the examiners previously to the survey´s development.

Performance of fluorescence methods, radiographic examination and ICDAS II on occlusal surfaces in vitro

This study compared the performance of fluorescence-based methods, radiographic examination, and International Caries Detection and Assessment System (ICDAS) II on occlusal surfaces. One hundred and nineteen permanent human molars were assessed twice by 2 experienced dentists using the laser fluorescence (LF and LFpen) and fluorescence camera (FC) devices, ICDAS II and bitewing radiographs (BW). After measuring, the teeth were histologically prepared and assessed for caries extension. The sensitivities for dentine caries detection were 0.86 (FC), 0.78 (LFpen), 0.73 (ICDAS II), 0.51 (LF) and 0.34 (BW). The specificities were 0.97 (BW), 0.89 (LF), 0.65 (ICDAS II), 0.63 (FC) and 0.56 (LFpen). BW presented the highest values of likelihood ratio (LR)+ (12.47) and LR- (0.68). Rank correlations with histology were 0.53 (LF), 0.52 (LFpen), 0.41 (FC), 0.59 (ICDAS II) and 0.57 (BW). The area under the ROC curve varied from 0.72 to 0.83. Inter- and intraexaminer intraclass correlation values were respectively 0.90 and 0.85 (LF), 0.93 and 0.87 (LFpen) and 0.85 and 0.76 (FC). The ICDAS II kappa values were 0.51 (interexaminer) and 0.61 (intraexaminer). The BW kappa values were 0.50 (interexaminer) and 0.62 (intraexaminer). The Bland and Altman limits of agreement were 46.0 and 38.2 (LF), 55.6 and 40.0 (LFpen) and 1.12 and 0.80 (FC), for intra- and interexaminer reproducibilities. The posttest probability for dentine caries detection was high for BW and LF. In conclusion, LFpen, FC and ICDAS II presented better sensitivity and LF and BW better specificity. ICDAS II combined with BW showed the best performance and is the best combination for detecting caries on occlusal surfaces.

Performance of experienced dentists in Switzerland after an e-learning program on ICDAS occlusal caries detection

This study aimed to evaluate the effect of an e-learning program on the validity and reproducibility of the International Caries Detection and Assessment System (ICDAS) in detecting occlusal caries. For the study, 170 permanent molars were selected. Four dentists in Switzerland who had no previous contact with ICDAS examined the teeth before and after the e-learning program and scored the sites according to ICDAS. Teeth were histologically prepared and assessed for caries extension. The significance level was set at 0.05. Sensitivity before and after the e-learning program was 0.80 and 0.77 (D1), 0.72 and 0.63 (D2), and 0.74 and 0.67 (D3,4), respectively. Specificity was 0.64 and 0.69 (D1), 0.70 and 0.81 (D2), and 0.81 and 0.87 (D3,4). A McNemar test did not show any difference between the values of sensitivity, specificity, accuracy, and area under the ROC curve (AUC) before and after the e-learning program. The averages of wK values for interexaminer reproducibility were 0.61 (before) and 0.66 (after). Correlation with histology presented wK values of 0.62 (before) and 0.63 (after). A Wilcoxon test showed a statistically significant difference between before and after the e-learning program. In conclusion, even though ICDAS performed well in detecting occlusal caries, the e-learning program did not have any statistically significant effect on its performance by these experienced dentists.

Validität und Reliabilität bei der visuellen okklusalen Kariesdiagnostik mit ICDAS unter der Verwendung von unterschiedlichen dentalen Vergrösserungshilfen

Zielsetzung: Diese Studie untersuchte die Validität und Reliabilität von verschiedenen visuellen dentalen Vergrösserungshilfen in Bezug auf die okklusale Kariesdiagnostik mit Hilfe des International Caries Detection and Assessment System (ICDAS). Material und Methode: Die Okklusalflächen von 100 extrahierten Zähnen wurde an einer zuvor bestimmten Stelle von 10 Studenten (5 Studenten des 3. Jahreskurses (Bachelor-Studenten) und 5 Studenten des 4. Jahreskurses (Master-Studenten) der Zahnmedizinischen Kliniken der Universität Bern) und 4 Zahnärzten visuell untersucht und nach ICDAS auf das Vorhandensein und die Tiefe einer kariösen Läsion beurteilt. Die Beurteilung der Zähne erfolgte je zwei Mal von blossem Auge, mit einem Galilei-Lupensystem (2.5x Vergrösserung), mit einem Kepler-Lupensystem (4.5x Vergrösserung) und mit dem Operationsmikroskop (10x Vergrösserung) mit mindestens 24 Stunden Abstand zwischen den jeweiligen Untersuchungen. Als Goldstandard diente die Histologie. Die statistische Auswertung der Untersuchungen erfolgte mit der Berechnung der Kappa-Koeffizienten für die Intra- und Inter-Untersucher Reliabilität sowie einer Bayes-Analyse durch Ermittlung von Sensitivität, Spezifität und der Fläche unter der Receiver Operating Characteristic Kurve (AUC). Ergebnisse: Bei den Untersuchungsdurchläufen, welche mit dentalen Vergrösserungshilfen für die Diagnostik der okklusalen Zahnoberflächen durchgeführt wurden, sank die Anzahl der mit einem ICDAS-Code 0 (gesunde Zahnoberfläche) beurteilten Zähne, während die Quantität des Codes 3 (Schmelzeinbruch) mit höheren Vergrösserungen drastisch zunahm. Mit steigendem Vergrösserungsfaktor liessen sich sowohl mehr Schmelzkaries als auch Dentinkaries richtig erkennen (bessere Sensitivität), im Gegenzug sanken aber die Werte der Spezifität auf ein klinisch unakzeptables Niveau. Während der Abfall der Spezifität und AUC-Werte bei der Beurteilung von Schmelzkaries unter Verwendung von kleinen Vergrösserungen lediglich einen Trend darstellte, waren die Verschlechterungen in der Diagnostik bei der Dentinkaries unter der Zuhilfenahme von höheren Vergrösserungen häufig signifikant. So stiegen zum Beispiel bei den Zahnärzten die Werte der Sensitivität (Bandbreite) auf dem D3-Diagnostikniveau von 0.47 (0.17-0.79) bei dem Durchlauf von Auge auf 0.91 (0.83-1.00) bei der Benutzung des Operationsmikroskopes an, während jedoch die Spezifitätswerte (Bandbreite) von 0.78 (0.58-0.95) auf 0.30 (0.07-0.55) sanken. Ebenfalls einen negativen Einfluss von optischen Hilfsmitteln zeigte sich bei der Inter-Untersucher Reliabilität, während die Intra-Untersucher Reliabilität unbeeinflusst blieb. Die persönliche klinische Erfahrung scheint sowohl in Bezug auf das Mass der Übereinstimmung visueller Kariesdiagnostik als auch auf die Präferenz bei der Vergabe der ICDAS-Codes und somit auf die Werte der Validität einen wesentlichen Faktor auszumachen. Die Studenten erreichten die besten Werte der Sensitivität, indes die Zahnärzte dies bei der Spezifität erzielten. Schlussfolgerung: Insgesamt zeigte sich, dass ICDAS nicht für den zusätzlichen Gebrauch von optischen Vergrösserungen konzipiert wurde. Da es auf Grund von der Zuhilfenahme von dentalen Vergrösserungen zu mehr und unnötigen invasiven Behandlungsentscheidungen kommen könnte, ist von der Zuhilfenahme derselben für die okklusale Kariesdiagnostik mit ICDAS abzuraten.

Impact of Different Illumination Conditions on Visual Caries Detection with ICDAS

The aim of this study was to test the influence of different degrees of additional illumination on visual caries detection using the International Caries Detection and Assessment System (ICDAS). Two calibrated examiners assessed 139 occlusal surfaces of extracted permanent molars using a standard operation lamp with or without an additional headlamp providing three default brightness intensities. Histology served as the gold standard. Pooled data showed no differences in sensitivities. Specificities were not influenced by additional light. The area under the curve for the Marthaler classification D3 threshold was significantly lower when an additional strong headlamp was used (0.59 compared to 0.69-0.72 when reduced illumination intensities were used). One of the two examiners also had a significantly lower sensitivity for the D1 threshold when an additional headlamp was used. The use of additional white light led to a reduced detection of dentine lesions.

A quality assessment system for fresh fruits in hypermarkets and fruit trading centres.

When the fresh fruit reaches the final markets from the suppliers, its quality is not always as good as it should, either because it has been mishandled during transportation or because it lacks an adequate quality control at the producer level, before being shipped. This is why it is necessary for the final markets to establish their own quality assessment system if they want to ensure to their customers the quality they want to sell. In this work, a system to control fruit quality at the last level of the distribution channel has been designed. The system combines rapid control techniques with laboratory equipment and statistical sampling protocols, to obtain a dynamic, objective process, which can substitute advantageously the quality control inspections carried out visually by human experts at the reception platform of most hypermarkets. Portable measuring equipment have been chosen (firmness tester, temperature and humidity sensors...) as well as easy-to-use laboratory equipment (texturometer, colorimeter, refractometer..,) combining them to control the most important fruit quality parameters (firmness, colour, sugars, acids). A complete computer network has been designed to control all the processes and store the collected data in real time, and to perform the computations. The sampling methods have been also defined to guarantee the confidence of the results. Some of the advantages of a quality assessment system as the proposed one are: the minimisation of human subjectivity, the ability to use modern measuring techniques, and the possibility of using it also as a supplier's quality control system. It can be also a way to clarify the quality limits of fruits among members of the commercial channel, as well as the first step in the standardisation of quality control procedures.