Large-scale assessment of language proficiency: theoretical and pedagogical reflections on the use of multiple-choice tests

The new requirement placed on students in tertiary settings in Spain to demonstrate a B1 or a B2 proficiency level of English, in accordance with the Common European Framework of Reference for Languages (CEFRL), has led most Spanish universities to develop a program of certification or accreditation of the required level. The first part of this paper aims to provide a rationale for the type of test that has been developed at the Universidad Politécnica de Madrid for the accreditation of a B2 level, a multiple choice version, and to describe how it was constructed and validated. Then, in the second part of the paper, the results from its application to 924 students enrolled in different degree courses at a variety of schools and faculties at the university are analyzed based on a final test version item analysis. To conclude, some theoretical as well as practical conclusions about testing grammar that affect the teaching and learning process are drawn. RESUMEN. Las nuevas exigencias sobre niveles de competencia B1 y B2 en inglés según el Marco Común Europeo de Referencia para las Lenguas (MCERL) que se imponen sobre los estudiantes de grado y posgrado han llevado a la mayoría de las universidades españolas a desarrollar programas de acreditación o de certificación de estos niveles. La primera parte de este trabajo trata sobre las razones que fundamentan la elección de un tipo concreto de examen para la acreditación del nivel B2 de lengua inglesa en la Universidad Politécnica de Madrid. Se trata de un test de opción múltiple y en esta parte del trabajo se describe cómo fue diseñado y validado. En la segunda parte, se analizan los resultados de la aplicación del test a gran escala a un total de 924 estudiantes matriculados en varias escuelas y Facultades de la Universidad. Para terminar, se apuntan una serie de conclusiones teóricas y prácticas sobre la evaluación de la gramática y de qué modo influye en los procesos de enseñanza y aprendizaje.

Forest inventory-based large-scale forest biomass and carbon budget assessment: new enhanced methods and use of remote sensing for verification

In recent years, concern has arisen over the effects of increasing carbon dioxide (CO2) in the earth's atmosphere due to the burning of fossil fuels. One way to mitigate increase in atmospheric CO2 concentration and climate change is carbon sequestration to forest vegeta-tion through photosynthesis. Comparable regional scale estimates for the carbon balance of forests are therefore needed for scientific and political purposes. The aim of the present dissertation was to improve methods for quantifying and verifying inventory-based carbon pool estimates of the boreal forests in the mineral soils. Ongoing forest inventories provide a data based on statistically sounded sampling for estimating the level of carbon stocks and stock changes, but improved modelling tools and comparison of methods are still needed. In this dissertation, the entire inventory-based large-scale forest carbon stock assessment method was presented together with some separate methods for enhancing and comparing it. The enhancement methods presented here include ways to quantify the biomass of understorey vegetation as well as to estimate the litter production of needles and branches. In addition, the optical remote sensing method illustrated in this dis-sertation can be used to compare with independent data. The forest inventory-based large-scale carbon stock assessment method demonstrated here provided reliable carbon estimates when compared with independent data. Future ac-tivity to improve the accuracy of this method could consist of reducing the uncertainties regarding belowground biomass and litter production as well as the soil compartment. The methods developed will serve the needs for UNFCCC reporting and the reporting under the Kyoto Protocol. This method is principally intended for analysts or planners interested in quantifying carbon over extensive forest areas.

Large scale features and assessment of spatial scale correspondence between TMPA and IMD rainfall datasets over Indian landmass

Daily rainfall datasets of 10 years (1998-2007) of Tropical Rainfall Measuring Mission (TRMM) Multi-satellite Precipitation Analysis (TMPA) version 6 and India Meteorological Department (IMD) gridded rain gauge have been compared over the Indian landmass, both in large and small spatial scales. On the larger spatial scale, the pattern correlation between the two datasets on daily scales during individual years of the study period is ranging from 0.4 to 0.7. The correlation improved significantly (similar to 0.9) when the study was confined to specific wet and dry spells each of about 5-8 days. Wavelet analysis of intraseasonal oscillations (ISO) of the southwest monsoon rainfall show the percentage contribution of the major two modes (30-50 days and 10-20 days), to be ranging respectively between similar to 30-40% and 5-10% for the various years. Analysis of inter-annual variability shows the satellite data to be underestimating seasonal rainfall by similar to 110 mm during southwest monsoon and overestimating by similar to 150 mm during northeast monsoon season. At high spatio-temporal scales, viz., 1 degrees x1 degrees grid, TMPA data do not correspond to ground truth. We have proposed here a new analysis procedure to assess the minimum spatial scale at which the two datasets are compatible with each other. This has been done by studying the contribution to total seasonal rainfall from different rainfall rate windows (at 1 mm intervals) on different spatial scales (at daily time scale). The compatibility spatial scale is seen to be beyond 5 degrees x5 degrees average spatial scale over the Indian landmass. This will help to decide the usability of TMPA products, if averaged at appropriate spatial scales, for specific process studies, e.g., cloud scale, meso scale or synoptic scale.

Now What!?! Exploring the Next Steps for Large-scale Library Assessment Projects

This presentation was offered as part of the CUNY Library Assessment Conference, Reinventing Libraries: Reinventing Assessment, held at the City University of New York in June 2014.

Incorporating Critically Conscious Assessment into a Large Scale Information Literacy Program

Lesson plan published in Critical Pedagogy Handbook, vol. 2

Catholic teachers’ postgraduate qualifications and students’ end of schooling outcomes: A large scale Queensland based comparative study

A key feature of the current era of Australian schooling is the dominance of publically available student, school and teacher performance data. Our paper examines the intersection of data on teachers’ postgraduate qualifications and students’ end of schooling outcomes in 26 Catholic Systemic Secondary Schools and 18 Catholic Independent Secondary Schools throughout the State of Queensland. We introduce and justify taking up a new socially-just measurement model of students’ end of schooling outcomes, called the ‘Tracking and Academic Management Index’, otherwise known as ‘TAMI’. Additional analysis is focused on the outcomes of top-end students vis-à-vis all students who are encouraged to remain in institutionalised education of one form or another for the two final years of senior secondary schooling. These findings of the correlations between Catholic teachers’ postgraduate qualifications and students’ end of schooling outcomes are also compared with teachers’ postgraduate qualifications and students’ end of schooling outcomes across 174 Queensland Government Secondary Schools and 58 Queensland Independent Secondary Schools from the same data collection period. The findings raise important questions about the transference of teachers’ postgraduate qualifications for progressing students’ end of schooling outcomes as well as the performance of Queensland Catholic Systemic Secondary Schools and Queensland Catholic Independent Secondary Schools during a particular era of education.

Effects of large-scale deforestation on precipitation in the monsoon regions: Remote versus local effects

In this paper, using idealized climate model simulations, we investigate the biogeophysical effects of large-scale deforestation on monsoon regions. We find that the remote forcing from large-scale deforestation in the northern middle and high latitudes shifts the Intertropical Convergence Zone southward. This results in a significant decrease in precipitation in the Northern Hemisphere monsoon regions (East Asia, North America, North Africa, and South Asia) and moderate precipitation increases in the Southern Hemisphere monsoon regions (South Africa, South America, and Australia). The magnitude of the monsoonal precipitation changes depends on the location of deforestation, with remote effects showing a larger influence than local effects. The South Asian Monsoon region is affected the most, with 18% decline in precipitation over India. Our results indicate that any comprehensive assessment of afforestation/reforestation as climate change mitigation strategies should carefully evaluate the remote effects on monsoonal precipitation alongside the large local impacts on temperatures.

Detection of large-scale concrete columns for automated bridge inspection

There are over 600,000 bridges in the US, and not all of them can be inspected and maintained within the specified time frame. This is because manually inspecting bridges is a time-consuming and costly task, and some state Departments of Transportation (DOT) cannot afford the essential costs and manpower. In this paper, a novel method that can detect large-scale bridge concrete columns is proposed for the purpose of eventually creating an automated bridge condition assessment system. The method employs image stitching techniques (feature detection and matching, image affine transformation and blending) to combine images containing different segments of one column into a single image. Following that, bridge columns are detected by locating their boundaries and classifying the material within each boundary in the stitched image. Preliminary test results of 114 concrete bridge columns stitched from 373 close-up, partial images of the columns indicate that the method can correctly detect 89.7% of these elements, and thus, the viability of the application of this research.

Large Scale Column Detection for Bridge Inspection

Manually inspecting bridges is a time-consuming and costly task. There are over 600,000 bridges in the US, and not all of them can be inspected and maintained within the specified time frame as some state DOTs cannot afford the essential costs and manpower. This paper presents a novel method that can detect bridge concrete columns from visual data for the purpose of eventually creating an automated bridge condition assessment system. The method employs SIFT feature detection and matching to find overlapping areas among images. Affine transformation matrices are then calculated to combine images containing different segments of one column into a single image. Following that, the bridge columns are detected by identifying the boundaries in the stitched image and classifying the material within each boundary. Preliminary test results using real bridge images indicate that most columns in stitched images can be correctly detected and thus, the viability of the application of this research.

Large‐scale wind deployment, social acceptance

The public is typically in agreement with the renewable energy targets established in many national states and generally supports the idea of increased reliance on wind energy. Nevertheless, many specific wind power projects face significant local opposition. A key question for the wind energy sector is, therefore, how to better engage local people to foster support for specific projects. IEA Wind Task 28 on Social Acceptance of Wind Energy Projects aims to facilitate wind energy development by reviewing current practices, emerging ideas, and exchanging successful practices among the participating countries. It also aims to disseminate the insights of leading research to a nontechnical audience, including project developers, local planning officials, and the general public. The interdisciplinary approach adopted by Task 28 enables an in-depth understanding of the nature of opposition to wind projects and a critical assessment of emerging strategies for social acceptance. Task 28 has analyzed a range of key issues related to social acceptance of wind energy, including the impacts on landscapes and ecosystems, on standard of living and well-being, the implementation of energy policy and spatial planning, the distribution of costs and benefits, and procedural justice. It is clear that although wind energy has many benefits; however, specific projects do impact local communities. As such the concerns of the affected people have to be taken seriously. Moreover, as opposition is rarely without foundation, it is in the interests of developers and advocates to engage local people and to improve projects for the benefit of all.

BOB CAT: a Large-Scale Review and Delphi Consensus for Management of Barrett’s Esophagus With No Dysplasia, Indefinite for, or Low-Grade Dysplasia

OBJECTIVES: Barrett’s esophagus (BE) is a common premalignant lesion for which surveillance is recommended. This strategy is limited by considerable variations in clinical practice. We conducted an international, multidisciplinary, systematic search and evidence-based review of BE and provided consensus recommendations for clinical use in patients with nondysplastic, indefinite, and low-grade dysplasia (LGD). METHODS: We defined the scope, proposed statements, and searched electronic databases, yielding 20,558 publications that were screened, selected online, and formed the evidence base. We used a Delphi consensus process, with an 80% agreement threshold, using GRADE (Grading of Recommendations Assessment, Development and Evaluation) to categorize the quality of evidence and strength of recommendations. RESULTS: In total, 80% of respondents agreed with 55 of 127 statements in the final voting rounds. Population endoscopic screening is not recommended and screening should target only very high-risk cases of males aged over 60 years with chronic uncontrolled reflux. A new international definition of BE was agreed upon. For any degree of dysplasia, at least two specialist gastrointestinal (GI) pathologists are required. Risk factors for cancer include male gender, length of BE, and central obesity. Endoscopic resection should be used for visible, nodular areas. Surveillance is not recommended for <5 years of life expectancy. Management strategies for indefinite dysplasia (IND) and LGD were identified, including a de-escalation strategy for lower-risk patients and escalation to intervention with follow-up for higher-risk patients. CONCLUSIONS: In this uniquely large consensus process in gastroenterology, we made key clinical recommendations for the escalation/de-escalation of BE in clinical practice. We made strong recommendations for the prioritization of future research.

Validation of a fast method for quantification of intra-abdominal and subcutaneous adipose tissue for large-scale human studies

Central obesity is the hallmark of a number of non-inheritable disorders. The advent of imaging techniques such asMRI has allowed for a fast and accurate assessment of body fat content and distribution. However, image analysis continues to be one of the major obstacles to the use of MRI in large-scale studies. In this study we assess the validity of the recently proposed fat–muscle quantitation system (AMRATM Profiler) for the quantification of intra-abdominal adipose tissue (IAAT) and abdominal subcutaneous adipose tissue (ASAT) from abdominal MR images. Abdominal MR images were acquired from 23 volunteers with a broad range of BMIs and analysed using sliceOmatic, the current gold-standard, and the AMRATM Profiler based on a non-rigid image registration of a library of segmented atlases. The results show that there was a highly significant correlation between the fat volumes generated by the two analysis methods, (Pearson correlation r = 0.97, p < 0.001), with the AMRATM Profiler analysis being significantly faster (~3 min) than the conventional sliceOmatic approach (~40 min). There was also excellent agreement between the methods for the quantification of IAAT (AMRA 4.73 ± 1.99 versus sliceOmatic 4.73 ± 1.75 l, p = 0.97). For the AMRATM Profiler analysis, the intra-observer coefficient of variation was 1.6% for IAAT and 1.1% for ASAT, the inter-observer coefficient of variationwas 1.4%for IAAT and 1.2%for ASAT, the intra-observer correlationwas 0.998 for IAAT and 0.999 for ASAT, and the inter-observer correlation was 0.999 for both IAAT and ASAT. These results indicate that precise and accurate measures of body fat content and distribution can be obtained in a fast and reliable form by the AMRATM Profiler, opening up the possibility of large-scale human phenotypic studies.

Establishment of a Cross-European Field Site Network in the ALARM Project for Assessing Large-Scale Changes in Biodiversity

The field site network (FSN) plays a central role in conducting joint research within all Assessing Large-scale Risks for biodiversity with tested Methods (ALARM) modules and provides a mechanism for integrating research on different topics in ALARM on the same site for measuring multiple impacts on biodiversity. The network covers most European climates and biogeographic regions, from Mediterranean through central European and boreal to subarctic. The project links databases with the European-wide field site network FSN, including geographic information system (GIS)-based information to characterise the test location for ALARM researchers for joint on-site research. Maps are provided in a standardised way and merged with other site-specific information. The application of GIS for these field sites and the information management promotes the use of the FSN for research and to disseminate the results. We conclude that ALARM FSN sites together with other research sites in Europe jointly could be used as a future backbone for research proposals