Large-scale assessment of language proficiency: theoretical and pedagogical reflections on the use of multiple-choice tests

The new requirement placed on students in tertiary settings in Spain to demonstrate a B1 or a B2 proficiency level of English, in accordance with the Common European Framework of Reference for Languages (CEFRL), has led most Spanish universities to develop a program of certification or accreditation of the required level. The first part of this paper aims to provide a rationale for the type of test that has been developed at the Universidad Politécnica de Madrid for the accreditation of a B2 level, a multiple choice version, and to describe how it was constructed and validated. Then, in the second part of the paper, the results from its application to 924 students enrolled in different degree courses at a variety of schools and faculties at the university are analyzed based on a final test version item analysis. To conclude, some theoretical as well as practical conclusions about testing grammar that affect the teaching and learning process are drawn. RESUMEN. Las nuevas exigencias sobre niveles de competencia B1 y B2 en inglés según el Marco Común Europeo de Referencia para las Lenguas (MCERL) que se imponen sobre los estudiantes de grado y posgrado han llevado a la mayoría de las universidades españolas a desarrollar programas de acreditación o de certificación de estos niveles. La primera parte de este trabajo trata sobre las razones que fundamentan la elección de un tipo concreto de examen para la acreditación del nivel B2 de lengua inglesa en la Universidad Politécnica de Madrid. Se trata de un test de opción múltiple y en esta parte del trabajo se describe cómo fue diseñado y validado. En la segunda parte, se analizan los resultados de la aplicación del test a gran escala a un total de 924 estudiantes matriculados en varias escuelas y Facultades de la Universidad. Para terminar, se apuntan una serie de conclusiones teóricas y prácticas sobre la evaluación de la gramática y de qué modo influye en los procesos de enseñanza y aprendizaje.

Using global analysis, partial specifications, and an extensible assertion language for program validation and debugging

We discuss a framework for the application of abstract interpretation as an aid during program development, rather than in the more traditional application of program optimization. Program validation and detection of errors is first performed statically by comparing (partial) specifications written in terms of assertions against information obtained from (global) static analysis of the program. The results of this process are expressed in the user assertion language. Assertions (or parts of assertions) which cannot be checked statically are translated into run-time tests. The framework allows the use of assertions to be optional. It also allows using very general properties in assertions, beyond the predefined set understandable by the static analyzer and including properties defined by user programs. We also report briefly on an implementation of the framework. The resulting tool generates and checks assertions for Prolog, CLP(R), and CHIP/CLP(fd) programs, and integrates compile-time and run-time checking in a uniform way. The tool allows using properties such as types, modes, non-failure, determinacy, and computational cost, and can treat modules separately, performing incremental analysis.

Using global analysis, partial specifications, and an extensible assertion language for program validation and debugging

We present a framework for the application of abstract interpretation as an aid during program development, rather than in the more traditional application of program optimization. Program validation and detection of errors is first performed statically by comparing (partial) specifications written in terms of assertions against information obtained from static analysis of the program. The results of this process are expressed in the user assertion language. Assertions (or parts of assertions) which cannot be verified statically are translated into run-time tests. The framework allows the use of assertions to be optional. It also allows using very general properties in assertions, beyond the predefined set understandable by the static analyzer and including properties defined by means of user programs. We also report briefly on an implementation of the framework. The resulting tool generates and checks assertions for Prolog, CLP(R), and CHIP/CLP(fd) programs, and integrates compile-time and run-time checking in a uniform way. The tool allows using properties such as types, modes, non-failure, determinacy, and computational cost, and can treat modules separately, performing incremental analysis. In practice, this modularity allows detecting statically bugs in user programs even if they do not contain any assertions.

Plataforma MALL (Mobile-Assisted Language Learning) para el aprendizaje y desarrollo del conocimiento del idioma, particularizado en el Inglés

El creciente uso de las Tecnologías de la Información y las Comunicaciones en el ámbito educativo ha hecho posible que existan nuevas formas de enseñanza que facilitan el aprendizaje y la mejora de éste. Una de las ramas educativas que más influenciada se ha visto por esto es la de los idiomas, debido en gran parte a la necesidad global de aprender nuevas lenguas y mejorar sus conocimientos de ellas. Entre todos los idiomas que la gente desea aprender destaca uno por encima de todos, el inglés. Esto viene dado no solo por la presencia de éste a nivel mundial, sino por la gran repercusión en el ámbito educativo, comenzando a ser un requisito indispensable en la realización de estudios superiores. El presente proyecto Fin de Grado pretende contribuir a la mejora del conocimiento del inglés para estudiantes que no han alcanzado un nivel B2 de éste. En éste se desarrolla una plataforma educativa accesible por el mayor número de alumnos posibles, no solo solo a través de ordenadores personales, sino principalmente a través de dispositivos móviles tales como smartphones y tablets. Para que fuese posible una mayor utilización de esta por parte de los estudiantes era necesario la creación de una aplicación que pudiese ser utilizada desde cualquier dispositivo sin importar el sistema operativo empleado. Dicha plataforma educativa está formada por un juego de preguntas en la que los estudiantes deberán contestar correctamente para obtener una puntuación final con la que accederán a una clasificación con el resto de miembros de dicha plataforma. Con éste sistema de puntos se pretende dar una componente de gamificación al juego para motivar a los estudiantes a que sigan compitiendo y realizando test de preguntas. Además a dicha plataforma podrán acceder los profesores administradores de ella para monitorizar y ver resultados de los estudiantes participantes. ABSTRACT. The growing use of Information and Communication Technologies in the educational field has made possible for new teaching ways to exist, thus making learning easier and better. One of the more influenced educational branches by this fact is languages, largely due to a global need to learn them and improve knowledge. Among all the languages that people wish to learn, one stands out above them, English. It is given, not only by its worldwide presence, but by its big scholar repercussion; that English is an essential requirement for higher education. This final degree project aims to improve the english level for those who have a hard time doing it. This project develops an educational accesible platform to the greatest number of students, not only through personal computers, but mainly through mobile devices like smartphones or tablets. To make a great use of it by students possible, it was necessary an application which could be used from any device regardless of the operative system. This teaching platform is formed by a quiz game in which students must answer correctly in order to get a final score which will place them in a ranking composed by other platform members. With this score system it is intended to give a gamification component in order to motivate students to keep playing and answering question tests. Also, in this platform, administration teachers will be able to monitor the students and watch their results.