E-assessment in mathematics courses with multiple-choice questions tests

With the implementation of the Bologna Process several challenges have been posed to higher education institution, particularly in Portugal. One of the main implications is related to the change of the paradigm of a teacher centered education, to a paradigm that is student centered. This change implies the change of the way to assess courses in higher education institutions. Continuous and formative assessments emerged as the focus, catalyzed by electronic assessment, or e-assessment. This paper presents a case of the implementation of an e-assessment strategy, implemented in order to allow continuous, formative assessment in numerous mathematics classes using multiple-choice questions tests implement in Moodle open-source learning management system. The implementation can be considered a success.

E-assessment in mathematics courses with multiple-choice questions tests

With the implementation of the Bologna Process several challenges have been posed to higher education institution, particularly in Portugal. One of the main implications is related to the change of the paradigm of a teacher centered education, to a paradigm that is student centered. This change implies the change of the way to assess courses in higher education institutions. Continuous and formative assessments emerged as the focus, catalyzed by electronic assessment, or e-assessment. This paper presents a case of the implementation of an e-assessment strategy, implemented in order to allow continuous, formative assessment in numerous mathematics classes using multiple-choice questions tests implement in Moodle open-source learning management system. The implementation can be considered a success.

How teachers think about the role of digital technologies in student assessment in mathematics

This study concerns teachers’ use of digital technologies in student assessment, and how the learning that is developed through the use of technology in mathematics can be evaluated. Nowadays math teachers use digital technologies in their teaching, but not in student assessment. The activities carried out with technology are seen as ‘extra-curricular’ (by both teachers and students), thus students do not learn what they can do in mathematics with digital technologies. I was interested in knowing the reasons teachers do not use digital technology to assess students’ competencies, and what they would need to be able to design innovative and appropriate tasks to assess students’ learning through digital technology. This dissertation is built on two main components: teachers and task design. I analyze teachers’ practices involving digital technologies with Ruthven’s Structuring Features of Classroom Practice, and what relation these practices have to the types of assessment they use. I study the kinds of assessment tasks teachers design with a DGE (Dynamic Geometry Environment), using Laborde’s categorization of DGE tasks. I consider the competencies teachers aim to assess with these tasks, and how their goals relate to the learning outcomes of the curriculum. This study also develops new directions in finding how to design suitable tasks for student mathematical assessment in a DGE, and it is driven by the desire to know what kinds of questions teachers might be more interested in using. I investigate the kinds of technology-based assessment tasks teachers value, and the type of feedback they give to students. Finally, I point out that the curriculum should include a range of mathematical and technological competencies that involve the use of digital technologies in mathematics, and I evaluate the possibility to take advantage of technology feedback to allow students to continue learning while they are taking a test.

Diversity in mathematics assessment equals diversity in opinion?

We undertook a study to investigate the views of both students and staff in our department towards assessment in mathematics, as a precursor to considering increasing the diversity of assessment types. In a survey and focus group there was reasonable agreement amongst the students with regards major themes such as mode of assessment. However, this level of agreement was not seen amongst the staff, where discussions regarding diversity in mathematics assessment definitely revealed a difference of opinion. As a consequence, we feel that the greatest barriers to increasing diversity may be with staff, and so more efforts are needed to communicate to staff the advantages and disadvantages, in order to give them greater confidence in trying a range of assessment types.

Adecuación curricular del diagnóstico y la evaluación en matemáticas = Curricular validity of assessment and evaluation instruments in mathematics.

Resumen basado en el del autor

New challenges in mathematics for the european higher education

In this paper we will talk about a math project submitted to the Lifelong Learning Programme. European higher education needs a reform in order to play its full role in the Europe of Knowledge. Modernisation of higher education is necessary in the areas of curricula (Bologna process), funding and governance so that higher education institutions can face the challenges posed by globalisation and contribute more effectively to the training and retraining of the European workforce. On the other hand Mathematics is an essential component of all educational systems. Mathematical literacy is being scrutinized in assessment efforts such as the OCDE Programme for International Student Assessment (PISA). This showed a low level in Europe. Due to the Bologna Process, which brought several didactical implications for Higher Education (HE) institutions, there is the need of lifelong learning. This evolution is in conflict with the earlier mentioned lack of competencies on basic sciences, such as Mathematics. Forced by this duality, efforts are combined to share expertise in the Math field and the integration of pedagogical methodologies becomes a necessity. Thus, several European countries have proposed an International Project to the Lifelong Learning Programme, Action ERASMUS Modernisation of Higher Education, to make institutions more attractive and more responsive to the needs of the labour market, citizens and society at large. One of the main goals of the project is to attract students to math through high-quality instructional units in an understandable, exciting and attractive way.

Gender bias in the Trends in Mathematics and Science Study 2003 (TIMMS) for Canadian students /

This study is a secondary data analysis of the Trends in Mathematics and Science Study 2003 (TIMSS) to determine if there is a gender bias, unbalanced number of items suited to the cognitive skill of one gender, and to compare performance by location. Results of the Grade 8, math portion of the test were examined. Items were coded as verbal, spatial, verbal /spatial or neither and as conventional or unconventional. A Kruskal- Wallis was completed for each category, comparing performance of students from Ontario, Quebec, and Singapore. A Factor Analysis was completed to determine if there were item categories with similar characteristics. Gender differences favouring males were found in the verbal conventional category for Canadian students and in the spatial conventional category for students in Quebec. The greatest differences were by location, as students in Singapore outperformed students from Canada in all areas except for the spatial unconventional category. Finally, whether an item is conventional or unconventional is more important than whether the item is verbal or spatial. Results show the importance of fair assessment for the genders in both the classroom and on standardized tests.

Collaborative Learning and Assessment in e-Learning

Report published in the Proceedings of the National Conference on "Education and Research in the Information Society", Plovdiv, May, 2016

The effects of the use of technology in mathematics instruction on student achievement

The purpose of this study was to examine the effects of the use of technology on students’ mathematics achievement, particularly the Florida Comprehensive Assessment Test (FCAT) mathematics results. Eleven schools within the Miami-Dade County Public School System participated in a pilot program on the use of Geometers Sketchpad (GSP). Three of these schools were randomly selected for this study. Each school sent a teacher to a summer in-service training program on how to use GSP to teach geometry. In each school, the GSP class and a traditional geometry class taught by the same teacher were the study participants. Students’ mathematics FCAT results were examined to determine if the GSP produced any effects. Students’ scores were compared based on assignment to the control or experimental group as well as gender and SES. SES measurements were based on whether students qualified for free lunch. The findings of the study revealed a significant difference in the FCAT mathematics scores of students who were taught geometry using GSP compared to those who used the traditional method. No significant differences existed between the FCAT mathematics scores of the students based on SES. Similarly, no significant differences existed between the FCAT scores based on gender. In conclusion, the use of technology (particularly GSP) is likely to boost students’ FCAT mathematics test scores. The findings also show that the use of GSP may be able to close known gender and SES related achievement gaps. The results of this study promote policy changes in the way geometry is taught to 10th grade students in Florida’s public schools.

The Predictive Power of Homework Assignments on Student Achievement in Mathematics

This study examined the relationship between homework performance (percent of homework completed and percent of homework correct), student characteristics (Stanford Achievement Test score, gender, ethnicity, and socio-economic status), perceptions, and challenges and academic achievement determined by the students’ average score on weekly tests and their score on the Florida Comprehensive Assessment Test (FCAT) Norm Reference Test (NRT) mathematics assessment.

The impact of standards -based practices in mathematics on the achievement of low -performing students

This study examined standards-based mathematics reform initiatives to determine if they would improve student achievement on the part of low-performing students. New curricula, the Carnegie Learning Cognitive Tutor®, were provided for algebra and geometry students. The new instructional strategy relied on both the teacher-led instruction and the use of computers to differentiate instruction for individual students. Mathematics teachers received ongoing professional development to help them implement the new curricula. In addition, teachers were provided with ongoing support to assist them with the transformation of the learning environments for students using standards-based practices. This quasi-experimental (nonrandomized) study involved teachers in two matched urban high schools. Analyses (ANCOVAs) revealed that the experimental group with an appropriately implemented program had significantly higher learning gains than the comparison group as determined by the students' 2007 mathematics Developmental Scale Score (DSS). In addition, the experimental group's adjusted mean for the second interim mathematics assessment was significantly higher than the comparison group's mean. The findings support the idea that if the traditional curriculum is replaced with standards-based curriculum, and the curriculum is implemented as intended, low-performing students may make significant learning gains. With respect to the teaching practices as observed with the Classroom Observation Protocol (COP), t-tests were conducted on four constructs. The results for both the algebra and geometry teachers on the constructs were not significant. The COP indicated that teachers in both the experimental and comparison groups used traditional instruction strategies in their classrooms. The analyses of covariance (ANCOVA) on the use of technology revealed no significant main effects for computer use.

The Effects of the Use of Technology In Mathematics Instruction on Student Achievement

The purpose of this study was to examine the effects of the use of technology on students’ mathematics achievement, particularly the Florida Comprehensive Assessment Test (FCAT) mathematics results. Eleven schools within the Miami-Dade County Public School System participated in a pilot program on the use of Geometers Sketchpad (GSP). Three of these schools were randomly selected for this study. Each school sent a teacher to a summer in-service training program on how to use GSP to teach geometry. In each school, the GSP class and a traditional geometry class taught by the same teacher were the study participants. Students’ mathematics FCAT results were examined to determine if the GSP produced any effects. Students’ scores were compared based on assignment to the control or experimental group as well as gender and SES. SES measurements were based on whether students qualified for free lunch. The findings of the study revealed a significant difference in the FCAT mathematics scores of students who were taught geometry using GSP compared to those who used the traditional method. No significant differences existed between the FCAT mathematics scores of the students based on SES. Similarly, no significant differences existed between the FCAT scores based on gender. In conclusion, the use of technology (particularly GSP) is likely to boost students’ FCAT mathematics test scores. The findings also show that the use of GSP may be able to close known gender and SES related achievement gaps. The results of this study promote policy changes in the way geometry is taught to 10th grade students in Florida’s public schools.

The impact of standards-based practices in mathematics on the achievement of low-performing students

This study examined standards-based mathematics reform initiatives to determine if they would improve student achievement on the part of low-performing students. New curricula, the Carnegie Learning Cognitive Tutor®, were provided for algebra and geometry students. The new instructional strategy relied on both the teacher-led instruction and the use of computers to differentiate instruction for individual students. Mathematics teachers received ongoing professional development to help them implement the new curricula. In addition, teachers were provided with ongoing support to assist them with the transformation of the learning environments for students using standards-based practices. This quasi-experimental (nonrandomized) study involved teachers in two matched urban high schools. Analyses (ANCOVAs) revealed that the experimental group with an appropriately implemented program had significantly higher learning gains than the comparison group as determined by the students' 2007 mathematics Developmental Scale Score (DSS). In addition, the experimental group's adjusted mean for the second interim mathematics assessment was significantly higher than the comparison group's mean. The findings support the idea that if the traditional curriculum is replaced with standards-based curriculum, and the curriculum is implemented as intended, low-performing students may make significant learning gains. With respect to the teaching practices as observed with the Classroom Observation Protocol (COP), t-tests were conducted on four constructs. The results for both the algebra and geometry teachers on the constructs were not significant. The COP indicated that teachers in both the experimental and comparison groups used traditional instruction strategies in their classrooms. The analyses of covariance (ANCOVA) on the use of technology revealed no significant main effects for computer use.