Investigating Formative Assessment: Exploring the Impact on the Self-Efficacy and Motivation of Mathematics Students

This is a study of the implementation and impact of formative assessment strategies on the motivation and self-efficacy of secondary school mathematics students. An explanatory sequential mixed methods design was implemented where quantitative and qualitative data were collected and analyzed sequentially in 2 different phases. The first phase involved quantitative data from student questionnaires and the second phase involved qualitative data from individual student and teacher interviews. The findings of the study suggest that formative assessment is implemented in practice in diverse ways and is a process where the strategies are interconnected. Teachers experience difficulty in incorporating peer and self-assessment and perceive a need for exemplars. Key factors described as influencing implementation include teaching philosophies, interpretation of ministry documents, teachers’ experiences, leadership in administration and department, teacher collaboration, misconceptions of teachers, and student understanding of formative assessment. Findings suggest that overall, formative assessment positively impacts student motivation and self-efficacy, because feedback is provided which offers encouragement and recognition by highlighting the progress that has been made and what steps need to be taken to improve. However, students are impacted differently with some considerations including how students perceive mistakes and if they fear judgement. Additionally, the impact of formative assessment is influenced by the connection between self-efficacy and motivation, namely how well a student is doing is a source of both concepts.

Use of web-based formative assessment to support student learning in metabolism/nutrition unit

In 2002, an integrated basic science course was introduced into the Bachelor of Dental Sciences programme at the University of Queensland, Australia. Learning activities for the Metabolism and Nutrition unit within this integrated course included lectures, problem-based learning tutorials, computer-based self-directed learning exercises and practicals. To support student learning and assist students to develop the skills necessary to become lifelong learners, an extensive bank of formative assessment questions was set up using the commercially available package, WebCT®. Questions included short-answer, multiple-choice and extended matching questions. As significant staff time was involved in setting up the question database, the extent to which students used the formative assessment and their perceptions of its usefulness to their learning were evaluated to determine whether formative assessment should be extended to other units within the course. More than 90% of the class completed formative assessment tasks associated with learning activities scheduled in the first two weeks of the block, but this declined to less than 50% by the fourth and final week of the block. Patterns of usage of the formative assessment were also compared in students who scored in the top 10% for all assessment for the semester with those who scored in the lowest 10%. High-performing students accessed the Web-based formative assessment about twice as often as those who scored in the lowest band. However, marks for the formative assessment tests did not differ significantly between the two groups. In a questionnaire that was administered at the completion of the block, students rated the formative assessment highly, with 80% regarding it as being helpful for their learning. In conclusion, although substantial staff time was required to set up the question database, this appeared to be justified by the positive responses of the students.

Formative assessment and motivation in higher education: a successful approach in mechanical engineer thermodynamics

Between 2000/01 and 2006/07, the approval rate of a Thermodynamics course in a Mechanical Engineer graduation was 25%. However, a careful analysis of the results showed that 41% of the students chosen not to attend or dropped out, missing the final examination. Thus, a continuous assessment methodology was developed, whose purpose was to reduce drop out, motivating students to attend this course, believing that what was observed was due, not to the incapacity to pass, but to the anticipation of the inevitability of failure by the students. If, on one hand, motivation is defined as a broad construct pertaining to the conditions and processes that account for the arousal, direction, magnitude, and maintenance of effort, on the other hand, assessment is one of the most powerful tools to change the will that students have to learn, motivating them to learn in a quicker and permanent way. Some of the practices that were implemented, included: promoting learning goal orientation rather than performance goal orientation; cultivating intrinsic interest in the subject and put less emphasis on grades but make grading criteria explicit; emphasizing teaching approaches that encourage collaboration among students and cater for a range of teaching styles; explaining the reasons for, and the implications of, tests; providing feedback to students about their performance in a form that is non-egoinvolving and non-judgemental and helping students to interpret it; broadening the range of information used in assessing the attainment of individual students. The continuous assessment methodology developed was applied in 2007/08 and 2008/09, having found an increase in the approval from 25% to 55% (30%), accompanied by a decrease of the drop out from 41% to 23,5% (17,5%). Flunking with a numerical grade lowered from 34,4% to 22,0% (12,4%). The perception by the students of the continuous assessment relevance was evaluated with a questionnaire. 70% of the students that failed the course respond that, nevertheless, didn’t repent having done the continuous assessment.

Adecuación curricular del diagnóstico y la evaluación en matemáticas = Curricular validity of assessment and evaluation instruments in mathematics.

Resumen basado en el del autor

Viewbrics: Formative Assessment of Complex Skills with Video-Enhanced Rubrics (VER) in Dutch Secondary Education

To learn complex skills, like collaboration, learners need to acquire a concrete and consistent mental model of what it means to master this skill. If learners know their current mastery level and know their targeted mastery level, they can better determine their subsequent learning activities. Rubrics support learners in judging their skill performance as they provide textual descriptions of skills’ mastery levels with performance indicators for all constituent subskills. However, text-based rubrics have a limited capacity to support the formation of mental models with contextualized, time-related and observable behavioral aspects of a complex skill. This paper outlines the design of a study that intends to investigate the effect of rubrics with video modelling examples compared to text-based rubrics on skills acquisition and feedback provisioning. The hypothesis is that video-enhanced rubrics, compared to text based rubrics, will improve mental model formation of a complex skill and improve the feedback quality a learner receives (from e.g. teachers, peers) while practicing a skill, hence positively effecting final mastery of a skill.

Pratiche di formative assessment per promuovere abilita di comprensione dei testi. Una sperimentazione in una scuola secondaria di primo grado

I dati delle indagini sugli apprendimenti degli studenti in Italia rivelano l’esistenza di fragilità nell’acquisizione di competenze essenziali e di differenze tra i risultati conseguiti. Per innovare la didattica al fine di adeguarla ai bisogni degli studenti, gli esperti di Docimologia caldeggiano l’uso di pratiche di valutazione formativa, o formative assessment (FA). In ambito internazionale diversi studi hanno mostrato l'efficacia di tali prassi, mentre in Italia non esistono ricerche sperimentali finalizzate a studiarne l’impatto sugli apprendimenti. Il progetto è entrato all’interno di quest’ambito di studi per controllare l’efficacia di un insieme di pratiche di FA sull'incremento delle abilità di comprensione dei testi degli studenti. Lo scopo è stato perseguito realizzando una sperimentazione in una scuola secondaria di primo grado che ha coinvolto gli studenti di due classi prime, i quali sono stati suddivisi a metà attraverso tecniche di randomizzazione per formare i due gruppi, sperimentale e di controllo. Dopo aver effettuato una rilevazione iniziale delle abilità di comprensione dei testi degli studenti (pre-test), è stato realizzato con quelli del gruppo sperimentale un intervento composto da 15 incontri di FA della durata di due ore ciascuno. Alla fine, sono state effettuate due rilevazioni finali (post-test) utilizzando sia la stessa prova utilizzata come pre-test sia una prova parallela. È stata calcolata la differenza post-test-pre-test per ogni gruppo ed è stato verificato quanto avesse influito la partecipazione all’intervento sperimentale su tale differenza tramite test non parametrici. I risultati hanno mostrato un incremento di abilità lievemente maggiore nel gruppo sperimentale, se confrontato con quello del gruppo di controllo, anche se questa differenza tra i due gruppi non è statisticamente significativa. Sebbene le analisi non abbiano consentito di rifiutare l’ipotesi nulla, la rilevanza di tale progetto risiede nel tentativo di aprire il dibattito sull’efficacia di prassi di FA sugli apprendimenti degli studenti in Italia.

New challenges in mathematics for the european higher education

In this paper we will talk about a math project submitted to the Lifelong Learning Programme. European higher education needs a reform in order to play its full role in the Europe of Knowledge. Modernisation of higher education is necessary in the areas of curricula (Bologna process), funding and governance so that higher education institutions can face the challenges posed by globalisation and contribute more effectively to the training and retraining of the European workforce. On the other hand Mathematics is an essential component of all educational systems. Mathematical literacy is being scrutinized in assessment efforts such as the OCDE Programme for International Student Assessment (PISA). This showed a low level in Europe. Due to the Bologna Process, which brought several didactical implications for Higher Education (HE) institutions, there is the need of lifelong learning. This evolution is in conflict with the earlier mentioned lack of competencies on basic sciences, such as Mathematics. Forced by this duality, efforts are combined to share expertise in the Math field and the integration of pedagogical methodologies becomes a necessity. Thus, several European countries have proposed an International Project to the Lifelong Learning Programme, Action ERASMUS Modernisation of Higher Education, to make institutions more attractive and more responsive to the needs of the labour market, citizens and society at large. One of the main goals of the project is to attract students to math through high-quality instructional units in an understandable, exciting and attractive way.

Assessment in CLIL

The aim of this talk is to explore assessment in higher education and support for learners during their academic education. It investigates the assessment methods that provide success for universities and learners. Universities which implement CLIL should assess learners who would like to attend a programme in English without taking account of their English language qualifications. This assessment should be done in writing, listening and comprehension, speaking and reading and comprehension. In the literature, formative and summative assessments are considered. Formative assessment is ongoing, 'more complex as its intention is to be directly diagnostics with a view to immediately impacting on learner's next steps' (Coyle et al, 2010). Summative assessment occurs at the end of the term or course. McKay, 2006 divides assessment into three phases: design, operationalization and administration phase. If these three phases can't be embedded in the classroom as they are, they can be introduced as a set of questions; why?, how? and what?

Gender bias in the Trends in Mathematics and Science Study 2003 (TIMMS) for Canadian students /

This study is a secondary data analysis of the Trends in Mathematics and Science Study 2003 (TIMSS) to determine if there is a gender bias, unbalanced number of items suited to the cognitive skill of one gender, and to compare performance by location. Results of the Grade 8, math portion of the test were examined. Items were coded as verbal, spatial, verbal /spatial or neither and as conventional or unconventional. A Kruskal- Wallis was completed for each category, comparing performance of students from Ontario, Quebec, and Singapore. A Factor Analysis was completed to determine if there were item categories with similar characteristics. Gender differences favouring males were found in the verbal conventional category for Canadian students and in the spatial conventional category for students in Quebec. The greatest differences were by location, as students in Singapore outperformed students from Canada in all areas except for the spatial unconventional category. Finally, whether an item is conventional or unconventional is more important than whether the item is verbal or spatial. Results show the importance of fair assessment for the genders in both the classroom and on standardized tests.

Collaborative Learning and Assessment in e-Learning

Report published in the Proceedings of the National Conference on "Education and Research in the Information Society", Plovdiv, May, 2016