Documenter les pratiques évaluatives de trois enseignants du primaire au Sénégal au regard de la rétroaction écrite en correction de textes d'élèves du CM1

Notre recherche s’inscrit dans le cadre de l’adoption par le Sénégal de l’approche par compétences avec des pratiques évaluatives favorisant la réussite du plus grand nombre d’élèves. Parmi ces pratiques, figurent celles liées à l’évaluation formative et particulièrement aux rétroactions écrites, pouvant prolonger les activités d’apprentissage (Scallon, 2004; OCDE, 2005) et permettre la maîtrise des acquis. De ce point de vue, nous avons examiné les façons de faire l’évaluation formative de trois enseignants sénégalais du primaire. Le but est de documenter leurs façons de pratiquer la rétroaction écrite avant et après une expérimentation des annotations selon les modèles de Rodet (2000) et de Lebœuf (1999). Dans cette optique, notre recherche puise ses fondements dans les recherches qualitatives liées au paradigme naturaliste (Fortin, 2010; Deslauriers et Kérésit, 1997; Savoie-Zajc et Karsenti, 2011). Plus précisément, nous avons opté pour une recherche-formation au travers de la double démarche que nous avons empruntée. D’une part, l’étude est parcourue par une démarche de recherche qualitative telle que Fortin (2010) la conçoit, et ce, à des fins de compréhension des pratiques de rétroaction écrite des enseignants ciblés. D’autre part, le chercheur suit une démarche de formation en s’appuyant sur les travaux de Galvani (1999) et de Lafortune (2006), avec comme visée l’expérimentation de la pratique des annotations. Comme instruments de collecte, nous avons utilisé l’entrevue individuelle semi-structurée ainsi que deux guides d’entretien, en plus des deux grilles de recueil d’annotations. L’analyse des données a permis de constater que, en amont de l’expérimentation, la rétroaction écrite est constituée essentiellement de signes divers, de notes chiffrées et de commentaires sous forme d’appréciations globales. En aval, elle se compose majoritairement d’annotations à formulations positive et constructive à contenu cognitif, et des commentaires injonctifs, verdictifs et explicatifs. Au final, les enseignants trouvent cette nouvelle façon de faire avantageuse en termes de réussite des élèves mais contraignante au vu de son caractère chronophage. Cette recherche ouvre, entre autres, sur une étude traitant des liens entre annotations et réussite des élèves.

Akzeptanz und Motivation beim selbstregulierten Lernen unter Einsatz von neuen Medien in der berufsbegleitenden Weiterbildung

Das Ziel der Dissertation war die Untersuchung des Computereinsatzes zur Lern- und Betreuungsunterstützung beim selbstgesteuerten Lernen in der Weiterbildung. In einem bisher konventionell durchgeführten Selbstlernkurs eines berufsbegleitenden Studiengangs, der an das Datenmanagement der Bürodatenverarbeitung heranführt, wurden die Kursunterlagen digitalisiert, die Betreuung auf eine online-basierte Lernbegleitung umgestellt und ein auf die neuen Lernmedien abgestimmtes Lernkonzept entwickelt. Dieses neue Lernkonzept wurde hinsichtlich der Motivation und der Akzeptanz von digitalen Lernmedien evaluiert. Die Evaluation bestand aus zwei Teilen: 1. eine formative, den Entwicklungsprozess begleitende Evaluation zur Optimierung der entwickelten Lernsoftware und des eingeführten Lernkonzeptes, 2. eine sowohl qualitative wie quantitative summative Evaluation der Entwicklungen. Ein zentraler Aspekt der Untersuchung war die freie Wahl der Lernmedien (multimediale Lernsoftware oder konventionelles Begleitbuch) und der Kommunikationsmedien (online-basierte Lernplattform oder die bisher genutzten Kommunikationskanäle: E-Mail, Telefon und Präsenztreffen). Diese Zweigleisigkeit erlaubte eine differenzierte Gegenüberstellung von konventionellen und innovativen Lernarrangements. Die Verbindung von qualitativen und quantitativen Vorgehensweisen, auf Grund derer die subjektiven Einstellungen der Probanden in das Zentrum der Betrachtung rückten, ließen einen Blickwinkel auf den Nutzen und die Wirkung der Neuen Medien in Lernprozessen zu, der es erlaubte einige in der Literatur als gängig angesehene Interpretationen in Frage zu stellen und neu zu diskutieren. So konnten durch eine Kategorisierung des Teilnehmerverhaltens nach online-typisch und nicht online-typisch die Ursache-Wirkungs-Beziehungen der in vielen Untersuchungen angeführten Störungen in Online-Seminaren verdeutlicht werden. In den untersuchten Kursen zeigte sich beispielsweise keine Abhängigkeit der Drop-out-Quote von den Lern- und Betreuungsformen und dass diese Quote mit dem neuen Lernkonzept nur geringfügig beeinflusst werden konnte. Die freie Wahl der Lernmedien führte zu einer gezielten Nutzung der multimedialen Lernsoftware, wodurch die Akzeptanz dieses Lernmedium stieg. Dagegen war die Akzeptanz der Lernenden gegenüber der Lernbegleitung mittels einer Online-Lernplattform von hoch bis sehr niedrig breit gestreut. Unabhängig davon reichte in allen Kursdurchgängen die Online-Betreuung nicht aus, so dass Präsenztreffen erbeten wurde. Hinsichtlich der Motivation war die Wirkung der digitalen Medien niedriger als erwartet. Insgesamt bieten die Ergebnisse Empfehlungen für die Planung und Durchführung von computerunterstützten, online-begleiteten Kursen.

Investigating familiar interfaces to help older adults learn computer applications more easily

Many older adults wish to gain competence in using a computer, but many application interfaces are perceived as complex and difficult to use, deterring potential users from investing the time to learn them. Hence, this study looks at the potential of ‘familiar’ interface design which builds upon users’ knowledge of real world interactions, and applies existing skills to a new domain. Tools are provided in the form of familiar visual objects, and manipulated like real-world counterparts, rather than with buttons, icons and menus found in classic WIMP interfaces. This paper describes the formative evaluation of computer interactions that are based upon familiar real world tasks, which supports multitouch interaction, involves few buttons and icons, no menus, no right-clicks or double-clicks and no dialogs. Using an example of an email client to test the principles of using “familiarity”, the initial feedback was very encouraging, with 3 of the 4 participants being able to undertake some of the basic email tasks with no prior training and little or no help. The feedback has informed a number of refinements of the design principles, such as providing clearer affordance for visual objects. A full study is currently underway.

Evaluating a strategic approach to professional development through guided reflection

Research on quality in early childhood has consistently shown that staff are the cornerstone of excellence, and that staff training makes a difference to services provided to children and families. There is also a growing awareness of the importance of adopting a planned approach to career development and that this begins with self-assessment, and can be enhanced through the use of guided reflection with a mentor. The Early Childhood Consortium Victoria (ECCV) at The University of Melbourne, has developed a self-assessment manual (SAM) designed as a tool for early childhood practitioners to explore their work in a strategic way. It serves the dual purposes of assisting practitioners to address issues of service quality, as well as promoting individual professional development through reflective practice. SAM has now been piloted in a number of early childhood settings in Australia and this paper presents a formative evaluation of this work and discusses its potential for professional development planning.

Empowering practitioners to critically examine their current practice

A Self-Assessment Manual (SAM) for early childhood practitioners has been developed around the previously reported framework (Raban, Waniganayake, Deans, Brown & Reynolds, 2003a), and this has been piloted in a number of early childhood settings. When engaging in self reflection using SAM, practitioners collaborate with mentors from the Early Childhood Consortium Victoria (ECCV) to consider their past, present and future professional experiences. This process empowers practitioners to critically examine their current practice and plan for their future professional development in a more systematic way. SAM is seen here to serve dual purposes: on the one hand, it is an evaluative instrument that can direct professional development of individual practitioners. On the other hand, it is a research tool aimed at identifying theoretical assumptions underpinning professional practice, and allows a longitudinal approach to mapping professional growth and development. Either way, it has the potential to enhance the quality of early childhood experiences for preschool children regardless of the settings in which they may find themselves. This paper presents a formative evaluation of this work and discusses its potential for professional development planning.

Using multimedia concept maps to enhance the learner experience in business law

Students’ learning experience can be affected by difficulties in understanding the interrelationships between concepts and also between topics. Concept maps have been used in many disciplines (Kremer & Gains, 1996) to structure information and express relationships between them. Their holistic approach with multiple pathways through the learning resource can make relationships and linkages between topics and subtopics obvious, and contribute to a meaningful and positive learning experience. This paper outlines the development and formative evaluation of two hypermedia concept maps which led to the development of a series of eleven concept maps to enhance the learning experience of students in a first year undergraduate business law unit.

As part of the Stage 1 formative evaluation, two concept maps were developed together with supporting multimedia resources and trialled on the learners. Feedback was also obtained from technical staff. This phase was designed to assess and control the quality of the learning resource as well as the impact it had on the learning experience. The paper closes by discussing how information gained in Stage 1 was used in Stage 2 as a basis to modify the initially trialled maps and to develop the other supporting maps.

Converged learning environment to support all learners

Universities face an uncertain future unless they significantly alter their teaching and learning approaches and become more client focused. They need to reach more and more students who do not fit the standard residential degree. This has meant that lecturers have had to facilitate learning for on-campus students on local and overseas campuses as well as for off-campus students based locally and globally. Given the context, flexibility has been recognised as a key idea making it imperative to explore innovative models for flexibility that bring together and accommodate and support all learner groups.

This paper describes a project to support students of an undergraduate Business Law unit via the development of such a converged learning environment. It attempts to draw together the different communities of students (on-campus and off-campus based locally and overseas) enrolled in that unit. In order to assist others interested in supporting flexible learning in a similar way, the paper shares details of formative evaluation and planned summative evaluation, together with reflections on lessons learned by the teaching academic and educational designer during its development process.

Introducing active support in the United States : staff training developments and research directions

Aim: Active Support, an evidence-based intervention developed in the UK and tested in Australia, enables direct support professionals to engage people with high support needs in meaningful and rewarding every day activities. This paper outlines the practical details of adapting the Active Support curriculum for service providers in the US and outlines an evaluation methodology that will inform both service delivery and future developments of Active Support.

Method: Active Support curricula developed in the UK and Australia were adapted for implementation the US.Train-the-trainer activities were conducted in early 2008 in three group homes serving 12 people with intellectual or developmental disabilities. A formative evaluation process was used to identify changes in the materials and training design needed to support a randomized controlled trial of the intervention in 20 small group homes.

Results: Modifications in the delivery of training are needed to account for differences in scheduling patterns and high turnover rates in US group homes, and to adjust British/Australian terminology to the U.S. context.

Conclusions: The translation of active support into the U.S. context requires modifications to support successful implementation. Research is planned to document the success of the modified curriculum in improving outcomes for persons with disabilities.

Addressing online information needs in palliative care : an action research-inspired approach

Whereas user participation has been embraced worldwide as a means to provide better patient outcomes, the implementation of formative, action research approaches in online health information has remained under-explored. The purpose of this study is to present an action research-based methodology that allows the scoping of health information and design needs in complex, multi-user online environments. The project's four main stages were informed by an iterative, formative approach involving continuous expert and user evaluation. The study suggests that an action research-inspired formative approach can be successfully employed to generate user-participation. Moreover, sustained user-participation effectively addresses most quality issues regarding content, language, and accessibility raised in the recent literature. The paper concludes that an action research approach geared to develop online health resources deserves more attention.

Evidence-based development of school-based and family-involved prevention of overweight across Europe : the ENERGY-project's design and conceptual framework

Background
There is an urgent need for more carefully developed public health measures in order to curb the obesity epidemic among youth. The overall aim of the "EuropeaN Energy balance Research to prevent excessive weight Gain among Youth" (ENERGY)-project is the development and formative evaluation of a theory-informed and evidence-based multi-component school-based and family-involved intervention program ready to be implemented and evaluated for effectiveness across Europe. This program aims at promoting the adoption or continuation of health behaviors that contribute to a healthy energy balance among school-aged children. Earlier studies have indicated that school and family environments are key determinants of energy-balance behaviors in schoolchildren. Schools are an important setting for health promotion in this age group, but school-based interventions mostly fail to target and involve the family environment.

Methods
Led by a multidisciplinary team of researchers from eleven European countries and supported by a team of Australian experts, the ENERGY-project is informed by the Environmental Research Framework for Weight gain Prevention, and comprises a comprehensive epidemiological analysis including 1) systematic reviews of the literature, 2) secondary analyses of existing data, 3) focus group research, and 4) a cross European school-based survey.

Results and discussion
The theoretical framework and the epidemiological analysis will subsequently inform stepwise intervention development targeting the most relevant energy balance-related behaviors and their personal, family-environmental and school-environmental determinants applying the Intervention Mapping protocol. The intervention scheme will undergo formative and pilot evaluation in five countries. The results of ENERGY will be disseminated among key stakeholders including researchers, policy makers and the general population.

Conclusions
The ENERGY-project is an international, multidisciplinary effort to develop and test an evidence-based and theory-informed intervention program for obesity prevention among school-aged children.

Eventscapes : visualizing events over time with emotive facets

The scale and dynamicity of social media, and interaction between traditional news sources and online communities, has created challenges to information retrieval approaches. Users may have no clear information need or be unable to express it in the appropriate idiom, requiring instead to be oriented in an unfamiliar domain, to explore and learn. We present a novel data-driven visualization, termed Eventscape, that combines time, visual media, mood, and controversy. Formative evaluation highlights the value of emotive facets for rapid evaluation of mixed news and social media topics, and a role for such visualizations as pre-cursors to deeper search. Copyright 2011 ACM.

A context-sensitive device to help people with autism cope with anxiety

We describe a smartphone application that helps people with Autism Spectrum Disorder (ASD) cope with anxiety attacks. Our prototype provides a one-touch interface for indicating a panic level. The device's response-to instruct, soothe, and/or contact carers-is sensitive to the user's context, consisting of time, location, ambient noise, and nearby friends. Formative evaluation unearths a critical challenge to building assistive technologies for ASD sufferers: can regimented interfaces foster flexible behaviour? Our observations suggest that a delicate balance of design goals is required for a viable assistive technology.

Towards a video browser for the digital native

Almost every aspect of how we create, transmit, and consume video has changed, but video interfaces still mimic those from video's inception. We extend Temporal Semantic Compression for interactive video browsing, which uses an arbitrary frame-by-frame interest measure to sub-sample video in real time, with user interface elements that visualize these measures and the effect of compressing on them. We experiment with a novel interest measure for popularity, and design novel visualizations for expressing interest measures and the compression interaction. We conduct the first formative evaluation of the TSC paradigm, with 8 subjects, and report design implications arising from it.

Uma avaliação política da política de avaliação da educação superior brasileira

We had as the problem of analysis in this research: what are the assumptions, principles and general content that based the Sistema Nacional de Avaliação da Educação Superior (SINAES). We started from the hypothesis that the general content of SINAES is essentially based on the assumptions and principles of a control/regulatory perspective of evaluation and a summative epistemology, objectivist and quantitativist, constituted by members who prioritize testing and classification of courses and institutions based on market values. The overall goal was to make a political evaluation of SINAES and the specific objectives were: a) apply the concepts of politics evaluation and meta-evaluation, b) identify the role of international organizations in education reform in the 1990s and its impact on superior education in Brazil c) redeem the concept of evaluation, especially in the field of studies in education; and d) investigate the evaluation policies of Brazilian superior education leading to SINAES. As for the technical procedures for collecting and analyzing data, the research was made with bibliography and documents, considering that it was developed by bibliographic sources and official publications. It was developed by crossing sources: texts or documents remitted to others; it was also concentrated: on the role of international organizations in educational and State reforms (in the 1990s); on the policies of evaluation of the Brazilian superior education (1980s and 1990s); on the proposal of the Comissão Especial de Avaliação (CEA); on the Law No. 10.861/2004; on the documents of CONAES; on the Decree No. 5.773/2006, and the MEC Regulatory Ordinances No. 4/2008 and No. 12/2008. It did not stop in the so called purely technical aspects, but in the ideological field itself. The research found that international organizations, notably the World Bank, played a political, intellectual and financial role determinant to the field of education, a fact that reflects in the legal framework. It was also found that the politics of evaluation of the superior education is historically marked by conflict, represented by two distinct perspectives of different natures and emphases. On one hand, the focus is on control / regulation, favoring efficiency, productivity and competitiveness benchmarking and prioritizing the punctual performance and measurement. On the other, it seeks to transform academic perspective in primarily formative / emancipatory, in order to support more institutional improvement. It was concluded that the CEA presented a conception evaluation predominantly formative and emancipatory, which emphasized the idea of system, centered around the institution and repudiated the rankings practices. In the post-formulation period, however, some of its principles were fragmenting and, gradually, the institution was giving way to the courses and the Exame Nacional de Desempenho de Estudantes (ENADE) grew in prominence. With the creation of the Conceito Preliminar de Cursos superiores (CPC) and of the Índice Geral de Cursos da Instituição de Educação Superior (IGC), it was redemeed the practice of evaluation as measurement and control, under the principles of efficiency and productivity. So, SINAES that seemed like a progressive evaluation method has assumed a setting that close resembles the Exame Nacional de Cursos (ENC-Provão). Nevertheless, the survival of institutional formative evaluation, in the superior education evaluation policies, still an issue in dispute

A avaliação vista sob o aspecto da educação a distância

Este artigo trata da avaliação como um aspecto bastante relevante para a educação em geral, que também deve ser pensado e discutido frente à Educação a Distância (EAD). Assim, a partir de nossa experiência como professores e tendo por contexto um curso realizado totalmente à distância, analisamos algumas interações ocorridas ao longo do curso, que foi desenvolvido tendo como norte a teoria educacional construcionista. Valemo-nos também desta teoria para elaborar nossas idéias a respeito do caráter da avaliação frente a uma concepção formativa, em um ambiente de EAD, o qual valorizou todos os tipos de interação. Então, aliamos o Construcionismo1 à Avaliação Formativa que visa ao aperfeiçoamento do processo de aprendizagem do aluno em vez de buscar medir o que este aprendeu.