Documenter les façons de faire d'enseignants de la 6e année du primaire dans toutes les étapes de la démarche d'évaluation

Le changement de paradigme amené par l'approche par compétences dans le système éducatif québécois au début des années 2000 devait conduire les enseignants à adopter de nouvelles façons de faire prescrites par la Politique en évaluation des apprentissages (MEQ, 2003) qui s’inscrivent dans une évaluation au service de l’apprentissage. Brookhart (2004) pour sa part, considère que la recherche en ce qui concerne les apprentissages et l'évaluation au primaire sont limitées et Boutin (2007) se questionne sur le changement effectif des pratiques considérant les vives critiques suscitées quant à l'implantation de l'approche par compétences dans les écoles québécoises. Cette recherche vise à apporter un éclairage quant aux façons de faire d'enseignants de la 6e année du primaire à toutes les étapes de la démarche d'évaluation en lecture, écriture et mathématique en les situant dans des perspectives nouvelles ou traditionnelles de l'évaluation et en observant si la fréquence des énoncés reliés aux façons de faire diffère selon les caractéristiques personnelles des enseignants. Suivant une méthodologie de type simultanée imbriquée, 55 enseignants ont rempli un questionnaire et 14 d'entre eux ont participé à des entrevues semi-dirigées. L’analyse des données montre que tout au long de la démarche d'évaluation, les façons de faire des enseignants varient, et ce, dans les trois matières: ils utilisent des façons de faire qui sont situées tantôt dans un continuum allant des perspectives traditionnelles aux perspectives nouvelles de l'évaluation comme dans la planification, la collecte de données, l'interprétation et la communication et tantôt dans les nouvelles perspectives de l'évaluation comme dans l'étape du jugement, et ce, selon leurs caractéristiques sociodémographiques. Nous avons ainsi pu catégoriser les enseignants selon le modèle de Schwartz, Bransford et Sears (2005) en distinguant ceux qui sont efficients de ceux qui ne le sont pas, même s'ils innovent. Afin d’améliorer les pratiques des enseignants à chaque étape de la démarche d’évaluation, nous pensons qu'il serait intéressant de valider un tableau synthèse inspiré de Scallon (2004) et l'OCDE (2005) afin de créer une métagrille pour analyser la pertinence et la cohérence des façons de faire des enseignants en cours de cycle dans une optique d’évaluation intégrée à l’apprentissage.

Does the summative assessment of real world learning using criterion-referenced assessment need to be discipline specific?

This paper synthesises the existing literature on the contemporary conception of ‘real world’ and compares it with similar notions such as ‘authentic’ and ‘work integrated learning’. While the term ‘real world’ may be partly dependent on the discipline, it does not necessarily follow that the criterion-referenced assessment of ‘real world’ assessment must involve criteria and performance descriptors that are discipline specific. Two examples of summative assessment (court report and trial process exercise) from a final year core subject at the Queensland University of Technology, LWB432 Evidence, emphasise real world learning, are authentic, innovative and better prepare students for the transition into the workplace than more generic forms of assessment such as tutorial participation or oral presentations. The court report requires students to attend a criminal trial in a Queensland Court and complete a two page report on what they saw in practice compared with what they learned in the classroom. The trial process exercise is a 50 minute written closed book activity conducted in tutorials, where students plan questions that they would ask their witness in examination-in-chief, plan questions that they would ask their opponent’s witness in cross-examination, plan questions that they would ask in reexamination given what their opponent asked in cross-examination, and prepare written objections to their opponent’s questions. The trial process exercise simulates the real world, whereas the court report involves observing the real world, and both assessment items are important to the role of counsel. The design of the criterion-referenced assessment rubrics for the court report and trial process exercise is justified by the literature. Notably, the criteria and performance descriptors are not necessarily law specific and this paper highlights the parts that may be easily transferred to other disciplines.

Development and evaluation of an integrated clinical learning model to inform continuing education for acute care nurses

Background Significant ongoing learning needs for nurses have occurred as a direct result of the continuous introduction of technological innovations and research developments in the healthcare environment. Despite an increased worldwide emphasis on the importance of continuing education, there continues to be an absence of empirical evidence of program and session effectiveness. Few studies determine whether continuing education enhances or develops practice and the relative cost benefits of health professionals’ participation in professional development. The implications for future clinical practice and associated educational approaches to meet the needs of an increasingly diverse multigenerational and multicultural workforce are also not well documented. There is minimal research confirming that continuing education programs contribute to improved patient outcomes, nurses’ earlier detection of patient deterioration or that standards of continuing competence are maintained. Crucially, evidence-based practice is demonstrated and international quality and safety benchmarks are adhered to. An integrated clinical learning model was developed to inform ongoing education for acute care nurses. Educational strategies included the use of integrated learning approaches, interactive teaching concepts and learner-centred pedagogies. A Respiratory Skills Update education (ReSKU) program was used as the content for the educational intervention to inform surgical nurses’ clinical practice in the area of respiratory assessment. The aim of the research was to evaluate the effectiveness of implementing the ReSKU program using teaching and learning strategies, in the context of organisational utility, on improving surgical nurses’ practice in the area of respiratory assessment. The education program aimed to facilitate better awareness, knowledge and understanding of respiratory dysfunction in the postoperative clinical environment. This research was guided by the work of Forneris (2004), who developed a theoretical framework to operationalise a critical thinking process incorporating the complexities of the clinical context. The framework used educational strategies that are learner-centred and participatory. These strategies aimed to engage the clinician in dynamic thinking processes in clinical practice situations guided by coaches and educators. Methods A quasi experimental pre test, post test non–equivalent control group design was used to evaluate the impact of the ReSKU program on the clinical practice of surgical nurses. The research tested the hypothesis that participation in the ReSKU program improves the reported beliefs and attitudes of surgical nurses, increases their knowledge and reported use of respiratory assessment skills. The study was conducted in a 400 bed regional referral public hospital, the central hub of three smaller hospitals, in a health district servicing the coastal and hinterland areas north of Brisbane. The sample included 90 nurses working in the three surgical wards eligible for inclusion in the study. The experimental group consisted of 36 surgical nurses who had chosen to attend the ReSKU program and consented to be part of the study intervention group. The comparison group included the 39 surgical nurses who elected not to attend the ReSKU program, but agreed to participate in the study. Findings One of the most notable findings was that nurses choosing not to participate were older, more experienced and less well educated. The data demonstrated that there was a barrier for training which impacted on educational strategies as this mature aged cohort was less likely to take up educational opportunities. The study demonstrated statistically significant differences between groups regarding reported use of respiratory skills, three months after ReSKU program attendance. Between group data analysis indicated that the intervention group’s reported beliefs and attitudes pertaining to subscale descriptors showed statistically significant differences in three of the six subscales following attendance at the ReSKU program. These subscales included influence on nursing care, educational preparation and clinical development. Findings suggest that the use of an integrated educational model underpinned by a robust theoretical framework is a strong factor in some perceptions of the ReSKU program relating to attitudes and behaviour. There were minimal differences in knowledge between groups across time. Conclusions This study was consistent with contemporary educational approaches using multi-modal, interactive teaching strategies and a robust overarching theoretical framework to support study concepts. The construct of critical thinking in the clinical context, combined with clinical reasoning and purposeful and collective reflection, was a powerful educational strategy to enhance competency and capability in clinicians.

An instrument to measure the approach to learning for assessment in economics

Economics education research studies conducted in the UK, USA and Australia to investigate the effects of learning inputs on academic performance have been dominated by the input-output model (Shanahan and Meyer, 2001). In the Student Experience of Learning framework, however, the link between learning inputs and outputs is mediated by students' learning approaches which in turn are influenced by their perceptions of the learning contexts (Evans, Kirby, & Fabrigar, 2003). Many learning inventories such as Biggs' Study Process Questionnaires and Entwistle and Ramsden' Approaches to Study Inventory have been designed to measure approaches to academic learning. However, there is a limitation to using generalised learning inventories in that they tend to aggregate different learning approaches utilised in different assessments. As a result, important relationships between learning approaches and learning outcomes that exist in specific assessment context(s) will be missed (Lizzio, Wilson, & Simons, 2002). This paper documents the construction of an assessment specific instrument to measure learning approaches in economics. The post-dictive validity of the instrument was evaluated by examining the association of learning approaches to students' perceived assessment demand in different assessment contexts.

A matrix for appropriate assessment of workplace learning in stem disciplines

With increasing interest shown by Universities in workplace learning, especially in STEM disciplines, an issue has arisen amongst educators and industry partners regarding authentic assessment tasks for work integrated learning (WIL) subjects. This paper describes the use of a matrix, which is also available as a decision-tree, based on the features of the WIL experience, in order to facilitate the selection of appropriate assessment strategies. The matrix divides the WIL experiences into seven categories, based on such factors as: the extent to which the experience is compulsory, required for membership of a professional body or elective; whether the student is undertaking a project, or embedding in a professional culture; and other key aspects of the WIL experience. One important variable is linked to the fundamental purpose of the assessment. This question revolves around the focus of the assessment: whether on the person (student development); the process (professional conduct/language); or the product (project, assignment, literature review, report, software). The matrix has been trialed at QUT in the Faculty of Science and Technology, and also at the University of Surrey, UK, and has proven to have good applicability in both universities.

A practical introduction to first steps : assessment, teaching and learning. 'Una introducción práctica a los primeros pasos : evaluación, enseñanza y aprendizaje'.

Es un recurso pensado para apoyar a los docentes en la labor de mejorar los niveles de alfabetización infantil y, alcanzar los objetivos que se han marcado para los estudiantes y las escuelas. Para ello, se establece la evaluación de este proceso de enseñanza del lenguaje oral y escrito, a través del llamado 'proceso de desarrollo continuo', por el cual el profesor puede supervisar y evaluar el progreso de sus alumnos desde la guardería y en los sucesivos años de escolarización, mediante la utilización de estrategias que cubran las necesidades específicas de cada uno de ellos en el contexto de la misma clase.

Mathematical power of special-needs pupils : an ICT-based dynamic assessment format to reveal weak pupils' learning potential

This paper reports a study aimed at revealing special-educational-needs pupils' learning potential by means of an ICT-based assessment including a dynamic visual tool that might help pupils when solving mathematics problems. The study focused on subtraction problems up to 100, which require 'borrowing'. These problems, in which the value of the ones-digit of the subtrahend is larger than the ones-digit of the minuend, are known as a serious difficulty for weak pupils in mathematics. Seven of such problems from a standardised test were placed in the ICT environment. Data were collected from two test conditions: the standardised written test format and the ICT version of the test items including the tool that provided pupils with a set of virtual manipulatives. The 37 pupils involved in the study were 8–12 years old and from two special-education schools in the Netherlands. Comparison of the performance scores in the two formats showed that an ICT-based assessment format, including a dynamic visual tool, can reveal weak pupils' learning potential and strategy use. The study also pointed out that 'partial-tool use', ie, not carrying out the complete subtraction operation with the tool, can provide sufficient support to find the correct answer.

Using online environments to promote assessment as a learning enhancement process

The 21st century presents new challenges relating to the need for assessment to be more innovative, more responsive to students' needs, and more relevant and authentic. The characteristics of good assessment are well known and resources abound to assist academic staff to change their practices. Yet, at a time when the imperative for reconsidering practices has never been greater, it appears to be very difficult to bring about and maintain substantive change in assessment. This paper presents case studies that illustrate the way some academic staff have responded to the challenges. In particular, how the online environment can enhance learning through formative assessment is illustrated with four case studies. The paper outlines specific challenges faced in each case and  discusses issues that arose during development and delivery. It concludes by identifying some of the factors that helped to facilitate changes in assessment practices in these specific cases.

Approaches to learning across cultures : The role of assessment

In the context of a broader research study on the intercultural understanding of teachers in Australia, Japan and Thailand, this paper focuses on approaches to learning and the role of assessment in shaping such approaches. Popular contrasts portray Asian learners as compliant and favouring rote memorisation and Western learners as independent and favouring deep, conceptual learning. Yet Asian students frequently outperform their Western counterparts in competitive tests purported to measure higher cognitive skills. Biggs and his associates have challenged the stereotypical view of Asian students as rote learners as a Western misperception. But data from the present cross-cultural study suggest it is more than a Western misperception, being shared by teachers in Japan and Thailand. With this background, this paper then explores the role of assessment through an analysis of examination papers in the three countries at the high stakes, year 12 level. This analysis of the ways in which knowledge and comprehension are assessed identifies different practices across cultures but not ones corresponding to the rhetoric on contrasting approaches to learning. Rather it concludes that assessment tasks classified superficially as comprehension can be approached through memorisation and conversely, those often classified as memorisation can require careful reading, thought and interpretation, while drawing from an extensive knowledge base. A shared understanding of the nature of assessment tasks in different cultures thus has the potential to dissolve the demarcation of culturally embedded learning styles and to enhance deep learning grounded in specialist knowledge for scholars, be they students or teachers, in all cultures.

Integrated Solar City: Application of the Ecological Risk Assessment Paradigm to Inform Reclamation

The Integrated Solar City (ISC) is a large solar project that has been proposed for development in the western state of Gujarat, India. The project will be the largest solar project in the world. It will require the use of large land resources to construct. An ecological risk assessment (ERA) is used to assess potential impacts from project construction and operation. Previous research suggests that a solar project of this scale would require the removal of vegetation along with other negative effects on vegetation and soil. The ERA was used to lay out a revegetation plan that would help mitigate the long-term environmental impacts in the Banaskantha and Kachchh regions of Gujarat, India.

Field assessment of social learning approach to teaching adolescents about alcohol and driving. Final report.

National Highway Traffic Safety Administration, Washington, D.C.

Using online peer assessment tools to provide feedback and promote learning

A set of slides used for the RAP SIG event on 19 Jan 2017

What are students' understandings of how digital tools contribute to learning in design disciplines?

Building Information Modelling (BIM) is evolving in the Construction Industry as a successor to CAD. CAD is mostly a technical tool that conforms to existing industry practices, however BIM has the capacity to revolutionise industry practice. Rather than producing representations of design intent, BIM produces an exact Virtual Prototype of any building that in an ideal situation is centrally stored and freely exchanged between the project team, facilitating collaboration and allowing experimentation in design. Exposing design students to this technology through their formal studies allows them to engage with cutting edge industry practices and to help shape the industry upon their graduation. Since this technology is relatively new to the construction industry, there are no accepted models for how to “teach” BIM effectively at university level. Developing learning models to enable students to make the most out of their learning with BIM presents significant challenges to those teaching in the field of design. To date there are also no studies of students experiences of using this technology. This research reports on the introduction of Building Information Modeling (BIM) software into a second year Bachelor of Design course. This software has the potential to change industry standards through its ability to revolutionise the work practices of those involved in large scale design projects. Students’ understandings and experiences of using the software in order to complete design projects as part of their assessment are reported here. In depth semi-structured interviews with 6 students revealed that students had views that ranged from novice to sophisticate about the software. They had variations in understanding of how the software could be used to complete course requirements, to assist with the design process and in the workplace. They had engaged in limited exploration of the collaborative potential of the software as a design tool. Their understanding of the significance of BIM for the workplace was also variable. The results indicate that students are beginning to develop an appreciation for how BIM could aid or constrain the work of designers, but that this appreciation is highly varied and likely to be dependent on the students’ previous experiences of working in a design studio environment. Their range of understandings of the significance of the technology is a reflection of their level of development as designers (they are “novice” designers). The results also indicate that there is a need for subjects in later years of the course that allow students to specialise in the area of digital design and to develop more sophisticated views of the role of technology in the design process. There is also a need to capitalise on the collaborative potential inherent in the software in order to realise its capability to streamline some aspects of the design process. As students become more sophisticated designers we should explore their understanding of the role of technology as a design tool in more depth in order to make recommendations for improvements to teaching and learning practice related to BIM and other digital design tools.

Students’ conceptual knowledge about workplace pedagogies and applications to learning in the workplace

The development of effective workplace pedagogies is integral to work-integrated and work-based learning. The workplace pedagogies that facilitate and support learning include: activities in which individuals engage such as daily work practices, questioning; observing, and listening; interactions with more experienced workers through coaching and modelling; and referencing documented procedures. Each of these dimensions is significant in enhancing processes of workplace learning. Learning can be optimised when these pedagogies are appropriately embedded in the context of and process of participating in normal work activities. Yet learners need to understand the nature of these pedagogies, and how and for what purposes to use these to achieve a range of learning outcomes. This is because it is the worker-learners who play the key roles in the process and outcomes of learning through work. A pilot study was conducted on students’ conceptions of how each of these dimensions of workplace pedagogy help their learning, by providing examples of learning from these sources; and stating their preferences for learning in the workplace. A sample of seventeen students, enrolled in the second year of a Diploma in Nursing course at a Technical and Further Education institution, participated in a survey intended to capture these conceptions and the importance attached to each of them. The findings indicate that these students have basic understanding of how each of seven workplace pedagogic practices can contribute to their learning. They reported relying mostly on daily practices, observing and listening to others, modelling, coaching, and other workers. Their selection of these contributions emphasise significant opportunities for guided learning by others, yet suggest fewer student-initiated interactions, less intensity in interactions, and likelihood that learning is more passive. The data also suggests that these students rely mostly on using academic learning skill, and limited workplace learning skills. It is proposed, therefore, that the knowledge and understandings about workplace learning and pedagogies might be best embedded in the full curriculum and not become add-on shortly before students go on work placement. This approach will allow students to appreciate the significance and use of workplace pedagogies for learning.