The potential contributions of concept maps for learning website to assessment for learning practices

The purpose of this paper is to examine the promising contributions of the Concept Maps for Learning (CMfL) website to assessment for learning practices. The CMfL website generates concept maps from relatedness degree of concepts pairs through the Pathfinder Scaling Algorithm. This website also confirms the established principles of effective assessment for learning, for it is capable of automatically assessing students' higher order knowledge, simultaneously identifying strengths and weaknesses, immediately providing useful feedback and being user-friendly. According to the default assessment plan, students first create concept maps on a particular subject and then they are given individualized visual feedback followed by associated instructional material (e.g., videos, website links, examples, problems, etc.) based on a comparison of their concept map and a subject matter expert's map. After studying the feedback and instructional material, teachers can monitor their students' progress by having them create revised concept maps. Therefore, we claim that the CMfL website may reduce the workload of teachers as well as provide immediate and delayed feedback on the weaknesses of students in different forms such as graphical and multimedia. For the following study, we will examine whether these promising contributions to assessment for learning are valid in a variety of subjects.

TQM in e-Learning: a Self-assessment Model and Questionnaire

Organizations are seeking new, integrated systems that enable rapid changes through early identification of opportunities and problems, tracking of progress against plans, flexible allocation of resources to achieve goals, and consistent operations. Total Quality Management (TQM) is an overall business strategy. It means that all activities of the company will be focused on satisfying all stakeholders of the company. TQM can be realised by using the EFQM model. The EFQM model is a tool that organizations may use as a framework for self-evaluation that enables an organization to identify its strengths and areas for improvement and the extent to which its operations and results are in line with the characteristics of an excellent organization. We focus on a training organisation or to the learning department of an organization. So we are limiting the EFQM model to the training /learning activities. We can apply EFQM perfect on the level of an activity (business line) of a company. We selected the main criteria for which the learner can play the role of assessor. So only three main criteria left: the enabling resources, the enabling processes and the (learning) results for the learner. We limited the last one to “learning results” based on the Kirkpatrick model.

The Australian Universities Teaching Committee project in 'Learning Outcomes and Curriculum Development in Psychology'

The Australian Universities Teaching Committee (AUTC) funds projects intended to improve the quality of teaching and learning in specific disciplinary areas. The project brief for 'Learning Outcomes and Curriculum Development in Psychology' for 2004/2005 was to 'produce an evaluative overview of courses ... with a focus on the specification and assessment of learning outcomes and ... identify strategic directions for universities to enhance teaching and learning'. This project was awarded to a consortium from The University of Queensland, University of Tasmania, and Southern Cross University. The starting point for this project is an analysis of the scientist-practitioner model and its role in curriculum design, a review of current challenges at a conceptual level, and consideration of the implications of recent changes to universities relating to such things as intemationalisation of programs and technological advances. The project will seek to bring together stakeholders from around the country in order to survey the widest possible range of perspectives on the project brief requirements. It is hoped also to establish mechanisms for fiiture scholarly discussion of these issues, including the establishment of an Australian Society for the Teaching of Psychology and an annual conference.

Tele-education and competencies assessment to Brazilian's auxiliary nurse

This paper presents Brazilian's experience with the organization of methods and strategies for the assessment of competencies for technical level of nursing workers. The evaluative process proposed includes the creation of a learning-oriented and distance-based virtual assessment environment. The proposed methodology for professional competencies assessment adopted a critical-emancipatory perspective. A tele-education environment was deployed, involving software development - a virtual man - and an assessment cybertutor. Learning modules for the cybertutor were developed and videos of clinical simulations, structured around assessment in cognitive, behavioral, and simulation areas. The evaluation modules considered aspects of competencies in know-know, know-how and know-act professional ethics. Also the variability of practices of nursing - hospitals and primary health care units - was considered. This instrument showed as an important strategy for the optimization of assessment procedures that are widely used across Brazil and it is a powerful tool for incorporation into the continuing professional education.

Health-related learning needs and interests of selected non-institutionalized elderly

The research question in this study was "How do the noninstitutionalized elderly in the Hamilton-Wentworth Region perceive their learning needs and interests related to health?" The theoretical foundations of instruction for adults were reviewed as well as learning needs and interests in adult education, the assessment of learning needs in general, and the assessment of the learning needs of the elderly. The methodology used was a descriptive design. A research-based questionnaire-interview was developed, refined, and pilot tested. From a random sampling procedure, a participant group of 23 was secured. The questionnaireinterview was administered in a home visit situation. Data, which were collected, were coded, analyzed, processed, and printed. The results indicated that each participant had many learning needs and interests of varying intensities. The participants had many preferences in the delivery of health promotion. The learning needs and interests had several significant correlations with other variables. The implications of the result~ were discussed.

Globalization and Its Impact on Assessment: Moving Toward a New Story

Globalization has resulted in large-scale international and local assessments closely tied to notions of accountability and competitiveness in a globalized economy. Although policy makers seek to ensure citizens meet the demands of a global knowledge-based economy, such assessments may also impede the development of requisite 21st century skills. While standardization currently is viewed as the most effective measurement of student achievement, several Canadian and international jurisdictions are moving toward assessment for learning (AfL). This conceptual study sought to identify whether AfL or standardized assessment most effectively meets 21st century learning goals in the wake of rapid global change. It applies a Story Model theoretical framework to understand the current, the new emerging, and the future ideal story of education from a personal, cultural, and global lens. The study examines the main critiques and/or challenges of standardized testing, the benefits of AfL for student learning, and new teaching and assessment approaches to the development of 21st century learning goals. The study applies the Story Model’s inside-outside/past-future approach to determine the future direction of assessment. Results show that the new story of assessment will most likely entail a model that integrates both standardized testing and in-class assessments in the form of AfL and PBL.

A Teacher’s Formative Assessment Perceptions and Practices in Oral Intermediate English Courses at the Université de Montréal

Au cours des dernières années, les pratiques de l’évaluation comme aide à l’apprentissage (c’est-à-dire l’auto-évaluation, l’évaluation par les pairs, la rétroaction) dans la salle de classe ont été de plus en plus considérées comme des éléments essentiels (Black & Wiliam, 1998; Harlen & Winter, 2004; van de Watering & van der Rijt, 2006). Cependant, dans le domaine de l’apprentissage d’une langue seconde la recherche sur ce sujet est plutôt limitée. En nous fondant sur les études de Colby-Kelly et Turner (2007) et de Lyster et Ranta (1997), nous avons mené une recherche exploratoire visant à combler ce besoin. L’objectif général était de comprendre comment l’évaluation formative se réalise dans deux cours d’anglais intermédiaire à l’Université de Montréal, et de comparer comment ces pratiques sont perçues et vécues par la professeure et ses étudiants. Trois questions de recherche étaient posées: 1. Quelle est la nature de l’évaluation formative dans une salle de classe d’anglais langue seconde? 2. Est-ce que les pratiques de la professeure reflètent ce qu’elle pense de l’évaluation formative? 3. Quels sont les correspondances et différences entre les croyances de la professeure et les perceptions de ses étudiants quant aux bénéfices de l’évaluation formative pour l’apprentissage de l’anglais langue seconde? La collecte de données comprend des observations en classe, des entrevues auprès de la professeure et des questionnaires pour les étudiants. Pour répondre à notre première question de recherche, nous avons analysé la rétroaction donnée par la professeure pendant une production orale réalisée par ses étudiants à partir de la typologie de feedback et de uptake de l’étude de Lyster et Ranta (1997). En ce qui a trait à la deuxième question de recherche, nous avons fait des entrevues avec la professeure en vue d’expliciter ses perceptions relativement à l’évaluation formative. À la fin du trimestre, nous avons comparé ses réponses avec sa pratique à partir des enregistrements vidéo produits en classe. Finalement, pour répondre à notre dernière question de recherche nous avons comparé les réponses données par la professeure aux entrevues avec les réponses des étudiants à un questionnaire adapté à partir de celui de Colby-Kelly et Turner. Finalement, nous présentons et discutons les résultats les plus significatifs obtenus dans cette étude qualitative Nous concluons cette thèse en proposant de avenues pour des recherches futures.

Building a Learning Architecture : e-Learning and e-Services

With the rapid advancement of the webtechnology, more and more educationalresources, including software applications forteaching/learning methods, are available acrossthe web, which enables learners to access thelearning materials and use various ways oflearning at any time and any place. Moreover,various web-based teaching/learning approacheshave been developed during the last decade toenhance the capability of both educators andlearners. Particularly, researchers from bothcomputer science and education are workingtogether, collaboratively focusing ondevelopment of pedagogically enablingtechnologies which are believed to improve theinfrastructure of education systems andprocesses, including curriculum developmentmodels, teaching/learning methods, managementof educational resources, systematic organizationof communication and dissemination ofknowledge and skills required by and adapted tousers. Despite of its fast development, however,there are still great gaps between learningintentions, organization of supporting resources,management of educational structures,knowledge points to be learned and interknowledgepoint relationships such as prerequisites,assessment of learning outcomes, andtechnical and pedagogic approaches. Moreconcretely, the issues have been widelyaddressed in literature include a) availability andusefulness of resources, b) smooth integration ofvarious resources and their presentation, c)learners’ requirements and supposed learningoutcomes, d) automation of learning process interms of its schedule and interaction, and e)customization of the resources and agilemanagement of the learning services for deliveryas well as necessary human interferences.Considering these problems and bearing in mindthe advanced web technology of which weshould make full use, in this report we willaddress the following two aspects of systematicarchitecture of learning/teaching systems: 1)learning objects – a semantic description andorganization of learning resources using the webservice models and methods, and 2) learningservices discovery and learning goals match foreducational coordination and learning serviceplanning.

Machine translation and the disruption of foreign language learning activities

This study examines the question of how language teachers in a highly technology-friendly university environment view machine translation and the implications that this has for the personal learning environments of students. It brings an activity-theory perspective to the question, examining the ways that the introduction of new tools can disrupt the relationship between different elements in an activity system. This perspective opens up for an investigation of the ways that new tools have the potential to fundamentally alter traditional learning activities. In questionnaires and group discussions, respondents showed general agreement that although use of machine translation by students could be considered cheating, students are bound to use it anyway, and suggested that teachers focus on the kinds of skills students would need when using machine translation and design assignments and exams to practice and assess these skills. The results of the empirical study are used to reflect upon questions of what the roles of teachers and students are in a context where many of the skills that a person needs to be able to interact in a foreign language increasingly can be outsourced to laptops and smartphones.

Assessment of problem solving in computing studies

The assessment of learning outcomes is a key concept in the European Credit Transfer and Accumulation System (ECTS) since credits are awarded when the assessment shows the competences which were aimed at have been developed at an appropriate level. This paper describes a study which was first part of the Bologna Experts Team-Spain project and then developed as an independent study. It was carried out with the overall goal to gain experience in the assessment of learning outcomes. More specifically it aimed at 1) designing procedures for the assessment of learning outcomes related to these compulsory generic competences; 2) testing some basic psychometric features that an assessment device with some consequences for the subjects being evaluated needs to prove; 3) testing different procedures of standard setting, and 4) using assessment results as orienting feedback to students and their tutors. The process of development of tests to carry out the assessment of learning outcomes is described as well as some basic features regarding their reliability and validity. First conclusions on the comparison of the results achieved at two academic levels are also presented.

Student response to a pub quiz style first year psychology assessment

The deterioration in staff-student ratios in UK higher education has had a disproportionate impact on assessment and feedback, meaning that contemporary students may have fewer assessments and much less feedback than a generation ago (Gibbs, 2006). Early use of a quiz assessment may offer a blend of social benefits (social comparison, shared problem solving leading to engagement, belonging and continuation), academic benefits (early formative assessment, immediate feedback) and administrative benefits (on-the-spot verbal marking and feedback to 230 students simultaneously). This study sought student views on the acceptability and contribution to learning of the quiz. Social benefits were apparent but difficulties in creating questions to elicit deeper reasoning and problem solving are discussed and the quiz had limited pedagogic value in the eyes of participants. The use of assertion-reason questions are considered as a way of taking the table quiz to a higher level and extending its pedagogic value.

Assessment in primary education in Ireland

This doctoral study examines assessment in primary education in the Republic of Ireland. The nature and purpose of assessment offer an insight into the values which are prioritised by an education system. In 2011, in the Republic of Ireland, the Department of Education and Skills (DES) published a strategy aiming to improve standards of literacy and numeracy. The document, entitled, Literacy and numeracy for learning and life: the national strategy to improve literacy and numeracy for children and young people 2011-2020, contains improvement targets as measured by standardised tests. It also mandates the increased use of standardised tests in primary education, and directs that aggregated scores should be reported to both Boards of Management and the DES. The study is framed by the theoretical perspectives of Michel Foucault and Pierre Bourdieu. Both of these commentators examine social policy and practice in an effort to provide insight into the history and operation of social institutions. This study is especially influenced by Foucault’s archaeology and genealogy of knowledge, and his notion of governmentality. It is also particularly cognisant of Bourdieu’s thoughts on habitus, doxa and capital. The study contains reviews of literature in the areas of assessment, assessment policy, and assessment policy in Ireland. These reviews highlight current debate in each of these areas while also grounding this debate in an historical context. The dissertation contains four empirical sections. 1) It analyses policy documents prepared in the development of the published strategy as well as investigating the strategy itself. In so doing it is aware of the burgeoning influence of pan-national bodies on policy development. 2) A number of high profile policy makers were interviewed as part of the study and their views are interpreted in light of the findings of the literature reviews. 3) The perspective of teachers was sought through a questionnaire survey. This gathered data on these teachers’ views on the purpose of assessment as well as their actual practice. 4) Finally, children were also included as participants in this study. They were interviewed in focus groups and encouraged to contribute drawings as well on their views of assessment in primary school. Literacy and numeracy for learning and life is seen as a seminal document in Irish education. This study is significant in its analysis of original data from high profile policy makers, including two Ministers for Education and Skills. It is also significant in its inclusion of the perspectives of primary school pupils. Finally, the study considers the nature and role of assessment in a holistic manner by including the views of policy makers, teachers and pupils. The study notes that policy development in Ireland underwent a change in the preparation of Literacy and numeracy for learning and life and that international influences, while present, are also mediated to suit the local context. It also highlights a lack of clarity in the definition of assessment in primary education and argues that there is a lack of balance in the approaches that are prioritised. The study demonstrates that teachers are impacted by the strategy but that they also change it by focusing on their own concerns while using assessment tools. The children provide compelling evidence of the impact of assessment on the learner. The study shows how assessment tools (and school subjects) are valued with differing levels of importance by a variety of stakeholders.

A literature review to Examine the Validity and Reliability of group poster presentations as an assessment method of a module in an undergraduate nursing degree programme

The introduction of a poster presentation as a formative assessment method over a multiple choice examination after the first phase of a three phase “health and well-being” module in an undergraduate nursing degree programme was greeted with a storm of criticism from fellow lecturers stating that poster presentations are not valid or reliable and totally irrelevant to the assessment of learning in the module. This paper seeks to investigate these criticisms by investigating the literature regarding producing nurses fit for practice, nurse curriculum development and wider nurse education, the purpose of assessment, validity and reliability to critically evaluate the poster presentation as a legitimate assessment method for these aims.

O currículo nos processos de ensino-aprendizagem e procedimentos de avaliação dos alunos na Educação Pré-Escolar e no 1.º Ciclo do Ensino Básico

Dissertação de Mestrado, Educação Pré-Escolar e Ensino do 1.º Ciclo do Ensino Básico, 15 de Junho de 2015, Universidade dos Açores.