Mathematical power of special-needs pupils : an ICT-based dynamic assessment format to reveal weak pupils' learning potential

This paper reports a study aimed at revealing special-educational-needs pupils' learning potential by means of an ICT-based assessment including a dynamic visual tool that might help pupils when solving mathematics problems. The study focused on subtraction problems up to 100, which require 'borrowing'. These problems, in which the value of the ones-digit of the subtrahend is larger than the ones-digit of the minuend, are known as a serious difficulty for weak pupils in mathematics. Seven of such problems from a standardised test were placed in the ICT environment. Data were collected from two test conditions: the standardised written test format and the ICT version of the test items including the tool that provided pupils with a set of virtual manipulatives. The 37 pupils involved in the study were 8–12 years old and from two special-education schools in the Netherlands. Comparison of the performance scores in the two formats showed that an ICT-based assessment format, including a dynamic visual tool, can reveal weak pupils' learning potential and strategy use. The study also pointed out that 'partial-tool use', ie, not carrying out the complete subtraction operation with the tool, can provide sufficient support to find the correct answer.

Using online environments to promote assessment as a learning enhancement process

The 21st century presents new challenges relating to the need for assessment to be more innovative, more responsive to students' needs, and more relevant and authentic. The characteristics of good assessment are well known and resources abound to assist academic staff to change their practices. Yet, at a time when the imperative for reconsidering practices has never been greater, it appears to be very difficult to bring about and maintain substantive change in assessment. This paper presents case studies that illustrate the way some academic staff have responded to the challenges. In particular, how the online environment can enhance learning through formative assessment is illustrated with four case studies. The paper outlines specific challenges faced in each case and  discusses issues that arose during development and delivery. It concludes by identifying some of the factors that helped to facilitate changes in assessment practices in these specific cases.

Approaches to learning across cultures : The role of assessment

In the context of a broader research study on the intercultural understanding of teachers in Australia, Japan and Thailand, this paper focuses on approaches to learning and the role of assessment in shaping such approaches. Popular contrasts portray Asian learners as compliant and favouring rote memorisation and Western learners as independent and favouring deep, conceptual learning. Yet Asian students frequently outperform their Western counterparts in competitive tests purported to measure higher cognitive skills. Biggs and his associates have challenged the stereotypical view of Asian students as rote learners as a Western misperception. But data from the present cross-cultural study suggest it is more than a Western misperception, being shared by teachers in Japan and Thailand. With this background, this paper then explores the role of assessment through an analysis of examination papers in the three countries at the high stakes, year 12 level. This analysis of the ways in which knowledge and comprehension are assessed identifies different practices across cultures but not ones corresponding to the rhetoric on contrasting approaches to learning. Rather it concludes that assessment tasks classified superficially as comprehension can be approached through memorisation and conversely, those often classified as memorisation can require careful reading, thought and interpretation, while drawing from an extensive knowledge base. A shared understanding of the nature of assessment tasks in different cultures thus has the potential to dissolve the demarcation of culturally embedded learning styles and to enhance deep learning grounded in specialist knowledge for scholars, be they students or teachers, in all cultures.

Assessment in experiential learning : the case of a public policy internship

Assessment is a significant issue for learning in the workplace. In some professions there are key indicators of success shared by workplace and academic supervisors alike. Beyond specific professions, however, assessment becomes more diffuse in workplaces that do not have explicit criteria established to judge performance of students in experiential learning. Assessing learning in these workplaces may be associated with methods that rely more upon student self appraisal and workplace supervisor reports. This article reports on the approach used for assessment in a public policy internship program in one Australian university - Deakin University in Victoria. The article argues that assessment, rather than being an add-on or a test of pre-ordained information, is central to the process of learning itself. This means that before students embark upon a policy internship they need to build their critical thinking abilities; i.e. a process of purposeful, self- regulatory judgment. Secondly they need to discuss how to negotiate their tasks in different workplaces and how to produce the criteria to be used in their evaluation.

A systematic approach to learning aimed at graduate physiotherapists practicing in South West Victoria

Mandatory standards developed by allied health professions for registration and accreditation purposes require continuing professional development (CPD) that can be accessed by all professionals, particularly those practicing in regions removed from the bigger cities. To improve and maintain competencies and standards of care CPD programs need to be accessible and provide opportunities for lifelong learning of efficacious evidence-based intervention. Despite the benefits of CPD, problems reported include access and lack of clarity on the usefulness of CPD in relation to clinical practice. The aim of this study was to develop a CPD program for physiotherapists in the south west of Victoria by employing a systematic approach that included a needs assessment as a vehicle to compose the 2004/2005 program and to optimise ease of attendance, relevance and perceived applicability to clinical practice. The education delivered was purposely in line with the principles of adult learning and presenters were instructed to focus for at least one-third of the workshop time on praxis. This study measured attendance levels throughout the program and satisfaction with the education received in terms of perceived clinical benefits in order to understand the benefits of employing detailed local needs assessments for rural professionals. All workshops and presentations were evaluated with regard to suitability of the venue, presenter style, content, applicability to clinical practice and overall impression by using 7-point Likert scales. Modes and medians both were 7, with seven being rated as highly successful. Attendance was high, 57.2% attended four or more sessions and 68.6% attended at least one workshop in the clinic over the period. In addition, 22.9% attended at least one of the two conducted courses that were held in that period. Although most physiotherapists (68.6%) reported some effect, 20% of the physiotherapists perceived that the CPD program had a large effect on their clinical skills and 29.4% found that patient demand had increased. This paper will discuss the results in light of approaches for allied health workplace learning.

Teacher change in exploring representational approaches to learning science

The researcher worked closely with two biology-trained teachers to plan three teaching sequences in the topics of forces, substances and astronomy that were subsequently taught to Year 7 students. The sequences sought to develop a model of classroom practice that foregrounds students’ negotiation of conceptual representations.

The difficulties encountered by individuals in learning science point to the need for a very strong emphasis of the role of representations in learning. There is a need for learners to use their own representational, cultural and cognitive resources to engage with the subject-specific representational practices of science. Researchers who have undertaken classroom studies whereby students have constructed and used their own representations have pointed to several principles in the planning, execution and assessment of student learning (diSessa, 2004; Greeno & Hall, 1997). A key principle is that teachers need to identify big ideas, key concepts, of the topic at the planning stage in order to guide refinement of representational work. These researchers also point out the need for students to engage with multiple representations in different modes that are both teacher and student generated. A representation can only partially explain a particular phenomenon or process and has both positive and negative attributes to the target that it represents. The issue of the partial nature of representations needs to be a component of classroom practice (Greeno & Hall, 1997) in terms of students critiquing representations for their limitations and affordances and explicitly linking multiple representations to construct a fuller understanding of the phenomenon or process under study. The classroom practice should also provide opportunities for students to manipulate representations as reasoning tools (Cox, 1999) in constructing the scientifically acceptable ideas and communicating them.

Research question: What impact was there on the participating teacher’s practice through the adoption of a representational focus to teaching science?

Data collection included video sequences of classroom practice and student responses, student work, field notes, tape records of meetings and discussions, and student and teacher interviews based in some cases on video stimulated recall. Video analysis software was used to capture the variety of representations used, and sequences of representational negotiation.

The teachers in this study reported substantial shifts in their classroom practices, and in the quality of classroom discussions, arising from adopting a representational focus. The shifts were reported by them as a three-fold challenge. First, there was an epistemological challenge as they came to terms with the culturally produced nature of representations in the topics of force, substance and astronomy and their flexibility and power as tools for analysis and communication, as opposed to their previous assumption that this was given knowledge to be learnt as an end point. The second challenge was pedagogical, in that this approach was acknowledged to place much greater agency in the hands of students, and this brought a need to learn to run longer and more structured discussions around conceptual problems. The third challenge related to content coverage. The teachers sacrificed coverage for the greater depth offered by this approach, and were unanimous in their judgment that this had been a change that had paid dividends in terms of student learning.

Teaching in practice : work integrated design learning and practice readiness for architecture students

This literature review describes the theoretical basis for developing a pedagogical model of higher education/industry engagement for the built environment and related design disciplines, with a focus on architecture. In particular, attention is given to the conceptualisation informing the development of such a model as a form of work integrated learning (WIL). In the discussion, the use and development of WIL in architecture will be placed in the historical context of Cooperative Education as a whole. The objective of the paper is to present ideas about the way in which design education relocated to practice might better prepare students for professional life.

Aiming to capitalize on the work place as a location for authentic learning, the paper will propose a form of WIL that will be termed “Teaching in Practice” (TiP). A prime aim of such a model is to bridge the growing gap between academia and the profession by enabling students to learn design from practitioners within a practice environment. The paper will argue that TiP allows practitioners to have a direct influence on design education, and thus establishes connections between academia and the professions that ensure built environment education remains relevant to industry needs.

The social network virtual design studio : integrated design learning using blended learning environments

Online communications, multimedia, mobile computing and face-to-face learning create blended learning environments to which some Virtual Design Studios (VDS) have reacted to. Social Networks (SN), as instruments for communication, have provided a potentially fruitful operative base for VDS. These technologies transfer communication, leadership, democratic interaction, teamwork, social engagement and responsibility away from the design tutors to the participants. The implementation of Social Network VDS (SNVDS) moved the VDS beyond its conventional realm and enabled students to develop architectural design that is embedded into a community of learners and expertise both online and offline. Problem-based learning (PBL) becomes an iterative and reflexive process facilitating deep learning. The paper discusses details of the SNVDS, its pedagogical implications to PBL, and presents how the SNVDS is successful in enabling architectural students to collaborate and communicate design proposals that integrate a variety of skills, deep learning, knowledge and construction with a rich learning experience.

Using video tutorials as a carrot-and-stick approach to learning

Traditional teaching styles practiced at universities do not generally suit all students' learning styles. For a variety of reasons, students do not always engage in learning in the courses in which they are enrolled. New methods to create and deliver educational material are available, but these do not always improve learning outcomes. Acknowledging these truths and developing and delivering educational material that provides diverse ways for students to learn is a constant challenge. This study examines the use of video tutorials within a university environment in an attempt to provide a teaching model that is valuable to all students, and in particular to those students who are not engaging in learning. The results of a three-year study have demonstrated that the use of well-designed, assessment-focused, and readily available video tutorials have the potential to improve student satisfaction and grades by enabling and encouraging students to learn how they want, when they want, and at a pace that suits their needs.

Pre-service visual art teachers’ perceptions of assessment in online learning

This paper reports on a study conducted into how one cohort of Master of Teaching pre-service visual art teachers perceived their learning in a fully online learning environment. Located in an Australian urban university, this qualitative study provided insights into a number of areas associated with higher education online learning, including that of assessment, the focus of this paper. Authentic assessment tasks were designed within the University’s learning and teaching framework of constructive alignment and were sequenced across the three semesters of the visual art program. Analysis of data collected through a questionnaire and semi-structured interviews revealed that participants largely held very positive attitudes about the suite of online assessment tasks, particularly in light of (a) the collaborative learning that took place, (b) the nature, structure and sequence of the tasks, and (c) the ways in which the tasks contributed to their workplace readiness.

Does calibration reduce variability in the assessment of accounting learning outcomes?

Reliable, consistent assessment process that produces comparable assessment grades between assessors and institutions is a core activity and an ongoing challenge with which universities have failed to come to terms. In this paper, we report results from an experiment that tests the impact of an intervention designed to reduce grader variability and develop a shared understanding of national threshold learning standards by a cohort of reviewers. The intervention involved consensus moderation of samples of accounting students’ work, with a focus on three research questions. First, what is the quantifiable difference in grader variability on the assessment of learning outcomes in ‘application skills’ and ‘judgement’? Second, does participation in the workshops lead to reduced disparity in the assessment of the students’ learning outcomes in ‘application skills’ and ‘judgement’? Third, does participation in the workshops lead to greater confidence by reviewers in their ability to assess students’ skills in application skills and judgement? Our findings suggest consensus moderation does reduce variability across graders and also builds grader confidence.

Sustainable assessment: rethinking assessment for the learning society

Assessment practices in higher education institutions tend not to equip students well for the processes of effective learning in a learning society. The purposes of assessment should be extended to include the preparation of students for sustainable assessment. Sustainable assessment encompasses the abilities required to undertake those activities that necessarily accompany learning throughout life in formal and informal settings. Characteristics of effective formative assessment identified by recent research are used to illustrate features of sustainable assessment. Assessment acts need both to meet the specific and immediate goals of a course as well as establishing a basis for students to undertake their own assessment activities in the future. To draw attention to the importance of this, the idea that assessment always has to do double duty is introduced.

A collaborative development of quality mathematics assessment tasks to promote preservice teachers’ professional eye

The Mathematics Teacher Education Collective (MTEC) — a self-study group based at the University of British Columbia, Canada — collaborates to enhance our pedagogical practice in mathematics teacher education through analysing, constructing, and reflecting on variations to assessment tasks. The theoretical framework underlying the establishment of the MTEC is based on Lave and Wenger’s (1991) view of learning through a Community of Practice (CoP). “Communities of practice are groups of people who share a concern or a passion for something they do and learn how to do it better as they interact regularly” (Wenger-Trayner, 2011, http://wenger-trayner.com/theory/). Three characteristics are viewed as crucial to the CoP: domain, community, and practice. The shared domain for MTEC is a commitment to gaining a deeper understanding of practice as mathematics teacher educators. In particular, as members we are interested in better understanding the role and development of tasks for learning to teach mathematics. As a community MTEC engages “in joint activities and discussions, [that] help each other, and share information” (Wenger-Trayner, 2011, http://wenger-trayner.com/theory/), with the goal to build relationships that provide members with opportunities to learn from one other. MTEC members are practitioners in the field. The success of the MTEC is based on the sharing, evaluation and critical reflection of assessment tasks and pedagogical approaches refined by the CoP.

Teacher subject specialisms and their relationships to learning styles, psychological types and multiple intelligences: implications for course development

This study explores issues in teacher education that increase our understanding of, and response to, the individual differences displayed by learners. A large undergraduate teacher education cohort provided evidence of the range and distribution of preferences in learning styles, psychological types and multiple intelligences. This information revealed that distributions of scores on the Kolb Learning Style Inventory, the Myers-Briggs Type Indicator, and the Multiple Intelligences Checklist for Adults provide evidence about the scope and range of differences between four teacher subject specialisms. This rich information about those participating in teacher education courses provides some guidance for educating those with their own clear preferences to the range of different preferences expressed by many other learners and highlights the existence of four sets of major differences in approaches to teaching and learning in prospective teachers.