Learning approaches: examination type, discipline of study, and gender

A sample of 248 Australian university students participated in a study that investigated the influence of assessment type and discipline of study on students' learning approaches. Participants (93 psychology and 155 business students) responded to the Study Process Questionnaire in a context of preparation for a hypothetical examination. The hypothetical examination is in either a multiple-choice or an essay format. Results indicated that assessment type had no significant influence on how students approach their learning, while discipline did have significant influence on student learning.

Developing formal mathematical assessment for 4-to-8-year-olds

The assessment of children in their years before school and their first years of school has been, traditionally, informal. Further, assessment of children's mathematical skills at this level has been infrequent compared to social, emotional and physical assessments. However, there are contexts where reliable, valid, standardised data from assessment in mathematics are required. This paper outlines the development of two assessment tools for mathematics that were originally developed for such contexts. Item Response Theory (IRT) analyses enabled the construction of assessment forms that address the range of abilities of 4- to 8-year-old children, and provided the scales used for constructing formative and summative reports of achievement. A description of the development of the assessment tools and the IRT analysis that provides the reporting formats are presented together with some research uses of the tools.

Learning and teaching assessment: reviewing the evidence

The authors have recently completed a research review on learning and teaching of assessment in social work which was commissioned by the Social Care Institute for Excellence (SCIE) and the Social Policy and Social Work Learning and Teaching Support Network (SWAPltsn) to support the development of the new social work award in England. This involved reviewing relevant literature from social work and cognate disciplines back to 1990 with the aim of identifying best practice in learning and teaching of assessment skills.

Although assessment has been recognised as a core skill in social work and should underpin social work interventions, there is no singular theory or understanding as to what the purpose of assessment is and what the process should entail. Social work involvement in the assessment process may include establishing need or eligibility for services, to seek evidence of past events or to determine likelihood of future danger, may underpin recommendations to other agencies, or may determine the suitability of other service providers. In some settings assessment is considered to begin from the first point of contact and may be a relatively short process, whereas elsewhere it may be a process involving several client contacts over an extended period of time. The assessment process may range from the collection of data on standardised proforma to a flexible approach depending on circumstances. These variations permeate the literature on the learning and teaching of assessment in social work and cognate disciplines.

Several different approaches to classroom based learning were proposed in the literature including case-based teaching, interviews with actors who have been trained to play 'standardised clients', and observation of children and families, as well as didactic lecturing and various uses of video equipment and computers. Furthermore learning by doing has long been one of the hallmarks of social work education, and there are a number of models proposed in which students learn about the assessment process through conducting assessments. The evidence to support these different approaches to learning and teaching is variable. Based on the evidence reviewed, recommendations as to what is good practice in learning and teaching about assessment will be presented.

Addressing training needs for community care assessment in remote Indigenous communities

Access to Home and Community Care services in Australia is based on the assessed needs of individual clients, with individual Home and Community Care organisations generally being responsible for initial assessment of eligibility and need. Home and Community Care funded services are expected to operate within the agency's program guidelines and to adhere to minimum service standards. However, service delivery contexts in remote areas of Australia present particular challenges for staff in the practice of assessment and care planning. This paper discusses the findings of a project which investigated approaches to assessment of client needs in remote Home and Community Care services. Some of the challenges of providing care in remote/Indigenous contexts are discussed. The research project highlighted that there was an inadequate knowledge base to assist staff with assessment and care planning in these cross-cultural contexts; a greater focus on developing the assessment skills of staff was needed. Subsequently, an education program incorporating the International Classification of Functioning, Disability and Health was developed for Home and Community Care assessment staff in remote communities. Rather than focusing on process skills and procedures, the program was designed to equip staff with a solid and consistent conceptual framework to assist with assessment and care planning.

Assessment management using software

Web based learning is providing new and innovative environments to facilitate the delivery of course material to increasing numbers students, but most of the effort is centered around the presentation of the learning material and creating environments where student interact with this material and each other. Despite the changes the web based learning environments have delivered, little attention has been given to improving the management and process of assessment. This paper introduces a new software application designed to take advantage of the web based environments and addresses the management overheads associated with assessment whilst improving the feedback to students. Initial investigations indicate significant benefits can be achieved by using software to manage the assessment process. A detailed description of the software is provided and two case studies presented that highlight the software's application and confirmed benefits when used to conduct and manage assessments.

Media use in the design studio: a case study of second year architecture

This paper outlines a case study of media use within a second year design studio at Deakin University in Victoria. Australia. The case study involves an active cohort of students working on four design projects, each staged to address specific aspects of tectonics and conceptual design. The research is based on three questionnaires, a focus group discussion and analysis of assessment and digital folios to explore the way students use digital, analogue and hybrid media within their design projects. Relationships arc drawn between media use within projects and student perceptions of the benefits of using particular media within projects of a conceptual or tectonic nature.

Of great love and immense hate: the ambivalence of the other in a local/global school

In recent times, and in times of insurgent globalisation, modern notions of identity and with them, conceptions of essential and primordially defined difference seem to have fallen apart. Identity is understood as post-modern, a ‘moveable feast’ of ever-in-process, negotiated differences. The examination of the material and conceptual terms and conditions that position these logics otherwise suggests that these arguments remain tied within conceptions of ourselves made through the ambivalent conceptions of others. In this paper, I trace these paradoxical relations as they are represented in a particular local Melbourne school at each end of a decade and at a time of increasing demographic change and global transformation. Teachers and parents understood and defined their identities and the identities of others in ways that were increasingly fragmented, changing and complex. Beneath these changing patterns, they continued to define others as different and as not us in ways that were ambivalent and extreme. These negotiations took place differently in recent years as the definitions of essential notions of identity changed and became more complex to define. Nevertheless, they continued as ambivalent stories of otherness that transversed the tortuous spectrum between orientalism and nativism speculated upon in post-colonial writings.

Establishing best-practice principles for the teaching of group design projects

As student-to-staff ratios escalate, increasing numbers of undergraduate architects are finding the reduction of ‘one-to-one’ studio supervision an impediment to learning. Group design projects are becoming a widespread solution to this problem. However, little analysis has been undertaken as to their effectiveness both in terms of student assessment and as a design teaching methodology.
The two hundred years of apprentice/master tradition that underpins the atelier studio system is still at the core of much present day architectural design education. Yet this tradition today poses uncertainties for a large number of co-ordinating lecturers faced with current changes in the nature of tertiary education and its funding structure. In particular, with reductions in staff/student contact time, in sessional funding sources and in the relative weighting of design-based subjects with respect to other subject areas, many design teachers are finding it increasingly difficult to maintain an atelier system that has shaped both their learning and, more pointedly, their teaching. If these deficiencies remain unchecked and design-based schools are unable to implement strategies that successfully overcome the resource intensive one-to-one teaching program, then architecture may prove to be an untenable course structure for many institutions.
Rather then spreading their time thinly, many co-ordinating lecturers are setting group projects in order to review less assignments but at greater depth. However, while this learning model better reflects design teams in practice, this approach may pose other pedagogical and assessment questions. What is clear is the urgent need for structured research into the teaching and assessment problems experienced by design teachers, and for a readily adoptable pedagogy for group design projects. At Deakin University, research is underway aimed at establishing best-practice principles for group design projects by analysing students’ performance and recording and implementing their feedback to adjustments made to the pedagogical fundamentals of assessment, group configuration, and program structure. There are after two years of preliminary studies already clear indications of what changes can be made to these to encourage more effective team learning. This paper will present the findings of these studies.

Online student portfolios for demonstration of engineering graduate attributes

Engineers Australia is the Australian professional body that accredits undergraduate engineering programs. It espouses an ‘outcomes-based’ program accreditation philosophy, but imposes mandatory ‘process’ requirements for off-campus programs that are in addition to the requirements for conventional on-campus programs. The focus on off-campus engineering study raises the question: how can learning outcomes, regardless of mode of study, be effectively measured? The current answer appears to be ‘graduate attributes’. The literature reveals a range of sophistication in approach to graduate attributes from identifying desirable graduate attributes, through to evidence-based certification of individual student attainment of graduate attributes. Many engineering accrediting bodies around the world identify student portfolios as a strategy for demonstrating student attainment of graduate attributes. The increasing use of online technology by students and educators alike, including as part of assessment, means that many of the reported applications of student portfolios are online portfolios. The effectiveness of online student portfolios will depend on them being embedded in day-to-day educational practice, rather than being an optional extra given a low priority by busy students. This paper presents a survey of the related literature and briefly outlines a project in progress at Deakin University to trial an online student portfolio.

Innovative science education assessment : linking theory with practice

This paper presents an assessment approach which demonstrates the characteristics of excellent assessment. In a third year Science Education unit in an undergraduate degree in teacher education, assessment is seen as an integral part of the learning process. Learning outcomes are improved for the students and they appreciate the validity of the assessment. Assessment is an important aspect of any unit in higher education but should be seen, not as an end in itself, but rather as a means for educational improvement. Using the assessment task as an illustration, this paper will discuss the theoretical framework of assessment. It will describe how the unit, delivered in a school-based mode, provides opportunity for students to link their theoretical understandings with practical applications, drawing together the academic debates with the first-hand experiences. It will illustrate how the assessment task itself embeds the principles of constructivism and conceptual change models in science education. Finally, the paper will highlight the benefits of this assessment approach with particular reference to the student learning.

The factor structure of the strengths and difficulties questionnaire

The Strengths and Difficulties Questionnaire (SDQ) has been widely adopted as a measure of child and adolescent mental health and behavioral problems. However, despite an impressive number of studies demonstrating its psychometric properties, appropriate analyses of the instrument's underlying structure have not been reported. We conducted confirmatory factor analyses on matched data obtained from a large community sample of 7-17-year-olds, their parents, and their teachers. The analyses indicated that the reputed factor structure was not supported, with none of the subscales being unidimensional. Further, each informant group appeared to respond differently to the questionnaire. Considering the findings in relation to the stringency of the tests used to evaluate the SDQ, its utility, and previous research on its clinical validity, it is suggested that the SDQ be used with caution and in conjunction with other forms of assessment.

Assessment frameworks : a critical reflection

Increasing widespread requirements that assessment practice conforms to generic guidelines contained in assessment frameworks has been contentious and critiques offered on individual frameworks have been assumed to apply to the concept of assessment frameworks more generally. After comparing four assessment frameworks currently being used in the UK, this paper argues that although some generalizations can be made, for the most part, they are highly individual documents in terms of range and depth of content, the extent to which they are evidenced and the quality of that evidence and implicit expectations as to the skill bases of assessors. Furthermore, the introduction of assessment frameworks is not in itself a panacea to ensure good practice. Even with the most comprehensive frameworks, social workers will still need comprehensive training in assessment and supervision of their practice.

Student expectations of teaching and learning

Higher education aims to develop students as life-long learners. Facilitative, learning-centred approaches are more likely to develop independent learners. However, these learning methods may challenge students’ conceptions of “good teaching” developed from their previous learning experiences. Student beliefs and expectations about teaching were examined through interviews of a small number of students as part of a wider study looking at developing techniques to assist students to become more aware, engaged and appreciative of their learning experience. The analysis of the interviews offer some useful suggestions for lecturers engaged in teaching professional disciplines wishing to use facilitative, student-centred teaching approaches.

Online self-and-peer-assessment for teamwork in architecture and business communications

There is considerable evidence of general student scepticism regarding the purpose of team assignments and high levels of concern for the fairness of assessment procedures when all members of a team receive the same grade. Some educators are similarly anxious about not only the validity of team grades, but also the need to assess ongoing team processes in addition to the final assignment product. This paper offers self-andpeer-assessment (SAPA) as a fair, valid and reliable method of producing information about ongoing team processes. The paper examines a pilot study investigating an online SAPA tool originally developed for a small class of architecture students. This tool is adapted for use for by students completing team assignment in two further architecture design units and for a very large class of 800 business communication students. The sample students studied on four campuses, as well as in off campus and offshore modes. The paper focuses on the initial stages of the study to demonstrate how researchers from very different backgrounds collaborated to adapt the online tool and implement a pilot study whilst maintaining both comparability of assessment and integrity of research design.

Online self and peer assessment in large, multi-campus, multi-cohort contexts

The increasing use of team assignments within higher education is well documented. The driving forces behind this include desires to facilitate reflective and collaborative learning, to develop generic teamwork skills for graduate employment and to reduce the grading workloads of faculty staff. Students however consistently report dissatisfaction when the assessment of team assignments produces a common grade for all team members. Self-andpeer-assessment (SAPA) is presented as a fair, valid and reliable method of producing information about ongoing team processes. This information can provide ongoing feedback to team members and rich formative data to instructors attempting to assess the team process and students’ teamwork skills. This data can also enable individualised summative assessment in dysfunctional teams or situations of uneven team member contributions. Whilst manual SAPA protocols can work effectively for smaller classes, computer-assisted SAPA offers a solution to the problems of large classes. This paper reports on the early stages of an online SAPA tool, originally developed for small classes of architecture students, adapted for use by very large business communication classes comprising up to 1000 students in a semester. This large unit is delivered on four Australian campuses as well as off-campus and in off-shore mode, by up to fourteen instructors at any one time. The paper documents how three researchers from very different backgrounds worked to create their own research team, implement a pilot study, and adapt the online tool, whilst adhering to comparability of assessment constraints and maintaining integrity of research design.