Role and purpose of standards in the context of national curriculum and assessment reform for accountability, improvement and equity in student learning

In this article our starting point is the current context of national curriculum change and intense speculation about the assessment, standards and reporting. It is written against a background of accountability measures and improvement imperatives, and focuses attention on standards as offering representations of quality. We understand standards to be constructs that aim to achieve public credibility and utility. Further, they can be examined for the purposes they seek to serve and also their expected functions. Fitness for purpose is therefore a useful notion in considering the nature of standards. Our interest in the discussion is the ‘fit’ between how standards are formulated and how they are used in practice, by whom and for what purposes. A related interest is in the matter of how standards can be harnessed to realise improvement.

Using poster presentations as assessment of work integrated learning

Background / context: The ALTC WIL Scoping Study identified a need to develop innovative assessment methods for work integrated learning (WIL) that encourage reflection and integration of theory and practice within the constraints that result from the level of engagement of workplace supervisors and the ability of academic supervisors to become involved in the workplace. Aims: The aim of this paper is to examine how poster presentations can be used to authentically assess student learning during WIL. Method / Approach: The paper uses a case study approach to evaluate the use of poster presentations for assessment in two internship units at the Queensland University of Technology. The first is a unit in the Faculty of Business where students majoring in advertising, marketing and public relations are placed in a variety of organisations. The second unit is a law unit where students complete placements in government legal offices. Results / Discussion: While poster presentations are commonly used for assessment in the sciences, they are an innovative approach to assessment in the humanities. This paper argues that posters are one way that universities can overcome the substantial challenges of assessing work integrated learning. The two units involved in the case study adopt different approaches to the poster assessment; the Business unit is non-graded and the poster assessment task requires students to reflect on their learning during the internship. The Law unit is graded and requires students to present on a research topic that relates to their internship. In both units the posters were presented during a poster showcase which was attended by students, workplace supervisors and members of faculty. The paper evaluates the benefits of poster presentations for students, workplace supervisors and faculty and proposes some criteria for poster assessment in WIL. Conclusions / Implications: The paper concludes that posters can effectively and authentically assess various learning outcomes in WIL in different disciplines while at the same time offering a means to engage workplace supervisors with academic staff and other students and supervisors participating in the unit. Posters have the ability to demonstrate reflection in learning and are an excellent demonstration of experiential learning and assessing authentically. Keywords: Work integrated learning, assessment, poster presentations, industry engagement.

Bridging the gap between tertiary education and work : a model of situated learning in accountancy

In professions such as teaching, health sciences (medicine, nursing, allied health), and built environment (engineering), significant work-based learning through practica is an essential element before graduation. However, there is no such requirement in Accountancy. This thesis reports the findings of a qualitative case study of the development and implementation of a Workplace Learning Experience Program in Accountancy at the Queensland University of Technology (QUT) in Australia. The case study of this intervention, based on sociocultural learning theory, provides the grounds for the development of a new model of teaching and learning for accounting education. The survey and interview-based study documents the responses of two cohorts of university students and a group of employers to a work placement program. The study demonstrates that a 100 hour work placement in Accountancy has elements that enhance student learning. It demonstrates the potential value of the application of sociocultural theories of learning, especially the concept of situated learning involving legitimate peripheral participation (Lave & Wenger, 1991). This research establishes the theoretical base for a paradigm shift for the Accountancy profession to acknowledge work placements prior to graduation as a major element of learning. It is argued that the current model of accounting education requires reform to better align university and workplace learning.

Incorporating authentic assessment into different university learning scenarios

There is a current requirement for universities to prepare graduates who are skilled in practical as well as theoretical knowledge of the workplace. It is argued in this paper that assessment, as integral to the teaching/learning process, should also relate to the real world context of the workplace, in that students are able to transform, use and apply the knowledge that they learn into these contexts. While assessment authentic for students in a university setting is often a difficult task for lecturers. This paper discusses three different learning contexts that involved different assessment experiences linked in some way to real world learning and application of the theory. The results of the trial indicated that as contexts became close to a real world experience, the sustainability of the assessment became more problematic. While acknowledging the difficulty of these practices, it is suggested that there is a need for a continuous cycle of evaluation amid some creative and innovative approaches to assessment practice.

Students' perceptions of the relevance of mathematics in engineering

In this paper, we report on the findings of an exploratory study into the experience of students as they learn first year engineering mathematics. Here we define engineering as the application of mathematics and sciences to the building and design of projects for the use of society (Kirschenman and Brenner 2010)d. Qualitative and quantitative data on students' views of the relevance of their mathematics study to their engineering studies and future careers in engineering was collected. The students described using a range of mathematics techniques (mathematics skills developed, mathematics concepts applied to engineering and skills developed relevant for engineering) for various usages (as a subject of study, a tool for other subjects or a tool for real world problems). We found a number of themes relating to the design of mathematics engineering curriculum emerged from the data. These included the relevance of mathematics within different engineering majors, the relevance of mathematics to future studies, the relevance of learning mathematical rigour, and the effectiveness of problem solving tasks in conveying the relevance of mathematics more effectively than other forms of assessment. We make recommendations for the design of engineering mathematics curriculum based on our findings.

The power of educational podcasting : using short-format podcasts to reinforce tertiary student learning experiences in science

In 2007 I introduced short-format educational podcast resources that reinforced conceptual teaching and learning in an interdisciplinary tertiary science study area (biochemistry). This study aims to determine student attitudes to the perceived usefulness and benefit of short-format educational podcasts, and presents the findings (qualitative and quantitative) from surveys obtained from three offerings of the science teaching unit (2007, 2008 and 2009). Podcasts were recorded (MP3 audio files) separately from the instructive lecture sessions, and subsequent to the weekly lecture, short-format podcasts summarising the key learning objectives were integrated within the resources presented through the students learning management system (Blackboard). The vast majority (>88%) of students utilised the podcast resources, indicating a high level of acceptance and uptake for this portable educational technology. The respondents reported that podcasts focused their attention to core learning concepts and supported their understanding and learning of the lecture material. Furthermore, the data showed that respondents agreed strongly that podcasts assisted with study and revision for examinations and, somewhat surprisingly, there was a perception that podcasts positively impacted on examination performance. Overall, student users perceived that podcasting is as an effective and valuable educational tool that offers convenience and flexibility for their learning and understanding of a tertiary science study area, such as biochemistry.

Sustainable assessment for large science classes : non-multiple choice, randomised assignments through a Learning Management System

This paper reports on the development of a tool that generates randomised, non-multiple choice assessment within the BlackBoard Learning Management System interface. An accepted weakness of multiple-choice assessment is that it cannot elicit learning outcomes from upper levels of Biggs’ SOLO taxonomy. However, written assessment items require extensive resources for marking, and are susceptible to copying as well as marking inconsistencies for large classes. This project developed an assessment tool which is valid, reliable and sustainable and that addresses the issues identified above. The tool provides each student with an assignment assessing the same learning outcomes, but containing different questions, with responses in the form of words or numbers. Practice questions are available, enabling students to obtain feedback on their approach before submitting their assignment. Thus, the tool incorporates automatic marking (essential for large classes), randomised tasks to each student (reducing copying), the capacity to give credit for working (feedback on the application of theory), and the capacity to target higher order learning outcomes by requiring students to derive their answers rather than choosing them. Results and feedback from students are presented, along with technical implementation details.

Indigenous mathematics : creating an equitable learning environment

This chapter examines how a change in school leadership can successfully address competencies in complex situations and thus create a positive learning environment in which Indigenous students can excel in their learning rather than accept a culture that inhibits school improvement. Mathematics has long been an area that has failed to assist Indigenous students in improving their learning outcomes, as it is a Eurocentric subject (Rothbaum, Weisz, Pott, Miyake & Morelli, 2000, De Plevitz, 2007) and does not contextualize pedagogy with Indigenous culture and perspectives (Matthews, Cooper & Baturo, 2007). The chapter explores the work of a team of Indigenous and non-Indigenous academics from the YuMi Deadly Centre who are turning the tide on improving Indigenous mathematical outcomes in schools and in communities with high numbers of Aboriginal and Torres Strait Islander students.

Neural network learning:theoretical foundations

This important work describes recent theoretical advances in the study of artificial neural networks. It explores probabilistic models of supervised learning problems, and addresses the key statistical and computational questions. Chapters survey research on pattern classification with binary-output networks, including a discussion of the relevance of the Vapnik Chervonenkis dimension, and of estimates of the dimension for several neural network models. In addition, Anthony and Bartlett develop a model of classification by real-output networks, and demonstrate the usefulness of classification with a "large margin." The authors explain the role of scale-sensitive versions of the Vapnik Chervonenkis dimension in large margin classification, and in real prediction. Key chapters also discuss the computational complexity of neural network learning, describing a variety of hardness results, and outlining two efficient, constructive learning algorithms. The book is self-contained and accessible to researchers and graduate students in computer science, engineering, and mathematics

Early years teachers’ attitudes towards mathematics

Worldwide, there is considerable attention to providing a supportive mathematics learning environment for young children because attitude formation and achievement in these early years of schooling have a lifelong impact. Key influences on young children during these early years are their teachers. Practising early years teachers‟ attitudes towards mathematics influence the teaching methods they employ, which in turn, affects young students‟ attitudes towards mathematics, and ultimately, their achievement. However, little is known about practising early years teachers‟ attitudes to mathematics or how these attitudes form, which is the focus of this study. The research questions were: 1. What attitudes do practising early years teachers hold towards mathematics? 2. How did the teachers‟ mathematics attitudes form? This study adopted an explanatory case study design (Yin, 2003) to investigate practising early years teachers‟ attitudes towards mathematics and the formation of these attitudes. The research took place in a Brisbane southside school situated in a middle socio-economic area. The site was chosen due to its accessibility to the researcher. The participant group consisted of 20 early years teachers. They each completed the Attitude Towards Mathematics Inventory (ATMI) (Schackow, 2005), which is a 40 item instrument that measures attitudes across the four dimensions of attitude, namely value, enjoyment, self-confidence and motivation. The teachers‟ total ATMI scores were classified according to five quintiles: strongly negative, negative, neutral, positive and strongly positive. The results of the survey revealed that these teachers‟ attitudes ranged across only three categories with one teacher classified as strongly positive, twelve teachers classified as positive and seven teachers classified as neutral. No teachers were identified as having negative or strongly negative attitudes. Subsequent to the surveys, six teachers with a breadth of attitudes were selected from the original cohort to participate in open-ended interviews to investigate the formation of their attitudes. The interview data were analysed according to the four dimensions of attitudes (value, enjoyment, self-confidence, motivation) and three stages of education (primary, secondary, tertiary). Highlighted in the findings is the critical impact of schooling experiences on the formation of student attitudes towards mathematics. Findings suggest that primary school experiences are a critical influence on the attitudes of adults who become early years teachers. These findings also indicate the vital role tertiary institutions play in altering the attitudes of preservice teachers who have had negative schooling experiences. Experiences that teachers indicated contributed to the formation of positive attitudes in their own education were games, group work, hands-on activities, positive feedback and perceived relevance. In contrast, negative experiences that teachers stated influenced their attitudes were insufficient help, rushed teaching, negative feedback and a lack of relevance of the content. These findings together with the literature on teachers‟ attitudes and mathematics education were synthesized in a model titled a Cycle of Early Years Teachers’ Attitudes Towards Mathematics. This model explains positive and negative influences on attitudes towards mathematics and how the attitudes of adults are passed on to children, who then as adults themselves, repeat the cycle by passing on attitudes to a new generation. The model can provide guidance for practising teachers and for preservice and inservice education about ways to foster positive influences to attitude formation in mathematics and inhibit negative influences. Two avenues for future research arise from the findings of this study both relating to attitudes and secondary school experiences. The first question relates to the resilience of attitudes, in particular, how an individual can maintain positive attitudes towards mathematics developed in primary school, despite secondary school experiences that typically have a negative influence on attitude. The second question relates to the relationship between attitudes and achievement, specifically, why secondary students achieve good grades in mathematics despite a lack of enjoyment, which is one of the dimensions of attitude.

Hunters & gatherers : strategies for curriculum mapping and data collection for assurance of learning

Assurance of learning is a predominant feature in both quality enhancement and assurance in higher education. Assurance of learning is a process that articulates explicit program outcomes and standards, and systematically gathers evidence to determine the extent to which performance matches expectations. Benefits accrue to the institution through the systematic assessment of whole of program goals. Data may be used for continuous improvement, program development, and to inform external accreditation and evaluation bodies. Recent developments, including the introduction of the Tertiary Education and Quality Standards Agency (TEQSA) will require universities to review the methods they use to assure learning outcomes. This project investigates two critical elements of assurance of learning: 1. the mapping of graduate attributes throughout a program; and 2. the collection of assurance of learning data. An audit was conducted with 25 of the 39 Business Schools in Australian universities to identify current methods of mapping graduate attributes and for collecting assurance of learning data across degree programs, as well as a review of the key challenges faced in these areas. Our findings indicate that external drivers like professional body accreditation (for example: Association to Advance Collegiate Schools of Business (AACSB)) and TEQSA are important motivators for assuring learning, and those who were undertaking AACSB accreditation had more robust assurance of learning systems in place. It was reassuring to see that the majority of institutions (96%) had adopted an embedding approach to assuring learning rather than opting for independent standardised testing. The main challenges that were evident were the development of sustainable processes that were not considered a burden to academic staff, and obtainment of academic buy in to the benefits of assuring learning per se rather than assurance of learning being seen as a tick box exercise. This cultural change is the real challenge in assurance of learning practice.