Assessment in tertiary mathematics

There is a growing consensus among many educators that the goals of teaching and learning mathematics are to help students solve real-life problems, participate intelligently in daily affairs, and prepare them for jobs (Gardiner, 1994; Roeber, 1995). These goals suggest that the role of routine procedural skills should be diminished while more emphasis ought to be placed on learners gaining conceptual insights and analytical skills that appear essential in real-life mathematical problem solving (Schoenfeld, 1993; Stenmark, 1989).

Implementation of an integrated, technology-based, discovery mode assessment item involving an incubation period to enhance learning outcomes for engineering maths students

In this paper we discuss our current efforts to develop and implement an exploratory, discovery mode assessment item into the total learning and assessment profile for a target group of about 100 second level engineering mathematics students. The assessment item under development is composed of 2 parts, namely, a set of "pre-lab" homework problems (which focus on relevant prior mathematical knowledge, concepts and skills), and complementary computing laboratory exercises which are undertaken within a fixed (1 hour) time frame. In particular, the computing exercises exploit the algebraic manipulation and visualisation capabilities of the symbolic algebra package MAPLE, with the aim of promoting understanding of certain mathematical concepts and skills via visual and intuitive reasoning, rather than a formal or rigorous approach. The assessment task we are developing is aimed at providing students with a significant learning experience, in addition to providing feedback on their individual knowledge and skills. To this end, a noteworthy feature of the scheme is that marks awarded for the laboratory work are primarily based on the extent to which reflective, critical thinking is demonstrated, rather than the amount of CBE-style tasks completed by the student within the allowed time. With regard to student learning outcomes, a novel and potentially critical feature of our scheme is that the assessment task is designed to be intimately linked to the overall course content, in that it aims to introduce important concepts and skills (via individual student exploration) which will be revisited somewhat later in the pedagogically more restrictive formal lecture component of the course (typically a large group plenary format). Furthermore, the time delay involved, or "incubation period", is also a deliberate design feature: it is intended to allow students the opportunity to undergo potentially important internal re-adjustments in their understanding, before being exposed to lectures on related course content which are invariably delivered in a more condensed, formal and mathematically rigorous manner. In our presentation, we will discuss in more detail our motivation and rationale for trailing such a scheme for the targeted student group. Some of the advantages and disadvantages of our approach (as we perceived them at the initial stages) will also be enumerated. In a companion paper, the theoretical framework for our approach will be more fully elaborated, and measures of student learning outcomes (as obtained from eg. student provided feedback) will be discussed.

Re-imagining school through young people’s drawings

Children’s drawings provide rich qualitative data (Walker, 2008) and “valuable information for the assessment of children's environmental perceptions” (Barraza, 1999, p. 49). They are the primary data source being used to re-imagine school from a student perspective (Schratz & Steiner-Löffler, 1998) in a research project being carried out with primary school students in Queensland, Australia. This paper will report on the progress of this project which addresses a mostly unmet need for students’ perspectives to be included in school design (Rudduck & Flutter, 2004). Grade 5/6 students in a number of primary schools have been invited to submit annotated drawings with up to 200 words of text illustrating their ideal educational spaces. Using purpose-designed analytical tools, the submissions will be compared across student backgrounds and school types to obtain a better understanding of the needs and educational desires of young people in relation to changing learning environments. The findings will inform consideration of the design and use of educational spaces with all work exhibited through a dedicated website. The term ‘educational spaces’ avoids restrictive notions of what the concept of ‘school’ means, referring to any real or virtual space in which teaching and learning may occur or, as Ferguson and Seddon (2007) have referred to it, “the shifting imagery of education” that includes red brick schools and dispersed learning networks. The theoretical framework for this study is grounded in the work of Greene (1995) and Wright-Mills (2001) who cited the deployment of critical and empathic imagination in addressing education reform.

Changing assessment practices : the case for online moderation

Online moderation meetings have the potential to support the collaborative professional development of teachers, and the formation of a common understanding of what denotes quality in student work in a standards based assessment system. In doing so systemic calls for consistency across education systems are also being met. In this paper a case for employing online moderation meetings is developed through recourse to the demands of learning in the twenty-first century and the place of assessment within those discourses. It is argued that empirical data is needed on the efficacy of online moderation meetings to guide future practice as the use of information and communication technologies increases in education systems. Online moderation is one way of gathering teachers across vast distances to share their understandings and develop common meanings of assessment. While it is suggested that online moderation is one possible procedure to meet systemic requirements and support teachers’ professional collaboration, the implementation of such a system also introduces new challenges for schools and teachers. Meeting online to discuss professional understandings is a new way of operating for teachers and involves technology that has not yet been fully utilised within education departments. Issues such as the types of interactions that are afforded within such an environment, as well as technical operating problems that occur when using technology impact on the employment of online meetings. Online moderation meetings while potentially solving the issue of developing common understandings across an entire department also pose new issues to be resolved. There is a need for research into the efficacy of online moderation meetings so that future policy decisions may be based on sound empirical data. It is imperative that as new ways of knowing and acting are incorporated into school curriculum and pedagogy, assessment practices are also aligned. Online moderation meetings can support such practices by enabling teachers to communicate with a wider and more diverse group of teachers to establish common understandings.

Aligning ICT in assessment with teaching and learning : enhancing student achievement in the middle years

Student underachievement in the middle years (typically Years 4 to 9) is a concern in education. Incorporating Information and Communication Technologies (ICT) in assessment that is aligned to teaching and learning has the potential to engage students in higher cognitive processes that lead to increased student achievement. To examine this proposition an investigation was undertaken into teachers’ perceptions of alignment and the implications of those for student achievement in ICT enhanced middle years assessment tasks. This investigation used a collective case study design underpinned by socio-cultural theory. Two methods were used for data collection, namely, semi-structured interviews with individual teachers and a focus group discussion with teachers and another with students. Findings revealed teachers’ perceptions that alignment: assists in mediating achievement of learning outcomes in quality middle years assessment tasks, assists in creating a challenging but supportive environment in which positive learning dispositions and success is encouraged for all students, and contributes to more rigorous use of ICT in assessment. The process of implementing alignment was found to be complex but assisted through prioritising particular practices. These findings enabled the development of eight steps which serve as a guide to the effective implementation of alignment in middle years assessment tasks.

Identity and disciplinarity : Multi-disciplinary student cohorts in Higher Education [Abstract]

This paper will describe a research project that examines the implications of multidisciplinary student cohorts on teaching and learning within undergraduate and postgraduate units in higher education. Whist students generally specialise in one discipline, it is also common that, at some point during their degree, they will choose to undertake subjects that are outside their specialist area. Students may choose a multidisciplinary learning experience either out of interest or because the subject is seen as complementary to their core discipline. When the lens of identity is applied to the multi-disciplinary cohorts in undergraduate and postgraduate units, it assists in identifying learning needs. The nature of disciplinarity, and the impact it has on students’ academic identity, presents challenges to both students and teachers when they engage in teaching and learning, impacting on curriculum design, assessment practices and teaching delivery strategies (Winberg, 2008). This project aims to identify the barriers that exist to effective teaching and learning in units that have multidisciplinary student cohorts. It will identify the particular needs of students in multidisciplinary student cohorts and determine a teaching and learning model that meets the needs of such cohorts. References Becher, T. & Trowler, P.R. (2001). Academic tribes and territories: Intellectual enquiry and the culture of the discipline. Buckingham, UK: Open University Press. Light, G. & Cox, R. (2001). Learning and teaching in higher education: A reflective professional. Thousand Oaks, CA: Sage. Neumann, R. (2001). Disciplinary differences and university teaching. Studies in Higher Education, 26 (2), 135-46. Neumann, R., Parry, S. & Becher, T. (2002). Teaching and Learning in their disciplinary contexts: A conceptual analysis. Studies in Higher Education, 27(4), 405-417. Taylor, P.G. (1999) Making Sense of Academic Life: Academics, Universities and Change. Buckingham, UK: Open University Press. Winberg, C. (2008). Teaching engineering/engineering teaching: interdisciplinary collaboration and the construction of academic identities. Teaching in Higher Education, 13(3), 353 - 367.

Formative and Summative Assessment and the Notion of Constructive Allignment

This paper discusses perceptions of first year accounting students about their tutorial activities and their engagements in assessment. As the literature suggests, unless participation in learning activities forms part of graded assessment it is often difficult to engage students in these activities. Using an action research model, this paper reports the study of first year accounting students' responses to action-orientated learning tasks in tutorials. The paper focuses on the importance of aligning curriculum objectives, learning and teaching activities and assessment,i.e. the notion of constructive alignment. However, as the research findings indicate, without support at institutional level, applying constructive alignment to facilitate quality student learning outcomes is a difficult task. Thus, the impacts of policy constraints on curriculum issues are also discussed, focusing on the limitations faced by tutors and their lack of involvement in curriculum development.

Science education policy-making : eleven emerging issues

The Perth Declaration on Science and Technology Education of 2007 expresses strong concern about the state of science and technology education worldwide and calls on governments to respond to a number of suggestions for establishing the structural conditions for their improved practice. The quality of school education in science and technology has never before been of such critical importance to governments. There are three imperatives for its critical importance. The first relates to the traditional role of science in schooling, namely the identification, motivation and initial preparation of those students who will go on to further studies for careers in all those professional fi elds that directly involve science and technology. A suffi cient supply of these professionals is vital to the economy of all countries and to the health of their citizens. In the 21st century they are recognised everywhere as key players in ensuring that industrial and economic development occurs in a socially and environmentally sustainable way. In many countries this supply is now falling seriously short and urgently needs to be addressed. The second imperative is that sustainable technological development and many other possible societal applications of science require the support of scientifically and technologically informed citizens. Without the support and understanding of citizens, technological development can all too easily serve short term and sectional interests. The longer term progress of the whole society is overlooked, citizens will be confused about what should, and what should not be supported, and reactive and the environment will continue to be destroyed rather than sustained. Sustainable development, and the potential that science and technology increasingly offers, involves societies in ways that can often interact strongly, with traditional values, and hence, making decisions about them involve major moral decisions. All students need to be prepared through their science and technology education to be able to participate actively as persons and as responsible citizens in these essential and exciting possibilities. This goal is far from being generally achieved at present, but pathways to it are now more clearly understood. The third imperative derives from the changes that are resulting from the application of digital technologies that are the most rapid, the most widespread, and probably the most pervasive influence that science has ever had on human society. We all, wherever we live, are part of a global communication society. Information exchange and access to it that have been hitherto the realm of the few, are now literally in the hands of individuals. This is leading to profound changes in the World of Work and in what is known as the Knowledge Society. Schooling is now being challenged to contribute to the development in students of an active repertoire of generic and subject-based competencies. This contrasts very strongly with existing priorities, in subjects like the sciences that have seen the size of a student’s a store of established knowledge as the key measure of success. Science and technology education needs to be a key component in developing these competencies. When you add to these imperatives, the possibility that a more effective education in science and technology will enable more and more citizens to delight in, and feel a share in the great human enterprise we call Science, the case for new policy decisions is compellingly urgent. What follows are the recommendations (and some supplementary notes) for policy makers to consider about more operational aspects for improving science and technology education. They are listed under headings that point to the issues within each of these aspects. In the full document, a background is provided to each set of issues, including the commonly current state of science and technology education. Associated with each recommendation for consideration are the positive Prospects that could follow from such decision making, and the necessary Prerequisites, if such bold policy decisions are to fl ow, as intended, into practice in science and technology classrooms.

Assessment of Speech Dialog Systems using Multi-Modal Cognitive Load Analysis and Driving Performance Metrics

In this paper, cognitive load analysis via acoustic- and CAN-Bus-based driver performance metrics is employed to assess two different commercial speech dialog systems (SDS) during in-vehicle use. Several metrics are proposed to measure increases in stress, distraction and cognitive load and we compare these measures with statistical analysis of the speech recognition component of each SDS. It is found that care must be taken when designing an SDS as it may increase cognitive load which can be observed through increased speech response delay (SRD), changes in speech production due to negative emotion towards the SDS, and decreased driving performance on lateral control tasks. From this study, guidelines are presented for designing systems which are to be used in vehicular environments.

Effects and feasibility of a multi-disciplinary orientation program for newly registered cancer patients : design of a randomised controlled trial

Background Diagnosis and treatment of cancer can contribute to psychological distress and anxiety amongst patients. Evidence indicates that information giving can be beneficial in reducing patient anxiety, so oncology specific information may have a major impact on this patient group. This study investigates the effects of an orientation program on levels of anxiety and self-efficacy amongst newly registered cancer patients who are about to undergo chemotherapy and/or radiation therapy in the cancer care centre of a large tertiary Australian hospital. Methods The concept of interventions for orienting new cancer patients needs revisiting due to the dynamic health care system. Historically, most orientation programs at this cancer centre were conducted by one nurse. A randomised controlled trial has been designed to test the effectiveness of an orientation program with bundled interventions; a face-to-face program which includes introduction to the hospital facilities, introduction to the multi-disciplinary team and an overview of treatment side effects and self care strategies. The aim is to orientate patients to the cancer centre and to meet the health care team. We hypothesize that patients who receive this orientation will experience lower levels of anxiety and distress, and a higher level of self-efficacy. Discussion An orientation program is a common health care service provided by cancer care centres for new cancer patients. Such programs aim to give information to patients at the beginning of their encounter at a cancer care centre. It is clear in the literature that interventions that aim to improve self-efficacy in patients may demonstrate potential improvement in health outcomes. Yet, evidence on the effects of orientation programs for cancer patients on self-efficacy remains scarce, particularly with respect to the use of multidisciplinary team members. This paper presents the design of a randomised controlled trial that will evaluate the effects and feasibility of a multidisciplinary orientation program for new cancer patients.

Assessment in education : principles, policy and practice

The English examination system provides a market in which a limited number of providers are accredited to offer curriculum-based examinations in many subject areas and at several levels. The most significant are the General Certificate of Secondary Education (GCSE) and the General Certificate of Education, Advanced (A level). Because these examinations are used for high-stakes purposes, including higher education and employment selection for individuals and programme evaluation for institutions, it is desired that scores from various exams be ‘comparable’ in several respects: across syllabuses and examination boards within a subject area, across years, and even across subject areas. Just how to accomplish this goal has been a topic of continual research and debate for over 50 years, through many changes of examination and institutional structures. But ever year, tens of thousands of scores must be reported, and every year, users expect them to ‘be comparable’ and use them as if they are.

Assessment for learning revisited : an Asia-Pacific perspective

In March of this year, 2009, the Third International Conference on Assessment for Learning was held in Dunedin, New Zealand. Colleagues from Australia (4), Canada (6), Europe (5), New Zealand (7), United Kingdom (5) and the United States of America (4) met to advance the understanding and practices of Assessment for Learning at all levels of education. An important outcome of this meeting was a position paper on Assessment for Learning (AfL) that has been reproduced with permission in this editorial because of its significance to a recurrent theme of the majority of the articles published in this special Asia-Pacific issue of the journal. The text of this statement is set out in italics below.

Comparative assessment of characteristics influencing the industrial property markets in Sydney and Hong Kong

Industrial property is commonly located in a designated ‘industrial’ precinct. An industrial property has a specific design and a number of services to support industrial activities including manufacture, distribution and transportation. Although it has a unique characteristic, certain industrial factor might operate differently in different countries. The aim of this paper is to provide a comparison between the Sydney and Hong Kong industrial property characteristics and to highlight their similarities and differences. This exploratory research used secondary data to provide background information of government policy and market conditions. Two case studies were use to illustrate similarities, trends, differences and to explore town planning, specific property characteristics including location, design and layout. Then, analyse whether these factors influence the performance and value of an industrial asset. The location of industrial properties varies between each country and depends heavily on infrastructure. It was noted that the town planning restrictions not only vary between markets and cities but also between property lots. The market conditions of both industrial markets were investigated and the supply and demand and rental levels in both cities were distinctly opposite.

Can Risk Management boost the supply of Affordable Housing Development and Management?

A shortage of affordable housing is a major problem in Australia today. This is mainly due to the limited supply of affordable housing that is provided by the non-government housing sector. Some private housing developers see the provision of affordable housing for lower income people as a high risk investment which offers a lower return than broader market-based housing. The scarcity of suitable land, a limited government ‘subsidy’, and increasing housing costs have not provided sufficient development incentives to encourage their investment despite the existing high demand for affordable housing. This study analyses the risk management process conducted by some private and not-for-profit housing providers in South East Queensland, and draws conclusions about the relationship between risk assessments/responses and past experiences. In-depth interviews of selected non-government housing providers have been conducted to facilitate an understanding of their approach to risk assessment/response in developing and in managing affordable housing projects. These developers use an informal risk management process as part of their normal business process in accordance with industry standards. A simple qualitative matrix has been used to analyse probability and impacts using a qualitative scale - low, medium and high. For housing providers who have considered investing in affordable housing but have not yet implemented any such projects, affordable housing development is seen as an opportunity that needs to be approached with caution. The risks associated with such projects and the levels of acceptance of these are not consistently identified by current housing providers. Many interviewees agree that the recognition of financial risk and the fear of community rejection of such housing projects have restrained them from committing to such investment projects. This study suggests that implementing improvements to the risk mitigation and management framework may assist in promoting the supply of affordable housing by non-government providers.

Is implementing criterion-referenced assessment worth the effort with gen Y?

Well implemented criterion-referenced assessment (CRA) requires dedicated time and effort, especially in describing realistic expectations of evidence of achievement to students in the form of criteria sheets (or grading rubrics). It is also takes time out of delivering content to teach students how to judge their own work using criteria sheets. In 2007, to engage third year Microbiology students in using criteria sheets for the first time in their degree, we devised an innovative assessment tutorial supported by online resources. We were sceptical of much of the literature that reported ‘agreed’ characteristics of our predominantly gen Y cohort, because of the older ages of the majority of authors. These authors claim gen Y has a propensity for digital media, overconfidence in their own abilities and a collaborative orientation. We rejected this stereotype when developing the tutorial. Evaluations by students were positive and there was no dramatic change to grades for the unit. These results are similar to those in the literature for non gen Y cohorts. This lends support to our claim that giving students control over their own learning, irrespective of their generational label, is worth the time and effort.