Integrating ‘role play’ in assessment to strengthen professional conduct and accountability of students : a pilot study

BACKGROUND In a process engineering setting, graduates are frequently allocated reviews of existing operations or required to scope new production processes by their supervisors with a view to improving or expanding on operations and overall productivity. These tasks may be carried out in teams and in consultation with the process engineer’s immediate line manager or a more experienced engineer, such as the Production or Maintenance Manager; ultimately reporting to senior management, which is frequently a non-engineer. Although professional skills development is part of engineering curricula, ‘professional conduct’ and ‘accountability’ required for dealing with peers and superiors in industry is not very well addressed at university. Consequently, upon graduation, many students are, in terms of knowledge and experience in this area, underprepared to work effectively in industry settings. PURPOSE The purpose of this study was to develop and implement a role-play scenario within a core 2nd year process engineering unit, so that students could gain knowledge, skills and experience in different aspects (and nuances) of professional conduct and accountability. DESIGN/METHOD In the role-play scenario, students worked in ‘engineering production teams’ to design a process for an iconic Queensland fruitcake and to present their solution and recommendations (culminating in a poster presentation) to an assessment panel consisting of staff, role-playing as, ‘production and plant managers’. Students were assessed on several areas, including professionalism using a criteria referenced assessment guide by a 3-member cross-disciplinary staff panel consisting of a Business Faculty lecturer, an engineer from industry and the lecturer of the Process Engineering unit. Professional conduct and accountability was gauged through direct questioning by the panel. Feedback was also sought from students on various aspects through a survey questionnaire after the role play activity at the end of semester. RESULTS Overall, the role play was very well performed with students achieving an average score of 79.3/100 (distinction grade). Professional conduct as assessed by panel was on average better than scores given for professional accountability (4.0 compared with 3.6 out of 5). Feedback from students indicated that the learning activities had contributed to their overall understanding of the content and the role of process engineers. Industry involvement was rated very highly as contributing to their learning at 4.8 (on Likert scale from 1 – 5) and the poster presentation was rated at 3.6. CONCLUSIONS This pilot study was successful in implementing a new assessment task for modelling professional conduct and accountability within a 2nd year core unit. This task incorporated a role-play activity and there was evidence to suggest that this and associated learning tasks were successful in broadening students’ understanding and skills in this area required for engineering practice. Following feedback given by students and staff, improvements will be made to the nature of the problem, how it is defined, its assessment, and the approach taken in the role-play scenario when the unit is offered in 2014.

Is philanthropy relevant? a study of professional advisers in Australia

CPNS’ new Working Paper examines the latest findings from a national survey of professional advisers on the topic of philanthropy assistance to high-net-worth individuals. Findings confirm a growing willingness within the Australian advisory sector to provide philanthropy advice to clients with means, although the rate of change has slowed since 2005. Advisers are now more likely to see benefits in providing this type of counselling, as well as benefits for their clients in engaging in philanthropy.

Moderation as judgement practice: Reconciling system level accountability and local level practice

Internationally, recognition of the role of assessment to inform the learning process has received much attention in recent years. Assessment for learning, not just of learning is being supported by an increasing body of literature providing strategies that teachers and their students can incorporate to support the learning process (Assessment Reform Group, 2002; Broadfoot & Black, 2004; James, 2006). Concurrently there has been an increase internationally in systemic accountability requirements of schools in terms of student results. The convergence of these two movements has resulted in some education systems promoting standards-driven reform involving authentic assessment and a re-examination of the relationship between the teacher and the student in the learning process. In this context standards are intended to be used as the basis for judgements of student achievement; while the results from assessment tasks are meant to both inform the teaching/learning process, and to report and track student progress. In such system, the role and reliability of teacher judgement takes centre stage.

The impact of outcomes-driven curriculum reform on teacher perspectives of professional practice

This thesis is the result of an investigation of a Queensland example of curriculum reform based on outcomes, a type of reform common to many parts of the world during the last decade. The purpose of the investigation was to determine the impact of outcomes on teacher perspectives of professional practice. The focus was chosen to permit investigation not only of changes in behaviour resulting from the reform but also of teachers' attitudes and beliefs developed during implementation. The study is based on qualitative methodology, chosen because of its suitability for the investigation of attitudes and perspectives. The study exploits the researcher's opportunities for prolonged, direct contact with groups of teachers through the selection of an over-arching ethnography approach, an approach designed to capture the holistic nature of the reform and to contextualise the data within a broad perspective. The selection of grounded theory as a basis for data analysis reflects the open nature of this inquiry and demonstrates the study's constructivist assumptions about the production of knowledge. The study also constitutes a multi-site case study by virtue of the choice of three individual school sites as objects to be studied and to form the basis of the report. Three primary school sites administered by Brisbane Catholic Education were chosen as the focus of data collection. Data were collected from three school sites as teachers engaged in the first year of implementation of Student Performance Standards, the Queensland version of English outcomes based on the current English syllabus. Teachers' experience of outcomes-driven curriculum reform was studied by means of group interviews conducted at individual school sites over a period of fourteen months, researcher observations and the collection of artefacts such as report cards. Analysis of data followed grounded theory guidelines based on a system of coding. Though classification systems were not generated prior to data analysis, the labelling of categories called on standard, non-idiosyncratic terminology and analytic frames and concepts from existing literature wherever practicable in order to permit possible comparisons with other related research. Data from school sites were examined individually and then combined to determine teacher understandings of the reform, changes that have been made to practice and teacher responses to these changes in terms of their perspectives of professionalism. Teachers in the study understood the reform as primarily an accountability mechanism. Though teachers demonstrated some acceptance of the intentions of the reform, their responses to its conceptualisation, supporting documentation and implications for changing work practices were generally characterised by reduced confidence, anger and frustration. Though the impact of outcomes-based curriculum reform must be interpreted through the inter-relationships of a broad range of elements which comprise teachers' work and their attitudes towards their work, it is proposed that the substantive findings of the study can be understood in terms of four broad themes. First, when the conceptual design of outcomes did not serve teachers' accountability requirements and outcomes were perceived to be expressed in unfamiliar technical language, most teachers in the study lost faith in the value of the reform and lost confidence in their own abilities to understand or implement it. Second, this reduction of confidence was intensified when the scope of outcomes was outside the scope of the teachers' existing curriculum and assessment planning and teachers were confronted with the necessity to include aspects of syllabuses or school programs which they had previously omitted because of a lack of understanding or appreciation. The corollary was that outcomes promoted greater syllabus fidelity when frameworks were closely aligned. Third, other benefits the teachers associated with outcomes included the development of whole school curriculum resources and greater opportunity for teacher collaboration, particularly among schools. The teachers, however, considered a wide range of factors when determining the overall impact of the reform, and perceived a number of them in terms of the costs of implementation. These included the emergence of ethical dilemmas concerning relationships with students, colleagues and parents, reduced individual autonomy, particularly with regard to the selection of valued curriculum content and intensification of workload with the capacity to erode the relationships with students which teachers strongly associated with the rewards of their profession. Finally, in banding together at the school level to resist aspects of implementation, some teachers showed growing awareness of a collective authority capable of being exercised in response to top-down reform. These findings imply that Student Performance Standards require review and, additional implementation resourcing to support teachers through times of reduced confidence in their own abilities. Outcomes prove an effective means of high-fidelity syllabus implementation, and, provided they are expressed in an accessible way and aligned with syllabus frameworks and terminology, should be considered for inclusion in future syllabuses across a range of learning areas. The study also identifies a range of unintended consequences of outcomes-based curriculum and acknowledges the complexity of relationships among all the aspects of teachers' work. It also notes that the impact of reform on teacher perspectives of professional practice may alter teacher-teacher and school-system relationships in ways that have the potential to influence the effectiveness of future curriculum reform.

Role and purpose of standards in the context of national curriculum and assessment reform for accountability, improvement and equity in student learning

In this article our starting point is the current context of national curriculum change and intense speculation about the assessment, standards and reporting. It is written against a background of accountability measures and improvement imperatives, and focuses attention on standards as offering representations of quality. We understand standards to be constructs that aim to achieve public credibility and utility. Further, they can be examined for the purposes they seek to serve and also their expected functions. Fitness for purpose is therefore a useful notion in considering the nature of standards. Our interest in the discussion is the ‘fit’ between how standards are formulated and how they are used in practice, by whom and for what purposes. A related interest is in the matter of how standards can be harnessed to realise improvement.

Accountability through high-stakes testing and curriculum change

The motivation for secondary school principals in Queensland, Australia, to investigate curriculum change coincided with the commencement in 2005 of the state government’s publication of school exit test results as a measure of accountability. Aligning the schools’ curriculum with the requirements of high-stakes testing is considered by many academics and teachers as negative outcome of accountability for reasons such as ‘teaching to the test’ and narrowing the curriculum. However, this article outlines empirical evidence that principals are instigating curriculum change to improve published high-stakes test results. Three principals in this study offered several reasons as to why they wished to implement changes to school curricula. One reason articulated by all three was the pressures of accountability, particularly through the publication of high-stakes test data which has now become commonplace in education systems of many Western Nations.

Testing for accountability

Current graduates in education are entering a very different profession to the one in which most of their “baby-boomer” colleagues started. It is a profession in which accountability and national high-stakes testing (e.g. NAPLAN) have become catch-cries, and where the interpretation and use of educational data is an additional challenge. This has led to schools focusing on performance, and teachers now have to analyse test data and apply the findings to their teaching.

Assessment for learning in the accountability era : Queensland, Australia

Developments in school education in Australia over the past decade have witnessed the rise of national efforts to reform curriculum, assessment and reporting. Constitutionally the power to decide on curriculum matters still resides with the States. Higher stakes in assessment, brought about by national testing and international comparative analyses of student achievement data, have challenged State efforts to maintain the emphasis on assessment to promote learning while fulfilling accountability demands. In this article lessons from the Queensland experience indicate that it is important to build teachers' assessment capacity and their assessment literacy for the promotion of student learning. It is argued that teacher assessment can be a source of dependable results through moderation practice. The Queensland Studies Authority has recognised and supported the development of teacher assessment and moderation practice in the context of standards-driven, national reform. Recent research findings explain how the focus on learning can be maintained by avoiding an over-interpretation of test results in terms of innate ability and limitations and by encouraging teachers to adopt more tailored diagnosis of assessment data to address equity through focus on achievement for all. Such efforts are challenged as political pressures related to the Australian government’s implementation of national testing and national partnership funding arrangements tied to the performance of students at or below minimum standards become increasingly apparent.

Sharing with care : an information accountability perspective

Health information sharing has become a vital part of modern healthcare delivery. E-health technologies provide efficient and effective ways of sharing medical information, but give rise to issues that neither the medical professional nor the consumers have control over. Information security and patient privacy are key impediments that hinder sharing information as sensitive as health information. Health information interoperability is another issue which hinders the adoption of available e health technologies. In this paper we propose a solution for these problems in terms of information accountability, the HL7 interoperability standard and social networks for manipulating personal health records.

Data-driven accountability in Australia : an unfolding story with lessons for leaders

Throughout the world, state and nation standardised testing of children, has become a "huge industry" (English, 2002). Although English is referring to the American system which has been involved in standardised testing for over half a century, the same could be said of many other countries, including Australia. It has been only in recent years that Australia has embraced national testing as part of a wider reform effort to bring about increased accountability in schooling. The results of high-stakes tests in Australia are now published in newspapers and electronically on the Australian federal government's MySchool website (www.myschoold.edu.au). MySchool provides results on the National Assessment Program - Literacy and Numeracy (NAPLAN) for students in Years 3,5, 7 and 9. Data are available that compare schools to statistically similar schools. This more recent publication of national testing results in Australia is a visible example of "contractual accountability", described by Mulford, Edmunds, Kendall, Kendall and Bishop (2008) as " the degree to which [actors] are fulfilling the expectations of particular audiences in terms of standards, outcomes and results" (p.20).

The current context of Queensland primary teacher engagement with professional learning through professional associations

Engaging Queensland primary teachers in professional associations can be a challenge, particularly for subject-specific associations. Professional associations are recognised providers of professional learning. By not being involved in professional associations primary teachers are missing potential quality professional learning opportunities that can impact the results of their students. The purpose of the research is twofold: Firstly, to provide a thorough understanding of the current context in order to assist professional associations who wish to change from their current level of primary teacher engagement; and secondly, to contribute to the literature in the area of professional learning for primary teachers within professional associations. Using a three part research design, interviews of primary teachers and focus groups of professional association participants and executives were conducted and themed to examine the current context of engagement. Force field analysis was used to provide the framework to identify the driving and restraining forces for primary teacher engagement in professional learning through professional associations. Communities of practice and professional learning communities were specifically examined as potential models for professional associations to consider. The outcome is a diagrammatic framework outlining the current context of primary teacher engagement, specifically the driving and restraining forces of primary teacher engagement with professional associations. This research also identifies considerations for professional associations wishing to change their level of primary teacher engagement. The results of this research show that there are key themes that provide maximum impact if wishing to increase engagement of primary teachers in professional associations. However the implications of this lies with professional associations and their alignment between intent and practice dedicated to this change.

The teacher as reflexive professional : making visible the excluded discourse in teacher standards

In the current climate of accountability, political manoeuvring, changing curriculum, increasingly diverse student cohorts and community expectations, teachers, more than ever, need to develop the skills and abilities to be reflective and reflexive practitioners. This study examines national teacher professional standards from Australia and the UK to identify the extent to which reflexivity is embedded in key policy documents that are intended to guide the work of teachers in those countries. Using Margaret Archer's theories of reflexivity and morphogenesis, and methods of critical discourse analysis, we argue that these blueprints for teachers’ work exclude reflexivity as an essential and overarching discourse of teacher professionalism.

Accounting at home in developing economies : Current practices and implications for the accounting professional

We determine the extent of accounting at home in developing economies in this research. We then consider the role of the accounting profession may have in promoting accounting values at home. A language of business, accounting today plays a fundamental support role within the business community to evaluate the impact past decisions, and foresees directions for future initiatives. Sound accounting practices are fundamental to ensure symmetrical information dissemination across various stakeholders. Accounting literature has sought to investigate a number of questions that attempt to improve the practice of accounting in the corporate world. Equally, we must obtain adequate understanding of how we use accounting in our everyday life, and how accounting could assist the people most affected by the effects of accounting scandals, economic conditions, and corporate collapses.

Accountancy capstone : enhancing integration and professional identity

Capstone units are generally seen to have three main aims: integrating the program, reflecting on prior learning, and transitioning into the workplace. However, research indicates that most programs do not achieve outcomes in all three areas with Henscheid (2000) revealing that integration is the major goal of many capstone programs. As well, in the accounting education literature there has been little empirical evidence relating to the effectiveness of student learning as a result of implementing a capstone unit. This study reports on the development and implementation of an accountancy capstone unit at the Queensland University of Technology (QUT), which began in 2006. The main features of this capstone unit are: the use of problem-based learning (PBL); integration of the program; the development of a professional identity whereby classes are broken up into groups of a maximum of five students who take on the persona of a professional accounting firm for an entire semester; and the students, acting as professional advisors within that firm, are required to solve a series of unstructured, multi-dimensional accounting problems based on limited given facts. This process is similar to a professional advisor asking a client about the facts relating to the particular problem of the client and then solving the problem. The research was conducted over nine semesters and involved the collection of both quantitative and qualitative data from a student questionnaire. The results indicate that in terms of student perceptions, the capstone unit was very effective in enhancing integration of the program and enhancing professional identity thereby assisting student transition into the professional accounting workplace. Our approach therefore meets two of the three generally accepted aims of a capstone unit. With accounting educators striving to maximise student learning from a finite set of resources, this approach using PBL has resulted in improved learning outcomes for accounting students about to enter the workplace as professionals.

Is it RIP for the IEP? The future of individual education plans in an era of accountability

This article presents a brief overview of the development of the Individual Education Plan (IEP) and prompts teachers to question its use and relevance in an era of accountability in Australian schools. Many Australian teachers do not realise that the IEP was adopted from the United States where is was legislated practice based on that country's Human Rights Legislation. It is not included in the Australian policy context. Though not embedded in the legislation of many other countries, it became a process and a product synonymous with the education of students with disability worldwide. In the era of standards-based education and curriculum for all, the relevance of the IEP process and product has been questioned or re-imaged in some Australian schools. The story of one school leader, Violet, is presented here as an example.