Integrating ‘role play’ in assessment to strengthen professional conduct and accountability of students : a pilot study

BACKGROUND In a process engineering setting, graduates are frequently allocated reviews of existing operations or required to scope new production processes by their supervisors with a view to improving or expanding on operations and overall productivity. These tasks may be carried out in teams and in consultation with the process engineer’s immediate line manager or a more experienced engineer, such as the Production or Maintenance Manager; ultimately reporting to senior management, which is frequently a non-engineer. Although professional skills development is part of engineering curricula, ‘professional conduct’ and ‘accountability’ required for dealing with peers and superiors in industry is not very well addressed at university. Consequently, upon graduation, many students are, in terms of knowledge and experience in this area, underprepared to work effectively in industry settings. PURPOSE The purpose of this study was to develop and implement a role-play scenario within a core 2nd year process engineering unit, so that students could gain knowledge, skills and experience in different aspects (and nuances) of professional conduct and accountability. DESIGN/METHOD In the role-play scenario, students worked in ‘engineering production teams’ to design a process for an iconic Queensland fruitcake and to present their solution and recommendations (culminating in a poster presentation) to an assessment panel consisting of staff, role-playing as, ‘production and plant managers’. Students were assessed on several areas, including professionalism using a criteria referenced assessment guide by a 3-member cross-disciplinary staff panel consisting of a Business Faculty lecturer, an engineer from industry and the lecturer of the Process Engineering unit. Professional conduct and accountability was gauged through direct questioning by the panel. Feedback was also sought from students on various aspects through a survey questionnaire after the role play activity at the end of semester. RESULTS Overall, the role play was very well performed with students achieving an average score of 79.3/100 (distinction grade). Professional conduct as assessed by panel was on average better than scores given for professional accountability (4.0 compared with 3.6 out of 5). Feedback from students indicated that the learning activities had contributed to their overall understanding of the content and the role of process engineers. Industry involvement was rated very highly as contributing to their learning at 4.8 (on Likert scale from 1 – 5) and the poster presentation was rated at 3.6. CONCLUSIONS This pilot study was successful in implementing a new assessment task for modelling professional conduct and accountability within a 2nd year core unit. This task incorporated a role-play activity and there was evidence to suggest that this and associated learning tasks were successful in broadening students’ understanding and skills in this area required for engineering practice. Following feedback given by students and staff, improvements will be made to the nature of the problem, how it is defined, its assessment, and the approach taken in the role-play scenario when the unit is offered in 2014.

Teachers' cultural values and accountability in Nigeria

This study investigates teacher‟s cultural values and accountability in Nigeria. A questionnaire developed by Professor Rosenblatt (University of Haifa, Israel) was used to gather quantitative data from 483 secondary teachers across Oyo, Osun, Ogun, and Lagos States in Southwest Nigeria. Data collected were analyzed using percentages, descriptive statistics, and analysis of variance (ANOVA). The findings show that Nigerian teachers have high dispositions towards both bureaucratic (external) and internal (professional) accountability and their scores for internal accountability (M= 4.4286; SD= 0.5726) were higher than their scores for external accountability (M= 3.9759; SD = 0.5575). Geographical locations made a significant difference in the scores. Teachers from urban and suburban areas demonstrate higher scores than teachers from the rural in both bureaucratic (external) and internal (professional) accountability

Bereavement Assessment Practice in Hospice Settings: Challenges for Palliative Care Social Workers

The management and delivery of bereavement support services in palliative care settings presents practical and ethical challenges. A national survey, conducted in 2007, examined bereavement practice in ten Marie Curie hospices across the United Kingdom. This qualitative study was undertaken using semi-structured telephone interviews with Bereavement Service Leaders located in each hospice. Although findings revealed that bereavement services were in operation and had been reviewed in response to the National Institute for Clinical Excellence Guidance (2004), and all bereaved families were offered support, there was no standardisation of service delivery across sites. Multi-disciplinary team meetings facilitated shared decision-making for bereavement follow-up, and expanded and clarified documentation completed by nursing staff around the time of the patient’s death. However, there was ambiguity regarding professional ‘duty of care’ and agency responses to bereaved individuals who were suicidal. Questions were raised around clinical effectiveness, reliability and professional accountability. The study highlighted ethical issues centred on documentation, user participation and consent, and found staff training was variable across the 10 hospices. The findings have informed the development of a post-bereavement service model which has been subsequently implemented across Marie Curie Cancer Care.

Professionalism in digitally-mediated project work

Fieldwork in a major construction programme is used to examine what is meant by professionalism where large integrated digital systems are used to design, deliver, and maintain buildings and infrastructure. The increasing ‘professionalization’ of the client is found to change other professional roles and interactions in project delivery. New technologies for approvals and workflow monitoring are associated with new occupational groups; new kinds of professional accountability; and a greater integration across professional roles. Further conflicts also arise, where occupational groups have different understandings of project deliverables and how they are competently achieved. The preliminary findings are important for an increasing policy focus on shareable data, in order for building owners and operators to improve the cost, value, handover and operation of complex buildings. However, it will also have an impact on wider public decision-making processes, professional autonomy, expertise and interdependence. These findings are considered in relation to extant literatures, which problematize the idea of professionalism; and the shift from drawings to shareable data as deliverables. The implications for ethics in established professions and other occupational groups are discussed; directions are suggested for further scholarship on professionalism in digitally mediated project work to improve practices which will better serve society.

The Deprofessionalisation Thesis, Accountability and Professional Character

It is said that the deprofessionalisation of social work and other welfare occupations reduces workers' professional discretion and autonomy, and thus their capacity to act in the best interests of their client. Without necessarily regarding the deprofessionalisation thesis as conclusive, this paper will ask how the state's control of the role and task of social workers impacts on their role-implicated obligations as professionals. If workers are reduced (as claimed) to the status of mere functionaries in systems they neither approve of nor control, does this exonerate them from bad outcomes or service failures? How should we view the dramatic increase in formal regulation now seen in the UK - as professionalisation or deprofessionalisation? The paper will argue that whatever the drift of policy, workers remain in some measure personally accountable. Service failures imply faults of practical reason that are partly attributable to the moral and intellectual character of professionals as individuals. It is therefore up to professionals, and their organisations, to attend to the improvement of professional character.

Is philanthropy relevant? a study of professional advisers in Australia

CPNS’ new Working Paper examines the latest findings from a national survey of professional advisers on the topic of philanthropy assistance to high-net-worth individuals. Findings confirm a growing willingness within the Australian advisory sector to provide philanthropy advice to clients with means, although the rate of change has slowed since 2005. Advisers are now more likely to see benefits in providing this type of counselling, as well as benefits for their clients in engaging in philanthropy.

Moderation as judgement practice: Reconciling system level accountability and local level practice

Internationally, recognition of the role of assessment to inform the learning process has received much attention in recent years. Assessment for learning, not just of learning is being supported by an increasing body of literature providing strategies that teachers and their students can incorporate to support the learning process (Assessment Reform Group, 2002; Broadfoot & Black, 2004; James, 2006). Concurrently there has been an increase internationally in systemic accountability requirements of schools in terms of student results. The convergence of these two movements has resulted in some education systems promoting standards-driven reform involving authentic assessment and a re-examination of the relationship between the teacher and the student in the learning process. In this context standards are intended to be used as the basis for judgements of student achievement; while the results from assessment tasks are meant to both inform the teaching/learning process, and to report and track student progress. In such system, the role and reliability of teacher judgement takes centre stage.

The impact of outcomes-driven curriculum reform on teacher perspectives of professional practice

This thesis is the result of an investigation of a Queensland example of curriculum reform based on outcomes, a type of reform common to many parts of the world during the last decade. The purpose of the investigation was to determine the impact of outcomes on teacher perspectives of professional practice. The focus was chosen to permit investigation not only of changes in behaviour resulting from the reform but also of teachers' attitudes and beliefs developed during implementation. The study is based on qualitative methodology, chosen because of its suitability for the investigation of attitudes and perspectives. The study exploits the researcher's opportunities for prolonged, direct contact with groups of teachers through the selection of an over-arching ethnography approach, an approach designed to capture the holistic nature of the reform and to contextualise the data within a broad perspective. The selection of grounded theory as a basis for data analysis reflects the open nature of this inquiry and demonstrates the study's constructivist assumptions about the production of knowledge. The study also constitutes a multi-site case study by virtue of the choice of three individual school sites as objects to be studied and to form the basis of the report. Three primary school sites administered by Brisbane Catholic Education were chosen as the focus of data collection. Data were collected from three school sites as teachers engaged in the first year of implementation of Student Performance Standards, the Queensland version of English outcomes based on the current English syllabus. Teachers' experience of outcomes-driven curriculum reform was studied by means of group interviews conducted at individual school sites over a period of fourteen months, researcher observations and the collection of artefacts such as report cards. Analysis of data followed grounded theory guidelines based on a system of coding. Though classification systems were not generated prior to data analysis, the labelling of categories called on standard, non-idiosyncratic terminology and analytic frames and concepts from existing literature wherever practicable in order to permit possible comparisons with other related research. Data from school sites were examined individually and then combined to determine teacher understandings of the reform, changes that have been made to practice and teacher responses to these changes in terms of their perspectives of professionalism. Teachers in the study understood the reform as primarily an accountability mechanism. Though teachers demonstrated some acceptance of the intentions of the reform, their responses to its conceptualisation, supporting documentation and implications for changing work practices were generally characterised by reduced confidence, anger and frustration. Though the impact of outcomes-based curriculum reform must be interpreted through the inter-relationships of a broad range of elements which comprise teachers' work and their attitudes towards their work, it is proposed that the substantive findings of the study can be understood in terms of four broad themes. First, when the conceptual design of outcomes did not serve teachers' accountability requirements and outcomes were perceived to be expressed in unfamiliar technical language, most teachers in the study lost faith in the value of the reform and lost confidence in their own abilities to understand or implement it. Second, this reduction of confidence was intensified when the scope of outcomes was outside the scope of the teachers' existing curriculum and assessment planning and teachers were confronted with the necessity to include aspects of syllabuses or school programs which they had previously omitted because of a lack of understanding or appreciation. The corollary was that outcomes promoted greater syllabus fidelity when frameworks were closely aligned. Third, other benefits the teachers associated with outcomes included the development of whole school curriculum resources and greater opportunity for teacher collaboration, particularly among schools. The teachers, however, considered a wide range of factors when determining the overall impact of the reform, and perceived a number of them in terms of the costs of implementation. These included the emergence of ethical dilemmas concerning relationships with students, colleagues and parents, reduced individual autonomy, particularly with regard to the selection of valued curriculum content and intensification of workload with the capacity to erode the relationships with students which teachers strongly associated with the rewards of their profession. Finally, in banding together at the school level to resist aspects of implementation, some teachers showed growing awareness of a collective authority capable of being exercised in response to top-down reform. These findings imply that Student Performance Standards require review and, additional implementation resourcing to support teachers through times of reduced confidence in their own abilities. Outcomes prove an effective means of high-fidelity syllabus implementation, and, provided they are expressed in an accessible way and aligned with syllabus frameworks and terminology, should be considered for inclusion in future syllabuses across a range of learning areas. The study also identifies a range of unintended consequences of outcomes-based curriculum and acknowledges the complexity of relationships among all the aspects of teachers' work. It also notes that the impact of reform on teacher perspectives of professional practice may alter teacher-teacher and school-system relationships in ways that have the potential to influence the effectiveness of future curriculum reform.

Role and purpose of standards in the context of national curriculum and assessment reform for accountability, improvement and equity in student learning

In this article our starting point is the current context of national curriculum change and intense speculation about the assessment, standards and reporting. It is written against a background of accountability measures and improvement imperatives, and focuses attention on standards as offering representations of quality. We understand standards to be constructs that aim to achieve public credibility and utility. Further, they can be examined for the purposes they seek to serve and also their expected functions. Fitness for purpose is therefore a useful notion in considering the nature of standards. Our interest in the discussion is the ‘fit’ between how standards are formulated and how they are used in practice, by whom and for what purposes. A related interest is in the matter of how standards can be harnessed to realise improvement.

Accountability through high-stakes testing and curriculum change

The motivation for secondary school principals in Queensland, Australia, to investigate curriculum change coincided with the commencement in 2005 of the state government’s publication of school exit test results as a measure of accountability. Aligning the schools’ curriculum with the requirements of high-stakes testing is considered by many academics and teachers as negative outcome of accountability for reasons such as ‘teaching to the test’ and narrowing the curriculum. However, this article outlines empirical evidence that principals are instigating curriculum change to improve published high-stakes test results. Three principals in this study offered several reasons as to why they wished to implement changes to school curricula. One reason articulated by all three was the pressures of accountability, particularly through the publication of high-stakes test data which has now become commonplace in education systems of many Western Nations.

Testing for accountability

Current graduates in education are entering a very different profession to the one in which most of their “baby-boomer” colleagues started. It is a profession in which accountability and national high-stakes testing (e.g. NAPLAN) have become catch-cries, and where the interpretation and use of educational data is an additional challenge. This has led to schools focusing on performance, and teachers now have to analyse test data and apply the findings to their teaching.

Assessment for learning in the accountability era : Queensland, Australia

Developments in school education in Australia over the past decade have witnessed the rise of national efforts to reform curriculum, assessment and reporting. Constitutionally the power to decide on curriculum matters still resides with the States. Higher stakes in assessment, brought about by national testing and international comparative analyses of student achievement data, have challenged State efforts to maintain the emphasis on assessment to promote learning while fulfilling accountability demands. In this article lessons from the Queensland experience indicate that it is important to build teachers' assessment capacity and their assessment literacy for the promotion of student learning. It is argued that teacher assessment can be a source of dependable results through moderation practice. The Queensland Studies Authority has recognised and supported the development of teacher assessment and moderation practice in the context of standards-driven, national reform. Recent research findings explain how the focus on learning can be maintained by avoiding an over-interpretation of test results in terms of innate ability and limitations and by encouraging teachers to adopt more tailored diagnosis of assessment data to address equity through focus on achievement for all. Such efforts are challenged as political pressures related to the Australian government’s implementation of national testing and national partnership funding arrangements tied to the performance of students at or below minimum standards become increasingly apparent.

Sharing with care : an information accountability perspective

Health information sharing has become a vital part of modern healthcare delivery. E-health technologies provide efficient and effective ways of sharing medical information, but give rise to issues that neither the medical professional nor the consumers have control over. Information security and patient privacy are key impediments that hinder sharing information as sensitive as health information. Health information interoperability is another issue which hinders the adoption of available e health technologies. In this paper we propose a solution for these problems in terms of information accountability, the HL7 interoperability standard and social networks for manipulating personal health records.

Data-driven accountability in Australia : an unfolding story with lessons for leaders

Throughout the world, state and nation standardised testing of children, has become a "huge industry" (English, 2002). Although English is referring to the American system which has been involved in standardised testing for over half a century, the same could be said of many other countries, including Australia. It has been only in recent years that Australia has embraced national testing as part of a wider reform effort to bring about increased accountability in schooling. The results of high-stakes tests in Australia are now published in newspapers and electronically on the Australian federal government's MySchool website (www.myschoold.edu.au). MySchool provides results on the National Assessment Program - Literacy and Numeracy (NAPLAN) for students in Years 3,5, 7 and 9. Data are available that compare schools to statistically similar schools. This more recent publication of national testing results in Australia is a visible example of "contractual accountability", described by Mulford, Edmunds, Kendall, Kendall and Bishop (2008) as " the degree to which [actors] are fulfilling the expectations of particular audiences in terms of standards, outcomes and results" (p.20).

The current context of Queensland primary teacher engagement with professional learning through professional associations

Engaging Queensland primary teachers in professional associations can be a challenge, particularly for subject-specific associations. Professional associations are recognised providers of professional learning. By not being involved in professional associations primary teachers are missing potential quality professional learning opportunities that can impact the results of their students. The purpose of the research is twofold: Firstly, to provide a thorough understanding of the current context in order to assist professional associations who wish to change from their current level of primary teacher engagement; and secondly, to contribute to the literature in the area of professional learning for primary teachers within professional associations. Using a three part research design, interviews of primary teachers and focus groups of professional association participants and executives were conducted and themed to examine the current context of engagement. Force field analysis was used to provide the framework to identify the driving and restraining forces for primary teacher engagement in professional learning through professional associations. Communities of practice and professional learning communities were specifically examined as potential models for professional associations to consider. The outcome is a diagrammatic framework outlining the current context of primary teacher engagement, specifically the driving and restraining forces of primary teacher engagement with professional associations. This research also identifies considerations for professional associations wishing to change their level of primary teacher engagement. The results of this research show that there are key themes that provide maximum impact if wishing to increase engagement of primary teachers in professional associations. However the implications of this lies with professional associations and their alignment between intent and practice dedicated to this change.