Multi-criteria assessment of innovative technology in the beef industry

In Australia rural research and development corporations and companies expended over $AUS500 million on agricultural research and development. A substantial proportion of this is invested in R&D in the beef industry. The Australian beef industry exports almost $AUS5billionof product annually and invest heavily in new product development to improve the beef quality and improve production efficiency. Review points are critical for effective new product development, yet many research and development bodies, particularly publicly funded ones, appear to ignore the importance of assessing products prior to their release. Significant sums of money are invested in developing technological innovations that have low levels and rates of adoption. The adoption rates could be improved if the developers were more focused on technology uptake and less focused on proving their technologies can be applied in practice. Several approaches have been put forward in an effort to improve rates of adoption into operational settings. This paper presents a study of key technological innovations in the Australian beef industry to assess the use of multiple criteria in evaluating the potential uptake of new technologies. Findings indicate that using multiple criteria to evaluate innovations before commercializing a technology enables researchers to better understand the issues that may inhibit adoption.

Communicating assessment criteria is not sufficient for influencing students' approaches to assessment tasks – perspectives from a differential equations class

This report presents the findings of an exploratory study into the perceptions held by students regarding the use of criterion-referenced assessment in an undergraduate differential equations class. Students in the class were largely unaware of the concept of criterion referencing and of the various interpretations that this concept has among mathematics educators. Our primary goal was to investigate whether explicitly presenting assessment criteria to students was useful to them and guided them in responding to assessment tasks. Quantitative data and qualitative feedback from students indicates that while students found the criteria easy to understand and useful in informing them as to how they would be graded, the manner in which they actually approached the assessment activity was not altered as a result of the use of explicitly communicated grading criteria.

The teacher as reflexive professional : making visible the excluded discourse in teacher standards

In the current climate of accountability, political manoeuvring, changing curriculum, increasingly diverse student cohorts and community expectations, teachers, more than ever, need to develop the skills and abilities to be reflective and reflexive practitioners. This study examines national teacher professional standards from Australia and the UK to identify the extent to which reflexivity is embedded in key policy documents that are intended to guide the work of teachers in those countries. Using Margaret Archer's theories of reflexivity and morphogenesis, and methods of critical discourse analysis, we argue that these blueprints for teachers’ work exclude reflexivity as an essential and overarching discourse of teacher professionalism.

Closing the loop 21st century style : providing feedback on written assessment via MP3 recordings

Feedback on student performance, whether in the classroom or on written assignments, enables them to reflect on their understandings and restructure their thinking in order to develop more powerful ideas and capabilities. Research has identified a number of broad principles of good feedback practice. These include the provision of feedback that facilitates the development of reflection in learning; helps clarify what good performance is in terms of goals, criteria and expected standards; provides opportunities to close the gap between current and desired performance; delivers high quality information to students about their learning; and encourages positive motivational beliefs and self-esteem. However, high staff–student ratios and time pressures often result in a gulf between this ideal and reality. Whilst greater use of criteria referenced assessment has enabled an improvement in the extent of feedback being provided to students, this measure alone does not go far enough to satisfy the requirements of good feedback practice. Technology offers an effective and efficient means by which personalised feedback may be provided to students. This paper presents the findings of a trial of the use of the freely available Audacity program to provide individual feedback via MP3 recordings to final year Media Law students at the Queensland University of Technology on their written assignments. The trial has yielded wide acclaim by students as an effective means of explaining the exact reasons why they received the marks they were awarded, the things they did well and the areas needing improvement. It also showed that good feedback practice can be achieved without the burden of an increase in staff workload.

Transferring knowledge through peer-reviewed assessment : the creation of a community of practice and the threats to its survival

While it is generally accepted in the learning and teaching literature that assessment is the single biggest influence on how students approach their learning, assessment methods within higher education are generally conservative and inflexible. Constrained by policy and accreditation requirements and the need for the explicit articulation of assessment standards for public accountability purposes, assessment tasks can fail to engage students or reflect the tasks students will face in the world of practice. Innovative assessment design can simultaneously deliver program objectives and active learning through a knowledge transfer process which increases student participation. This social constructivist view highlights that acquiring an understanding of assessment processes, criteria and standards needs active student participation. Within this context, a peer-assessed, weekly, assessment task was introduced in the first “serious” accounting subject offered as part of an undergraduate degree. The positive outcomes of this assessment innovation was that student failure rates declined 15%, tutorial participation increased fourfold, tutorial engagement increased six-fold and there was a 100% approval rating for the retention of the assessment task. In contributing to the core conference theme of “seismic” shifts within higher education, in stark contrast to the positive student response, staff-related issues of assessment conservatism and the necessity of meeting increasing research commitments, threatened the assessment task’s survival. These opposing forces to change have the potential to weaken the ability of higher education assessment arrangements to adequately serve either a new generation of students or the sector's community stakeholders.

Transferring knowledge through peer-reviewed assessment : the creation of a community of practice and the threats to its survival

While it is generally accepted in the learning and teaching literature that assessment is the single biggest influence on how students approach their learning, assessment methods within higher education are generally conservative and inflexible. Constrained by policy and accreditation requirements and the need for the explicit articulation of assessment standards for public accountability purposes, assessment tasks can fail to engage students or reflect the tasks students will face in the world of practice. Innovative assessment design can simultaneously deliver program objectives and active learning through a knowledge transfer process which increases student participation. This social constructivist view highlights that acquiring an understanding of assessment processes, criteria and standards needs active student participation. Within this context, a peer-assessed, weekly, assessment task was introduced in the first “serious” accounting subject offered as part of an undergraduate degree. The positive outcomes of this assessment innovation was that student failure rates declined 15%, tutorial participation increased fourfold, tutorial engagement increased six-fold and there was a 100% approval rating for the retention of the assessment task. In contributing to the core conference theme of “seismic” shifts within higher education, in stark contrast to the positive student response, staff-related issues of assessment conservatism and the necessity of meeting increasing research commitments, threatened the assessment task’s survival. These opposing forces to change have the potential to weaken the ability of higher education assessment arrangements to adequately serve either a new generation of students or the sector's community stakeholders.

The Development of Competency Standards for Specialist Critical Care Nurses

In defining the contemporary role of the specialist nurse it is necessary to challenge the concept of nursing as merely a combination of skills and knowledge. Nursing must be demonstrated and defined in the context of client care and include the broader notions of professional development and competence. This qualitative study sought to identify the competency standards for nurse specialists in critical care and to articulate the differences between entry-to-practice standards and the advanced practice of specialist nurses. Over 800 hours of specialist critical care nursing practice were observed and grouped into 'domains' or major themes of specialist practice using a constant comparison qualitative technique. These domains were further refined to describe attributes of the registered nurses which resulted in effective and/or superior performance (competency standards) and to provide examples of performance (performance criteria) which met the defined standard. Constant comparison of the emerging domains, competency standards and performance criteria to observations of specialist critical care practice, ensured the results provided a true reflection of the specialist nursing role. Data analysis resulted in 20 competency standards grouped into six domains: professional practice, reflective practice, enabling, clinical problem solving, teamwork, and leadership. Each of these domains is comprised of between two and seven competency standards. Each standard is further divided into component parts or 'elements' and the elements are illustrated with performance criteria. The competency standards are currently being used in several Australian critical care educational programmes and are the foundation for an emerging critical care credentialling process. They have been viewed with interest by a variety of non-critical care specialty groups and may form a common precursor from which further specialist nursing practice assessment will evolve.

The enactment of formative assessment in English language classrooms in two Chinese universities : teacher and student responses

The College English Curriculum Requirements (CECR), announced by the Chinese Ministry of Education in 2007, recommended the inclusion of formative assessment into the existing summative assessment framework of College English. This policy had the potential to fundamentally change the nature of assessment and its role in the teaching and learning of English in Chinese universities. In order to document and analyse these changes, case studies involving English language teachers and learners were undertaken in two Chinese Universities: one a Key university in the national capital; the other a non-Key university in a western province. The case study design incorporated classroom observations and interviews with English language teachers and their students. The type and focus of feedback and the engagement of students in assessment were analysed in the two contexts. Fundamental to the analysis was the concept of enactment, with the focus of this study on the ways that policy ideas and principles were enacted in the practices of the Chinese university classroom. Understandings of formative assessment as applied in contexts other than the predominantly Western, Anglophone contexts from where many of its principles derive, are offered.

Regulatory Impact Assessment of Potential Duplication of Governance and Reporting Standards for Charities

On 25 January 2013, the Council of Australian Governments (COAG) released a Regulatory Impact Assessment (RIA) for consultation on ways to reduce regulatory duplication between the proposed Commonwealth governance and reporting standards and existing state and territory requirements.

Designing online assessment tools for disengaged youth

This article reports on the development of online assessment tools for disengaged youth in flexible learning environments. Sociocultural theories of learning and assessment and Bourdieu’s sociological concepts of capital and exchange were used to design a purpose-built content management system. This design experiment engaged participants in assessment that led to the exchange of self, peer and teacher judgements for credentialing. This collaborative approach required students and teachers to adapt and amend social networking practices for students to submit and judge their own and others’ work using comments, ratings, keywords and tags. Students and teachers refined their evaluative expertise across contexts, and negotiated meanings and values of digital works, which gave rise to revised versions and emergent assessment criteria. By combining social networking tools with sociological models of capital, assessment activities related to students’ digital productions were understood as valuations and judgements within an emergent, negotiable social field of exchange.

An investigation of moderation practices within a faculty of education

Moderation of student assessment is a critical component of teaching and learning in contemporary universities. In higher education, moderation is usually governed by university-wide policies and practices. However, in Australia, moderation processes will now be guided by the new national university accreditation authority, Tertiary Education Quality and Standards Agency (TEQSA). In light of this reform, the purpose of this qualitative study was to identify and analyse current moderation practices operating within a faculty of education at a large urban university in eastern Australia.

Student self-assessment of performance : a useful learning tool for students and instructors?

Assurance of Learning is a focus for many Business Schools to meet AACSB requirements. Prior research has examined student self-assessment as a measure of learning in this context, but we propose instead that this is a useful ‘learning tool’ for students and instructors that can help improve student performance and curricula. We examined self-assessment in a third year undergraduate e-marketing course and found a positive, though weak relationship between student self-assessment and instructor ratings on intended learning goals and criteria for a written assignment. Students who self-assessed tended to perform better in the assessment item and course than those who did not self-assess. But less competent students were more inaccurate in their self-assessment, suggesting a need to enhance understanding of marking criteria and performance standards within this group. Implications for educators are discussed.

Parent-teacher engagement : a coteaching and cogenerative dialoguing approach

The accumulated evidence from more than four decades of education research strongly suggests that parent involvement in schools carries significant benefits for students as well as for the success of schools (e.g., Henderson & Mapp, 2002). Governments in Australia and overseas have supported parent involvement in schools with a range of initiatives while parent groups have indicated a strong desire for expanded school roles that include participation in formal educational processes namely curriculum, pedagogy, and assessment. Research has also signalled the need for teachers to engage parents rather than adopt traditional parent-school involvement practices so that parents can participate as joint educators in their children's schooling alongside teachers (Pushor, 2001). Actually improving the quality of contact and relationships between parents and teachers to enable engagement however remains problematic. Coteaching and cogenerative dialoguing originally emerged as an innovative approach in the context of teaching secondary school science. Coteaching brings together the collective expertise of several individuals to expand learning opportunities for students while cogenerative dialogues refer to sessions in which participants talk, listen, and learn from one another about the process (Roth & Tobin, 2002a). Coteaching and cogenerative dialoguing reportedly benefits students academically and socially while rewarding educators professionally and emotionally through the support and collaboration they receive from fellow coteachers. These benefits ensue because coteaching theoretically positions teachers at one another's elbows, providing new and different understandings about teaching based on first-hand perspectives and shared goals for assisting students to learn. This thesis proposes that coteaching and cogenerative dialoguing may provide a vehicle for improving quality of contact and relationships between parents and teachers. To investigate coteaching and cogenerative dialoguing as a parent-teacher engagement mechanism, interpretive ethnographic case study research was conducted involving two parents and a secondary school teacher. Sociological ideas, namely Bourdieu's (1977) fields, habitus, and capitals, together with multiple dialectical concepts such as agency|structure (Sewell, 1992) and agency|passivity (Roth, 2007b, 2010) were assembled into a conceptual framework to examine parent-teacher relationships by describing and explaining cultural production and identity construction throughout the case study. Video and audio recordings of cogenerative dialogues and cotaught lessons comprised the chief data sources. Data were analysed using qualitative techniques such as discourse and conversation analysis to identify patterns and contradictions (Roth & Tobin, 2002a). The use of quality criteria detailed by Guba and Lincoln (2005) gives credence to the way in which ethical considerations infused the planning and conduct of this research. From the processes of data collection and analyses, three broad assertions were proffered. The findings highlight the significance of using multiple coordinated dialectical concepts for analysing the affordances and challenges of coteaching and cogenerative dialogues that include parents and teachers. Adopting the principles and purposes of coteaching and cogenerative dialoguing promoted trusting respectful relationships that generated an equitable culture. The simultaneous processes and tensions between logistics and ethics (i.e., the logistics|ethics dialectic) were proposed as a new way to conceptualise how power was redistributed among the participants. Knowledge of positive emotional energy and ongoing capital exchange conceived dialectically as the reciprocal interaction among cultural, social, and symbolic capitals (i.e., the dialectical relationship of cultural|social|symbolic capital) showed how coteaching and cogenerative dialoguing facilitated mutual understandings, joint decision-making, and group solidarity. The notion of passivity as the dialectical partner of agency explained how traditional roles and responsibilities were reconfigured and individual and collective agency expanded. Complexities that surfaced when implementing the coteaching and cogenerative dialoguing approach were outweighed by the multiple benefits that accrued for all involved. These benefits included the development of community-relevant and culturally-significant curricula that increased student agency and learning outcomes, heightened parent self-efficacy for participating in and contributing to formal educational processes, and enhanced teacher professionalism. This case study contributes to existing theory, knowledge and practice, and methodology in the research areas of parent-teacher relationships, specifically in secondary schools, and coteaching and cogenerative dialoguing. The study is particularly relevant given the challenges schools and teachers increasingly face to meaningfully connect with parents to better meet the needs of educational stakeholders in times of continual, complex, and rapid societal change.

The effects of standardised assessment (NAPLAN) on teacher pedagogy at two Queensland schools

The purpose of this qualitative interpretative case study was to explore how the National Assessment Program – Literacy and Numeracy (NAPLAN) requirements may be affecting pedagogies of two Year 3, Year 5 and Year 7 teachers at two Queensland schools. The perceived problem was that standardised assessment NAPLAN practices and its growing status as a key measure of education quality throughout Australia has the potential to limit the everyday literacy and numeracy practices of teachers to instructional methods primarily focused on teaching to the test. The findings demonstrate how increased explicit teaching of NAPLAN content and procedural knowledge prior to testing has the potential to negatively impact on the teaching of everyday literacy and numeracy skills and knowledge that extend beyond those concerned with NAPLAN. Such teaching limited opportunity for what teachers reported as valued collaborative learning contexts aiming for long-term literacy and numeracy results.

The development of shared understandings of assessment policy : travelling between global and local contexts

In this paper, teachers’ enactment of assessment policy within demands for accountability and consistency of teacher judgements is considered. Evidence is drawn from a qualitative study involving 50 middle school teachers from Queensland, Australia, who participated in online social moderation meetings with teachers located in dispersed areas around the state. The study presents how travelling policy is embedded in local histories and cultures, in particular within systems of accountability; and the different layers of what may be considered ‘local’. The paper examines the intersections of travelling and embedded policy, and global and local contexts as these are enacted through online moderation meetings.