The centrality of teachers’ judgement practice in assessment : a study of standards in moderation

There is a strong quest in several countries including Australia for greater national consistency in education and intensifying interest in standards for reporting. Given this, it is important to make explicit the intended and unintended consequences of assessment reform strategies and the pressures to pervert and conform. In a policy context that values standardisation, the great danger is that the technical, rationalist approaches that generalise and make superficial assessment practices, will emerge. In this article, the authors contend that the centrality and complexity of teacher judgement practice in such a policy context need to be understood. To this end, we discuss and analyse recorded talk in teacher moderation meetings showing the processes that teachers use as they work with stated standards to award grades (A to E). We show how they move to and fro between (1) supplied textual artefacts, including stated standards and samples of student responses, (2) tacit knowledge of different types, drawing into the moderation, and (3) social processes of dialogue and negotiation. While the stated standards play a part in judgement processes, in and of themselves they are shown to be insufficient to account for how the teachers ascribe value and award a grade to student work in moderation. At issue is the nature of judgement as cognitive and social practice in moderation and the legitimacy (or otherwise) of the mix of factors that shape how judgement occurs.

Developing strong social enterprises : a documentary approach

Social enterprises are diverse in their mission, business structures and industry orientations. Like all businesses, social enterprises face a range of strategic and operational challenges and utilize a range of strategies to access resources in support of their venture. This exploratory study examined the strategic management issues faced by Australian social enterprises and the ways in which they respond to these. The research was based on a comprehensive literature review and semi-structured interviews with 11 representatives of eight social enterprises based in Victoria and Queensland. The sample included mature social enterprises and those within two years of start-up. In addition to the research report, the outputs of the project include a series of six short documentaries, which are available on YouTube at http://www.youtube.com/user/SocialEnterpriseQUT#p/u. The research reported on here suggests that social enterprises are sophisticated in utilizing processes of network bricolage (Baker et al. 2003) to mobilize resources in support of their goals. Access to network resources can be both enabling and constraining as social enterprises mature. In terms of the use of formal business planning strategies, all participating social enterprises had utilized these either at the outset or the point of maturation of their business operations. These planning activities were used to support internal operations, to provide a mechanism for managing collective entrepreneurship, and to communicate to external stakeholders about the legitimacy and performance of the social enterprises. Further research is required to assess the impacts of such planning activities, and the ways in which they are used over time. Business structures and governance arrangements varied amongst participating enterprises according to: mission and values; capital needs; and the experiences and culture of founding organizations and individuals. In different ways, participants indicated that business structures and governance arrangements are important ways of conferring legitimacy on social enterprise, by signifying responsible business practice and strong social purpose to both external and internal stakeholders. Almost all participants in the study described ongoing tensions in balancing social purpose and business objectives. It is not clear, however, whether these tensions were problematic (in the sense of eroding mission or business opportunities) or productive (in the sense of strengthening mission and business practices through iterative processes of reflection and action). Longitudinal research on the ways in which social enterprises negotiate mission fulfillment and business sustainability would enhance our knowledge in this area. Finally, despite growing emphasis on measuring social impact amongst institutions, including governments and philanthropy, that influence the operating environment of social enterprise, relatively little priority was placed on this activity. The participants in our study noted the complexities of effectively measuring social impact, as well as the operational difficulties of undertaking such measurement within the day to day realities of running small to medium businesses. It is clear that impact measurement remains a vexed issue for a number of our respondents. This study suggests that both the value and practicality of social impact measurement require further debate and critically informed evidence, if impact measurement is to benefit social enterprises and the communities they serve.

Strategies to facilitate grading consistency in large classes

First year undergraduate university classes can be very large, and big student numbers often creates a challenge for instructors to ensure assignments are graded consistently across the cohort. This session describes and demonstrates the use of interactive audience response technology (ART) with assessors (rather than students) to moderate assignment grading. Results from preliminary research indicate this method of moderating the grading of assignments is effective, and achieves more consistent outcomes for students.

Eschewing the fat: strong production but Neil LaBute below his best : a review

AWARD-WINNING American play and screen writer Neil LaBute is known for producing character-driven dramas that concentrate on the darker side of human nature and desire. In Fat Pig, LaBute picks up on a familiar theme: the way a perverse social preference for physical perfection affects human relationships. It is a topic LaBute has tackled before in The Shape of Things, a compelling play in which a beautiful young woman's efforts to help her new boyfriend pursue a program of self-improvement are eventually revealed to be part of a bizarre human experiment for her master-of-fine-arts degree.

Physical function and health-related quality of life of older adults undergoing hospital rehabilitation : how strong is the association?

The purpose of this research is to report preliminary empirical evidence regarding the association between common physical performance measures and health-related quality of life (HRQoL) of hospitalized older adults recovering from illness and injury. Frequently, these patients do not return to premorbid levels of independence and physical ability. Rehabilitation for this population often focuses on improving physical functioning and mobility with the intention of maximizing their HRQoL for discharge and thereafter. For this reason, longitudinal use of physical performance measures as an indicator of improvement in physical functioning (and thus HRQoL) is common. Although this is a logical approach, there have been mixed results from previous investigations into the association between common measures of physical function and HRQoL amongst other adult patient populations.1,2 There has been no previous investigation reporting the association between HRQoL and a variety of common physical performance measures in hospitalized older adults.

Clinical indicators of quality for Australian residential aged care facilities : establishing reliability, validity, and quality thresholds

Background: In response to the need for more comprehensive quality assessment within Australian residential aged care facilities, the Clinical Care Indicator (CCI) Tool was developed to collect outcome data as a means of making inferences about quality. A national trial of its effectiveness and a Brisbane-based trial of its use within the quality improvement context determined the CCI Tool represented a potentially valuable addition to the Australian aged care system. This document describes the next phase in the CCI Tool.s development; the aims of which were to establish validity and reliability of the CCI Tool, and to develop quality indicator thresholds (benchmarks) for use in Australia. The CCI Tool is now known as the ResCareQA (Residential Care Quality Assessment). Methods: The study aims were achieved through a combination of quantitative data analysis, and expert panel consultations using modified Delphi process. The expert panel consisted of experienced aged care clinicians, managers, and academics; they were initially consulted to determine face and content validity of the ResCareQA, and later to develop thresholds of quality. To analyse its psychometric properties, ResCareQA forms were completed for all residents (N=498) of nine aged care facilities throughout Queensland. Kappa statistics were used to assess inter-rater and test-retest reliability, and Cronbach.s alpha coefficient calculated to determine internal consistency. For concurrent validity, equivalent items on the ResCareQA and the Resident Classification Scales (RCS) were compared using Spearman.s rank order correlations, while discriminative validity was assessed using known-groups technique, comparing ResCareQA results between groups with differing care needs, as well as between male and female residents. Rank-ordered facility results for each clinical care indicator (CCI) were circulated to the panel; upper and lower thresholds for each CCI were nominated by panel members and refined through a Delphi process. These thresholds indicate excellent care at one extreme and questionable care at the other. Results: Minor modifications were made to the assessment, and it was renamed the ResCareQA. Agreement on its content was reached after two Delphi rounds; the final version contains 24 questions across four domains, enabling generation of 36 CCIs. Both test-retest and inter-rater reliability were sound with median kappa values of 0.74 (test-retest) and 0.91 (inter-rater); internal consistency was not as strong, with a Chronbach.s alpha of 0.46. Because the ResCareQA does not provide a single combined score, comparisons for concurrent validity were made with the RCS on an item by item basis, with most resultant correlations being quite low. Discriminative validity analyses, however, revealed highly significant differences in total number of CCIs between high care and low care groups (t199=10.77, p=0.000), while the differences between male and female residents were not significant (t414=0.56, p=0.58). Clinical outcomes varied both within and between facilities; agreed upper and lower thresholds were finalised after three Delphi rounds. Conclusions: The ResCareQA provides a comprehensive, easily administered means of monitoring quality in residential aged care facilities that can be reliably used on multiple occasions. The relatively modest internal consistency score was likely due to the multi-factorial nature of quality, and the absence of an aggregate result for the assessment. Measurement of concurrent validity proved difficult in the absence of a gold standard, but the sound discriminative validity results suggest that the ResCareQA has acceptable validity and could be confidently used as an indication of care quality within Australian residential aged care facilities. The thresholds, while preliminary due to small sample size, enable users to make judgements about quality within and between facilities. Thus it is recommended the ResCareQA be adopted for wider use.

Human resource flexibility and strong ties in entrepreneurial teams

Human resource flexibility is important in entrepreneurial ventures that need to respond to the changing challenges of growing the new business. This research investigates the impact of previously well-known people (strong ties) as entrepreneurial team members on the human resource flexibility of new ventures. Data collected from German founding entrepreneurs in technology-oriented, incubator-based firms shows that choosing a well known individual to join the entrepreneurial team increases the founder's ability to modify the team member's work role, but complicates asking the team member to leave the team if required. Hence, strong ties both increase and reduce human resource flexibility. However, the effect of strong ties on role modifiability is statistically significant only with novice entrepreneurs. These research findings counsel founders to discuss role modification and exit during partnership and entrepreneurial team membership negotiations.

The Blair Witch Project : Forming strong attitudes, beliefs and consumer intentions from a myth

This brief consumer marketing case study was published in a consumer marketing text book.

Spatial population genetic structure reveals strong natal site fidelity in Echinocladius martini (Diptera: Chironomidae) in northeast Queensland, Australia

1. A diverse array of patterns has been reported regarding the spatial extent of population genetic structure and effective dispersal in freshwater macroinvertebrates. In river systems, the movements of many taxa can be restricted to varying degrees by the natural stream channel hierarchy. 2. In this study, we sampled populations of the non-biting freshwater midge Echinocladius martini in the Paluma bioregion of tropical northeast Queensland to investigate fine scale patterns of within- and among-stream dispersal and gene flow within a purported historical refuge. We amplified a 639 bp fragment of mitochondrial COI and analysed genetic structure using pairwise ΦST, hierarchical AMOVA, Mantel tests and a parsimony network. Genetic variation was partitioned among stream sections using Streamtree to investigate the effect of potential instream dispersal barriers. 3. The data revealed strong natal site fidelity and significant differentiation among neighbouring, geographically proximate streams. We found evidence for only episodic adult flight among sites on separate stream reaches. Overall, however, our data suggested that both larval and adult dispersal was largely limited to within a stream channel. 4. This may arise from a combination of the high density of riparian vegetation physically restricting dispersal and from the joint effects of habitat stability and large population sizes. Together these may mitigate the requirement for movement among streams to avoid inbreeding and local extinction due to habitat change and may thus enable persistence of upstream populations in the absence of regular compensatory upstream flight. Taken together, these data suggest that dispersal of E. martini is highly restricted, to the scale of only a few kilometres, and hence occurs predominantly within the natal stream.

Crystal growth from undercooling melts under strong gradients of temperatures generating in short-duration microgravity

Crystal growth of bulk CdTe in short-duration microgravity is performed by the unidirectional cooling method. The largest growth grains in microgravity samples are 4X2mm. The cooling profiles indicate undercooling melts in microgravity. Cooling melt samples in microgravity generate strong gradient of temperature due to stop thermal convections. Temperature distribution in the melt is calculated by the one-dimensional equation of heat conduction, and about 100 K-undercooling is considered to occur at the cooling surface.

Moderation and consistency of teacher judgement : teachers’ views

Major curriculum and assessment reforms in Australia have generated research interest in issues related to standards, teacher judgement and moderation. This article is based on one related inquiry of a large-scale Australian Research Council Linkage project conducted in Queensland. This qualitative study analysed interview data to identify teachers’ views on standards and moderation as a means to achieving consistency of teacher judgement. A complementary aspect of the research involved a blind review that was conducted to determine the degree of teacher consistency without the experience of moderation. Empirical evidence was gained that most teachers, of the total interviewed, articulated a positive attitude towards the use of standards in moderation and perceived that this process produces consistency in teachers’ judgements. Context was identified as an important influential factor in teachers’ judgements and it was concluded that teachers’ assessment beliefs, attitudes and practices impact on their perceptions of the value of moderation practice and the extent to which consistency can be achieved.

On the consistency of multiclass classification methods

Binary classification methods can be generalized in many ways to handle multiple classes. It turns out that not all generalizations preserve the nice property of Bayes consistency. We provide a necessary and sufficient condition for consistency which applies to a large class of multiclass classification methods. The approach is illustrated by applying it to some multiclass methods proposed in the literature.