UNDERSTANDING ESSAY RATING AS A SOCIALLY MEDIATED ACTIVITY: THE CASE OF A HIGH-STAKES ENGLISH TEST IN CHINA

Most essay rating research in language assessment has examined human raters’ essay rating as a cognitive process, thus overlooking or oversimplifying the interaction between raters and sociocultural contexts. Given that raters are social beings, their practices have social meanings and consequences. Hence it is important to situate essay rating within its sociocultural context for a more meaningful understanding. Drawing on Engeström’s (1987, 2001) cultural-historical activity theory (CHAT) framework with a sociocultural perspective, this study reconceptualized essay rating as a socially mediated activity with both cognitive (individual raters’ goal-directed decision-making actions) and social layers (raters’ collective object-oriented essay rating activity at related settings). In particular, this study explored raters’ essay rating at one provincial rating centre in China within the context of a high-stakes university entrance examination, the National Matriculation English Test (NMET). This study adopted a multiple-method multiple-perspective qualitative case study design. Think-aloud protocols, stimulated recalls, interviews, and documents served as the data sources. This investigation involved 25 participants at two settings (rating centre and high schools), including rating centre directors, team leaders, NMET essay raters who were high school teachers, and school principals and teaching colleagues of these essay raters. Data were analyzed using Strauss and Corbin’s (1990) open and axial coding techniques, and CHAT for data integration. The findings revealed the interaction between raters and the NMET sociocultural context. Such interaction can be understood through a surface structure (cognitive layer) and a deep structure (social layer) concerning how raters assessed NMET essays, where the surface structure reflected the “what” and the deep structure explained the “how” and “why” in raters’ decision-making. This study highlighted the roles of goals and rules in rater decision-making, rating tensions and raters’ solutions, and the relationship between essay rating and teaching. This study highlights the value of a sociocultural view to essay rating research, demonstrates CHAT as a sociocultural approach to investigate essay rating, and proposes a direction for future washback research on the effect of essay rating. This study also provides support for NMET rating practices that can potentially bring positive washback to English teaching in Chinese high schools.

UNDERSTANDING ESSAY RATING AS A SOCIALLY MEDIATED ACTIVITY: THE CASE OF A HIGH-STAKES ENGLISH TEST IN CHINA

Thesis (Ph.D, Education) -- Queen's University, 2016-09-22 22:05:24.246

Subtropical subdivisions : toward a lot-rating methodology for subtropical climates

What role can climatically appropriate subdivision design play in decreasing the use of energy required to cool premises by maximising access to natural ventilation? How can this design be achieved? The subdivision design stage is critical to urban and suburban sustainability outcomes, as significant changes after development are constrained by the configuration of the subdivision, and then by the construction of the dwellings. Existing Australian lot rating methodologies for energy efficiency, such as that by the Sustainable Energy Development Authority (SEDA), focus on reducing heating needs by increasing solar access, a key need in Australia’s temperate zone. A recent CRC CI project, Sustainable Subdivisions: Energy (Miller and Ambrose 2005) examined these guidelines to see if they could be adapted for use in subtropical South East Queensland (SEQ). Correlating the lot ratings with dwelling ratings, the project found that the SEDA guidelines would need to be modified for use to make allowance for natural ventilation. In SEQ, solar access for heating is less important than access to natural ventilation, and there is a need to reduce energy used to cool dwellings. In Queensland, the incidence of residential air-conditioning was predicted to reach 50 per cent by the end of 2005 (Mickel 2004). The CRC-CI, Sustainable Subdivisions: Ventilation Project (CRC-CI, in progress), aims to verify and quantify the role natural ventilation has in cooling residences in subtropical climates and develop a lot rating methodology for SEQ. This paper reviews results from an industry workshop that explored the current attitudes and methodologies used by a range of professionals involved in subdivision design and development in SEQ. Analysis of the workshop reveals that a key challenge for sustainability is that land development in subtropical SEQ is commonly a separate process from house design and siting. Finally, the paper highlights some of the issues that regulators and industry face in adopting a lot rating methodology for subdivisions offering improved ventilation access, including continuing disagreement between professionals over the desirability of rating tools.

Catalogue essay : a thin white line

Objects have consequences, seemingly. They move, atomic, formlessly – when static they are seen. That they vibrate constantly, that they are NOW present, is something we will have to trust the physicists on. They only seem here. Now is their moment of form, but later, who knows? Things SEEM when we recognise our own transience and temporary-ness. We call upon a bevy of senses that forever frustrate us with their limitation, despite our little understanding of what we actually have – is this here? So some forms seem to be telling us to trust our senses – that this world IS as it seems. Their form constantly refines and is refined and refined until in its essentialness it cannot be doubted – it absolutely IS. Is this our eyes? Can we only see it? But light is also a particle, if I remember correctly, so there is some weight to seeing. So to SEEM is also to FEEL,as this light imposes its visual weight upon our skins – we see with every pore of our body.

Reflection on the use of rating and score cards for asset and service assessment

The concept of star rating council facilities has progressively gained traction in Australia following the work of Dean Taylor at Marochy Shire Council in Queensland in 2006 – 2007 and more recently by the Victorian STEP asset management program. The following paper provides a brief discussion on the use and merits of star rating within community asset management. We suggest that the current adoption of the star rating system to manage community investment in services is lacking in consistency. It is suggested that the major failing is a lack of clear understanding in the purpose being served by the systems. The discussion goes on to make some recommendations on how the concept of a star system could be further enhanced to serve the needs of our communities better.

Description and evaluation of a Newton-based electronic appetite rating system for temporal tracking of appetite in human subjects

This study assessed the reliability and validity of a palm-top-based electronic appetite rating system (EARS) in relation to the traditional paper and pen method. Twenty healthy subjects [10 male (M) and 10 female (F)] — mean age M=31 years (S.D.=8), F=27 years (S.D.=5); mean BMI M=24 (S.D.=2), F=21 (S.D.=5) — participated in a 4-day protocol. Measurements were made on days 1 and 4. Subjects were given paper and an EARS to log hourly subjective motivation to eat during waking hours. Food intake and meal times were fixed. Subjects were given a maintenance diet (comprising 40% fat, 47% carbohydrate and 13% protein by energy) calculated at 1.6×Resting Metabolic Rate (RMR), as three isoenergetic meals. Bland and Altman's test for bias between two measurement techniques found significant differences between EARS and paper and pen for two of eight responses (hunger and fullness). Regression analysis confirmed that there were no day, sex or order effects between ratings obtained using either technique. For 15 subjects, there was no significant difference between results, with a linear relationship between the two methods that explained most of the variance (r2 ranged from 62.6 to 98.6). The slope for all subjects was less than 1, which was partly explained by a tendency for bias at the extreme end of results on the EARS technique. These data suggest that the EARS is a useful and reliable technique for real-time data collection in appetite research but that it should not be used interchangeably with paper and pen techniques.

Rating counselor - client behavior in online counseling: Development and preliminary psychometric properties of the Counseling Progress and Depth Rating Instrument

Although there are widely accepted and utilized models and frameworks for nondirective counseling (NDC), there is little in the way of tools or instruments designed to assist in determining whether or not a specific episode of counseling is consistent with the stated model or framework. The Counseling Progress and Depth Rating Instrument (CPDRI) was developed to evaluate counselor integrity in the use of Egan's skilled helper model in online counseling. The instrument was found to have sound internal consistency, good interrater reliability, and good face and convergent validity. The CPDRI is, therefore, proposed as a useful tool to facilitate investigation of the degree to which counselors adhere to and apply a widely used approach to NDC

The validation of the rating for subdivision neighbourhood sustainability design (RSNSD) In Bangkok Metropolitan Region (BMR), Thailand

In recent years, the problems resulting from unsustainable subdivision development have become significant problems in the Bangkok Metropolitan Region (BMR), Thailand. Numbers of government departments and agencies have tried to eliminate the problems by introducing the rating tools to encourage the higher sustainability levels of subdivision development in BMR, such as the Environmental Impact Assessment Monitoring Award (EIA-MA) and the Thai’s Rating for Energy and Environmental Sustainability of New construction and major renovation (TREES-NC). However, the EIA-MA has included the neighbourhood designs in the assessment criteria, but this requirement applies to large projects only. Meanwhile, TREES-NC has focused only on large scale buildings such as condominiums, office buildings, and is not specific for subdivision neighbourhood designs. Recently, the new rating tool named “Rating for Subdivision Neighbourhood Sustainability Design (RSNSD)” has been developed. Therefore, the validation process of RSNSD is still required. This paper aims to validate the new rating tool for subdivision neighbourhood design in BMR. The RSNSD has been validated by applying the rating tool to eight case study subdivisions. The result of RSNSD by data generated through surveying subdivisions will be compared to the existing results from the EIA-MA. The selected cases include of one “Excellent Award”, two “Very Good Award”, and five non-rated subdivision developments. This paper expects to prove the credibility of RSNSD before introducing to the real subdivision development practises. The RSNSD could be useful to encourage higher sustainability subdivision design level, and then protect the problems from further subdivision development in BMR.