UNDERSTANDING ESSAY RATING AS A SOCIALLY MEDIATED ACTIVITY: THE CASE OF A HIGH-STAKES ENGLISH TEST IN CHINA

Most essay rating research in language assessment has examined human raters’ essay rating as a cognitive process, thus overlooking or oversimplifying the interaction between raters and sociocultural contexts. Given that raters are social beings, their practices have social meanings and consequences. Hence it is important to situate essay rating within its sociocultural context for a more meaningful understanding. Drawing on Engeström’s (1987, 2001) cultural-historical activity theory (CHAT) framework with a sociocultural perspective, this study reconceptualized essay rating as a socially mediated activity with both cognitive (individual raters’ goal-directed decision-making actions) and social layers (raters’ collective object-oriented essay rating activity at related settings). In particular, this study explored raters’ essay rating at one provincial rating centre in China within the context of a high-stakes university entrance examination, the National Matriculation English Test (NMET). This study adopted a multiple-method multiple-perspective qualitative case study design. Think-aloud protocols, stimulated recalls, interviews, and documents served as the data sources. This investigation involved 25 participants at two settings (rating centre and high schools), including rating centre directors, team leaders, NMET essay raters who were high school teachers, and school principals and teaching colleagues of these essay raters. Data were analyzed using Strauss and Corbin’s (1990) open and axial coding techniques, and CHAT for data integration. The findings revealed the interaction between raters and the NMET sociocultural context. Such interaction can be understood through a surface structure (cognitive layer) and a deep structure (social layer) concerning how raters assessed NMET essays, where the surface structure reflected the “what” and the deep structure explained the “how” and “why” in raters’ decision-making. This study highlighted the roles of goals and rules in rater decision-making, rating tensions and raters’ solutions, and the relationship between essay rating and teaching. This study highlights the value of a sociocultural view to essay rating research, demonstrates CHAT as a sociocultural approach to investigate essay rating, and proposes a direction for future washback research on the effect of essay rating. This study also provides support for NMET rating practices that can potentially bring positive washback to English teaching in Chinese high schools.

An Examination of Current Approaches to Integrative Indigenous and Western Knowledge System Implementation in Water Research and Management: A Case Study Encompassing the Colonized Geographies of Canada, Australia, New Zealand, and the United States

The commodification of natural resources and the pursuit of continuous growth has resulted in environmental degradation, depletion, and disparity in access to these life-sustaining resources, including water. Utility-based objectification and exploitation of water in some societies has brought us to the brink of crisis through an apathetic disregard for present and future generations. The ongoing depletion and degradation of the world’s water sources, coupled with a reliance on Western knowledge and the continued omission of Indigenous knowledge to manage our relationship with water has unduly burdened many, but particularly so for Indigenous communities. The goal of my thesis research is to call attention to and advance the value and validity of using both Indigenous and Western knowledge systems (also known as Two-Eyed Seeing) in water research and management to better care for water. To achieve this goal, I used a combined systematic and realist review method to identify and synthesize the peer-reviewed, integrative water literature, followed by semi-structured interviews with first authors of the exemplars from the included literature to identify the challenges and insights that researchers have experienced in conducting integrative water research. Findings suggest that these authors recognize that many previous attempts to integrate Indigenous knowledges have been tokenistic rather than meaningful, and that new methods for knowledge implementation are needed. Community-based participatory research methods, and the associated tenets of balancing power, fostering trust, and community ownership over the research process, emerged as a pathway towards the meaningful implementation of Indigenous and Western knowledge systems. Data also indicate that engagement and collaborative governance structures developed from a position of mutual respect are integral to the realization of a given project. The recommendations generated from these findings offer support for future Indigenous-led research and partnerships through the identification and examination of approaches that facilitate the meaningful implementation of Indigenous and Western knowledge systems in water research and management. Asking Western science questions and seeking Indigenous science solutions does not appear to be working; instead, the co-design of research projects and asking questions directed at the problem rather than the solution better lends itself to the strengths of Indigenous science.