UNDERSTANDING ESSAY RATING AS A SOCIALLY MEDIATED ACTIVITY: THE CASE OF A HIGH-STAKES ENGLISH TEST IN CHINA

Most essay rating research in language assessment has examined human raters’ essay rating as a cognitive process, thus overlooking or oversimplifying the interaction between raters and sociocultural contexts. Given that raters are social beings, their practices have social meanings and consequences. Hence it is important to situate essay rating within its sociocultural context for a more meaningful understanding. Drawing on Engeström’s (1987, 2001) cultural-historical activity theory (CHAT) framework with a sociocultural perspective, this study reconceptualized essay rating as a socially mediated activity with both cognitive (individual raters’ goal-directed decision-making actions) and social layers (raters’ collective object-oriented essay rating activity at related settings). In particular, this study explored raters’ essay rating at one provincial rating centre in China within the context of a high-stakes university entrance examination, the National Matriculation English Test (NMET). This study adopted a multiple-method multiple-perspective qualitative case study design. Think-aloud protocols, stimulated recalls, interviews, and documents served as the data sources. This investigation involved 25 participants at two settings (rating centre and high schools), including rating centre directors, team leaders, NMET essay raters who were high school teachers, and school principals and teaching colleagues of these essay raters. Data were analyzed using Strauss and Corbin’s (1990) open and axial coding techniques, and CHAT for data integration. The findings revealed the interaction between raters and the NMET sociocultural context. Such interaction can be understood through a surface structure (cognitive layer) and a deep structure (social layer) concerning how raters assessed NMET essays, where the surface structure reflected the “what” and the deep structure explained the “how” and “why” in raters’ decision-making. This study highlighted the roles of goals and rules in rater decision-making, rating tensions and raters’ solutions, and the relationship between essay rating and teaching. This study highlights the value of a sociocultural view to essay rating research, demonstrates CHAT as a sociocultural approach to investigate essay rating, and proposes a direction for future washback research on the effect of essay rating. This study also provides support for NMET rating practices that can potentially bring positive washback to English teaching in Chinese high schools.

EDUCATING THE PUBLIC THROUGH NEWS MEDIA: CASE STUDIES OF NEWS LITERACY IN THE NEW MEDIA LANDSCAPE

Two decades of unprecedented changes in the media landscape have increased the complexity of informing the public through news media. With significant changes to the way the news industry does business and the way news consumers access this information, a new set of skills is being proposed as essential for today’s news consumer. News literacy is the use of critical thinking skills to assess the reliability and source of the information that people consume on a daily basis, as well as fostering self-awareness of personal news consumption habits and how it can create audience bias. The purpose of this study was to examine how adults experience the news in their everyday lives and to describe the nature of the news literacy skills people employ in their daily news consumption. This study purposefully selected four adults who have completed high school, and who regularly consume news information across a number of platforms, both traditional and digital. Two of the participants, one man and one woman, were over 50 years old. One other male participant was in his 30’s and the final participant, a young woman, was in her 20’s. They all utilized both traditional and digital media on a regular basis and all had differing skill levels when using social media for information. Their news experiences were documented by in-depth interviews and the completion of seven daily news logs. In their daily logs the participants differentiated news information from other information available on-line but the interviews revealed a contradiction between their intentions and their news consumption practices. All four participants had trouble distinguishing between news and opinion pieces in the news information realm. In addition all but one seemed unaware of their personal bias and any possible effect it was having on their news consumption. Further research should explore the benefits of an adult-centered news literacy curriculum on news consumers similar to the participants, and should examine the development of audience bias and its relationship to the daily exposure people have to the torrent of information that is available to them on a daily basis.