UNDERSTANDING ESSAY RATING AS A SOCIALLY MEDIATED ACTIVITY: THE CASE OF A HIGH-STAKES ENGLISH TEST IN CHINA

Most essay rating research in language assessment has examined human raters’ essay rating as a cognitive process, thus overlooking or oversimplifying the interaction between raters and sociocultural contexts. Given that raters are social beings, their practices have social meanings and consequences. Hence it is important to situate essay rating within its sociocultural context for a more meaningful understanding. Drawing on Engeström’s (1987, 2001) cultural-historical activity theory (CHAT) framework with a sociocultural perspective, this study reconceptualized essay rating as a socially mediated activity with both cognitive (individual raters’ goal-directed decision-making actions) and social layers (raters’ collective object-oriented essay rating activity at related settings). In particular, this study explored raters’ essay rating at one provincial rating centre in China within the context of a high-stakes university entrance examination, the National Matriculation English Test (NMET). This study adopted a multiple-method multiple-perspective qualitative case study design. Think-aloud protocols, stimulated recalls, interviews, and documents served as the data sources. This investigation involved 25 participants at two settings (rating centre and high schools), including rating centre directors, team leaders, NMET essay raters who were high school teachers, and school principals and teaching colleagues of these essay raters. Data were analyzed using Strauss and Corbin’s (1990) open and axial coding techniques, and CHAT for data integration. The findings revealed the interaction between raters and the NMET sociocultural context. Such interaction can be understood through a surface structure (cognitive layer) and a deep structure (social layer) concerning how raters assessed NMET essays, where the surface structure reflected the “what” and the deep structure explained the “how” and “why” in raters’ decision-making. This study highlighted the roles of goals and rules in rater decision-making, rating tensions and raters’ solutions, and the relationship between essay rating and teaching. This study highlights the value of a sociocultural view to essay rating research, demonstrates CHAT as a sociocultural approach to investigate essay rating, and proposes a direction for future washback research on the effect of essay rating. This study also provides support for NMET rating practices that can potentially bring positive washback to English teaching in Chinese high schools.

THE EFFECT OF PURPOSEFUL MATHEMATICS DISCOURSE IN THE CLASSROOM ON STUDENTS’ MATHEMATICS LANGUAGE IN THE CONTEXT OF PROBLEM SOLVING

This study examines how one secondary school teacher’s use of purposeful oral mathematics language impacted her students’ language use and overall communication in written solutions while working with word problems in a grade nine academic mathematics class. Mathematics is often described as a distinct language. As with all languages, students must develop a sense for oral language before developing social practices such as listening, respecting others ideas, and writing. Effective writing is often seen by students that have strong oral language skills. Classroom observations, teacher and student interviews, and collected student work served as evidence to demonstrate the nature of both the teacher’s and the students’ use of oral mathematical language in the classroom, as well as the effect the discourse and language use had on students’ individual written solutions while working on word problems. Inductive coding for themes revealed that the teacher’s purposeful use of oral mathematical language had a positive impact on students’ written solutions. The teacher’s development of a mathematical discourse community created a space for the students to explore mathematical language and concepts that facilitated a deeper level of conceptual understanding of the learned material. The teacher’s oral language appeared to transfer into students written work albeit not with the same complexity of use of the teacher’s oral expression of the mathematical register. Students that learn mathematical language and concepts better appear to have a growth mindset, feel they have ownership over their learning, use reorganizational strategies, and help develop a discourse community.