UNDERSTANDING ESSAY RATING AS A SOCIALLY MEDIATED ACTIVITY: THE CASE OF A HIGH-STAKES ENGLISH TEST IN CHINA

Most essay rating research in language assessment has examined human raters’ essay rating as a cognitive process, thus overlooking or oversimplifying the interaction between raters and sociocultural contexts. Given that raters are social beings, their practices have social meanings and consequences. Hence it is important to situate essay rating within its sociocultural context for a more meaningful understanding. Drawing on Engeström’s (1987, 2001) cultural-historical activity theory (CHAT) framework with a sociocultural perspective, this study reconceptualized essay rating as a socially mediated activity with both cognitive (individual raters’ goal-directed decision-making actions) and social layers (raters’ collective object-oriented essay rating activity at related settings). In particular, this study explored raters’ essay rating at one provincial rating centre in China within the context of a high-stakes university entrance examination, the National Matriculation English Test (NMET). This study adopted a multiple-method multiple-perspective qualitative case study design. Think-aloud protocols, stimulated recalls, interviews, and documents served as the data sources. This investigation involved 25 participants at two settings (rating centre and high schools), including rating centre directors, team leaders, NMET essay raters who were high school teachers, and school principals and teaching colleagues of these essay raters. Data were analyzed using Strauss and Corbin’s (1990) open and axial coding techniques, and CHAT for data integration. The findings revealed the interaction between raters and the NMET sociocultural context. Such interaction can be understood through a surface structure (cognitive layer) and a deep structure (social layer) concerning how raters assessed NMET essays, where the surface structure reflected the “what” and the deep structure explained the “how” and “why” in raters’ decision-making. This study highlighted the roles of goals and rules in rater decision-making, rating tensions and raters’ solutions, and the relationship between essay rating and teaching. This study highlights the value of a sociocultural view to essay rating research, demonstrates CHAT as a sociocultural approach to investigate essay rating, and proposes a direction for future washback research on the effect of essay rating. This study also provides support for NMET rating practices that can potentially bring positive washback to English teaching in Chinese high schools.

Supporting Metacognitive Development in Early Science Education: Exploring Elementary Teachers' Beliefs and Practices in Metacognition

Metacognition is the understanding and control of cognitive processes. Students with high levels of metacognition achieve greater academic success. The purpose of this mixed-methods study was to examine elementary teachers’ beliefs about metacognition and integration of metacognitive practices in science. Forty-four teachers were recruited through professional networks to complete a questionnaire containing open-ended questions (n = 44) and Likert-type items (n = 41). Five respondents were selected to complete semi-structured interviews informed by the questionnaire. The selected interview participants had a minimum of three years teaching experience and demonstrated a conceptual understanding of metacognition. Statistical tests (Pearson correlation, t-tests, and multiple regression) on quantitative data and thematic analysis of qualitative data indicated that teachers largely understood metacognition but had some gaps in their understanding. Participants’ reported actions (teaching practices) and beliefs differed according to their years of experience but not gender. Hierarchical multiple regression demonstrated that the first block of gender and experience was not a significant predictor of teachers' metacognitive actions, although experience was a significant predictor by itself. Experience was not a significant predictor once teachers' beliefs were added. The majority of participants indicated that metacognition was indeed appropriate for elementary students. Participants consistently reiterated that students’ metacognition developed with practice, but required explicit instruction. A lack of consensus remained around the domain specificity of metacognition. More specifically, the majority of questionnaire respondents indicated that metacognitive strategies could not be used across subject domains, whereas all interviewees indicated that they used strategies across subjects. Metacognition was integrated frequently into Ontario elementary classrooms; however, metacognition was integrated less frequently in science lessons. Lastly, participants used a variety of techniques to integrate metacognition into their classrooms. Implications for practice include the need for more professional development aimed at integrating metacognition into science lessons at both the Primary and Junior levels. Further, teachers could benefit from additional clarification on the three main components of metacognition and the need to integrate all three to successfully develop students’ metacognition.