Assessment and curriculum reform in China : the college English test and tertiary English as a foreign language education.

Educational assessment was a worldwide commonplace practice in the last century. With the theoretical underpinnings of education shifting from behaviourism and social efficiency to constructivism and cognitive theories in the past two decades, the assessment theories and practices show a widespread changing movement. The emergent assessment paradigm, with a futurist perspective, indicates a deviation away from the prevailing large scale high-stakes standardised testing and an inclination towards classroom-based formative assessment. Innovations and reforms initiated in attempts to achieve better education outcomes for a sustainable future via more developed learning and assessment theories have included the 2007 College English Reform Program (CERP) in Chinese higher education context. This paper focuses on the College English Test (CET) - the national English as a Foreign Language (EFL) testing system for non-English majors at tertiary level in China. It seeks to explore the roles that the CET played in the past two College English curriculum reforms, and the new role that testing and assessment assumed in the newly launched reform. The paper holds that the CET was operationalised to uplift the standards. However, the extended use of this standardised testing system brings constraints as well as negative washback effects on the tertiary EFL education. Therefore in the newly launched reform -CERP, a new assessment model which combines summative and formative assessment approaches is proposed. The testing and assessment, assumed a new role - to engender desirable education outcomes. The question asked is: will the mixed approach to formative and summative assessment provide the intended cure to the agony that tertiary EFL education in China has long been suffering - spending much time, yet achieving little effects? The paper reports the progresses and challenges as informed by the available research literature, yet asserts a lot needs to be explored on the potential of the assessment mix in this examination tradition deep-rooted and examination-obsessed society.

Assessment policy change in relation to English language teaching and learning in China : a study of perspectives from two universities

In response to concerns about the quality of English Language Learning (ELL) education at tertiary level, the Chinese Ministry of Education (CMoE) launched the College English Reform Program (CERP) in 2004. By means of a press release (CMoE, 2005) and a guideline document titled College English Curriculum Requirements (CECR) (CMoE, 2007), the CERP proposed two major changes to the College English assessment policy, which were: (1) the shift to optional status for the compulsory external test, the College English Test Band 4 (CET4); and (2) the incorporation of formative assessment into the existing summative assessment framework. This study investigated the interactions between the College English assessment policy change, the theoretical underpinnings, and the assessment practices within two Chinese universities (one Key University and one Non-Key University). It adopted a sociocultural theoretical perspective to examine the implementation process as experienced by local actors of institutional and classroom levels. Systematic data analysis using a constant comparative method (Merriam, 1998) revealed that contextual factors and implementation issues did not lead to significant differences in the two cases. Lack of training in assessment and the sociocultural factors such as the traditional emphasis on the product of learning and hierarchical teacher/students relationship are decisive and responsible for the limited effect of the reform.

A comparison of international occupational therapy competencies : implications for Australian standards in the new millennium

Background/aim: A timely evaluation of the Australian Competency Standards for Entry-Level Occupational Therapists© (1994) was conducted. This thorough investigation comprised a literature review exploring the concept of competence and the applications of competency standards; systematic benchmarking of the Australian Occupational Therapy Competency Standards (OT AUSTRALIA, 1994) against other national and international competency standards and other affiliated documents, from occupational therapy and other cognate disciplines; and extensive nationwide consultation with the professional community. This paper explores and examines the similarities and disparities between occupational therapy competency standards documents available in English from Australia and other countries.----- Methods: An online search for national occupational therapy competency standards located 10 documents, including the Australian competencies.----- Results: Four 'frameworks' were created to categorise the documents according to their conceptual underpinnings: Technical-Prescriptive, Enabling, Educational and Meta-Cognitive. Other characteristics that appeared to impact the design, content and implementation of competency standards, including definitions of key concepts, authorship, national and cultural priorities, scope of services, intended use and review mechanisms, were revealed.----- Conclusion: The proposed 'frameworks' and identification of influential characteristics provided a 'lens' through which to understand and evaluate competency standards. While consistent application of and attention to some of these characteristics appear to consolidate and affirm the authority of competency standards, it is suggested that the national context should be a critical determinant of the design and content of the final document. The Australian Occupational Therapy Competency Standards (OT AUSTRALIA, 1994) are critiqued accordingly, and preliminary recommendations for revision are proposed.

A voting mechanism for named entity translation in English-Chinese question answering

In this paper, we describe a voting mechanism for accurate named entity (NE) translation in English–Chinese question answering (QA). This mechanism involves translations from three different sources: machine translation,online encyclopaedia, and web documents. The translation with the highest number of votes is selected. We evaluated this approach using test collection, topics and assessment results from the NTCIR-8 evaluation forum. This mechanism achieved 95% accuracy in NEs translation and 0.3756 MAP in English–Chinese cross-lingual information retrieval of QA.

Metacognitive strategy instruction in English as Foreign Language (EFL) listening skill

Listening skill is a critical part of language learning in general, and second, and foreign language learning, in particular. However, the process of this basic skill has been overlooked compared to other skills such as speaking, reading and writing, in terms of an explicit instruction, and the product of listening is instead mainly tested indirectly through comprehension questions in classrooms. Instruction of metacognitive strategies demonstrates the pivotal impact on second language listening skill development. In this vein, this study used a mixed method with an experimental male group (N = 30) listened to texts using process-approach pedagogy directed students through metacognitive strategies over a semester (10 weeks) in Iran. To investigate the impact of metacognitive strategy instruction, the following approaches were implemented. First, IELTS listening test was used to track any development of listening comprehension. Second, using Vandergrift et al. (2006) Metacognitive Awareness Listening Questionnaire (MALQ) helped examine students’ use of metacognitive strategies in listening comprehension. Finally, interviews were used to examine students’ use of strategies in listening. The results showed that students had a development in comprehension of IELTS listening test, but no statistical significant development of metacognitive awareness in listening was demonstrated. Students and teacher reported in the interviews students used multiple strategies to approach listening comprehension besides metacognitive strategies.

Metacognitive strategy instruction in English as a Foreign Language (EFL) listening skill

Listening skill is allocated inadequate consideration in English language instruction and learning in Iran. At the school level, listening skill is not taught but reading and writing skills are taught traditionally. At the college level, reading skill is emphasised. For students seeking IELTS certification, institutes teach listening skill within the framework of a Communicative Language Teaching (CLT) approach. Nonetheless, despite the official syllabus, many teachers tend to test rather than teach listening skill. Currently, listening skill in the curriculum is embedded in an oral comprehension teaching approach through multiple choice written responses in the institutes. Therefore, the process of explicitly teaching listening is overlooked with a strong emphasis on the post hoc assessment of the products of listening. This study used a mixed methods approach to investigate the relationship between metacognitive strategy instruction and listening performance, metacognitive awareness and use of metacognitive strategies in listening. Three research questions were addressed in this study: - Is there a relationship between metacognitive strategy instruction (planning, monitoring and evaluation) and Iranian High Intermediate students¡¦ listening? „ - Is there a relationship between metacognitive strategy instruction and Iranian High Intermediate students¡¦ metacognitive awareness of listening? - Does metacognitive strategy instruction help Iranian High Intermediate students¡¦ use of metacognitive strategies during listening? A single group (N = 30) of High Intermediate level tertiary students in Iran were guided through a metacognitive strategy instruction over one semester (10 weeks). The first research question was measured through IELTS listening tests, which tracked any change of students’ listening performance. The second research question was analysed through results of a Metacognitive Awareness Listening Questionnaire (MALQ) to survey students’ awareness of metacognitive strategies in listening. Finally, the third research question was analysed through interviews, which explored students’ use of metacognitive strategies in listening. Results indicate that High Intermediate students developed listening performance, but there were no significant changes in metacognitive awareness in listening. Students reported in the interviews that they used multiple strategies (cognitive and metacognitive) to approach listening. Implications for English teaching in Iran and other contexts are discussed.

'Explain in plain English' questions revisited : data structures problems

Recent studies have linked the ability of novice (CS1) programmers to read and explain code with their ability to write code. This study extends earlier work by asking CS2 students to explain object-oriented data structures problems that involve recursion. Results show a strong correlation between ability to explain code at an abstract level and performance on code writing and code reading test problems for these object-oriented data structures problems. The authors postulate that there is a common set of skills concerned with reasoning about programs that explains the correlation between writing code and explaining code. The authors suggest that an overly exclusive emphasis on code writing may be detrimental to learning to program. Non-code writing learning activities (e.g., reading and explaining code) are likely to improve student ability to reason about code and, by extension, improve student ability to write code. A judicious mix of code-writing and code-reading activities is recommended.

Satisfaction with emergency department service among non-English-speaking background patients

Objective: The present study aims to investigate non-English-speaking background (NESB) patients’ satisfaction with hospital ED service and compare it with that of English-speaking background (ESB) patients. Methods: A cross-sectional survey was conducted at the ED of an adult tertiary referral hospital in Queensland, Australia. Patients assigned an Australasian Triage Scale score of 3, 4 or 5 were surveyed in the ED, before and after their ED service. Pearson χ2- test and multivariate logistic regression analyses were performed to examine the differences between the ESB and NESB groups in terms of patient-reported satisfaction. Results: In total, 828 patients participated in the present study. Although the overall satisfaction with the service was high – 95.1% (ESB) and 90.5% (NESB) – the NESB patients who did not use an interpreter were less satisfied with their ED service than the ESB patients (odds ratio 0.5, 95% confidence interval 0.3–0.8, P = 0.013). The promptness of service received the lowest satisfaction rates (ESB 85.4% [82.4–88.0], NESB 74.5% [68.5– 79.7], P < 0.001), whereas courtesy and friendliness received the highest satisfaction rates (ESB 98.8 [97.6–99.4], NESB 97.0 [93.9–98.5], P = 0.063). All participants reported the promptness of service (33.5%), quality and professional care (18.5%) and communication (17.6%) as the most important elements of ED service. Conclusion: The NESB patients were significantly less satisfied than the ESB patients with the ED service. Use of an interpreter improved the NESB patients’ level of satisfaction. Further research is required to examine what NESB patients’ expectations of ED service are.

Exploring and validating the internal dimensions of occupational stress: Evidence from construction cost estimators in China

A recurring feature of modern practice is occupational stress of project professionals, with both debilitating effects on the people concerned and indirectly affecting project success. Previous research outside the construction industry has involved the use of a psychology perceived stress questionnaire (PSQ) to measure occupational stress, resulting in the identification of one stressor – demand - and three sub-dimensional emotional reactions in terms of worry, tension and joy. The PSQ is translated into Chinese with a back translation technique and used in a survey of young construction cost professionals in China. Principal component analysis and confirmatory factor analysis are used to test the divisibility of occupational stress - little mentioned in previous research on stress in the construction context. In addition, structural equation modelling is used to assess nomological validity by testing the effects of the three dimensions on organizational commitment, the main finding of which is that lack of joy has the sole significant effect. The three-dimensional measurement framework facilitates the standardizing measurement of occupational stress. Further research will establish if the findings are also applicable in other settings and explore the relations between stress dimensions and other managerial concepts.

Validation and reliability of a Spanish version of Simple Shoulder Test (SST-Sp)

Background: The Simple Shoulder Test (SST-Sp) is a widely used outcome measure. Objective: The purpose of this study was to develop and validate a Spanish-version SST (SST-Sp). Methods: A two-stage observational study was conducted. The SST was initially cross-culturally adapted to Spanish through double forward and backward translation and then validated for its psychometric characteristics. Participants (n = 66) with several shoulder disorders completed the SST-Sp, DASH, VAS and SF-12. The full sample was employed to determine factor structure, internal consistency and concurrent criterion validity. Reliability was determined in the first 24–48 h in a subsample of 21 patients. Results: The SST-Sp showed three factors that explained the 56.1 % of variance, and the internal consistency for each factor was α = 0.738, 0.723 and 0.667, and reliability was ICC = 0.687–0.944. The factor structure was three-dimensional and supported construct validity. Criterion validity determined from the relationship between the SST-Sp and DASH was strong (r = −0.73; p < 0.001) and fair for VAS (r = −0.537; p < 0.001). Relationships between SST-Sp and SF-12 were weak for both physical (r = −0.47; p < 0.001) and mental (r = −0.43; p < 0.001) dimensions. Conclusions: The SST-Sp supports the findings of the original English version as being a valid shoulder outcome measure with similar psychometric properties to the original English version.