Assessing L2 task performance: understanding effects of task design

The overarching aim of the research reported here was to investigate the effects of task structure and storyline complexity of oral narrative tasks on second language task performance. Participants were 60 Iranian language learners of English who performed six narrative tasks of varying degree of structure and storyline complexity in an assessment setting. A number of analytic detailed measures were employed to examine whether there were any differences in the participants’ performances elicited by the different tasks in terms of their accuracy, fluency, syntactic complexity and lexical diversity. Results of the data analysis showed that performance in the more structured tasks was more accurate and to a great extent more fluent than that in the less structured tasks. The results further revealed that syntactic complexity of L2 performance was related to the storyline complexity, i.e. more syntactic complexity was associated with narratives that had both foreground and background storylines. These findings strongly suggest that there is some unsystematic variance in the participants’ performance triggered by the different aspects of task design.

Task design and second language performance: the effect of narrative type on learner output

This article reports on a detailed empirical study of the way narrative task design influences the oral performance of second-language (L2) learners. Building on previous research findings, two dimensions of narrative design were chosen for investigation: narrative complexity and inherent narrative structure. Narrative complexity refers to the presence of simultaneous storylines; in this case, we compared single-story narratives with dual-story narratives. Inherent narrative structure refers to the order of events in a narrative; we compared narratives where this was fixed to others where the events could be reordered without loss of coherence. Additionally, we explored the influence of learning context on performance by gathering data from two comparable groups of participants: 60 learners in a foreign language context in Teheran and 40 in an L2 context in London. All participants recounted two of four narratives from cartoon pictures prompts, giving a between-subjects design for narrative complexity and a within-subjects design for inherent narrative structure. The results show clearly that for both groups, L2 performance was affected by the design of the task: Syntactic complexity was supported by narrative storyline complexity and grammatical accuracy was supported by an inherently fixed narrative structure. We reason that the task of recounting simultaneous events leads learners into attempting more hypotactic language, such as subordinate clauses that follow, for example, while, although, at the same time as, etc. We reason also that a tight narrative structure allows learners to achieve greater accuracy in the L2 (within minutes of performing less accurately on a loosely structured narrative) because the tight ordering of events releases attentional resources that would otherwise be spent on finding connections between the pictures. The learning context was shown to have no effect on either accuracy or fluency but an unexpectedly clear effect on syntactic complexity and lexical diversity. The learners in London seem to have benefited from being in the target language environment by developing not more accurate grammar but a more diverse resource of English words and syntactic choices. In a companion article (Foster & Tavakoli, 2009) we compared their performance with native-speaker baseline data and see that, in terms of nativelike selection of vocabulary and phrasing, the learners in London are closing in on native-speaker norms. The study provides empirical evidence that L2 performance is affected by task design in predictable ways. It also shows that living within the target language environment, and presumably using the L2 in a host of everyday tasks outside the classroom, confers a distinct lexical advantage, not a grammatical one.

Task design and second language performance: the effect of narrative type on learner output

This article presents a study examining how narrative structure and narrative complexity might influence the performance of second language learners. Forty learners of English in London and sixty learners in Teheran were asked to retell cartoon stories from picture prompts. Each performed two of four narrative tasks that had different degrees of narrative structure (loose or tight) and of storyline complexity (with or without background events). Results support the findings of previous research that tight task structure is connected to increased accuracy and that narratives involving background information give rise to more complex syntax. A comparison of the data from the London and Teheran cohorts showed that the learners in London used significantly more complex syntax and diverse vocabulary even though they did not differ from the Teheran learners in other performance dimensions.

Task design and interaction in collaborative writing: the students’ story

This article investigates student behaviour on collaborative assignments, looking at the relationship between task type and interaction, and considers the implications for task design. Students reported on interactions in a year-long workplace-focussed group communication project, comparing these with interactions on other academy based group assignments. Differences were seen in the amount of brainstorming, the criteria for dividing up work, the intensity of editing, and how conflict was managed. Contributing factors to these differences included the presence or absence of a creative element, the instrumental nature of the task, and the need for a collective approach inherent in the task design.

GISQ, a multifunctional indicator of soil quality

We present here an indicator of soil quality that evaluates soil ecosystem services through a set of 5 subindicators, and further combines them into a single general Indicator of Soil Quality (GISQ). We used information derived from 54 properties commonly used to describe the multifaceted aspects of soil quality. The design and calculation of the indicators were based on sequences of multivariate analyses. Subindicators evaluated the physical quality, chemical fertility, organic matter stocks, aggregation and morphology of the upper 5 cm of soil and the biodiversity of soil macrofauna. A GISQ combined the different subindicators providing a global assessment of soil quality. Research was conducted in two hillside regions of Colombia and Nicaragua, with similar types of land use and socio-economic context. However, soil and climatic conditions differed significantly. In Nicaragua, soil quality was assessed at 61 points regularly distributed 200 m apart on a regular grid across the landscape. In Colombia, 8 plots representing different types of land use were arbitrarily chosen in the landscape and intensively sampled. Indicators that were designed in the Nicaragua site were further applied to the Colombian site to test for their applicability. In Nicaragua, coffee plantations, fallows, pastures and forest had the highest values of GISQ (1.00; 0.80; 0.78 and 0.77, respectively) while maize crops and eroded soils (0.19 and 0.10) had the lowest values. Examination of subindicator values allowed the separate evaluation of different aspects of soil quality: subindicators of organic matter, aggregation and morphology and biodiversity of macrofauna had the maximum values in coffee plantations (0.89; 0.72 and 0.56, respectively on average) while eroded soils had the lowest values for these indicators (0.10; 0.31 and 0.33, respectively). Indicator formulae derived from information gained at the Nicaraguan sites were not applicable to the Colombian situation and site-specific constants were calculated. This indicator allows the evaluation of soil quality and facilitates the identification of problem areas through the individual values of each subindicator. It allows monitoring of change through time and can guide the implementation of soil restoration technologies. Although GISQ formulae computed on a set of data were only valid at a regional scale, the methodology used to create these indices can be applied everywhere.

Strategies to prevent falls and fractures in hospitals and care homes and effect of cognitive impairment: systematic review and meta-analyses

OBJECTIVES: To evaluate the evidence for strategies to prevent falls or fractures in residents in care homes and hospital inpatients and to investigate the effect of dementia and cognitive impairment. DESIGN: Systematic review and meta-analyses of studies grouped by intervention and setting (hospital or care home). Meta-regression to investigate the effects of dementia and of study quality and design. DATA SOURCES: Medline, CINAHL, Embase, PsychInfo, Cochrane Database, Clinical Trials Register, and hand searching of references from reviews and guidelines to January 2005. RESULTS: 1207 references were identified, including 115 systematic reviews, expert reviews, or guidelines. Of the 92 full papers inspected, 43 were included. Meta-analysis for multifaceted interventions in hospital (13 studies) showed a rate ratio of 0.82 (95% confidence interval 0.68 to 0.997) for falls but no significant effect on the number of fallers or fractures. For hip protectors in care homes (11 studies) the rate ratio for hip fractures was 0.67 (0.46 to 0.98), but there was no significant effect on falls and not enough studies on fallers. For all other interventions (multifaceted interventions in care homes; removal of physical restraints in either setting; fall alarm devices in either setting; exercise in care homes; calcium/vitamin D in care homes; changes in the physical environment in either setting; medication review in hospital) meta-analysis was either unsuitable because of insufficient studies or showed no significant effect on falls, fallers, or fractures, despite strongly positive results in some individual studies. Meta-regression showed no significant association between effect size and prevalence of dementia or cognitive impairment. CONCLUSION: There is some evidence that multifaceted interventions in hospital reduce the number of falls and that use of hip protectors in care homes prevents hip fractures. There is insufficient evidence, however, for the effectiveness of other single interventions in hospitals or care homes or multifaceted interventions in care homes.

Standardization of procurement: National or international?

The ISO has issued a Draft International Standard on construction procurement and the British Standards Institute is drafting a standard based upon this for use in the UK. Three questions arise from these observations. First, what kind of consultation processes would be adequate to ensure that such a standard meets the requirements of an industry as diverse as construction? Second, why would an international standard be inappropriate for use in a country like UK? Third, what sort of issues should such a standard seek to cover? There are strong precedents for process standards, such as quality assurance, design management and workmanship on building sites. So the idea of a standard on procurement is not unusual. Moreover, there are many differences in tendering and procurement practice that are wasteful and even collusive or illegal. These issues are explored with a view to offering insights and suggestions for guidance based on the experiences in UK. The research method is first-hand observation of the drafting committee who are dealing with the British Standard. As an example to test and inform the standardization concept, six different standard guidance documents on tendering procedures are compared. This reveals a significant degree of diversity, and based on this, nine stages for implementing a tendering procedure are derived.

Marker placement to describe the wrist movements during activities of daily living in cyclical tasks

Objective. To describe the wrist kinematics during movement through free range of motion and activities of daily living using a cyclical task. Design. The wrist angles were initially calculated in a calibration trial and then in two selected activities of daily living (jar opening and carton pouring). Background. Existing studies which describe the wrist movement do not address the specific application of daily activities. Moreover, the data presented from subject to subject may differ simply because of the non-cyclical nature of the upper limbs movements. Methods. The coordinates of external markers attached to bone references on the forearm and dorsal side of the hand were obtained using an optical motion capture system. The wrist angles were derived from free motion trials and successively calculated in four healthy subjects for two specific cyclical daily activities (opening a jar and pouring from a carton). Results. The free motions trial highlighted the interaction between the wrist angles. Both the jar opening and the carton pouring activity showed a repetitive pattern for the three angles within the cycle length. In the jar-opening task, the standard deviation for the whole population was 10.8degrees for flexion-extension, 5.3degrees for radial-ulnar deviation and 10.4degrees for pronation-supination. In the carton-pouring task, the standard deviation for the whole population was 16.0degrees for flexion-extension, 3.4degrees for radial-ulnar deviation and 10.7degrees for pro nation-supination. Conclusion. Wrist kinematics in healthy subjects can be successfully described by the rotations about the axes of marker-defined coordinates systems during free range of motion and daily activities using cyclical tasks.

The development of time-based prospective memory in childhood: the role of working memory updating

This large-scale study examined the development of time-based prospective memory (PM) across childhood and the roles that working memory updating and time monitoring play in driving age effects in PM performance. One hundred and ninety-seven children aged 5 to 14 years completed a time-based PM task where working memory updating load was manipulated within individuals using a dual task design. Results revealed age-related increases in PM performance across childhood. Working memory updating load had a negative impact on PM performance and monitoring behavior in older children, but this effect was smaller in younger children. Moreover, the frequency as well as the pattern of time monitoring predicted children’s PM performance. Our interpretation of these results is that processes involved in children’s PM may show a qualitative shift over development from simple, nonstrategic monitoring behavior to more strategic monitoring based on internal temporal models that rely specifically on working memory updating resources. We discuss this interpretation with regard to possible trade-off effects in younger children as well as alternative accounts.

Exploring the role of design quality in the Building Schools for the Future programme

The Building Schools for the Future (BSF) programme represents the biggest single UK government investment in school buildings for more than 50 years. A key goal for BSF is to ensure that pupils learn in 21st-century facilities that are designed or redesigned to allow for educational transformation. This represents a major challenge to those involved in the design of schools. The paper explores the conceptualizations of design quality within the BSF programme. It draws on content analysis of influential reports on design published between 2000 and 2007 and interviews with key actors in the provision of schools. The means by which design quality has become defined and given importance within the programme through official documents is described and compared with the multiple understandings of design quality among key stakeholders. The findings portray the many challenges that practitioners face when operationalizing design quality in practice. The paper concludes with reflections on the inconsistencies between how design quality has been appropriated in the BSF programme and how it is interpreted and adopted in practice.