Assessing L2 task performance: understanding effects of task design

The overarching aim of the research reported here was to investigate the effects of task structure and storyline complexity of oral narrative tasks on second language task performance. Participants were 60 Iranian language learners of English who performed six narrative tasks of varying degree of structure and storyline complexity in an assessment setting. A number of analytic detailed measures were employed to examine whether there were any differences in the participants’ performances elicited by the different tasks in terms of their accuracy, fluency, syntactic complexity and lexical diversity. Results of the data analysis showed that performance in the more structured tasks was more accurate and to a great extent more fluent than that in the less structured tasks. The results further revealed that syntactic complexity of L2 performance was related to the storyline complexity, i.e. more syntactic complexity was associated with narratives that had both foreground and background storylines. These findings strongly suggest that there is some unsystematic variance in the participants’ performance triggered by the different aspects of task design.

Assessing the spatial and temporal variation in the skill of precipitation forecasts from an NWP model

It is becoming increasingly important to be able to verify the spatial accuracy of precipitation forecasts, especially with the advent of high-resolution numerical weather prediction (NWP) models. In this article, the fractions skill score (FSS) approach has been used to perform a scale-selective evaluation of precipitation forecasts during 2003 from the Met Office mesoscale model (12 km grid length). The investigation shows how skill varies with spatial scale, the scales over which the data assimilation (DA) adds most skill, and how the loss of that skill is dependent on both the spatial scale and the rainfall coverage being examined. Although these results come from a specific model, they demonstrate how this verification approach can provide a quantitative assessment of the spatial behaviour of new finer-resolution models and DA techniques.

A framework for assessing continuing professional development activities for satisfying pharmacy revalidation requirements

The United Kingdom’s pharmacy regulator contemplated using continuing professional development (CPD) in pharmacy revalidation in 2009, simultaneously asking pharmacy professionals to demonstrate the value of their CPD by showing its relevance and impact. The idea of linking new CPD requirements with revalidation was yet to be explored. Our aim was to develop and validate a framework to guide pharmacy professionals to select CPD activities that are relevant to their work and to produce a score sheet that would make it possible to quantify the impact and relevance of CPD. METHODS: We adapted an existing risk matrix, producing a CPD framework consisting of relevance and impact matrices. Concepts underpinning the framework were refined through feedback from five pharmacist teacher-practitioners. We then asked seven pharmacists to rate the relevance of the framework’s individual elements on a 4-point scale to determine content validity. We explored views about the framework through focus groups with six and interviews with 17 participants who had used it formally in a study. RESULTS: The framework’s content validity index was 0.91. Feedback about the framework related to three themes of penetrability of the framework, usefulness to completion of CPD, and advancement of CPD records for the purpose of revalidation. DISCUSSION: The framework can help professionals better select CPD activities prospectively, and makes assessment of CPD more objective by allowing quantification, which could be helpful for revalidation. We believe the framework could potentially help other health professionals with better management of their CPD irrespective of their field of practice.

Assessing levels of uncertainty in recent temperature time series

We examine to what degree we can expect to obtain accurate temperature trends for the last two decades near the surface and in the lower troposphere. We compare temperatures obtained from surface observations and radiosondes as well as satellite-based measurements from the Microwave Soundings Units (MSU), which have been adjusted for orbital decay and non-linear instrument-body effects, and reanalyses from the European Centre for Medium-Range Weather Forecasts (ERA) and the National Centre for Environmental Prediction (NCEP). In regions with abundant conventional data coverage, where the MSU has no major influence on the reanalysis, temperature anomalies obtained from microwave sounders, radiosondes and from both reanalyses agree reasonably. Where coverage is insufficient, in particular over the tropical oceans, large differences are found between the MSU and either reanalysis. These differences apparently relate to changes in the satellite data availability and to differing satellite retrieval methodologies, to which both reanalyses are quite sensitive over the oceans. For NCEP, this results from the use of raw radiances directly incorporated into the analysis, which make the reanalysis sensitive to changes in the underlying algorithms, e.g. those introduced in August 1992. For ERA, the bias-correction of the one-dimensional variational analysis may introduce an error when the satellite relative to which the correction is calculated is biased itself or when radiances change on a time scale longer than a couple of months, e.g. due to orbit decay. ERA inhomogeneities are apparent in April 1985, October/November 1986 and April 1989. These dates can be identified with the replacements of satellites. It is possible that a negative bias in the sea surface temperatures (SSTs) used in the reanalyses may have been introduced over the period of the satellite record. This could have resulted from a decrease in the number of ship measurements, a concomitant increase in the importance of satellite-derived SSTs, and a likely cold bias in the latter. Alternately, a warm bias in SSTs could have been caused by an increase in the percentage of buoy measurements (relative to deeper ship intake measurements) in the tropical Pacific. No indications for uncorrected inhomogeneities of land surface temperatures could be found. Near-surface temperatures have biases in the boundary layer in both reanalyses, presumably due to the incorrect treatment of snow cover. The increase of near-surface compared to lower tropospheric temperatures in the last two decades may be due to a combination of several factors, including high-latitude near-surface winter warming due to an enhanced NAO and upper-tropospheric cooling due to stratospheric ozone decrease.

Assessing continental-scale risks for generalist and specialist pollinating bee species under climate change

Increased risks of extinction to populations of animals and plants under changing climate have now been demonstrated for many taxa. This study assesses the extinction risks to species within an important genus of pollinating bees (Colletes: Apidae) by estimating the expected changes in the area and isolation of suitable habitat under predicted climatic condition for 2050. Suitable habitat was defined on the basis of the presence of known forage plants as well as climatic suitability. To investigate whether ecological specialisation was linked to extinction risk we compared three species which were generalist pollen foragers on several plant families with three species which specialised on pollen from a single plant species. Both specialist and generalist species showed an increased risk of extinction with shifting climate, and this was particularly high for the most specialised species (Colletes anchusae and C. wolfi). The forage generalist C. impunctatus, which is associated with Boreo-Alpine environments, is potentially threatened through significant reduction in available climatic niche space. Including the distribution of the principal or sole pollen forage plant, when modelling the distribution of monolectic or narrowly oligolectic species, did not improve the predictive accuracy of our models as the plant species were considerably more widespread than the specialised bees associated with them.

The utility of aerial pan-trapping for assessing insect pollinators across vertical strata

Insect pollinators provide a critical ecosystem service by pollinating many wild flowers and crops. It is therefore essential to be able to effectively survey and monitor pollinator communities across a range of habitats, and in particular, sample the often stratified parts of the habitats where insects are found. To date, a wide array of sampling methods have been used to collect insect pollinators, but no single method has been used effectively to sample across habitat types and throughout the spatial structure of habitats. Here we present a method of ‘aerial pan-trapping’ that allows insect pollinators to be sampled across the vertical strata from the canopy of forests to agro-ecosystems. We surveyed and compared the species richness and abundance of a wide range of insect pollinators in agricultural, secondary regenerating forest and primary forest habitats in Ghana to evaluate the usefulness of this approach. In addition to confirming the efficacy of the method at heights of up to 30 metres and the effects of trap color on catch, we found greatest insect abundance in agricultural land and higher bee abundance and species richness in undisturbed forest compared to secondary forest.

The challenge of validation: assessing the performance of a test of productive vocabulary

This paper assesses the performance of a vocabulary test designed to measure second language productive vocabulary knowledge.The test, Lex30, uses a word association task to elicit vocabulary, and uses word frequency data to measure the vocabulary produced. Here we report firstly on the reliability of the test as measured by a test-retest study, a parallel test forms experiment and an internal consistency measure. We then investigate the construct validity of the test by looking at changes in test performance over time, analyses of correlations with scores on similar tests, and comparison of spoken and written test performance. Last, we examine the theoretical bases of the two main test components: eliciting vocabulary and measuring vocabulary. Interpretations of our findings are discussed in the context of test validation research literature. We conclude that the findings reported here present a robust argument for the validity of the test as a research tool, and encourage further investigation of its validity in an instructional context

Assessing the completeness of optical resetting of quartz OSL in the natural environment

Resetting of previously accumulated optically stimulated luminescence (OSL) signals during transport of sediment is a fundamental requirement for reliable optical dating. The completeness of optical resetting of 46 modern-age quartz samples from a variety of depositional environments was examined. All equivalent dose (De) estimates were View the MathML source, with the majority of aeolian samples View the MathML source, and fluvial samples View the MathML source. The OSL signal of quartz originates from several trap types with different rates of charge loss during illumination. As such, incomplete bleaching may be identifiable as an increase in De from easy-to-bleach through to hard-to-bleach components. For all modern fluvial samples with non-zero De values, SAR De(t) analysis and component-resolved linearly modulated OSL (LM OSL) De estimates showed this to be the case, implying incomplete resetting of previously accumulated charge. LM OSL measurements were also made to investigate the extent of bleaching of the slow components in the natural environment. In aeolian sediments examined, the natural LM OSL was effectively zero (i.e. all components were fully reset). The slow components of modern fluvial samples displayed measurable residual signals up to 15 Gy.

Assessing the benefits of crop albedo bio-geoengineering

It has been proposed that growing crop varieties with higher canopy albedo would lower summer-time temperatures over North America and Eurasia and provide a partial mitigation of global warming ('bio-geoengineering') (Ridgwell et al 2009 Curr. Biol. 19 1–5). Here, we use a coupled ocean–atmosphere–vegetation model (HadCM3) with prescribed agricultural regions, to investigate to what extent the regional effectiveness of crop albedo bio-geoengineering might be influenced by a progressively warming climate as well as assessing the impacts on regional hydrological cycling and primary productivity. Consistent with previous analysis, we find that the averted warming due to increasing crop canopy albedo by 0.04 is regionally and seasonally specific, with the largest cooling of ~1 °C for Europe in summer whereas in the low latitude monsoonal SE Asian regions of high density cropland, the greatest cooling is experienced in winter. In this study we identify potentially important positive impacts of increasing crop canopy albedo on soil moisture and primary productivity in European cropland regions, due to seasonal increases in precipitation. We also find that the background climate state has an important influence on the predicted regional effectiveness of bio-geoengineering on societally-relevant timescales (ca 100 years). The degree of natural climate variability and its dependence on greenhouse forcing that are evident in our simulations highlights the difficulties faced in the detection and verification of climate mitigation in geoengineering schemes. However, despite the small global impact, regionally focused schemes such as crop albedo bio-geoengineering have detection advantages.

Assessing the impact on chronic disease of incorporating the societal cost of greenhouse gases into the price of food: an econometric and comparative risk assessment modelling study

Objectives To model the impact on chronic disease of a tax on UK food and drink that internalises the wider costs to society of greenhouse gas (GHG) emissions and to estimate the potential revenue. Design An econometric and comparative risk assessment modelling study. Setting The UK. Participants The UK adult population. Interventions Two tax scenarios are modelled: (A) a tax of £2.72/tonne carbon dioxide equivalents (tCO2e)/100 g product applied to all food and drink groups with above average GHG emissions. (B) As with scenario (A) but food groups with emissions below average are subsidised to create a tax neutral scenario. Outcome measures Primary outcomes are change in UK population mortality from chronic diseases following the implementation of each taxation strategy, the change in the UK GHG emissions and the predicted revenue. Secondary outcomes are the changes to the micronutrient composition of the UK diet. Results Scenario (A) results in 7770 (95% credible intervals 7150 to 8390) deaths averted and a reduction in GHG emissions of 18 683 (14 665to 22 889) ktCO2e/year. Estimated annual revenue is £2.02 (£1.98 to £2.06) billion. Scenario (B) results in 2685 (1966 to 3402) extra deaths and a reduction in GHG emissions of 15 228 (11 245to 19 492) ktCO2e/year. Conclusions Incorporating the societal cost of GHG into the price of foods could save 7770 lives in the UK each year, reduce food-related GHG emissions and generate substantial tax revenue. The revenue neutral scenario (B) demonstrates that sustainability and health goals are not always aligned. Future work should focus on investigating the health impact by population subgroup and on designing fiscal strategies to promote both sustainable and healthy diets.

People or machines? Assessing the impacts of smart meters and load controllers in Italian office spaces

Government initiatives in several developed and developing countries to roll-out smart meters call for research on the sustainability impacts of these devices. In principle smart meters bring about higher control over energy theft and lower consumption, but require a high level of engagement by end-users. An alternative consists of load controllers, which control the load according to pre-set parameters. To date, research has focused on the impacts of these two alternatives separately. This study compares the sustainability impacts of smart meters and load controllers in an occupied office building in Italy. The assessment is carried out on three different floors of the same building. Findings show that demand reductions associated with a smart meter device are 5.2% higher than demand reductions associated with the load controller.

Assessing the quality of modelled 3D protein structures using the ModFOLD server

Model quality assessment programs (MQAPs) aim to assess the quality of modelled 3D protein structures. The provision of quality scores, describing both global and local (per-residue) accuracy are extremely important, as without quality scores we are unable to determine the usefulness of a 3D model for further computational and experimental wet lab studies.Here, we briefly discuss protein tertiary structure prediction, along with the biennial Critical Assessment of Techniques for Protein Structure Prediction (CASP) competition and their key role in driving the field of protein model quality assessment methods (MQAPs). We also briefly discuss the top MQAPs from the previous CASP competitions. Additionally, we describe our downloadable and webserver-based model quality assessment methods: ModFOLD3, ModFOLDclust, ModFOLDclustQ, ModFOLDclust2, and IntFOLD-QA. We provide a practical step-by-step guide on using our downloadable and webserver-based tools and include examples of their application for improving tertiary structure prediction, ligand binding site residue prediction, and oligomer predictions.