On the strategic equivalence of multiple-choice test scoring rules

A disadvantage of multiple-choice tests is that students have incentives to guess. To discourage guessing, it is common to use scoring rules that either penalize wrong answers or reward omissions. These scoring rules are considered equivalent in psychometrics, although experimental evidence has not always been consistent with this claim. We model students' decisions and show, first, that equivalence holds only under risk neutrality and, second, that the two rules can be modified so that they become equivalent even under risk aversion. This paper presents the results of a field experiment in which we analyze the decisions of subjects taking multiple-choice exams. The evidence suggests that differences between scoring rules are due to risk aversion as theory predicts. We also find that the number of omitted items depends on the scoring rule, knowledge, gender and other covariates.

Substratum choice for nesting in male Nile tilapia Oreochromis niloticus

Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq)

Large-scale testing of proficiency in English: Back to multiple choice?

The paper analyses whether that a properly designed multiple choice test can discriminate with a high level of accuracy if a student in our context has reached a B2 level according to the CEFRL.

Item and task difficulty in a B2 reading examination: perceptions of test-takers and CEFR alignment experts compared with psychometric measurements

The article presents a study of a CEFR B2-level reading subtest that is part of the Slovenian national secondary school leaving examination in English as a foreign language, and compares the test-taker actual performance (objective difficulty) with the test-taker and expert perceptions of item difficulty (subjective difficulty). The study also analyses the test-takers’ comments on item difficulty obtained from a while-reading questionnaire. The results are discussed in the framework of the existing research in the fields of (the assessment of) reading comprehension, and are addressed with regard to their implications for item-writing, FL teaching and curriculum development.

Oral testosterone self-administration in male hamsters

The addiction potential of anabolic steroids remains largely unexplored. Here, we demonstrate voluntary oral testosterone intake in hamsters. Using a 2-bottle choice test, males preferred an aqueous solution of 200 microg/ml testosterone over vehicle. However, the taste of testosterone is not highly preferred. Addition of testosterone at 400 microg/ml increased fluid consumption from the nonpreferred bottle in a 2-bottle choice test, but cholesterol at the same concentration reduced drinking, suggesting that testosterone reward is not common to all sterols. With food-induced drinking, testosterone maintained fluid intake when food was withdrawn. These data demonstrate that oral self-administration of testosterone is reinforcing in hamsters, suggesting the potential for dependence in human users.

Using automated text analysis to evaluate students’ conceptual understanding

Background: A major challenge for assessing students’ conceptual understanding of STEM subjects is the capacity of assessment tools to reliably and robustly evaluate student thinking and reasoning. Multiple-choice tests are typically used to assess student learning and are designed to include distractors that can indicate students’ incomplete understanding of a topic or concept based on which distractor the student selects. However, these tests fail to provide the critical information uncovering the how and why of students’ reasoning for their multiple-choice selections. Open-ended or structured response questions are one method for capturing higher level thinking, but are often costly in terms of time and attention to properly assess student responses. Purpose: The goal of this study is to evaluate methods for automatically assessing open-ended responses, e.g. students’ written explanations and reasoning for multiple-choice selections. Design/Method: We incorporated an open response component for an online signals and systems multiple-choice test to capture written explanations of students’ selections. The effectiveness of an automated approach for identifying and assessing student conceptual understanding was evaluated by comparing results of lexical analysis software packages (Leximancer and NVivo) to expert human analysis of student responses. In order to understand and delineate the process for effectively analysing text provided by students, the researchers evaluated strengths and weakness for both the human and automated approaches. Results: Human and automated analyses revealed both correct and incorrect associations for certain conceptual areas. For some questions, that were not anticipated or included in the distractor selections, showing how multiple-choice questions alone fail to capture the comprehensive picture of student understanding. The comparison of textual analysis methods revealed the capability of automated lexical analysis software to assist in the identification of concepts and their relationships for large textual data sets. We also identified several challenges to using automated analysis as well as the manual and computer-assisted analysis. Conclusions: This study highlighted the usefulness incorporating and analysing students’ reasoning or explanations in understanding how students think about certain conceptual ideas. The ultimate value of automating the evaluation of written explanations is that it can be applied more frequently and at various stages of instruction to formatively evaluate conceptual understanding and engage students in reflective

Improved termite resistance of wood by wax impregnation.

We investigated the effect of wax-treated and biocide-free wood specimens against three different termite species. A laboratory no-choice test with Reticulitermes banyulensis Clément was carried out in Valencia (Spain) under Mediterranean conditions for eight weeks. Scots pine sapwood (Pinus sylvestris L.) fully impregnated with distinct waxes was used. Two field trials were conducted with Coptotermes acinaciformis (Froggatt) and Mastotermes darwiniensis Froggatt in northern Queensland (Australia) with wax-impregnated beech (Fagus sylvatica L.) for 16 weeks. All three subterranean termites are of major economic importance in their respective regions. The results indicated that feeding pressure by the termites was sufficient within all trials for a valid test. Wax-impregnated Scots pine sapwood was classified as durable. No termites survived the test. The results showed an aging process under submersion conditions, which lead to a classification of moderately durable. The paraffin treatment showed good termite resistance under both test procedures, and was classified as durable. The Australian field trials showed a decreased mass loss of wax-treated beech, in which an amide wax showed excellent termite resistance. The results indicate a clear dependence of the termite resistance on the type and ratio of wax used and the feeding preferences of the specific termite species.

Preference and performance of Diachasmimorpha kraussii (Fullaway) (Hymenoptera: Braconidae) on five commercial fruit species

Diachasmimorpha kraussii is a polyphagous endoparasitoid of dacine fruit flies. The fruit fly hosts of D. krausii, in turn, attack a wide range of fruits and vegetables. The role that fruits play in host selection behaviour of D. kraussii has not been previously investigated. This study examines fruit preference of D. kraussii through a laboratory choice-test trial and field fruit sampling. In the laboratory trial, oviposition preference and offspring performance measures (sex ratio, developmental time, body length, hind tibial length) of D. kraussii were investigated with respect to five fruit species [Psidium guajava L. (guava), Prunis persica L. (peach), Malus domestica Borkh. (apple), Pyrus communis L. (pear) and Citrus sinensis L. (orange)], and two fruit fly species (Bactrocera jarvisi and B. tryoni). Diachasmimorpha kraussii responded to infested fruit of all fruit types in both choice and no-choice tests, but showed stronger preference for guava and peach in the choice tests irrespective of the species of fly larvae within the fruit. The wasp did not respond to uninfested fruit. The offspring performance measures differed in a non-consistent fashion between the fruit types, but generally wasp offspring performed better in guava, peach and orange. The offspring sex ratio, except for one fruit/fly combination (B. jarvisi in apple), was always female biased. The combined results suggest that of the five fruits tested, guava and peach are the best fruit substrates for D. krausii. Field sampling indicated a non-random use of available, fruit fly infested fruit by D. kraussii. Fruit fly maggots within two fruit species, Plachonia careya and Terminalia catappa, had disproportionately higher levels of D. krausii parasitism than would be expected based on the proportion of different infested fruit species sampled, or levels of fruit fly infestation within those fruit.

The leaf-feeding geometrid Isturgia disputaria (Guenee)-A potential biological control agent for prickly acacia, Vachellia nilotica subsp. indica (Benth.) Kyal. & Boatwr. (Mimosaceae) in Australia

Prickly acacia (Vachellia nilotica subsp. indica), a native multipurpose tree in India, is a weed of National significance, and a target for biological control in Australia. Based on plant genetic and climatic similarities, native range surveys for identifying potential biological control agents for prickly acacia were conducted in India during 2008-2011. In the survey leaf-feeding geometrid, Isturgia disputaria Guenee (syn. Tephrina pulinda), widespread in Tamil Nadu and Karnataka States, was prioritized as a potential biological control agent based on field host range, damage potential and no choice test on non target plant species. Though the field host range study exhibited that V. nilotica ssp. indica and V. nilotica ssp. tomentosa were the primary hosts for successful development of the insect, I. disputaria, replicated no - choice larval feeding and development tests conducted on cut foliage and live plants of nine non-target acacia test plant species in India revealed the larval feeding and development on three of the nine non-target acacia species, V. tortilis, V. planiferons and V. leucophloea in addition to the V. nilotica ssp. indica and V. nilotica ssp. tomentosa. However, the proportion of larvae developing into adults was higher on V. nilotica subsp. indica and V. nilotica subsp. tomentosa, with 90% and 80% of the larvae completing development, respectively. In contrast, the larval mortality was higher on V. tortilis (70%), V. leucophloea (90%) and V. planiferons (70%). The no-choice test results support the earlier host specificity test results of I. disputaria from Pakistan, Kenya and under quarantine in Australia. Contrasting results between field host range and host use pattern under no-choice conditions are discussed.

Increased attractiveness of honeybee hive product volatiles to adult small hive beetle, Aethina tumida, resulting from small hive beetle larval infestation

The small hive beetle, Aethina tumida Murray (Coleoptera: Nitidulidae), is a recent but significant pest of honeybee Apis mellifera L. (Hymenoptera: Apidae) hives in various regions throughout the world, including Eastern Australia. The larval stage of this beetle damages hives when they feed on brood, pollen, and honeycomb, leaving behind fermented wastes. In cases of extreme damage, hives collapse and are turned to an odorous mass of larvae in fermenting hive products. The yeast Kodamaea ohmeri (Etchells & Bell) Yamada et al. (Ascomycota) has been consistently isolated from the fermenting material as well as each life stage of this beetle. Various studies have noted that the small hive beetle is attracted to volatiles from hive products and those of the yeast K. ohmeri, although earlier studies have not used naturally occurring hive products as their source of fermentation. This study investigated changes through time in the attractiveness of natural honeybee hive products to the small hive beetle as the hive products were altered by the action of beetle larvae and fermentation by K. ohmeri. We used gas chromatography-mass spectrometry and choice-test behavioural assays to investigate these changes using products sampled from three apiaries. Attractiveness of the fermenting hive products (‘slime’) increased as fermentation progressed, and volatile profiles became more complex. Fermenting hive products remained extremely attractive for more than 30 days, significantly longer than previous reports. These results have strong implications for the development of an external attractant trap to assist in the management of this invasive pest.

Efeitos da desnutrição calórica ou protéica durante a lactação na susceptibilidade à nicotina durante a adolescência de camundongos

A desnutrição durante o desenvolvimento produz alterações permanentes em diferentes sistemas de neurotransmissores, o que pode gerar modificações na respostas a drogas psicoativas. Apesar dos efeitos da desnutrição precoce no sistema colinérgico serem bem conhecidas, não existem evidências que demonstrem efeitos relacionados a susceptibilidade aos efeitos da nicotina. Assim, o objetivo deste estudo foi investigar os efeitos da restrição protéica ou calórica durante a lactação de camundongos na susceptibilidade aos efeitos desta droga. Considerando que estudos demonstram que o consumo de tabaco freqüentemente se inicia na adolescência, investigamos neste período, os efeitos da nicotina no teste de campo aberto (CA), teste da preferência condicionada por lugar (CPP) e teste da preferência pela nicotina (PPN). Estudos sugerem que o estresse pode alterar a susceptibilidade ao uso de drogas, por isso foram avaliados os níveis séricos de corticosterona, o conteúdo de catecolaminas da medula adrenal e enzimas desta via. As mães foram randomicamente divididas nos seguintes grupos: 1) Grupo Controle (GC)- dieta padrão (23% de proteína); 2) Grupo Restrição Protéica (RP)- dieta isoenergética (8% de proteína) e 3) Grupo Restrição Calórica (RC)- dieta padrão em quantidade restrita (média de ingestão do grupo RP). A desnutrição abrangeu o período do segundo dia de vida pós-natal (PN2) até o desmame (PN21) e em PN30, foram realizados os testes comportamentais. Após o término dos testes de OP e CPP, os animais foram decapitados e o sangue e a adrenal coletados para análises endócrinas. Os animais do grupo RP e RC apresentaram menor ganho de peso e menor conteúdo de gordura retroperitoneal quando comparados aos animais GC. No teste CA, a administração de nicotina produziu um aumento da atividade locomotora nos animais GC e RP, o que não foi observado nos animais RC A desnutrição levou a uma diminuição do conteúdo de catecolaminas da adrenal em PN30. No teste CPP, apenas o GC e RC apresentaram padrão de condicionamento. Em relação ao teste da PPN, o grupo CG apresentou aumento no padrão de consumo de nicotina, o que não foi visto nos grupos RC e RP. A nicotina não afetou a função adrenal dos grupos programados. Estes resultados sugerem que a desnutrição durante a lactação ameniza os efeitos da nicotina durante a adolescência e que as alterações comportamentais dependem do padrão de desnutrição.

Applied behaviour analysis: What do teachers of students with autism spectrum disorder know

With rising numbers of school-aged children with autism educated in mainstream classrooms and applied behaviour analysis (ABA) considered the basis of best practice, teachers’ knowledge in this field has become a key concern for inclusion. Self-reported knowledge of ABA of special needs teachers (n=165) was measured and compared to their actual knowledge of ABA demonstrated in accurate responses to a multiple-choice test. Findings reported here show that teachers’ self-perceived knowledge exceeded actual knowledge and that actual knowledge of ABA was not related to training received by government agency. Implications for teacher training are discussed.

Using a runway paradigm to assess the relative strength of rats' motivations for enrichment objects

Laboratory animals should be provided with enrichment objects in their cages; however, it is first necessary to test whether the proposed enrichment objects provide benefits that increase the animals’ welfare. The two main paradigms currently used to assess proposed enrichment objects are the choice test, which is limited to determining relative frequency of choice, and consumer demand studies, which can indicate the strength of a preference but are complex to design. Here, we propose a third methodology: a runway paradigm, which can be used to assess the strength of an animal’s motivation for enrichment objects, is simpler to use than consumer demand studies, and is faster to complete than typical choice tests. Time spent with objects in a standard choice test was used to rank several enrichment objects in order to compare with the ranking found in our runway paradigm. The rats ran significantly more times, ran faster, and interacted longer with objects with which they had previously spent the most time. It was concluded that this simple methodology is suitable for measuring rats’ motivation to reach enrichment objects. This can be used to assess the preference for different types of enrichment objects or to measure reward system processes.