Validity evidence based on test content

Resumen tomado de la publicación

Student, school, and country differences in sustained test-taking effort in the 2009 PISA reading assessment

In this article, the change in examinee effort during an assessment, which we will refer to as persistence, is modeled as an effect of item position. A multilevel extension is proposed to analyze hierarchically structured data and decompose the individual differences in persistence. Data from the 2009 Program of International Student Achievement (PISA) reading assessment from N = 467,819 students from 65 countries are analyzed with the proposed model, and the results are compared across countries. A decrease in examinee effort during the PISA reading assessment was found consistently across countries, with individual differences within and between schools. Both the decrease and the individual differences are more pronounced in lower performing countries. Within schools, persistence is slightly negatively correlated with reading ability; but at the school level, this correlation is positive in most countries. The results of our analyses indicate that it is important to model and control examinee effort in low-stakes assessments. (DIPF/Orig.)

A prática avaliativa em uma instituição privada de ensino de língua estrangeira

The main objective of this work is to describe conceptions and practices of evaluation observed at a private language school. The theoretical background was gathered from Demo (2002a, 2002b), Luckesi (2001), Romão (2001), Shohamy (2001), Hughes (1994) and Depresbiteris (1989). Regarding the data collected, we made use of questionnaires, interviews, group discussions and diaries. Results show that the topics “fear of test” and “test content” were the most frequent ones. Furthermore, there was a harmonious relationship between teacher and students when tests were applied. We observed a “non-verbal agreement” between them, that is, there was a minimum content to be studied and to be asked on a test. We also noticed that classroom activities had a more complex level than the content actually tested.

Prevalência e fatores associados à alteração vocal em idosos institucionalizados com capacidade cognitiva preservada

Voice disorders (VD) in the elderly can interfere negatively in communication, emotional well-being and quality of life, conditions that correspond to greater exposure to illness and social isolation bringing consequent economic impact for the health system. It is assumed that institutionalized confinement, weakness and morbidity associated to nursing home (NH) contribute to transform VD an especially prevalent condition in institutionalized elderly, including those without cognitive impairment. Thus, the aim of this study was to determine the prevalence and associated factors of VD in NH elderly residents without cognitive impairment. There is no epidemiological diagnostic instruments of VD for elderly populations, so the first step of this study was dedicated to prepare and analyze the psychometric properties of a short, inexpensive and easy to use questionnaire named Screening for Voice Disorders in Older Adults (Rastreamento de Alterações Vocais em Idosos—RAVI). The methodological procedures of this step followed the guidelines of the Standards for Educational and Psychological Testing and contemplated validity evidence based on test content, based on response processes, based on internal structure and based on relations with other variables, as well as reliability analysis and clinical consistency. The result of the validation process showed that the RAVI final score generate valid and reliable interpretations for the epidemiological diagnosis of VD in the elderly, which endorsed the use of the questionnaire in the second stage of the study, performed in ten NH located in the city of Natal, Rio Grande do Norte. At this stage, data from socioeconomic and demographic variables, lifestyle, general health conditions and characterization of the institution were collected. It was performed a bivariate analysis and it was calculated the prevalence ratio as a magnitude association measure, with a confidence interval of 95%. The variables with p-value less than 0.20 were included in the multiple logistic regression model that followed the Forward selection method. The odds ratio found in the multivariate model was converted into prevalence ratio and the level of significance was 5%. The sample consisted of 117 subjects with predominance of females and average of 79.68 (± 7.92) years old. The prevalence of VD was 39.3% (95% CI: 30.4-48.1%). The multivariate model showed statistically significant association between VD and depressive symptoms, smoking for a year or more and selfreported hearing loss. In conclusion, VD is a prevalent health condition in NH elderly residents without cognitive impairment and is associated with factors involving psychosocial, lifestyle and communicative disability that require attention of managers and professionals involved with NH environment. Strategies to encourage communication and social integration, actions to combat smoking and minimizing the effects of hearing loss could stimulate the physical well-being, emotional and mental health of institutionalized elderly population, contributing to the vocal and communicative maintenance, a more effective social inclusion and better overall health condition.

Content validity and reliability of test of gross motor development in Chilean children

ABSTRACT OBJECTIVE To validate a Spanish version of the Test of Gross Motor Development (TGMD-2) for the Chilean population. METHODS Descriptive, transversal, non-experimental validity and reliability study. Four translators, three experts and 92 Chilean children, from five to 10 years, students from a primary school in Santiago, Chile, have participated. The Committee of Experts has carried out translation, back-translation and revision processes to determine the translinguistic equivalence and content validity of the test, using the content validity index in 2013. In addition, a pilot implementation was achieved to determine test reliability in Spanish, by using the intraclass correlation coefficient and Bland-Altman method. We evaluated whether the results presented significant differences by replacing the bat with a racket, using T-test. RESULTS We obtained a content validity index higher than 0.80 for language clarity and relevance of the TGMD-2 for children. There were significant differences in the object control subtest when comparing the results with bat and racket. The intraclass correlation coefficient for reliability inter-rater, intra-rater and test-retest reliability was greater than 0.80 in all cases. CONCLUSIONS The TGMD-2 has appropriate content validity to be applied in the Chilean population. The reliability of this test is within the appropriate parameters and its use could be recommended in this population after the establishment of normative data, setting a further precedent for the validation in other Latin American countries.

Changes in the biogenic amine content of the prefrontal cortex, amygdala, dorsal hippocampus, and nucleus accumbens of rats submitted to single and repeated sessions of the elevated plus-maze test

It has been demonstrated that exposure to a variety of stressful experiences enhances fearful reactions when behavior is tested in current animal models of anxiety. Until now, no study has examined the neurochemical changes during the test and retest sessions of rats submitted to the elevated plus maze (EPM). The present study uses a new approach (HPLC) by looking at the changes in dopamine and serotonin levels in the prefrontal cortex, amygdala, dorsal hippocampus, and nucleus accumbens in animals upon single or double exposure to the EPM (one-trial tolerance). The study involved two experiments: i) saline or midazolam (0.5 mg/kg) before the first trial, and ii) saline or midazolam before the second trial. For the biochemical analysis a control group injected with saline and not tested in the EPM was included. Stressful stimuli in the EPM were able to elicit one-trial tolerance to midazolam on re-exposure (61.01%). Significant decreases in serotonin contents occurred in the prefrontal cortex (38.74%), amygdala (78.96%), dorsal hippocampus (70.33%), and nucleus accumbens (73.58%) of the animals tested in the EPM (P < 0.05 in all cases in relation to controls not exposed to the EPM). A significant decrease in dopamine content was also observed in the amygdala (54.74%, P < 0.05). These changes were maintained across trials. There was no change in the turnover rates of these monoamines. We suggest that exposure to the EPM causes reduced monoaminergic neurotransmission activity in limbic structures, which appears to underlie the "one-trial tolerance" phenomenon.

The TKT Teaching Knowledge Test. course : CLIL module ( Content and Language Integrate Learning).

El TKT es un examen que se centra en los conocimientos esenciales que requiere todo profesor de inglés como segunda lengua. Evalúa los conocimientos pedagógicos y no las habilidades didácticas. Quienes se preparan para él profundizan sus conocimientos sobre la enseñanza del inglés y mejoran su comprensión de los conceptos relacionados con la lengua y su uso, así como la teoría y la práctica del proceso de enseñanza y aprendizaje. La prueba es adecuada para todos los profesores de Aprendizaje Integrado de Contenidos y Lenguas Extranjeras (AICLE) que trabajan en primaria y secundaria. Cubre las cuatro áreas claves de la prueba: conocimiento y principios de AICLE, preparación de la lección, entrega de la lección y evaluación La prueba también es adecuada para los profesores que trabajan en inglés como segunda lengua (EAL). Es una prueba de ochenta minutos que cuenta con ochenta preguntas. Éstas son una mezcla de distintas opciones verdadero - falso, selección múltiple, etc.

Investigation of Escape and Negative Student Behaviors Related to Florida State High Stakes Test Preparation in Miami-Dade County Public High Schools, having been approved in respect to style and intellectual content, is referred to you for judgment

The purpose of this study was to determine whether there was a relationship between pressure to perform on state mandated, high-stakes tests and the rate of student escape behavior defined as the number of school suspensions and absences. The state assigned grade of a school was used as a surrogate measure of pressure with the assumption that pressure increased as the school grade decreased. Student attendance and suspension data were gathered from all 33 of the regular public high schools in Miami-Dade County Public Schools. The research questions were: Is the number of suspensions highest in the third quarter, when most FCAT preparation takes place for each of the 3 school years 2007-08 through 2009-10? How accurately does the high school’s grade predict the number of suspensions and number of absences during each of the 4 school years 2005-06 through 2008-09? The research questions were answered using repeated measures analysis of variance for research question #1 and non-linear multiple regression for research question #2. No significant difference could be found between the numbers of suspensions in each of the grading periods nor was there a relationship between the number of suspensions and school grade. A statistically significant relationship was found between student attendance and school grade. When plotted, this relationship was found to be quadratic in nature and formed a loose inverted U for each of the four years during which data were collected. This indicated that students in very high and very low performing schools had low levels of absences while those in the midlevel of the distribution of school performance (C schools) had the greatest rates of absence. Identifying a relationship between the pressures associated with high stakes testing and student escape behavior suggests that it might be useful for building administrators to reevaluate test preparation activities and procedures being used in their building and to include anxiety reducing strategies. As a relationship was found, it sets the foundation for future studies to identify whether testing related activities are impacting some students emotionally and are causing unintended consequences of testing mandates.

NEAR INFRARED SPECTROSCOPY FOR ESTIMATING SUGARCANE BAGASSE CONTENT IN MEDIUM DENSITY FIBERBOARD

Medium density fiberboard (MDF) is an engineered wood product formed by breaking down selected lignin-cellulosic material residuals into fibers, combining it with wax and a resin binder, and then forming panels by applying high temperature and pressure. Because the raw material in the industrial process is ever-changing, the panel industry requires methods for monitoring the composition of their products. The aim of this study was to estimate the ratio of sugarcane (SC) bagasse to Eucalyptus wood in MDF panels using near infrared (NIR) spectroscopy. Principal component analysis (PCA) and partial least square (PLS) regressions were performed. MDF panels having different bagasse contents were easily distinguished from each other by the PCA of their NIR spectra with clearly different patterns of response. The PLS-R models for SC content of these MDF samples presented a strong coefficient of determination (0.96) between the NIR-predicted and Lab-determined values and a low standard error of prediction (similar to 1.5%) in the cross-validations. A key role of resins (adhesives), cellulose, and lignin for such PLS-R calibrations was shown. PLS-DA model correctly classified ninety-four percent of MDF samples by cross-validations and ninety-eight percent of the panels by independent test set. These NIR-based models can be useful to quickly estimate sugarcane bagasse vs. Eucalyptus wood content ratio in unknown MDF samples and to verify the quality of these engineered wood products in an online process.

THE STELLAR CONTENT OF OBSCURED GALACTIC GIANT H II REGIONS. VII. W3

Spectrophotometric distances in the K band have been reported by different authors for a number of obscured Galactic H II regions. Almost 50% of them show large discrepancies compared to the classical method using radial velocities measured in the radio spectral region. In order to provide a crucial test of both methods, we selected a target that does not present particular difficulty for any method and which has been measured by as many techniques as possible. The W3 star-forming complex, located in the Perseus arm, offers a splendid opportunity for such a task. We used the Near-Infrared Integral Field Spectrograph on the Frederick C. Gillett Gemini North telescope to classify candidate ""naked photosphere"" OB stars based on Two Micron All Sky Survey photometry. Two of the targets are revealed to be mid-O-type main-sequence stars leading to a distance of d = 2.20 kpc. This is in excellent agreement with the spectrophotometric distance derived in the optical band (d = 2.18 pc) and with a measurement of the W3 trigonometric parallax (d = 1.95 kpc). Such results confirm that the spectrophotometric distances in the K band are reliable. The radio-derived kinematic distance, on the contrary, gives a distance twice as large (d = 4.2 kpc). This indicates that this region of the Perseus arm does not follow the Galactic rotation curve, and this may also be the case for other H II regions for which discrepancies have been found.

Influence of alumina content on green machined electrical porcelain

The effect of alumina content on the mechanical strength of electrical porcelain manufactured by green machining of isostatically pressed blanks was examined with a view to attaining optimal mechanical properties at low sintering temperatures. Porcelain compositions were formulated with four different alumina contents, maintaining the same proportion of the other materials (kaolin, clay and feldspar). Test specimens were isostatically pressed at 70 MPa and machined at high speed into cylindrical test specimens using controlled machining parameters. These specimens were sintered at several temperatures to determine the optimal sintering temperature for each composition, after which their mechanical properties were analyzed by the flexural bend test. The results indicated a correlation between the alumina content and the sintering temperature, and between the flexural strength and its influence on the green machining conditions. An average tensile strength of 786 MPa was attained for the composition with an added content of 30 wt% of commercial alumina sintered at 1250 degrees C, pressed and machined under industrial conditions.

Influence of Water Content, Time, and Temperature on the Rheological Behavior of Polyethylene Terephtalate

In this work, the main factors affecting the rheological behavior of polyethylene terephtalate (PET) in the linear viscoelastic regime (water content, time delay before test, duration of experiment, and temperature) were accessed. Small amplitude oscillatory shear tests were performed after different time delays ranging from 300 to 5000 s for samples with water contents ranging from 0.02 to 0.45 wt %. Time sweep tests were carried out for different durations to explain the changes undergone by PET before and during small amplitude oscillatory shear measurements. Immediately after the time sweep tests, the PET samples were removed from the rheometer, analyzed by differential scanning calorimetry and their molar mass was obtained by viscometry analysis. It was shown that for all the samples, the delay before test and residence time within the rheometer (i.e. duration of experiment) result in structural changes of the PET samples, such as increase or decrease of molar mass, broadening of molar mass distribution, and branching phenomena. (C) 2010 Wiley Periodicals, Inc. J Appl Polym Sci 116: 3525-3533, 2010

Memory with emotional content, brain amygdala and Alzheimer`s disease

Objectives - A highly adaptive aspect of human memory is the enhancement of explicit, consciously accessible memory by emotional stimuli. We studied the performance of Alzheimer`s disease (AD) patients and elderly controls using a memory battery with emotional content, and we correlated these results with the amygdala and hippocampus volume. Methods - Twenty controls and 20 early AD patients were subjected to the International Affective Picture System (IAPS) and to magnetic resonance imaging-based volumetric measurements of the medial temporal lobe structures. Results - The results show that excluding control group subjects with 5 or more years of schooling, both groups showed improvement with pleasant or unpleasant figures for the IAPS in an immediate free recall test. Likewise, in a delayed free recall test, both the controls and the AD group showed improvement for pleasant pictures, when education factor was not controlled. The AD group showed improvement in the immediate and delayed free recall test proportional to the medial temporal lobe structures, with no significant clinical correlation between affective valence and amygdala volume. Conclusion - AD patients can correctly identify emotions, at least at this early stage, but this does not improve their memory performance.

Biomechanical failure properties and microstructural content of ruptured and unruptured abdominal aortic aneurysms

Purpose: To test the hypothesis that ruptured abdominal aortic aneurysms (AAA) are globally weaker than unruptured ones. Methods: Four ruptured and seven unruptured AAA specimens were harvested whole from fresh cadavers during autopsies performed over an 18-month period. Multiple regionally distributed longitudinally oriented rectangular strips were cut from each AAA specimen for a total of 77 specimen strips. Strips were subjected to uniaxial extension until failure. Sections from approximately the strongest and weakest specimen strips were studied histologically and histochemically. From the load-extension data, failure tension, failure stress and failure strain were calculated. Rupture site characteristics such as location, arc length of rupture and orientation of rupture were also documented. Results: The failure tension, a measure of the tissue mechanical caliber was remarkably similar between ruptured and unruptured AAA (group mean +/- standard deviation of within-subject means: 11.2 +/- 2.3 versus 11.6 +/- 3.6 N/cin; p=0.866 by mixed model ANOVA). In post-hoc analysis, there was little difference between the groups in other measures of tissue mechanical caliber as well such as failure stress (95 +/- 28 versus 98 +/- 23 N/cm(2); p=0.870), failure strain (0.39 +/- 0.09 versus 0.36 +/- 0.09; p=0.705), wall thickness (1.7 +/- 0.4 versus 1.5 +/- 0.4 mm; p=0.470), and % coverage of collagen within tissue cross section (49.6 +/- 12.9% versus 60.8 +/- 9.6%; p=0.133). In the four ruptured AAA, primary rupture sites were on the lateral quadrants (two on left; one on left-posterior; one on right). Remarkably, all rupture lines had a longitudinal orientation and ranged from 1 to 6 cm in length. Conclusion: The findings are not consistent with the hypothesis that ruptured aortic aneurysms are globally weaker than unruptured ones. (C) 2011 Elsevier Ltd. All rights reserved.

Quality control of Toxoplasma gondii in meat packages: Standardization of an ELISA test and its use for detection in rabbit meat cuts

Toxoplasma gondii causes severe disease both to man and livestock and its detection in meat after slaughtering requires PCR or biological tests. Meat packages contain retained exudate that could be used for serology due to its blood content. Similar studies reported false negative assays in those tests. We standardized an anti-T. gondii IgG ELISA in muscle juices from experimentally infected rabbits, with blood content determination by cyanhemoglobin spectrophotometry. IgG titers and immunoblotting profiles were similar in blood, serum or meat juice, after blood content correction. These assays were adequate regardless of the storage time up to 120 days or freeze-thaw cycles, without false negative results. We also found 1.35% (1/74) positive sample in commercial Brazilian rabbit meat cuts, by this assay. The blood content determination shows ELISA of meat juice may be useful for quality control for toxoplasmosis monitoring. (C) 2011 Elsevier Ltd. All rights reserved.