Making sense of research quality assessment

Purpose – For many academics in UK universities the nature and orientation of their research is overwhelmingly determined by considerations of how that work will be graded in research assessment exercises (RAEs). The grades awarded to work in a particular subject area can have a considerable impact on the individual and their university. There is a need to better understand those factors which may influence these grades. The paper seeks to address this issue. Design/methodology/approach – The paper considers relationships between the grades awarded and the quantitative information provided to the assessment panels for the 1996 and 2001 RAEs for two subject areas, built environment and town and country planning, and for three other subject areas, civil engineering, geography and archaeology, in the 2001 RAE. Findings – A simple model demonstrating strong and consistent relationships is established. RAE performance relates to numbers of research active staff, the production of books and journal papers, numbers of research studentships and graduations, and research income. Important differences between subject areas are identified. Research limitations/implications – Important issues are raised about the extent to which the new assessment methodology to be adopted for the 2008 RAE will capture the essence of good quality research in architecture and built environment. Originality/value – The findings provide a developmental perspective of RAEs and show how, despite a changed methodology, various research activities might be valued in the 2008 RAE. The basis for a methodology for reviewing the credibility of the judgements of panels is proposed.

Preliterate phonological awareness and early literacy skills in Turkish

The role of preschool phonological awareness in early reading and spelling skills was investigated in the transparent orthography of Turkish. Fifty-six preschool children (mean age=5.6 years) were followed into Grade 2 (mean age=7.6 years). While preschool phonological awareness failed to make any reliable contribution to future reading skills, it was the strongest longitudinal correlate of spelling skills measured at the end of Grades 1 and 2. Overall findings suggested that phonological awareness may be differentially related to reading and spelling, and that spelling is a more sensitive index of phonological processing skills. In this study, verbal short-term memory emerged as the most powerful and consistent longitudinal correlate of reading speed. This finding raised important questions about the component processes of reading speed, and the role of memory and morphosyntactic skills in an agglutinative and transparent orthography such as Turkish.

Advanced skills teachers: professional identity and status

The teaching profession continues to struggle with defining itself in relation to other professions. Even though public opinion positions teachers second only to doctors and nurses in terms of their professional status and prestige research in the UK suggests that teachers still believe that they have much lower status than other professions. With teacher job satisfaction considerably lower today than the past and on-going issues with teacher recruitment and retention, new government policies have set out to enhance the status of teachers both within and outside of the profession. The Advanced Skill Teacher (AST) grade was introduced in 1998 as a means to recognise and reward teaching expertise and was framed as a way of also raising the status of the teaching profession. As to what a teaching professional should look like, the AST was in many ways positioned as the embodiment. Using survey data from 849 ASTs and in depth interviews with 31, this paper seeks to explores the ways that the AST designation impacts or not on teachers’ perceptions of their professional identity. In particular, the paper considers whether such awards contribute in positive ways to a teacher’s sense of professional identity and status. The results from the research suggest that teaching grades that recognise and reward teaching excellence do contribute in important ways to a teachers’ professional identity via an increased sense of recognition, reward and job satisfaction. The results from this research also suggest that recognising the skills and expertise of teachers is clearly important in supporting teacher retention. This is because as it allows highly accomplished teachers to remain where they want to be and that is the classroom.

Multimodel assessment of the upper troposphere and lower stratosphere: tropics and global trends

The performance of 18 coupled Chemistry Climate Models (CCMs) in the Tropical Tropopause Layer (TTL) is evaluated using qualitative and quantitative diagnostics. Trends in tropopause quantities in the tropics and the extratropical Upper Troposphere and Lower Stratosphere (UTLS) are analyzed. A quantitative grading methodology for evaluating CCMs is extended to include variability and used to develop four different grades for tropical tropopause temperature and pressure, water vapor and ozone. Four of the 18 models and the multi-model mean meet quantitative and qualitative standards for reproducing key processes in the TTL. Several diagnostics are performed on a subset of the models analyzing the Tropopause Inversion Layer (TIL), Lagrangian cold point and TTL transit time. Historical decreases in tropical tropopause pressure and decreases in water vapor are simulated, lending confidence to future projections. The models simulate continued decreases in tropopause pressure in the 21st century, along with ∼1K increases per century in cold point tropopause temperature and 0.5–1 ppmv per century increases in water vapor above the tropical tropopause. TTL water vapor increases below the cold point. In two models, these trends are associated with 35% increases in TTL cloud fraction. These changes indicate significant perturbations to TTL processes, specifically to deep convective heating and humidity transport. Ozone in the extratropical lowermost stratosphere has significant and hemispheric asymmetric trends. O3 is projected to increase by nearly 30% due to ozone recovery in the Southern Hemisphere (SH) and due to enhancements in the stratospheric circulation. These UTLS ozone trends may have significant effects in the TTL and the troposphere.

The relationship between rapid naming and word spelling in English

A study of the concurrent relationships between naming speed, phonological awareness and spelling ability in 146 children in Year 3 and 4 of state funded school in SE England (equivalent to US Grades 2 and 3) is reported. Seventy-two children identified as having normal phonological awareness but reduced rapid automatized naming (RAN) performance (1 standard deviation below the mean) participated in the study. A group of 74 children were further identified. These children were matched on phonological awareness, verbal and non verbal IQ, and visual acuity but all members of this group showed normal rapid automatized naming performance. Rapid automatized naming made a significant unique contribution to spelling performance. Further analyses showed that the participants with low naming performance were significantly poorer spellers overall and had a specific difficulty in spelling irregular words. The findings support the view that rapid automatized naming may be indexing processes that are implicated in the establishment of fully specified orthographic representations.

The effect of class size on student achievement: evidence from Bangladesh

This study examines the effect of class size on student achievement in Bangladesh using national secondary school survey data. A Ministry of Education rule regarding allocation of teachers to secondary grades is exploited to construct an instrument for class size. This rule causes a discontinuity between grade enrolment and class size thereby generating exogenous variation in the latter. It is found that OLS and IV estimates of class size effects have perverse signs: both yield a positive coefficient on the class size variable. The results suggest that reduction in class size in secondary grades is not efficient in a developing country like Bangladesh. Last, as by-product, some evidence is found suggesting that greater competition among schools improve student achievement.

New wine into old skins: the enactment of literacy policy in Singapore

To better comprehend how educational reforms and classroom practice interconnect, we need to understand the epistemic environments created for learning, as well as the pedagogical activities and the modes of classroom discourse related to these activities. This article examines how a particular innovation in English literacy, Strategies for English Language Learning and Reading (STELLAR), has been implemented in Singapore. Outlining the broader curriculum initiatives, current literacy policy landscape and pedagogical effect of classroom discourse, we look at how English language teachers in grades 1 and 2 interpret the STELLAR curriculum. Situated within the larger international zeal of educational reform, Singapore presents a rich case for the study of policy–pedagogy initiatives, literacy instruction and cultural values. Adding to the existing policy enactment research, this investigation provides an opportunity to probe both the prospects and limitations of policy implementation associated with centralised educational structures, examination-oriented systems and societal cultural frameworks.

Predicting long-term growth in students' mathematics achievement: the unique contributions of motivation and cognitive strategies

This research examined how motivation (perceived control, intrinsic motivation, and extrinsic motivation), cognitive learning strategies (deep and surface strategies), and intelligence jointly predict long-term growth in students' mathematics achievement over 5 years. Using longitudinal data from six annual waves (Grades 5 through 10; Mage = 11.7 years at baseline; N = 3,530), latent growth curve modeling was employed to analyze growth in achievement. Results showed that the initial level of achievement was strongly related to intelligence, with motivation and cognitive strategies explaining additional variance. In contrast, intelligence had no relation with the growth of achievement over years, whereas motivation and learning strategies were predictors of growth. These findings highlight the importance of motivation and learning strategies in facilitating adolescents' development of mathematical competencies.

Precision placement of fertiliser for optimising the early nutrition of vegetable crops: a review of the implications for the yield and quality of crops, and their nutrient use efficiency

The research outlined in this paper highlights the importance of the early nutrition of vegetable crops, and its long-term effects on their subsequent growth and development. Results are also presented to demonstrate how the nutrient supply during the establishment stages of young seedlings and transplants can be enhanced by targeting fertiliser to a zone close to their developing roots. Three different precision fertiliser placement techniques are compared for this purpose: starter, band or side-injected fertiliser. The use of each of these methods consistently produced the same (or greater) yields at lower application rates than those from conventional broadcast applications, increasing the apparent recovery of N, P and K, and the overall efficiency of nutrient use, while reducing the levels of residual nutrients in the soil. Starter fertilisers also advanced the maturity of some crops, and enhanced produce quality by increasing the proportions of the larger and/or more desirable marketable grades. The benefits of the different placement techniques are illustrated with selected examples from research at Warwick HRI using different vegetable crops, including lettuce, onion and carrot.

Correlates of early reading comprehension skills: a componential analysis

This study had three main aims. First, we examined to what extent listening comprehension, vocabulary, grammatical skills and verbal short-term memory (VSTM) assessed prior to formal reading instruction explained individual differences in early reading comprehension levels. Second, we examined to what extent the three common component skills, namely vocabulary, grammar and VSTM explained the relationship between kindergarten listening comprehension and early reading comprehension levels. Third, we examined the relative contributions of word-reading and listening comprehension skills to early reading comprehension in Turkish. For this purpose, 56 Turkish-speaking children were followed from kindergarten (mean age = 67.7 months) into Grade 2 (mean age = 90.6 months). The relative role of kindergarten listening comprehension, vocabulary, VSTM and grammatical skills in later reading comprehension tended to vary across time, and they partly explained the relationship between listening comprehension and reading comprehension. Finally, as anticipated, listening comprehension, rather than word-reading , was found to play a more powerful role in children’s reading comprehension levels even during the early primary grades. These results contradicted those reported in English and can be explained by the rapid development of accurate word-reading skills due to the consistency of the grapheme–phoneme relationships of the Turkish orthography.

Control and analysis of oriented thin films of lipid inverse bicontinuous cubic phases using grazing incidence small-angle X‑ray scattering

Lipid cubic phases are complex nanostructures that form naturally in a variety of biological systems, with applications including drug delivery and nanotemplating. Most X-ray scattering studies on lipid cubic phases have used unoriented polydomain samples as either bulk gels or suspensions of micrometer-sized cubosomes. We present a method of investigating cubic phases in a new form, as supported thin films that can be analyzed using grazing incidence small-angle X-ray scattering (GISAXS). We present GISAXS data on three lipid systems: phytantriol and two grades of monoolein (research and industrial). The use of thin films brings a number of advantages. First, the samples exhibit a high degree of uniaxial orientation about the substrate normal. Second, the new morphology allows precise control of the substrate mesophase geometry and lattice parameter using a controlled temperature and humidity environment, and we demonstrate the controllable formation of oriented diamond and gyroid inverse bicontinuous cubic along with lamellar phases. Finally, the thin film morphology allows the induction of reversible phase transitions between these mesophase structures by changes in humidity on subminute time scales, and we present timeresolved GISAXS data monitoring these transformations.

Therapist characteristics and their effect on training outcomes: what counts?

Background: Evidence exists for a relationship between individual characteristics and both job and training performance; however relationships may not be generalizable. Little is known about the impact of therapist characteristics on performance in postgraduate therapist training programmes. Aims: The aim of this study was to investigate associations between the grades of trainee Low-Intensity and High-Intensity cognitive behavioural therapists and individual characteristics. Method: Trainee Low-Intensity (n=81) and High-Intensity (n=59) therapists completed measures of personality and cognitive ability; demographic and course grade data for participants were collected. Results: Degree classification emerged as the only variable to be significantly associated with performance across assessments and courses. Higher undergraduate degree classifications were associated with superior academic and clinical performance. Agreeableness was the only dimension of personality to be associated (positively) with clinical skill. Age was weakly and negatively associated with performance. Conclusions: Relationships between individual characteristics and training outcomes are complex and may be context specific. These results could have important implications for the selection and development of therapists for Low or High-Intensity cognitive behavioural therapy (CBT) training.

Don’t aim too high for your kids: parental over-aspiration undermines students’ learning in mathematics

Previous research has suggested that parents’ aspirations for their children’s academic attainment can have a positive influence on children’s actual academic performance. Possible negative effects of parental over-aspiration, however, have found little attention in the psychological literature. Employing a dual-change score model with longitudinal data from a representative sample of German schoolchildren and their parents (N = 3,530; grades 5 to 10), we showed that parental aspiration and children’s mathematical achievement were linked by positive reciprocal relations over time. Importantly, we also found that parental aspiration that exceeded their expectation (i.e., over-aspiration) had negative reciprocal relations with children’s mathematical achievement. These results were fairly robust after controlling for a variety of demographic and cognitive variables such as children’s gender, age, intelligence, school type, and family SES. The results were also replicated with an independent sample of US parents and their children. These findings suggest that unrealistically high parental aspiration can be detrimental for children’s achievement.

Internalizing symptomatology and academic achievement: bi-directional prospective relations in adolescence

Prior research has documented negative, concurrent relations between internalizing symptomatology and academic achievement among adolescents. The present study provided the first rigorous, longitudinal examination of the bi-directional, prospective relations between adolescent internalizing symptomatology and academic achievement. One hundred and thirty adolescents reported depression and anxiety annually from 6th through 10th grades, and GPA records were obtained annually from schools. Results showed that a) high depression and anxiety at the beginning of a school year predicted lower GPA during that school year, and b) low GPA in any school year predicted higher depression and anxiety at the beginning of the following school year. These findings underscore the tight link between adolescent internalizing symptomatology and academic achievement.

Breaking the double-edged sword of effort/trying hard: developmental equilibrium and Longitudinal relations among effort, achievement, and academic self-concept

Ever since the classic research of Nicholls (1976) and others, effort has been recognized as a double-edged sword: whilst it might enhance achievement, it undermines academic self-concept (ASC). However, there has not been a thorough evaluation of the longitudinal reciprocal effects of effort, ASC and achievement,in the context of modern self-concept theory and statistical methodology. Nor have there been developmental equilibrium tests of whether these effects are consistent across the potentially volatile early-to-middle adolescence. Hence, focusing on mathematics, we evaluate reciprocal effects models over the first four years of secondary school, relating effort, achievement (test scores and school grades), ASC, and ASCxEffort interactions for a representative sample of 3,421 German students (Mn age = 11.75 years at Wave 1). ASC, effort and achievement were positively correlated at each wave, and there was a clear pattern of positive reciprocal positive effects among ASC, test scores and school grades—each contributing to the other, after controlling for the prior effects of all others. There was an asymmetrical pattern of effects for effort that is consistent with the double-edged sword premise: prior school grades had positive effects on subsequent effort, but prior effort had non-significant or negative effects on subsequent grades and ASC. However, on the basis of a synergistic application of new theory and methodology, we predicted and found a significant ASC-by-effort interaction, such that prior effort had more positive effects on subsequent ASC and school grades when prior ASC was high—thus providing a key to breaking the double-edged sword.