Quantifying the impact and relevance of scientific research

Qualitative and quantitative methods are being developed to measure the impacts of research on society, but they suffer from serious drawbacks associated with linking a piece of research to its subsequent impacts. We have developed a method to derive impact scores for individual research publications according to their contribution to answering questions of quantified importance to end users of research. To demonstrate the approach, here we evaluate the impacts of research into means of conserving wild bee populations in the UK. For published papers, there is a weak positive correlation between our impact score and the impact factor of the journal. The process identifies publications that provide high quality evidence relating to issues of strong concern. It can also be used to set future research agendas.

Evoked prior learning experience and approach to learning as predictors of academic achievement

Background. In separate studies and research from different perspectives, five factors are found to be among those related to higher quality outcomes of student learning (academic achievement). Those factors are higher self-efficacy, deeper approaches to learning, higher quality teaching, students’ perceptions that their workload is appropriate, and greater learning motivation. University learning improvement strategies have been built on these research results. Aim. To investigate how students’ evoked prior experience, perceptions of their learning environment, and their approaches to learning collectively contribute to academic achievement. This is the first study to investigate motivation and self-efficacy in the same educational context as conceptions of learning, approaches to learning and perceptions of the learning environment. Sample. Undergraduate students (773) from the full range of disciplines were part of a group of over 2,300 students who volunteered to complete a survey of their learning experience. On completing their degrees 6 and 18 months later, their academic achievement was matched with their learning experience survey data. Method. A 77-item questionnaire was used to gather students’ self-report of their evoked prior experience (self-efficacy, learning motivation, and conceptions of learning), perceptions of learning context (teaching quality and appropriate workload), and approaches to learning (deep and surface). Academic achievement was measured using the English honours degree classification system. Analyses were conducted using correlational and multi-variable (structural equation modelling) methods. Results. The results from the correlation methods confirmed those found in numerous earlier studies. The results from the multi-variable analyses indicated that surface approach to learning was the strongest predictor of academic achievement, with self-efficacy and motivation also found to be directly related. In contrast to the correlation results, a deep approach to learning was not related to academic achievement, and teaching quality and conceptions of learning were only indirectly related to achievement. Conclusions. Research aimed at understanding how students experience their learning environment and how that experience relates to the quality of their learning needs to be conducted using a wider range of variables and more sophisticated analytical methods. In this study of one context, some of the relations found in earlier bivariate studies, and on which learning intervention strategies have been built, are not confirmed when more holistic teaching–learning contexts are analysed using multi-variable methods.

Teaching English to speakers of other languages teachers’ views on the relationship between research and practice

This paper reports on a study investigating teachers’ views and beliefs about the relationship between second language (L2) research and practice. Although a gap has been frequently reported between the two, there is little empirical data to show what teachers’ views on this relationship are or how these views and beliefs influence their use of research. A total of 60 TESOL1 teachers in England responded to a questionnaire which sought both qualitative and quantitative data. Results of the data analysis suggest that although their views on research and its usefulness are positive, teachers are mainly sceptical about the practicality and relevance of L2 research. More importantly, they expect research to originate from rather than end in classrooms and maintain that the prime responsibility of bringing research and practice together is to be shared by teacher training programmes and educational policies of the institutions they work in. Our analysis of the data further implies that there are differences between teachers’ epistemological assumptions and the more established notions of research.

The ideal self at play: the appeal of video games that let you be all you can be

Video games constitute a popular form of entertainment that allows millions of people to adopt virtual identities. In our research, we explored the idea that the appeal of games is due in part to their ability to provide players with novel experiences that let them “try on” ideal aspects of their selves that might not find expression in everyday life. We found that video games were most intrinsically motivating and had the greatest influence on emotions when players’ experiences of themselves during play were congruent with players’ conceptions of their ideal selves. Additionally, we found that high levels of immersion in gaming environments, as well as large discrepancies between players’ actual-self and ideal-self characteristics, magnified the link between intrinsic motivation and the experience of ideal-self characteristics during play.

Participatory research approaches in the development of improved management practices in indigenous chickens production systems with smallholder farmers in Kenya

This thesis is concerned with development of improved management practices in indigenous chicken production systems in a research process that includes participatory approaches with smallholder farmers and other stakeholders in Kenya. The research process involved a wide range of activities that included on-station experiments, field surveys, stakeholder consultations in workshops, seminars and visits, and on-farm farmer participatory research to evaluate the effect of some improved management interventions on production performance of indigenous chickens. The participatory research was greatly informed from collective experiences and lessons of the previous activities. The on-station studies focused on hatching, growth and nutritional characteristics of the indigenous chickens. Four research publications from these studies are included in this thesis. Quantitative statistical analyses were applied and they involved use of growth models estimated with non-linear regressions for the growth characteristics, chi-square determinations to investigate differences among different reciprocal crosses of indigenous chickens and general linear models and covariance determination for the nutrition study. The on-station studies brought greater understanding of performance and production characteristics of indigenous chickens and the influence of management practices on these characteristics. The field surveys and stakeholder consultations helped in understanding the overarching issues affecting the productivity of the indigenous chickens systems and their place in the livelihoods of smallholder farmers. These activities created strong networking opportunities with stakeholders from a wide spectrum. The on-farm farmer participatory research involved selection of 200 farmers in five regions followed by training and introduction of interventions on improved management practices which included housing, vaccination, deworming and feed supplementation. Implementation and monitoring was mainly done by individual farmers continuously for close to one and half years. Six quarterly visits to the farms were made by the research team to monitor and provide support for on-going project activities. The data collected has been analysed for 5 consecutive 3-monthly periods. Descriptive and inferential statistics were applied to analyse the data collected involving treatment applications, production characteristics and flock demography characteristics. Out of the 200 farmers initially selected, 173 had records on treatment applications and flock demography characteristics while 127 farmers had records on production characteristics. The demographic analysis with a dissimilarity index of flock size produced 7 distinct farm groups from among the 173 farms. Two of these farm groups were represented in similar numbers in each of the five regions. The research process also involved a number of dissemination and communication strategies that have brought the process and project outcomes into the domain of accessibility by wider readership locally and globally. These include workshops, seminars, field visits and consultations, local and international conferences, electronic conferencing, publications and personal communication via emailing and conventional posting. A number of research and development proposals were also developed based on the knowledge and experiences gained from the research process. The thesis captures the research process activities and outcomes in 8 chapters which include in ascending order – introduction, theoretical concepts underpinning FPR, research methodology and process, on-station research output, FPR descriptive statistical analysis, FPR inferential statistical analysis on production characteristics, FPR demographic analysis and conclusions. Various research approaches both quantitative and qualitative have been applied in the research process indicating the possibilities and importance of combining both systems for greater understanding of issues being studied. In our case, participatory studies of the improved management of indigenous chickens indicates their potential importance as livelihood assets for poor people.

Multilevel research in the field of organizational behavior: an empirical look at 10 years of theory and research

During the last 30 years, significant debate has taken place regarding multilevel research. However, the extent to which multilevel research is overtly practiced remains to be examined. This article analyzes 10 years of organizational research within a multilevel framework (from 2001 to 2011). The goals of this article are (a) to understand what has been done, during this decade, in the field of organizational multilevel research and (b) to suggest new arenas of research for the next decade. A total of 132 articles were selected for analysis through ISI Web of Knowledge. Through a broad-based literature review, results suggest that there is equilibrium between the amount of empirical and conceptual papers regarding multilevel research, with most studies addressing the cross-level dynamics between teams and individuals. In addition, this study also found that the time still has little presence in organizational multilevel research. Implications, limitations, and future directions are addressed in the end. Organizations are made of interacting layers. That is, between layers (such as divisions, departments, teams, and individuals) there is often some degree of interdependence that leads to bottom-up and top-down influence mechanisms. Teams and organizations are contexts for the development of individual cognitions, attitudes, and behaviors (top-down effects; Kozlowski & Klein, 2000). Conversely, individual cognitions, attitudes, and behaviors can also influence the functioning and outcomes of teams and organizations (bottom-up effects; Arrow, McGrath, & Berdahl, 2000). One example is when the rewards system of one organization may influence employees’ intention to quit and the existence or absence of extra role behaviors. At the same time, many studies have showed the importance of bottom-up emergent processes that yield higher level phenomena (Bashshur, Hernández, & González-Romá, 2011; Katz-Navon & Erez, 2005; Marques-Quinteiro, Curral, Passos, & Lewis, in press). For example, the affectivity of individual employees may influence their team’s interactions and outcomes (Costa, Passos, & Bakker, 2012). Several authors agree that organizations must be understood as multilevel systems, meaning that adopting a multilevel perspective is fundamental to understand real-world phenomena (Kozlowski & Klein, 2000). However, whether this agreement is reflected in practicing multilevel research seems to be less clear. In fact, how much is known about the quantity and quality of multilevel research done in the last decade? The aim of this study is to compare what has been proposed theoretically, concerning the importance of multilevel research, with what has really been empirically studied and published. First, this article outlines a review of the multilevel theory, followed by what has been theoretically “put forward” by researchers. Second, this article presents what has really been “practiced” based on the results of a review of multilevel studies published from 2001 to 2011 in business and management journals. Finally, some barriers and challenges to true multilevel research are suggested. This study contributes to multilevel research as it describes the last 10 years of research. It quantitatively depicts the type of articles being written, and where we can find the majority of the publications on empirical and conceptual work related to multilevel thinking.

Synapses in digital medium: computational investigations of neural basis of anticipation

Anticipation is an emerging concept that can provide a bridge between the deepest philosophical theories about the nature of life and cognition on one hand and the empirical biological sciences steeped in reductionist and Newtonian conception of causality. Three conceptions of anticipation have been emerging from the literature that may be operationalised in a way leading to a viable empirical programme. The discussion of the research into a novel dynamical concept of anticipating synchronisation lends credence to such a possibility and suggests further links between the three anticipation paradigms. A careful progress mindful to the deep philosophical concerns but also respecting empirical evidence will ultimately lead towards unifying theoretical and empirical biological sciences and may offer progress where reductionist science have been so far faltering.

Children’s conceptions about mathematics and mathematics education

This paper deals with younger students’ (grade 2 and 5) conceptions about mathematics and mathematics education. The questionnaire consisted of three parts: (1) statements with a Likert-scale; (2) open-end questions where the students could explain further their conceptions; and, (3) a request to draw a picture of yourself doing mathematics. The results from the statements were summarised and the pictures were analysed. Most students in grade 2 had a positive attitude towards mathematics whereas a larger proportion in grade 5 gave negative answers. All students presented mathematics as an individual activity with a focus on the textbook. The elder students narrow the activity down to calculating. A post-questionnaire confirmed the results.

A modest start, but a steady rise in research use : A longitudinal study of nurses during the first five years in professional life

Background: Newly graduated nurses are faced with a challenging work environment that may impede theirability to provide evidence-based practice. However, little is known about the trajectory of registered nurses’ use ofresearch during the first years of professional life. Thus, the aim of the current study was to prospectively examinethe extent of nurses’ use of research during the first five years after undergraduate education and specifically assesschanges over time.Method: Survey data from a prospective cohort of 1,501 Swedish newly graduated nurses within the nationalLANE study (Longitudinal Analyses of Nursing Education and Entry in Worklife) were used to investigate perceiveduse of research over the first five years as a nurse. The dependent variables consisted of three single itemsassessing instrumental, conceptual, and persuasive research use, where the nurses rated their use on a five-pointscale, from ‘never’ (1) to ‘on almost every shift’ (5). These data were collected annually and analyzed bothdescriptively and by longitudinal growth curve analysis.Results: Instrumental use of research was most frequently reported, closely followed by conceptual use, withpersuasive use occurring to a considerably lower extent. The development over time showed a substantial generalupward trend, which was most apparent for conceptual use, increasing from a mean of 2.6 at year one to 3.6 atyear five (unstandardized slope +0.25). However, the descriptive findings indicated that the increase started onlyafter the second year. Instrumental use had a year one mean of 2.8 and a year five mean of 3.5 (unstandardizedslope +0.19), and persuasive use showed a year one mean of 1.7 and a year five mean of 2.0 (unstandardized slope+0.09).Conclusion: There was a clear trend of increasing research use by nurses during their first five years of practice.The level of the initial ratings also indicated the level of research use in subsequent years. However, it took morethan two years of professional development before this increase ‘kicked in.’ These findings support previousresearch claiming that newly graduated nurses go through a ‘transition shock,’ reducing their ability to useresearch findings in clinical work.

The problem of postoperative pain: issues for future research

Uncontrolled postoperative pain continues despite abundant research in the area. The purposes of the paper are to review how past research influences our understanding of pain in the postsurgery context and to argue for a methodological shift towards naturalistic inquiry. Such a shift incorporates the complexities of pain assessment and management in the clinical practice environment. Decisions regarding pain are often examined outside of the contextual concerns of clinical practice. Research approaches have involved analyses of nurse and patient-related factors associated with pain. These approaches do not account for complex interactions that occur between nurses, patients and the dynamic environment in which these interactions take place. The failure of research to address the context of pain decisions has several implications. It limits our understanding of why pain continues despite ongoing research and it does not enable evaluation of clinical strategies to improve pain decision-making and pain outcomes for patients.

What does it meme? The exegesis as valorisation and validation of creative arts research

This paper will draw on Richard Dawkin's idea of the 'meme' to discuss how the creative arts exegesis can operate as valorisation and validation of creative arts research. According to Dawkins, the rate and fecundity of replication permits an artefact to achieve recognition and stability as a meme within a culture. The value and application of traditional forms of research is underpinned by a secondary order of production, publication, that establishes visibility of the work and articulates its empirical processes and findings as sources of social benefit and cultural enhancement.

In the arts, conventional modes of valorisation such as the gallery system, reviews and criticism focus on the artistic product and hence, lack sustained engagement with the creative processes as models of research. Such engagement is necessary to articulate and validate studio practices as modes of enquiry.

A crucial question to initiate this engagement is: 'What did the studio process reveal that could not have been revealed by any other mode of enquiry?'

Re-versioning of the studio process and its significant moments through the exegesis locates the work within the broader field of practice and theory. It is also part of the replication process that establishes the creative arts as a stable research discipline, able to withstand peer and wider assessment. The exegesis is a primary means of realising creative arts research as 'meme'.

Design, format, validity and reliability of mutiple choice questions for use in nursing research and education

Multiple choice questions are used extensively in nursing research and education and play a fundamental role in the design of research studies or educational programs. Despite their widespread use, there is a lack of evidence-based guidelines relating to design and use of multiple choice questions. Little is written about their format, structure, validity and reliability of in the context of nursing research and/or education and most of the current literature in this area is based on opinion or consensus. Systematic multiple choice question design and use of valid and reliable multiple choice questions are vital if the results of research or educational testing are to be considered valid. Content and face validity schould be established by expert panel review and construct validity should be established using ‘key check’, item discrimination and item difficulty analyses. Reliability measures include internal consistency and equivalence. Internal consistency should be established by determination of internal consistency using reliability coefficients while equivalence should be established using alternate form correlation. This paper reviews literature related to the use of multiple choice questions, current design recommendations and processes to establish reliability and validity, and discusses implications for their use in nursing research and education.

Foucault's 'What is an author' : towards a critical discourse of practice as research

A vexed issue for many artistic researchers is related to the need for the artist/researcher to write about his or her own work in the research report or exegesis. In the creative arts, the outcomes that emerge from an alternative logic of practice are not easily quantifiable and it can be difficult to articulate conclusions objectively given the emotional and ideological investments and the intrinsically subjective dimension of the artistic process. How then, might the artist as researcher avoid on the one hand, what has been referred to as 'auto-connoisseurship', the undertaking of a thinly veiled labour of valorising what has been achieved in the creative work, or alternatively producing a research report that is mere description or history?

In this paper I suggest that a way of overcoming such a dilemma is for creative arts researchers to shift the critical focus away from the notion of the work as product, to an understanding of both studio enquiry and its outcomes as process. I’d like to draw on Michel Foucault’s essay ‘What is An Author ‘ to explore how we might move away from art criticism to the notion of a critical discourse of practice-led enquiry that involves viewing the artist as a researcher, and the artist/critic as a scholar who comments on the value of the artistic process as the production of knowledge.

Foucault’s essay provides artistic researchers with a template for more objective and distanced discourse on the practice-led research process and its writing. It allows researchers to locate themselves within contexts of theory and practice and provides an analytical framework though which researchers might locate themselves and their work within the broader social arena and field of research, As I will show with reference to the work of Donna Haraway and a number of commentaries on Pablo Picasso’s Demioselles d’Avignon, an application of Foucault’s ideas need not negate those subjective and situated aspects of practice as research.

Participatory research in EE: some issues of epistemology and methodology

The conference theme of epistemology and methodology suggests an interest in epistemological issues in environmental education research. I have argued previously that for too long there seemed to be a blindness in environmental education research: that there was an unwarranted assumption that all research in environmental education was and should be conducted within an applied science conceptual framework that did not recognise nor problematise the epistemological assumptions of research. In this paper I intend to address the issue of epistemological coherence between the substantive subject matters of environmental education on the one hand and research, methodology on the other. The paper will draw upon two recent international environmental education projects to explore issues concerning the nature, status and role of research in environmental education. A number of features of community-based environment development projects in two different settings will be described, illustrating the complexity and contextuality of environmental issues as subject matters for environmental education. The implications for research that seeks to acknowledge and respect relationships within community contexts will be considered in relation to the following questions: Whose research agenda? The importance of project partnerships Participants' preconceptions about the nature of research. What is 'rigor' in participatory research in environmental education'?

Positivism: one ring to rule them all? A tale of information systems research methodology

The tale of research methodology in information systems is told through the fantasy of Tolkien’s Lord of the Rings. The tale is intended to be at once a piece of light hearted fun in its placement of the struggles of research methodology as an epic story but, in the tradition of the court jester, attempts to provide a new perspective on Information Systems (IS) research methodology and our struggles with positivism in particular. Our tale is one of developing a greater maturity and confidence in IS methodology and introduces postmodern methodologies to Information Systems. Our tale, our pastiche, is itself postmodern.