The use of 'queer' in criminal justice discourses

Within criminological literature, there are growing references to a 'queer/ed criminology'. To date, ‘queer criminology’ remains a loose collection of studies and criminal-justice related commentary that uses the term 'queer'. Amid the growing calls for the more substantial development of these criminological studies, it is timely to reflect on the ways that the term ‘queer’ has been used in these discourses, to what ends, and with what effects. This paper considers the manner in which the term 'queer' has been used in these criminological and criminal justice discourses. It suggests that ‘queer’ has been used in two dominant ways: as an 'umbrella' term for lesbian, gay, bisexual, intersex, and queer-identified people; and to signify the use of theoretical tools with which to represent sexuality- and gender-diverse people more effectively within criminological research. The paper will argue that these ways of using ‘queer’ have a variety of implications and effects. Specifically, using ‘queer’ as an umbrella term has the potential to reinforce identity categories and the politics that surround identities (a critique that has often appeared in queer contexts), while using it as a theoretical tool potentially reproduces various investments in criminology and criminal justice institutions. Both uses may preclude other productive avenues for critique opened up by the term ‘queer’. The paper will conclude by suggesting that using ‘queer’ as a verb to signify a more deconstructive project directed towards criminology is a possible direction for these discussions. While this approach has its own effects, and articulates with existing deconstructive approaches in criminology, it is important to explore these possibilities at this point in the development of a ‘queer/ed criminology’ for two reasons: it highlights that multiple, and often competing, ‘queer/ed criminologies’ exist; and it expands the diverse possibilities heralded by the notion of ‘queer’.

Students' perceptions of teacher biases : experimental economics in schools

We put forward a new experimental economics design with monetary incentives to estimate students’ perceptions of grading discrimination. We use this design in a large field experiment which involved 1,200 British students in grade 8 classrooms across 29 schools. In this design, students are given an endowment they can invest on a task where payoff depends on performance. The task is a written verbal test which is graded non anonymously by their teacher, in a random half of the classrooms, and graded anonymously by an external examiner in the other random half of the classrooms. We find significant evidence that students’ choices reflect perceptions of biases in teachers’ grading practices. Our results show systematic gender interaction effects: male students invest less with female teachers than with male teachers while female students invest more with male teachers than with female teachers. Interestingly, female students’ perceptions are not in line with actual discrimination: Teachers tend to give better grades to students of their own gender. Results do not suggest that ethnicity and socioeconomic status play a role. .

Incongruence between self-reported and observed senior physical education teaching styles : an analysis using Mosston and Ashworth’s spectrum

Pedagogical styles, methods, models, practices or strategies are valued for what they claim they can achieve. In recent times curriculum documents and governments have called for a range of teaching approaches to meet the variety of learner differences and allow students to make more independent decision making in physical education (Hardy and Mawer, 1999). One well known system of categorizing teaching styles is the Mosston and Ashworth’s Spectrum of Teaching Styles (2002). In Queensland, prior to 2005, no research had been conducted on the teaching styles used by teachers of Physical Education. However, many teachers self-reported that they employed a variety of teaching styles depending on the aims and content of the material to be taught (Cothran, et al., 2005). This research, for the first time, collected teacher’s self-reported use of teaching styles and through observations verify the styles that were being used to teach Senior Physical Education in Queensland. More specifically the aims of the research were to determine: a) What teaching styles teachers of Senior Physical Education in Queensland believe they use? i) Were they using a range of teaching styles? ii) Were teachers of Senior Physical Education in Queensland using teaching styles that the Queensland Senior Physical Education Syllabus (2004) required? b) If Mosston and Ashworth’s (2002) Spectrum of Teaching Styles were used to categorise styles observed during the teaching of Senior Physical Education did the styles being used provide opportunities for evaluating as described by the Queensland Senior Physical Education Syllabus (2004)? The research was conducted in two phases. Part A involved use of a questionnaire to determine the teaching styles Queensland teachers of Senior Physical Education reported using and how often they reported using them. The questionnaire was administered to 110 teachers throughout Queensland. The sample was determined from 346 schools teaching Senior Physical Education (in 2006) across the state of Queensland, Australia. 286 questionnaires were sent to 77 non-randomised schools. There were 66 male and 44 female respondents in the sample. A wide range of teaching styles were reportedly used by teachers of Senior Physical Education with Practice Style-Style B, Command Style-Style A and Divergent Discovery Style-Style H, the most reportedly used. The Self-Teaching Style-Style K was reportedly used the least by teachers involved in this study. From the respondents a group of teachers were identified to form the participants for Part B. Part B of the study involved observation of a group of volunteer participants (from those who had completed the questionnaire) who displayed many of the ‘typical’ characteristics, and a cross-section of backgrounds, of teachers of Senior Physical Education in Queensland. In the case of this study, the criteria used to select the group of teachers to be observed teaching were, teaching experience (number of years: 0-4, 5-10 and 11 years and over), gender, geographical location of schools (focused on Brisbane and near area for travel/access purposes), profile of the students at schools (girls, boys or co-educational), nature of school (Government or Private) and the physical activities being taught in a school (activities to reflect all the areas of physical activity outlined within the syllabus). A total of 27 questionnaire respondents from Part A indicated that they were willing to be observed teaching practical lessons. The respondents who volunteered to be involved in Part B of the study came from different regions across the state of Queensland and was not confined to the Brisbane metropolitan area or large cities. From the group of people who volunteered for Part B four came from outside Brisbane and 23 from the Brisbane area. The final observation group of nine participants included eight teachers from the Brisbane area and one from a rural area. The characteristics of the final group included three females and six males from private and public schools with a range of teaching experience in years and a range of physical activities. Four year 12 and five year 11 teachers and their classes were videoed on three occasions as they progressed through an eight – nine week unit of work. This resulted in 24 hours 48 minutes and 20 seconds (or 4465 observations) of video teaching data which was subsequently coded by several researchers (99% interobserver reliability) to determine the teaching styles employed by the participants. This research indicated that, based on Mosston and Ashworth’s (2002) Spectrum of Teaching Styles, teachers of Senior Physical Education in Queensland used predominantly one style to teach 27 observed lessons. This is in sharp contrast to the variety of styles 110 teachers self- reportedly used and in spite of the Queensland Senior Physical Education Syllabus (2004) suggesting a range of specific styles be used. These results are discussed in the context of the Queensland Senior Physical Education Syllabus (2004), teacher knowledge of teaching styles and high-stakes curriculum and external pressures such as national testing and the publication of data from schools in tabloid newspapers. The data and findings in this research provide a rationale for improving teacher knowledge regarding teaching styles and the need for a clear definition of terminology in syllabus documents. Careful examination of the effects that the publishing of school data may have on teaching styles is advised. This research not only collected teacher’s perceptions of the teaching styles they believed they used it also verified these claims through direct observations of the teachers while teaching. These findings are relevant to syllabus writers, teacher educators, policy makers within education and teachers.

Modelling users' contextual querying behaviour for web image searching

The rapid growth of visual information on Web has led to immense interest in multimedia information retrieval (MIR). While advancement in MIR systems has achieved some success in specific domains, particularly the content-based approaches, general Web users still struggle to find the images they want. Despite the success in content-based object recognition or concept extraction, the major problem in current Web image searching remains in the querying process. Since most online users only express their needs in semantic terms or objects, systems that utilize visual features (e.g., color or texture) to search images create a semantic gap which hinders general users from fully expressing their needs. In addition, query-by-example (QBE) retrieval imposes extra obstacles for exploratory search because users may not always have the representative image at hand or in mind when starting a search (i.e. the page zero problem). As a result, the majority of current online image search engines (e.g., Google, Yahoo, and Flickr) still primarily use textual queries to search. The problem with query-based retrieval systems is that they only capture users’ information need in terms of formal queries;; the implicit and abstract parts of users’ information needs are inevitably overlooked. Hence, users often struggle to formulate queries that best represent their needs, and some compromises have to be made. Studies of Web search logs suggest that multimedia searches are more difficult than textual Web searches, and Web image searching is the most difficult compared to video or audio searches. Hence, online users need to put in more effort when searching multimedia contents, especially for image searches. Most interactions in Web image searching occur during query reformulation. While log analysis provides intriguing views on how the majority of users search, their search needs or motivations are ultimately neglected. User studies on image searching have attempted to understand users’ search contexts in terms of users’ background (e.g., knowledge, profession, motivation for search and task types) and the search outcomes (e.g., use of retrieved images, search performance). However, these studies typically focused on particular domains with a selective group of professional users. General users’ Web image searching contexts and behaviors are little understood although they represent the majority of online image searching activities nowadays. We argue that only by understanding Web image users’ contexts can the current Web search engines further improve their usefulness and provide more efficient searches. In order to understand users’ search contexts, a user study was conducted based on university students’ Web image searching in News, Travel, and commercial Product domains. The three search domains were deliberately chosen to reflect image users’ interests in people, time, event, location, and objects. We investigated participants’ Web image searching behavior, with the focus on query reformulation and search strategies. Participants’ search contexts such as their search background, motivation for search, and search outcomes were gathered by questionnaires. The searching activity was recorded with participants’ think aloud data for analyzing significant search patterns. The relationships between participants’ search contexts and corresponding search strategies were discovered by Grounded Theory approach. Our key findings include the following aspects: - Effects of users' interactive intents on query reformulation patterns and search strategies - Effects of task domain on task specificity and task difficulty, as well as on some specific searching behaviors - Effects of searching experience on result expansion strategies A contextual image searching model was constructed based on these findings. The model helped us understand Web image searching from user perspective, and introduced a context-aware searching paradigm for current retrieval systems. A query recommendation tool was also developed to demonstrate how users’ query reformulation contexts can potentially contribute to more efficient searching.

Establishing design thinking : accident, program frameworks and personal practices

Distribution through electronic media provides an avenue for promotion, recognition and an outlet of display for graphic designers. The emergence of available media technologies have enabled graphic designers to extend these boundaries of their practice. In this context the designer is constantly striving for aesthetic success and is strongly influenced by the fashion and trends of contemporary design work. The designer is always in a state of inquiry, finding pathways of discovery that lead to innovation and originality that are highly valued criteria for self-evaluation. This research is based on an analysis of the designer perspective and the processes used within an active graphic design practice specializing entirely within a digital collage domain. Contemporary design methodologies were critically examined, compared and refined to reflect the self-practice of the researcher. The refined methodology may assist designers in maintaining systematic work practices, as well as promote the importance of exploration and experimentation processes. Research findings indicate some differences in the identified methodologies and the design practice of the researcher in the sense that many contemporary designers are not confined to a client-base but are self-generating design images influenced by contemporary practitioners. As well as confirming some aspects of more conventional design processes, the researcher found that accidental discoveries and the designer’s interaction with technology plays a significant part in the design process.

Diurnal variation of ocular biometrics under natural and defocused conditions

It is well known that a broad range of ocular anatomical and physiological parameters undergo significant diurnal variation. However, the natural diurnal variations that occur in the length of the human eye (axial length) and their underlying causes have been less well studied. Improvements in optical methods for the measurement of ocular biometrics now allow more precise and comprehensive measurements of axial length to be performed than has previously been possible. Research from animal models also suggests a link between diurnal axial length variations and longer term myopic eye growth, and that retinal image defocus can disrupt these diurnal rhythms in axial length. This research programme has examined the diurnal variations in axial length in young normal eyes, the contributing components and the influence of optical stimuli on these changes. In the first experiment, the normal pattern and consistency of the diurnal variations in axial length were examined at 10 different times (5 measurements each day, at ~ 3-hour intervals from ~ 9 am to ~ 9 pm) over 2 consecutive days on 30 young adult subjects (15 myopes, 15 emmetropes). Additionally, variations in a range of other ocular biometric measurements such as choroidal thickness, intraocular pressure, and other ocular biometrics were also explored as potential factors that may be associated with the observed variations in axial length. To investigate the potential influence of refractive error on diurnal axial length variations, the differences in the magnitude and pattern of diurnal variations in axial length between the myopic and emmetropic subjects were examined. Axial length underwent significant diurnal variation that was consistently observed over the 2 consecutive days of measurements, with the longest axial length typically occurring during the day, and the shortest at night. Significant diurnal variations were also observed in choroidal thickness, IOP and other ocular biometrics (such as central corneal thickness, anterior chamber depth and vitreous chamber depth) of the eye. Diurnal variations in vitreous chamber depth, IOP (positive associations) and choroidal thickness (negative association) were all significantly correlated with the diurnal changes in axial length. Choroidal thickness was found to fluctuate approximately in antiphase to the axial length changes, with the average timing of the longest axial length coinciding with the thinnest choroid and vice versa. There were no significant differences in the ocular diurnal variations associated with refractive error. Given that the diurnal changes in axial length could be associated with the changes in the eye’s optical quality, whether the optical quality of the eye also undergoes diurnal variation in the same cohort of young adult myopes and emmetropes over 2 consecutive days was also examined. Significant diurnal variations were observed only in the best sphere refraction (power vector M) and in the spherical aberration of the eye over two consecutive days of testing. The changes in the eyes lower and higher order ocular optics were not significantly associated with the diurnal variations in axial length and the other measured ocular biometric parameters. No significant differences were observed in the magnitude and timing of diurnal variations in lower-order and higher-order optics associated with refractive error. Since the small natural fluctuations in the eye’s optical quality did not appear to be sufficient to influence the natural diurnal fluctuations in ocular biometric parameters, in the next experiment, the influence of monocular myopic defocus (+1.50 DS) upon the normal diurnal variations in axial length and choroidal thickness of young adult emmetropic human subjects (n=13) imposed over a 12 hour period was examined. A series of axial length and choroidal thickness measurements (collected at ~3 hourly intervals, with the first measurement at ~9 am and the final measurement at ~9 pm) were obtained over three consecutive days. The natural diurnal rhythms (Day 1, no defocus), diurnal rhythms with monocular myopic defocus (Day 2, +1.50 DS spectacle lens over the right eye), and the recovery from any defocus induced changes (Day 3, no defocus) were examined. Significant diurnal variations over the course of the day were observed in both axial length and choroidal thickness on each of the three measurement days. The introduction of monocular myopic defocus led to significant reductions in the mean amplitude of diurnal change, and phase shifts in the peak timing of the diurnal rhythms in axial length and choroidal thickness. These defocus induced changes were found to be transient in nature and returned to normal the day following removal of the defocus. To further investigate the influence of optical stimuli on human diurnal rhythms, in the final experiment, the influence of monocular hyperopic defocus on the normal diurnal rhythms in axial length and choroidal thickness was examined in young adult emmetropic subjects (n=15). Similar to the previous experiment, the natural diurnal rhythms (Day 1, no defocus), diurnal rhythms with monocular hyperopic defocus (Day 2, -2.00 DS spectacle lens over the right eye), and the recovery from any defocus induced changes (Day 3, no defocus) were examined over three consecutive days. Both axial length and choroidal thickness underwent significant diurnal variations on each of the three days. The introduction of monocular hyperopic defocus resulted in a significant increase in the amplitude of diurnal change, but no change in the peak timing of diurnal rhythms in both parameters. The ocular changes associated with hyperopic defocus returned to normal, the day following removal of the defocus. This research has shown that axial length undergoes significant diurnal variation in young adult human eyes, and has shown that the natural diurnal variations in choroidal thickness and IOP are significantly associated, and may underlie these diurnal fluctuations in axial length. This work also demonstrated for the first time that exposing young human eyes to monocular myopic and hyperopic defocus leads to a significant disruption in the normal diurnal rhythms of axial length and choroidal thickness. These changes in axial length with defocus may reflect underlying mechanisms in the human eye that are involved in the regulation of longer term eye growth.

Citizen motivation on the go : the role of psychological empowerment

Although advances in technology now enable people to communicate 'anytime, anyplace', it is not clear how citizens can be motivated to actually do so. This paper evaluates the impact of three principles of psychological empowerment, namely perceived self-efficacy, sense of community and causal importance, on public transport passengers' motivation to report issues and complaints while on the move. A week-long study with 65 participants revealed that self-efficacy and causal importance increased participation in short bursts and increased perceptions of service quality over longer periods. Finally, we discuss the implications of these findings for citizen participation projects and reflect on design opportunities for mobile technologies that motivate citizen participation.

(Re)-regulating care : employing foreign carers for older persons in Taiwan

The purpose of this research was to develop a theoretical understanding of the social phenomenon of the employment of foreign carers for older Taiwanese in households. Foreign carers were introduced into Taiwan in 1992 to address the care needs of the older population. By 2012, over 200,000 foreign caregivers from Indonesia, Philippines, and Vietnam were providing care in households in Taiwan. There has been little research on the interactions between and experiences of family employers, foreign carers and older persons receiving care. The theoretical framework brought together symbolic interactionist concepts and the social constructionism of Berger and Luckmann. Data collection and analysis were informed by Charmaz‘s formulation of grounded theory. Two focus groups and 54 in-depth interviews with a total of 57 Indonesian and Vietnamese foreign carers, Taiwanese family employers and older persons receiving care were undertaken. The analytical findings of the research reflect the ways in which the foreign carer, older persons receiving care and family employer participants were socially situated within the research context and how their respective social realities were shaped differently by changing social structures and cultural values within a globalising context. (Re)-regulating care was generated as the core category, forming a coherent and overarching framework that integrated the three analytical dimensions of the reality of the social change, resituating roles and struggling for control. The reality of social change refers to the employment of foreign carers as a manifestation of the reshaping of the social worlds of the three groups of participants. Resituating roles reflects the processes that underpin the hierarchical positioning of participants, the resultant asymmetrical power relations and associated interactions. Struggling for control, depicts how each group employed strategies to create space and identities that would sustain a sense of self and autonomy. In the current situation of economic and social change in Taiwan the three participant groups shared a desire for control. The autonomy of the women employers was negotiated through employment of foreign carers; for the foreign carers, a pragmatic decision to work abroad became a means for personal empowerment; and the older persons receiving care regained some authority through relationships with carers.

Qualitative criminology : Stories from the field

Qualitative researchers in the discipline of criminology perform a wide range of challenging tasks. They interview prisoners, police officers, magistrates and judges. They speak with survivors of domestic violence, and drink tea with the mothers of murdered children. They observe courts and communities, investigate the decision-making processes of juries and immerse themselves in the data they collect. They ask ‘big’ questions – ‘how do we criminalise the producers of toxic toys?’ – as well as ‘little’ questions – ‘what should I wear to conduct this interview?’ Qualitative Criminology: Stories from the Field brings to life the stories behind the research of both emerging and established scholars in Australian criminology. The book’s contributors provided honest, reflective, and decidedly unsanitised accounts of their qualitative research journeys - the lively tales of what really happens when conducting research of this nature, the stories that often make for parenthetical asides in conference papers but tend to be excised from journal articles. This book considers the gap between research methods and the realities of qualitative research. As such, it aims to help researchers and students who conduct qualitative criminological research reflect upon their role as researchers, and the practical, ideological and ethical issues which may arise in the course of their research. It is also a call to criminologists to make public the ‘failures’ and missteps of their research endeavours so that we can learn from one another and become better informed and more reflexive qualitative criminologists.

Introducing Masculinity Studies to Information Systems research : the case of Gaydar

I believe that studies of men's gendered experiences of information systems are needed. In order to support this claim, I introduce the area of Masculinity Studies to Information Systems research and, using this, present an exploratory analysis of an internet dating website for gay men – Gaydar. The information system, which forms part of the Gaydar community, is shown to shape, and be shaped by the members as they accept and challenge aspects of it as related to their identities. In doing this, I show how the intertwined processes of information systems development and use contribute to the creation of diverse interpretations of masculinity within a group of men. In sum, my analysis highlights different kinds of men and different versions of masculinity that can sometimes be associated with different experiences of information systems. The implications of this work centre on the need to expand our knowledge of men's gendered experiences with information systems, to reflect upon processes of technology facilitated categorisation and to consider the influences that contribute to the roll out of particular software features along with the underlying rationales for market segmentation in the software and software-based services industries.

Critical reflection on the SIA’s professional project and the body of knowledge

Over the last few years the Safety Institute of Australia (SIA) has developed and implemented a number of strategies to gain professional status for the ‘generalist occupational health and safety professional’. Two of the most significant developments have been the publication of the ‘Core Body of Knowledge for the Generalist OHS Professional.’ and the accreditation of university OHS courses. Despite a considerable amount of work aimed at gaining professional status there has not been any public debate or reflection about how the professionalisation project may impact on OHS and how the project is being conducted. Professionalisation has been vigorously promoted as a sign of maturity for the SIA and which will provide unmitigated benefits for workplace health and safety. The aim of this paper is to critically reflect on the processes of professionalisation (the professional project) and discuss some of the ways in which this project may shape the field of occupational health and safety. The implications for the role of universities will also be discussed.

Using real-time authentic online learning scenarios to teach criminal intelligence

Criminal intelligence is an area of expertise highly sought-after internationally and within a variety of justice-related professions; however, producing university graduates with the requisite professional knowledge, as well as analytical, organisational and technical skills presents a pedagogical and technical challenge to university educators. The situation becomes even more challenging when students are undertaking their studies by distance education. This best practice session showcases the design of an online undergraduate unit for final year justice students which uses an evolving real-time criminal scenario as the focus of authentic learning activities in order to prepare students for graduate roles within the criminal intelligence and justice professions. Within the unit, students take on the role of criminal intelligence analysts, applying relevant theories, models and strategies to solve a complex but realistic crime and complete briefings and documentation to industry standards as their major summative assessment task. The session will demonstrate how the design of the online unit corresponds to authentic learning principles, and will specifically map the elements of the unit design to Herrington & Oliver’s instructional design framework for authentic learning (2000; Herrington & Herrington 2006). The session will show how a range of technologies was used to create a rich learning experience for students that could be easily maintained over multiple unit iterations without specialist technical support. The session will also discuss the unique pedagogical affordances and challenges implicated in the location of the unit within an online learning environment, and will reflect on some of the lessons learned from the development which may be relevant to other authentic online learning contexts.

Using real-time authentic online learning scenarios to teach criminal intelligence : presentation

Criminal intelligence is an area of expertise highly sought-after internationally and within a variety of justice-related professions; however, producing university graduates with the requisite professional knowledge, as well as analytical, organisational and technical skills presents a pedagogical and technical challenge to university educators. The situation becomes even more challenging when students are undertaking their studies by distance education. This best practice session showcases the design of an online undergraduate unit for final year justice students which uses an evolving real-time criminal scenario as the focus of authentic learning activities in order to prepare students for graduate roles within the criminal intelligence and justice professions. Within the unit, students take on the role of criminal intelligence analysts, applying relevant theories, models and strategies to solve a complex but realistic crime and complete briefings and documentation to industry standards as their major summative assessment task. The session will demonstrate how the design of the online unit corresponds to authentic learning principles, and will specifically map the elements of the unit design to Herrington & Oliver’s instructional design framework for authentic learning (2000; Herrington & Herrington 2006). The session will show how a range of technologies was used to create a rich learning experience for students that could be easily maintained over multiple unit iterations without specialist technical support. The session will also discuss the unique pedagogical affordances and challenges implicated in the location of the unit within an online learning environment, and will reflect on some of the lessons learned from the development which may be relevant to other authentic online learning contexts.

Designing an innovative approach to engage students in learning science : the evolving case of hybridized writing

Innovations are usually attributed to ideas generated in the minds of individuals. As we reflect upon the evolving design of an online project to engage students in learning science through hybridized writing activities we propose a more distributed view of the process of innovative design. That is, our experience suggests ideas are generated in the activity of interacting with human and material resources that expand and constrain possibilities. This project is innovative in that it is a new educational response to the problem of disengagement of students in science, and has proven to be effective in changing classroom practice and improving students’ scientific literacy. In this chapter, we identify the antecedents and trace the evolution of the project. This account illuminates the innovative design process, presents a summary of the evidence for the effectiveness of the project, and identifies future directions for further development and research. Keywords: Science learning, hybridized writing, case study, innovative approach

Time to change consumer involvement in nursing research

The experiences of people affected by cancer are at the very heart of nursing research efforts. Because much of our work is focused on understanding how to improve experiences and outcomes for people with cancer, it is easy for us to believe that our research is inherently "person centered" and thus collaborative. Let's reflect on what truly collaborative approaches to cancer nursing research could be like, and how we measure up to such goals. Collaboration between people affected by cancer (consumers) and nurses in research is much more than providing a voice for individuals as participants in a research study. Today, research governing bodies in many countries require us to seek a different kind of consumer participation, where consumers and researchers work in partnership with one another to shape decisions about research priorities, policies, and practices.1 Most granting bodies now require explanations of how consumer and community participation will occur within a study. Ethical imperatives and the concept of patient advocacy also require that we give more considered attention to what is meant by consumer involvement.2 Consumers provide perspective on what will be relevant, acceptable, feasible, and sensitive research, having lived the experience of cancer. As a result, they offer practical insights that can ensure the successful conduct and better outcomes from research. Some granting bodies now even allocate a proportion of final score or assign a "public value" weighting for a grant, to recognize the importance of consumer involvement and reflect the quality of patient involvement in all stages of the research process.3