Appraising qualitative research for inclusion in systematic reviews:A quantitative and qualitative comparison of three methods

Objective: Qualitative research is increasingly valued as part of the evidence for policy and practice, but how it should be appraised is contested. Various appraisal methods, including checklists and other structured approaches, have been proposed but rarely evaluated. We aimed to compare three methods for appraising qualitative research papers that were candidates for inclusion in a systematic review of evidence on support for breast-feeding. Method: A sample of 12 research papers on support for breast-feeding was appraised by six qualitative reviewers using three appraisal methods: unprompted judgement, based on expert opinion; a UK Cabinet Office quality framework; and CASP, a Critical Appraisal Skills Programme tool. Papers were assigned, following appraisals, to 1 of 5 categories, which were dichotomized to indicate whether or not papers should be included in a systematic review. Patterns of agreement in categorization of papers were assessed quantitatively using κ statistics, and qualitatively using cross-case analysis. Results: Agreement in categorizing papers across the three methods was slight (κ =0.13; 95% CI 0.06-0.24). Structured approaches did not appear to yield higher agreement than that by unprompted judgement. Qualitative analysis revealed reviewers' dilemmas in deciding between the potential impact of findings and the quality of the research execution or reporting practice. Structured instruments appeared to make reviewers more explicit about the reasons for their judgements. Conclusions: Structured approaches may not produce greater consistency of judgements about whether to include qualitative papers in a systematic review. Future research should address how appraisals of qualitative research should be incorporated in systematic reviews. © The Royal Society of Medicine Press Ltd 2007.

An empirical examination of emotional and cognitive responses to threat appeals

Advertising and other forms of communications are often used by government bodies, non-government organisations, and other institutions to try to influence the population to either a) reduce some form of harmful behaviour (e.g. smoking, drunk- driving) or b) increase some more healthy behaviour (e.g. eating healthily). It is common for these messages to be predicated on the chances of some negative event occurring if the individual does not either a) stop the harmful behaviour, or b) start / increase the healthy behaviour. This design of communication is referred to by many names in the relevant literature, but for the purposes of this thesis, will be termed a ‘threat appeal’. Despite their widespread use in the public sphere, and concerted academic interest since the 1950s, the effectiveness of threat appeals in delivering their objective remains unclear in many ways. In a detailed, chronological and thematic examination of the literature, two assumptions are uncovered that have either been upheld despite little evidence to support them, or received limited attention at all, in the literature. Specifically, a) that threat appeal characteristics can be conflated with their intended responses, and b) that a threat appeal always and necessarily evokes a fear response in the subject. A detailed examination of these assumptions underpins this thesis. The intention is to take as a point of departure the equivocality of empirical results, and deliver a novel approach with the objective of reducing the confusion that is evident in existing work. More specifically, the present thesis frames cognitive and emotional responses to threat appeals as part of a decision about future behaviour. To further develop theory, a conceptual framework is presented that outlines the role of anticipated and anticipatory emotions, alongside subjective probabilities, elaboration and immediate visceral emotions, resultant from manipulation of the intrinsic message characteristics of a threat appeal (namely, message direction, message frame and graphic image). In doing so, the spectrum of relevant literature is surveyed, and used to develop a theoretical model which serves to integrate key strands of theory into a coherent model. In particular, the emotional and cognitive responses to the threat appeal manipulations are hypothesised to influence behaviour intentions and expectations pertaining to future behaviour. Using data from a randomised experiment with a sample of 681 participants, the conceptual model was tested using analysis of covariance. The results for the conceptual framework were encouraging overall, and also with regard to the individual hypotheses. In particular, empirical results showed clearly that emotional responses to the intrinsic message characteristics are not restricted to fear, and that different responses to threat appeals were clearly attributed to specific intrinsic message characteristics. In addition, the inclusion of anticipated emotions alongside cognitive appraisals in the framework generated interesting results. Specifically, immediate emotions did not influence key response variables related to future behaviour, in support of questioning the assumption of the prominent role of fear in the response process that is so prevalent in existing literature. The findings, theoretical and practical implications, limitations and directions for future research are discussed.

A new appraisal-based framework underlying hope in conflict resolution

Hope is a positive emotion that plays a pivotal role in intractable conflicts and conflict resolution processes by inducing conciliatory attitudes for peace. As a catalyser for conflict resolution, it is important to further understand hope in such contexts. In this paper we present a novel framework for understanding hope in contexts of intergroup conflict. Utilizing appraisal theory of emotions and heavily relying on the implicit theories framework, we describe three targets upon which hope appraisals focus in intractable conflict - the conflict, the outgroup, and the ingroup. Next, we describe the importance of developing ways to experimentally induce hope, and utilize the appraisal-target framework to describe and classify existing and potential interventions for inducing hope in intractable conflict resolution.

Navigating health sources on the Internet: A mixed-methods examination of online consumer reviews and expert text on psychotropic drugs

Purpose. The Internet has provided an unprecedented opportunity for psychotropic medication consumers, a traditionally silenced group in clinical trial research, to have voice by contributing to the construction of drug knowledge in an immediate, direct manner. Currently, there are no systematic appraisals of the potential of online consumer drug reviews to contribute to drug knowledge. The purpose of this research was to explore the content of drug information on various websites representing themselves as consumer- and expert-constructed, and as a practical consideration, to examine how each source may help and hinder treatment decision-making.^ Methodology. A mixed-methods research strategy utilizing a grounded theory approach was used to analyze drug information on 5 exemplar websites (3 consumer- and 2 expertconstructed) for 2 popularly prescribed psychotropic drugs (escitalopram and quetiapine). A stratified simple random sample was used to select 1,080 consumer reviews from the websites (N=7,114) through February 2009. Text was coded using QDA Miner 3.2 software by Provalis Research. A combination of frequency tables, descriptive excerpts from text, and chi-square tests for association were used throughout analyses.^ Findings. The most frequently mentioned effects by consumers taking either drug were related to psychological/behavioral symptoms and sleep. Consumers reported many of the same effects as found on expert health sites, but provided more descriptive language and situational examples. Expert labels of less serious on certain effects were not congruent with the sometimes tremendous burden described by consumers. Consumers mentioned more than double the themes mentioned in expert text, and demonstrated a diversity and range of discourses around those themes.^ Conclusions. Drug effects from each source were complete relative to the information provided in the other, but each also offered distinct advantages. Expert health sites provided concise summaries of medications’ effects, while consumer reviews had the added advantage of concrete descriptions and greater context. In short, consumer reviews better prepared potential consumers for what it’s like to take psychotropic drugs. Both sources of information benefit clinicians and consumers in making informed treatment-related decisions. Social work practitioners are encouraged to thoughtfully utilize online consumer drug reviews as a legitimate additional source for assisting clients in learning about treatment options.^

The Use of Performance Appraisal Systems in Restaurants

Do restaurant managers commonly use performance appraisals and, if so, how frequently anf for what purposes? The authors address these questions and review the restaurant industry in general.

Is there really "nothing you can do"? Pathways to enhanced flood-risk preparedness

Whilst policy makers have tended to adopt an ‘information-deficit model’ to bolster levels of flood-risk preparedness primarily though communication strategies promoting awareness, the assumed causal relation between awareness and preparedness is empirically weak. As such, there is a growing interest amongst scholars and policy makers alike to better understand why at-risk individuals are underprepared. In this vein, empirical studies, typically employing quantitative methods, have tended to focus on exploring the extent to which flood-risk preparedness levels vary depending not only on socio-demographic variables, but also (and increasingly so) the perceptual factors that influence flood risk preparedness. This study builds upon and extends this body of research by offering a more solution-focused approach that seeks to identify how pathways to flood-risk preparedness can be opened up. Specifically, through application of a qualitative methodology, we seek to explore how the factors that negatively influence flood-risk preparedness can be addressed to foster a shift towards greater levels of mitigation behaviour. In doing so, we focus our analysis on an urban community in Ireland that is identified as ‘at risk’ of flash flooding and is currently undergoing significant flood relief works. In this regard, the case study offers an interesting laboratory to explore how attitudes towards flood-risk preparedness at the individual level are being influenced within the context of a flood relief scheme that is only partially constructed. In order to redress the dearth of theoretically informed qualitative studies in this field, we draw on Protection Motivation Theory (PMT) to help guide our analysis and make sense of our results. Our findings demonstrate that flood-risk preparedness can be undermined by low levels of efficacy amongst individuals in terms of the preparedness measures available to them and their own personal capacity to implement them. We also elucidate that the ‘levee effect’ can occur before engineered flood defences are fully constructed as the flood relief works within our case study are beginning to affect people’s perception of flood risk in the case study area. We conclude by arguing that 1) individuals’ coping appraisals need to be enhanced through communication strategies and other interventions which highlight that future floods may not replicate past events; and 2) the concept of residual risk needs to be communicated at all stages of a flood relief scheme, not just upon completion.

Professional Practice in Learning and Development: How to Design and Deliver Plans for the Workplace

Introduction The world is changing! It is volatile, uncertain, complex and ambiguous. As cliché as it may sound the evidence of such dynamism in the external environment is growing. Business-as-usual is more of the exception than the norm. Organizational change is the rule; be it to accommodate and adapt to change, or instigate and lead change. A constantly changing environment is a situation that all organizations have to live with. What makes some organizations however, able to thrive better than others? Many scholars and practitioners believe that this is due to the ability to learn. Therefore, this book on developing Learning and Development (L&D) professionals is timely as it explores and discusses trends and practices that impact organizations, the workforce and L&D professionals. Being able to learn and develop effectively is the cornerstone of motivation as it helps to address people’s need to be competent and to be autonomous (Deci & Ryan, 2002; Loon & Casimir, 2008; Ryan & Deci, 2000). L&D stimulates and empowers people to perform. Organizations that are better at learning at all levels; the individual, group and organizational level, will always have a better chance of surviving and performing. Given the new reality of a dynamic external environment and constant change, L&D professionals now play an even more important role in their organizations than ever before. However, L&D professionals themselves are not immune to the turbulent changes as their practices are also impacted. Therefore, the challenges that L&D professionals face are two-pronged. Firstly, in relation to helping and supporting their organization and its workforce in adapting to the change, whilst, secondly developing themselves effectively and efficiently so that they are able to be one-step ahead of the workforce that they are meant to help develop. These challenges are recognised by the CIPD, as they recently launched their new L&D qualification that has served as an inspiration for this book. L&D plays a crucial role at both strategic (e.g. organizational capability) and operational (e.g. delivery of training) levels. L&D professionals have moved from being reactive (e.g. following up action after performance appraisals) to being more proactive (e.g. shaping capability). L&D is increasingly viewed as a driver for organizational performance. The CIPD (2014) suggest that L&D is increasingly expected to not only take more responsibility but also accountability for building both individual and organizational knowledge and capability, and to nurture an organizational culture that prizes learning and development. This book is for L&D professionals. Nonetheless, it is also suited for those studying Human Resource Development HRD at intermediate level. The term ‘Human Resource Development’ (HRD) is more common in academia, and is largely synonymous with L&D (Stewart & Sambrook, 2012) Stewart (1998) defined HRD as ‘the practice of HRD is constituted by the deliberate, purposive and active interventions in the natural learning process. Such interventions can take many forms, most capable of categorising as education or training or development’ (p. 9). In fact, many parts of this book (e.g. Chapters 5 and 7) are appropriate for anyone who is involved in training and development. This may include a variety of individuals within the L&D community, such as line managers, professional trainers, training solutions vendors, instructional designers, external consultants and mentors (Mayo, 2004). The CIPD (2014) goes further as they argue that the role of L&D is broad and plays a significant role in Organizational Development (OD) and Talent Management (TM), as well as in Human Resource Management (HRM) in general. OD, TM, HRM and L&D are symbiotic in enabling the ‘people management function’ to provide organizations with the capabilities that they need.

High-Throughput Prediction of Acacia and Eucalypt Lignin Syringyl/Guaiacyl Content Using FT-Raman Spectroscopy and Partial Least Squares Modeling

High-throughput techniques are necessary to efficiently screen potential lignocellulosic feedstocks for the production of renewable fuels, chemicals, and bio-based materials, thereby reducing experimental time and expense while supplanting tedious, destructive methods. The ratio of lignin syringyl (S) to guaiacyl (G) monomers has been routinely quantified as a way to probe biomass recalcitrance. Mid-infrared and Raman spectroscopy have been demonstrated to produce robust partial least squares models for the prediction of lignin S/G ratios in a diverse group of Acacia and eucalypt trees. The most accurate Raman model has now been used to predict the S/G ratio from 269 unknown Acacia and eucalypt feedstocks. This study demonstrates the application of a partial least squares model composed of Raman spectral data and lignin S/G ratios measured using pyrolysis/molecular beam mass spectrometry (pyMBMS) for the prediction of S/G ratios in an unknown data set. The predicted S/G ratios calculated by the model were averaged according to plant species, and the means were not found to differ from the pyMBMS ratios when evaluating the mean values of each method within the 95 % confidence interval. Pairwise comparisons within each data set were employed to assess statistical differences between each biomass species. While some pairwise appraisals failed to differentiate between species, Acacias, in both data sets, clearly display significant differences in their S/G composition which distinguish them from eucalypts. This research shows the power of using Raman spectroscopy to supplant tedious, destructive methods for the evaluation of the lignin S/G ratio of diverse plant biomass materials. © 2015, The Author(s).

"Learning together, growing with family": the implementation and evaluation of a family support programme

The "Learning together, growing with family" programme is targeted to at-risk parents and children from 6 to 11 years old, with a preventive focus on promoting positive parent-child relationships. In this study, we examined the quality of the programme implementation and its influence on the programme results in a sample of 425 parents and 138 facilitators drawn from the first trial. Mixed methods were used, consisting of: parental self-reports on parenting dimensions, professionals' records on parental attendance and appraisals on six topics of the implementation process, and focus group discussions in which facilitators reported on the initial steps of the implementation. Results showed a high quality of implementation with respect to the group facilitator and the programme organization factors, followed by the coordination with services and the support facilities offered to participants and, finally, by the factors of fidelity and prior organization steps. Results of the focus groups confirmed that the prior steps were challenging and offered the more effective strategies. Better quality in the implementation factors predicted better parenting styles and parental competencies after the programme, as well as a higher attendance rate. In sum, this study demonstrates the importance of good implementation in at-risk contexts and provides some clues as to the key elements that moderate programme effectiveness.

The ethical ambivalence of resistant violence: notes from postcolonial south Asia

In the face of mounting militarism in south Asia, this essay turns to anti-state, ‘liberatory’ movements in the region that employ violence to achieve their political aims. It explores some of the ethical quandaries that arise from the embrace of such violence, particularly for feminists for whom political violence and militarism is today a moot point. Feminist responses towards resistant political violence have, however, been less straightforward than towards the violence of the state, suggesting a more ambivalent ethical position towards the former than the latter. The nature of this ambivalence can be located in a postcolonial feminist ethics that is conceptually committed to the use of political violence in certain, albeit exceptional circumstances on the basis of the ethical ends that this violence (as opposed to other oppressive violence) serves. In opening up this ethical ambivalence – or the ethics of ambiguity, as Simone de Beauvoir says – to interrogation and reflection, I underscore the difficulties involved in ethically discriminating between forms of violence, especially when we consider the manner in which such distinctions rely on and reproduce gendered modes of power. This raises particular problems for current feminist appraisals of resistant political violence as an expression of women's empowerment and ‘agency’.

Explaining psychological insulin resistance in adults with non-insulin-treated type 2 diabetes: the roles of diabetes distress and current medication concerns. Results from diabetes MILES-Australia.

AIMS: To investigate the contribution of general and diabetes-specific emotional wellbeing and beliefs about medicines in the prediction of insulin therapy appraisals in adults with non-insulin-treated type 2 diabetes. METHODS: The sample included Diabetes MILES-Australia cross-sectional survey participants whose primary diabetes treatment was oral hypoglycaemic agents (N=313; 49% women; mean±SD age: 57±9 years; diabetes duration: 7±6 years). They completed validated measures of beliefs about the 'harm' and 'overuse' of medications in general (BMQ General); 'concerns' about and 'necessity' of current diabetes medications (BMQ Specific); negative insulin therapy appraisals (ITAS); depression (PHQ-9); anxiety (GAD-7), and diabetes distress (DDS-17). Factors associated with ITAS Negative scores were examined using hierarchical multiple regressions. RESULTS: Twenty-two percent of the variance in ITAS Negative scores (52±10), was explained by: number of complications (β=-.15, p=.005), DDS-17 subscale 'emotional burden' (β=.23, p<.001), and 'concerns' about current diabetes treatment (β=.29, p<.001). General beliefs about medications and general emotional wellbeing did not contribute significantly to the model. CONCLUSIONS: Psychological insulin resistance may reflect broader distress about diabetes and concerns about its treatment but not general beliefs about medicines, depression or anxiety. Reducing diabetes distress and current treatment concerns may improve attitudes towards insulin as a potential therapeutic option.

Willingness to initiate insulin among adults with type 2 diabetes in Australian primary care: results from the Stepping Up Study

AIMS: To determine 'hypothetical willingness' to initiate insulin, and identify associated factors, among adults with type 2 diabetes (T2DM) in primary care for whom insulin is clinically indicated.

METHODS: Eligible participants were adults with T2DM with an HbA1c ≥7.5% (58mmol/mol) and prescribed maximum oral hypoglycaemic agents. A total of 261 participants were recruited from 74 Victorian general practices: mean age 62±10 years; 39% (n=103) women; diabetes duration 10±6 years; HbA1c 9.0±1.3% (75±14mmol/mol). Data collected by the Stepping Up Study: demographic and clinical characteristics, 'willingness' to initiate insulin, insulin appraisals, depressive symptoms, and diabetes-related distress. A multinomial regression investigated predictors of 'willingness'.

RESULTS: Nineteen percent (n=50) were 'very willing' to initiate insulin, if recommended. The final regression model (R(2)=.44, χ(2)(12) 145.91, p<.001) demonstrated higher socioeconomic status and less negative attitudes to insulin were associated with increased willingness to initiate insulin.

CONCLUSIONS: Among adults with T2DM for whom insulin is clinically indicated, only one in five are 'very willing' to begin insulin therapy. Independent of demographics, clinical factors and emotional wellbeing, insulin appraisals were associated with 'willingness'. This study highlights the importance of addressing attitudinal barriers to insulin therapy among adults with T2DM in primary care to improve insulin receptiveness.

Progress

The Savannah Valley Authority publishes this quarterly newsletter giving an update on various projects, meetings and developments going on in the Savannah Valley Region. This issue covers among other things, the Russell Project land appraisals, Savannah Lakes Village, wastewater treatment needs and regional grants.