A strategy to identify critical appraisal criteria for primary mixed-method studies

The practice of mixed-methods research has increased considerably over the last 10 years. While these studies have been criticized for violating quantitative and qualitative paradigmatic assumptions, the methodological quality of mixed-method studies has not been addressed. The purpose of this paper is to identify criteria to critically appraise the quality of mixed-method studies in the health literature. Criteria for critically appraising quantitative and qualitative studies were generated from a review of the literature. These criteria were organized according to a cross-paradigm framework. We recommend that these criteria be applied to a sample of mixed-method studies which are judged to be exemplary. With the consultation of critical appraisal experts and experienced qualitative, quantitative, and mixed-method researchers, further efforts are required to revise and prioritize the criteria according to importance.

Community identity as resource and context: A mixed method investigation of coping and collective action in a disadvantaged community

Community identities enhance well-being through the provision of social support and feelings of collective efficacy as well as by acting as a basis for collective action and social change. However, the precise mechanisms through which community identity acts to enhance well-being are complicated by stigmatisation which potentially undermines solidarity and collective action. The present research examines a real-world stigmatised community group in order to investigate: (1) the community identity factors that act to enhance well-being, and (2) the consequences of community identity for community action. Study 1 consisted of a household survey conducted in disadvantaged areas of Limerick city in Ireland. Participants (n=322) completed measures of community identification, social support, collective efficacy, community action, and psychological well-being. Mediation analysis indicated that perceptions of collective efficacy mediated the relationship between identification and well-being. However, levels of self-reported community action were low and unrelated to community identification. In Study 2, twelve follow–up multiple-participant interviews with residents and community group workers were thematically analysed, revealing high levels of stigmatisation and opposition to identity-related collective action. These findings suggest the potential for stigma to reduce collective action through undermining solidarity and social support.

Healthcare Staff Experience of Providing End-of-Life Care to Children: A Mixed Method Review

Background: Staff who provide end-of-life care to children not only have to deal with their own sense of loss, but also that of bereaved families. There is a dearth of knowledge on how they cope with these challenges.
Aim: The aim of this review is to explore the experiences of health care professionals who provide end-of-life care to children in order to inform the development of interventions to support them, thereby improving the quality of paediatric care for both children and their families.
Data sources: Searches included CINAHL, MEDLINE, Web of Science, EMBASE, PsychINFO, and The Cochrane Library in June 2015, with no date restrictions. Additional literature was uncovered from searching reference lists of relevant studies, along with contacting experts in the field of paediatric palliative care.
Design: This was a systematic mixed studies review. Study selection, appraisal and data extraction were conducted by two independent researchers. Integrative thematic analysis was used to synthesise the data.
Results: The 16 qualitative, six quantitative, and eight mixed-method studies identified included healthcare professionals in a range of settings. Key themes identified rewards and challenges of providing end-of-life care to children, the impact on staff’s personal and professional lives, coping strategies, and key approaches to help support staff in their role.
Conclusions: Education focusing on the unique challenges of providing end-of-life care to children and the importance of self-care, along with timely multidisciplinary debriefing are key strategies for improving healthcare staffs’ experiences, and as such the quality of care they provide.

The effectiveness of a nurse practitioner-led pain management team in long-term care: A mixed methods study

BACKGROUND: Considering the high rates of pain as well as its under-management in long-term care (LTC) settings, research is needed to explore innovations in pain management that take into account limited resource realities. It has been suggested that nurse practitioners, working within an inter-professional model, could potentially address the under-management of pain in LTC.

OBJECTIVES: This study evaluated the effectiveness of implementing a nurse practitioner-led, inter-professional pain management team in LTC in improving (a) pain-related resident outcomes; (b) clinical practice behaviours (e.g., documentation of pain assessments, use of non-pharmacological and pharmacological interventions); and, (c) quality of pain medication prescribing practices.

METHODS: A mixed method design was used to evaluate a nurse practitioner-led pain management team, including both a quantitative and qualitative component. Using a controlled before-after study, six LTC homes were allocated to one of three groups: 1) a nurse practitioner-led pain team (full intervention); 2) nurse practitioner but no pain management team (partial intervention); or, 3) no nurse practitioner, no pain management team (control group). In total, 345 LTC residents were recruited to participate in the study; 139 residents for the full intervention group, 108 for the partial intervention group, and 98 residents for the control group. Data was collected in Canada from 2010 to 2012.

RESULTS: Implementing a nurse practitioner-led pain team in LTC significantly reduced residents' pain and improved functional status compared to usual care without access to a nurse practitioner. Positive changes in clinical practice behaviours (e.g., assessing pain, developing care plans related to pain management, documenting effectiveness of pain interventions) occurred over the intervention period for both the nurse practitioner-led pain team and nurse practitioner-only groups; these changes did not occur to the same extent, if at all, in the control group. Qualitative analysis highlighted the perceived benefits of LTC staff about having access to a nurse practitioner and benefits of the pain team, along with barriers to managing pain in LTC.

CONCLUSIONS: The findings from this study showed that implementing a nurse practitioner-led pain team can significantly improve resident pain and functional status as well as clinical practice behaviours of LTC staff. LTC homes should employ a nurse practitioner, ideally located onsite as opposed to an offsite consultative role, to enhance inter-professional collaboration and facilitate more consistent and timely access to pain management.

Complexity of risk: Mixed methods approach to understanding youth risk and insecurity in post-conflict settings

In settings of intergroup conflict, identifying contextually-relevant risk factors for youth development in an important task. In Vukovar, Croatia, a city devastated during the war in former Yugoslavia, ethno-political tensions remain. The current study utilized a mixed method approach to identify two salient community-level risk factors (ethnic tension and general antisocial behavior) and related emotional insecurity responses (ethnic and non-ethnic insecurity) among youth in Vukovar. In Study 1, focus group discussions (N=66) with mother, fathers, and adolescents 11 to 15-years-old were analyzed using the Constant Comparative Method, revealing two types of risk and insecurity responses. In Study 2, youth (N=227, 58% male, M=15.88 SD=1.12 years old) responded to quantitative scales developed from the focus groups; discriminate validity was demonstrated and path analyses established predictive validity between each type of risk and insecurity. First, community ethnic tension (i.e., threats related to war/ethnic identity) significantly predicted ethnic insecurity for all youth (β=.41, p<.001). Second, experience with community antisocial behavior (i.e., general crime found in any context) predicted non-ethnic community insecurity for girls (β=.32, p<.05), but not for boys. These findings are the first to show multiple forms of emotional insecurity at the community level; implications for future research are discussed.

The general and specific effects of educational programmes aimed at promoting awareness of and respect for diversity among young children

This article reports the findings of a mixed-method evaluation of a pilot educational programme undertaken with 6-7 year olds in a sample of primary schools in England with the aim of increasing their awareness of and respect for diversity through theatre, workshops and related teacher-led classroom activities. The qualitative feedback from the teachers involved was extremely positive and encouraging and an analysis of the actual impact of the pilot programme on the children’s attitudes and awareness, using an experimental design, demonstrated some positive effects. In particular, the programme was found to increase the children’s general awareness of diversity and their ability to recognise instances of exclusion. While not a planned objective of the pilot programme, the evaluation also examined whether it had any effects on the children’s attitudes to specific differences, in this particular case racial differences. Interestingly, however, no evidence was found of any change in the children’s racial attitudes. With this in mind the article suggests that there is a need to distinguish between the general and specific effects of such educational programmes. The article considers the implications of this for future work in the area and also stresses the need to undertake more thorough and rigorous evaluations of such initiatives.

‘Stakeholders’ views of legal and advice services for people admitted to psychiatric hospital’

This paper describes a study that used a mixed method approach to elicit the views of a range of stakeholders about experiences of compulsory admission to psychiatric hospital, and the use of the Mental Health Review Tribunal (MHRT). The paper begins with an introduction to the background of the study, one that took place in Northern Ireland, a region in the UK with its own mental health legislation and policy. A review of literature is then presented. This highlights some of the disadvantages that service users and carers face when dealing with professionals during and following compulsory admission to hospital. This section concludes with an overview of literature on the MHRT in the UK. A range of methods was used to gather data from the following stakeholders: five service user and carer focus group interviews (n = 44); interviews with four lawyers experienced in Tribunal work; an interview with a legal member of the Tribunal; a survey of solicitors who identified themselves as equipped to carry out Tribunal work; interviews with three managers of organisations that provided patient advocacy services; letters to hospital managers requesting information provided to patients and carers. The findings reveal a number of themes associated with these experiences of compulsory admission to hospital and subsequent use of the Tribunal. Service users and carers generally found it difficult to access relevant information about rights, information provided by hospital managers was uneven and lawyers were often not familiar with processes associated with compulsory admission. There was a range of views about the Tribunal. Most respondents felt that the Tribunal was necessary and mostly satisfactory in the way it carried out its functions, but stakeholders raised a number of issues. Carers in particular felt that they should be more involved in decision-making processes, whereas lawyers tended to be focused on more technical, legal issues. Problems of regrading prior to the Tribunal and in examining medical evidence were highlighted by lawyers. There was an appeal for better information and advice by service users and carers, and recognition of the need for better training and education for lawyers. The paper concludes with a brief discussion about current mental health law in the UK, arguing that, in this context, professionals should more proactively use information and advice that can enable service users and carers to defend their rights. Keywords: compulsory mental health; law; legal and advice services

Psychic Distance, its Business Impact and Modes of Coping: A Study of British and Indian Partner SMEs

This paper reports one of the first investigations to analyze inter-partner perceptions of psychic distance between two countries. Its empirical focus is British and Indian SMEs engaged in business with each other. It examines different dimensions of psychic distance, their impact and modes of coping with them. Potential firm-level and individual influences are also taken into account. The paper aims to transcend some of the conceptual and methodological limitations of previous research on the subject and to identify the theoretical and practical implications that arise. A ‘mirror’ approach is applied, accessing both partners’ perceptions. These are assessed through a ‘mixed’ method combining quantitative measurement with qualitative interpretations. Psychic distance dimensions are found to vary in their impact on doing business with the other country, and there is also variation according to the firm’s sector. There is considerable asymmetry in British and Indian partners’ perceptions of psychic distance but the degree of difference between their psychic distance evaluations lacks predictive power. Culturally embedded psychic distance dimensions tend to have less impact and to be easier to cope with than institutionally embedded dimensions. Four categories of coping are identified. The principal theoretical implication of this study is that a contingency perspective needs to be adopted in the field of ‘distance’ research, taking account of factors such as a firm’s sector, and that this will require a more complex analytical framework that hitherto.

Meeting the Requirements of the CDM Regulations: Identification of Critical Success Factors of Small to Medium Sized Contractor’ Compliance in the UK Construction Industry

The Construction Design and Management (CDM) Regulations (2007) is one of the most important set of health and safety regulations in the construction industry today. The aim of this research is to examine critical success factors for CDM compliance in small to medium size contractors in the UK construction industry. The objectives of the research include the identification of critical barriers in doing so along with the identification of success factors where CDM is incorporated. A mixed method approach is adopted in the identification and categorisation of the various factors encompassing a literature review, interviews and questionnaire survey. The key finding which emerge is the lack of knowledge and understanding with regards the CDM regulations with the recommendation to encourage small and medium contractor compliance through illustrating the benefits attainable. The practicality of the research is evident based on the significant uptake in the CDM by larger contractors, yet the research indicates that further insight and guidance is required to educate and inform those working within small to medium sized contractors in the UK. Where such acknowledgement and compliance is adopted, it is envisaged that this sector will benefit from reduced incidents and accidents, increased productivity while ultimately leading to a safer and more productive industry as a whole.

Construction Disputes in Small to Medium Enterprises in Ireland during Recession: Identification of Critical Factors

Purpose - To identify the critical factors causing construction disputes in Small to Medium Enterprises (SMEs) in Ireland during the recent recession period of 2007 to 2013.
Design/Methodology/Approach - A mixed method approach incorporating a literature review, case studies and questionnaire survey, with results analysed using exploratory (data reduction) factor analysis.
Findings - The results indicate seven core critical factors which result in construction disputes in SMEs in Ireland during a recession: Payment and extras; Physical work conditions; Poor financial/legal practise; Changes to the agreed scope of works; Time overrun; Defects; and Requests for increase in speed of project and long-term defects.
Research Limitations/Implications - With Ireland emerging from the current economic recession and the prevalence of SMEs to the construction sector, it is essential to document the core critical factors of construction disputes which emerge within this particular segment of the built environment.
Practical Implications - To address the adversarial nature of the construction sector and the prevalence of SMEs, it is essential to identify and document the critical factors of construction disputes within this remit. It is envisaged that the results of this research will be acknowledged, and the recommendations adopted, by construction SMEs, particularly within Ireland, as they emerge from the economic recession.
Originality/Value - This paper fulfils a gap in knowledge with the emergence of the economic recession and the identification of critical factors of construction dispute within SMEs in the Irish construction industry.

A study to evaluate the introduction of simulation as a teaching strategy for the mental health and learning disability fields of nursing, in an undergraduate nursing curriculum within one higher education institution

High Fidelity Simulation or Human Patient Simulation is an educational strategy embedded within nursing curricula throughout many healthcare educational institutions. This paper reports on an evaluative study that investigated the views of a group of Year 2 undergraduate nursing students from the mental health and the learning disability fields of nursing (n = 75) in relation to simulation as a teaching pedagogy. The study took place in the simulation suite within a School of Nursing and Midwifery in the UK. Two patient scenarios were used for the session and participants completed a 22-item questionnaire consisting of three biographical information questions and a 19-item Likert scale. Descriptive statistics were employed to illustrate the data and non-parametric testing (Mann-Whitney U test) was employed to test a number of hypotheses. Overall students were positive about the introduction of patient scenarios using the human patient simulator into the undergraduate nursing curriculum. This study used a small, convenience sample in one institution and therefore the results obtained cannot be generalised to nursing education before further research can be conducted with larger samples and a mixed-method research approach. However these results provide encouraging evidence to support the use of simulation within the mental health and the learning disability fields of nursing, and the development and implementation of further simulations to complement the students’ practicum.

Evaluation of Video Presentation to Deliver Surgical Anatomy Teaching

Title Evaluation of Video Presentation to Deliver Surgical Anatomy Teaching

Authors Walsh I.K., Boohan M., Dorman A.

Objectives To evaluate the efficacy of newly introduced video presentation to deliver Surgical Anatomy teaching to undergraduate medical students.

Design and Setting Qualitative and quantitative study using questionnaires and focus groups, employing students undertaking the perioperative medicine module of the phase 4 undergraduate medical curriculum at Queen’s University Belfast.

Outcome Measures To determine:
(1) if video presentation is effective in delivering surgical anatomy teaching,
(2) student’s learning preferences regarding this teaching method.
Results The questionnaire response rate was 89% (216 of 244 students; female: male ratio 1.25) and 42 students participated in 6 focus groups. Mean questionnaire responses indicated a favourable opinion on quality assurance items, with a mixed response to video presentation as a learning method. 71% of students preferred to receive a lecture in person, rather than via video presentation. There were no statistically significant differences between genders regarding learning preferences in general and regarding video versus live presentation in particular. Exploratory factor analysis demonstrated that favourable responses to video presentation were strongly associated with perceived audiovisual quality and learning preferences (Cronbach’s alpha coefficient 0.77), with 72% of students considering video presentation worthwhile. Positive perception of overall quality was strongly associated with learning preferences as well as more generic quality assurance issues (80% students; alpha coefficient 0.83).
The results were supported by triangulation of the above quantitative data with qualitative data generated by the focus groups. Students further articulated the view that video presentation may be more appropriate and effective in a mixed method setting.

Reference Basu Roy R, McMahon GT. Video-based cases disrupt deep critical thinking in problem-based learning. Med Educ 2012 Apr;46(4):426-435.

Construction Industry Attitudes to Global Environmental Change: A Comparison with the United Kingdom and Japan

With the continued diffusion of global boundaries coupled with the onset of increased environmental pressure, construction industry attitudes are also shifting. The aim of this paper is to evaluate the construction industry attitudes to global environmental change in both the United Kingdom and Japan. In order to achieve this goal, a qualitative mixed method approach is adopted, encompassing a desk based critique of the literature coupled with an industry interview from both regions. This methodology is adopted with the objective of ascertaining if there are any geographical similarities or differences with the regions in question. The resulting information is analyzed and the results deciphered utilizing mind mapping techniques in the dissemination of the data obtained with the objective of identifying various traits within the data. The results indicate that the United Kingdom and Japan both illustrate various attributes in relation to attitudes towards the global environment. In particular, research indicates that in the Japanese construction industry, there is a distinct lack of enthusiasm shown in construction industry attitudes to counteract environmental challenges currently being faced by implementing sustainable practices, compared to attitudes in the UK construction industry. One of the reasons identified for this, is the lack of leadership provided by the corresponding government, thus resulting in the lack of promotion of sustainable practices in the region. The benefit of this research is that it enables various industry leaders, regardless of geographical location, to actively consider the attitudes and perceptions of those around them, particularly in relation to the sensitive topic of global environmental change within the industry. Where the findings are acknowledged and also utilized, the results should aid in the improvement of the industry on an international scale, while also improving the overall persona of environmental change within the sector.

The design and psychometric assessment of a TPB-based questionnaire suitable for use with primary school children

Despite the popularity of the Theory of Planned Behaviour (TPB) a lack of research assessing the efficacy of the model in understanding the health behaviour of children exists, with those studies that have been conducted reporting problems with questionnaire formulation and low to moderate internal consistencies for TPB constructs. The aim of this study was to develop and test a TPB-based measure suitable for use with primary school children aged 9 to 10 years. A mixed method sequential design was employed. In Stage 1, 7 semi-structured focus group discussions (N=56) were conducted to elicit the underlying beliefs specific to tooth brushing. Using content thematic analysis the beliefs were identified and a TPB measure was developed. A repeated measures design was employed in Stage 2 using test re-test reliability analysis in order to assess its psychometric properties. In all, 184 children completed the questionnaire. Test-retest reliabilities support the validity and reliability of the TPB measure for assessing the tooth brushing beliefs of children. Pearson’s product moment correlations were calculated for all of the TPB beliefs, achieving substantial to almost perfect agreement levels. Specifically, a significant relationship between all 10 of the direct and indirect TPB constructs at the 0.01 level was achieved. This paper will discuss the design and development of the measure so could serve as a guide to fellow researchers and health psychologists interested in using theoretical models to investigate the health and well-being of children.

Reconstructing the Social Fabric amid On-going Violence: Attitudes toward Reconciliation and Structural Transformation in Colombia

Given the increase of reconciliation processes initiated amid on-going violence, this study focuses on community reconciliation and its relation to structural transformation, or social reconstruction through reforming unjust institutions and practices that facilitate protracted violent conflict. Drawing lessons from the Caribbean coast of Colombia, mixed method analyses include eight in-depth interviews and 184 surveys. Four key dimensions of reconciliation – truth, justice, mercy, peace – are examined. In the interviews, participants prioritize reconstructing the truth and bringing perpetrators to justice as essential aspects of reconciliation. Notions of mercy and forgiveness are less apparent. For the participants, sustainable peace is dependent on structural transformation to improve livelihoods. These data, however, do not indicate how this understanding of reconciliation may relate to individual participation in reconciliation processes. Complementing the qualitative data, quantitative analyses identify some broad patterns that relate to participation in reconciliation events. Compared to those who did not participate, individuals who engaged in reconciliation initiatives report higher levels of personal experience with violence, live alongside demobilized paramilitaries, are more engaged in civic life, and express greater preference for structural transformation. The paper concludes with policy implications that integrate reconciliation and structural transformation to deepen efforts to rebuild the social fabric amid violence.