Pitfalls in the use of kappa when interpreting agreement between multiple raters in reliability studies

OBJECTIVE To compare different reliability coefficients (exact agreement, and variations of the kappa (generalised, Cohen's and Prevalence Adjusted and Biased Adjusted (PABAK))) for four physiotherapists conducting visual assessments of scapulae. DESIGN Inter-therapist reliability study. SETTING Research laboratory. PARTICIPANTS 30 individuals with no history of neck or shoulder pain were recruited with no obvious significant postural abnormalities. MAIN OUTCOME MEASURES Ratings of scapular posture were recorded in multiple biomechanical planes under four test conditions (at rest, and while under three isometric conditions) by four physiotherapists. RESULTS The magnitude of discrepancy between the two therapist pairs was 0.04 to 0.76 for Cohen's kappa, and 0.00 to 0.86 for PABAK. In comparison, the generalised kappa provided a score between the two paired kappa coefficients. The difference between mean generalised kappa coefficients and mean Cohen's kappa (0.02) and between mean generalised kappa and PABAK (0.02) were negligible, but the magnitude of difference between the generalised kappa and paired kappa within each plane and condition was substantial; 0.02 to 0.57 for Cohen's kappa and 0.02 to 0.63 for PABAK, respectively. CONCLUSIONS Calculating coefficients for therapist pairs alone may result in inconsistent findings. In contrast, the generalised kappa provided a coefficient close to the mean of the paired kappa coefficients. These findings support an assertion that generalised kappa may lead to a better representation of reliability between three or more raters and that reliability studies only calculating agreement between two raters should be interpreted with caution. However, generalised kappa may mask more extreme cases of agreement (or disagreement) that paired comparisons may reveal.

Grand tours in the glare of the sun : harnessing digital media to develop cultural tourism in Queensland, Australia

It has been well established that highlighting the cultural attributes of a region through stories of place, local histories, and the creative arts boosts tourism income to a region. Cultural tourism also serves to promote the creative industries to visitors and residents alike and, by enhancing a region’s cultural identity, fosters new opportunities for the arts. It can therefore offer considerable potential benefit to the creative economy in Australia. However, in comparison with Europe, where cultural tourism can rely upon an established historical, artistic and literary cultural identity that stretches back to Grand Tours of the seventeenth century, in Queensland, Australia the relatively new enterprise of cultural tourism must compete with visitor expectations of sun, surf and the natural landscapes, which have become the mainstay of tourism advertising. Moreover, in Queensland, it is essential to connect vast distances, diverse communities and a variety of cultural experiences. We must also take account of the expectations of contemporary tourists, who anticipate a digitally mediated travel experience and increasingly seek to connect with local communities in authentic ways. In this paper we consider the unique considerations that must be taken into account in the Queensland context and propose approaches to developing an integrated identity that embraces both the ‘great outdoors’ and the region’s cultural attributes. We make recommendations for providing the types of digitally mediated ‘local’ experiences that cultural tourists now expect, and illustrate the design principles we propose through early, tentative approaches to smart phones, locative media and augmented reality applications for cultural tourism in the region. We conclude by proposing additional ways to formulate a digital strategy in line with the recommendations we make.

Global indigenous studies in the first world: some reflections and epistemological matters

Indigenous studies in First World nation states such as Australia, Canada, New Zealand, the United States of America and Hawaii, appear to have acquired the status of a discipline, although the accounts of its formation vary. Indigenous studies is formally recognised as part of university curricula in these countries and is included in inter‐disciplinary contexts and degree programs or is offered as a program and a degree in its own right. Indigenous scholarship is being published in unprecedented numbers with publishing houses competing for manuscripts. Indigenous studies journals have proliferated having emerged in the 1970s though most were, and continue to be, edited by non‐Indigenous people. In addition, Indigenous studies professional associations have been established organising research related activities as well as convening conferences to enable intellectual engagement and the formation of national and international networks. The nature and extent of this institutionalisation and the conditions of existence, though often marginalised and under resourced, may allude to the coherence of Indigenous Studies as a discipline with global reach but what remains unclear are its epistemological boundaries and the degree to which it perpetuates cultural entrapment . This paper will reflect on some of these epistemological matters.

Child sexual abuse in China : a meta-analysis of 27 studies

Objective: To examine whether Chinese studies of child sexual abuse (CSA) in the general population show lower prevalence rates than other international studies, and whether certain features of these studies may help to account for variation in estimates. Methods: A meta-analysis and meta-regression were conducted on 27 studies found in the English and Chinese language peer reviewed journals that involved general populations of students or residents, estimated CSA prior to age 18, and specified rates for males or females individually. Results: Estimates for Chinese females were lower than the international composites. For total CSA for females, the Chinese pooled estimate was 15.3% (95% CI = 12.6–18.0) based on the meta-analysis of 24 studies, lower than the international estimate (Stoltenborgh, van IJzendoorn, Euser, & Bakermans-Kranenburg, 2011) but not significantly. For contact CSA for females, the pooled estimate was 9.5% (95% CI = 7.5–11.5), based on 16 studies, significantly lower than the international prevalence. For penetrative CSA for females, the pooled estimate was 1% (95% CI = 0.7–1.3), based on 15 studies, significantly lower than the international estimate of 15.1%. Chinese men reported significantly less penetrative CSA but significantly more total CSA than international estimates; while contact CSA reported by Chinese and international males appeared to be roughly equivalent. Chinese CSA prevalence estimates were lower in studies from urban areas and non-mainland areas (Hong Kong and Taiwan), and in surveys with larger and probability samples, multiple sites, face-to-face interview method and when using less widely used instruments. Conclusions: The findings to date justify further research into possible cultural and sociological reasons for lower risk of contact and penetrative sexual abuse of girls and less penetrative abuse of boys in China. Future research should examine sociological explanations, including patterns of supervision, sexual socialization and attitudes related to male sexual prowess. Practice implications: The findings suggest that future general population studies in China should use well validated instruments, avoid face-to-face interview formats and be careful to maintain methodological standards when sampling large populations over multiple sites.

Humanities and social scientific research methods in porn studies

Porn studies researchers in the humanities have tended to use different research methods from those in social sciences. There has been surprisingly little conversation between the groups about methodology. This article presents a basic introduction to textual analysis and statistical analysis, aiming to provide for all porn studies researchers a familiarity with these two quite distinct traditions of data analysis. Comparing these two approaches, the article suggests that social science approaches are often strongly reliable – but can sacrifice validity to this end. Textual analysis is much less reliable, but has the capacity to be strongly valid. Statistical methods tend to produce a picture of human beings as groups, in terms of what they have in common, whereas humanities approaches often seek out uniqueness. Social science approaches have asked a more limited range of questions than have the humanities. The article ends with a call to mix up the kinds of research methods that are applied to various objects of study.

Cinema studies : Women's Experimental Cinema edited by Robin Blaetz

Women’s Experimental Cinema provides lively introductions to the work of fifteen avant-garde women filmmakers, some of whom worked as early as the 1950s and many of whom are still working today. In each essay in this collection, a leading film scholar considers a single filmmaker, supplying biographical information, analyzing various influences on her work, examining the development of her corpus, and interpreting a significant number of individual films. The essays rescue the work of critically neglected but influential women filmmakers for teaching, further study, and, hopefully, restoration and preservation. Just as importantly, they enrich the understanding of feminism in cinema and expand the terrain of film history, particularly the history of the American avant-garde.

Gender studies : Intersex by Catherine Harper

Intersex is the condition whereby an individual is born with biological features that are simultaneously perceived as male and female. Ranging from the ambiguous genitalia of the true 'hermaphrodite' to the 'mildly or internally intersexed', the condition may be as common as cleft palate. Like cleft palate, it is hidden and surgically altered, but for very different reasons. Intersex draws heavily on the personal testimony of intersexed individuals, their loved ones and medical carers. The impact of early sex-assignment surgery on an individual's later life is examined within the context of ethical and clinical questions. Harper challenges the conventional and radical 'treatment' of intersexuality through non-consensual infant sex-assignment surgery. In doing so, she exposes powerful myths, taboos and constructions of gender - the perfect phallus, a bi-polar model of gender and the infallibility of medical decisions. Handling sensitive material with care, this book deepens our understanding of a condition that has itself only been medically understood in recent years.

Validation of β-actin used as endogenous control for gene expression analysis in mechanobiology studies : amendments

We write in response to the letter by Liu et al. [1] commenting on our article, ‘‘Mesenchymal Stem Cells Regulate Angiogenesis According to Their Mechanical Environment’’ [2]. The study by Liu et al. demonstrates that the commonly used endogeneous reference gene (ERG), b-actin, is upregulated by mechanical loading, indicating a potential bias in the determined target gene expression when normalizing to b-actin, such as in our report on unchanged vascular endothelial growth factor (VEGF) and hypoxia-inducible factors (HIF)-1a mRNA levels in mechanically loaded mesenchymal stem cells (MSCs).

Lesson studies in Chinese kindergartens

Lesson studies are a powerful form of professional development (Doig and Groves, 2011). The processes of creating, enacting, analyzing, and refining lessons to improve teaching practices are key components of lesson studies. Lesson studies have been the primary form of professional development in Japanese classrooms for many years (Lewis, Perry and Hurd, 2009). This model is now used to improve instruction in many South-East Asian countries (White and Lim, 2008), as well as increasingly in North America (Lesson Study Research Group, 2004), and South Africa (Ono and Ferreira, 2010). In China, this form of professional development aimed at improving teaching, has also been adopted, originating from Soviet models of teacher professional development arising from influences post 1949 (China Education Yearbook, 1986). Thus, China too has a long history of improving teaching and learning through this form of school-based professional learning.

Diporphyrins linked by two-atom bridges synthestic, structural and theoretical studies

The syntheses, properties and electronic structures of a series of porphyrin dimers connected by two-atom bridges were compared. The study found that an azo linker results in the most efficient electronic communication between the two porphyrin rings, and is the superior connector for dimers, trimers and oligomers in the design of nonlinear optical materials. This has implications for the design of molecular probes and sensors, photodynamic therapy, microfabrication, and three-dimensional optical data storage. The research led to the synthesis of a number of new porphyrin monomers and dimers, which were characterised using structural, spectroscopic and spectrometric techniques.

Amplified activism : transmedia storytelling and social change

The avenues through which communities and community organisations raise awareness about the issues they face and how they agitate for change have developed rapidly in the past ten years; and digital technology has provided community activists with the means to quickly create and widely disseminate stories. Perhaps the most influential and wide reaching of recent innovations in storytelling has been transmedia storytelling. This article explores a new breed of projects that utilise recognisable conventions of transmedia storytelling and borrow elements from other forms of storytelling that predate transmedia, such as digital storytelling and documentary film making. In addition to being hybrid in form these projects are independent and solely focused on raising awareness about particular social issues or telling the stories of marginalized groups, who otherwise do not have a voice in the public sphere.

A comparison of the gas phase acidities of phospholipid headgroups: Experimental and computational studies

Proton-bound dimers consisting of two glycerophospholipids with different headgroups were prepared using negative ion electrospray ionization and dissociated in a triple quadrupole mass spectrometer. Analysis of the tandem mass spectra of the dimers using the kinetic method provides, for the first time, an order of acidity for the phospholipid classes in the gas phase of PE < PA << PG < PS < PI. Hybrid density functional calculations on model phospholipids were used to predict the absolute deprotonation enthalpies of the phospholipid classes from isodesmic proton transfer reactions with phosphoric acid. The computational data largely support the experimental acidity trend, with the exception of the relative acidity ranking of the two most acidic phospholipid species. Possible causes of the discrepancy between experiment and theory are discussed and the experimental trend is recommended. The sequence of gas phase acidities for the phospholipid headgroups is found to (1) have little correlation with the relative ionization efficiencies of the phospholipid classes observed in the negative ion electrospray process, and (2) correlate well with fragmentation trends observed upon collisional activation of phospholipid \[M - H](-) anions. (c) 2005 American Society for Mass Spectrometry.

End-of-life care in the intensive care unit : a systematic review of qualitative studies investigating the experiences and perceptions of the patient's family

Review question/objective The review objective is to synthesise the best available evidence on experiences and perceptions of family members of intensive care unit patients on the adequacy of end-of-life care, where life-support modalities have been withheld or withdrawn. Inclusion criteria Types of participants This review will consider studies that report on the experiences and perceptions of patients’ families on EOLC in the ICU, where life-support modalities have been withheld or withdrawn. The family is defined as “those who are closest to the patient... the family may include the biological family, family by acquisition, and the family of choice and friends”. Phenomena of interest The phenomena of interest for this review are the patients’ families experiences, perceptions or views on the adequacy of EOLC delivered in the ICU, where life-support modalities were withheld or withdrawn. These experiences may refer to the following views on domains of care considered important at the end-of-life in the ICU, which have been described already in the existing literature: timely, consistent, and compassionate communication, clinician availability, clinical decision making based on patients’ preferences, goals and values, physical care implemented to maintain patient comfort, holistic interdisciplinary care and bereavement care for families of patients who died.