Pitfalls in the use of kappa when interpreting agreement between multiple raters in reliability studies

OBJECTIVE To compare different reliability coefficients (exact agreement, and variations of the kappa (generalised, Cohen's and Prevalence Adjusted and Biased Adjusted (PABAK))) for four physiotherapists conducting visual assessments of scapulae. DESIGN Inter-therapist reliability study. SETTING Research laboratory. PARTICIPANTS 30 individuals with no history of neck or shoulder pain were recruited with no obvious significant postural abnormalities. MAIN OUTCOME MEASURES Ratings of scapular posture were recorded in multiple biomechanical planes under four test conditions (at rest, and while under three isometric conditions) by four physiotherapists. RESULTS The magnitude of discrepancy between the two therapist pairs was 0.04 to 0.76 for Cohen's kappa, and 0.00 to 0.86 for PABAK. In comparison, the generalised kappa provided a score between the two paired kappa coefficients. The difference between mean generalised kappa coefficients and mean Cohen's kappa (0.02) and between mean generalised kappa and PABAK (0.02) were negligible, but the magnitude of difference between the generalised kappa and paired kappa within each plane and condition was substantial; 0.02 to 0.57 for Cohen's kappa and 0.02 to 0.63 for PABAK, respectively. CONCLUSIONS Calculating coefficients for therapist pairs alone may result in inconsistent findings. In contrast, the generalised kappa provided a coefficient close to the mean of the paired kappa coefficients. These findings support an assertion that generalised kappa may lead to a better representation of reliability between three or more raters and that reliability studies only calculating agreement between two raters should be interpreted with caution. However, generalised kappa may mask more extreme cases of agreement (or disagreement) that paired comparisons may reveal.

Global indigenous studies in the first world: some reflections and epistemological matters

Indigenous studies in First World nation states such as Australia, Canada, New Zealand, the United States of America and Hawaii, appear to have acquired the status of a discipline, although the accounts of its formation vary. Indigenous studies is formally recognised as part of university curricula in these countries and is included in inter‐disciplinary contexts and degree programs or is offered as a program and a degree in its own right. Indigenous scholarship is being published in unprecedented numbers with publishing houses competing for manuscripts. Indigenous studies journals have proliferated having emerged in the 1970s though most were, and continue to be, edited by non‐Indigenous people. In addition, Indigenous studies professional associations have been established organising research related activities as well as convening conferences to enable intellectual engagement and the formation of national and international networks. The nature and extent of this institutionalisation and the conditions of existence, though often marginalised and under resourced, may allude to the coherence of Indigenous Studies as a discipline with global reach but what remains unclear are its epistemological boundaries and the degree to which it perpetuates cultural entrapment . This paper will reflect on some of these epistemological matters.

Child sexual abuse in China : a meta-analysis of 27 studies

Objective: To examine whether Chinese studies of child sexual abuse (CSA) in the general population show lower prevalence rates than other international studies, and whether certain features of these studies may help to account for variation in estimates. Methods: A meta-analysis and meta-regression were conducted on 27 studies found in the English and Chinese language peer reviewed journals that involved general populations of students or residents, estimated CSA prior to age 18, and specified rates for males or females individually. Results: Estimates for Chinese females were lower than the international composites. For total CSA for females, the Chinese pooled estimate was 15.3% (95% CI = 12.6–18.0) based on the meta-analysis of 24 studies, lower than the international estimate (Stoltenborgh, van IJzendoorn, Euser, & Bakermans-Kranenburg, 2011) but not significantly. For contact CSA for females, the pooled estimate was 9.5% (95% CI = 7.5–11.5), based on 16 studies, significantly lower than the international prevalence. For penetrative CSA for females, the pooled estimate was 1% (95% CI = 0.7–1.3), based on 15 studies, significantly lower than the international estimate of 15.1%. Chinese men reported significantly less penetrative CSA but significantly more total CSA than international estimates; while contact CSA reported by Chinese and international males appeared to be roughly equivalent. Chinese CSA prevalence estimates were lower in studies from urban areas and non-mainland areas (Hong Kong and Taiwan), and in surveys with larger and probability samples, multiple sites, face-to-face interview method and when using less widely used instruments. Conclusions: The findings to date justify further research into possible cultural and sociological reasons for lower risk of contact and penetrative sexual abuse of girls and less penetrative abuse of boys in China. Future research should examine sociological explanations, including patterns of supervision, sexual socialization and attitudes related to male sexual prowess. Practice implications: The findings suggest that future general population studies in China should use well validated instruments, avoid face-to-face interview formats and be careful to maintain methodological standards when sampling large populations over multiple sites.

Humanities and social scientific research methods in porn studies

Porn studies researchers in the humanities have tended to use different research methods from those in social sciences. There has been surprisingly little conversation between the groups about methodology. This article presents a basic introduction to textual analysis and statistical analysis, aiming to provide for all porn studies researchers a familiarity with these two quite distinct traditions of data analysis. Comparing these two approaches, the article suggests that social science approaches are often strongly reliable – but can sacrifice validity to this end. Textual analysis is much less reliable, but has the capacity to be strongly valid. Statistical methods tend to produce a picture of human beings as groups, in terms of what they have in common, whereas humanities approaches often seek out uniqueness. Social science approaches have asked a more limited range of questions than have the humanities. The article ends with a call to mix up the kinds of research methods that are applied to various objects of study.

Exploring the effect of aquatic exercise on behaviour and psychological wellbeing in people with moderate to severe dementia : a pilot study of the Watermemories Swimming Club

Aim To explore the effects of a dementia-specific, aquatic exercise intervention on behavioural and psychological symptoms in people with dementia (BPSD). Method Residents from two aged care facilities in Queensland, Australia, received a 12-week intervention consisting of aquatic exercises for strength, agility, flexibility, balance and relaxation. The Psychological Well-Being in Cognitively Impaired Persons Scale (PW-BCIP) and the Revised Memory and Behaviour Problems Checklist (RMBPC) were completed by registered nurses at baseline, week 6, week 9 and post intervention. Results Ten women and one man (median age = 88.4 years, interquartile range = 12.3) participated. Statistically significant declines in the RMBPC and PW-BCIP were observed over the study period. Conclusion Preliminary evidence suggests that a dementia-specific, aquatic exercise intervention reduces BPSD and improves psychological well-being in people with moderate to severe dementia. With further testing, this innovative intervention may prove effective in addressing some of the most challenging aspects of dementia care.

Cinema studies : Women's Experimental Cinema edited by Robin Blaetz

Women’s Experimental Cinema provides lively introductions to the work of fifteen avant-garde women filmmakers, some of whom worked as early as the 1950s and many of whom are still working today. In each essay in this collection, a leading film scholar considers a single filmmaker, supplying biographical information, analyzing various influences on her work, examining the development of her corpus, and interpreting a significant number of individual films. The essays rescue the work of critically neglected but influential women filmmakers for teaching, further study, and, hopefully, restoration and preservation. Just as importantly, they enrich the understanding of feminism in cinema and expand the terrain of film history, particularly the history of the American avant-garde.

Gender studies : Intersex by Catherine Harper

Intersex is the condition whereby an individual is born with biological features that are simultaneously perceived as male and female. Ranging from the ambiguous genitalia of the true 'hermaphrodite' to the 'mildly or internally intersexed', the condition may be as common as cleft palate. Like cleft palate, it is hidden and surgically altered, but for very different reasons. Intersex draws heavily on the personal testimony of intersexed individuals, their loved ones and medical carers. The impact of early sex-assignment surgery on an individual's later life is examined within the context of ethical and clinical questions. Harper challenges the conventional and radical 'treatment' of intersexuality through non-consensual infant sex-assignment surgery. In doing so, she exposes powerful myths, taboos and constructions of gender - the perfect phallus, a bi-polar model of gender and the infallibility of medical decisions. Handling sensitive material with care, this book deepens our understanding of a condition that has itself only been medically understood in recent years.

A pilot study on understanding the journey of advanced prostate cancer patients

Objective: To understand the journey of advanced prostate cancer patients for supporting development of an innovative patient journey browser. Background: Prostate cancer is one of the common cancers in Australia. Due to the chronic nature of the disease, it is important to have effective disease management strategy and care model. Multi-disciplinary care is a well-proven approach for chronic disease management. The Multi-disciplinary team (MDT) can function more effectively if all the required information is available for the clinical decision support. The development of innovative technology relies on an accurate understanding of the advanced prostate cancer patient’s journey over a prolonged period. This need arises from the fact that advanced prostate cancer patients may follow various treatment paths and change their care providers. As a result of this, it is difficult to understand the actual sources of patient’s clinical records and their treatment patterns. The aim of the research is to understand variable sources of clinical records, treatment patterns, alternative therapies, over the counter (OTC) medications of advanced prostate cancer patients. This study provides better and holistic understanding of advanced prostate cancer journey. Methods: The study was conducted through an on-line survey developed to seek and analyse the responses from the participants. The on-line questionnaire was carefully developed through consultations with the clinical researchers at the Australian Prostate Cancer Research Centre-Queensland, prostate cancer support group representatives and health informaticians at the Australian e-Health Research Centre. The non-identifying questionnaire was distributed to the patients through prostate cancer support groups in Queensland, Australia. The pilot study was carried out between August 2010 and December 2010. Results: The research made important observations about the advanced prostate cancer journey. It showed that General Practitioner (GP) was the common source of patient’s clinical records (41%) followed by Urologist (14%) and other clinicians (14%). The data analysis also showed that selenium was the common complementary supplement (55%) used by the patients and about 48% patients did not use any OTC drugs. The most common OTC used by the patients was Paracetamol (about 45%). Conclusion: The results have provided a foundation to the architecture of the proposed technology solution. The outcomes of this study are incorporated in design of the proposed patient journey browser system. A basic version of the system is currently being used at the advanced prostate cancer MDT meetings.

Validation of β-actin used as endogenous control for gene expression analysis in mechanobiology studies : amendments

We write in response to the letter by Liu et al. [1] commenting on our article, ‘‘Mesenchymal Stem Cells Regulate Angiogenesis According to Their Mechanical Environment’’ [2]. The study by Liu et al. demonstrates that the commonly used endogeneous reference gene (ERG), b-actin, is upregulated by mechanical loading, indicating a potential bias in the determined target gene expression when normalizing to b-actin, such as in our report on unchanged vascular endothelial growth factor (VEGF) and hypoxia-inducible factors (HIF)-1a mRNA levels in mechanically loaded mesenchymal stem cells (MSCs).

A pilot study exploring Australian general practice nurses roles, responsibilities and professional development needs in well and sick child care

Aim Explore practice nurses' (PNs) role in child health and development, and advising parents about child health issues. Background Introduction of the four-year-old child health check into general practice in 2008 placed additional responsibilities on PNs in child health and wellness. This study explores their readiness to expand their practice into this area. Design Integrated mixed method design, self-report survey. Method A purpose-developed questionnaire explored demographics, child health roles and responsibilities, difficulties encountered, professional development needs, barriers and facilitators, and professional development activities undertaken in the past year. Surveys were posted to 218 PNs in one rural Division of General Practice (DGP) in Queensland, Australia; 29 responded. Results PNs reported a significant role in well and sick child care (93.1%) though few had a paediatric/child health background (14.3%). Roles included immunisations (92.3%), child health checks (65.4%), general child health and development (26.9%), asthma (23.1%), feeding (15.4%), fever (11.5%), settling/sleeping (11.5%). PNs were interested in learning more about (81.5%) and incorporating more child health into their practice (81.5%). Professional development in childhood growth and development (80.0%), health and illness (60.0%) and advising new mothers (20.0%) was needed. Conclusions PNs play a substantial role in child health, are unprepared for the complexities of this role and have preferred methods for undertaking professional development to address knowledge deficits. Implications for practice PNs are unprepared for an advanced role in child health and wellness. Significant gaps in their knowledge to support this role were identified. This ever-expanding role requires close monitoring to ensure knowledge precedes expectations to practice.

Lesson studies in Chinese kindergartens

Lesson studies are a powerful form of professional development (Doig and Groves, 2011). The processes of creating, enacting, analyzing, and refining lessons to improve teaching practices are key components of lesson studies. Lesson studies have been the primary form of professional development in Japanese classrooms for many years (Lewis, Perry and Hurd, 2009). This model is now used to improve instruction in many South-East Asian countries (White and Lim, 2008), as well as increasingly in North America (Lesson Study Research Group, 2004), and South Africa (Ono and Ferreira, 2010). In China, this form of professional development aimed at improving teaching, has also been adopted, originating from Soviet models of teacher professional development arising from influences post 1949 (China Education Yearbook, 1986). Thus, China too has a long history of improving teaching and learning through this form of school-based professional learning.

Knowledge unlatched announces the launch of its pilot collection [Blog]

Frances Pinter and I have been visiting fellows at the Big Innovation Centre for more than a year now. Tucked away in a corner, inspired by BIC’s open innovation vision, we have been attempting to solve a problem that continues to perplex many in the era of digital affordance: creating sustainable markets for high quality new content that include free access for end users.

A pilot randomised trial of Medilixir cream shows some promising results, but control treatment may have been inappropriate

Aim To test the efficacy of Medilixir [cream] against the standard treatment of aqueous cream in the provision of relief from the symptoms of postburn itch. Design RCT with two parallel arms. Setting Professor Stuart Pegg Adult Burns Centre, Royal Brisbane and Women's Hospital, Brisbane, Australia. Participants Fifty-two patients aged between 18 and 80 years, admitted directly to the burns centre between 10 March and 22 July 2008, were able to provide informed consent, and had shown no allergic reaction to a patch test with the study medication, were randomised. Patients admitted from intensive care or high dependency were excluded. Main results Effect estimates and confidence intervals were not reported for any of the outcomes; only group means/proportions and P-values from hypothesis testing were provided. More patients in the intervention group reported itch reduction compared to comparison treatment (91 vs. 82%, P=0.001). Itch recurrence after cream application occurred later in the intervention group compared to the control group (P<0.001). Use of antipruritic medication was significantly greater in the control group (P=0.023). There was no difference in sleep disturbance between groups (not quantified). On average, Medilixir took longer to apply than aqueous cream (157s for Medilixir vs. 139s for aqueous cream; mean difference 17s), but authors noted that the groups did not differ significantly (CI for mean difference and P-values were not reported).