Pitfalls in the use of kappa when interpreting agreement between multiple raters in reliability studies

OBJECTIVE To compare different reliability coefficients (exact agreement, and variations of the kappa (generalised, Cohen's and Prevalence Adjusted and Biased Adjusted (PABAK))) for four physiotherapists conducting visual assessments of scapulae. DESIGN Inter-therapist reliability study. SETTING Research laboratory. PARTICIPANTS 30 individuals with no history of neck or shoulder pain were recruited with no obvious significant postural abnormalities. MAIN OUTCOME MEASURES Ratings of scapular posture were recorded in multiple biomechanical planes under four test conditions (at rest, and while under three isometric conditions) by four physiotherapists. RESULTS The magnitude of discrepancy between the two therapist pairs was 0.04 to 0.76 for Cohen's kappa, and 0.00 to 0.86 for PABAK. In comparison, the generalised kappa provided a score between the two paired kappa coefficients. The difference between mean generalised kappa coefficients and mean Cohen's kappa (0.02) and between mean generalised kappa and PABAK (0.02) were negligible, but the magnitude of difference between the generalised kappa and paired kappa within each plane and condition was substantial; 0.02 to 0.57 for Cohen's kappa and 0.02 to 0.63 for PABAK, respectively. CONCLUSIONS Calculating coefficients for therapist pairs alone may result in inconsistent findings. In contrast, the generalised kappa provided a coefficient close to the mean of the paired kappa coefficients. These findings support an assertion that generalised kappa may lead to a better representation of reliability between three or more raters and that reliability studies only calculating agreement between two raters should be interpreted with caution. However, generalised kappa may mask more extreme cases of agreement (or disagreement) that paired comparisons may reveal.

Global indigenous studies in the first world: some reflections and epistemological matters

Indigenous studies in First World nation states such as Australia, Canada, New Zealand, the United States of America and Hawaii, appear to have acquired the status of a discipline, although the accounts of its formation vary. Indigenous studies is formally recognised as part of university curricula in these countries and is included in inter‐disciplinary contexts and degree programs or is offered as a program and a degree in its own right. Indigenous scholarship is being published in unprecedented numbers with publishing houses competing for manuscripts. Indigenous studies journals have proliferated having emerged in the 1970s though most were, and continue to be, edited by non‐Indigenous people. In addition, Indigenous studies professional associations have been established organising research related activities as well as convening conferences to enable intellectual engagement and the formation of national and international networks. The nature and extent of this institutionalisation and the conditions of existence, though often marginalised and under resourced, may allude to the coherence of Indigenous Studies as a discipline with global reach but what remains unclear are its epistemological boundaries and the degree to which it perpetuates cultural entrapment . This paper will reflect on some of these epistemological matters.

Child sexual abuse in China : a meta-analysis of 27 studies

Objective: To examine whether Chinese studies of child sexual abuse (CSA) in the general population show lower prevalence rates than other international studies, and whether certain features of these studies may help to account for variation in estimates. Methods: A meta-analysis and meta-regression were conducted on 27 studies found in the English and Chinese language peer reviewed journals that involved general populations of students or residents, estimated CSA prior to age 18, and specified rates for males or females individually. Results: Estimates for Chinese females were lower than the international composites. For total CSA for females, the Chinese pooled estimate was 15.3% (95% CI = 12.6–18.0) based on the meta-analysis of 24 studies, lower than the international estimate (Stoltenborgh, van IJzendoorn, Euser, & Bakermans-Kranenburg, 2011) but not significantly. For contact CSA for females, the pooled estimate was 9.5% (95% CI = 7.5–11.5), based on 16 studies, significantly lower than the international prevalence. For penetrative CSA for females, the pooled estimate was 1% (95% CI = 0.7–1.3), based on 15 studies, significantly lower than the international estimate of 15.1%. Chinese men reported significantly less penetrative CSA but significantly more total CSA than international estimates; while contact CSA reported by Chinese and international males appeared to be roughly equivalent. Chinese CSA prevalence estimates were lower in studies from urban areas and non-mainland areas (Hong Kong and Taiwan), and in surveys with larger and probability samples, multiple sites, face-to-face interview method and when using less widely used instruments. Conclusions: The findings to date justify further research into possible cultural and sociological reasons for lower risk of contact and penetrative sexual abuse of girls and less penetrative abuse of boys in China. Future research should examine sociological explanations, including patterns of supervision, sexual socialization and attitudes related to male sexual prowess. Practice implications: The findings suggest that future general population studies in China should use well validated instruments, avoid face-to-face interview formats and be careful to maintain methodological standards when sampling large populations over multiple sites.

Humanities and social scientific research methods in porn studies

Porn studies researchers in the humanities have tended to use different research methods from those in social sciences. There has been surprisingly little conversation between the groups about methodology. This article presents a basic introduction to textual analysis and statistical analysis, aiming to provide for all porn studies researchers a familiarity with these two quite distinct traditions of data analysis. Comparing these two approaches, the article suggests that social science approaches are often strongly reliable – but can sacrifice validity to this end. Textual analysis is much less reliable, but has the capacity to be strongly valid. Statistical methods tend to produce a picture of human beings as groups, in terms of what they have in common, whereas humanities approaches often seek out uniqueness. Social science approaches have asked a more limited range of questions than have the humanities. The article ends with a call to mix up the kinds of research methods that are applied to various objects of study.

A Literature Review of Wellness, Wellbeing and Quality of Life Issues as they impact upon the Australian Mining Sector

Australia’s mining boom Global demand for minerals and energy products has fuelled Australia’s recent resources boom and has led to the rapid expansion of mining projects not only in remote locations but increasingly in settled traditionally agricultural rural areas. A fundamental shift has also occurred in the provisioning of skilled and semi-skilled workers. The huge acceleration in industry demand for labour has been accompanied by the entrenchment of workforce arrangements largely dependent on fly-in, fly-out (FIFO) and drive–in, drive–out (DIDO) non-resident workers (NRWs). While NRWs are working away from their homes, they are usually accommodated in work camps or ‘villages’ for the duration of their work cycle which are normally comprised of many consecutive days of 12-hour day- and night-shifts. The health effects of this form of employment and the accompanying lifestyle is increasingly becoming contentious. Impacts on personal wellness, wellbeing and quality of life essentially remain under-researched and thus misunderstood. Sodexo in Australia Sodexo began operations in Australia in 1982, and has since become a leader in providing Quality of Life (QOL) services to businesses across the country. The 6,000 Australian employees are part of a global Sodexo team of 413,000 people. Sodexo in Australia designs, delivers and manages on-site their QOL services at 320 diverse site locations, including remote sites. Sodexo operates in a range of sectors, including the mining industry. Service plans are tailored to suit the individual needs of organisations. Sodexo Remote Sites has previously conducted unpublished research among mining workers in Australia. The results highlighted needs and expectations of Australian mining workers. Main insights about workers’ requirements were directed towards: • contacts with closest; • warm rest time around proper and varied meals; • additional services to help them better enjoy their life onsite and/or make the most of it; • organise their transportation; • promote community living; and • finding balance between professional and personal life. The brief for this current research is aimed at building upon this knowledge. Research brief Expectations for quality of life and wellness and wellbeing services are increasing dramatically. It's getting costlier and more difficult to retain valuable employees. This is particularly the case in the Australian mining sector. Given the level of interest in ensuring healthy workplaces in Australia, Sodexo has commissioned QUT to conduct a literature review. The objectives as specified by Sodexo are: Objective 1: To define the concepts of wellness and wellbeing and quality of life in Australia Objective 2: To examine how wellness and wellbeing are developed within organisations in Australia and how they impact on employee and organizational performance. More specifically, to review the literature that could be sourced about: • challenges of the mining environment; • the mining lifestyle – implications for health, wellness and daily life; • personal health and wellness of Australian mining workers; • factors affecting health in mines and perceived support for health and wellness; and • the impact of employer investment in health on perceptions and behaviour of employees. Objective 3: To determine what impact employee wellness and well-being has on the performance of mining workers. More specifically, to review the literature that could be sourced about: • impact of obesity, alcohol, tobacco use on companies; and • links between employee engagement and satisfaction and company productivity. Accordingly this review has attempted to ascertain what factors an organisation should focus on in order to reduce absenteeism and turnover and increase commitment, satisfaction, safety and productivity, with specific reference to the mining industry in Australia. The structure of the report aligns with the stated objectives in that each of the first three parts address an objective. Part IV summarises prominent issues that have arisen and offers some concluding observations and comments.

Cinema studies : Women's Experimental Cinema edited by Robin Blaetz

Women’s Experimental Cinema provides lively introductions to the work of fifteen avant-garde women filmmakers, some of whom worked as early as the 1950s and many of whom are still working today. In each essay in this collection, a leading film scholar considers a single filmmaker, supplying biographical information, analyzing various influences on her work, examining the development of her corpus, and interpreting a significant number of individual films. The essays rescue the work of critically neglected but influential women filmmakers for teaching, further study, and, hopefully, restoration and preservation. Just as importantly, they enrich the understanding of feminism in cinema and expand the terrain of film history, particularly the history of the American avant-garde.

Gender studies : Intersex by Catherine Harper

Intersex is the condition whereby an individual is born with biological features that are simultaneously perceived as male and female. Ranging from the ambiguous genitalia of the true 'hermaphrodite' to the 'mildly or internally intersexed', the condition may be as common as cleft palate. Like cleft palate, it is hidden and surgically altered, but for very different reasons. Intersex draws heavily on the personal testimony of intersexed individuals, their loved ones and medical carers. The impact of early sex-assignment surgery on an individual's later life is examined within the context of ethical and clinical questions. Harper challenges the conventional and radical 'treatment' of intersexuality through non-consensual infant sex-assignment surgery. In doing so, she exposes powerful myths, taboos and constructions of gender - the perfect phallus, a bi-polar model of gender and the infallibility of medical decisions. Handling sensitive material with care, this book deepens our understanding of a condition that has itself only been medically understood in recent years.

Innovation & workplace culture in the Australian interactive entertainment industry : the Halfbrick story

A recent success story of the Australian videogames industry is Brisbane based Halfbrick Studios, developer of the hit game for mobile devices, Fruit Ninja. Halfbrick not only survived the global financial crisis and an associated downturn in the Australian industry, but grew strongly, moving rapidly from developing licensed properties for platforms such as Game Boy Advance, Nintendo DS, and Playstation Portable (PSP) to becoming an independent developer and publisher of in-house titles, generating revenue both through App downloads and merchandise sales. Amongst the reasons for Halfbrick’s success is their ability to adaptively transform by addressing different technical platforms, user dynamics, business models and market conditions. Our ongoing case-study research from 2010 into Halfbrick’s innovation processes, culminating with some 10 semi-structured interviews with senior managers and developers, has identified a strong focus on workplace organisational culture, with staff reflecting that the company is a flat, team-based organisation devolving as much control as possible to the development teams directly, and encouraging a work-life balance in which creativity can thrive. The success of this strategy is evidenced through Halfbrick’s low staff turnover; amongst our interviewees most of the developers had been with the company for a number of years, with all speaking positively of the workplace culture and sense of creative autonomy they enjoyed. Interviews with the CEO, Shainiel Deo, and team leaders highlighted the autonomy afforded to each team and the organisation and management of the projects on which they work. Deo and team leaders emphasised the collaboration and communication skills they require in the developers that they employ, and that these characteristics were considered just as significant in hiring decisions as technical skills. Halfbrick’s developers celebrate their workplace culture and insist it has contributed to their capacity for innovation and to their commercial success with titles such as Fruit Ninja. This model of organisational management is reflected in both Stark’s (2009) idea of heterarchy, and Neff’s (2012) concept of venture labour, and provides a different perspective on the industry than the traditional political economy critique of precarious labour exploited by gaming conglomerates. Nevertheless, throughout many of the interviews and in our informal discussions with Halfbrick developers there is also a sense that this rewarding culture is quite tenuous and precarious in the context of a rapidly changing and uncertain global videogames industry. Whether such a workplace culture represents the future of the games industry, or is merely a ‘Prague Spring’ before companies such as Halfbrick are swallowed by traditional players’ remains to be seen. However, as the process of rapid and uncertain transformation plays out across the videogames industry, it is important to pay attention to emerging modes of organisation and workplace culture, even whilst they remain at the margins of the industry. In this paper we investigate Halfbrick’s workplace culture and ask how sustainable is this kind of rewarding and creative workplace?

Validation of β-actin used as endogenous control for gene expression analysis in mechanobiology studies : amendments

We write in response to the letter by Liu et al. [1] commenting on our article, ‘‘Mesenchymal Stem Cells Regulate Angiogenesis According to Their Mechanical Environment’’ [2]. The study by Liu et al. demonstrates that the commonly used endogeneous reference gene (ERG), b-actin, is upregulated by mechanical loading, indicating a potential bias in the determined target gene expression when normalizing to b-actin, such as in our report on unchanged vascular endothelial growth factor (VEGF) and hypoxia-inducible factors (HIF)-1a mRNA levels in mechanically loaded mesenchymal stem cells (MSCs).

Cyclic mechanical strain guides capillary-like morphology in vitro

Introduction Stretching of tissue stimulates angiogenesis but increased motion at a fracture site hinders revascularisation. In vitro studies have indicated that mechanical stimuli promote angiogenic responses in endothelial cells, but can either inhibit or enhance responses when applied directly to angiogenesis assays. We anticipated that cyclic tension applied during endothelial network assembly would increase vascular structure formation up to a certain threshold. Methods Fibroblast/HUVEC co-cultures were subjected to cyclic equibiaxial strain (1 Hz; 6 h/day; 7 days) using the FlexerCell FX-4000T system and limiting rings for simultaneous application of multiple strain magnitudes (0–13%). Cells were labelled using anti-PECAM-1, and image analysis provided measures of endothelial network length and numbers of junctions. Results Cyclic stretching had no significant effect on the total length of endothelial networks (P > 0.2) but resulted in a strain-dependent decrease in branching and localised alignments of endothelial structures, which were in turn aligned with the supporting fibroblastic construct. Conclusion The organisation of endothelial networks under cyclic strain is dominated by structural adaptation to the supporting construct. It may be that, in fracture healing, the formation and integrity of the granulation tissue and callus is ultimately critical in revascularisation and its failure under severe strain conditions.

Music production in times of monopoly : the example of Sweden

For several decades now, Sweden has been successful in the worldwide popular music arena. This article explores how Sweden, as an integral part of the global music industry, has been able to cope with the changed market conditions brought about by regulatory changes and digital technologies. The article reflects on the virtualization of music distribution, the decline of the long‐play album and the ageing popular music audience.

Lesson studies in Chinese kindergartens

Lesson studies are a powerful form of professional development (Doig and Groves, 2011). The processes of creating, enacting, analyzing, and refining lessons to improve teaching practices are key components of lesson studies. Lesson studies have been the primary form of professional development in Japanese classrooms for many years (Lewis, Perry and Hurd, 2009). This model is now used to improve instruction in many South-East Asian countries (White and Lim, 2008), as well as increasingly in North America (Lesson Study Research Group, 2004), and South Africa (Ono and Ferreira, 2010). In China, this form of professional development aimed at improving teaching, has also been adopted, originating from Soviet models of teacher professional development arising from influences post 1949 (China Education Yearbook, 1986). Thus, China too has a long history of improving teaching and learning through this form of school-based professional learning.