Pitfalls in the use of kappa when interpreting agreement between multiple raters in reliability studies

OBJECTIVE To compare different reliability coefficients (exact agreement, and variations of the kappa (generalised, Cohen's and Prevalence Adjusted and Biased Adjusted (PABAK))) for four physiotherapists conducting visual assessments of scapulae. DESIGN Inter-therapist reliability study. SETTING Research laboratory. PARTICIPANTS 30 individuals with no history of neck or shoulder pain were recruited with no obvious significant postural abnormalities. MAIN OUTCOME MEASURES Ratings of scapular posture were recorded in multiple biomechanical planes under four test conditions (at rest, and while under three isometric conditions) by four physiotherapists. RESULTS The magnitude of discrepancy between the two therapist pairs was 0.04 to 0.76 for Cohen's kappa, and 0.00 to 0.86 for PABAK. In comparison, the generalised kappa provided a score between the two paired kappa coefficients. The difference between mean generalised kappa coefficients and mean Cohen's kappa (0.02) and between mean generalised kappa and PABAK (0.02) were negligible, but the magnitude of difference between the generalised kappa and paired kappa within each plane and condition was substantial; 0.02 to 0.57 for Cohen's kappa and 0.02 to 0.63 for PABAK, respectively. CONCLUSIONS Calculating coefficients for therapist pairs alone may result in inconsistent findings. In contrast, the generalised kappa provided a coefficient close to the mean of the paired kappa coefficients. These findings support an assertion that generalised kappa may lead to a better representation of reliability between three or more raters and that reliability studies only calculating agreement between two raters should be interpreted with caution. However, generalised kappa may mask more extreme cases of agreement (or disagreement) that paired comparisons may reveal.

Literature review : use of respite by carers of people with dementia

Respite care is a cornerstone service for the home management of people with dementia. It is used by carers to mitigate the stress related to the demands of caring by allowing time for them to rest and do things for themselves, thus maintaining the caring relationship at home and perhaps forestalling long-term placement in a residential aged care facility. Despite numerous anecdotal reports in support of respite care, its uptake by carers of people with dementia remains relatively low. The aim of this paper was to examine the factors that constitute the use of respite by carers of people with dementia by reviewing quantitative and qualitative research predominantly from the years 1990 to 2012. Seventysix international studies of different types of respite care were included for this review and their methods were critically appraised. The key topics identified were in relation to information access, the barriers to carers realising need for and seeking respite, satisfaction with respite services including the outcomes for carers and people with dementia, the characteristics of an effective respite service and the role of health workers in providing appropriate respite care. Finally, limitations with considering the literature as a whole were highlighted and recommendations made for future research.

Raising awareness of Australian Aboriginal peoples reality : Embedding Aboriginal knowledge in social work education through the use of field experiences

Effective social work practice with Aboriginal peoples and communities requires knowledge of operational communication skills and practice methods. In addition, there is also a need for practitioners to be aware of the history surrounding white engagement with Aboriginal communities and their cultures. Indeed, the Australian Association of Social Workers (AASW) acknowledges the importance of social workers practising cultural safety. Engendering knowledge of cultural safety for social work students is the opportunity to listen and talk with Aboriginal people who have experienced the destructive impacts of colonisation and the subsequent disruption to family and community. This article discusses the use of field experiences within a Masters of Social Work (Qualifying) Program (MSW) as an educational method aimed at increasing student awareness of contemporary Aboriginal issues and how to practice effectively and within a culturally safe manner.

Use of a photographic food diary method to document dietary intake in people with Parkinson's Disease

Cognitive impairment and physical disability are common in Parkinson’s disease (PD). As a result diet can be difficult to measure. This study aimed to evaluate the use of a photographic dietary record (PhDR) in people with PD. During a 12-week nutrition intervention study, 19 individuals with PD kept 3-day PhDRs on three occasions using point-and-shoot digital cameras. Details on food items present in the PhDRs and those not photographed were collected retrospectively during an interview. Following the first use of the PhDR method, the photographer completed a questionnaire (n=18). In addition, the quality of the PhDRs was evaluated at each time point. The person with PD was the sole photographer in 56% of the cases, with the remainder by the carer or combination of person with PD and the carer. The camera was rated as easy to use by 89%, keeping a PhDR was considered acceptable by 94% and none would rather use a “pen and paper” method. Eighty-three percent felt confident to use the camera again to record intake. Of the photos captured (n=730), 89% were of adequate quality (items visible, in-focus), while only 21% could be used alone (without interview information) to assess intake. Over the study, 22% of eating/drinking occasions were not photographed. PhDRs were considered an easy and acceptable method to measure intake among individuals with PD and their carers. The majority of PhDRs were of adequate quality, however in order to quantify intake the interview was necessary to obtain sufficient detail and capture missing items.

Innovations in dietary interventions : Use of a photographic food diary method and telephone linked computerized care in chronic disease

Access to dietetic care is important in chronic disease management and innovative technologies assists in this purpose. Photographic dietary records (PhDR) using mobile phones or cameras are valid and convenient for patients. Innovations in providing dietary interventions via telephone and computer can also inform dietetic practice. Three studies are presented. A mobile phone method was validated by comparing energy intake (EI) to a weighed food record and a measure of energy expenditure (EE) obtained using the doubly labelled water technique in 10 adults with T2 diabetes. The level of agreement between mean (±sd) energy intake mobile phone (8.2±1.7 MJ) and weighed record (8.5±1.6 MJ) was high (p=0.392), however EI/EE for both methods gave similar levels of under-reporting (0.69 and 0.72). All subjects preferred using the mobile phone vs. weighed record. Nineteen individuals with Parkinsons disease kept 3-day PhDRs on three occasions using point-and-shoot digital cameras over a 12 week period. The camera was rated as easy to use by 89%, keeping a PhDR was considered acceptable by 94% and none would rather use a “pen and paper” method. Eighty-three percent felt confident to use the camera again to record intake. An interactive, automated telephone system designed to coach people with T2 diabetes to adopt and maintain diabetes self-care behaviours, including nutrition, showed trends for improvements in total fat, saturated fat and vegetable intake of the intervention group compared to control participants over 6 months. Innovative technologies are acceptable to patients with chronic conditions and can be incorporated into dietetic care.

A needle in a haystack : the use of routinely collected emergency department injury surveillance data to help identify physical child abuse

A retrospective, descriptive analysis of a sample of children under 18 years presenting to a hospital emergency department (ED) for treatment of an injury was conducted. The aim was to explore characteristics and identify differences between children assigned abuse codes and children assigned unintentional injury codes using an injury surveillance database. Only 0.1% of children had been assigned the abuse code and 3.9% a code indicating possible abuse. Children between 2-5 years formed the largest proportion of those coded to abuse. Superficial injury and bruising were the most common types of injury seen in children in the abuse group and the possible abuse group (26.9% and 18.8% respectively), whereas those with unintentional injury were most likely to present with open wounds (18.4%). This study demonstrates that routinely collected injury surveillance data can be a useful source of information for describing injury characteristics in children assigned abuse codes compared to those assigned no abuse codes.

GIS and qualitative data on young mothers’ use of urban neighbourhoods for physical activity

Public health research consistently demonstrates the salience of neighbourhood as a determinant of both health-related behaviours and outcomes across the human life course. This paper will report on the findings from a mixed-methods Brisbane-based study that explores how mothers with primary school children from both high and low socioeconomic suburbs use the local urban environment for the purpose of physical activity. Firstly, we demonstrate findings from an innovative methodology using the geographic information systems (GIS) embedded in social media platforms on mobile phones to track locations, resource-use, distances travelled, and modes of transport of the families in real-time; and secondly, we report on qualitative data that provides insight into reasons for differential use of the environment by both groups. Spatial/mapping and statistical data showed that while the mothers from both groups demonstrated similar daily routines, the mothers from the high SEP suburb engaged in increased levels of physical activity, travelled less frequently and less distance by car, and walked more for transport. The qualitative data revealed differences in the psychosocial processes and characteristics of the households and neighbourhoods of the respective groups, with mothers in the lower SEP suburb reporting more stress, higher conflict, and lower quality relationships with neighbours.

The impact of personal identity and intimacy on the use of social media

Personal identity and intimacy levels change over time and this can influence the way consumers buy and use goods and services. This thesis examined how levels of personal identity and intimacy influence the use of social media by consumers of different ages. A survey of 208 users of facebook demonstrated that consumers with weak levels of personal identity use social media to increase their identity and popularity, while consumers with strong levels of personal identity use social media for self-expression. Consumers with high intimacy levels use social media for socian connection and social investigation.

The Use of Ecological Design to Achieve Sustainable Development in Queensland, Australia

This series of technical papers arose out of the action by a private entrepreneur to initiate a process beyond mere regulatory compliance in order to achieve best environmental practice at proposed large new visitor gateways to Australia’s Great Barrier Reef. Because of the complexity of issues involved at such urbanized downstream sites, the range of topics covered is wide – though still only those considered at this juncture to be of management priority. Included on this platform is one introductory paper reviewing the history of environmental management in the field in Queensland, and three papers which seek to appreciate the main techniques by which government contributes to the solutions viz. through the national park, threatened species list, and environmental impact assessment. The history paper was designed to allow the present series to be considered in broad context as well as performance to date. The work emphasizes that much of the fertile land that must be sustained nowadays lies in the province of the private sector, and that the initiative to create any new cost-effective paradigm in ecologically-sustainable practices lies mostly in their hands. In all instances, this strategic approach to large-scale property planning is through ecological design – using field case studies around the immediate biophysical catchment of the development, with attendant focus on the associated legal catchment (the actual development site) and the social catchment (the effective land managers). The first of these has given rise to a document termed a Regional Landscape Strategy, its implementation planned in concert with an Environmental Impact Assessment of the site and with a Strategic Regional Initiative (still being tested in the field) for community engagement. The first document takes into account the aspirations of government as expressed in its broad-scale regional plans.

What factors influence nurses’ assessment practices? Development of the Barriers to Nurses’ use of Physical Assessment Scale

Aim To develop and psychometrically test the Barriers to Nurses’ use of Physical Assessment Scale. Background There is growing evidence of failure to recognise hospitalised patients at risk of clinical deterioration, in part due to inadequate physical assessment by nurses. Yet, little is known about the barriers to nurses’ use of physical assessment in the acute hospital setting and no validated scales have been published. Design Instrument development study. Method Scale development was based on a comprehensive literature review, focus groups, expert review and psychometric evaluation. The scale was administered to 434 acute care registered nurses working at a large Australian teaching hospital between June and July 2013. Psychometric analysis included factor analysis, model fit statistics and reliability testing. Results The final scale was reduced to 38 items representing seven factors, together accounting for 57.7% of the variance: (1) reliance on others and technology, (2) lack of time and interruptions, (3) ward culture, (4) lack of confidence, (5) lack of nursing role models, (6) lack of influence on patient care, and; (7) specialty area. Internal reliability ranged from .70 to .86. Conclusion Findings provide initial evidence for the validity and reliability of the Barriers to Nurses’ use of Physical Assessment Scale and point to the importance of understanding the organisational determinants of nurses’ assessment practices. The new scale has potential clinical and research applications to support nursing assessment in acute care settings.

The changing motivations of students’ use of lecture podcasts across a semester: An extended theory of planned behaviour approach

We extended the previous work of Moss, O’Connor and White, to include a measure of group norms within the theory of planned behaviour (TPB), to examine the influences on students’ decisions to use lecture podcasts as part of their learning. Participants (N = 90) completed the extended TPB predictors before semester began (Time 1) and mid-semester (Time 2) and reported on their podcast use at mid-semester (Time 2) and end of semester (Time 3). We found that attitudes and perceived social pressures were important in informing intentions at both time points. At Time 1, perceptions of control over performing the behaviour and, at Time 2, perceptions of whether podcast use was normative among fellow students (group norms) also predicted intended podcast use. Intentions to use podcasting predicted self-reported use at both Time 2 and Time 3. These results provide important applied information for educators to encourage student use of novel on-line educational tools.

Migrants' use of the Internet in re-settlement

The project is a qualitative and ethnographic study investigating how the internet is used by migrants from cultural and linguistically diverse (CALD) groups. It examines how internet use assists the re- settlement process in Brisbane, Australia. The project aims to support strategies and initiatives in the successful re-settlement of migrants from CALD groups into urban localities. It has 2 main foci: • To find out how and what type of online information and services are used by migrants and what are the barriers to accessing the information. Information and resources about transport, housing, health, social services, education and other information is essential for successful re-settlement. • In what ways is the internet is used as a social medium, to communicate with friends and family in homeland countries and connect with people in local regions, in ways that might help to combat social isolation.

Students’ perceptions and use of the Internet as a news channel

New technologies, in particular the Internet, have transformed journalistic practices in many ways around the world. While a number of studies have investigated how established journalists are dealing with and using new technologies in a number of countries, very little attention has been paid to how student journalists view and use the Internet as a source of news. This study examined the ways in which second and third-year journalism and arts students at the University of Queensland (Australia) get their news, how they use the Internet as a news channel, as well as their perceptions and use of other new technologies. The authors draw on the theoretical frameworks of uses and gratifications, as well as the media richness theory to explore the primary reasons why students use and perceive the Internet as a news channel.

QUT Library advances the use of open public tools to navigate genetic inventions and builds research networks

Many emerging economies are dangling the patent system to stimulate bio-technological innovations with the ultimate premise that these will improve their economic and social growth. The patent system mandates full disclosure of the patented invention in exchange of a temporary exclusive patent right. Recently, however, patent offices have fallen short of complying with such a mandate, especially for genetic inventions. Most patent offices provide only static information about disclosed patent sequences and even some do not keep track of the sequence listing data in their own database. The successful partnership of QUT Library and Cambia exemplifies advocacy in Open Access, Open Innovation and User Participation. The library extends its services to various departments within the university, builds and encourages research networks to complement skills needed to make a contribution in the real world.