Pitfalls in the use of kappa when interpreting agreement between multiple raters in reliability studies

OBJECTIVE To compare different reliability coefficients (exact agreement, and variations of the kappa (generalised, Cohen's and Prevalence Adjusted and Biased Adjusted (PABAK))) for four physiotherapists conducting visual assessments of scapulae. DESIGN Inter-therapist reliability study. SETTING Research laboratory. PARTICIPANTS 30 individuals with no history of neck or shoulder pain were recruited with no obvious significant postural abnormalities. MAIN OUTCOME MEASURES Ratings of scapular posture were recorded in multiple biomechanical planes under four test conditions (at rest, and while under three isometric conditions) by four physiotherapists. RESULTS The magnitude of discrepancy between the two therapist pairs was 0.04 to 0.76 for Cohen's kappa, and 0.00 to 0.86 for PABAK. In comparison, the generalised kappa provided a score between the two paired kappa coefficients. The difference between mean generalised kappa coefficients and mean Cohen's kappa (0.02) and between mean generalised kappa and PABAK (0.02) were negligible, but the magnitude of difference between the generalised kappa and paired kappa within each plane and condition was substantial; 0.02 to 0.57 for Cohen's kappa and 0.02 to 0.63 for PABAK, respectively. CONCLUSIONS Calculating coefficients for therapist pairs alone may result in inconsistent findings. In contrast, the generalised kappa provided a coefficient close to the mean of the paired kappa coefficients. These findings support an assertion that generalised kappa may lead to a better representation of reliability between three or more raters and that reliability studies only calculating agreement between two raters should be interpreted with caution. However, generalised kappa may mask more extreme cases of agreement (or disagreement) that paired comparisons may reveal.

Modeling predictors of risky drug use behavior among male street laborers in urban Vietnam

Background The application of theoretical frameworks for modeling predictors of drug risk among male street laborers remains limited. The objective of this study was to test a modified version of the IMB (Information-Motivation-Behavioral Skills Model), which includes psychosocial stress, and compare this modified version with the original IMB model in terms of goodness-of-fit to predict risky drug use behavior among this population. Methods In a cross-sectional study, social mapping technique was conducted to recruit 450 male street laborers from 135 street venues across 13 districts of Hanoi city, Vietnam, for face-to-face interviews. Structural equation modeling (SEM) was used to analyze data from interviews. Results Overall measures of fit via SEM indicated that the original IMB model provided a better fit to the data than the modified version. Although the former model was able to predict a lesser variance than the latter (55% vs. 62%), it was of better fit. The findings suggest that men who are better informed and motivated for HIV prevention are more likely to report higher behavioral skills, which, in turn, are less likely to be engaged in risky drug use behavior. Conclusions This was the first application of the modified IMB model for drug use in men who were unskilled, unregistered laborers in urban settings. An AIDS prevention program for these men should not only distribute information and enhance motivations for HIV prevention, but consider interventions that could improve self-efficacy for preventing HIV infection. Future public health research and action may also consider broader factors such as structural social capital and social policy to alter the conditions that drive risky drug use among these men.

Use and usefulnss of PDSs in the financial planning context

Following considerable criticism of the complexity and lack of readability of product disclosure statements (PDSs), regulatory changes were introduced requiring shorter PDSs for certain investment products. This paper reports the findings of an online survey of financial planners regarding use of managed investment scheme (MIS) PDSs with clients, the perceived usefulness of PDSs as an information source, and their views on shorter PDSs. Our findings highlight major concerns about the usefulness of the PDS and disclosure reforms.

Possible, inevitable or fait accompli? An analysis of streaming video acquisition, acceptance and use in higher education

This paper explores the potential for online video as a mechanism to transform the ways students learn, as measured by research, user experience and usage following surveys and trials of patron-driven acquisition collaboratively undertaken by Queensland University of Technology, La Trobe University and Kanopy.

Governing young people’s drug use: Crime, harm and contemporary drug use practices

Since the nineteenth century, drug use has been variously understood as a problem of epidemiology, psychiatry, physiology, and criminality. Consequently drug research tends to be underpinned by assumptions of inevitable harm, and is often directed towards preventing drug use or solving problems. These constructions of the drug problem have generated a range of law enforcement responses, drug treatment technologies and rehabilitative programs that are intended to prevent drug related harm and resituate drug users in the realm of neo-liberal functional citizenship. This paper is based on empirical research of young people’s illicit drug use in Brisbane. The research rejects the idea of a pre-given drug problem, and seeks to understand how drugs have come to be defined as a problem. Using Michel Foucault’s conceptual framework of governmentality, the paper explores how the governance of illicit drugs, through law, public health and medicine, intersects with self-governance to shape young people’s drug use practices. It is argued that constructions of the drug problem shape what drug users believe about themselves and the ways in which they use drugs. From this perspective, drug use practices are ‘practices of the self’, formed through an interaction of the government of illicit drugs and the drug users own subjectivity.

Literature review : use of respite by carers of people with dementia

Respite care is a cornerstone service for the home management of people with dementia. It is used by carers to mitigate the stress related to the demands of caring by allowing time for them to rest and do things for themselves, thus maintaining the caring relationship at home and perhaps forestalling long-term placement in a residential aged care facility. Despite numerous anecdotal reports in support of respite care, its uptake by carers of people with dementia remains relatively low. The aim of this paper was to examine the factors that constitute the use of respite by carers of people with dementia by reviewing quantitative and qualitative research predominantly from the years 1990 to 2012. Seventysix international studies of different types of respite care were included for this review and their methods were critically appraised. The key topics identified were in relation to information access, the barriers to carers realising need for and seeking respite, satisfaction with respite services including the outcomes for carers and people with dementia, the characteristics of an effective respite service and the role of health workers in providing appropriate respite care. Finally, limitations with considering the literature as a whole were highlighted and recommendations made for future research.

Raising awareness of Australian Aboriginal peoples reality : Embedding Aboriginal knowledge in social work education through the use of field experiences

Effective social work practice with Aboriginal peoples and communities requires knowledge of operational communication skills and practice methods. In addition, there is also a need for practitioners to be aware of the history surrounding white engagement with Aboriginal communities and their cultures. Indeed, the Australian Association of Social Workers (AASW) acknowledges the importance of social workers practising cultural safety. Engendering knowledge of cultural safety for social work students is the opportunity to listen and talk with Aboriginal people who have experienced the destructive impacts of colonisation and the subsequent disruption to family and community. This article discusses the use of field experiences within a Masters of Social Work (Qualifying) Program (MSW) as an educational method aimed at increasing student awareness of contemporary Aboriginal issues and how to practice effectively and within a culturally safe manner.

Use of a photographic food diary method to document dietary intake in people with Parkinson's Disease

Cognitive impairment and physical disability are common in Parkinson’s disease (PD). As a result diet can be difficult to measure. This study aimed to evaluate the use of a photographic dietary record (PhDR) in people with PD. During a 12-week nutrition intervention study, 19 individuals with PD kept 3-day PhDRs on three occasions using point-and-shoot digital cameras. Details on food items present in the PhDRs and those not photographed were collected retrospectively during an interview. Following the first use of the PhDR method, the photographer completed a questionnaire (n=18). In addition, the quality of the PhDRs was evaluated at each time point. The person with PD was the sole photographer in 56% of the cases, with the remainder by the carer or combination of person with PD and the carer. The camera was rated as easy to use by 89%, keeping a PhDR was considered acceptable by 94% and none would rather use a “pen and paper” method. Eighty-three percent felt confident to use the camera again to record intake. Of the photos captured (n=730), 89% were of adequate quality (items visible, in-focus), while only 21% could be used alone (without interview information) to assess intake. Over the study, 22% of eating/drinking occasions were not photographed. PhDRs were considered an easy and acceptable method to measure intake among individuals with PD and their carers. The majority of PhDRs were of adequate quality, however in order to quantify intake the interview was necessary to obtain sufficient detail and capture missing items.

Innovations in dietary interventions : Use of a photographic food diary method and telephone linked computerized care in chronic disease

Access to dietetic care is important in chronic disease management and innovative technologies assists in this purpose. Photographic dietary records (PhDR) using mobile phones or cameras are valid and convenient for patients. Innovations in providing dietary interventions via telephone and computer can also inform dietetic practice. Three studies are presented. A mobile phone method was validated by comparing energy intake (EI) to a weighed food record and a measure of energy expenditure (EE) obtained using the doubly labelled water technique in 10 adults with T2 diabetes. The level of agreement between mean (±sd) energy intake mobile phone (8.2±1.7 MJ) and weighed record (8.5±1.6 MJ) was high (p=0.392), however EI/EE for both methods gave similar levels of under-reporting (0.69 and 0.72). All subjects preferred using the mobile phone vs. weighed record. Nineteen individuals with Parkinsons disease kept 3-day PhDRs on three occasions using point-and-shoot digital cameras over a 12 week period. The camera was rated as easy to use by 89%, keeping a PhDR was considered acceptable by 94% and none would rather use a “pen and paper” method. Eighty-three percent felt confident to use the camera again to record intake. An interactive, automated telephone system designed to coach people with T2 diabetes to adopt and maintain diabetes self-care behaviours, including nutrition, showed trends for improvements in total fat, saturated fat and vegetable intake of the intervention group compared to control participants over 6 months. Innovative technologies are acceptable to patients with chronic conditions and can be incorporated into dietetic care.

Preoperative fasting procedures : let's use the evidence

Today's anaesthetic techniques are improved and pulmonary aspiration in elective surgical patients is rare. The purpose of fasting guidelines for healthy, low risk patients undergoing elective surgery is to minimize the volume of gastric contents while avoiding unnecessary thirst and dehydration. Fasting guidelines should be based on the best available evidence and in the absence of evidence, on the knowledge of gastrointestinal physiology.

Visually impaired drivers who use bioptic telescopes : self-assessed driving skills and agreement with on-road driving evaluation

Purpose. To compare self-assessed driving habits and skills of licensed drivers with central visual loss who use bioptic telescopes to those of age-matched normally sighted drivers, and to examine the association between bioptic drivers' impressions of the quality of their driving and ratings by a “backseat” evaluator. Methods. Participants were licensed bioptic drivers (n = 23) and age-matched normally sighted drivers (n = 23). A questionnaire was administered addressing driving difficulty, space, quality, exposure, and, for bioptic drivers, whether the telescope was helpful in on-road situations. Visual acuity and contrast sensitivity were assessed. Information on ocular diagnosis, telescope characteristics, and bioptic driving experience was collected from the medical record or in interview. On-road driving performance in regular traffic conditions was rated independently by two evaluators. Results. Like normally sighted drivers, bioptic drivers reported no or little difficulty in many driving situations (e.g., left turns, rush hour), but reported more difficulty under poor visibility conditions and in unfamiliar areas (P < 0.05). Driving exposure was reduced in bioptic drivers (driving 250 miles per week on average vs. 410 miles per week for normally sighted drivers, P = 0.02), but driving space was similar to that of normally sighted drivers (P = 0.29). All but one bioptic driver used the telescope in at least one driving task, and 56% used the telescope in three or more tasks. Bioptic drivers' judgments about the quality of their driving were very similar to backseat evaluators' ratings. Conclusions. Bioptic drivers show insight into the overall quality of their driving and areas in which they experience driving difficulty. They report using the bioptic telescope while driving, contrary to previous claims that it is primarily used to pass the vision screening test at licensure.

Bike share's impact on car use : evidence from the United States, Great Britain, and Australia

There are currently more than 400 cities operating bike share programs. Purported benefits of bike share programs include flexible mobility, physical activity, reduced congestion, emissions and fuel use. Implicit or explicit in the calculation of program benefits are assumptions regarding the modes of travel replaced by bike share journeys. This paper examines the degree to which car trips are replaced by bike share, through an examination of survey and trip data from bike share programs in Melbourne, Brisbane, Washing, D.C., London, and Minneapolis/St. Paul. A secondary and unique component of this analysis examines motor vehicle support services required for bike share fleet rebalancing and maintenance. These two components are then combined to estimate bike share’s overall contribution to changes in vehicle kilometres traveled. The results indicate that the estimated mean reduction in car use due to bike share is at least twice the distance covered by operator support vehicles, with the exception of London, in which the relationship is reversed, largely due to a low car mode substitution rate. As bike share programs mature, evaluation of their effectiveness in reducing car use may become increasingly important. This paper reveals that by increasing the convenience of bike share relative to car use and by improving perceptions of safety, the capacity of bike share programs to reduce vehicle trips and yield overall net benefits will be enhanced. Researchers can adapt the analytical approach proposed in this paper to assist in the evaluation of current and future bike share programs.

A needle in a haystack : the use of routinely collected emergency department injury surveillance data to help identify physical child abuse

A retrospective, descriptive analysis of a sample of children under 18 years presenting to a hospital emergency department (ED) for treatment of an injury was conducted. The aim was to explore characteristics and identify differences between children assigned abuse codes and children assigned unintentional injury codes using an injury surveillance database. Only 0.1% of children had been assigned the abuse code and 3.9% a code indicating possible abuse. Children between 2-5 years formed the largest proportion of those coded to abuse. Superficial injury and bruising were the most common types of injury seen in children in the abuse group and the possible abuse group (26.9% and 18.8% respectively), whereas those with unintentional injury were most likely to present with open wounds (18.4%). This study demonstrates that routinely collected injury surveillance data can be a useful source of information for describing injury characteristics in children assigned abuse codes compared to those assigned no abuse codes.

GIS and qualitative data on young mothers’ use of urban neighbourhoods for physical activity

Public health research consistently demonstrates the salience of neighbourhood as a determinant of both health-related behaviours and outcomes across the human life course. This paper will report on the findings from a mixed-methods Brisbane-based study that explores how mothers with primary school children from both high and low socioeconomic suburbs use the local urban environment for the purpose of physical activity. Firstly, we demonstrate findings from an innovative methodology using the geographic information systems (GIS) embedded in social media platforms on mobile phones to track locations, resource-use, distances travelled, and modes of transport of the families in real-time; and secondly, we report on qualitative data that provides insight into reasons for differential use of the environment by both groups. Spatial/mapping and statistical data showed that while the mothers from both groups demonstrated similar daily routines, the mothers from the high SEP suburb engaged in increased levels of physical activity, travelled less frequently and less distance by car, and walked more for transport. The qualitative data revealed differences in the psychosocial processes and characteristics of the households and neighbourhoods of the respective groups, with mothers in the lower SEP suburb reporting more stress, higher conflict, and lower quality relationships with neighbours.

Do we need to follow medication use-by dates?

"It’s late in the night. And after a long day at work, you have a splitting headache. You rattle around in the bottom drawer of the bathroom vanity to find a packet of paracetamol tablets you know are hiding there. Phew, relief is at hand! Then you turn the packet over and discover that the crumpled box of pills actually expired two years ago..."--http://theconversation.com/explainer-do-we-need-to-follow-medication-use-by-dates-4329