Test-retest reliability of four physical activity measures used in population surveys

Accurate monitoring of prevalence and trends in population levels of physical activity (PA) is a fundamental public health need. Test-retest reliability (repeatability) was assessed in population samples for four self-report PA measures: the Active Australia survey (AA, N=356), the short International Physical Activity Questionnaire (IPAQ, N=104), the physical activity items in the Behavioral Risk Factor Surveillance System (BRFSS, N=127) and in the Australian National Health Survey (NHS, N=122). Percent agreement and Kappa statistics were used to assess reliability of classification of activity status as 'active', 'insufficiently active' or 'sedentary'. Intraclass correlations (ICCs) were used to assess agreement on minutes of activity reported for each item of each survey and for total minutes. Percent agreement scores for activity status were very good on all four instruments, ranging from 60% for the NHS to 79% for the IPAQ. Corresponding Kappa statistics ranged from 0.40 (NHS) to 0.52 (AA). For individual items, ICCs were highest for walking (0.45 to 0.78) and vigorous activity (0.22 to 0.64) and lowest for the moderate questions (0.16 to 0.44). All four measures provide acceptable levels of test-retest reliability for assessing both activity status and sedentariness, and moderate reliability for assessing total minutes of activity.

Advances in population surveillance for physical activity and sedentary behavior : reliability and validity of time use surveys

Many countries conduct regular national time use surveys, some of which date back as far as the 1960s. Time use surveys potentially provide more detailed and accurate national estimates of the prevalence of sedentary and physical activity behavior than more traditional self-report surveillance systems. In this study, the authors determined the reliability and validity of time use surveys for assessing sedentary and physical activity behavior. In 2006 and 2007, participants (n = 134) were recruited from work sites in the Australian state of New South Wales. Participants completed a 2-day time use diary twice, 7 days apart, and wore an accelerometer. The 2 diaries were compared for test-retest reliability, and comparison with the accelerometer determined concurrent validity. Participants with similar activity patterns during the 2 diary periods showed reliability intraclass correlations of 0.74 and 0.73 for nonoccupational sedentary behavior and moderate/vigorous physical activity, respectively. Comparison of the diary with the accelerometer showed Spearman correlations of 0.57-0.59 and 0.45-0.69 for nonoccupational sedentary behavior and moderate/vigorous physical activity, respectively. Time use surveys appear to be more valid for population surveillance of nonoccupational sedentary behavior and health-enhancing physical activity than more traditional surveillance systems. National time use surveys could be used to retrospectively study nonoccupational sedentary and physical activity behavior over the past 5 decades.

Comparison of surveys used to measure physical activity

Objective To compare the level of agreement in results obtained from four physical activity (PA) measurement instruments that are in use in Australia and around the world. Methods 1,280 randomly selected participants answered two sets of PA questions by telephone. 428 answered the Active Australia (AA) and National Health Surveys, 427 answered the AA and CDC Behavioural Risk Factor Surveillance System surveys (BRFSS), and 425 answered the AA survey and the short International Physical Activity Questionnaire (IPAQ). Results Among the three pairs of survey items, the difference in mean total PA time was lowest when the AA and NHS items were asked (difference=24) (SE:17) minutes, compared with 144 (SE:21) mins for AA/BRFSS and 406 (SE:27) mins for AA/IPAQ). Correspondingly, prevalence estimates for 'sufficiently active' were similar for AA and NHS (56% and 55% respectively), but about 10% higher when BRFSS data were used, and about 26% higher when the IPAQ items were used, compared with estimates from the AA survey. Conclusions The findings clearly demonstrate that there are large differences in reported PA times and hence in prevalence estimates of 'sufficient activity' from these four measures. Implications It is important to consistently use the same survey for population monitoring purposes. As the AA survey has now been used three times in national surveys, its continued use for population surveys is recommended so that trend data ever a longer period of time can be established.

Test-retest reliability of physical activity measures used in Australian population surveys

PURPOSE Accurate monitoring of prevalence and trends in population levels of physical activity is fundamental to the planning of health promotion and disease-prevention strategies. Test-retest reliability (repeatability) was assessed for four self-report measures of physical activity commonly used in population surveys: the Active Australia survey (AA, N=356), the short form of the International Physical Activity Questionnaire (IPAQ-S, N=104), the physical activity items in the Behavioral Risk Factor Surveillance System (BRFSS, N=127) and the physical activity items in the Australian National Health Survey (NHS, N=122). METHODS Percent agreement and Kappa statistics were used to assess the reliability of classification of activity status (where ‘active’= 150 minutes of activity per week) and sedentariness (where ‘sedentary’ = reporting no physical activity). Intraclass correlations (ICCs) were used to assess agreement on minutes of activity reported for each item of each survey and on total minutes reported in each survey. RESULTS Percent agreement scores for both activity status and sedentariness were very good on all four instruments. Overall the percent agreement between repeated surveys was between 73% (NHS) and 87% (IPAQ) for the criterion measure of achieving 150 minutes per week, and between 77% (NHS) and 89% (IPAQ) for the criterion of being sedentary. Corresponding Kappa statistics ranged from 0.46 (NHS) to 0.61 (AA) for activity status and from 0.20 (BRFSS) to 0.52 (AA) for sedentariness. For the individual items ICCs were highest for walking (0.45 to 0.56) and vigorous activity (0.22 to 0.64) and lowest for the moderate questions (0.16 to 0.44). CONCLUSION All four measures provide acceptable levels of test-retest reliability for assessing both activity status and sedentariness, and moderate reliability for assessing total minutes of activity. Supported by the Australian Commonwealth Department of Health and Ageing.

Evaluation of public hospital performance in Khanh Hoa Province : Vietnam in connection with patient and staff satisfaction surveys

This research aimed to develop a framework for performance evaluation of public hospitals in Vietnam that is culturally, socially, and politically appropriate. The research included both qualitative and quantitative methods and identified and validated novel instruments to measure patient satisfaction and job satisfaction of hospital staff and to determine a set of hospital indicators that reflect the quality of hospital performance. New models for understanding the determinants of patient and staff satisfaction were developed along with a new performance indicator framework for hospital performance. These instruments will now be applied to the evaluation of hospital services in Khanh Hoa Province, permitting longer term evaluation of their effectiveness in changing system wide performance and satisfaction.

E-mail in the workplace : the role of stress appraisals and normative response pressure in the relationship between email stressors and employee strain

In many organizations, e-mail is an effective and dominant workplace application tool; however, research identifying its role as a potential workplace stressor remains limited. Utilizing the Transactional Model of Stress (Lazarus & Folkman, 1984), 215 full-time administrative and academic staff at a university were surveyed about workplace e-mail. The aim was to study the effects of potential e-mail stressors on emotional exhaustion as mediated and moderated by person and situation variables. Results indicated that 2 distinct e-mail stressors—high quantity and poor quality (in terms of high emotionality and ambiguity) of workplace e-mail—were associated both with stress appraisals (e-mail overload and e-mail uncertainty) and with emotional exhaustion. Furthermore, the effects of the 2 e-mail stressors on emotional exhaustion were mediated by appraised e-mail overload. Perceived normative response pressure—a relevant aspect of the specific work environment—added to the explanation of emotional exhaustion and accentuated the positive effect of e-mail ambiguity on emotional exhaustion, although effects involving normative response pressure were not explained by the stress appraisals.

Understanding Uncertainties in Non-Linear Population Trajectories: A Bayesian Semi-Parametric Hierarchical Approach to Large-Scale Surveys of Coral Cover

Recently, attempts to improve decision making in species management have focussed on uncertainties associated with modelling temporal fluctuations in populations. Reducing model uncertainty is challenging; while larger samples improve estimation of species trajectories and reduce statistical errors, they typically amplify variability in observed trajectories. In particular, traditional modelling approaches aimed at estimating population trajectories usually do not account well for nonlinearities and uncertainties associated with multi-scale observations characteristic of large spatio-temporal surveys. We present a Bayesian semi-parametric hierarchical model for simultaneously quantifying uncertainties associated with model structure and parameters, and scale-specific variability over time. We estimate uncertainty across a four-tiered spatial hierarchy of coral cover from the Great Barrier Reef. Coral variability is well described; however, our results show that, in the absence of additional model specifications, conclusions regarding coral trajectories become highly uncertain when considering multiple reefs, suggesting that management should focus more at the scale of individual reefs. The approach presented facilitates the description and estimation of population trajectories and associated uncertainties when variability cannot be attributed to specific causes and origins. We argue that our model can unlock value contained in large-scale datasets, provide guidance for understanding sources of uncertainty, and support better informed decision making

Recent surveys of bats (Mammalia: Chiroptera) from China. I. Rhinolophidae and Hipposideridae

We conducted surveys of bats in China between 1999 and 2007, resulting in the identification of at least 62 species. In this paper we present data on 19 species, comprising 12 species from the family Rhinolophidae and seven from the Hipposideridae. Rhinolophids captured were Rhinolophus affinis, R. ferrumequinum, R. lepidus, R. luctus, R. macrotis, R. siamensis, R. marshalli, R. rex, R. pearsonii, R. pusillus, R. sinicus and R. stheno. Because of extensive morphological similarities we question the species distinctiveness of R. osgoodi (may be conspecific with R. lepidus), R. paradoxolophus (which may best be treated as a subspecies of R. rex), R. huananus (probably synonymous with R. siamensis), and we are skeptical as to whether R. sinicus is distinct from R. thomasi. Hipposiderids captured were Hipposideros armiger, H. cineraceus, H. larvatus, H. pomona, H. pratti, Aselliscus stoliczkanus and Coelops frithii. Of these species, two rhinolophids (Rhinolophus marshalli and R. stheno) and one hipposiderid (Hipposideros cineraceus) represent new species records for China. We present data on species' ranges, morphology and echolocation call frequencies, as well as some notes on ecology and conservation status. China hosts a considerable diversity of rhinolophid and hipposiderid bats, yet threats to their habitats and populations are substantial.

Integrating field survey data with satellite image data to improve shallow water seagrass maps : the role of AUV and snorkeller surveys

Repeatable and accurate seagrass mapping is required for understanding seagrass ecology and supporting management decisions. For shallow (< 5 m) seagrass habitats, these maps can be created by integrating high spatial resolution imagery with field survey data. Field survey data for seagrass is often collected via snorkelling or diving. However, these methods are limited by environmental and safety considerations. Autonomous Underwater Vehicles (AUVs) are used increasingly to collect field data for habitat mapping, albeit mostly in deeper waters (>20 m). Here we demonstrate and evaluate the use and potential advantages of AUV field data collection for calibration and validation of seagrass habitat mapping of shallow waters (< 5 m), from multispectral satellite imagery. The study was conducted in the seagrass habitats of the Eastern Banks (142 km2), Moreton Bay, Australia. In the field, georeferenced photos of the seagrass were collected along transects via snorkelling or an AUV. Photos from both collection methods were analysed manually for seagrass species composition and then used as calibration and validation data to map seagrass using an established semi-automated object based mapping routine. A comparison of the relative advantages and disadvantages of AUV and snorkeller collected field data sets and their influence on the mapping routine was conducted. AUV data collection was more consistent, repeatable and safer in comparison to snorkeller transects. Inclusion of deeper water AUV data resulted in mapping of a larger extent of seagrass (~7 km2, 5 % of study area) in the deeper waters of the site. Although overall map accuracies did not differ considerably, inclusion of the AUV data from deeper water transects corrected errors in seagrass mapped at depths to 5 m, but where the bottom is visible on satellite imagery. Our results demonstrate that further development of AUV technology is justified for the monitoring of seagrass habitats in ongoing management programs.

Improving wound management for residents in Residential Aged Care Facilities: National dissemination and implementation of the evidence based Champions for Skin Integrity Program

Overview The incidence of skin tears, pressure injuries and chronic wounds increases with age [1-4] and therefore is a serious issue for staff and residents in Residential Aged Care Facilities (RACFs). A pilot project funded in Round 2 of the Encouraging Best Practice in Residential Aged Care (EBPRAC) program by the then Australian Government Department of Health and Ageing found that a substantial proportion of residents in aged care facilities experienced pressure injuries, skin tears or chronic wounds. It also found the implementation of the evidence based Champions for Skin Integrity (CSI) model of wound care was successful in significantly decreasing the prevalence and severity of wounds in residents, improving staff skills and knowledge of evidence based wound management, increasing staff confidence with wound management, increasing implementation of evidence based wound management and prevention strategies, and increasing staff awareness of their roles in evidence based wound care at all levels [5]. Importantly, during the project, the project team developed a resource kit on evidence based wound management. Two critical recommendations resulting from the project were that: - The CSI model or a similar strategic approach should be implemented in RACFs to facilitate the uptake of evidence based wound management and prevention - The resource kit on evidence based wound management should be made available to all Residential Aged Care Facilities and interested parties A proposal to disseminate or rollout the CSI model of wound care to all RACFs across Australia was submitted to the department in 2012. The department approved funding from the Aged Care Services Improvement Healthy Ageing Grant (ACSIHAG) at the same time as the Round 3 of the Encouraging Better Practice in Aged Care (EBPAC) program. The dissemination involved two crucial elements: 1. The updating, refining and distribution of a Champions for Skin Integrity Resource Kit, more commonly known as a CSI Resource Kit and 2. The presentation of intensive one day Promoting Healthy Skin “Train the Trainer” workshops in all capital cities and major regional towns across Australia Due to demand, the department agreed to fund a second round of workshops focussing on regional centres and the completion date was extended to accommodate the workshops. Later, the department also decided to host a departmental website for a number of clinical domains, including wound management, so that staff from the residential aged care sector had easy access to a central repository of helpful clinical resource material that could be used for improving the health and wellbeing of their older adults, consumers and carers. CSI Resource Kit Upgrade and Distribution: At the start of the project, a full evidence review was carried out on the material produced during the EBPRAC-CSI Stage 1 project and the relevant evidence based changes were made to the documentation. At the same time participants in the EBPRAC-CSI Stage 1 project were interviewed for advice on how to improve the resource material. Following this the documentation, included in the kit, was sent to independent experts for peer review. When this process was finalised, a learning designer and QUT’s Visual Communications Services were engaged to completely refine and update the design of the resources, and combined resource kit with the goal of keeping the overall size of the kit suitable for bookshelf mounting and the cost at reasonable levels. Both goals were achieved in that the kit is about the same size as a 25 mm A4 binder and costs between $19.00 and $28.00 per kit depending on the size of the print run. The dissemination of the updated CSI resource kit was an outstanding success. Demand for the kits was so great that a second print run of 2,000 kits was arranged on top of the initial print run of 4,000 kits. All RACFs across Australia were issued with a kit, some 2,740 in total. Since the initial distribution another 1,100 requests for kits has been fulfilled as well as 1,619 kits being distributed to participants at the Promoting Healthy Skin workshops. As the project was winding up a final request email was sent to all workshop participants asking if they required additional kits or resources to distribute the remaining kits and resources. This has resulted in requests for 200 additional kits and resources. Feedback from the residential aged care sector and other clinical providers who have interest in wound care has been very positive regarding the utility of the kit, (see Appendix 4). Promoting Healthy Skin Workshops The workshops also exceeded the project team’s initial objective. Our goal of providing workshop training for staff from one in four facilities and 450 participants was exceeded, with overwhelming demand for workshop places resulting in the need to provide a second round of workshops across Australia. At the completion of the second round, 37 workshops had been given, with 1286 participants, representing 835 facilities. A number of strategies were used to promote the workshops ranging from invitations included in the kit, to postcard mail-outs, broadcast emailing to all facilities and aged care networks and to articles and paid advertising in aged care journals. The most effective method, by far, was directly phoning the facilities. This enabled the caller to contact the relevant staff member and enlist their support for the workshop. As this is a labour intensive exercise, it was only used where numbers needed bolstering, with one venue rising from 3 registrants before the calls to 53 registrants after. The workshops were aimed at staff who had the interest and the capability of implementing evidence-based wound management within their facility or organisation. This targeting was successful in that a large proportion (68%) of participants were Registered Nurses, Nurse Managers, Educators or Consultants. Twenty percent were Endorsed Enrolled Nurses with the remaining 12% being made up of Personal Care Workers or Allied Health Professionals. To facilitate long term sustainability, the workshop employed train-the-trainer strategies. Feedback from the EBPRAC-CSI Stage 1 interviews was used in the development of workshop content. In addition, feedback from the workshop conducted at the end of the EBPRAC-CSI Stage 1 project suggested that change management and leadership training should be included in the workshops. The program was trialled in the first workshop conducted in Brisbane and then rolled out across Australia. Participants were asked to complete pre and post workshop surveys at the beginning and end of the workshop to determine how knowledge and confidence improved over the day. Results from the pre and post surveys showed significant improvements in the level of confidence in attendees’ ability to implement evidence based wound management. The results also indicated a significant increase in the level of confidence in ability to implement change within their facility or organisation. This is an important indication that the inclusion of change management/leadership training with clinical instruction can increase staff capacity and confidence in translating evidence into practice. To encourage the transfer of the evidence based content of the workshop into practice, participants were asked to prepare an Action Plan to be followed by a simple one page progress report three months after the workshop. These reports ranged from simple (e.g. skin moisturising to prevent skin tears), to complex implementation plans for introducing the CSI model across the whole organisation. Outcomes described in the project reports included decreased prevalence of skin tears, pressure injuries and chronic wounds, along with increased staff and resident knowledge and resident comfort. As stated above, some organisations prepared large, complex plans to roll out the CSI model across their organisation. These plans included a review of the organisation’s wound care system, policies and procedures, the creation of new processes, the education of staff and clients, uploading education and resource material onto internal electronic platforms and setting up formal review and evaluation processes. The CSI Resources have been enthusiastically sought and incorporated into multiple health care settings, including aged care, acute care, Medicare Local intranets (e.g. Map of Medicine e-pathways), primary health care, community and home care organisations, education providers and New Zealand aged and community health providers. Recommendations: Recommendations for RACFs, aged care and health service providers and government  Skin integrity and the evidence-practice gap in this area should be recognised as a major health issue for health service providers for older adults, with wounds experienced by up to 50% of residents in aged care settings (Edwards et al. 2010). Implementation of evidence based wound care through the Champions for Skin Integrity model in this and the pilot project has demonstrated the prevalence of wounds, wound healing times and wound infections can be halved.  A national program and Centre for Evidence Based Wound Management should be established to: - expand the reach of the model to other aged care facilities and health service providers for older adults - sustain the uptake of models such as the Champions for Skin Integrity (CSI) model - ensure current resources, expertise and training are available for consumers and health care professionals to promote skin integrity for all older adults  Evidence based resources for the CSI program and similar projects should be reviewed and updated every 3 – 4 years as per NH&MRC recommendations  Leadership and change management training is fundamental to increasing staff capacity, at all levels, to promote within-organisation dissemination of skills and knowledge gained from projects providing evidence based training Recommendations for future national dissemination projects  A formal program of opportunities for small groups of like projects to share information and resources, coordinate activities and synergise education programs interactively would benefit future national dissemination projects - Future workshop programs could explore an incentive program to optimise attendance and reduce ‘no shows’ - Future projects should build in the capacity and funding for increased follow-up with workshop attendees, to explore the reasons behind those who are unable to translate workshop learnings into the workplace and identify factors to address these barriers.

Clustering acoustic events in environmental recordings for species richness surveys

Environmental acoustic recordings can be used to perform avian species richness surveys, whereby a trained ornithologist can observe the species present by listening to the recording. This could be made more efficient by using computational methods for iteratively selecting the richest parts of a long recording for the human observer to listen to, a process known as “smart sampling”. This allows scaling up to much larger ecological datasets. In this paper we explore computational approaches based on information and diversity of selected samples. We propose to use an event detection algorithm to estimate the amount of information present in each sample. We further propose to cluster the detected events for a better estimate of this amount of information. Additionally, we present a time dispersal approach to estimating diversity between iteratively selected samples. Combinations of approaches were evaluated on seven 24-hour recordings that have been manually labeled by bird watchers. The results show that on average all the methods we have explored would allow annotators to observe more new species in fewer minutes compared to a baseline of random sampling at dawn.

Automating marine mammal detection in aerial images captured during wildlife surveys: A deep learning approach

Aerial surveys conducted using manned or unmanned aircraft with customized camera payloads can generate a large number of images. Manual review of these images to extract data is prohibitive in terms of time and financial resources, thus providing strong incentive to automate this process using computer vision systems. There are potential applications for these automated systems in areas such as surveillance and monitoring, precision agriculture, law enforcement, asset inspection, and wildlife assessment. In this paper, we present an efficient machine learning system for automating the detection of marine species in aerial imagery. The effectiveness of our approach can be credited to the combination of a well-suited region proposal method and the use of Deep Convolutional Neural Networks (DCNNs). In comparison to previous algorithms designed for the same purpose, we have been able to dramatically improve recall to more than 80% and improve precision to 27% by using DCNNs as the core approach.

Assistive classification for improving the efficiency of avian species richness surveys

Avian species richness surveys, which measure the total number of unique avian species, can be conducted via remote acoustic sensors. An immense quantity of data can be collected, which, although rich in useful information, places a great workload on the scientists who manually inspect the audio. To deal with this big data problem, we calculated acoustic indices from audio data at a one-minute resolution and used them to classify one-minute recordings into five classes. By filtering out the non-avian minutes, we can reduce the amount of data by about 50% and improve the efficiency of determining avian species richness. The experimental results show that, given 60 one-minute samples, our approach enables to direct ecologists to find about 10% more avian species.