Validating a teaching survey which drives increased response rates in a unit survey

At Curtin University, student perceptions of teaching and learning are gathered and reported online through eVALUate, a system that includes separate unit and teaching surveys. This article reports the development and validation of one of those surveys, the eVALUate teaching survey, which was developed based on the research literature on excellent teaching and evaluation. Since its development in 2006, repeated statistical testing using progressively larger samples has shown that the survey is valid and reliable. Moreover, the way in which the teaching survey is deployed within eVALUate, appended to the unit survey, which provides crucial institutional data, has significantly increased university response rates. This validated instrument is used for self-reflection, professional development, and rewarding staff.

Modification of the National Inpatient Medication Chart improves venous thromboembolism prophylaxis rates in high-risk medical patients

Background : Venous thromboembolism (VTE) is a significant contributor to morbidity and mortality in Australia. While there is well-established evidence for the use of VTE prophylaxis in hospital inpatients, adherence to such guidelines is poor. Aim : The aim of the present study is to assess the impact of education and system change on improving rates of VTE prophylaxis in hospital inpatients. Methods : We performed four consecutive audits of inpatient medical records of a regional hospital service over 2 years. The audits aimed to test the impact of serial interventions at increasing the appropriate use of VTE prophylaxis (based on risk assessment). The interventions were (i) staff education and (ii) a process change that mandated a prophylaxis decision by modifying the National Inpatient Medication Chart with ‘VTE avoidance’ preprinted in the first medication box. Results : Our results from the baseline study showed that of the 236 medical inpatients reviewed, 80% were at high risk of VTE. Of this high-risk cohort, 34.9% (confidence interval (CI) 28–42%) had appropriate prophylaxis decisions. Post the education intervention, 43.2% (CI 37–49%) of the high-risk cohort received appropriate VTE prophylaxis, an improvement of 8.3% (CI −1% to 18%) from baseline. With the subsequent introduction of a process change, 82.1% (CI 66–92%) of the high-risk cohort received appropriate prophylaxis, an improvement of 47.2% and 38.8% (CI 24–54%) when compared with baseline and education respectively. Retention rates at 11 months postsystem change were 73% (CI 55–86%). Conclusions : This study therefore concluded that while education has an impact on rates of appropriate VTE prophylaxis, it is system change that has the most marked and sustained effect.

Response rates in Australian market research

RICA commissioned Deakin University to “establish whether response rates are in decline in the Australian market research industry and to identify, as far as possible, the reasons for these declines if they exist. This is likely to involve a review of previous research, a literature review and collection of data on response rates provided on a confidential basis and with the assistance of AMSRO to facilitate data provision.”

Attempts were made to contact all listed market research companies in Australia, including all major internet panel companies. While industry co-operation was not high with the study, sufficient data was provided to depict current response rates and to show how they had declined over time. Because of the low contactability issues, this Report proposes the use of better methods to compute the reliability of survey estimates by taking account of past survey results.

The literature review revealed a wealth of recent studies, with the main emphasis being on studies of telephone and internet surveys. This review of the research produced 34 evidence-based guidelines for social researchers. While some of these reflect current practice, the emergence of the internet as the main survey method raises a number of disclosure and sampling issues. Esomar (2012) has produced 28 issues to be raised with providers, which sets the basis for good industry practice. This suggests an opportunity for the industry to adopt these standards as its own and to conduct training courses for major clients and suppliers. There are many panel providers, some of whom are not AMSRO members. AMSRO may need to examine what role it can play in mandating or encouraging adherence to these standards as a way of promoting the industry.

Talks with key industry people, as well as the literature, have revealed the importance of blended surveys, where multiple contact and response mechanisms are used. Particularly where an internet panel is used as one source, this poses representativeness and weighting issues which are difficult to resolve. The Report recommends that where blended survey methods are used, measures be taken to measure contactability in the other contact media, along with more sophisticated weighting schemes. The industry should examine its training courses to ensure that industry expertise keeps pace with these developments.
Summary of Results

The results focus on two main collection methods – the telephone and the internet. As far as the telephone is concerned response rates have been in a gradual decline the last decade. This outcome is hard to detect because the data show considerable fluctuations from one survey wave to the next. Among cold-calling surveys, telephone response rates are typically below 10%, for a range of topics and survey types. Co-operation rates, (the ratio of obtained interviews to refusals) are typically below 0.2 (that is below one interview to five refusals). Telephone interviews with clients have a higher response rate – typically above 20% with co-operation rates above 1.0. It would appear that some topics, such as financial services, may induce a lower level of co-operation. Government sponsored surveys have higher response rates, at times over 50%, but even here a sharp decline in response rates over time for one long running monitor was observed. Co-operation rates were also higher in government sponsored surveys.

One long data series from a telephone omnibus suggested that the “Do Not Call Register” which began in May, 2007 had some positive effects for the industry. Initially there was a spike in both response rates and co-operation. Although this was relatively short-lived, response rates thereafter declined more slowly and co-operation rates were somewhat higher and remained stable. These conclusions should be regarded as tentative as more data series would really be necessary to see if similar trends occurred elsewhere.

As far as the internet is concerned, panel response rates are around the 20% mark and appear to be relatively stable over the last few years. In this case, the gross response rate is the number of interviews divided by the number of invitations sent. As the number of invitations may be a function of the need to fill a survey quickly, it should be considered a gross indicator of response. In order to capture this phenomenon, a further measure has been devised, termed the “attempt rate” which measures the percentage of people who attempt to participate once sent the invitation. The available data suggests that it is relatively stable. However, it is also somewhat susceptible to the time the survey was left open. Finally, a co-operation rate was also calculated. It measures the ratio of completed to terminated interviews, typically at least five interviews to each termination, but often much higher. This measure is not directly comparable with the co-operation rate in telephone surveys because it cannot take account of the number of eligible people on the panel who open the invitation, see the company doing the survey or its length and decide not to take the survey. For internet client studies, response rates were typically somewhat higher than shown for the panels, but there was marked variability.

There was only one study provided of intercept interviews. It showed response rates of over 60% and co-operation rates of nearly 2 interviews per refusal. A strength and a weakness of intercept interviewing is the ability to be selective in who is asked to participate. As for mail, one government sponsored mail survey from 2010 is reported, with a response rate over 50%. The previous review contains more data, as mail appears to be infrequently used within the industry for commercial surveys.

While surveys remain a major and highly effective tool for the industry and its clients, issues with contactability and co-operation mean that even closer attention is needed to survey design, sampling, weighting and analysis than was previously the case.

High rates of alcohol consumption and related harm at schoolies week : a portal study

To investigate alcohol consumption, substance use and risky and harmful behaviour among young people attending 'schoolies' week in Victoria.

Professionals’ views on child sexual abuse attrition rates

Child sexual abuse cases often do not result in convictions; this attrition is due to factors inside and outside the control of the justice system. The aims of the current study were to: (1) establish the most important factors in contributing to the attrition of child sexual abuse; and (2) suggest ways to reduce the attrition associated with these factors. This study focused on system improvements to determine where efforts should be prioritised. The research approach consisted of in-depth interviews with 31 professionals from various disciplines (including police, judges, child welfare officers, doctors and psychologists). The interviewees represented a diverse group of professionals offering unique perspectives. Thematic analysis revealed five broad areas requiring focus for improvement and further reform: greater specialisation, facilitating the accessibility of services, making the trial process more user-friendly, overcoming misinformed beliefs and adequate representation of child sexual abuse. These areas, along with professionals’ practical recommendations, are discussed.

Among- and within-individual correlations between basal and maximal metabolic rates in birds

The aerobic capacity model proposes that endothermy is a by-product of selection favouring high maximal metabolic rates (MMR) and its mechanistic coupling with basal metabolic rate (BMR). Attempts to validate this model in birds are equivocal and restricted to phenotypic correlations (rP), thus failing to distinguish among- and within-individual correlations (rind and re). We examined 300 paired measurements of BMR and MMR from 60 house sparrows before and after two levels of experimental manipulation - testosterone implants and immune challenge. Overall, repeatability was significant in both BMR (R=0.25±0.06) and MMR (R=0.52±0.06). Only the testosterone treatment altered the rP between BMR and MMR, which resulted from contrasting effects on rind and re. While rind was high and significant (0.62±0.22) in sham-implanted birds, re was negative and marginally non-significant (-0.15±0.09) in testosterone-treated birds. Thus, the expected mechanistic link between BMR and MMR was apparent, but only in birds with low testosterone levels.

Individual (co)variation in thermal reaction norms of standard and maximal metabolic rates in wild-caught slimy salamanders

Standard metabolic rate (SMR) and maximal metabolic rate (MMR) are fundamental measures in ecology and evolution because they set the scope within which animals can perform activities that directly affect fitness. In ectotherms, both SMR and MMR are repeatable over time when measured at a single ambient temperature (Ta). Many ectotherms encounter variable Ta from day to day and over their lifetime, yet it is currently unknown whether individual differences hold across an ecologically relevant range of Ta (i.e. thermal repeatability; RT). Moreover, it is possible that thermal sensitivity of SMR and MMR are important individual attributes, and correlated with one another, but virtually nothing is known about this at present. We measured SMR and MMR across an ecologically relevant Ta gradient (i.e. from 10 to 25 °C) in wild-caught salamanders (Plethodon albagula) and found that RT was significant in both traits. SMR and MMR were also positively correlated, resulting in a lower RT in absolute and factorial aerobic scopes (AAS and FAS). We found significant individual differences in thermal sensitivity for both SMR and MMR, but not for AAS and FAS. The intercept (at Ta = 0 °C) and the slope of the thermal reaction norms were negatively correlated; individuals with low MR at low Ta had a higher thermal sensitivity. Finally, individuals with a high thermal sensitivity for SMR also had high thermal sensitivity for MMR. Our results suggest that natural selection occurring over variable Ta may efficiently target the overall level of - and thermal sensitivity in - SMR and MMR. However, this may not be the case for metabolic scopes, as the positive correlation between SMR and MMR, in addition to their combined changes in response to Ta, yielded little individual variation in AAS and FAS. Our results support the idea that organisms with low metabolism at low Ta have a high metabolic thermal sensitivity as a compensatory mechanism to benefit in periods of warmer environmental conditions. Hence, our study reveals the importance of considering within-individual variation in metabolism, as it may represent additional sources of adaptive (co)variation.

How the prevalence rates of male sexual dysfunction vary using different criteria

Objectives: This study examined the prevalence of male sexual dysfunction (MSD) and how different criteria alter prevalence rates. Methods: Five hundred seventy-three Australian men completed an online survey. Results: Of these men, 42.2% were sexually functional and 57.8% reported 1 or more sexual dysfunctions. No matter which criteria were used, the most prevalent MSD was erectile dysfunction, followed by premature ejaculation, hypoactive sexual desire disorder, and delayed ejaculation. Frequencies varied according to different definitions and measures used to diagnose MSD. More than half of the men with MSD experienced only 1 sexual dysfunction. Conclusions: These results demonstrate the high prevalence of MSD and the relatively low level of comorbidity of MSDs. © 2014 Taylor & Francis Group, LLC.

Lecturing and other face-to-face teaching – too much or too little? An assessment based on student feedback and fail rates

Institutes of higher learning are tending to reduce the amount of face-to-face teaching that they offer, and particularly through the traditional pedagogical method of lecturing. There is ongoing debate about the educational value of lectures as a teaching approach, in terms of both whether they facilitate understanding of subject material and whether they augment the student educational experience. In this study, student evaluation of teaching scores plus academic outcome (percentage of students who fail) was assessed for 236 course units offered by a science faculty at an Australian university over the course of one year. These measures were related to the degree to which lectures and other face-to-face teaching were used in these units, controlling for factors such as class size, school and year level. An information-theoretic model selection approach was employed to identify the best models and predictors of student assessments and fail rates. All the top models of student feedback included a measure reflecting amount of face-to-face teaching, with the evaluation of quality of teaching being higher in units with higher proportions of lectures. However, these models explained only 12–20% of the variation in student evaluation scores, suggesting that many other factors come into play. By contrast, units with fewer lectures have lower failure rates. These results suggest that moving away from lectures and face-to-face teaching may not harm, and indeed may improve the number of students who pass the subject, but that this may be incurred at the expense of greater dissatisfaction in students' learning experience.