The systematic influences on student evaluation of teaching in engineering education

BACKGROUND Student evaluation of teaching (SET) has a long history, has grown in prevalence and importance over a period of decades, and is now common-place in many universities internationally. SET data are collected for a range of purposes, including: as diagnostic feedback to improve the quality of teaching and learning; as an input to staff performance management processes and personnel decisions such as promotion for staff; to provide information to prospective students in their selection of courses and programs; and as a source of data for research on teaching. Rovai et al. (2006) report that while SET research provides mixed results, there is evidence that, for course-related factors, smaller classes are rated more favourably than large classes, upper-year-level classes are rated more favourably than lower-year classes, and that there are rating differences between discipline areas. While additional course-related factors are also noted, other reviews of the literature on SET also identify these three factors as commonly reported systematic influences on SET ratings. The School of Engineering at Deakin University in Australia offers undergraduate and postgraduate engineering programs, and these programs are delivered in both on-campus and off-campus modes.PURPOSEThe paper presents a quantitative investigation of SET data for the School of Engineering at Deakin University to identify whether the commonly reported systematic influences on SET ratings of class size and year level are also observed here. The influence of online mode of offer is also explored.DESIGN/METHOD Deakin University’s Student Evaluation of Teaching and Units (SETU) questionnaire is administered to students enrolled in every unit of study every time that unit is offered, unless it is specially exempted. Following data collation, summary results are reported via a public website. The publicly available SETU data for all School of Engineering units of study were collected for a two year period. The collected data were subjected to analysis of variance (ANOVA) analysis to identify any significant systematic influences on mean student SETU ratings.RESULTS SETU data from 100 separate units of study over the two year period were collected, representing 3375 sets of SETU ratings, and covering unit enrolment sizes from 12 to 462 students. Although this was a modest sized investigation, significantly higher mean ratings for some SETU items were observed for units with small enrolments, for postgraduate level units compared to undergraduate level units, and for units offered in conventional mode compared to online mode of offer. The presence of the commonly observed systematic influences on SET ratings was confirmed.CONCLUSIONS While the use of SET data may have originally been primarily for formative purposes to improve teaching and learning, they are also increasingly used for summative judgements of teaching quality and teaching staff performance that have implications for personnel decision making. There may be an acceptance of the need for SET, however there remains no universal consensus as to what constitutes quality in university teaching and learning, and the increasing use of SET for high-stakes decision making puts pressure on institutions to ensure that their SET practices are sound, equitable and defensible.

Library spaces designed with students in mind: an evaluation study of University of Queensland libraries at St Lucia campus

This paper identifies the design qualities of library spaces that matter the most foruniversity students. Drawing upon the data from an online survey made available to students from the University of Queensland, Australia, a number of design-related considerations are examined including: acoustics, furniture, interior architecture, lighting, and thermal comfort. 1505 students completed the survey, which aimed to assess how effective and responsive library spaces are in meeting students’ needs and supporting their learning experiences. The survey included ‘Likert scale questions’ requiring students to rate their levels of satisfaction with different aspects of library spaces and ‘open-ended questions’ asking students to elucidate their ratings. Findings revealed that the qualities of physical spaces were ranked as the third mostsignificant category of reasons accounting for students’ preference for certain library buildings over others, and for their frequency of visit (behind “location” of the library building and then “access to books and course-related materials or resources”). Design-related themes which emerged from qualitative analysis highlighted students’ awareness of the impacts that the design of spaces and furniture can have on their learning experiences. The study concludes with recommendations informed by students’ expectations, needs and preferences in relation to the qualities and features of library spaces.

A multilevel trust management framework for service oriented environment

In service-oriented computing applications, trust management systems are emerging as a promising technology to improve the e-commerce consumers and provider's relationship. Both consumers and providers need to evaluate the trust levels of potential partners before engaging in interactions. The accuracy of trust evaluation greatly affects the success rate of the interaction. This paper addresses the threats and challenges that can compromise the reliability of the current trust management system. This paper studies and examines the importance of the trust factors of the trust management framework, specifically in dealing with malicious feedback ratings from e-commerce users. To improve the reliability of the trust management systems, an approach that addresses feedback-related vulnerabilities is paramount. A multilevel trust management system computes trust by combining different types of information. Using this combination, we introduce a multilevel framework for a new interactive trust management to improve the correctness in estimate of trust information.

The effects of a course of intranasal oxytocin on social behaviors in youth diagnosed with autism spectrum disorders: A randomized controlled trial

Background There is increasing interest in oxytocin as a therapeutic to treat social deficits in autism spectrum disorders (ASD). The aim of this study was to investigate the efficacy of a course of oxytocin nasal spray to improve social behavior in youth with ASD. Methods In a double-blind, placebo-controlled trial across two Australian university sites between February 2009 and January 2012, 50 male participants aged between 12 and 18 years, with Autistic or Asperger's Disorder, were randomized to receive either oxytocin (n = 26) or placebo (n = 24) nasal sprays (either 18 or 24 International Units), administered twice-daily for 8 weeks. Participants were assessed at baseline, after 4- and 8-weeks of treatment, and at 3-month follow-up. Primary outcomes were change in total scores on the caregiver-completed Social Responsiveness Scale and clinician-ratings on the Clinical Global Impressions-Improvement scale. Secondary assessments included caregiver reports of repetitive and other developmental behaviors and social cognition. Clinical trial registration: Australian New Zealand Clinical Trials Registry www.anzctr.org.au ACTRN12609000513213. Results Participants who received oxytocin showed no benefit following treatment on primary or secondary outcomes. However, caregivers who believed their children received oxytocin reported greater improvements compared to caregivers who believed their child received placebo. Nasal sprays were well tolerated and there was no evidence of increased side effects resulting from oxytocin administration. Conclusions This is the first evaluation of the efficacy for a course of oxytocin treatment for youth with ASD. Although results did not suggest clinical efficacy, further research is needed to explore alternative delivery methods, earlier age of intervention, and the influence of caregiver expectation on treatment response.

Family day care educators’ knowledge, confidence and skills in promoting children’s social and emotional wellbeing: baseline data from Thrive

THIS PAPER PRESENTS BASELINE data from Thrive, a capacity-building program for family day care educators. Educators completed a self-report survey assessing knowledge and confidence in promoting children’s social and emotional wellbeing. An in-home observation was used to assess care quality. Twenty-four educators responded to the survey (40 per cent response rate). They had an average of nine years’ experience and 82 percent held childcare qualifications. Educators reported knowledge of, on average, three early signs of social and emotional problems in children, three risk factors and two protective factors. Using a scale from 0-10, mean educator confidence levels ranged from an average of 6.69 to 7.25. Quality of care ratings were moderate. Although educators had a good understanding of children’s social and emotional wellbeing, the study identified opportunities for significant changes in the quality of the educators’ interactions with children in their care and their professional development.

Acute mood but not cognitive improvements following administration of a single multivitamin and mineral supplement in healthy women aged 50 and above : a randomised controlled trial

A number of randomised controlled trials have indicated that multivitamin/mineral supplementation for a period of 4 weeks or greater can enhance mood and cognition. To date, no studies have investigated whether a single multivitamin dose can benefit mental function in older adults. This study investigated the acute effects of a single multivitamin and mineral and herbal (MVMH) supplement versus placebo on self ratings of mood and the performance of an effortful computerised cognitive battery in a sample of 76 healthy women aged 50-75 years. Mood was assessed using the depression anxiety stress scale (DASS), state trait anxiety inventory-state anxiety scale and visual analogue scales (VAS). Mood was rated at 1 h post supplementation and again after the competition of the cognitive assessments at 2 h post supplementation. It was demonstrated that the MVMH supplement improved overall DASS mood ratings; however, the most prominent effects appeared to be a reduction in ratings of perceived mental stress. These findings were confirmed using visual analogue scales, with these measures also demonstrating MVMH-related increased ratings of calmness. There were no benefits of the MVMH to mood ratings of depression and performance was not enhanced on the cognitive battery. Supplementation with a single multivitamin, mineral and herbal supplement reduces stress several hours after intake in healthy older people.

An effective privacy preserving algorithm for neighborhood-based collaborative filtering

As a popular technique in recommender systems, Collaborative Filtering (CF) has been the focus of significant attention in recent years, however, its privacy-related issues, especially for the neighborhood-based CF methods, cannot be overlooked. The aim of this study is to address these privacy issues in the context of neighborhood-based CF methods by proposing a Private Neighbor Collaborative Filtering (PNCF) algorithm. This algorithm includes two privacy preserving operations: Private Neighbor Selection and Perturbation. Using the item-based method as an example, Private Neighbor Selection is constructed on the basis of the notion of differential privacy, meaning that neighbors are privately selected for the target item according to its similarities with others. Recommendation-Aware Sensitivity and a re-designed differential privacy mechanism are introduced in this operation to enhance the performance of recommendations. A Perturbation operation then hides the true ratings of selected neighbors by adding Laplace noise. The PNCF algorithm reduces the magnitude of the noise introduced from the traditional differential privacy mechanism. Moreover, a theoretical analysis is provided to show that the proposed algorithm can resist a KNN attack while retaining the accuracy of recommendations. The results from experiments on two real datasets show that the proposed PNCF algorithm can obtain a rigid privacy guarantee without high accuracy loss. © 2013 Published by Elsevier B.V. All rights reserved.

Time series analysis of the impact of tobacco control policies on smoking prevalence among Australian adults, 2001–2011

Objective: To determine the impact of tobacco control policies and mass media campaigns on smoking prevalence in Australian adults.
Methods: Data for calculating the average monthly prevalence of smoking between January 2001 and June 2011 were obtained via structured interviews of randomly sampled adults aged 18 years or older from Australia’s five largest capital cities (monthly mean number of adults interviewed: 2375). The influence on smoking prevalence was estimated for increased tobacco taxes; strengthened smoke-free laws; increased monthly population exposure to televised tobacco control mass media campaigns and pharmaceutical company advertising for nicotine replacement therapy (NRT), using gross ratings points; monthly sales of NRT, bupropion and varenicline; and introduction of graphic health warnings on cigarette packs. Autoregressive integrated moving average (ARIMA) models were used to examine the influence of these interventions on smoking prevalence.
Findings: The mean smoking prevalence for the study period was 19.9% (standard deviation: 2.0%), with a drop from 23.6% (in January 2001) to 17.3% (in June 2011). The best-fitting model showed that stronger smoke-free laws, tobacco price increases and greater exposure to mass media campaigns independently explained 76% of the decrease in smoking prevalence from February 2002 to June 2011.
Conclusion: Increased tobacco taxation, more comprehensive smoke-free laws and increased investment in mass media campaigns played a substantial role in reducing smoking prevalence among Australian adults between 2001 and 2011.

Cross-cultural examination of the structure of the Revised American Pain Society Patient Outcome Questionnaire (APS-POQ-R)

This study investigated the cross-cultural factor stability and internal consistency of the Revised American Pain Society Patient Outcome Questionnaire (APS-POQ-R); a measure of the quality of postoperative pain management employed internationally. We conducted exploratory factor analysis (EFA) of APS-POQ-R data from two point-prevalence studies comprising 268 and 311 surveys of Danish and Australian medical-surgical patients. Parallel analysis indicated four and three factor solutions for Danish and Australian patients respectively, which accounted for 58.1% and 52.9% of variance. Internal consistency was unsatisfactory among both Danish (Cronbach α=.54) and Australian (Cronbach α=.63) cohorts. There was a high degree of between-group similarity in item-factor loadings of variables coded as "pain experience", but not "pain management". This reflected cross-cultural differences in ratings of treatment satisfaction. For Danish patients, satisfaction was associated with the degree of pain severity and activity interference whereas for Australian patients, satisfaction was associated with their perceived ability to participate in treatment. To facilitate further cross-cultural comparison, we compared our findings to past research conducted in the U.S. and Iceland. EFA supported the construct validity of the APS-POQ-R as a measure of "pain experience", but indicated that items measuring "pain management" may vary cross-culturally. Findings highlighted the need for further validation of the APS-POQ-R internationally. PERSPECTIVE: This study revealed the APS-POQ-R as a valid measure of postoperative pain experience for Danish and Australian patients. Measures of patients' perception of pain management were not robust to group differences in treatment expectations and demonstrated cross-cultural instability. Results highlighted difficulties in establishing stable cross-cultural, cross-population subscales for the APS-POQ-R.

First aid recommendations for psychosis: using the Delphi method to gain consensus between mental health consumers, carers, and clinicians.

BACKGROUND: Members of the general public often lack the knowledge and skills to intervene effectively to help someone who may be developing a psychotic illness before appropriate professional help is received. METHODS: We used the Delphi method to determine recommendations on first aid for psychosis. An international panel of 157 mental health consumers, carers, and clinicians completed a 146-item questionnaire about how a member of the public could help someone who may be experiencing psychosis. The panel members rated each questionnaire item according to whether they believed the statement should be included in the first aid recommendations. The results were analyzed by comparing consensus rates across the 3 groups. Three rounds of ratings were required to consolidate consensus levels. RESULTS: Eighty-nine items were endorsed by >or=80% of panel members from all 3 groups as essential or important for psychosis first aid. These items were grouped under the following 9 headings: how to know if someone is experiencing psychosis; how to approach someone who may be experiencing psychosis; how to be supportive; how to deal with delusions and hallucinations; how to deal with communication difficulties; whether to encourage the person to seek professional help; what to do if the person does not want help; what to do in a crisis situation when the person has become acutely unwell; what to do if the person becomes aggressive. CONCLUSIONS: These recommendations will improve the provision of first aid to individuals who are developing a psychotic disorder by informing the content of training courses.

Effects of persisting emotional impact from child abuse and norepinephrine transporter genetic variation on antidepressant efficacy in major depression: a pilot study

OBJECTIVE: Previous studies suggest child abuse and serotonergic polymorphism influence depression susceptibility and antidepressant efficacy. Polymorphisms of the norepinephrine transporter (NET) may also be involved. Research in the area is possibly clouded by under reporting of abuse in researcher trials. METHODS: Adults (n=51) with major depressive disorder has 8 weeks treatment with escitalopram or venlafaxine. Abuse history was obtained, the ongoing emotional impact of which was measured with the 15-item impact of event scale (IES-15). The 17-item Hamilton Depression Rating Scale (HDRS) was applied serially. Two NET polymorphisms (rs2242446 and rs5569) were assayed, blinded to HDRS ratings and abuse history. RESULTS: No subjects reporting abuse with high impact in adulthood (IES-15 ≥26, n=12) remitted; whereas 77% reporting low impact (IES-15 <26; n=26) remitted (p<0.001). Subjects reporting high impact abuse (n=12) had a 50-fold (95% confidence interval=4.85-514.6) greater odds of carrying rs2242446-TT genotype, but the small sample size leaves this finding vulnerable to type I error. CONCLUSIONS: The level of persisting impact of child abuse appears relevant to antidepressant efficacy, with susceptibility to such possibly being influence by NET rs2242446 polymorphism. Larger studies may be merited to expand on this pilot level finding given potential for biomarker utility.

The relationships between common measurements of taste function

BACKGROUND: There are five common, independent measures used to characterize taste function in humans: detection and recognition thresholds (DT and RT), suprathreshold intensity ratings of prototypical tastants, propylthiouracil (PROP) bitterness intensity, and fungiform papillae (FP) number. METHODS: We employed all five methods to assess taste function of 65 women (21.5 ± 4 years, BMI 22.3 ± 2.8 kg/m(2)). Pearson correlation coefficients were calculated between the different measures. RESULTS: The DT and RT were positively correlated for sweet, bitter, sour, and umami (p < 0.05), but not for salt. The DT or RT did not correlate with suprathreshold intensity ratings, except for umami (suprathreshold intensity and RT: r = -0.32, p = 0.009). FP number did not correlate with any measurement of taste function. PROP bitterness intensity ratings did not correlate with any measurement of taste function, except for suprathreshold ratings for saltiness (r = 0.26, p = 0.033). CONCLUSION: As most of the individual measures of taste function did not correlate with each other, with exception of the two threshold measures, we conclude that there are multiple perceptual phases of taste, with no single measure able to represent the sense of taste globally.

Does tobacco-control mass media campaign exposure prevent relapse among recent quitters?

OBJECTIVE: To determine whether greater mass media campaign exposure may assist recent quitters to avoid relapse. METHOD: Using date of data collection and postcode, media market estimates of televised tobacco-control advertising exposure measured by gross ratings points (GRPs) were merged with a replenished cohort study of 443 Australians who had quit in the past year. Participants' demographic and smoking characteristics prior to quitting, and advertising exposure in the period after quitting, were used to predict relapse 1 year later. RESULTS: In multivariate analysis, each increase in exposure of 100 GRPs (i.e., 1 anti-smoking advertisement) in the three-month period after the baseline quit was associated with a 5% increase in the odds of not smoking at follow-up (OR = 1.05, 95% CI 1.02-1.07, p < 0.001). This relationship was linear and unmodified by length of time quit prior to the baseline interview. At the mean value of 1081 GRPs in the 3 months after the baseline-quit interview, the predicted probability of being quit at follow-up was 52%, whereas it was 41% for the minimum (0) and 74% for the maximum (3,541) GRPs. CONCLUSION: Greater exposure to tobacco-control mass media campaigns may reduce the likelihood of relapse among recent quitters.

Mental health consumers' perceptions of quality of life and mental health care

Research spanning the past decade consistently reports that people with severe mental illnesses experience lower quality of life than the general population, however, little is known about what "quality of life" means to consumers, or how quality of life can be promoted in mental health care. This study measured the Quality of Life of mental health consumers receiving care from a Mental Health Nurse Incentive Program, and examined consumer perceptions of quality of life. The study used an exploratory design incorporating the WHOQOL-brèf survey and four additional qualitative questions for data collection. Data were analysed using descriptive and correlational statistics. Participants (n = 49) reported lower quality of life scores on all four domains of the WHOQOL-brèf and lower overall ratings for "quality of life" than the general population. Having basic needs met, good relationships with family and friends, regular support, and improved social connectedness were identified by consumers as important to their quality of life.

An era of governance through performance management - New Labour's National Health Service from 1999 to 2010

In 1997, the New Labour government inherited a ‘crisis’ in the UK National Health Service from the outgoing Conservative government. To address this perceived crisis, New Labour offered investment and, contrary to expectations, further neo-liberal health service reforms. In particular, the government extended the scope of performance management beyond financial numbers to encompass all aspects of managerial and organisational performance. Drawing on an analytics of government framework, this paper demonstrates how reforms were framed and given meaning through a framework of hierarchical accountability and centralised control. These panoptical arrangements relied on performance-management technologies of targets and ratings, which were linked to patient choice and a prospective funding system called ‘Payment by Results’. In turn, these top-down technologies disciplined knowledge, identity, and visibility and control of practice.