Student evaluation of teaching data 2009-2010

This dataset consists of a summary of publicly available student evaluation of teaching (SET) data for the annual period of trimester 2 2009, trimester 3 2009/2010 and trimester 1 2010, from the Student Evaluation of Teaching and Units (SETU) portal.

The data was analysed to include mean rating sets for 1432 units of study, and represented 74498 sets of SETU ratings, 188391 individual student enrolements and 58.5 percent of all units listed in the Deakin University handbook for the period under consideration, to identify any systematic influences on SET results at Deakin University.

The data reported for a unit included:
• total enrolment;
• total number of responses; and
• computed response rate for the enrolment location(s) selected

And, the data reported for each of the ten core SETU items included:
• number of responses;
• mean rating;
• standard deviation of the mean rating;
• percentage agreement;
• percentage disagreement; and
• percentage difference.

The CDM-Net project : the development, implementation and evaluation of a broadband-based network for managing chronic disease

Background. In Australia most chronic disease management is funded by Medicare Australia through General Practitioner Management Plans (GPMPs) and Team Care Arrangements (TCAs). Identified barriers may be reduced effectively using a broadband-based network known as the Chronic Disease Management Service (CDMS).

Aims. To measure the uptake and adherence to CDMS, test CDMS, and assess the adherence of health providers and patients to GPMPs and TCAs generated through CDMS.

Methods. A single cohort before and after study.

Results. GPMPs and TCAs increased. There was no change to prescribed medicines or psychological quality of life. Attendance at allied health professionals increased, but decreased at pharmacies. Overall satisfaction with CDMS was high among GPs, allied health professionals, and patients.

Conclusion. This study demonstrates proof of concept, but replication or continuation of the study is desirable to enable the impact of CDMS on diabetes outcomes to be determined.

Increasing the sensitivity of the AQoL inventory for the evaluation of interventions affecting mental health

This paper presents the rationale and psychometric analysis for extending the inventory of the Assessment of Quality of Life (AQoL)-6D instrument. The resulting AQoL-8D has an 8 dimensional, 35 item inventory with greater sensitivity in the domain of mental health.The paper briefly reviews the existing QoL instruments used for economic evaluation of health programs. It outlines the steps adopted in developing the AQoL descriptive inventories and, specifically, the methods adopted for data collection and analysis for the AQoL-8D inventory.Three instruments are presented. The first, PsyQoL, is a 22 item instrument which represents the best statistical fit for the measurement of mental health related quality of life. The second, PsyQoL-Brief is a reduced form instrument which is combined with AQoL-6D as the basis for the third instrument, the AQoL-8D. Psychometric properties of the first instrument are excellent and the second are good. The full AQoL-8D has satisfactory properties. Results from a comparison with the original AQoL-6D are reported. The mental health content of AQoL-8D is unique amongst MAU instruments and, along with other AQoL instruments, unique in its derivation from psychometric analysis. Its application to mental health patients and the public demonstrates its ability to discriminate between the groups with greater sensitivity than the previous AQoL-6D instrument.

Utility of short-term evaluation of presbyopic contact lens performance

Objectives: To establish if evaluations of multifocal contact lens performance conducted at dispensing are representative of behavior after a moderate adaptation period.

Methods: Eighty-eight presbyopic subjects, across four clinical sites, wore each of four multifocal soft contact lenses (ACUVUE BIFOCAL, Focus Progressives, Proclear Multifocal, and SofLens Multifocal) for 4 days of daily wear. Comprehensive performance assessments were conducted at dispensing and after 4 days wear and included the following objective metrics: LogMAR acuity (contrast, 90% and 10%; illumination, 250 and 10 cd/m2; distance, 6 m, 100 cm, and 40 cm), stereopsis (RANDOT), reading critical print size and maximum speed and range of clear vision at near. Subjective assessments were made, with 100-point numerical rating scales, of comfort, ghosting (distance, near), visual quality (distance, intermediate, and near), and the appearance of haloes. At two sites, subjects (n = 39) also rated visual fluctuation (distance, intermediate, and near), facial recognition, and overall satisfaction.

Results: Among the objective variables, significant differences (paired t test, P<0.05) between dispensing and 4 days were found only for range of clear vision at near (2.9 ± 2.0 cm; mean difference ± standard deviation) and high contrast near acuity in low illumination (-0.013 ± 0.011 LogMAR). With the exception of insertion comfort, all subjective variables showed significant decrements over the same period. Overall satisfaction declined by an average of 10.9 ± 5.1 points.

Conclusions: Early assessment is relatively unrepresentative of performance later on during multifocal contact lens wear. Acuity based measures of vision remain substantially unchanged over the medium term, apparently because these metrics are insensitive indicators of performance compared with subjective alternatives.

Transforming an academic library's spaces : an evaluation study of Deakin University Library at Burwood campus using TEALS discovery

Libraries worldwide are transforming their spaces to better align with the changing needs of their communities. The aim of this paper is to outline the process and outcome of an evaluation study of transformed academic library spaces at the Melbourne Burwood Campus using TEALS. In light of changing higher education practices and students learning preferences, Deakin University has been questioning the balance of informal learning spaces and more formal teaching and academic spaces across its campuses. Commissioned by Deakin University Library, TEALS (Tool for the Evaluation of Academic Library Spaces) was developed to evaluate academic library spaces. The Melbourne Burwood Campus library has undergone several phases of refurbishment to create a library environment that is centred around students’ needs and that supports their individual and group learning experiences. In addition, areas of the library yet to be improved will undergo a major redevelopment over the next year. Given this, carrying out an evaluation of the current spaces is timely to ensure that a better understanding of the impact of changes is achieved. The evaluation process involved: a review of architectural plans and space briefing documents; an observational study of spaces; focus groups with students and library staff; and an online survey of Students’ Library Experience. Use of the TEALS space evaluation tool along with an analysis of data collected during the evaluation process have provided significant insights into various dimensions of the quality of new library spaces. The areas of weakness and strength identified in the study will inform the next phase of Deakin University Library space redevelopment.

Student evaluation of teaching : keeping in touch with reality

Student evaluation of teaching is commonplace in many universities and may be the predominant input into the performance evaluation of staff and organisational units. This article used publicly available student evaluation of teaching data to present examples of where institutional responses to evaluation processes appeared to be educationally ineffective and where the pursuit of the ‘right’ student evaluation results appears to have been mistakenly equated with the aim of improved teaching and learning. If the vast resources devoted to student evaluation of teaching are to be effective, then the data produced by student evaluation systems must lead to real and sustainable improvements in teaching quality and student learning, rather than becoming an end in itself.

Development of a tool for evaluation of academic library spaces (TEALS) (0242)

The paper provides a brief description of the tool for evaluating the quality and utilisation of academic library spaces (TEALS). Supported by Deakin University Library, TEALS has been developed out of a research project in the School of Architecture and Building, Deakin University, Geelong Waterfront Campus. The tool is intended to establish the setting for evaluation of physical spaces at different phases of development of new academic library spaces and refurbishment of existing ones as well as throughout the life of buildings. The methodological framework of the tool consists of four key elements; establishing Criteria of Quality (CoQ), determining Quality Indicators, evaluating library spaces against QIs and interpreting results for future improvements. The characteristics that distinguish TEALS from existing evaluation models include adopting an approach that focus on people (students, faculty and library staff), acting as a “reflective” and “empowering” tool and being user-friendly, quick and easy to use.

Objective surface evaluation of fiber reinforced polymer composites

The mechanical properties of advanced composites are essential for their structural performance, but the surface finish on exterior composite panels is of critical importance for customer satisfaction. This paper describes the application of wavelet texture analysis (WTA) to the task of automatically classifying the surface finish properties of two fiber reinforced polymer (FRP) composite construction types (clear resin and gel-coat) into three quality grades. Samples were imaged and wavelet multi-scale decomposition was used to create a visual texture representation of the sample, capturing image features at different scales and orientations. Principal components analysis was used to reduce the dimensionality of the texture feature vector, permitting successful classification of the samples using only the first principal component. This work extends and further validates the feasibility of this approach as the basis for automated non-contact classification of composite surface finish using image analysis.

The performance of a student evaluation of teaching system

Student evaluation of teaching (SET) is now commonplace in many universities internationally. While much effort has been devoted to examining the statistical validity of SET instruments, there has been limited examination of the methodological and consequential validity (together referred to as ‘utility’) of the ways in which SET data are used. This paper examines the SET system at Deakin University from the perspective of utility. It draws on publicly available SET results for an entire annual cycle of unit offerings. Consideration is given to the representativeness of the data produced, and to the utility of the data reported, by the system. While this investigation focuses on the SET system currently employed at Deakin University, it offers both an analysis methodology and conclusions that can be applied more generally.

Diamond Dialogue method for the evaluation of personal well-being after a maternal health intervention in Lao PDR

This paper follows the genesis of an evolving tool to measure the impact of development interventions on personal well-being in non-literate and non-numerate communities. The Diamond Dialogue was adapted to evaluate the impact on women of the establishment of 17 one stop maternity waiting home/health promotion/income generating centres (Silk Homes) in Southern Lao PDR. The tool elicited data not accessible by research methods which assume literacy and numeracy and revealed that 86% of women who used the Silk Homes experienced substantial improvements in quality of life. The Diamond Dialogue can be modified to assess the outcomes of development interventions in a myriad of contexts.

Evaluation of the giant reed (Arundo donax) in horizontal subsurface flow wetlands for the treatment of dairy processing factory wastewater

Two emergent macrophytes, Arundo donax and Phragmites australis, were established in experimental horizontal subsurface flow (HSSF), gravel-based constructed wetlands (CWs) and challenged by treated dairy processing factory wastewater with a median electrical conductivity of 8.9 mS cm−1. The hydraulic loading rate was tested at 3.75 cm day−1. In general, the plants grew well during the 7-month study period, with no obvious signs of salt stress. The major water quality parameters monitored (biological oxygen demand (BOD), suspended solids (SS) and total nitrogen (TN) but not total phosphorus) were generally improved after the effluent had passed through the CWs. There was no significance different in removal efficiencies between the planted beds and unplanted gravel beds (p > 0.007), nor was there any significant difference in removal efficiencies between the A. donax and P. australis beds for most parameters. BOD, SS and TN removal in the A. donax and P. australis CWs was 69, 95 and 26 % and 62, 97 and 26 %, respectively. Bacterial removal was observed but only to levels that would allow reuse of the effluent for use on non-food crops under Victorian state regulations. As expected, the A. donax CWs produced considerably more biomass (37 ± 7.2 kg wet weight) than the P. australis CWs (11 ± 1.4 kg wet weight). This standing crop equates to approximately 179 and 68 tonnes ha−1 year−1 biomass (dry weight) for A. donax and P. australis, respectively (assuming a 250-day growing season and single-cut harvest). The performance similarity of the A. donax and P. australis planted CWs indicates that either may be used in HSSF wetlands treating dairy factory wastewater, although the planting of A. donax provides additional opportunities for secondary income streams through utilisation of the biomass produced.

Performance evaluation of multi-frame super-resolution algorithms

Multi-frame super-resolution algorithms aim to increase spatial resolution by fusing information from several low-resolution perspectives of a scene. While a wide array of super-resolution algorithms now exist, the comparative capability of these techniques in practical scenarios has not been adequately explored. In addition, a standard quantitative method for assessing the relative merit of super-resolution algorithms is required. This paper presents a comprehensive practical comparison of existing super-resolution techniques using a shared platform and 4 common greyscale reference images. In total, 13 different super-resolution algorithms are evaluated, and as accurate alignment is critical to the super-resolution process, 6 registration algorithms are also included in the analysis. Pixel-based visual information fidelity (VIFP) is selected from the 12 image quality metrics reviewed as the measure most suited to the appraisal of super-resolved images. Experimental results show that Bayesian super-resolution methods utilizing the simultaneous autoregressive (SAR) prior produce the highest quality images when combined with generalized stochastic Lucas-Kanade optical flow registration.

Construction of the descriptive system for the assessment of quality of life AQoL-6D utility instrument

Background
Multi attribute utility (MAU) instruments are used to include the health related quality of life (HRQoL) in economic evaluations of health programs. Comparative studies suggest different MAU instruments measure related but different constructs. The objective of this paper is to describe the methods employed to achieve content validity in the descriptive system of the Assessment of Quality of Life (AQoL)-6D, MAU instrument.

Methods
The AQoL program introduced the use of psychometric methods in the construction of health related MAU instruments. To develop the AQoL-6D we selected 112 items from previous research, focus groups and expert judgment and administered them to 316 members of the public and 302 hospital patients. The search for content validity across a broad spectrum of health states required both formative and reflective modelling. We employed Exploratory Factor Analysis and Structural Equation Modelling (SEM) to meet these dual requirements.

Results and Discussion
The resulting instrument employs 20 items in a multi-tier descriptive system. Latent dimension variables achieve sensitive descriptions of 6 dimensions which, in turn, combine to form a single latent QoL variable. Diagnostic statistics from the SEM analysis are exceptionally good and confirm the hypothesised structure of the model.

Conclusions
The AQoL-6D descriptive system has good psychometric properties. They imply that the instrument has achieved construct validity and provides a sensitive description of HRQoL. This means that it may be used with confidence for measuring health related quality of life and that it is a suitable basis for modelling utilities for inclusion in the economic evaluation of health programs.

Evaluation of salmon farming effects on marine systems in the inner seas of southern Chile : a large-scale mensurative experiment

The impact of salmon farming on the environment has been widely studied; there is, however, no consensus on the magnitude and quality of these effects and little information on their extent over large salmon farming areas. Forty-three salmon farm sites of which 29 are in full operation and grouped in nine locations in southern Chile were evaluated. Using statistical methods (two-way anova), no effects were found on water column variables such as nitrate, ammonia, orthophosphate and chlorophyll, whereas they were significant on sediment variables such as nitrogen (N), phosphorus (P) and organic carbon (OC), among others. Natural variability evaluation of some parameters revealed that P in sediments had the lowest coefficient of variation (23.2%) when compared with N (65.2%), particulate organic matter (POM) (139%) and OC (39%), and showed more marked salmon farming effects with no locality effects. Four of the nine locations showed stronger effects on sediments, with average P values ranging from 150 to 230 mmol that were six to nine times higher than in control sites (25 mmol). Nitrogen and carbon in sediments, while showing significant effects on salmon farming, also showed locality effects that revealed other biogenic processes influencing sediment composition. Thus, P in sediments was proposed as a promising indicator of impact on salmon farming, although the relationship with fauna in sediments was not linear and somewhat variable; more research is therefore needed to understand such connections. Considering entire geographical locations, no relationship was found between sediment conditions under salmon cages and the condition of the water column at a farm. This may indicate the possibility of high dilution rates and recycling processes, which so far preclude the detection of more global impacts beyond the cages shadow.

Assessing the impact of diabetes on the quality of life of older adults living in a care home : validation of the ADDQoL senior

Aims  Around a quarter of UK care-home residents have diabetes. Diabetes is known to impact quality of life but existing diabetes-specific quality of life measures are unsuitable for elderly care-home residents. We aimed to develop and evaluate a new measure for use with older adults, to be particularly suitable for use with care-home residents: the Audit of Diabetes-Dependent Quality of Life (ADDQoL) Senior†.

Methods  Content and format changes were made to the 19-domain ADDQoL, informed by related measures for people with visual impairments (12 domain-specific items were retained, four items were revised/added and three items were removed). This revision was modified further following cognitive debriefing interviews with three older adults living in a care home. Psychometric evaluation of the newly developed 17-domain ADDQoL Senior was conducted using data from 90 care-home residents with diabetes who took part in a broader intervention study.

Results  The life domains most impacted by diabetes were ‘independence’ and ‘freedom to eat as I wish’. The ADDQoL Senior demonstrated good factor structure and internal consistency (Cronbach’s alpha = 0.924). Domain scores were, as expected, significantly intercorrelated.

Conclusions  The ADDQoL Senior measures the perceived impact of diabetes on quality of life in older adults, and has been found to be suitable for those living in care homes if administered by interview. The scale has demonstrated acceptability and excellent psychometric properties. It is anticipated that the number of items may be reduced in the future if our current findings can be replicated.