Online self and peer assessment in large, multi-campus, multi-cohort contexts

The increasing use of team assignments within higher education is well documented. The driving forces behind this include desires to facilitate reflective and collaborative learning, to develop generic teamwork skills for graduate employment and to reduce the grading workloads of faculty staff. Students however consistently report dissatisfaction when the assessment of team assignments produces a common grade for all team members. Self-andpeer-assessment (SAPA) is presented as a fair, valid and reliable method of producing information about ongoing team processes. This information can provide ongoing feedback to team members and rich formative data to instructors attempting to assess the team process and students’ teamwork skills. This data can also enable individualised summative assessment in dysfunctional teams or situations of uneven team member contributions. Whilst manual SAPA protocols can work effectively for smaller classes, computer-assisted SAPA offers a solution to the problems of large classes. This paper reports on the early stages of an online SAPA tool, originally developed for small classes of architecture students, adapted for use by very large business communication classes comprising up to 1000 students in a semester. This large unit is delivered on four Australian campuses as well as off-campus and in off-shore mode, by up to fourteen instructors at any one time. The paper documents how three researchers from very different backgrounds worked to create their own research team, implement a pilot study, and adapt the online tool, whilst adhering to comparability of assessment constraints and maintaining integrity of research design.

Rubrics in assessment

A 'rubric' is a way of assessing what an individual student has learned about a particular topic. A rubric uses a checklist made of the sub-tasks or components within the task, with graded descriptions of how well a student can DO or has LEARNED the task.

A conceptual framework for assessing interaction quality in online discussion forums

The use of discussion forums in education has long been a hot topic in tertiary education. Discussion forums’ activities help learners to share and gain knowledge from each other. However, setting up discussion forums does not ensure that learners interact with each other actively and grading of discussion forum participation is done to ensure qualitative learner participation. Currently, a major focus has been put onto the better use of discussion forums, but the way in which quality of participation can be evaluated has yet to be adequately investigated. This paper presents a conceptual model, based on an extensive review of current literature in related areas, as a way forward in looking at the assessment of quality in online discussion forums. The main benefits of the proposed framework are towards facilitators, as a way to assess learners’ online contributions, while students may use it to understand what is expected of them as participants in online discussion forums

Education and training as a social science : some empirical evidence in the Rosebank Business Precinct of Auckland New Zealand

Tertiary institutions should seek continuous feedback from industries to keep track of the needs of businesses to provide education and training. Academics should stay in touch with businesses by networking and consulting. Holland and De Cieri (2006) refer to theories of child learning (pedagogy) to inform their understanding of andragogy, the study of adult learning. Adult learners would be continuous learners and would move in and out of formal education according to individual needs or life circumstances, job requirements or career development. In designing programmes and up-grading curricula, these are important factors to bear in mind so that programmes “cater” for these learners as well.

This study was financed by Auckland City Council focussing on Auckland’s Rosebank Business Precinct (ARBP). The surrounding communities, particularly Mäori, Pacific peoples and recent migrants, experience disparities in employment. Our research questions were:
• Is there a skills match between the present-day workforce and actual business needs over the medium term?
• What can these data tell us about Rosebank’s trajectory as a skilled business cluster and about its future workforce requirements?
• What education and training will be necessary for these organisations to maintain their competitive advantage and profit margins?

The target population were the 500-600 businesses operating on Rosebank Road. A total of 529 businesses were identified. Interviews with 102 companies with a 36-question questionnaire were conducted. The sampling frame was owner-managers (senior, non-shareholding managers). Of the respondent firms, 68.75% had vacancies for up to 3 months and 31.24% vacancies for 6 months.

This paper highlights areas identified in the ARBP for developing programmes and curricula for tertiary institutions to provide employable students with the right knowledge, skills and attributes (KSAs) to grow existing ventures. A fine balance must be struck between human and organisational needs. In the analysis and discussion we point out what education or training is necessary for the ARBP to provide greater efficiencies and subsequent improvement to their profit levels by current and future employees entering the workforce; well “equipped” employees with knowledge and skills to add value in their organisations. Recommendations, future perspectives and conclusions form the last part of this paper

Study of Australian alpaca fibres

This work represents the first systematic study on the properties and processing performance of Australian alpaca fibres. The resistance to compression behaviour of alpaca fibres was found to differ considerably from that of wool. A new technique has been developed to objectively measure the softness of fibres. The bleaching and dyeing behaviour of alpaca fibres has also been examined.

A systematic review of the quality of liver biopsy specimens

Characteristics for an optimal liver biopsy specimen were recently defined as 20 to 25 mm long and/or containing more than 11 complete portal tracts (CPTs). A systematic review of percutaneous liver biopsy (PLB) and transjugular liver biopsy (TJLB) series yielded only 32 PLB studies in which these characteristics were evaluated: mean ± SD length, 17.7 ± 5.8 mm and number of CPTs, 7.5 ± 3.4; and 15 TJLB studies: mean ± SD length, 13.5 ± 4.5 mm and number of CPTs, 6.8 ± 2.3. Studies of sampling heterogeneity and intraobserver and interobserver variability also used inadequate specimens by present standards. Only 11 (5.3%) of 207 therapeutic studies for chronic hepatitis B and C documented length and/or number of CPTs. Of the current 12 studies evaluating noninvasive fibrosis tests, only 8 documented length or number of CPTs, and only 1 documented length and number of CPTs. New studies are needed based on adequate liver biopsy samples to provide reliable estimation of grading and staging in chronic liver disease.

Assessing group work

When effective group management processes are employed, clear assessment guidelines developed and communicated and valid and fair grading processes employed, the likelihood of positive learning outcomes and student satisfaction with group activities is significantly increased. Alternatively, if students cannot see the objective of group work, are unsure of what is expected of them, or believe the assessment methods are invalid or simply unfair, the educational benefits are reduced and tensions can emerge. The conditions under which group work is conducted are crucial to its success:

Group work, under proper conditions, encourages peer learning and peer support and many studies validate the efficacy of peer learning. Under less than ideal conditions, group work can become the vehicle for acrimony, conflict and freeloading. It may also impose a host of unexpected stresses on, for example, students with overcrowded schedules living long distances from the University.
(University of Wollongong assessment policy, 2002).

The educational benefits of students working cooperatively in groups are well recognised. Among other things,
• studying collaboratively has been shown to directly enhance learning;
• employers value the teamwork and other generic skills that group work may help develop; and
• group activities may help academic staff to effectively utilise their own time.

The design of assessment is central to capturing the benefits of group work and avoiding its pitfalls. Assessment defines the character and quality of group work. In fact, the way in which students approach group work is largely determined by the way in which they are to be assessed.

To maximise student learning in group activities, this section offers advice on how academic staff can:
• establish explicit guidelines for group work to ensure that learning objectives are met and to ensure that they are transparent and equitable; and
• manage the planning, development and implementation of processes and procedures for learning through group work and group assessment.

Advice on assessing large classes

After a decade of rapid expansion in Australian higher education, student numbers have grown considerably in many courses and subjects, especially at the undergraduate level.
Larger class sizes pose significant teaching challenges, not least in the assessment of student learning. Perhaps most troubling, large classes may limit the amount of feedback provided to students.
In response to the pressures and challenges of assessing larger groups of students, academic staff are responding through:
• greater attention to the communication of clear assessment criteria to students;
• the development and use of marking guides to be used by teaching and assessing teams;
• the increasing use of various forms of exemplars to guide student efforts — as well as to guide marking and grading — including the modelling of discipline-based thinking, writing and performance; and
• the continuous refinement and dissemination of assessment policy and practice in relation to large student groups.
The issue of workload is central in any decisions about assessment of large classes for it is a serious one for students and staff alike. Staff teaching large student groups invariably undertake an informal, qualitative weighing-up of the efficiency of assessment tasks vis-à-vis their educational effectiveness.
There is little doubt that establishing an effective assessment program — developing criteria, guides, exemplars and models; discussing and refining them and communicating them to students and other staff — will have an initial negative impact on workload for staff with coordinating responsibilities.
However, this preparatory work is likely to lead to three gains. The first is a reduction in the time required for marking due to a higher quality of student submission. The second is a resolution of some of the potential issues likely when many staff are involved in marking and grading, through a streamlining of marking and grading practices. Finally, the availability of clear, transparent criteria and examples of work will contribute positively to the overall quality of teaching and learning.

Application of neural networks in modelling serviceability deterioration of concrete stormwater pipes

Stormwater pipe systems in Australia are designed to convey water from rainfall and surface runoff only and do not transport sewage. Any blockage can cause flooding events with the probability of subsequent property damage. Proactive maintenance plans that can enhance their serviceability need to be developed based on a sound deterioration model. This paper uses a neural network (NN) approach to model deterioration in serviceability of concrete stormwater pipes, which make up the bulk of the stormwater network in Australia. System condition data was collected using CCTV images. The outcomes of model are the identification of the significant factors influencing the serviceability deterioration and the forecasting of the change of serviceability condition over time for individual pipes based on the pipe attributes. The proposed method is validated and compared with multiple discriminant analysis, a traditionally statistical method. The results show that the NN model can be applied to forecasting serviceability deterioration. However, further improvements in data collection and condition grading schemes should be carried out to increase the prediction accuracy of the NN model.

Mental health-related risk factors for violence : using the evidence to guide mental health triage decision making

Mental health clinicians working in emergency crisis assessment teams or mental health triage roles are required to make rapid and accurate risk assessments. The assessment of violence risk at triage is particularly pertinent to the early identification and prevention of patient violence, and to enhancing the safety of clinical staff and the general public. To date, the evidence base for mental health triage violence risk assessment has been minimal. This study aimed to address this evidence gap by identifying best available evidence for mental health-related risk factors for patientinitiated violence.We conducted a systematic review based on the National Health and Medical Research Council of Australia’s methodology for systematic reviews. A total of 6847 studies were retrieved, of which 326 studies met the study inclusion criteria. Of these studies, 277 met inclusion criteria but failed the quality appraisal process, thus a total of 49 studies were included in the final review. The risk factors that achieved the highest evidence grading were predominantly related to dynamic clinical factors immediately observable in the patient’s general appearance, behaviour and speech. These factors included hostility/anger, agitation, thought disturbance, positive symptoms of schizophrenia, suspiciousness and irritability.

Impact of a rub and rinse on solution-induced corneal staining

Purpose. To investigate whether the inclusion of a rub and rinse step before contact lens disinfection has an impact on solution-induced corneal staining.

Methods. This was a prospective, double-masked, single investigator study. Twenty participants were recruited for two visits, where balafilcon-A lenses were worn bilaterally for 2 h. Each pair of lenses was prepared using two different methodologies. The “control” lens was transferred from the blister pack directly into a storage case containing polyhexamethylene biguanide-based lens care solution. The contralateral “test” lens was rubbed and simultaneously rinsed using the same polyhexamethylene biguanide-based care solution, for either 60 s (visit 1) or 20 s (visit 2). Both lenses were then soaked in the solution overnight. After baseline corneal staining assessments, the lenses were inserted following a randomized contralateral model. After 2 h, lenses were removed, corneal staining was regraded, and comfort scores were obtained.

Results. Rubbed and rinsed test lenses induced significantly less corneal staining than control lenses for all participants during visit 1 (mean ± SD: 516 ± 843 vs. 2170 ± 902; p < 0.001) and visit 2 (522 ± 417 vs. 2091 ± 965; p < 0.001). There was no significant difference between the test lenses during visits 1 and 2 (p = 0.72) or controls (p = 0.50). Comfort scores did not differ between eyes (p > 0.05).

Conclusions. Corneal staining induced after 2 h of lens wear with the combination of balafilcon-A and polyhexamethylene biguanide-based lens care solution can be significantly reduced by including a rub and rinse step before overnight soaking. Further work is required to establish the longevity of this effect during the monthly wearing cycle.

Developing robust assessment criteria for postgraduate research oriented papers

Assessment criteria designed to fully evaluate prescribed learning outcomes is a significant aid to both student and staff alike. For the student, it allows them to fully understand the requirements for a specific grade and for staff, it simplifies marking (grading) and minimises the likelihood of student appeals against assessment. Whilst criterion referencing is common place in the more traditional analytical type taught papers common in the Engineering degree curriculum it is perhaps less commonly utilised for research based papers. Presented here is a case study where both learning outcomes and achievement criteria have been proposed for a postgraduate research methodology paper which prepares students for their thesis. It has significant cross over to a descriptor for the thesis paper itself and is considered a template which could be equally applied to other subject domains where research methodology is taught.

Role assessment of GIS analysis and its reliability while ranking urban sustainability using scenarios specific to regional climate, community and culture

Urban Sustainability expresses the level of conservation of a city while living a town or consuming its urban resources, but the measurement of urban sustainability depends on what are considered important indicators of conservation besides the permitted levels of consumption in accordance with adopted criteria. This criterion should have common factors that are shared for all the members tested or cities to be evaluated as in this particular case for Abu Dhabi, but also have specific factors that are related to the geographic place, community and culture, that is the measures of urban sustainability specific to a middle east climate, community and culture where GIS Vector and Raster analysis have a role or add a value in urban sustainability measurements or grading are considered herein. Scenarios were tested using various GIS data types to replicate urban history (ten years period), current status and expected future of Abu Dhabi City setting factors to climate, community needs and culture. The useful Vector or Raster GIS data sets that are related to every scenario where selected and analysed in the sense of how and how much it can benefit the urban sustainability ranking in quantity and quality tests, this besides assessing the suitable data nature, type and format, the important topology rules to be considered, the useful attributes to be added, the relationships which should be maintained between data types of a geo- database, and specify its usage in a specific scenario test, then setting weights to each and every data type representing some elements of a phenomenon related to urban suitability factor. The results of assessing the role of GIS analysis provided data collection specifications such as the measures of accuracy reliable to a certain type of GIS functional analysis used in an urban sustainability ranking scenario tests. This paper reflects the prior results of the research that is conducted to test the multidiscipline evaluation of urban sustainability using different indicator metrics, that implement vector GIS Analysis and Raster GIS analysis as basic tools to assist the evaluation and increase of its reliability besides assessing and decomposing it, after which a hypothetical implementation of the chosen evaluation model represented by various scenarios was implemented on the planned urban sustainability factors for a certain period of time to appraise the expected future grade of urban sustainability and come out with advises associated with scenarios for assuring gap filling and relative high urban future sustainability. The results this paper is reflecting are concentrating on the elements of vector and raster GIS analysis that assists the proper urban sustainability grading within the chosen model, the reliability of spatial data collected; analysis selected and resulted spatial information. Starting from selecting some important indicators to comprise the model which include regional culture, climate and community needs an example of what was used is Energy Demand & Consumption (Cooling systems). Thus, this factor is related to the climate and it‟s regional specific as the temperature varies around 30-45 degrees centigrade in city areas, GIS 3D Polygons of building data used to analyse the volume of buildings, attributes „building heights‟, estimate the number of floors from the equation, following energy demand was calculated and consumption for the unit volume, and compared it in scenario with possible sustainable energy supply or using different environmental friendly cooling systems this is followed by calculating the cooling system effects on an area unit selected to be 1 sq. km, combined with the level of greenery area, and open space, as represented by parks polygons, trees polygons, empty areas, pedestrian polygons and road surface area polygons. (initial measures showed that cooling system consumption can be reduced by around 15 -20 % with a well-planned building distributions, proper spaces and with using environmental friendly products and building material, temperature levels were also combined in the scenario extracted from satellite images as interpreted from thermal bands 3 times during the period of assessment. Other examples of the assessment of GIS analysis to urban sustainability took place included Waste Productivity, some effects of greenhouse gases measured by the intensity of road polygons and closeness to dwelling areas, industry areas as defined from land use land cover thematic maps produced from classified satellite images then vectors were created to take part in defining their role within the scenarios. City Noise and light intensity assessment was also investigated, as the region experiences rapid development and noise is magnified due to construction activities, closeness of the airports, and highways. The assessment investigated the measures taken by urban planners to reduce degradation or properly manage it. Finally as a conclusion tables were presented to reflect the scenario results in combination with GIS data types, analysis types, and the level of GIS data reliability to measure the sustainability level of a city related to cultural and regional demands.

Economic evaluation of adult rehabilitation: a systematic review and meta-analysis of randomized controlled trials in a variety of settings

Objectives:
To report if there is a difference in costs from a societal perspective between adults receiving rehabilitation in an inpatient rehabilitation setting versus an alternative setting. If there are cost differences, to report whether opting for the least expensive program setting adversely affects patient outcomes.

Data Sources:
Electronic databases from the earliest possible date until May 2011. All languages were included.

Study Selection
Multiple reviewers identified randomized controlled trials with a full economic evaluation that compared adult inpatient rehabilitation with an alternative. There were 29 included trials with 6746 participants.

Data Extraction
Multiple observers extracted data independently. Trial appraisal included a risk of bias assessment and a checklist to report the strength of the economic evaluation.

Data Synthesis:
Results were synthesized using standardized mean differences (SMDs) and meta-analyses for the primary outcome of cost. The Grading of Recommendations Assessment, Development, and Evaluation was applied to assess for risk of bias across studies for meta-analyses. There was high-quality evidence that cost was significantly reduced for rehabilitation in the home versus inpatient rehabilitation in a meta-analysis of 732 patients poststroke (pooled SMD [δ]=−.28; 95% confidence interval [CI], −.47 to −.09), without compromise to patient outcomes. Results of individual trials in other patient groups (orthopedic, rheumatoid arthritis, and geriatric) receiving rehabilitation in the home or community were generally consistent with the meta-analysis. There was moderate quality evidence that cost was significantly reduced for inpatient rehabilitation (stroke unit) versus general acute care in a meta-analysis of 463 patients poststroke (δ=.31; 95% CI, .15–.48), with improvement to patient outcomes. These results were not replicated in 2 individual trials with a geriatric and a mixed cohort, where costs did not differ between general acute care and inpatient rehabilitation. Three of the 4 individual trials, inclusive of a stroke or orthopedic population, reported less cost for an intensive inpatient rehabilitation program compared with usual inpatient rehabilitation. Sensitivity analysis included a health service perspective and varied inflation rates with no change to the significant findings of the meta-analyses.

Conclusions:
Based on this systematic review and meta-analyses, a single rehabilitation service may not provide health economic benefits for all patient groups and situations. For some patients, inpatient rehabilitation may be the most cost-effective method of providing rehabilitation; yet, for other patients, rehabilitation in the home or community may be the most cost-effective model of care. To achieve cost-effective outcomes, the ideal combination of rehabilitation services and patient inclusion criteria, as well as further data for nonstroke populations, warrants further research.

The prevalence and risk factors of epiretinal membranes: the Melbourne collaborative cohort study

Purpose
To determine the prevalence of epiretinal membranes (ERMs) in Melbourne, Australia and its risk factors in this population.

Methods
The Melbourne Collaborative Cohort Study is a prospective study investigating the role of diet and life style in the causation of common chronic diseases. Eighty-six percent of participants were of Northern European origin born in Australia or United Kingdom and 14% were migrants from Greece or Italy (Southern European origin). Nonmydriatic digital retinal photography was implemented at Melbourne Collaborative Cohort Study follow-up. The ERMs were recorded as cellophane macular reflex without retinal folds or preretinal macular fibrosis (PMF) with retinal folds.

Results
A total of 22,406 participants had retinal photography, 95% (n = 21,241) were eligible for ERM grading. The ERM prevalence were 8.9% (1,882); cellophane macular reflex, 4.9% (1,047); and preretinal macular fibrosis, 3.9% (835). After adjustment for age, sex, level of education, smoking status, level of cholesterol, body mass index, waist-to-hip ratio, waist measurement, blood pressure, diabetes, and stroke, increasing age and Southern European ethnicity was significantly associated with ERMs. Overall, in Southern Europeans, ERMs odd ratio was 1.97 (95% confidence intervals, 1.67–2.31), P < 0.001; preretinal macular fibrosis was 1.82 (95% confidence intervals, 1.43–2.31), P < 0.001; and cellophane macular reflex was 1.93 (1.57–2.38), P < 0.001.

Conclusion
In an older Australian population, the prevalence of ERMs was 8.9% and was almost two times higher in participants of Southern European origin than Northern European origin.