A psychometric evaluation of the Learning Styles Questionnaire : 40-item version

Sixty-six English-speaking postgraduate distance-education medical students completed the Learning Styles Questionnaire (LSQ: 40-item version). This was completed while attending a residential workshop at the beginning of the semester, and 44 of these students completed the same LSQ questionnaire 5 months later at the completion of the semester. The psychometric properties of the LSQ were assessed using Cronbach’s alpha (internal consistency), test-retest, correlational analyses and factor analysis. The results indicated that the LSQ (40-item version) has poor reliability and validity, and therefore requires further development and psychometric evaluation.

Evaluation of the Whitten Project : final report

Evaluation of The Whitten Project. A pilot project aimed at developing emerging young community leaders across Melbourne’s western region. Final Report

Ensuring quality during monitoring of the learning environment of government primary schools achieved through EUI-PDP for teachers and head teachers

A positive change in the learning environment in schools is visible through ongoing professional development of teachers and administrators. Monitoring the professional development program and providing support to teachers and administrators to transfer their learnings into the school environment ensures some measures of quality. Quality issues led to the launching of the Professional Development Program (PDP) for Primary School Teachers (PSTs) of Sindh by the United Educational Initiative (UEI), a consortium of five Governmental and Non-Governmental Organizations, working under the supervision of Education Sector Reform Assistance (ESRA). Implementation of the UEI-PDP in four districts of Sindh, is ensured by a team of professionals in each district. Recognising that capacity building of district education employees would improve the educational system in the country, 130 Master Trainers were selected, on merit, from the District Education Office for the training of 17,000 teachers and 3000 Head teachers/administrators over a period of two years. This paper developed the design of a Monitoring Process for a Professional Development Program for Primary School Teachers and Administrators. Data was collected through Pre/Post observations, Interviews, Questionnaires and Reports. Such tools make it possible for the monitoring teams to observe, to inquire further, and, along with the Managers, Master Trainers and School Support Team, seek to explain the progress of the program and take corrective action where indicated. Both formative evaluations as well as summative  evaluation techniques are utilized for evaluating the program. The monitoring process that assisted in formative evaluations is described. In order to assist in summative evaluation, data collected through the monitoring process was further developed to categorize the schools where teachers and head teachers are trained. It is hoped that the categorization of the schools may lead to further improvements in those schools which fall in the group for need improvement. It may also initiate further research as to reasons behind why some schools are in the good category and why others fall in the average category.

Older and wiser?: a comparison of the learning and study strategies of mature age and younger teacher education students

'Non-traditional' students are increasingly a part of university populations. This study examined differences between mature age and younger university students in their learning and study strategies as measured by the Learning and Study Strategies Inventory (LASSI). Subjects were 21 mature age and 104 younger teacher education students enrolled in The Bachelor of Teaching (Primary) course at the Royal Melbourne Institute of Technology. Significant correlations were found between the students' LASSI scores and both their self-reported level of global skill and their perceptions of how difficult the course was. There were significant differences between the two groups in terms of their learning and study strategies, with mature age students reporting themselves to be using effective strategies more often, on average, than younger students. The validity and implications of these findings in terms of student learning, support and instruction in study and learning and in predicting academic success are discussed.

Using vignettes to evaluate the outcomes of student learning : data from the evaluation of the new social work degree in England

This paper reports the use of vignettes as a methodology to analyse the extent to which the new social work degree programmes enabled students to develop their analytical and reflective capabilities. Two vignettes, which focused on children and families and adult social care respectively, were developed for the study. Students were asked to respond in writing, from the perspective of a social worker, to a standard set of questions at the beginning (T1) and end of their degree programme (T2). Considering the responses to all questions across the two vignettes, a series of scales was developed to measure the key themes which had been identified by qualitative analysis. These included ‘Attention to process of relationships’ and ‘Social/structural/political awareness’. Responses were also rated as ‘descriptive’, ‘analytic’ or ‘reflective’.

Students from six universities in England participated. From an original sample of 222 students, it was possible to match 79 T1 and T2 responses. Analysis of variance demonstrated statistically significant increases in nine of the 11 themes and increases in ratings for analysis and reflection.

In conclusion, vignettes can be used to produce both qualitative and quantitative data in respect of changes in students’ acquisition of knowledge and skills over time.

Evaluation of the fuzzy ARTMAP neural network using off-line and on-line learning strategies

This paper describes an experimental study of the Fuzzy ARTMAP (FAM) neural network as an autonomous learning system for pattern classification tasks. A benchmark database of radar signals from ionosphere has been employed for the system to classify arbitrary sequences of pattern into distinct categories. A number of simulations have been conducted systematically to evaluate the applicability and usefulness of FAM in this context. First, we identify the 'optimum' parameter settings of FAM for the problem at hand, and investigate the effects of different training schemes and learning rules on classification results, using an off-line learning methodology. We then examine a voting strategy to improve classification accuracy by combining results from multiple FAM classifiers. In addition to off-line learning, we evaluate the prospect of using FAM as an autonomously learning pattern classification system for on-line, non-stationary environments. The performance of FAM is comparable with other reported results, but with the added advantage of on-line and incremental learning.

An evaluation of the impact of using authentic design and build industry projects in project-based learning

BACKGROUNDChisholm’s ‘first year experience’ is a significant feature of the new industry focused Bachelor of Engineering Technology program delivered in association with the South East Melbourne Manufacturers’ Alliance (SEMMA). This conceive-design-implement-operate (CDIO Initiative) program commenced as a full time program in first semester 2012. Whereas it is common for CDIO Initiative programs to have a first year experience program containing a project typical of the type of industry project they would complete as a graduate engineer or engineering technologist, this goes further by using real industry projects provided by SEMMA members.This design-and-build industry project runs across both semesters supporting project-based learning in three first year subjects. A concern is that the industry involvement of the projects adds substantially to an already heavy student workload. This has been further increased by the addition of two additional first year initiatives: writing workshops, and training in, and substantial use of, student oral presentations. It is recognised that an excessive workload could lead students to adopt surface learning approaches in other subjects.PURPOSEThe goal of the project is to evaluate student perceptions of the value and work load impact of the industry project and the other new first year initiatives.DESIGN/METHODCentral to this project is a student survey-based evaluation of the industry project based learning that is the core of the ‘first year experience’. The participants were limited to the small group of students who, in a single year, completed all three subjects that comprise the ‘first year experience’. To avoid compromising the results the survey was administered by Chisholm Institute’s Department of Strategy and Planning with no engineering technology degree program staff present. The survey included questions to enable responses to be linked with specific student demographics without identifying any of the respondents.RESULTSThe study showed the industry project-based learning had worthwhile outcomes but placed considerable time pressures on most respondents. For some, this also impacted on their other subjects. A first year oral presentation program was also shown to have worthwhile outcomes. However no conclusions could be reliably drawn on the third initiative – writing workshops.CONCLUSIONSThe results confirm that the authentic industry project is considered a worthwhile initiative but contributes significantly to student overload. This applies also – to a lesser extent – to the first year oral presentation program. Both also require new approaches to delivery as student numbers increase. Strategies to address these issues are discussed.

Evaluation of the performance and development culture initiative 2005-2008

An evaluation of the P&D Culture initiative 2005-2008 was contracted to Deakin University in 2009. The findings from the evaluation indicated a belief that the P&D Culture initiative had a significant impact on:

* Establishing effective school policies, processes and structures
* Strengthening school culture related to continuous improvement
* Improved instructional practice
* Improved student learning
* Implementation of other DEECD initiatives.

An evaluation of the Victorian Certificate of Education common study of English

This paper traces the development of the Victorian Certificate of Education and in particular the common English Field of Study demonstrating that the VCE is the culmination of many forces acting both within and from outside education. Changes in education are traced and the stimuli for these changes are shown to be economic, social, political and educational.