Tracking new directions in the evaluation of postgraduate supervision

This article focuses on the evaluation of thesis supervision and highlights the vast range of problem areas presently documented as significant areas of concern for both graduate students and their supervisors. Additionally, the authors report on a study completed in 1995, which surveyed all Australian universities about current evaluative practices in postgraduate supervision. The conclusion of this study was that the conduct of such evaluations appears to be minimal and is primarily designed to obtain an indicator of the general “health” of a university's postgraduate supervision rather than to foster improved supervisory practices. As part of the same study, the authors conducted University faculty-based student and supervisor focus groups. Key issues emerging from these focus groups were: (1) the importance of relational aspects of supervision as the student communicates over the long term with one or more supervisors; (2) the importance of systematic feedback, monitoring, and evaluation to the supervisory process; and (3) the lack of strategies to facilitate this evaluative feedback process. On the basis of these findings, the authors designed evaluative strategies to facilitate regular ongoing feedback between students and supervisors.

Successful outcomes in vocational education and training courses : how pedagogy and expectations influence achievement

This paper reports on a four year Australian Research Council funded Linkage Project titled Skilling Indigenous Queensland, conducted in regional areas of Queensland, Australia from 2009 to 2013. The project sought to investigate vocational education, training (VET) and teaching, Indigenous learners’ needs, employer cultural and expectations and community culture and expectations to identify best practice in numeracy teaching for Indigenous VET learners. Specifically it focused on ways to enhance the teaching and learning of courses and the associated mathematics in such courses to benefit learners and increase their future opportunities of employment. To date thirty-nine teachers/trainers/teacher aides and two hundred and thirty-one students consented to participate in the project. Nine VET courses were nominated to be the focus on the study. This paper focuses on questionnaire and interview responses from four trainers, two teacher aides and six students. In recent years a considerable amount of funding has been allocated to increasing Indigenous Peoples’ participation in education and employment. This increased funding is predicated on the assumption that it will make a difference and contribute to closing the education gap between Indigenous and non-Indigenous Australians (Council of Australia Governments, 2009). The central tenet is that access to education for Indigenous People will create substantial social and economic benefits for regional and remote Indigenous People. The project’s aim is to address some of the issues associated with the gap. To achieve the aims, the project adopted a mixed methods design aimed at benefitting research participants and included: participatory collaborative action research (Kemmis & McTaggart, 1988) and, community research (Smith, 1999). Participatory collaborative action research refers to a is a “collective, self-reflective enquiry undertaken by participants in social situations in order to improve the rationality and justice of their own social and educational practices” (Kemmis et al., 1988, p. 5). Community research is described as an approach that “conveys a much more intimate, human and self-defined space” (p. 127). Community research relies on and validates the community’s own definitions. As the project is informed by the social at a community level, it is described as “community action research or emancipatory research” (Smith, 1999, p. 127). It seeks to demonstrate benefit to the community, making positive differences in the lives of Indigenous People and communities. The data collection techniques included survey questionnaires, video recording of teaching and learning processes, teacher reflective video analysis of teaching, observations, semi-structured interviews and student numeracy testing. As a result of these processes, the findings indicate that VET course teachers work hard to adopt contextualising strategies to their teaching, however this process is not always straight forward because of the perceptions of how mathematics has been taught and learned historically. Further teachers, trainers and students have high expectations of one another with the view to successful outcomes from the courses.

A proposed Australian industrial control system security curriculum

The security of industrial control systems in critical infrastructure is a concern for the Australian government and other nations. There is a need to provide local Australian training and education for both control system engineers and information technology professionals. This paper proposes a postgraduate curriculum of four courses to provide knowledge and skills to protect critical infrastructure industrial control systems. Our curriculum is unique in that it provides security awareness but also the advanced skills required for security specialists in this area. We are aware that in the Australian context there is a cultural gap between the thinking of control system engineers who are responsible for maintaining and designing critical infrastructure and information technology professionals who are responsible for protecting these systems from cyber attacks. Our curriculum aims to bridge this gap by providing theoretical and practical exercises that will raise the awareness and preparedness of both groups of professionals.

Work-integrated learning courses : an essential component for preparing students to work in statutory child protection?

Undergraduate programs can play an important role in the development of individuals wanting professional employment within statutory child protection agencies: both the coursework and the work-integrated learning (WIL) components of degrees have a role in this process. This paper uses a collective case study methodology to examine the perceptions and experiences of first year practitioners within a specific statutory child protection agency in order to identify if they felt prepared for their current role. The sample of 20 participants came from a range of discipline backgrounds with just over half of the sample (55 per cent) completing a WIL placement as part of their undergraduate studies. The results indicate that while some participants were able to identify and articulate specific benefits from their undergraduate coursework studies all participants who had undertaken a WIL placement as part of their degree believed the WIL placement was beneficial for their current work.

Background to the development of a curriculum for the history of “cyber” and “communications” security

For any discipline to be regarded as a professional undertaking by which its members may be treated as true “professionals” in a specific area, practitioners must clearly understand that discipline’s history as well as the place and significance of that history in current practice as well as its relevance to available technologies and artefacts at the time. This is common for many professional disciplines such as medicine, pharmacy, engineering, law and so on but not yet, this paper submits, in information technology. Based on twenty five elapsed years of experience in developing and delivering Cybersecurity courses at undergraduate and postgraduate levels, this paper proposes a rationale and set of differing perspectives for the planning and development of curricula relevant to the delivery of appropriate courses in the history of cybersecurity or information assurance to information and communications technology (ICT) students and thus to potential information technology professionals.

Postgraduate response to an information retrieval credit course

Information skills instruction for research candidates bas recently been formalised as coursework at the Queensland University of Technology. Feedback solicited from participants suggests that students benefit from such coursework in a number of ways. Their perception of the value of specific content areas to their literature review and thesis presentation is favourable. A small group of students who participated in Interviews identified five ways in which the coursework assisted the research process. As Instructors continue to work with the post·graduate community it would be useful to deepen our understanding of how such instruction is perceived and the benefits which can be derived from it.

Information skills coursework for postgraduate students : investigation and response at the Queensland University of Technology

In response to current developments In the tertiary education sector, the Queensland University of Technology Library has mounted an Intensive course - Advanced Information Retrieval Skills - for higher degree students. In determining need for such a course, a survey of postgraduate students and their supervisors was conducted. Results of this survey are discussed and details of the four credit point subjects are outlined.

Pedagogy and community engagement in environmental design courses

This article describes an evaluation of student experiences in environmental design courses with a community engagement focus. It aims to identify pedagogical approaches that minimize obstacles faced by students while maximizing learning opportunities. Focus groups composed of undergraduate students in seven classes generated three major findings: (1) learning how to effectively engage with community partners is one of the most beneficial challenges of this type of course; (2) logistical hurdles and course characteristics that limited students’ ability to connect with the community partners or synthesize the social, emotional, technical, and theoretical aspects of the course were perceived as learning obstacles; and (3) social and emotional connections with community partners are the most educationally significant part of the experience for students. The conclusion discusses recommendations for how environmental design instructors can take advantage of the unique social and emotional connections with community partners that facilitated community engagement can foster, while limiting the learning obstacles that students may experience. Areas for future research

Too many cooks? Co-creating and co-teaching studio courses in the creative media context : a career-focussed approach

This Case Study relates to the creation and implementation of career‐focussed courses in Creative Media for film, television, animation, broadcast and web contexts. The paper examines the advantages and disadvantages of co‐teaching, and how different professional and academic backgrounds and disciplines can productively inform curriculum design and delivery in the academic/professional context. The authors, as co‐creators and co‐lecturers, have developed a number of courses which represent current working models for intermediate to advanced level academic/professional study, and attract students from across the creative disciplines; including theatre, media, visual arts and music. These courses are structured to develop in students a wide range of aesthetic and technical skills, as well as their ability to apply those skills professionally within and across the creative media industries. Issues regarding the balance between academic rigour, practical hands‐on skill development, assessment, logistics, resources, teamwork and other issues, are examined in the paper.

The impact on clinical practice of a postgraduate clinical pharmacy programme, incorporating competency-based performance evaluation

Background A goal of the postgraduate clinical pharmacy programme (PGCPP) at the University of Queensland is to enhance clinical practice. Aims To evaluate student perceptions of the impact of the PGCPP on practice and the inclusion of a competency-based performance evaluation as a formative component of the curriculum. Method In 2010, students completed a questionnaire to evaluate the impact of the PGCPP. In 2011, formative competency-based performance evaluations were conducted as a component of the course and the questionnaire was repeated. Responses, competency ratings and evaluation feedback were collated. Data were analysed using descriptive statistics. Results 51/57 (89%) of students completed the questionnaire in 2010 and 2011. Over 90% of students agreed or strongly agreed that the PGCPP enhanced practice, knowledge, confidence and contribution to patient care. Responses were similarly positive after the inclusion of the performance evaluation. Conclusion This study demonstrated that the PGCPP is achieving the goal of enhancing the practice of pharmacists.

Starting out in STEM : a study of young men and women in first year science, technology, engineering and mathematics courses

In late 2011, first year university students in science, technology, engineering and mathematics (STEM) courses across Australia were invited to participate in the international Interests and Recruitment in Science (IRIS) study. IRIS investigates the influences on young people's decisions to choose university STEM courses and their subsequent experiences of these courses. The study also has a particular focus on the motivations and experiences of young women in courses such as physics, IT and engineering given the low rates of female participation in these fields. Around 3500 students from 30 Australian universities contributed their views on the relative importance of various school and non-school influences on their decisions, as well as insights into their experiences of university STEM courses so far. It is hoped that their contributions will help improve recruitment, retention and gender equity in STEM higher education and careers.

Designing Web 2.0 ePortfolios for music postgraduate study : A practice-led enquiry

This article examines the design of ePortfolios for music postgraduate students utilizing a practice-led design iterative research process. It is suggested that the availability of Web 2.0 technologies such as blogs and social network software potentially provide creative artist with an opportunity to engage in a dialogue about art with artefacts of the artist products and processes present in that discussion. The design process applied Software Development as Research (SoDaR) methodology to simultaneously develop design and pedagogy. The approach to designing ePortfolio systems applied four theoretical protocols to examine the use of digitized artefacts to enable a dynamic and inclusive dialogue around representations of the students work. A negative case analysis identified a disjuncture between university access and control policy, and the relative openness of Web2.0 systems outside the institution that led to the design of an integrated model of ePortfolio.

The role of laboratory exercises in modern power engineering education at the University of Queensland

The University of Queensland (UQ) has extensive laboratory facilities associated with each course in the undergraduate electrical engineering program. The laboratories include machines and drives, power systems simulation, power electronics and intelligent equipment diagnostics. A number of postgraduate coursework programs are available at UQ and the courses associated with these programs also use laboratories. The machine laboratory is currently being renovated with i-lab style web based experimental facilities, which could be remotely accessed. Senior level courses use independent projects using laboratory facilities and this is found to be very useful to improve students' learning skill. Laboratory experiments are always an integral part of a course. Most of the experiments are conducted in a group of 2-3 students and thesis projects in BE and major projects in ME are always individual works. Assessment is done in-class for the performance and also for the report and analysis.

Successful outcomes in vocational education and training courses and mathematics: how pedagogy and expectations influence achievement

This paper reports on a four year Australian Research Council funded Linkage Project titled Skilling Indigenous Queensland, conducted in regional areas of Queensland, Australia from 2009 to 2013. The project sought to investigate Vocational Education and Training (VET) and teaching, Indigenous learners’ needs, employer culture and expectations and community culture and expectations to identify best practice in numeracy teaching for Indigenous VET learners. Specifically it focused on ways to enhance the teaching and learning of courses and the associated mathematics in such courses to benefit learners and increase their future opportunities of employment. To date thirty - nine teachers/trainers/teacher aides and two hundred and thirty - one students consented to participate in the project. Nine VET courses offered in schools and Technical and Further Education Institutes (TAFE) were nominated to be the focus on the study. This paper focuses on student questionnaire responses and interview responses from teachers/trainers one high school principal and five students as a result of these processes, the findings indicated that VET course teachers work hard to adopt contextualising strategies to their teaching; however this process is not always straight forward because of the perceptions of how mathematics has been taught and learned by trainers and teachers. Further teachers, trainers and students have high expectations of one another with the view to successful outcomes from the courses.

Developing learning cohorts for postgraduate research degrees

Development of researchers through higher degree research studies is a high priority in most universities. Yet, research about supervision as pedagogy and models of supervision is only recently gained increasing attention. Charged with producing good researchers within very limited resources, academics are constantly looking for more efficient models of supervision for higher degree research students. A cohort model of supervision promises several efficiencies, but we argue that its success lies importantly on how well the cohort is developed specifically for higher degree research studies. We drew on a growing body of literature on higher degree research supervision to design, implement and evaluate our approach to developing a cohort of seven students enrolled in the Master of Education (Research) degree. Our approach included four provisions: initial residential workshop, development of a learning community, nourishing scholarship, and ongoing learning opportunities. The four provisions resulted in gradually developing an environment and culture that students found very supportive and nurturing. This paper is based on the findings from data collected from student evaluations in the first year of studies, feedback from the cohort’s sponsor, and our reflective notes. The evaluation substantiated the value in investing time and resources for purposely developing a cohort for higher degree research studies. Whether the cohorts are sponsored or not, universities will still need to invest time and resources for cohort development if a cohort model is intended to gain wider efficiencies in supervision of higher degree research students.