Guidelines for interviewing children during child custody evaluations

This paper offers a brief review of the current literature related to the interviewing of children during child custody evaluations. In particular, the paper highlights several key issues and concerns, and provides a series of recommendations for professionals working in this area. These recommendations (which apply to children aged 3 to 12 years) are organised under the following headings: (a) establish rapport using broad open-ended questions, (b) make the purpose and ground rules of the interview clear to the child, (c) allow the child's perspective be heard without expecting an outright custody preference, (d) demonstrate a willingness to consider all reasonable perspectives or hypotheses about what has occurred, (e) try not to exacerbate the child's stress or guilt, (f) pursue all possible explanations for a child's report, irrespective of whether there are clear signs of “coaching” or contamination, (g) obtain appropriate training in the use of forensic interviewing techniques, and (h) engage in research on the impact of children's participation in custody cases.

The narrative of evaluations: medically supervised injecting centers

Medically supervised injecting centers, or drug consumption rooms are officially sanctioned places where people can inject or smoke illegal drugs in hygienic conditions and under supervision. Their ostensible purposes are to protect the health of drug users and contain the nuisance potential of open drug markets. This article argues that the debates and arguments supporting the establishment and existence of medically supervised injecting centers follow four interweaving narratives. These narratives can be characterized as (1) Caring and humanitarian (2) Elimination of public nuisance (3) Governance of the drug-using subject (4) Neo-liberal, utilitarian, and bureaucratic. These narratives alternatively combine and oppose each other. This means that the analysis of the benefits and problems with such initiatives depends on the perspective of the actors involved and the claims made for their effectiveness.

Review of first-year engineering and technology units based on student unit evaluations

There is recognition that the first-year of university study is a critical phase in the preparation, motivation and retention of science, mathematics,  engineering and technology (SMET) students. First-year provides the foundation/generic skills upon which students will base their undergraduate studies and professional practice; first-year is where many poorly prepared/at risk students will drop out and contribute to the poor student retention rate observed in the SMET disciplines; and first-year is when students may lose the motivation to pursue their chosen career direction if they find the studies at the commencement of their undergraduate program appear to bear no relationship to their intended career. In 2003, the Learning Resources Advisory Group of the Deakin University School of Engineering and Technology was requested to undertake a review of first-year units in the School’s programs. The information contained in anonymous unit evaluation questionnaires from the years 2000-2002 was used as the basis for analysing student perceptions of first-year units. In unit evaluations, students reported a wide range of issues that impacted negatively on their perception of the content and conduct of first-year units. It was noted that units service taught by other Schools form a significant element of the first-year of all of the Engineering and Technology undergraduate programs – typically 25 to 50 percent of the content. The significant influence of these units on the perceptions of the first-year of the School’s commencing students means that the School should exercise some control over the content and delivery of these units.

20 years on - have student evaluations made a difference?

This paper poses the question, what impact have student evaluations (SE’s) of teaching had on the improvement in teaching in Australian tertiary education. The paper proposes to assess the effectiveness of SE’s through an investigations of the ways in which have been used in Australian tertiary education over the last 20 years or so. Three approaches are discussed: a) quality assurance - student evaluations used to ensure the quality of the learning environment in which learning takes place; b) quality improvement - student evaluations used as a diagnostic tool for individual teaching staff; and c) student feedback – student evaluations used to provide prospective and current students with information to help inform their choices and expectations. The discussions reviews some of the research and known practise in Australian universities. It concludes that SE’s have had a profound impact on pedagological understandings of tertiary education by placing the student at centre stage of teaching and learning. However it suggests that we do not know how SE’s have impacted on teaching effectiveness and improvement. The paper concludes by recommending further research to define critical success factors, a better understanding of how to make the student feedback and evaluation tools and mechanisms more approachable and meaningful for students, and an assessment of the ‘survey industry’ as a sustainable enterprise.

Communicating outcomes of students' evaluations of teaching and learning: one-size-fits-all?

Student evaluations of teaching are increasingly used to measure the teaching of individual academics in Australian higher education. The outcomes of these evaluations are variably made available to the individual academics themselves, to university management and to the public. However, communicating evaluation outcomes to each of these audiences assumes a different purpose and necessitates different objectives, foci and methodology. The need for these differences is sometimes forgotten with a ‘one-size-fits-all’ approach in Australian higher education. This paper examines these differences and discusses some of the issues surrounding the communication of the outcomes of student evaluations of teaching.

Obesity prevention programs demand high-quality evaluations

Obesity prevention programs are at last underway or being planned in Australia and New Zealand. However, it is imperative that they are well-evaluated so that they can contribute to continuous program improvement and add much-needed evidence to the international literature on what works and does not work to prevent obesity. Three critical components of program evaluation are especially at risk when the funding comes from service delivery rather than research sources. These are: the need for comparison groups; the need for measured height and weight; and the need for sufficient process and context information. There is an important opportunity to build collaborative mechanisms across community-based obesity prevention sites to enhance the program and evaluation quality and to accelerate knowledge translation into practice and policy.

The influence of locus of attribution, level of employee authority and employee concern on consumers postrecovery evaluations

This study employed a 3 x 2 x 2 full-factorial, between-subjects design experiment involving locus of attribution, concern, and the level of authority of the employee performing the recovery on consumers’ postcomplaint evaluations. The research, conducted in a restaurant context, involved a sample of 411 undergraduate students. Findings suggest that customers are less dissatisfied and more likely to revisit the restaurant when the location of the cause of the failure is internal (i.e., they are to blame). In addition, consumers are less likely to repurchase when the manager, as opposed to the waiter, is responsible for the service failure.

The influence of procedural and interactional justice, and disconfirmation on customers post recovery satisfaction evaluations

This study examines the influence of distributive and interactional justice and disconfirmation on customers’ postrecovery satisfaction evaluations, and in so doing, combines, for the first time, two existing instruments to operationalise the interactional justice construct. Using Structural Equation Modelling, the findings suggest that while both disconfirmation and justice are important predictors of satisfaction, distributive justice has the greatest influence. The research presented here reports on a section of a larger experiment-based study examining how customers’ postrecovery satisfaction evaluations are influenced by the way in which the organisation responds to the failure.

Reviewing research in education in Australia and the UK: evaluating the evaluations

In many countries concerns have been expressed about the merits of educational research. This paper reports on the outcomes of a review of reviews of such research in Australia and the UK. Taken at face value, the latest round of reviews are largely critical in the UK (where they have generated much debate) and mainly favourable in Australia (where they have not). In accounting for this difference the paper suggests that it might be explained in part as a function of how the reviews were conducted. In the UK reviews have tended to begin with the research and work forward to practice whereas in Australia they have been inclined to begin with practice and work back to the research. It is suggested that policy makers, practitioners and researchers in Australia and the UK have much to learn from each other's experience, as have those in other countries planning similar reviews.

Improving the quality of school evaluations

Purpose – To highlight the challenges and identify options to improve school health evaluations.

Design/methodology/approach – This editorial draws on recent international and national meta-evaluations and the experiences of the author.

Findings – A simple set of questions is needed for discussion between those commissioning evaluations and those conducting them to make school health evaluations more effective and relevant to stakeholders.

Originality/value – The paper identifies important steps which need to be considered in undertaking evaluations of school health interventions.

Closing the loop on student evaluations

It is generally agreed that good teaching is dependent on the nature of the learning goals and the quality of the environment in which learning takes place1,2. If this is the case, then planned as opposed to unplanned variations in learning experiences are the hallmark of good teaching. This raises a complex set of relations between assuring and improving teaching within an institution. The essential question for a University is: how do we assure that learning is maximised in all given contexts?

Benchmarking the use of student feedback was identified as a priority project at the ATN annual conference in February 2002. This paper presents a number of issues arising from a study of practices across the ATN in relation to collecting, analysing and using student feedback. The project involved working with those responsible for teaching and learning improvements at the operational level to identify strategies for a systematic approach to the use of student feedback for improving communication of actions arising from results.

The framework for the inquiry involved an exploration of student feedback systems as they operate for different cohorts of students, differing measures (or constructs), and at different levels within institutional structures. The framework also explored the various tracking and reporting systems by which results generated from student feedback systems at each level were utilised to develop strategies for improving teaching and learning. Findings from the study were used to inform recommendations in relation to internal practices within each University, as well as initiatives for benchmarking student evaluation results across universities within the ATN network.

Student evaluations and the impact on curriculum, teaching and assessment

This presentation discusses some of the major pressures on universities to frame curriculum around employability skills and professional requirements. Recent evaluation of Australian university courses by graduates suggests that many institutions remain perplexed as to how to do this. The presentation suggests that the student evaluations do not necessarily indicate poor curriculum development but possibly a lack of making skill development more overt through teaching and assessment. The main objective of this presentation is to outline and describe a project on how curriculum needs to and can respond to professional needs and what this may entail for the way in which traditional professional courses are taught and assessed. The presentation seeks to involve participants in identifying and discussing options for the teaching and assessment of skills and possible options for how these skills can be progressively developed throughout a course of study.

A cross-cultural study into peer evaluations of women's leadership effectiveness

Purpose: The present paper is based on a cross-cultural exploration of middle managers in two diverse cultures and aims to focus on how the leadership styles of managerial women are perceived and evaluated. In particular, female and male peer evaluations of leadership effectiveness in Malaysia and Australia are to be explored.

Design/methodology/approach: Surveys from 324 middle managers from Malaysia and Australia were quantitatively analysed. The sample for the study was drawn from organisations in four industry types in both countries.

Findings:  Findings suggest that evaluations of female managers' leadership styles in general, and within the respondent's own organisations, were strongly culture specific, especially in Malaysia. The results reflected the strongly held values, attitudes and beliefs of each country. While this is not unexpected, it does highlight a need to be cautious when interpreting Western research results and attempting to transplant those into other cultures. In Malaysia, female managers were not seen as effective in the leadership styles they adopted in their roles when compared to the Australian female managers' evaluations. Such an evaluation may have had little to do with an objective appraisal of the female managers' capability, but rather with a strongly held cultural belief about the appropriate role of women in society, and in organisations in particular.

Research limitations/implications:  It is suggested that national culture manifests itself in the values, attitudes and behaviours of people. Cultural influences are therefore likely to impact on the way women and men behave in the workplace, particularly when roles of authority and power are evident, and the way in which that behaviour will be evaluated by others. Further research using different samples in different cultures are recommended. In addition, the influence of ethnicity, race or religion in plural countries such as Malaysia and Australia is also worthy of investigation.

Practical implications:  This research suggests that values and attitudes are strongly culture-specific and therefore have the ability to influence evaluations at an organisational level. Such an awareness of cultural influences should guide appropriate human resource practices, particularly within a globalized environment.

Originality/value:  The inclusion of a gender comparison in the data analysis in this paper is a significant attempt to add to the extant knowledge of the cross-cultural research. This is a unique contribution because of the omission of a gender perspective in the previous two seminal studies in culture literature (i.e. Hofstede and House et al.). In addition, the findings suggest that culture-specific influences are important determinants that impose expectations on the role of women differently from men in society and within organisations hence, making the gender comparison of the findings more significant.

Investigating sample bias in student evaluations of teaching

Student evaluations of teaching have increased in importance to universities in Australia over recent years due to changes in government policy. There has been significant debate in the literature as to the validity and usefulness of such evaluations and as to whether students who respond to the evaluations are indeed representative of the student population. A potential invalidating issue is self selection in the evaluation process. In this paper, we consider student evaluations of a large first year business statistics subject that had 1073 eligible students enrolled across four campuses at the time of the evaluation. The study is based on the 373 students (34.8%) who responded to the survey, and their final results. The evaluations were open for a period of six weeks leading up to and just after the final exam. The study looks in detail at the student population identifying such attributes as gender; home campus; course of study; domestic/international; Commonwealth Supported Place/full fee paying, etc. and then mapping these results to those of the students who responded to the survey.

Students' evaluations of teaching quality and their unit online activity : an empirical investigation

This paper reports on an investigation of the relationship between students’ level of online activity in units in a business faculty and their evaluations of teaching quality in these units. The analysis was conducted using student evaluation data from 2004 to 2007 together with data for student online activity for one semester. We compare on-campus and off-campus students and undergraduate and postgraduate students. The results indicate that students’ evaluations of units have improved on all surveyed criteria during the five years. We also show that for some cohorts student online activity is associated with greater satisfaction with teaching. The paper concludes by considering the implications of these findings for further research and teaching practice.