Assessment by interview and portfolio in a Graduate School Program

Assessment plays an integral role in teaching and learning in Higher Education and teachers have a strong interest in debates and commentaries on assessment as and for learning. In a one-year graduate entry teacher preparation program, the temptation is to emphasize assessment in an attempt to ensure students “cover” everything as part of a robust preparation for the profession. The risk is that, for students, assessment drives curriculum, and time spent in the completion of assignments is no guarantee of either effective learning or authentic preparation for teaching. Interviews as assessment provide an opportunity for a learning experience as well as an authentic task, since students will shortly be interviewing for employment in a “real world” situation. This paper reports on a project experimenting with interview panels as authentic assessment with pre-service early childhood teachers. At the end of their first semester of study, students enrolled in the Graduate Diploma of Education program at the Queensland University of Technology in Australia were required to participate in a panel interview where they were graded by a panel made up of three faculty staff and one undergraduate student enrolled in the four-year Bachelor of Education program. Students and panel members completed a questionnaire on their experience after the interview. Results indicated that both students and staff valued the experience and felt it was authentic. Results are discussed in terms of how the assessment interview and portfolio presentation supports graduating students in their preparation for employment interviews, and how this authentic assessment task has benefits for both students and teaching staff.

Modeling web search : preliminary results

This paper reports preliminary results from a study modeling the interplay between multitasking, cognitive coordination, and cognitive shifts during Web search. Study participants conducted three Web searches on personal information problems. Data collection techniques included pre- and post-search questionnaires; think-aloud protocols, Web search logs, observation, and post-search interviews. Key findings include: (1) users Web searches included multitasking, cognitive shifting and cognitive coordination processes, (2) cognitive coordination is the hinge linking multitasking and cognitive shifting that enables Web search construction, (3) cognitive shift levels determine the process of cognitive coordination, and (4) cognitive coordination is interplay of task, mechanism and strategy levels that underpin multitasking and task switching. An initial model depicts the interplay between multitasking, cognitive coordination, and cognitive shifts during Web search. Implications of the findings and further research are also discussed.

Assessing organizational culture? value management to the rescue

As part of a Doctor of Business Administration degree programme jointly run by Curtin University, Perth, Australia and Lingnan University, Hong Kong, a research thesis relating organizational effectiveness to the organizational culture of Hong Kong construction firms involved in public housing is being undertaken. Organizational effectiveness is measured by the Housing Department (HD) Performance Assessment Scoring System (PASS) and organizational culture traits and strengths have been measured by using the Denison Organizational Culture Survey (OCS), developed by Daniel Denison and William S. Neale and based on 16 years of research involving over 1,000 organizations. The PASS scores of building contractors are compared with the OCS scores to determine if there is any significant correlation between highly effective companies and particular organizational strengths and traits. Profiles are then drawn using the Denison Model and can be compared against ‘norms’ for the industry sector on which the survey has been carried out. The next stage of the work is to present the results of the survey to individual companies, conduct focus group interviews to test the results, discover more detail on that company’s culture and discuss possible actions based on the results. It is in this latter stage that certain value management techniques may well prove very useful.

Diagnosing postpartum depression in mothers and fathers : Whatever happened to anxiety?

Although anxiety disorders are documented in the literature for new mothers (but less so for fathers), rates of postpartum caseness tend to include only those with depression when diagnostic interviews or self-report measures validated on such interviews are used. This methodology therefore underestimates the true percentage of women and men who experience significant psychological difficulties postpartum. This has implications for assessment, treatment and screening for postnatal mood disorders. Two studies were conducted on a total of 408 women and 356 men expecting their first child. They were recruited antenatally, and interviewed at 6 weeks postpartum using the Diagnostic Interview Schedule. DSM-IV criteria were applied to determine the presence since birth of depression (major or minor), panic disorder, acute adjustment disorder with anxiety (meeting the criteria for generalised anxiety disorder except for the duration criterion), and phobia. The inclusion of diagnostic assessment for panic disorder and acute adjustment disorder with anxiety increased the rates of caseness by between 57 and 100% for mothers, and 31-130% for fathers, over the rates for major or minor depression. Inclusion of assessment for phobia further increased the rates of disorder in both samples.

Supervision practice for allied mental health professionals within a large mental health workforce : exploring the phenomenon

This paper reports on an exploration of the concept of 'supervision' as applied to allied health professionals within a large mental health service in one Australian State. A two-part methodology was used, with focus group interviews conducted with allied health professionals, and semi-structured telephone interviews with service managers. Fifty-eight allied health professionals participated in a series of seven focus groups. Semi-structured interviews were conducted with the Directors or Managers of mental health services in all 21 regions in the state. Allied health professionals and service managers both considered supervision to be an important mechanism for ensuring staff competence and best practice outcomes for consumers and carers. There was strong endorsement of the need for clarification and articulation of supervision policies within the organization, and the provision of appropriate resourcing to enable supervision to occur. Current practice in supervision was seen as ad hoc and of variable standard; the need for training in supervision was seen as critical. The supervision needs of newly graduated allied health professionals and those working in rural and regional areas were also seen as important. The need for a flexible and accessible model of supervision was clearly demonstrated.

Information security culture : a behaviour compliance conceptual framework

Understanding the complex dynamic and uncertain characteristics of organisational employees who perform authorised or unauthorised information security activities is deemed to be a very important and challenging task. This paper presents a conceptual framework for classifying and organising the characteristics of organisational subjects involved in these information security practices. Our framework expands the traditional Human Behaviour and the Social Environment perspectives used in social work by identifying how knowledge, skills and individual preferences work to influence individual and group practices with respect to information security management. The classification of concepts and characteristics in the framework arises from a review of recent literature and is underpinned by theoretical models that explain these concepts and characteristics. Further, based upon an exploratory study of three case organisations in Saudi Arabia involving extensive interviews with senior managers, department managers, IT managers, information security officers, and IT staff; this article describes observed information security practices and identifies several factors which appear to be particularly important in influencing information security behaviour. These factors include values associated with national and organisational culture and how they manifest in practice, and activities related to information security management.

There is no relationship : service provider staff on how LGBT young people experience policing

There has been an extended engagement with how young people experience policing, with a focus on the intersection between policing and indigeneity, ethnicity, gender, and social class. Interestingly, sexuality and/or gender diversity has been almost completely overlooked, both nationally and internationally. This paper reports on LGBT youth service providers’ accounts about police and LGBT young people interactions. It overviews the outcomes of semi-structured interviews with key LGBT youth service providers in different regions of Brisbane, Queensland. As the first qualitative engagement with these issues from the perspective of service providers, it highlights not only how LGBT young people experience policing, but also how service providers need to ‘work the system’ of policing to produce the best outcomes for LGBT young people.

Identification of barriers to and facilitators for the implementation of occupational road safety initiatives

To explore potential barriers to and facilitators for implementing occupational road safety initiatives, in-depth interviews were conducted with personnel from four major Australian organizations. Twenty-four participants were involved in the interviews comprising 16 front line employees and eight managers. The interviews identified that employees perceived six organizational characteristics as potential barriers to implementing occupational road safety initiatives. These included: prioritisation of production over safety; complacency towards occupational road risks; insufficient resources; diversity; limited employee input in safety decisions; and a perception that road safety initiatives were an unnecessary burden. Of these organizational characteristics, prioritisation of production over safety and complacency were the most frequently cited barriers. In regards to facilitators, participants perceived three organizational characteristics as potential facilitators to implementing occupational road safety initiatives. These included: management commitment; the presence of existing systems that could support the implementation of initiatives; and supportive relationships. Of these organizational characteristics, management commitment was the most frequently cited facilitator.

Effective employment-based training models for childcare workers

Childcare workers play a significant role in the learning and development of children in their care. This has major implications for the training of workers. Under new reforms of the childcare industry the Australian government now requires all workers to obtain qualifications from a vocational education and training provider (eg. Technical and Further Education) or university. Effective models of employment-based training are critical to provide training to highly competent workers. This paper presents findings from a study that examined current and emerging models of employment-based training in the childcare sector, particularly at the Diploma level. Semi-structured interviews were conducted with a sample of 16 participants who represented childcare directors, employers, and workers located in childcare services in urban, regional and remote locations in the State of Queensland. The study proposes a ‘best-fit’ employment-based training approach that is characterised by a compendium of five models instead of a ‘one size fits all’. Issues with successful implementation of the EBT models are also discussed

Public accountability : the perceived usefulness of School Annual reports

Annual reports are an important component of New Zealand schools’ public accountability. Through the annual report the governance body informs stakeholders about school aims, objectives, achievements, use of resources, and financial performance. We examine the perceived usefulness of the annual report in the discharge of public accountability. We find that 15% of the recipients (mainly parents/caregivers) do not read the annual report because they trust in the school to do the right thing or rely on others to monitor school activities. We find that the annual report is used for a variety of purposes including to determine if the school has conducted its activities effectively and achieved stated objectives and goals; to examine student achievements; to assess financial accountability and performance; and to make decisions about the school as a suitable environment for their child/children. We find that other forms of communication such as school newsletters, parent-teacher interviews, children and other parents are more important sources of information about the school than the annual report.

Aural auteur : sound in the films of Rolf de Heer

An interpretative methodology for understanding meaning in cinema since the 1950s, auteur analysis is an approach to film studies in which an individual, usually the director, is studied as the author of her or his films. The principal argument of this thesis is that proponents of auteurism have privileged examination of the visual components in a film-maker’s body of work, neglecting the potentially significant role played by sound. The thesis seeks to address this problematic imbalance by interrogating the creative use of sound in the films written and directed by Rolf de Heer, asking the question, “Does his use of sound make Rolf de Heer an aural auteur?” In so far as the term ‘aural’ encompasses everything in the film that is heard by the audience, the analysis seeks to discover if de Heer has, as Peter Wollen suggests of the auteur and her or his directing of the visual components (1968, 1972 and 1998), unconsciously left a detectable aural signature on his films. The thesis delivers an innovative outcome by demonstrating that auteur analysis that goes beyond the mise-en-scène (i.e. visuals) is productive and worthwhile as an interpretive response to film. De Heer’s use of the aural point of view and binaural sound recording, his interest in providing a ‘voice’ for marginalised people, his self-penned song lyrics, his close and early collaboration with composer Graham Tardif and sound designer Jim Currie, his ‘hands-on’ approach to sound recording and sound editing and his predilection for making films about sound are all shown to be examples of de Heer’s aural auteurism. As well as the three published (or accepted for publication) interviews with de Heer, Tardif and Currie, the dissertation consists of seven papers refereed and published (or accepted for publication) in journals and international conference proceedings, a literature review and a unifying essay. The papers presented are close textual analyses of de Heer’s films which, when considered as a whole, support the thesis’ overall argument and serve as a comprehensive auteur analysis, the first such sustained study of his work, and the first with an emphasis on the aural.

Two Thai teachers' perceptions of cooperative learning

Over the past decade, the need for educational reform in Thailand has become increasingly apparent. The strong tradition of teacher-directed instruction has been the major teaching and learning style in Thai education. Recent policy changes have focused on expanding education opportunities, the implementation of compulsory education and also on more student-centered pedagogies (Carter, 2006). A suggested way of bringing about the changes necessary to improve the standard of education in primary schools and retention rates is to incorporate cooperative learning into Thai primary school classrooms. The action research in this study proceeded in four stages. There were pre-implementation interviews of teachers, teacher preparation, implementation of program, and post-implementation evaluation. This study focused on the two Thai teachers' perceptions about the benefits of cooperative learning and the roles of the teachers in cooperative learning classroom. The study found that the two teachers had constructed different levels of perceptions about the benefits of cooperative learning and the roles of the teacher. These findings indicated that Thai teachers who are relatively inexperienced, lacking in confidence and with little or no experience with group work strategies such as peer tutoring need alternative, less intense professional development programs conducted over a period of a semester than the professional development program implemented in this study. In addition to being conducted over a longer period of time, the findings also indicate that alternative teacher professional programs need to provide additional workshops to improve their understanding of cooperative learning and the teachers' roles.

International students using online information resources to learn

This qualitative study views international students as information-using learners, through an information literacy lens. Focusing on the experiences of 25 international students at two Australian universities, the study investigates how international students use online information resources to learn, and identifies associated information literacy learning needs. An expanded critical incident approach provided the methodological framework for the study. Building on critical incident technique, this approach integrated a variety of concepts and research strategies. The investigation centred on real-life critical incidents experienced by the international students whilst using online resources for assignment purposes. Data collection involved semi-structured interviews and an observed online resource-using task. Inductive data analysis and interpretation enabled the creation of a multifaceted word picture of international students using online resources and a set of critical findings about their information literacy learning needs. The study’s key findings reveal: • the complexity of the international students’ experience of using online information resources to learn, which involves an interplay of their interactions with online resources, their affective and reflective responses to using them, and the cultural and linguistic dimensions of their information use. • the array of strengths as well as challenges that the international students experience in their information use and learning. • an apparent information literacy imbalance between the international students’ more developed information skills and less developed critical and strategic approaches to using information • the need for enhanced information literacy education that responds to international students’ identified information literacy needs. Responding to the findings, the study proposes an inclusive informed learning approach to support reflective information use and inclusive information literacy learning in culturally diverse higher education environments.

Leadership construction : an exploratory case study of two exemplary female principals in urban primary schools in mainland China

Worldwide, education systems have undergone unprecedented change due to a variety of economic, social, and political forces (Limerick, Cunnington & Crowther, 2002). The People’s Republic of China (PRC) is no exception. Continuous educational reform at primary and secondary levels in Mainland China has created new challenges and accountabilities for school principals. The important role of principals in primary and secondary schools has been acknowledged in both policy documents and the broader literature (Central Committee of the Chinese Communist Party, 1985; F. Chen, 2005; Chu, 2003; W. Huang, 2005; T. Wang, 2003). Yet, most of the literature on primary and secondary school principals in Mainland China is prescriptive in nature, identifying from the perspectives of researchers and academics what principals should do and how they should enact leadership. Lacking in this research is an awareness of the daily practices and lived experiences of principals. Furthermore, within the small body of writing on primary and secondary school principals in Mainland China, gender is seldom given any attention. To date, only a small number of empirical studies have focused on female principals as a specific category of research (Zen, 2004; Zhong, 2004). This study aimed to explore the professional lives of two female exemplary school principals in urban primary schools in Mainland China. A qualitative exploratory case study was used. Semi-structured interviews with each individual female principal, with six teachers in each of the school sites and with the superintendent of each principal were conducted. Field observations and document analysis were also undertaken to obtain multiple insights about their leadership practices. The conceptual framework was based largely on the theory of Gronn (1999) and incorporated five core leadership practices (vision building, ethical considerations, teaching and learning, power utilisation, and dealing with risks and challenges) taken from the wider literature. The key findings of this study were twofold. Firstly, while the five leadership practices were evident in the leadership of the two principals, this study identified some subtle differences in the way they approached each of them. Secondly, contextual factors such as Chinese traditional culture, the contemporary societal context, and the school organisational context, in addition to the biographical experiences of each principal were significant factors in shaping the way in which they exercised their leadership practices in the schools.

An evaluation framework for educational reform projects for teacher quality improvements in developing countries : a case study of Egyptian education reform

The role of the evaluation for Official Development Assistance (ODA) enterprises including educational development has become critical after increasing “aid fatigue” experienced by the international community in the 1990s. To date, however, monitoring and evaluating outcomes of the projects has been limited to the project life. Consequently these have been mainly through the international aid agencies. Furthermore, the monitoring and evaluation led by international aid agencies have paid little attention to aspects of the sustainability of technical cooperation in educational development. To sustain the impact of technical cooperation, the reinforcement of evaluation has drawn increasing attention in light of the emerging modalities in international development. Therefore this research was inspired to investigate alternative evaluation frameworks for an educational reform project for teacher quality improvement that may increase possibilities for long term sustainability. Importantly, the new modalities in international development and educational issues provide new options. In addition, the research reviewed theoretical and practical issues surrounding evaluation in general, and highlighted the evaluation of education reform projects. The research reported explored via case studies, the evaluation processes employed by the Egyptian education reform projects implemented by the Japan International Cooperation Agency (JICA) and the United Nations Children’s Fund (UNICEF). The case studies used three data sources (archival and relevant documents, a survey questionnaire and interviews) to illuminate the contextually-embedded evaluation processes. The research found that process evaluation is a potential alternative method since it is likely to be locally institutionalised, which may yield long-term sustainability of the projects.