Development and interrater reliability testing of a telephone interview training programme for Australian nurse interviewers

Summary Background The final phase of a three phase study analysing the implementation and impact of the nurse practitioner role in Australia (the Australian Nurse Practitioner Project or AUSPRAC) was undertaken in 2009, requiring nurse telephone interviewers to gather information about health outcomes directly from patients and their treating nurse practitioners. A team of several registered nurses was recruited and trained as telephone interviewers. The aim of this paper is to report on development and evaluation of the training process for telephone interviewers. Methods The training process involved planning the content and methods to be used in the training session; delivering the session; testing skills and understanding of interviewers post-training; collecting and analysing data to determine the degree to which the training process was successful in meeting objectives and post-training follow-up. All aspects of the training process were informed by established educational principles. Results Interrater reliability between interviewers was high for well-validated sections of the survey instrument resulting in 100% agreement between interviewers. Other sections with unvalidated questions showed lower agreement (between 75% and 90%). Overall the agreement between interviewers was 92%. Each interviewer was also measured against a specifically developed master script or gold standard and for this each interviewer achieved a percentage of correct answers of 94.7% or better. This equated to a Kappa value of 0.92 or better. Conclusion The telephone interviewer training process was very effective and achieved high interrater reliability. We argue that the high reliability was due to the use of well validated instruments and the carefully planned programme based on established educational principles. There is limited published literature on how to successfully operationalise educational principles and tailor them for specific research studies; this report addresses this knowledge gap.

Centroid training to achieve effective text classification

Traditional text classification technology based on machine learning and data mining techniques has made a big progress. However, it is still a big problem on how to draw an exact decision boundary between relevant and irrelevant objects in binary classification due to much uncertainty produced in the process of the traditional algorithms. The proposed model CTTC (Centroid Training for Text Classification) aims to build an uncertainty boundary to absorb as many indeterminate objects as possible so as to elevate the certainty of the relevant and irrelevant groups through the centroid clustering and training process. The clustering starts from the two training subsets labelled as relevant or irrelevant respectively to create two principal centroid vectors by which all the training samples are further separated into three groups: POS, NEG and BND, with all the indeterminate objects absorbed into the uncertain decision boundary BND. Two pairs of centroid vectors are proposed to be trained and optimized through the subsequent iterative multi-learning process, all of which are proposed to collaboratively help predict the polarities of the incoming objects thereafter. For the assessment of the proposed model, F1 and Accuracy have been chosen as the key evaluation measures. We stress the F1 measure because it can display the overall performance improvement of the final classifier better than Accuracy. A large number of experiments have been completed using the proposed model on the Reuters Corpus Volume 1 (RCV1) which is important standard dataset in the field. The experiment results show that the proposed model has significantly improved the binary text classification performance in both F1 and Accuracy compared with three other influential baseline models.

Improving automatic speaker verification using SVM techniques

Automatic recognition of people is an active field of research with important forensic and security applications. In these applications, it is not always possible for the subject to be in close proximity to the system. Voice represents a human behavioural trait which can be used to recognise people in such situations. Automatic Speaker Verification (ASV) is the process of verifying a persons identity through the analysis of their speech and enables recognition of a subject at a distance over a telephone channel { wired or wireless. A significant amount of research has focussed on the application of Gaussian mixture model (GMM) techniques to speaker verification systems providing state-of-the-art performance. GMM's are a type of generative classifier trained to model the probability distribution of the features used to represent a speaker. Recently introduced to the field of ASV research is the support vector machine (SVM). An SVM is a discriminative classifier requiring examples from both positive and negative classes to train a speaker model. The SVM is based on margin maximisation whereby a hyperplane attempts to separate classes in a high dimensional space. SVMs applied to the task of speaker verification have shown high potential, particularly when used to complement current GMM-based techniques in hybrid systems. This work aims to improve the performance of ASV systems using novel and innovative SVM-based techniques. Research was divided into three main themes: session variability compensation for SVMs; unsupervised model adaptation; and impostor dataset selection. The first theme investigated the differences between the GMM and SVM domains for the modelling of session variability | an aspect crucial for robust speaker verification. Techniques developed to improve the robustness of GMMbased classification were shown to bring about similar benefits to discriminative SVM classification through their integration in the hybrid GMM mean supervector SVM classifier. Further, the domains for the modelling of session variation were contrasted to find a number of common factors, however, the SVM-domain consistently provided marginally better session variation compensation. Minimal complementary information was found between the techniques due to the similarities in how they achieved their objectives. The second theme saw the proposal of a novel model for the purpose of session variation compensation in ASV systems. Continuous progressive model adaptation attempts to improve speaker models by retraining them after exploiting all encountered test utterances during normal use of the system. The introduction of the weight-based factor analysis model provided significant performance improvements of over 60% in an unsupervised scenario. SVM-based classification was then integrated into the progressive system providing further benefits in performance over the GMM counterpart. Analysis demonstrated that SVMs also hold several beneficial characteristics to the task of unsupervised model adaptation prompting further research in the area. In pursuing the final theme, an innovative background dataset selection technique was developed. This technique selects the most appropriate subset of examples from a large and diverse set of candidate impostor observations for use as the SVM background by exploiting the SVM training process. This selection was performed on a per-observation basis so as to overcome the shortcoming of the traditional heuristic-based approach to dataset selection. Results demonstrate the approach to provide performance improvements over both the use of the complete candidate dataset and the best heuristically-selected dataset whilst being only a fraction of the size. The refined dataset was also shown to generalise well to unseen corpora and be highly applicable to the selection of impostor cohorts required in alternate techniques for speaker verification.

Working with actors in open disclosure simulations

A key strategy in facilitating learning in Open Disclosure training is the use of hypothetical, interactive scenarios called ‘simulations’. According to Clapper (2010), the ‘advantages of using simulation are numerous and include the ability to help learners make meaning of complex tasks, while also developing critical thinking and cultural skills’. Simulation, in turn, functions largely through improvisation and role-play, in which participants ‘act out’ particular roles and characters according to a given scenario, without recourse to a script. To maximise efficacy in the Open Disclosure training context, role-play requires the specialist skills of professionally trained actors. Core capacities that professional actors bring to the training process include (among others) believability, an observable and teachable skill which underpins the western traditions of actor training; and flexibility, which pertains to the actor’s ability to vary performance strategies according to the changing dynamics of the learning situation. The Patient Safety and Quality Improvement Service of Queensland Health utilises professional actors as a key component of their Open Disclosure Training Program. In engaging actors in this work, it is essential that Facilitators of Open Disclosure training have a solid understanding of the acting process: what acting is; how actors work to a brief; how they improvise; and how they sustainably manage a wide range of emotional states. In the simulation context, the highly skilled actor can optimise learning outcomes by adopting or enacting – in collaboration with the Facilitator - a pedagogical function.

Robust image hash functions using higher order spectra

Robust hashing is an emerging field that can be used to hash certain data types in applications unsuitable for traditional cryptographic hashing methods. Traditional hashing functions have been used extensively for data/message integrity, data/message authentication, efficient file identification and password verification. These applications are possible because the hashing process is compressive, allowing for efficient comparisons in the hash domain but non-invertible meaning hashes can be used without revealing the original data. These techniques were developed with deterministic (non-changing) inputs such as files and passwords. For such data types a 1-bit or one character change can be significant, as a result the hashing process is sensitive to any change in the input. Unfortunately, there are certain applications where input data are not perfectly deterministic and minor changes cannot be avoided. Digital images and biometric features are two types of data where such changes exist but do not alter the meaning or appearance of the input. For such data types cryptographic hash functions cannot be usefully applied. In light of this, robust hashing has been developed as an alternative to cryptographic hashing and is designed to be robust to minor changes in the input. Although similar in name, robust hashing is fundamentally different from cryptographic hashing. Current robust hashing techniques are not based on cryptographic methods, but instead on pattern recognition techniques. Modern robust hashing algorithms consist of feature extraction followed by a randomization stage that introduces non-invertibility and compression, followed by quantization and binary encoding to produce a binary hash output. In order to preserve robustness of the extracted features, most randomization methods are linear and this is detrimental to the security aspects required of hash functions. Furthermore, the quantization and encoding stages used to binarize real-valued features requires the learning of appropriate quantization thresholds. How these thresholds are learnt has an important effect on hashing accuracy and the mere presence of such thresholds are a source of information leakage that can reduce hashing security. This dissertation outlines a systematic investigation of the quantization and encoding stages of robust hash functions. While existing literature has focused on the importance of quantization scheme, this research is the first to emphasise the importance of the quantizer training on both hashing accuracy and hashing security. The quantizer training process is presented in a statistical framework which allows a theoretical analysis of the effects of quantizer training on hashing performance. This is experimentally verified using a number of baseline robust image hashing algorithms over a large database of real world images. This dissertation also proposes a new randomization method for robust image hashing based on Higher Order Spectra (HOS) and Radon projections. The method is non-linear and this is an essential requirement for non-invertibility. The method is also designed to produce features more suited for quantization and encoding. The system can operate without the need for quantizer training, is more easily encoded and displays improved hashing performance when compared to existing robust image hashing algorithms. The dissertation also shows how the HOS method can be adapted to work with biometric features obtained from 2D and 3D face images.

A Best Practice Process for Fleet Safety Training

This paper outlines a process for fleet safety training based on research and management development programmes undertaken at the University of Huddersfield in the UK (www.hud.ac.uk/sas/trans/transnews.htm) and CARRS-Q in Australia (www.carrsq.qut.edu.au/staff/Murray.jsp) over the past 10 years.

Changing motorcycle rider safety attitudes and motives for risk taking : process evaluation of a rider training intervention

Risk-taking behaviour by motorcyclists has been shown to contribute to a substantial proportion of road crashes in Australia and abroad. Concern has been expressed that traditional motorcycle licence training programs do not sufficiently address such behaviour. Accordingly, the Three Steps to Safer Riding program was developed to address risk taking behaviour by riders as an adjunct to existing skills-based rider training. The program was designed to be delivered in a one hour classroom session at the start of training, with a 20 minute debrief to revise the key concepts at the end of training. This paper reports on the key training concepts, methodology and implementation of the pilot program with a major rider training organisation in Queensland and presents findings from a process evaluation. The Three Steps to Safer Riding intervention pilot was delivered to 518 learner riders over a three month period. Follow-up focus groups and one interview with intervention participants (N=18) five to eight months after completion of the program suggest that new riders (absolute novices) embraced and internalised many of the intervention concepts. However, some riders who had previous riding experience prior to training stated these issues were common sense, yet still expressed riding styles that were contrary to some of the key intervention messages. This is discussed in terms of raising awareness of risk issues for motorcyclists versus behaviour change. Additionally, interviews conducted with riding instructors are discussed regarding logistical challenges of implementation, training consistency, skills required to deliver the program, support for the program, and student engagement.

Exploring the process of implementing a smoking cessation intervention in pregnancy training program for midwives

The question of how to implement evidence effectively reveals a deficiency in our knowledge and understanding of the compound factors involved in such a process (Kitson, Rycroft-Malone et al. 2008). Although there is some awareness of the complexities of the process, there has been little exploration of the effectiveness of implementing evidence-based programs in health care. Despite public awareness of the dangers of smoking in pregnancy, and widespread public health measures to prevent smoking-related disease, women still continue to smoke in pregnancy (Ananth, Savitz et al. 1997; Laws and Hilder 2008). Evaluation of public health measures concludes that smoking cessation interventions during pregnancy increase quit rates among pregnant women (Melvin, Dolan-Mullen et al. 2000; Albrecht, Maloni et al. 2004; Lumley, Oliver et al. 2007). Notwithstanding the potential for improvement in health outcomes for pregnant women and their unborn babies, smoking interventions are often conducted poorly or not at all. Although midwives understand why women smoke in pregnancy and parenthood and are aware of the risks of smoking to both the pregnancy and the unborn child, they require specific knowledge and skills in the provision of support and advice on smoking for pregnant women (Bull and Whitehead 2006) . Organisational-change research demonstrates the complexity of the process of planned change in professionalised institutions such as health care (Greenhalgh, Robert et al. 2005). Some innovations and interventions are never accepted, and others are poorly supported (Greenhalgh, Robert et al. 2004). Comprehension of the change process around health promotion is crucial to the implementation of new health promotion interventions within health care (Riley, Taylor et al. 2003). This study utilised a case study approach to explore the process of implementing a smoking cessation training program for midwives in Queensland metropolitan and regional clinical areas, who attended a ‘Train-the-Trainer program’. The study draws on the organisational change work of Greenhalgh et al (2004) as the theoretical framework through which situational and structural factors are explored and examined as they inform the implementation of smoking cessation programs. The research data constituted staged interviews with midwives who instituted training programs for midwives, as well as organisational and policy documentation. Analysis of the data identified some areas that were not fully addressed in the theoretical model; these formed the basis of the Discussion and Implications for Future Research.

How should a vocational education and training course be evaluated?

The course evaluation process used by a large VET provider was evaluated using guidelines suggested by the course evaluation literature and feedback obtained from multiple stakeholders. A modified model is presented as an exemplar for course evaluation in the VET sector.

Principal preparation and training : a look at China and its issues

Purpose: The purpose of this paper is to provide an understanding of principal preparation and training in China by providing a background discussion of principal preparation in a number of countries. As an illustration, it provides an overview of the curriculum used in the initial preparation of school principals at Beijing Normal University.-----Design/methodology/approach: The paper draws mainly on writing and research from China, Australia and the USA to explore principal preparation and training in China.-----Findings: In addition to providing a rich description of principal preparation in China, the paper's main findings comprise seven key challenges that confront China as it endeavours to provide quality principal preparation. These challenges include China's diversity and uneven social, cultural and educational development; limited resources in some regions throughout China; the place and importance of study tours for principal preparation; the teaching approach used to train principals; the process used for assessing principal learning during their training programs; the limited transfer of learning from the classroom to the school environment; and the timing of training for principals.-----Practical implications: Each of the challenges arising here raises important practical implications for developers of principal training programs.-----Originality/value: The paper paints a picture of principal preparation in China and raises a number of issues and challenges with which it continues to grapple. Of note is that China is not alone in facing some of these ongoing concerns.

Aligning policy with practice: an evaluation of vocational education and training in the library and information services sector

Vocational education and training for the library and information services (LIS) sector in Australia offers students the career pathway to become library technicians. Library technicians play a valuable role in drawing on sound practical knowledge and skills to support the delivery of library and information services that meet client needs. Over the past forty years, the Australian Library and Information Association (ALIA) has monitored the quality of library technician courses. Since 2005, ALIA has run national professional development days for library technician educators with the goal of establishing an alternative model for course recognition focusing on the process of peer review to benchmark good practice and stimulate continuous improvement in library technician education. This initial developmental work has culminated in 2009 with site visits to all library technician courses in Australia. The paper presents a whole-of-industry case study to critically review the work undertaken to date.

Providing youth with skills, training and employment opportunities through ICT Initiatives

Youth population is increasing explosively particularly in developing countries as a result of rapid urbanization. This increase is bringing large number of social and economic problems. For instance the impacts of job and training availability, and the physical, social and cultural quality of urban environment on young people are enormous, and affect their health, lifestyles, and well-being (Gleeson and Sipe 2006). Besides this, globalization and technological developments are affecting youth in urban areas in all parts of the world, both positively and negatively (Robertson 1995). The rapidly advancing information and communications technologies (ICTs) helps in addressing social and economic problems caused by the rapid growth of urban youth populations in developing countries. ICTs offer opportunities to young people for learning, skill development and employment. But there are downsides: young people in many developing countries lack of having broad access to these new technologies, they are vulnerable to global market changes, and ICTs link them into global cultures which promote consumer goods, potentially eroding local cultures and community values (Manacorda and Petrongolo 1999). However we believe that the positives outweigh such negatives. At the beginning of the twenty-first century, the world’s young population number more than they ever have. There are over a billion young people between the ages of 15 and 24, which 85 per cent of them live in developing countries and mainly in urban environments. Many of these young people are in the process of making, or have already made, the transition from school to work. During the last two decades all around the world, these young people, as new workers, have faced a number of challenges associated with globalization and technological advances on labour markets (United Nations 2004). The continuous decrease in the manufacturing employment is made many of the young people facing three options: getting jobs in the informal economy with insecurity and poor wages and working conditions, or getting jobs in the low-tier service industries, or developing their vocational skills to benefit from new opportunities in the professional and advanced technical/knowledge sectors. Moreover in developing countries a large portion of young people are not even lucky enough to choose among any of these options, and consequently facing long-term unemployment, which makes them highly vulnerable. The United Nations’ World Youth Employment report (2004) indicates that in almost all countries, females tend to be far more vulnerable than males in terms of long-term unemployment, and young people who have advanced qualifications are far less likely to experience long-term unemployment than others. In the limited opportunities of the formal labour market, those with limited vocational skills resort to forced entrepreneurship and selfemployment in the informal economy, often working for low pay under hazardous conditions, with only few prospects for the future (United Nations 2005a). The International Labour Organization’s research (2004) revealed that the labour force participation rates for young people decreased by almost four per cent (which is equivalent of 88 million young people) between 1993 and 2003. This is largely as a result of the increased number of young people attending school, high overall unemployment rates, and the fact that some young people gave up any hope of finding work and dropped out of the labour market. At the regional level, youth unemployment was highest in Middle East and North Africa (MENA) (25.6%) and sub-Saharan Africa (21%) and lowest in East Asia (7%) and the industrialized economies(13.4%) (International Labour Organization 2004). The youth in economically disadvantaged regions (e.g. the MENA region) face many challenges in education and training that delivers them the right set of skills and knowledge demanded by the labour market. As a consequence, the transition from school to work is mostly unsuccessful and young population end up either unemployed or underemployed in the informal sectors (United Nations 2005b). Unemployment and lack of economic prospects of the urban youth are pushing many of them into criminal acts, excessive alcohol use, substance addiction, and also in many cases resulting in processes of social or political violence (Fernandez-Maldonado 2004; United Nations 2005a). Long-term unemployment leads young people in a process of marginalisation and social exclusion (United Nations 2004). The sustained high rates of long-term youth unemployment have a number of negative effects on societies. First, it results in countries failing to take advantage of the human resources to increase their productive potential, at a time of transition to a globalized world that inexorably demands such leaps in productive capacity. Second, it reinforces the intergenerational transmission of poverty. Third, owing to the discrepancy between more education and exposure to the mass media and fewer employment opportunities, it may encourage the spread of disruptive behaviours, recourse to illegal alternatives for generating income and the loss of basic societal values, all of which erode public safety and social capital. Fourth, it may trigger violent and intractable political conflicts. And lastly, it may exacerbate intergenerational conflicts when young people perceive a lack of opportunity and meritocracy in a system that favours adults who have less formal education and training but more wealth, power and job stability (Hopenhayn 2002). To assist in addressing youth’s skill training and employment problems this paper scrutinises useful international practices, policies, initiatives and programs targeting youth skill training, particularly in ICTs. The MENA national governments and local authorities could consider implementing similar initiative and strategies to address some of the youth employment issues. The broader aim of this paper is to investigate the successful practice and strategies for the information and communication related income generation opportunities for young people to: promote youth entrepreneurship; promote public-private partnerships; target vulnerable groups of young people; narrow digital divide; and put young people in charge. The rest of this paper is organised in five parts. First, the paper provides an overview of the literature on the knowledge economy, skill, education and training issues. Secondly, it reviews the role of ICTs for vocational skill development and employability. Thirdly, it discusses the issues surrounding the development of the digital divide. Fourthly, the paper underlines types and the importance of developing ICT initiatives targeting young people, and reviews some of the successful policy implementations on ICT-based initiatives from both developed and developing countries that offer opportunities to young people for learning, skill development and employment. Then the paper concludes by providing useful generalised recommendations for the MENA region countries and cities in: advocating possible opportunities for ICT generated employment for young people; and discussing how ICT policies could be modified and adopted to meet young people’s needs.

Training for lifestyle entrepreneurs

Many developed countries have issues with the movement of populations away from rural areas. There has been an active move towards 'value adding' in rural areas, and in particular, the development of tourism activities, to counter this trend. The purpose of this paper is to document the curriculum development process that was engaged in, in the design, delivery and outcomes of a programme designed to encourage and equip rural entrepreneurs to extend into the tourism and hospitality industries. These entrepreneurs operate in Hedmark Region of Norway and the training took place in Brisbane, Australia. The development and delivery of the training programme took place in Norway and Australia. The methodology is qualitative and it is hoped the research will lead to a longitudinal study of the impact of lifestyle entrepreneurs on local economic development in rural areas. The action research process that was engaged in means that the entrepreneurs are active participants in the research, and the quality of their feedback and willingness to discuss their changed behaviour are critical to both evaluating the impact of the programme and the potential for further study on the economic impact of their activities. The development process and the nature of the curriculum used for these entrepreneurs may well provide insights into effective training for lifestyle entrepreneurs in other contexts. The participants were asked to evaluate the programme immediately on its conclusion and six months after the programme when they were interviewed in their place of operation.

Proactive communication management beats hostile media exposure : training for multi-cultural community leaders in living with mass media

Proactive communication management instead of mortification in the glare of hostile media attention became the theme of a four-day training program for multi-cultural community leaders, the object of this research. The program in Brisbane from December 2009 through to February this year was conducted under auspices of a Community Media Link grant program shared by Griffith University and the Queensland Ethnic Communities Council, together with Journalism academics from the Queensland University of Technology. Twenty-eight participants from 23 organisations took part, with a team of nine facilitators from the host organisations, and guest presenters from the news media. This paper reviews the process, taking into account: its objectives, to empower participants by showing how Australian media operate and introducing participants to journalists; pedagogical thrust, where overview talks, with role play seminars with guest presenters from the media, were combined with practice in interviews and writing for media; and outcomes, assessed on the basis of participants’ responses. The research methodology is qualitative, in that the study is based on discussions to review the planning and experience of sessions, and anonymous, informal feed-back questionnaires distributed to the participants. Background literature on multiculturalism and community media was referred to in the study. The findings indicate positive outcomes for participants from this approach to protection of persons unversed in living in the Australian “mediatised” environment. Most affirmed that the “production side” perspective of the exercise had informed and motivated them effectively, such that henceforth they would venture far more into media management, in their community leadership roles.