Development and interrater reliability testing of a telephone interview training programme for Australian nurse interviewers

Summary Background The final phase of a three phase study analysing the implementation and impact of the nurse practitioner role in Australia (the Australian Nurse Practitioner Project or AUSPRAC) was undertaken in 2009, requiring nurse telephone interviewers to gather information about health outcomes directly from patients and their treating nurse practitioners. A team of several registered nurses was recruited and trained as telephone interviewers. The aim of this paper is to report on development and evaluation of the training process for telephone interviewers. Methods The training process involved planning the content and methods to be used in the training session; delivering the session; testing skills and understanding of interviewers post-training; collecting and analysing data to determine the degree to which the training process was successful in meeting objectives and post-training follow-up. All aspects of the training process were informed by established educational principles. Results Interrater reliability between interviewers was high for well-validated sections of the survey instrument resulting in 100% agreement between interviewers. Other sections with unvalidated questions showed lower agreement (between 75% and 90%). Overall the agreement between interviewers was 92%. Each interviewer was also measured against a specifically developed master script or gold standard and for this each interviewer achieved a percentage of correct answers of 94.7% or better. This equated to a Kappa value of 0.92 or better. Conclusion The telephone interviewer training process was very effective and achieved high interrater reliability. We argue that the high reliability was due to the use of well validated instruments and the carefully planned programme based on established educational principles. There is limited published literature on how to successfully operationalise educational principles and tailor them for specific research studies; this report addresses this knowledge gap.

Disclosure of Child Sexual Abuse : Impact of Interviewers’ Attitudes & Children's Collaboration during Forensic Interviews

L’agression sexuelle (AS) commise envers les enfants est un sujet complexe à enquêter et les allégations reposent souvent exclusivement sur le témoignage de l’enfant. Cependant, même quand l’enfant divulgue une AS, il peut être réticent à révéler certains détails personnels et gênants de l’AS à un étranger. Étant donné qu’il n'est pas toujours possible d'obtenir le consentement de filmer et qu’il est relativement difficile de mesurer l’attitude non verbale de l’enfant et celui de l’enquêteur au cours des entrevues d’investigations, cette recherche a été novatrice dans sa création d’échelles verbales de telles attitudes. Afin de déterminer la corrélation de l’attitude des enquêteurs et la collaboration des enfants, 90 entrevues d’enfants âgés de 4 à 13 ans ont été analysées. Les entrevues ont été enregistrées sur bande audio, transcrites et codifiées à l'aide des sous-échelles verbales d'attitudes soutenantes et non-soutenantes des enquêteurs ainsi que d’attitudes de résistance et de coopération de la part de l'enfant. La proportion des détails sur l’AS fournie par les enfants a également été calculée. Afin de comparer les entrevues avec et sans le protocole du National Institute of Child Health and Human Development (NICHD), une MANCOVA, contrôlant pour l’âge de l’enfant et la proportion de questions ouvertes, démontre tel qu’attendu que les entrevues avec le protocole obtiennent plus de détails fournis à la suite des questions ouvertes que les entrevues sans le protocole. Cependant, aucune différence ne ressort quant aux attitudes de l’enfant et celle de l’enquêteur. Afin de trouver le meilleur prédicteur de la quantité de détails dévoilés par les enfants, une analyse de régression multiple hiérarchique a été faite. Après avoir contrôlé pour l'âge de l’enfant, l’utilisation du protocole et la proportion de questions ouvertes, la résistance de l’enfant et l’attitude non-soutenante de l’enquêteur expliquent 28 % supplémentaire de la variance, tandis que la variance totale expliquée par le modèle est de 58%. De plus, afin de déterminer si la collaboration de l’enfant et l’attitude de l’enquêteur varient en fonction de l’âge des enfants, une MANOVA démontre que les enquêteurs se comportent similairement, quel que soit l'âge des enfants. Ceci, malgré le fait que les jeunes enfants sont généralement plus réticents et coopèrent significativement moins bien que les préadolescents. Finalement, une régression multiple hiérarchique démontre que le soutien de l'enquêteur est le meilleur prédicteur de la collaboration des enfants, au-delà des caractéristiques de l'enfant et de l’AS. Bien que l’utilisation du protocole NICHD ait permis des progrès considérables dans la manière d’interroger les enfants, augmentant la proportion de détails obtenus par des questions ouvertes/rappel libre et amplifiant la crédibilité du témoignage, l’adhésion au protocole n’est pas en soi suffisante pour convaincre des jeunes enfants de parler en détail d’une AS à un inconnu. Les résultats de cette thèse ont une valeur scientifique et contribuent à enrichir les connaissances théoriques sur les attitudes de l'enfant et de l'enquêteur exprimées lors des entrevues. Même si les enquêteurs de cette étude offrent plus de soutien aux enfants résistants, indépendamment de leur âge, pour promouvoir la divulgation détaillée de l’AS, de meilleures façons de contrer les attitudes de résistance exprimées par les jeunes enfants et une minimisation des attitudes non-soutenantes lors des entrevues sont nécessaires.

Scientific and technological survey in the country during 1981: interviewers manual

Manual del entrevistador de la encuesta a instituciones sobre ciencia y tecnologia.

Evaluation and research program of the U.S. censuses of population and housing, 1960 : effects of interviewers and crew leaders.

Bibliography: p. 89.

Aids to employment managers and interviewers on shipyard occupations with description of such occupations.

Mode of access: Internet.

Consumer expenditure surveys : initial training, self study for new interviewers, quarterly/diary.

"Form CE-317, January 1986."

Investigative interviewing and memory: How accurate are interviewers recollections of investigative interviews?

Contrary to interviewing guidelines, a considerable portion of witness interviews are not recorded. Investigators’ memory, their interview notes, and any subsequent interview reports therefore become important pieces of evidence; the accuracy of interviewers’ memory or such reports is therefore of crucial importance when interviewers testify in court regarding witness interviews. A detailed recollection of the actual exchange during such interviews and how information was elicited from the witness will allow for a better assessment of statement veracity in court. ^ Two studies were designed to examine interviewers’ memory for a prior witness interview. Study One varied interviewer note-taking and type of subsequent interview report written by interviewers by including a sample of undergraduates and implementing a two-week delay between interview and recall. Study Two varied levels of interviewing experience in addition to report type and note-taking by comparing experienced police interviewers to a student sample. Participants interviewed a mock witness about a crime, while taking notes or not, and wrote an interview report two weeks later (Study One) or immediately after (Study Two). Interview reports were written either in a summarized format, which asked interviewers for a summary of everything that occurred during the interview, or verbatim format, which asked interviewers to record in transcript format the questions they asked and the witness’s responses. Interviews were videotaped and transcribed. Transcriptions were compared to interview reports to score for accuracy and omission of interview content. ^ Results from both studies indicate that much interview information is lost between interview and report especially after a two-week delay. The majority of information reported by interviewers is accurate, although even interviewers who recalled information immediately after still reported a troubling amount of inaccurate information. Note-taking was found to increase accuracy and completeness of interviewer reports especially after a two week delay. Report type only influenced recall of interviewer questions. Experienced police interviewers were not any better at recalling a prior witness interview than student interviewers. Results emphasize the need to record witness interviews to allow for more accurate and complete interview reconstruction by interviewers, even if interview notes are available. ^

Confirmation bias in witness interviewing: Can interviewers ignore their preconceptions?

Basic research on expectancy effects suggests that investigative interviewers with pre-conceived notions about a crime may negatively influence the interview process in meaningful ways, yet many interviewing protocols recommend that interviewers review all available information prior to conducting their interviews. Previous research suggests that interviewers with no pre-interview knowledge elicit more detailed and accurate accounts than their informed counterparts (Cantlon, et al., 1996; Rivard et al., under review). The current study investigated whether (a) the benefit of blind versus informed interviewing is moderated by cautionary interviewer instructions to avoid suggestive questions and (b) whether any possible effects of pre-interview information extend beyond the immediate context of the forensic interview. ^ Paired participants (N = 584) were assigned randomly either to the role of interviewer or witness. Witnesses viewed a mock crime video and were interviewed one week later by an interviewer who received either correct, incorrect, or no information about the crime event. Half of the interviewers were assigned randomly to receive additional instructions to avoid suggestive questions. All participants returned 1 week after the interview to recall the crime video (for the witness) or the information recalled by the witness during the interview (for the interviewer). All interviews and delayed recall measures were scored for the quantity and accuracy of information reported. ^ Results replicate earlier findings that blind interviewers elicit more information from witnesses, without a decrease in accuracy rate. However instructions to avoid suggestive questions did not moderate the effect of blind versus informed interviewing on witness recall during the interview. Results further demonstrate that the effects of blind versus non-blind interviewing may extend beyond the immediate context of the interview to a later recall attempt. With instructions to avoid suggestive questions, witnesses of blind interviewers were more accurate than witnesses of incorrectly informed interviewers when recalling the event 1 week later. In addition, blind interviewers had more accurate memories for the witnesses' account of the event during the interview compared to non-blind interviewers.^

Investigative Interviewing and Memory: How Accurate Are Interviewers’ Recollections of Investigative Interviews?

Contrary to interviewing guidelines, a considerable portion of witness interviews are not recorded. Investigators’ memory, their interview notes, and any subsequent interview reports therefore become important pieces of evidence; the accuracy of interviewers’ memory or such reports is therefore of crucial importance when interviewers testify in court regarding witness interviews. A detailed recollection of the actual exchange during such interviews and how information was elicited from the witness will allow for a better assessment of statement veracity in court. Two studies were designed to examine interviewers’ memory for a prior witness interview. Study One varied interviewer note-taking and type of subsequent interview report written by interviewers by including a sample of undergraduates and implementing a two-week delay between interview and recall. Study Two varied levels of interviewing experience in addition to report type and note-taking by comparing experienced police interviewers to a student sample. Participants interviewed a mock witness about a crime, while taking notes or not, and wrote an interview report two weeks later (Study One) or immediately after (Study Two). Interview reports were written either in a summarized format, which asked interviewers for a summary of everything that occurred during the interview, or verbatim format, which asked interviewers to record in transcript format the questions they asked and the witness’s responses. Interviews were videotaped and transcribed. Transcriptions were compared to interview reports to score for accuracy and omission of interview content. Results from both studies indicate that much interview information is lost between interview and report especially after a two-week delay. The majority of information reported by interviewers is accurate, although even interviewers who recalled information immediately after still reported a troubling amount of inaccurate information. Note-taking was found to increase accuracy and completeness of interviewer reports especially after a two week delay. Report type only influenced recall of interviewer questions. Experienced police interviewers were not any better at recalling a prior witness interview than student interviewers. Results emphasize the need to record witness interviews to allow for more accurate and complete interview reconstruction by interviewers, even if interview notes are available.

Citizen journalism as social networking : reporting the 2007 Australian Federal Election

One of the perceived Achilles heels of online citizen journalism is its perceived inability to conduct investigative and first-hand reporting. A number of projects have recently addressed this problem, with varying success: the U.S.-based Assignment Zero was described as "a highly satisfying failure" (Howe 2007), while the German MyHeimat.de appears to have been thoroughly successful in attracting a strong community of contributors, even to the point of being able to generate print versions of its content, distributed free of charge to households in selected German cities. In Australia, citizen journalism played a prominent part in covering the federal elections held on 24 November 2007; news bloggers and public opinion Websites provided a strong counterpoint to the mainstream media coverage of the election campaign (Bruns et al., 2007). Youdecide2007.org, a collaboration between researchers at Queensland University of Technology and media practitioners at the public service broadcaster SBS, the public opinion site On Line Opinion, and technology company Cisco Systems, was developed as a dedicated space for a specifically hyperlocal coverage of the election campaign in each of Australia's 150 electorates from the urban sprawls of Sydney and Brisbane to the sparsely populated remote regions of outback Australia. YD07 provided training materials for would-be citizen journalists and encouraged them to contribute electorate profiles, interview candidates, and conduct vox-pops with citizens in their local area. The site developed a strong following especially in its home state of Queensland, and its interviewers influenced national public debate by uncovering the sometimes controversial personal views of mainstream and fringe candidates. At the same time, the success of YD07 was limited by external constraints determined by campaign timing and institutional frameworks. As part of a continuing action research cycle, lessons learnt from Youdecide2007.org are going to be translated into further iterations of the project, which will cover the local government elections in the Australian state of Queensland, to be held in March 2008, and developments subsequent to these elections. This paper will present research outcomes from the Youdecide2007.org project. In particular, it will examine the roles of staff contributors and citizen journalists in attracting members, providing information, promoting discussion, and fostering community on the site: early indications from a study of interaction data on the site indicate notably different contribution patterns and effects for staff and citizen participants, which may point towards the possibility of developing more explicit pro-am collaboration models in line with the Pro-Am phenomenon outlined by Leadbeater & Miller (2004). The paper will outline strengths and weaknesses of the Youdecide model and highlight requirements for the successful development of active citizen journalism communities. In doing so, it will also evaluate the feasibility of hyperlocal citizen journalism approaches, and their interrelationship with broader regional, state, and national journalism in both its citizen and industrial forms.

AITPM Email Newsletter Volume 0909, September 2009: Presidents Message

President’s Message Hello fellow AITPM members, A few weeks have now passed since our 2009 AITPM National Conference, Traffic Beyond Tomorrow, which was held at the Adelaide Convention Centre from 5 to 7 August. I personally had a most enjoyable and enriching time at the Conference and felt these same “vibes” all around me. Top marks go to the South Australia organising committee, convened by Andrew Leedham, for their dedication to this our flagship event for the year. I could go on to cite my highlights but there were too many to give due diligence here. I had a number of official functions to perform at the Conference, but one in particular worth mentioning was being interviewed by radio stations 5AA, the main news/talk commercial broadcaster in Adelaide, and 891 ABC Adelaide. All interviewers were focussed on the issue of congestion charging, which is interesting in its emergence as a public conversation piece. My main responses focussed on the importance of providing alternatives for travel to the motorist otherwise being charged by a scheme, if and when decisions were made to implement congestion charging. I found that these opportunities to present AITPM as a professional peak body were very fruitful. The Queensland organising committee is now in full swing organising the 2010 AITPM National Conference, What’s New?, so please keep a lookout for related content. You’ll also find within this edition a transcript of my President’s Report to the 2009 AITPM National Annual General Meeting, which was held during the Adelaide Conference. Best regards to all, Jon Bunker