Consulting pupils in Assessment for Learning classrooms: the twists and turns of working with students as co-researchers

This is an invited paper to a special issue on pupil voice focusing on methodological issues arising from the ESRC/TLRP project on consulting pupils about assessment practices in their classrooms. The issue of consulting pupils about assessment has rarely been researched before but what this article illustrates are some of the difficulties, tensions and positive outcomes of engaging with students as researchers within a nationally funded (and therefore externally driven), university-based project. This study adds considerably to the body of knowledge in this area by engaging students in the process as researchers in different capacities within the project. Issues discussed include the use of student advisory groups, ethical negotiation, students undertaking videotaped classroom observations and their subsequent role in co-interpreting video excerpts and visual images. The paper has attracted considerable interest already through the ESRC pupil seminar series forum and also from a prior paper presentation to the European Educational Research Association in September 2006 in Switzerland to the Childrens' Rights SIG becasue of researchers' current interests in embedding democratic principles and practices within research with children and young people.

Voice disorders in children and its relationship with auditory, acoustic and vocal behavior parameters

Objective: Parameters to distinguish normal from deviant voices in early childhood have not been established. The current study sought to auditorily and acoustically characterize voices of children, and to study the relationship between vocal behavior reported by teachers and the presence of vocal aberrations. Methods: One hundred children between four and 6 years and 11 months, who attended early childhood educational institutions, were included. The sample comprised 50 children with normal voices (NVG) and 50 with deviant voices (DVG) matched by gender and age. All participants were submitted to auditory and acoustic analysis of vocal quality and had their vocal behaviors assessed by teachers through a specific protocol. Results: DVG had a higher incidence of breathiness (p < 0.001) and roughness (p < 0.001), but not vocal strain (p = 0.546), which was similar in both groups. The average F-0 was lower in the DVG and a higher noise component was observed in this group as well. Regarding the protocol used "Aspects Related to Phonotrauma - Children's Protocol", higher means were observed for children from DVG in all analyzed aspects and also on the overall means (DVG = 2.15; NVG = 1.12, p < 0.001). In NVG, a higher incidence of vocal behavior without alterations or with discrete alterations was observed, whereas a higher incidence of moderate, severe or extreme alterations of vocal behavior was observed in DVG. Conclusions: Perceptual assessment of voice, vocal acoustic parameters (F-0, noise and GNE), and aspects related to vocal trauma and vocal behavior differentiated the groups of children with normal voice and deviant voice. (C) 2012 Elsevier Ireland Ltd. All rights reserved.

But, where are the children?

We examine the position and positioning of children in leadership studies through describing a project where we have worked with children as researchers and policymakers. The research group that we are a part of is located in a successful secondary school, and we have worked together over the past two years to find out more about student and staff perceptions of bullying with a view to developing and implementing a revised school policy. We examine the findings from this work, and show how it challenges current notions regarding pupil voice, and how the potential exists to think differently about what leadership is and how it is practiced.

Self-perception, complaints and vocal quality among undergraduate students enrolled in a Pedagogy course

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)

How do laryngeal and respiratory functions contribute to differentiate actors/actresses and untrained voices?

Purpose. The present study aimed to compare actors/actresses's voices and vocally trained subjects through aerodynamic and electroglottographic (EGG) analyses. We hypothesized that glottal and breathing functions would reflect technical and physiological differences between vocally trained and untrained subjects.Methods. Forty participants with normal voices participated in this study (20 professional theater actors and 20 untrained participants). In each group, 10 male and 10 female subjects were assessed. All participants underwent aerodynamic and EGG assessment of voice. From the Phonatory Aerodynamic System, three protocols were used: comfortable sustained phonation with EGG, voice efficiency with EGG, and running speech. Contact quotient was calculated from EGG. All phonatory tasks were produced at three different loudness levels. Mean sound pressure level and fundamental frequency were also assessed. Univariate, multivariate, and correlation statistical analyses were performed.Results. Main differences between vocally trained and untrained participants were found in the following variables: mean sound pressure level, phonatory airflow, subglottic pressure, inspiratory airflow duration, inspiratory airflow, and inspiratory volume. These variables were greater for trained participants. Mean pitch was found to be lower for trained voices.Conclusions. The glottal source seemed to have a weak contribution when differentiating the training status in speaking voice. More prominent changes between vocally trained and untrained participants are demonstrated in respiratory-related variables. These findings may be related to better management of breathing function (better breath support).

Impacto de treinamento auditivo na avaliação perceptivo-auditiva da voz realizada por estudantes de Fonoaudiologia

OBJETIVO: Analisar o impacto de treino auditivo na avaliação perceptivo-auditiva da voz realizada por estudantes de Fonoaudiologia. MÉTODOS: Durante dois semestres, 17 estudantes que cursavam disciplinas teóricas de fonação (Fonação/Distúrbios da Fonação) analisaram amostras de vozes alteradas e não alteradas (selecionadas para este estudo), por meio da escala GRBAS. Todos receberam treinamento auditivo durante um total de nove encontros semanais, com cerca de 15 minutos de duração cada. Em cada encontro foi apresentado um parâmetro, por meio de vozes diferentes da amostra avaliada, com predominância no aspecto treinado. A avaliação das amostras por meio da escala foi realizada pré e pós o treinamento e em outros quatro momentos ao longo dos encontros. As avaliações dos alunos foram comparadas com uma avaliação de juízas, realizada previamente por três fonoaudiólogos, especialistas em voz. Para verificar a efetividade do treinamento foi usado o teste de Friedman e Índice de Concordância Kappa. RESULTADOS: O índice de acertos dos alunos no momento pré-treinamento foi considerado entre regular e bom. Observou-se manutenção do número de acertos ao longo das avaliações realizadas, para a maioria dos parâmetros da escala. No momento pós-treinamento observou-se melhora na análise da astenia, parâmetro enfatizado a partir das dificuldades apresentadas pelos alunos. Houve diminuição dos acertos no parâmetro rugosidade após este ter sido trabalhado de maneira segmentada em rouquidão e aspereza, e associado a diferentes diagnósticos e parâmetros acústicos. CONCLUSÃO: O treino auditivo potencializa as habilidades iniciais dos alunos, refinando-as para realização da avaliação, além de nortear ajustes em dinâmicas das disciplinas.

Ensino da avaliação perceptivoauditiva da voz por meio de um ambiente virtual de aprendizagem

A avaliação vocal é realizada predominantemente por meio da avaliação perceptivoauditiva, sendo dependente de conhecimentos teóricos prévios e de treinamento prático e dinâmico. Entretanto, ainda são escassas as iniciativas educacionais que se utilizam das novas tecnologias para o ensino da avaliação perceptivoauditiva da voz. A utilização de estratégias com novas tecnologias de informação e comunicação, hoje tão presentes e familiarizadas no meio universitário, apresentam o intuito de facilitar e otimizar o processo de ensino e aprendizagem. Desta forma, este estudo teve o propósito de elaborar e avaliar um curso a distância em um ambiente virtual de aprendizagem sobre essa temática. Elaborou-se um curso a distância sobre a avaliação perceptivoauditiva da voz organizado em quatro módulos principais: 1. Noções básicas de anatomia e fisiologia da fonação; 2. Ouvindo vozes; 3. Avaliação perceptivoauditiva da voz e 4. Aplicabilidade da avaliação perceptivoauditiva da voz, além de um adicional com vídeos sobre curiosidades e sugestão de material complementar para estudo. O ambiente virtual de aprendizagem (AVA) também apresentou diversas ferramentas educacionais como textos, imagens ilustrativas, videoaulas, vídeos, arquivos de áudio, atividades práticas individuais, fóruns, além de recursos de interatividade entre alunos e tutora. Este material foi antecipadamente avaliado por três especialistas que avaliaram o material positivamente como uma inovadora e importante ferramenta educacional que poderá ser utilizada na formação de estudantes na área de voz. Foram convidados a participar do curso a distância, 133 alunos do 1o ao 4o ano de um curso de graduação em Fonoaudiologia de uma Universidade do interior paulista. Concordaram em participar 33 estudantes e desses, nove concluíram o curso. Os alunos responderam a avaliações de conteúdo nos momentos pré e pós-curso, de forma presencial e a avaliações de cada módulo, realizadas por meio de questões específicas e atividades práticas, no próprio site. Ao término do curso os alunos também responderam a uma avaliação motivacional do AVA. Observou-se diferença estatisticamente significante na média de acertos nas provas pré e pós-curso dos alunos, nas questões teóricas (p= 0,031), nas práticas (p=0,000) e no total (p=0,002), demonstrando que o material elaborado foi capaz de aumentar o conhecimento dos estudantes a respeito de seu tema. O AVA apresentou alto índice de satisfação motivacional e foi avaliado por todos os participantes como um curso impressionante, de acordo com o instrumento de avaliação motivacional utilizado. Conclui-se que foi possível elaborar um ambiente virtual de aprendizagem (AVA), em formato de curso a distância, sobre a temática da avaliação perceptivoauditiva da voz e que o material elaborado apresenta um importante potencial de ensino e aprendizagem sobre esse tema.

An innovative approach to the assessment of nutrient intake in adults with type 2 diabetes : the development, trial and evaluation of a mobile phone photo/voice dietary record

Nutrition interventions in the form of both self-management education and individualised diet therapy are considered essential for the long-term management of type 2 diabetes mellitus (T2DM). The measurement of diet is essential to inform, support and evaluate nutrition interventions in the management of T2DM. Barriers inherent within health care settings and systems limit ongoing access to personnel and resources, while traditional prospective methods of assessing diet are burdensome for the individual and often result in changes in typical intake to facilitate recording. This thesis investigated the inclusion of information and communication technologies (ICT) to overcome limitations to current approaches in the nutritional management of T2DM, in particular the development, trial and evaluation of the Nutricam dietary assessment method (NuDAM) consisting of a mobile phone photo/voice application to assess nutrient intake in a free-living environment with older adults with T2DM. Study 1: Effectiveness of an automated telephone system in promoting change in dietary intake among adults with T2DM The effectiveness of an automated telephone system, Telephone-Linked Care (TLC) Diabetes, designed to deliver self-management education was evaluated in terms of promoting dietary change in adults with T2DM and sub-optimal glycaemic control. In this secondary data analysis independent of the larger randomised controlled trial, complete data was available for 95 adults (59 male; mean age(±SD)=56.8±8.1 years; mean(±SD)BMI=34.2±7.0kg/m2). The treatment effect showed a reduction in total fat of 1.4% and saturated fat of 0.9% energy intake, body weight of 0.7 kg and waist circumference of 2.0 cm. In addition, a significant increase in the nutrition self-efficacy score of 1.3 (p<0.05) was observed in the TLC group compared to the control group. The modest trends observed in this study indicate that the TLC Diabetes system does support the adoption of positive nutrition behaviours as a result of diabetes self-management education, however caution must be applied in the interpretation of results due to the inherent limitations of the dietary assessment method used. The decision to use a close-list FFQ with known bias may have influenced the accuracy of reporting dietary intake in this instance. This study provided an example of the methodological challenges experienced with measuring changes in absolute diet using a FFQ, and reaffirmed the need for novel prospective assessment methods capable of capturing natural variance in usual intakes. Study 2: The development and trial of NuDAM recording protocol The feasibility of the Nutricam mobile phone photo/voice dietary record was evaluated in 10 adults with T2DM (6 Male; age=64.7±3.8 years; BMI=33.9±7.0 kg/m2). Intake was recorded over a 3-day period using both Nutricam and a written estimated food record (EFR). Compared to the EFR, the Nutricam device was found to be acceptable among subjects, however, energy intake was under-recorded using Nutricam (-0.6±0.8 MJ/day; p<0.05). Beverages and snacks were the items most frequently not recorded using Nutricam; however forgotten meals contributed to the greatest difference in energy intake between records. In addition, the quality of dietary data recorded using Nutricam was unacceptable for just under one-third of entries. It was concluded that an additional mechanism was necessary to complement dietary information collected via Nutricam. Modifications to the method were made to allow for clarification of Nutricam entries and probing forgotten foods during a brief phone call to the subject the following morning. The revised recording protocol was evaluated in Study 4. Study 3: The development and trial of the NuDAM analysis protocol Part A explored the effect of the type of portion size estimation aid (PSEA) on the error associated with quantifying four portions of 15 single foods items contained in photographs. Seventeen dietetic students (1 male; age=24.7±9.1 years; BMI=21.1±1.9 kg/m2) estimated all food portions on two occasions: without aids and with aids (food models or reference food photographs). Overall, the use of a PSEA significantly reduced mean (±SD) group error between estimates compared to no aid (-2.5±11.5% vs. 19.0±28.8%; p<0.05). The type of PSEA (i.e. food models vs. reference food photograph) did not have a notable effect on the group estimation error (-6.7±14.9% vs. 1.4±5.9%, respectively; p=0.321). This exploratory study provided evidence that the use of aids in general, rather than the type, was more effective in reducing estimation error. Findings guided the development of the Dietary Estimation and Assessment Tool (DEAT) for use in the analysis of the Nutricam dietary record. Part B evaluated the effect of the DEAT on the error associated with the quantification of two 3-day Nutricam dietary records in a sample of 29 dietetic students (2 males; age=23.3±5.1 years; BMI=20.6±1.9 kg/m2). Subjects were randomised into two groups: Group A and Group B. For Record 1, the use of the DEAT (Group A) resulted in a smaller error compared to estimations made without the tool (Group B) (17.7±15.8%/day vs. 34.0±22.6%/day, p=0.331; respectively). In comparison, all subjects used the DEAT to estimate Record 2, with resultant error similar between Group A and B (21.2±19.2%/day vs. 25.8±13.6%/day; p=0.377 respectively). In general, the moderate estimation error associated with quantifying food items did not translate into clinically significant differences in the nutrient profile of the Nutricam dietary records, only amorphous foods were notably over-estimated in energy content without the use of the DEAT (57kJ/day vs. 274kJ/day; p<0.001). A large proportion (89.6%) of the group found the DEAT helpful when quantifying food items contained in the Nutricam dietary records. The use of the DEAT reduced quantification error, minimising any potential effect on the estimation of energy and macronutrient intake. Study 4: Evaluation of the NuDAM The accuracy and inter-rater reliability of the NuDAM to assess energy and macronutrient intake was evaluated in a sample of 10 adults (6 males; age=61.2±6.9 years; BMI=31.0±4.5 kg/m2). Intake recorded using both the NuDAM and a weighed food record (WFR) was coded by three dietitians and compared with an objective measure of total energy expenditure (TEE) obtained using the doubly labelled water technique. At the group level, energy intake (EI) was under-reported to a similar extent using both methods, with the ratio of EI:TEE was 0.76±0.20 for the NuDAM and 0.76±0.17 for the WFR. At the individual level, four subjects reported implausible levels of energy intake using the WFR method, compared to three using the NuDAM. Overall, moderate to high correlation coefficients (r=0.57-0.85) were found across energy and macronutrients except fat (r=0.24) between the two dietary measures. High agreement was observed between dietitians for estimates of energy and macronutrient derived for both the NuDAM (ICC=0.77-0.99; p<0.001) and WFR (ICC=0.82-0.99; p<0.001). All subjects preferred using the NuDAM over the WFR to record intake and were willing to use the novel method again over longer recording periods. This research program explored two novel approaches which utilised distinct technologies to aid in the nutritional management of adults with T2DM. In particular, this thesis makes a significant contribution to the evidence base surrounding the use of PhRs through the development, trial and evaluation of a novel mobile phone photo/voice dietary record. The NuDAM is an extremely promising advancement in the nutritional management of individuals with diabetes and other chronic conditions. Future applications lie in integrating the NuDAM with other technologies to facilitate practice across the remaining stages of the nutrition care process.

Assessment of police subjective workload and preference for using a voice-based interface during simulated driving

Police in-vehicle systems include a visual output mobile data terminal (MDT) with manual input via touch screen and keyboard. This study investigated the potential for voice-based input and output modalities for reducing subjective workload of police officers while driving. Nineteen experienced drivers of police vehicles (one female) from New South Wales (NSW) Police completed four simulated urban drives. Three drives included a concurrent secondary task: an imitation licence number search using an emulated MDT. Three different interface output-input modalities were examined: Visual-Manual, Visual-Voice, and Audio-Voice. Following each drive, participants rated their subjective workload using the NASA - Raw Task Load Index and completed questions on acceptability. A questionnaire on interface preferences was completed by participants at the end of their session. Engaging in secondary tasks while driving significantly increased subjective workload. The Visual-Manual interface resulted in higher time demand than either of the voice-based interfaces and greater physical demand than the Audio-Voice interface. The Visual-Voice and Audio-Voice interfaces were rated easier to use and more useful than the Visual-Manual interface, although not significantly different from each other. Findings largely echoed those deriving from the analysis of the objective driving performance data. It is acknowledged that under standard procedures, officers should not drive while performing tasks concurrently with certain invehicle policing systems; however, in practice this sometimes occurs. Taking action now to develop voice-based technology for police in-vehicle systems has potential to realise visions for potentially safer and more efficient vehicle-based police work.

The effect of feedback from pupil to teacher on assessment for leaning and visible learning: An ethnographic case study in a community school in England and the outcome in a state high school in Queensland, Australia

This study shows that there is positive regulatory effect of feedback from pupils to teachers on Assessment for Learning (AfL), classroom proactiveness, and on visible and progressive learning but not on behaviour. This research finding further articulates feedback from pupil to teacher as a paradigm shift from the classical paradigm of feedback from teacher to pupil. Here, the emphasis is geared towards pupils understanding of objectives built from previous knowledge. These are then feedback onto the teachers by the pupils in the form of discrete loops of cues and questions, where they are with their learning. This therefore enables them to move to the next level of understanding, and thus acquired independence, which in turn is reflected by their success in both formative and summative assessments. This study therefore shows that when feedback from pupil to teacher is used in combination with teacher to pupil feedback, AfL is ameliorated and hence, visible and accelerated learning occurs in a gender, nor subject non-dependent manner.