Learning outcomes tracking system (L.O.T.S):seeing student progress as term progresses

At QUB we have constructed a system that allows students to self-assess their capability on the fine grained learning outcomes for a module and to update their record as the term progresses. In the system each of the learning outcomes are linked to the relevant teaching session (lectures and labs) and to [online] resources that students can access at any time. Students can structure their own learning experience to their needs to attain the learning outcomes. The system keeps a history of the student’s record, allowing the lecturer to observe how the students’ abilities progress over the term and to compare it to assessment results. The system also keeps of any of the resource links that student has clicked on.

Do Cochrane summaries help student midwives understand the findings of Cochrane systematic reviews: the BRIEF randomised trial

BACKGROUND: Abstracts and plain language summaries (PLS) are often the first, and sometimes the only, point of contact between readers and systematic reviews. It is important to identify how these summaries are used and to know the impact of different elements, including the authors' conclusions. The trial aims to assess whether (a) the abstract or the PLS of a Cochrane Review is a better aid for midwifery students in assessing the evidence, (b) inclusion of authors' conclusions helps them and (c) there is an interaction between the type of summary and the presence or absence of the conclusions.

METHODS: Eight hundred thirteen midwifery students from nine universities in the UK and Ireland were recruited to this 2 × 2 factorial trial (abstract versus PLS, conclusions versus no conclusions). They were randomly allocated to one of four groups and asked to recall knowledge after reading one of four summary formats of two Cochrane Reviews, one with clear findings and one with uncertain findings. The primary outcome was the proportion of students who identified the appropriate statement to describe the main findings of the two reviews as assessed by an expert panel.

RESULTS: There was no statistically significant difference in correct response between the abstract and PLS groups in the clear finding example (abstract, 59.6 %; PLS, 64.2 %; risk difference 4.6 %; CI -0.2 to 11.3) or the uncertain finding example (42.7 %, 39.3 %, -3.4 %, -10.1 to 3.4). There was no significant difference between the conclusion and no conclusion groups in the example with clear findings (conclusions, 63.3 %; no conclusions, 60.5 %; 2.8 %; -3.9 to 9.5), but there was a significant difference in the example with uncertain findings (44.7 %; 37.3 %; 7.3 %; 0.6 to 14.1, p = 0.03). PLS without conclusions in the uncertain finding review had the lowest proportion of correct responses (32.5 %). Prior knowledge and belief predicted student response to the clear finding review, while years of midwifery education predicted response to the uncertain finding review.

CONCLUSIONS: Abstracts with and without conclusions generated similar student responses. PLS with conclusions gave similar results to abstracts with and without conclusions. Removing the conclusions from a PLS with uncertain findings led to more problems with interpretation.

An evaluation of the Socrative (personal response system) app for increasing student engagement and learning in an undergraduate psychology curriculum.

Personal response systems using hardware such as 'clickers' have been around for some time, however their use is often restricted to multiple choice questions (MCQs) and they are therefore used as a summative assessment tool for the individual student. More recent innovations such as 'Socrative' have removed the need for specialist hardware, instead utilising web-based technology and devices common to students, such as smartphones, tablets and laptops. While improving the potential for use in larger classrooms, this also creates the opportunity to pose more engaging open-response questions to students who can 'text in' their thoughts on questions posed in class. This poster will present two applications of the Socrative system in an undergraduate psychology curriculum which aimed to encourage interactive engagement with course content using real-time student responses and lecturer feedback. Data is currently being collected and result will be presented at the conference.
The first application used Socrative to pose MCQs at the end of two modules (a level one Statistics module and level two Individual Differences Psychology module, class size N≈100), with the intention of helping students assess their knowledge of the course. They were asked to rate their self-perceived knowledge of the course on a five-point Likert scale before and after completing the MCQs, as well as their views on the value of the revision session and any issues that had with using the app. The online MCQs remained open between the lecture and the exam, allowing students to revisit the questions at any time during their revision.
This poster will present data regarding the usefulness of the revision MCQs, the metacognitive effect of the MCQs on student's judgements of learning (pre vs post MCQ testing), as well as student engagement with the MCQs between the revision session and the examination. Student opinions on the use of the Socrative system in class will also be discussed.
The second application used Socrative to facilitate a flipped classroom lecture on a level two 'Conceptual Issues in Psychology' module, class size N≈100). The content of this module requires students to think critically about historical and contemporary conceptual issues in psychology and the philosophy of science. Students traditionally struggle with this module due to the emphasis on critical thinking skills, rather than simply the retention of concrete knowledge. To prepare students for the written examination, a flipped classroom lecture was held at the end of the semester. Students were asked to revise their knowledge of a particular area of Psychology by assigned reading, and were told that the flipped lecture would involve them thinking critically about the conceptual issues found in this area. They were informed that questions would be posed by the lecturer in class, and that they would be asked to post their thoughts using the Socrative app for a class discussion. The level of preparation students engaged in for the flipped lecture was measured, as well as qualitative opinions on the usefulness of the session. This poster will discuss the level of student engagement with the flipped lecture, both in terms of preparation for the lecture, and engagement with questions posed during the lecture, as well as the lecturer's experience in facilitating the flipped classroom using the Socrative platform.

Assessing the evidence: Student response system versus computer based testing for undertaking multiple choice question assessment in undergraduate nursing education

There is a dearth of evidence focusing on student preferences for computer-based testing versus
testing via student response systems for summative assessment in undergraduate education.
This quantitative study compared the preference and acceptability of computer-based testing
and a student response system for completing multiple choice questions in undergraduate
nursing education. After using both computer-based testing and a student response system to
complete multiple choice questions, 192 first year undergraduate nursing students rated their
preferences and attitudes towards using computer-based testing and a student response system.
Results indicated that seventy four percent felt the student response system was easy to use.
Fifty six percent felt the student response system took more time than the computer-based testing
to become familiar with. Sixty Percent felt computer-based testing was more users friendly.
Seventy Percent of students would prefer to take a multiple choice question summative exam
via computer-based testing, although Fifty percent would be happy to take using student response
system. Results are useful for undergraduate educators in relation to student’s preference
for using computer-based testing or student response system to undertake a summative
multiple choice question exam

STUDENT’ S ENGAGEMENT IN SCHOOL: A LITERATURE REVIEW

Students’ Engagement in School has been the focus of debate concerning academic success and school dropout, and pointed out as a mean to address the problems affecting our schools and their students, not only for having value in itself, but also for being an important mediator between several academic variables. This paper reviews the research and literature on this concept and its relations with personal and contextual variables, as well as with academic performance, with the aim of summarizing the main relationships found. Literature presents a significant number of studies which sustain that personal variables, such as self-efficacy and self-concept, as well as contextual - peers, school, family- are related with school engagement. The adoption of mastery goals, for instance, has a positive impact on school, as they are related with the use of cognitive and self-regulatory strategies by students. Positive relationships with peers, teachers support and the quality of family relations are associated with higher levels of engagement and academic performance, while negative experiences, such as bullying, are related with educational difficulties. Following this, we reflect about the relevance of studying engagement in school, in the context of widespread financial crisis, and emphasize the need to rethink educational institutions considering the paradigmatic changes that currently occur.

Students´ Engagement In Schools: Differentiation and Promotion

The objective of this work is to present elements of the project Student engagement in Schools (SES). The team consists of 10 researchers from six Universities. Student engagement in schools is a multidimensional construct that unites affective, behavioural, and cognitive dimensions of student adaptation in the school and has influence on students‘outcomes. The team of researchers conceptualized two major studies, a differential study to analyze the relations between SES and contextual factors, personal factors, student’s outcomes, and a quasi-experimental study to analyze the effects on SES of a specific intervention programmes. In study 1, the sample size is around 600 students (150 6th graders, 150 7th graders, 150 9th graders, and 150 10th graders). We shall focus on years of school transition, with rural and urban populations, on different regions of the country, and on students with different family background. We shall conduct questionnaires with national and international scales. The study 2 will involve students in 7th and 9th grade, from four classes, two of the experimental group and two of the control group. Patterns of verbal communications between a teacher and students can influence the classroom environment and SES. This model of communication would result in more effective student management and more time on-task for learning.

Language anxiety in English teachers during their teaching practice

Este estudo explora a influência da ansiedade linguística em futuros professores de Inglês em situação de prática pedagógica. Setting the Scene descreve o aumento de interesse pela ansiedade linguística por parte dos investigadores no contexto da aprendizagem e do ensino, e a relevância desta questão para professores estagiários fazendo a transição de aluno para professor. O autor também considera a sua própria experiência de ansiedade – enquanto estudante e investigador – de modo a gerar um maior entendimento desta emoção complexa. O Capítulo 1 da Parte 1 descreve como o afecto na aprendizagem e na investigação da língua tem vindo a ser um factor preponderante no interesse mais alargado sobre as emoções em contextos educacionais. A recente influência da teoria social na aquisição de uma segunda língua e como esta pode ajudar a repensar a investigação das emoções é discutida antes do final do capítulo, onde se examina ainda como as emoções são expressas na comunicação e interacção. O Capítulo 2 concentra-se na ansiedade na aprendizagem da língua e em como o peso da noção em contexto social alargado tem provavelmente influenciado uma abordagem dominantemente de cariz positivista na investigação sobre a ansiedade linguística. Controvérsias e variáveis da personalidade relacionadas com a ansiedade linguística são discutidas, considerando-se a possibilidade de novas direcções para a investigação. A prática pedagógica é vista como um campo fértil de investigação sobre a ansiedade linguística em estagiários, com estilos de supervisão e discursos – nomeadamente estratégias de delicadeza e de mitigação – sendo considerados influências importantes na experiência desta emoção. O Capítulo 3 da Parte 2 detalha a abordagem etnográfica e etnometodológica do estudo e o procedimento de investigação em si. Os dados foram recolhidos em três momentos distintos. Primeiro, através de inquéritos aplicados aos estagiários antes do começo do estágio. Numa segunda fase, durante o estágio, os dados principais foram recolhidos através das aulas e duma entrevista semi-estruturada com os estagiários, ambas vídeo gravadas, e dos encontros de pós-observação áudio-gravados. Os dados subsidiários recolhidos nesta mesma fase incluem reflexões escritas e dossiers dos estagiários, observações escritas das aulas do investigador e o relatório intercalar dos professores supervisor e cooperante. Na última fase, posterior às aulas, a recolha dos dados principais foi realizada através de uma vídeo gravação da reunião de avaliação final com todos os participantes e de stimulated recall protocols com cada professor estagiário. O Capítulo 4 é predominantemente uma análise qualitativa de discurso, utilizando categorias de análise para identificar sinais de ansiedade emergentes dos dados. Os resultados mostram que um dos estagiários pode ser caracterizado como tendo uma experiência de ansiedade mais debilitadora, outro uma ansiedade mais facilitadora, enquanto a experiência do terceiro é menos pronunciada e mais difícil de caracterizar. Sinais e fontes múltiplos e complexos de ansiedade foram identificados mas as próprias autoimagens dos sujeitos como professores de Inglês, construídas em interacção ao longo do estágio, estão no centro desta experiência emocional. O Capítulo 5 considera as implicações e as conclusões deste estudo. São dadas indicações para a relação estagiário-supervisor e quanto aos estilos do supervisor no quadro da prática pedagógica assim como sugestões para que a ansiedade linguística seja explicitamente abordada na formação em supervisão. Finalmente, é ponderada se a experiência da ansiedade linguística destas estagiárias e as suas fontes têm ou não implicações na formação dos alunos de línguas.

Autonomy in English language learning: a case study

The main goal of this study was to analyse the development of a pedagogy for autonomy tuned to the current situation in which Higher Education finds itself, namely of implementation of the Bologna Process in Europe, and in particular at the Escola Superior Agrária of the Polytechnic School at Coimbra. For this purpose new course units were created, new descriptors written, new materials developed and new methodologies tried. A case study was undertaken to observe and analyse the changes the institution was undergoing and to assess the impact of the new methodologies, particularly regarding the development of student autonomy. The target population for this study were the first year students on the Biotechnology degree in the year 2007/2008, to whom a battery of tests were applied, namely proficiency tests, belief tests, metacognitive tests, as well as methods of ethnographic research. The study relied on the European Framework of Reference for Languages and the European Language Portfolio to establish recognised levels and competences, and employed the portfolio as its main tool for measuring student autonomy. This portfolio was simultaneously biographical and descriptive and was organised by the students in their own time. Great incentive was given to this independent work. The ethnographic component of the study was of significant importance being given to students learning histories and to the collection of students’ reflections. This component aimed in particular to allow students the opportunity to express their thoughts on the experience they underwent during 20 weeks. From the analysis of the data, a significant improvement in self-confidence and motivation for lifelong learning is observable in the development of multiple tasks. Regarding the students’ progression towards proficiency, this improvement is less clear, but the final results of educational success were generally of great relevance.

Educação em ciências em contexto pré-escolar: estratégias didáticas para o desenvolvimento de competências

Existe um crescente reconhecimento nacional e internacional do papel da Educação Pré-Escolar (EPE) no desenvolvimento e aprendizagem das crianças dos 3 aos 6 anos. As mais recentes orientações curriculares de diversos países para este nível de educação definem linhas de orientação para as aprendizagens das crianças que contemplam uma área das ciências. Em Portugal as Orientações Curriculares para a Educação Pré-Escolar (OCEPE) constituem-se como eixo estruturante das práticas didático-pedagógicas dos educadores. Este documento integra várias áreas de conteúdo, sendo a sensibilização às ciências considerada na área de Conhecimento do Mundo. A perspetiva que defende a educação em ciências (EC) desde os primeiros anos de escolaridade tem vindo a consolidar-se, dados os resultados alcançados em diversas investigações que demonstram que esta tem tido um impacte positivo relevante na promoção da literacia científica (LC), bem como no desenvolvimento de atitudes positivas face à ciência e à aprendizagem das ciências. Várias investigações, um pouco por todo o mundo, conferiram uma nova abrangência e profundidade à EC, tendo-se vindo a consolidar a ideia de que as crianças conseguem fazer construções cognitivas, ainda que elementares, acerca de fenómenos e conceitos alegadamente difíceis pela sua abstração e que também são muito competentes em processos de descoberta científica. O conceito de competência tem vindo a conquistar uma relevância cada vez mais acentuada nos contextos educativos, constituindo um pilar central em documentos curriculares de diversos níveis de ensino. Tem-se revelado vital na caracterização da interação dos indivíduos nas suas esferas pessoal, social e profissional. Concomitantemente, o caráter eminentemente científico e tecnológico das sociedades atuais exige cidadãos competentes e cientificamente literados, capazes de interagir com o mundo, sendo essa LC imprescindível para que as sociedades continuem a evoluir. Assumindo-se que a EC se implementa através de atividades práticas, importa conhecer formas específicas de abordar os conceitos e explorar os fenómenos com as crianças, em contexto de EPE. Os educadores devem ter acesso a estratégias didáticas (ED) especialmente concebidas para este nível de escolaridade, que suportem práticas inovadoras neste domínio e promovam a mobilização de competências científicas pelas crianças, contribuindo para a promoção da LC. A presente investigação pretende ser um contributo para a operacionalização da EC em contexto pré-escolar. O percurso de investigação desenvolvido, de natureza qualitativa, incidiu em dois focos estruturais que se consubstanciam nas suas duas grandes finalidades: (1) o desenvolvimento de ED para operacionalizar a EC, e (2) o desenvolvimento do quadro teórico referente à mobilização de competências pelas crianças e relativo ao processo de conceção de ED. Assim, o percurso investigativo suportou-se numa metodologia de Investigação Baseada em Design que integrou 15 fases multicontextuais articuladas entre si, envolvendo especialistas da área educativa e científica em processos cíclicos de design, produção, validação, revisão e avaliação das ED. A avaliação dos processos e produtos desta investigação efetuou-se tendo por base a análise dos dados recolhidos e o seu tratamento através de diversos métodos, técnicas e instrumentos, tendo possibilitado: (1) identificar as limitações das OCEPE nas suas linhas de orientação para a EC; (2) desenvolver um conjunto de ED validadas como instrumentos de inovação curricular e como instrumentos de mobilização e desenvolvimento de competências pelas crianças; (3) definir um Quadro de referência conceptual que permite clarificar as interações das crianças em termos de mobilização de capacidades e atitudes/valores e construção de conhecimento; (4) definir Princípios de conceção de estratégias didáticas que permitem replicar o seu processo de desenvolvimento, e (5) clarificar orientações para uma perspetiva integrada de EC. Assumindo-se como um contributo para impulsionar a educação em ciências em contexto pré-escolar, esta investigação fundamenta a necessidade de nela se investir de forma intencional, sistemática e contextualizada neste nível educativo.