A HARD PUSH FOR SOFT SKILLS: AN EXAMINATION OF POLICY AND RESEARCH ON NON-COGNITIVE SKILLS IN CANADIAN K-12 SCHOOLING

Non-cognitive skills have caught the attention of current education policy writers in Canada. Within the last 10 years, almost every province has produced a document including the importance of supporting non-cognitive skills in K-12 students in the classroom. Although often called different names (such as learning skills, cross curricular competencies, and 20th Century Skills) and occasionally viewed through different lenses (such as emotional intelligence skills, character skills, and work habits), what unifies non-cognitive skills within the policy documents is the claim that students that are strong in these skills are more successful in academic achievement and are more successful in post-secondary endeavors. Though the interest from policy-makers and educators is clear, there are still many questions about non-cognitive skills that have yet to be answered. These include: What skills are the most important for teacher’s to support in the classroom? What are these skills’ exact contributions to student success? How can teachers best support these skills? Are there currently reliable and valid measures of these skills? These are very important questions worth answering if Canadian teachers are expected to support non-cognitive skills in their classrooms with an already burdened workload. As well, it can begin to untangle the plethora of research that exists within the non-cognitive realm. Without a critical look at the current literature, it is impossible to ensure that these policies are effective in Canadian classrooms, and to see an alignment between research and policy. Upon analysis of Canadian curriculum, five non-cognitive skills were found to be the most prevalent among many of the provinces: Self-Regulation, Collaboration, Initiative, Responsibility and Creativity. The available research literature was then examined to determine the utility of teaching these skills in the classroom (can students improve on these skills, do these skills impact other aspects of students’ lives, and are there methods to validly and reliably assess these skills). It was found that Self-Regulation and Initiative had the strongest basis for being implemented in the classroom. On the other hand, Creativity still requires a lot more justification in terms of its impact on students’ lives and ability to assess in the classroom.

A First Step Towards Synthesising Rubrics and Video for the Formative Assessment of Complex Skills

Abstract. The performance objectives used for the formative assessment of com- plex skills are generally set through text-based analytic rubrics[1]. Moreover, video modeling examples are a widely applied method of observational learning, providing students with context-rich modeling examples of complex skills that act as an analogy for problem solving [1]. The purpose of this theoretical paper is to synthesize the components of video modeling and rubrics to support the formative assessment of complex skills. Based on theory, we argue that application of the developed Video Enhanced Rubrics (VER) fosters learners’ development of mental models, quality of provided feedback by various actors and finally, the learners mastery of complex skills.

Enhancing public speaking skills - an evaluation of the Presentation Trainer in the wild

Full paper presented at EC-TEL 2016

Viewbrics: Formative Assessment of Complex Skills with Video-Enhanced Rubrics (VER) in Dutch Secondary Education

To learn complex skills, like collaboration, learners need to acquire a concrete and consistent mental model of what it means to master this skill. If learners know their current mastery level and know their targeted mastery level, they can better determine their subsequent learning activities. Rubrics support learners in judging their skill performance as they provide textual descriptions of skills’ mastery levels with performance indicators for all constituent subskills. However, text-based rubrics have a limited capacity to support the formation of mental models with contextualized, time-related and observable behavioral aspects of a complex skill. This paper outlines the design of a study that intends to investigate the effect of rubrics with video modelling examples compared to text-based rubrics on skills acquisition and feedback provisioning. The hypothesis is that video-enhanced rubrics, compared to text based rubrics, will improve mental model formation of a complex skill and improve the feedback quality a learner receives (from e.g. teachers, peers) while practicing a skill, hence positively effecting final mastery of a skill.

A First Step Towards Video Enhanced Rubrics for the Formative Assessment of Complex Skills : A literature review and a plea

Paper presentation at the TEA2016 conference, Tallinn, Estonia.

A randomized controlled trial of an early-intervention, computer-based literacy program to boost phonological skills in 4- to 6-year-old children

Background: Many school-based interventions are being delivered in the absence of evidence of effectiveness (Snowling & Hulme, 2011, Br. J. Educ. Psychol., 81, 1).Aim: This study sought to address this oversight by evaluating the effectiveness of the commonly used the Lexia Reading Core5 intervention, with 4- to 6-year-old pupils in Northern Ireland.Sample: A total of 126 primary school pupils in year 1 and year 2 were screened on the Phonological Assessment Battery 2nd Edition (PhAB-2). Children were recruited from the equivalent year groups to Reception and Year 1 in England and Wales, and Pre-kindergarten and Kindergarten in North America.
Methods: A total of 98 below-average pupils were randomized (T0) to either an 8-week block (inline image = 647.51 min, SD = 158.21) of daily access to Lexia Reading Core5 (n = 49) or a waiting-list control group (n = 49). Assessment of phonological skills was completed at post-intervention (T1) and at 2-month follow-up (T2) for the intervention group only.
Results: Analysis of covariance which controlled for baseline scores found that the Lexia Reading Core5 intervention group made significantly greater gains in blending, F(1, 95) = 6.50, p = .012, partial η2 = .064 (small effect size) and non-word reading, F(1, 95) = 7.20, p = .009, partial η2 = .070 (small effect size). Analysis of the 2-month follow-up of the intervention group found that all group treatment gains were maintained. However, improvements were not uniform among the intervention group with 35% failing to make progress despite access to support. Post-hoc analysis revealed that higher T0 phonological working memory scores predicted improvements made in phonological skills.
Conclusions: An early-intervention, computer-based literacy program can be effective in boosting the phonological skills of 4- to 6-year-olds, particularly if these literacy difficulties are not linked to phonological working memory deficits.

Phonic skills mediate improved literacy outcomes in at-risk primary school children: results from the Ready-to-Learn Programme

Background
Learning to read is a key goal during primary school: reading difficulties may curtail children’s learning trajectories. Controversy remains regarding what types of interventions are effective for children at risk for academic failure, such as children in disadvantaged areas. We present data from a complex intervention to test the hypothesis that phonic skills and word recognition abilities are a pivotal and specific causal mechanism for the development of reading skills in children at risk for poorer literacy outcomes.
Method
Over 500 pupils across 16 primary schools took part in a Cluster Randomised Controlled Trial from school year 1 to year 3. Schools were randomly allocated to the intervention or the control arm. The intervention involved a literacy-rich after-school programme. Children attending schools in the control arm of the study received the curriculum normally provided. Children in both arms completed batteries of language, phonic skills, and reading tests every year. We used multilevel mediation models to investigate mediating processes between intervention and outcomes.
Findings
Children who took part in the intervention displayed improvements in reading skills compared to those in the control arm. Results indicated a significant indirect effect of the intervention via phonics encoding.
Discussion
The results suggest that the intervention was effective in improving reading abilities of children at risk, and this effect was mediated by improving children’s phonic skills. This has relevance for designing interventions aimed at improving literacy skills of children exposed to socio-economic disadvantage. Results also highlight the importance of methods to investigate causal pathways from intervention to outcomes.

Number comparison and number ordering as predictors of arithmetic performance in adults: Exploring the link between the two skills, and investigating the question of domain-specificity.

Recent evidence has highlighted the important role that number ordering skills play in arithmetic abilities (e.g., Lyons & Beilock, 2011). In fact, Lyons et al. (2014) demonstrated that although at the start of formal mathematics education number comparison skills are the best predictors of arithmetic performance, from around the age of 10, number ordering skills become the strongest numerical predictors of arithmetic abilities. In the current study we demonstrated that number comparison and ordering skills were both significantly related to arithmetic performance in adults, and the effect size was greater in the case of ordering skills. Additionally, we found that the effect of number comparison skills on arithmetic performance was partially mediated by number ordering skills. Moreover, performance on comparison and ordering tasks involving the months of the year was also strongly correlated with arithmetic skills, and participants displayed similar (canonical or reverse) distance effects on the comparison and ordering tasks involving months as when the tasks included numbers. This suggests that the processes responsible for the link between comparison and ordering skills and arithmetic performance are not specific to the domain of numbers. Finally, a factor analysis indicated that performance on comparison and ordering tasks loaded on a factor which included performance on a number line task and self-reported spatial thinking styles. These results substantially extend previous research on the role of order processing abilities in mental arithmetic.

The influence of socio-demographic, psychological and knowledge-related variables alongside perceived cooking and food skills abilities in the prediction of diet quality in adults: a nationally representative cross-sectional study

Background: Interventions to increase cooking skills (CS) and food skills (FS) as a route to improving overall diet are popular within public health. This study tested a comprehensive model of diet quality by assessing the influence of socio-demographic, knowledge- and psychological-related variables alongside perceived CS and FS abilities. The correspondence of two measures of diet quality further validated the Eating Choices Index (ECI) for use in quantitative research.
Methods: A cross-sectional survey was conducted in a quota-controlled nationally representative sample of 1049 adults aged 20–60 years drawn from the Island of Ireland. Surveys were administered in participants’ homes via computer-assisted personal interviewing (CAPI) assessing a range of socio-demographic, knowledge- and psychological-related variables alongside perceived CS and FS abilities. Regression models were used to model factors influencing diet quality. Correspondence between 2 measures of diet quality was assessed using chi-square and Pearson correlations.
Results: ECI score was significantly negatively correlated with DINE Fat intake (r = -0.24, p < 0.001), and ECI score was significantly positively correlated with DINE Fibre intake (r = 0.38, p < 0.001), demonstrating a high agreement. Findings indicated that males, younger respondents and those with no/few educational qualifications scored significantly lower on both CS and FS abilities. The relative influence of socio-demographic, knowledge, psychological variables and CS and FS abilities on dietary outcomes varied, with regression models explaining 10–20 % of diet quality variance. CS ability exerted the strongest relationship with saturated fat intake (β = -0.296, p < 0.001) and was a significant predictor of fibre intake (β = -0.113, p < 0.05), although not for healthy food choices (ECI) (β = 0.04, p > 0.05).
Conclusion: Greater CS and FS abilities may not lead directly to healthier dietary choices given the myriad of other factors implicated; however, CS appear to have differential influences on aspects of the diet, most notably in relation to lowering saturated fat intake. Findings suggest that CS and FS should not be singular targets of interventions designed to improve diet; but targeting specific sub-groups of the population e.g. males, younger adults, those with limited education might be more fruitful. A greater understanding of the interaction of factors influencing cooking and food practices within the home is needed.

Managerial skills required by innovative and technology-based firms

This paper aims to investigate the Business Administration professional profile specifically required to manage innovative and high technology-based companies. It is a qualitative study outlined by an exploratory-descriptive research, supported by questionnaires and interviews addressed to a sample of executives of technology-based companies, located in São Paulo metropolitan region, Brazil. Accordingly, modular innovation arises from the existence of an architectural knowledge improved in association with the conceptually destroyed knowledge's component, meaning that architectural innovation arises from an improvement in the knowledge of the parties allied to the architectural knowledge's destruction. Results show that managers see innovation as one essential pillar for competitiveness and commonly associate innovation with team expertise related with the structure for this purpose. However, to instill innovation as an organizational discipline, it is necessary to redesign organizational processes, namely those considered critical to innovate. The company must revise its management model aiming to emphasize innovative behavior, which means readiness to respond to external environment change's requirements. Moreover, once it is necessary to change the manager's mindset about innovation, higher education institutions also have to adapt their Business Administration courses according to both changes, essentially concerning a more dynamic and more diffuse business environment in comparison to their curricular contents. The institutional pragmatism generates professionals who reach the job market with a historical and non-managerial overview on innovation. Nevertheless, results highlight that attitude is more appreciated than knowledge, or business management skills, what makes managerial behavior a key element in the innovation process in technology-based firms.

Poor communication skills means high risk for aviation safety

Este artigo analisa diferentes tipos de comunicação no ambiente de negócios da aviação civil. Para tanto, utilizou-se uma abordagem qualitativa, delineada por análise documental dos relatórios das agencias governamentais. A comunicação é um sistema complexo que consiste em comunicação verbal, não verbal, escrita, falada e eletrônica. Na aviação, ela é um fator crucial ao enfrentamento de situações de alto risco. Os resultados obtidos indicam que lacunas de comunicação entre os indivíduos que atuam nas operações aeronáuticas e aeroviárias contribuem para a maior parte dos acidentes e incidentes ocorridos. As conclusões pontuam que as habilidades de comunicação são tão importantes quanto às habilidades técnicas e enfatizam a emergência do treinamento em habilidades de comunicação aos profissionais da aviação, possibilitando-os detectar ameaças e comunicar claramente a necessidade de apoio para o enfrentamento de riscos. É imperativo adotar as ações requeridas pela filosofia do Sistema de Gestão de Segurança, visando gerar comportamento seguro.

Social Skills Training in Flight Schools: A Proactive Tool for Management of Threats and Risks

Safety Management Systems in aviation generate training programs that develop skills needed to perform safety functions. The objective of this study is to show that, in groups, individuals need to have interpersonal skills and, in particular, ability to communicate with others, to listen, and to influence. It is for this reason that Social Skills Training is important in Aviation. Professionals trained in social skills are more likely to identify threats and risks caused by interpersonal situations, be assertive, and take appropriate action. As a contribution, this paper suggests a set of policies, procedures and practices for educating and training future professionals who will work in aviation safety.

Cognitive Component Skills of Reading Comprehension in Developing Readers

Die Fähigkeit, geschriebene Texte zu verstehen, d.h. eine kohärente mentale Repräsentation von Textinhalten zu erstellen, ist eine notwendige Voraussetzung für eine erfolgreiche schulische und außerschulische Entwicklung. Es ist daher ein zentrales Anliegen des Bildungssystems Leseschwierigkeiten frühzeitig zu diagnostizieren und mithilfe zielgerichteter Interventionsprogramme zu fördern. Dies erfordert ein umfassendes Wissen über die kognitiven Teilprozesse, die dem Leseverstehen zugrunde liegen, ihre Zusammenhänge und ihre Entwicklung. Die vorliegende Dissertation soll zu einem umfassenden Verständnis über das Leseverstehen beitragen, indem sie eine Auswahl offener Fragestellungen experimentell untersucht. Studie 1 untersucht inwieweit phonologische Rekodier- und orthographische Dekodierfertigkeiten zum Satz- und Textverstehen beitragen und wie sich beide Fertigkeiten bei deutschen Grundschüler(inne)n von der 2. bis zur 4. Klasse entwickeln. Die Ergebnisse legen nahe, dass beide Fertigkeiten signifikante und eigenständige Beiträge zum Leseverstehen leisten und dass sich ihr relativer Beitrag über die Klassenstufen hinweg nicht verändert. Darüber hinaus zeigt sich, dass bereits deutsche Zweitklässler(innen) den Großteil geschriebener Wörter in altersgerechten Texten über orthographische Vergleichsprozesse erkennen. Nichtsdestotrotz nutzen deutsche Grundschulkinder offenbar kontinuierlich phonologische Informationen, um die visuelle Worterkennung zu optimieren. Studie 2 erweitert die bisherige empirische Forschung zu einem der bekanntesten Modelle des Leseverstehens—der Simple View of Reading (SVR, Gough & Tunmer, 1986). Die Studie überprüft die SVR (Reading comprehension = Decoding x Comprehension) mithilfe optimierter und methodisch stringenter Maße der Modellkonstituenten und überprüft ihre Generalisierbarkeit für deutsche Dritt- und Viertklässler(innen). Studie 2 zeigt, dass die SVR einer methodisch stringenten Überprüfung nicht standhält und nicht ohne Weiteres auf deutsche Dritt- und Viertklässler(innen) generalisiert werden kann. Es wurden nur schwache Belege für eine multiplikative Verknüpfung von Dekodier- (D) und Hörverstehensfertigkeiten (C) gefunden. Der Umstand, dass ein beachtlicher Teil der Varianz im Leseverstehen (R) nicht durch D und C aufgeklärt werden konnte, deutet darauf hin, dass das Modell nicht vollständig ist und ggf. durch weitere Komponenten ergänzt werden muss. Studie 3 untersucht die Verarbeitung positiv-kausaler und negativ-kausaler Kohärenzrelationen bei deutschen Erst- bis Viertklässler(inne)n und Erwachsenen im Lese- und Hörverstehen. In Übereinstimmung mit dem Cumulative Cognitive Complexity-Ansatz (Evers-Vermeul & Sanders, 2009; Spooren & Sanders, 2008) zeigt Studie 3, dass die Verarbeitung negativ-kausaler Kohärenzrelationen und Konnektoren kognitiv aufwändiger ist als die Verarbeitung positiv-kausaler Relationen. Darüber hinaus entwickelt sich das Verstehen beider Kohärenzrelationen noch über die Grundschulzeit hinweg und ist für negativ-kausale Relationen am Ende der vierten Klasse noch nicht abgeschlossen. Studie 4 zeigt und diskutiert die Nützlichkeit prozess-orientierter Lesetests wie ProDi- L (Richter et al., in press), die individuelle Unterschiede in den kognitiven Teilfertigkeiten des Leseverstehens selektiv erfassen. Hierzu wird exemplarisch die Konstruktvalidität des ProDi-L-Subtests ‚Syntaktische Integration’ nachgewiesen. Mittels explanatorischer Item- Repsonse-Modelle wird gezeigt, dass der Test Fertigkeiten syntaktischer Integration separat erfasst und Kinder mit defizitären syntaktischen Fertigkeiten identifizieren kann. Die berichteten Befunde tragen zu einem umfassenden Verständnis der kognitiven Teilfertigkeiten des Leseverstehens bei, das für eine optimale Gestaltung des Leseunterrichts, für das Erstellen von Lernmaterialien, Leseinstruktionen und Lehrbüchern unerlässlich ist. Darüber hinaus stellt es die Grundlage für eine sinnvolle Diagnose individueller Leseschwierigkeiten und für die Konzeption adaptiver und zielgerichteter Interventionsprogramme zur Förderung des Leseverstehens bei schwachen Leser(inne)n dar.