Developing a robust self evaluation framework for active learning:the first stage of an ERASMUS+ project (QAEMarketPlace4HEI)

In ensuring the quality of learning and teaching in Higher Education, self-evaluation is an important component of the process. An example would be the approach taken within the CDIO community whereby self-evaluation against the CDIO standards is part of the quality assurance process. Eight European universities (Reykjavik University, Iceland; Turku University of Applied Sciences, Finland; Aarhus University, Denmark; Helsinki Metropolia University of Applied Sciences, Finland; Ume? University, Sweden; Telecom Bretagne, France; Aston University, United Kingdom; Queens University Belfast, United Kingdom) are engaged in an EU funded Erasmus + project that is exploring the quality assurance process associated with active learning. The development of a new self-evaluation framework that feeds into a ?Marketplace? where participating institutions can be paired up and then engage in peer evaluations and sharing around each institutions approach to and implementation of active learning. All of the partner institutions are engaged in the application of CDIO within their engineering programmes and this has provided a common starting point for the partnership to form and the project to be developed. Although the initial focus will be CDIO, the longer term aim is that the approach could be of value beyond CDIO and within other disciplines. The focus of this paper is the process by which the self-evaluation framework is being developed and the form of the draft framework. In today?s Higher Education environment, the need to comply with Quality Assurance standards is an ever present feature of programme development and review. When engaging in a project that spans several countries, the wealth of applicable standards and guidelines is significant. In working towards the development of a robust Self Evaluation Framework for this project, the project team decided to take a wide view of the available resources to ensure a full consideration of different requirements and practices. The approach to developing the framework considered: a) institutional standards and processes b) national standards and processes e.g. QAA in the UK c) documents relating to regional / global accreditation schemes e.g. ABET d) requirements / guidelines relating to particular learning and teaching frameworks e.g. CDIO. The resulting draft self-evaluation framework is to be implemented within the project team to start with to support the initial ?Marketplace? pairing process. Following this initial work, changes will be considered before a final version is made available as part of the project outputs. Particular consideration has been paid to the extent of the framework, as a key objective of the project is to ensure that the approach to quality assurance has impact but is not overly demanding in terms of time or paperwork. In other words that it is focused on action and value added to staff, students and the programmes being considered.

A case study of adults in college who developed an experiential learning portfolio

This single-case study provides a description and explanation of selected adult students' perspectives on the impact that the development of an experiential learning portfolio had on their understanding of their professional and personal lives. The conceptual framework that undergirded the study included theoretical and empirical studies on adult learning, experiential learning, and the academic quality of nontraditional degree programs with a portfolio component. The study employed qualitative data collection techniques of individual interviews, document review, field notes, and researcher journal. A purposive sample of 8 adult students who completed portfolios as a component of their undergraduate degrees participated in the study. The 4 male and 4 female students who were interviewed represented 4 ethnic/racial groups and ranged in age from 32 to 55 years. Each student's portfolio was read prior to the interview to frame the semi-structured interview questions in light of written portfolio documents. ^ Students were interviewed twice over a 3-month period. The study lasted 8 months from data collection to final presentation of the findings. The data from interview transcriptions and student portfolios were analyzed, categorized, coded, and sorted into 4 major themes and 2 additional themes and submitted to interpretive analysis. ^ Participants' attitudes, perceptions, and opinions of their learning from the portfolio development experience were presented in the findings, which were illustrated through the use of excerpts from interview responses and individual portfolios. The participants displayed a positive reaction to the learning they acquired from the portfolio development process, regardless of their initial concerns about the challenges of creating a portfolio. Concerns were replaced by a greater recognition and understanding of their previous professional and personal accomplishments and their ability to reach future goals. Other key findings included (a) a better understanding of the role work played in their learning and development, (b) a deeper recognition of the impact of mentors and role models throughout their lives, (c) an increase in writing and organizational competencies, and (d) a sense of self-discovery and personal empowerment. ^

Students' recollections of participating in a first year residential learning community experience

The purpose of this qualitative study was to gain an understanding of what participation in a first year residential learning community meant to students 2–3 years after their involvement in the program. Various theories including environmental, student involvement, psychosocial and intellectual, were used as a framework for this case study. Each of the ten participants was a junior or senior level student at the time of the study, but had previously participated in a first year residential learning community at Florida International University. The researcher held two semi-structured interviews with each participant, and collected data sheets from each. ^ The narrative data produced from the interviews were transcribed, coded and analyzed to gain insights into the experiences and perspectives of the participants. Member checking was used after the interview process. A peer reviewer offered feedback during the data analysis. The resulting data was coded into categories, with a final selection of four themes and 15 sub-themes, which captured the essence of the participants' experiences. The four major themes included: (a) community, (b) involvement, (c) identity, and (d) academics. The community theme is used to describe how students perceived the environment to be. The involvement theme is used to describe the students' participation in campus life and their interaction with other members of the university community. The identity theme is used to describe the students' process of development, and the personal growth they underwent as a result of their experiences. The academics theme refers to the intellectual development of students and their interaction around academic issues. ^ The results of this study showed that the participants valued greatly their involvement in the First Year Residents Succeeding Together program (FYRST) and can articulate how it helped them succeed as students. In describing their experience, they most recall the sense of community that existed, the personal growth they experienced, the academic development process they went through, and their involvement, both with other people and with activities in their community. Recommendations are provided for practice and research, including several related to enhancing the academic culture, integrating faculty, utilizing peer influence and providing further opportunities to create a seamless learning environment. ^

Socioemotional outcomes of children sexually abused during early childhood

This study investigated the nature and impact of the sexual abuse of children ages birth through 6 years. The purpose was to enhance knowledge about this understudied population through examination of: (1) characteristics of the abuse; (2) socioemotional developmental outcomes of young victims; and (3) potential moderating effects of family dynamics. An ecological-developmental theoretical framework was applied. Secondary data analysis was conducted using data collected from the consortium Longitudinal Studies of Child Abuse and Neglect (LONGSCAN). A sample of 250 children was drawn from LONGSCAN data, including children who were sexually abused (n=125) and their nonabused counterparts (n=125), matched on demographic variables. Results revealed that young victims of sexual abuse were disproportionately female (91 girls; 73%). The sexual abuse committed against these youngsters was severe in nature, with 111 children (89%) experiencing contact offenses ranging from fondling to forcible rape. Sixty-two percent of child victims demonstrated borderline, clinical, or less than adequate functioning on normative, expected socioemotional outcomes. Child victims reported low degrees of perceived competence and satisfaction in the social environment. When compared with their nonabused counterparts, child victims demonstrated significantly poorer socioemotional functioning, as evidenced by aggressive behaviors, attention and thought problems. Sexually abused youngsters also reported lower self-perceptions of cognitive and physical competence and maternal acceptance. Family dynamic factors did not significantly moderate the relationships between abuse and socioemotional outcomes, with one exception. The caregivers’ degree of empathy for their children had a significant moderating effect on the children’s social problems. This study contributes to an otherwise scant body of literature on the sexual abuse of preschoolers. Findings provide implications for social work practice, especially in the development of assessment and prevention strategies.

Effects of Family, Child, and Teacher Demographics on Prekindergarten Children's Access to and Use of Numeracy and Spatial Materials in the Early Education Setting

Florida’s Voluntary Pre-Kindergarten program (VPK) aims to ensure that all 4-year-olds are prepared to excel in K-12 mathematics. Early numeracy/spatial skills are predictive of success in K–12 mathematics. No research has examined whether VPK classrooms are equipped with the materials necessary to teach numeracy/spatial skill. The Pre-Kindergarten Numeracy and Spatial Environment Survey was created to examine the frequency of access to and use of numeracy/spatial materials in VPK classrooms. The 69-item survey was completed by the lead educator from a sample of 62 pre-kindergarten classrooms in Miami-Dade County. Regression analysis results suggest the location of the pre-kindergarten center, the sex distribution of the children in the classrooms or the number of years of experience that the educator has as a lead teacher along with the extra training courses undertaken by the teachers does not affect the access to or the use of, numeracy and spatial materials in the classrooms.

Students' recollections of participating in a first year residential learning community experience

The purpose of this qualitative study was to gain an understanding of what participation in a first year residential learning community meant to students 2-3 years after their involvement in the program. Various theories including environmental, student involvement, psychosocial and intellectual, were used as a framework for this case study. Each of the ten participants was a junior or senior level student at the time of the study, but had previously participated in a first year residential learning community at Florida International University. The researcher held two semi-structured interviews with each participant, and collected data sheets from each. The narrative data produced from the interviews were transcribed, coded and analyzed to gain insights into the experiences and perspectives of the participants. Member checking was used after the interview process. A peer reviewer offered feedback during the data analysis. The resulting data was coded into categories, with a final selection of four themes and 15 sub-themes, which captured the essence of the participants' experiences. The four major themes included: (a) community, (b) involvement, (c) identity, and (d) academics. The community theme is used to describe how students perceived the environment to be. The involvement theme is used to describe the students' participation in campus life and their interaction with other members of the university community. The identity theme is used to describe the students' process of development, and the personal growth they underwent as a result of their experiences. The academics theme refers to the intellectual development of students and their interaction around academic issues. The results of this study showed that the participants valued greatly their involvement in the First Year Residents Succeeding Together program (FYRST) and can articulate how it helped them succeed as students. In describing their experience, they most recall the sense of community that existed, the personal growth they experienced, the academic development process they went through, and their involvement, both with other people and with activities in their community. Recommendations are provided for practice and research, including several related to enhancing the academic culture, integrating faculty, utilizing peer influence and providing further opportunities to create a seamless learning environment.

Socioemotional Outcomes of Children Sexually Abused during Early Childhood

This study investigated the nature and impact of the sexual abuse of children ages birth through 6 years. The purpose was to enhance knowledge about this understudied population through examination of: (1) characteristics of the abuse; (2) socioemotional developmental outcomes of young victims; and (3) potential moderating effects of family dynamics. An ecological-developmental theoretical framework was applied. Secondary data analysis was conducted using data collected from the consortium Longitudinal Studies of Child Abuse and Neglect (LONGSCAN). A sample of 250 children was drawn from LONGSCAN data, including children who were sexually abused (n=125) and their nonabused counterparts (n=125), matched on demographic variables. Results revealed that young victims of sexual abuse were disproportionately female (91 girls; 73%). The sexual abuse committed against these youngsters was severe in nature, with 111 children (89%) experiencing contact offenses ranging from fondling to forcible rape. Sixty-two percent of child victims demonstrated borderline, clinical, or less than adequate functioning on normative, expected socioemotional outcomes. Child victims reported low degrees of perceived competence and satisfaction in the social environment. When compared with their nonabused counterparts, child victims demonstrated significantly poorer socioemotional functioning, as evidenced by aggressive behaviors, attention and thought problems. Sexually abused youngsters also reported lower self-perceptions of cognitive and physical competence and maternal acceptance. Family dynamic factors did not significantly moderate the relationships between abuse and socioemotional outcomes, with one exception. The caregivers’ degree of empathy for their children had a significant moderating effect on the children’s social problems. This study contributes to an otherwise scant body of literature on the sexual abuse of preschoolers. Findings provide implications for social work practice, especially in the development of assessment and prevention strategies.

Last Interglacial synthesis of high-latitude temperature: temperature anomalies and associated errors for 4 time slices

The Last Interglacial (LIG, 129-116 thousand of years BP, ka) represents a test bed for climate model feedbacks in warmer-than-present high latitude regions. However, mainly because aligning different palaeoclimatic archives and from different parts of the world is not trivial, a spatio-temporal picture of LIG temperature changes is difficult to obtain. Here, we have selected 47 polar ice core and sub-polar marine sediment records and developed a strategy to align them onto the recent AICC2012 ice core chronology. We provide the first compilation of high-latitude temperature changes across the LIG associated with a coherent temporal framework built between ice core and marine sediment records. Our new data synthesis highlights non-synchronous maximum temperature changes between the two hemispheres with the Southern Ocean and Antarctica records showing an early warming compared to North Atlantic records. We also observe warmer than present-day conditions that occur for a longer time period in southern high latitudes than in northern high latitudes. Finally, the amplitude of temperature changes at high northern latitudes is larger compared to high southern latitude temperature changes recorded at the onset and the demise of the LIG. We have also compiled four data-based time slices with temperature anomalies (compared to present-day conditions) at 115 ka, 120 ka, 125 ka and 130 ka and quantitatively estimated temperature uncertainties that include relative dating errors. This provides an improved benchmark for performing more robust model-data comparison. The surface temperature simulated by two General Circulation Models (CCSM3 and HadCM3) for 130 ka and 125 ka is compared to the corresponding time slice data synthesis. This comparison shows that the models predict warmer than present conditions earlier than documented in the North Atlantic, while neither model is able to produce the reconstructed early Southern Ocean and Antarctic warming. Our results highlight the importance of producing a sequence of time slices rather than one single time slice averaging the LIG climate conditions.

What more can we learn from early learning theory? The contemporary relevance for behaviour change interventions

Peer reviewed

What more can we learn from early learning theory? The contemporary relevance for behaviour change interventions

Peer reviewed

Using parent report to assess early lexical production in children exposed to more than one language

Limited expressive vocabulary skills in young children are considered to be the first warning signs of a potential Specific Language Impairment (SLI) (Ellis & Thal, 2008). In bilingual language learning environments, the expressive vocabulary size in each of the child’s developing languages is usually smaller compared to the number of words produced by monolingual peers (e.g. De Houwer, 2009). Nonetheless, evidence shows children’s total productive lexicon size across both languages to be comparable to monolingual peers’ vocabularies (e.g. Pearson et al., 1993; Pearson & Fernandez, 1994). Since there is limited knowledge as to which level of bilingual vocabulary size should be considered as a risk factor for SLI, the effects of bilingualism and language-learning difficulties on early lexical production are often confounded. The compilation of profiles for early vocabulary production in children exposed to more than one language, and their comparison across language pairs, should enable more accurate identification of vocabulary delays that signal a risk for SLI in bilingual populations. These considerations prompted the design of a methodology for assessing early expressive vocabulary in children exposed to more than one language, which is described in the present chapter. The implementation of this methodological framework is then outlined by presenting the design of a study that measured the productive lexicons of children aged 24-36 months who were exposed to different language pairs, namely Maltese and English, Irish and English, Polish and English, French and Portuguese, Turkish and German as well as English and Hebrew. These studies were designed and coordinated in COST Action IS0804 Working Group 3 (WG3) and will be described in detail in a series of subsequent publications. Expressive vocabulary size was measured through parental report, by employing the vocabulary checklist of the MacArthur-Bates Communicative Development Inventory: Words and Sentences (CDI: WS) (Fenson et al., 1993, 2007) and its adaptations to the participants’ languages. Here we describe the novelty of the study’s methodological design, which lies in its attempt to harmonize the use of vocabulary checklist adaptations, together with parental questionnaires addressing language exposure and developmental history, across participant groups characterized by different language exposure variables. This chapter outlines the various methodological considerations that paved the way for meaningful cross-linguistic comparison of the participants’ expressive lexicon sizes. In so doing, it hopes to provide a template for and encourage further research directed at establishing a threshold for SLI risk in children exposed to more than one language.

The framework for REVIEWS: an exploration into design principles for an electronic medical early warning system observation chart

The observation chart is for many health professionals (HPs) the primary source of objective information relating to the health of a patient. Information Systems (IS) research has demonstrated the positive impact of good interface design on decision making and it is logical that good observation chart design can positively impact healthcare decision making. Despite the potential for good observation chart design, there is a paucity of observation chart design literature, with the primary source of literature leveraging Human Computer Interaction (HCI) literature to design better charts. While this approach has been successful, this design approach introduces a gap between understanding of the tasks performed by HPs when using charts and the design features implemented in the chart. Good IS allow for the collection and manipulation of data so that it can be presented in a timely manner that support specific tasks. Good interface design should therefore consider the specific tasks being performed prior to designing the interface. This research adopts a Design Science Research (DSR) approach to formalise a framework of design principles that incorporates knowledge of the tasks performed by HPs when using observation charts and knowledge pertaining to visual representations of data and semiology of graphics. This research is presented in three phases, the initial two phases seek to discover and formalise design knowledge embedded in two situated observation charts: the paper-based NEWS chart developed by the Health Service Executive in Ireland and the electronically generated eNEWS chart developed by the Health Information Systems Research Centre in University College Cork. A comparative evaluation of each chart is also presented in the respective phases. Throughout each of these phases, tentative versions of a design framework for electronic vital sign observation charts are presented, with each subsequent iteration of the framework (versions Alpha, Beta, V0.1 and V1.0) representing a refinement of the design knowledge. The design framework will be named the framework for the Retrospective Evaluation of Vital Sign Information from Early Warning Systems (REVIEWS). Phase 3 of the research presents the deductive process for designing and implementing V0.1 of the framework, with evaluation of the instantiation allowing for the final iteration V1.0 of the framework. This study makes a number of contributions to academic research. First the research demonstrates that the cognitive tasks performed by nurses during clinical reasoning can be supported through good observation chart design. Secondly the research establishes the utility of electronic vital sign observation charts in terms of supporting the cognitive tasks performed by nurses during clinical reasoning. Third the framework for REVIEWS represents a comprehensive set of design principles which if applied to chart design will improve the usefulness of the chart in terms of supporting clinical reasoning. Fourth the electronic observation chart that emerges from this research is demonstrated to be significantly more useful than previously designed charts and represents a significant contribution to practice. Finally the research presents a research design that employs a combination of inductive and deductive design activities to iterate on the design of situated artefacts.

An Investigation of the Features and Effectiveness of the Full-Day Early Learning Kindergarten Program in Ontario

This dissertation includes two studies. Study 1 is a qualitative case study that describes enactment of the main components of a high fidelity Full-Day Early Learning Kindergarten (FDELK) classroom, specifically play-based learning and teacher-ECE collaboration. Study 2 is a quantitative analysis that investigates how effectively the FDELK program promotes school readiness skills, namely self-regulation, literacy, and numeracy, in Kindergarteners. To describe the main components of an FDELK classroom in Study 1, a sub-sample of four high fidelity case study schools were selected from a larger case study sample. Interview data from these schools’ administrators, educators, parents, and community stakeholders were used to describe how the main components of the FDELK program enabled educators to meet the individual needs of students and promote students’ SR development. In Study 2, hierarchical regression analyses of 32,207 students’ self-regulation, literacy, and numeracy outcomes using 2012 Ontario Early Development Instrument (EDI) data revealed essentially no benefit for students participating in the FDELK program when compared to peers in Half-Day or Alternate-Day Kindergarten programs. Being older and female predicted more positive SR and literacy outcomes. Age and gender accounted for limited variance in numeracy outcomes. Results from both studies suggest that the Ontario Ministry of Education should take steps to improve the quality of the FDELK program by incorporating evidence-based guidelines and goals for play, reducing Kindergarten class sizes to more effectively scaffold learning, and revising curriculum expectations to include a greater focus on SR, literacy, and numeracy skills.

Supporting Metacognitive Development in Early Science Education: Exploring Elementary Teachers' Beliefs and Practices in Metacognition

Metacognition is the understanding and control of cognitive processes. Students with high levels of metacognition achieve greater academic success. The purpose of this mixed-methods study was to examine elementary teachers’ beliefs about metacognition and integration of metacognitive practices in science. Forty-four teachers were recruited through professional networks to complete a questionnaire containing open-ended questions (n = 44) and Likert-type items (n = 41). Five respondents were selected to complete semi-structured interviews informed by the questionnaire. The selected interview participants had a minimum of three years teaching experience and demonstrated a conceptual understanding of metacognition. Statistical tests (Pearson correlation, t-tests, and multiple regression) on quantitative data and thematic analysis of qualitative data indicated that teachers largely understood metacognition but had some gaps in their understanding. Participants’ reported actions (teaching practices) and beliefs differed according to their years of experience but not gender. Hierarchical multiple regression demonstrated that the first block of gender and experience was not a significant predictor of teachers' metacognitive actions, although experience was a significant predictor by itself. Experience was not a significant predictor once teachers' beliefs were added. The majority of participants indicated that metacognition was indeed appropriate for elementary students. Participants consistently reiterated that students’ metacognition developed with practice, but required explicit instruction. A lack of consensus remained around the domain specificity of metacognition. More specifically, the majority of questionnaire respondents indicated that metacognitive strategies could not be used across subject domains, whereas all interviewees indicated that they used strategies across subjects. Metacognition was integrated frequently into Ontario elementary classrooms; however, metacognition was integrated less frequently in science lessons. Lastly, participants used a variety of techniques to integrate metacognition into their classrooms. Implications for practice include the need for more professional development aimed at integrating metacognition into science lessons at both the Primary and Junior levels. Further, teachers could benefit from additional clarification on the three main components of metacognition and the need to integrate all three to successfully develop students’ metacognition.

Cooperative or collaborative learning: Is there a difference in university students’ perceptions?

The hypothesis that the same educational objective, raised as cooperative or collaborative learning in university teaching does not affect students’ perceptions of the learning model, leads this study. It analyses the reflections of two students groups of engineering that shared the same educational goals implemented through two different methodological active learning strategies: Simulation as cooperative learning strategy and Problem-based Learning as a collaborative one. The different number of participants per group (eighty-five and sixty-five, respectively) as well as the use of two active learning strategies, either collaborative or cooperative, did not show differences in the results from a qualitative perspective.