Moving toward change: Institutionalizing reform through implementation of the Learning Assistant model and Open Source Tutorials

Florida International University has undergone a reform in the introductory physics classes by focusing on the laboratory component of these classes. We present results from the secondary implementation of two research-based instructional strategies: the implementation of the Learning Assistant model as developed by the University of Colorado at Boulder and the Open Source Tutorial curriculum developed at the University of Maryland, College Park. We examine the results of the Force Concept Inventory (FCI) for introductory students over five years (n=872) and find that the mean raw gain of students in transformed lab sections was 0.243, while the mean raw gain of the traditional labs was 0.159, with a Cohen’s d effect size of 0.59. Average raw gains on the FCI were 0.243 for Hispanic students and 0.213 for women in the transformed labs, indicating that these reforms are not widening the gaps between underrepresented student groups and majority groups. Our results illustrate how research-based instructional strategies can be successfully implemented in a physics department with minimal department engagement and in a sustainable manner.

A relationship between the Florida Comprehensive Assessment Test 2.0 mathematics scores and racial and ethnic concentration when considering socio-economic status, ESOL student population, and school climate

From the moment children are born, they begin a lifetime journey of learning about themselves and their surroundings. With the establishment of the No Child Left Behind Act of 2001, it mandates that all children receive a high-quality education in a positive school climate. Regardless of the school the child attends or the neighborhood in which the child lives, proper and quality education and resources must be provided and made available in order for the child to be academically successful. The purpose of this ex post facto study was to investigate the relationship between the FCAT 2.0 mathematics scores of public middle school students in Miami-Dade County, Florida and the concentrations of a school's racial and ethnic make-up (Whites, Blacks, and Hispanics), English for Speakers of other Languages (ESOL) population, socio-economic status (SES), and school climate. The research question of this study was: Is there a significant relationship between the FCAT 2.0 Mathematics scores and racial and ethnic concentration of public middle school students in Miami-Dade County when controlling SES, ESOL student population, and school climate for the 2010-2011 school year? The instruments used to collect the data were the FCAT 2.0 and Miami-Dade County Public Schools (M-DCPS) School Climate Survey. The study found that Economically Disadvantaged (SES) students socio-economic status had the strongest correlation with the FCAT 2.0 mathematics scores (r = -.830). The next strongest correlation was with the number of students who agreed that their school climate was positive and helped them learn (r = .741) and the third strongest correlation was a school percentage of White students (r = .668). The study concluded that the FCAT 2.0 mathematics scores of M-DCPS middle school students have a significant relationship with socio-economic status, school climate, and racial concentration.

Undergraduate Students’ Perceptions of Study Abroad and Their Level of Achievement of Global Learning Outcomes

This study expanded on current research on study abroad and global learning, using the Global Perspective Inventory (GPI), and conducted at Florida International University (FIU) in Miami, FL. The GPI assesses the holistic development of a global perspective in higher education within three domains and their respective FIU-determined equivalents: cognitive (global awareness), intrapersonal (global perspective), and interpersonal (global engagement). The main purpose of this study was to assess FIU’s undergraduate students’ perceptions of study abroad on their level of achievement of global awareness, global perspective, and global engagement. The secondary purpose was to determine how the students described their study abroad experience and achievement of global learning. The research design for this study consisted of parallel mixed methods. The quantitative component was an ex post facto with hypothesis design, using a pretest/posttest nonequivalent group methodology. FIU undergraduates (N=147) who studied abroad for one semester or more completed the GPI pre- and post-tests. Descriptive statistics and paired t-tests were conducted to compare the means. The interviews included 10 students, and were analyzed through Structural coding, Saldaña’s In Vivo coding, and Value coding. Quantitative analyses indicated positive changes in the students’ global awareness and global perspective. These analyses also showed that the FIU students achieved higher post-test means on all the domains of the GPI compared to other studies. Qualitative analyses showed that the students’ experiences incorporated all three global learning outcomes, most notably global awareness and perspective.

Development of a learning resource manual for nurses new to thoracic surgery

Background: Patients with lung and esophageal cancer often have surgery as a means of treatment. In Newfoundland and Labrador, patients with lung and esophageal issues are cared for on Six East, the General/Thoracic Surgery unit at St. Clare’s Mercy Hospital. These patients frequently require chest tubes, which are managed and assessed by Registered Nurses (RNs) on the unit. For nurses new to thoracic surgery, fulfilling their new role and caring for chest tube systems can be daunting. Purpose: The purpose of this practicum project was to develop a learning resource manual for nurses who are new to thoracic surgery. Via self-directed learning, the manual can increase the knowledge and self-efficacy of nurses who are caring for thoracic surgery clients and assessing chest tube systems. Methods: An informal needs assessment, integrated literature review, and several consultations via in-person interviews were conducted. Results: Based on the findings from these methodologies, Knowles’ Adult Learning Theory, and Benner’s Novice to Expert Model, a learning resource manual was created. The manual was divided into chapters covering various aspects of patient and chest tube system care and assessment. Conclusion: For the purpose of this practicum project, no evaluation was conducted. However, a plan for future evaluation of the learning resource manual has been developed to determine if the manual assisted with increasing the knowledge and self-efficacy of nurses new to thoracic surgery. “Test Your Knowledge” questions were included at the end of each chapter in the manual as well as case study scenarios to allow for participant self-evaluation.

The development of a self-directed learning module for rural emergency nurses on pediatric diabetic ketoacidosis

Background: Newfoundland and Labrador has a high incidence of type 1 diabetes and diabetic ketoacidosis (DKA) is a complication of type 1 diabetes. A clinical practice guideline was developed for the treatment of pediatric diabetic ketoacidosis (DKA) to standardize care in all Emergency Departments and improve patient outcomes. Rural emergency nurses are requires to maintain their competency and acquire new knowledge as stated by the Association of Registered Nurses of Newfoundland and Labrador (ARNNL). Purpose: The purpose of this practicum was to develop a self-learning module for rural emergency nurses to increase their knowledge and understanding of the clinical practise guideline to assess, treat, and prevent pediatric ketoacidosis. Methods: Two methodologies were used in this practicum. A review of the literature and consultations with key stakeholders were completed. Results: The self-learning module created was composed of three units and focused on the learning needs of rural emergency nurses in the areas of assessment, treatment, and prevention of pediatric DKA. Conclusion: The goal of the practicum was to increase rural emergency nurses’ knowledge and implementation of the clinical practice guideline when assessing and treating children and families experiencing DKA to improve patient outcomes. A planned evaluation of the self-learning module will be conducted following dissemination of the module throughout the rural Emergency Departments.

Self-assessment of clinical nurse mentors as dimensions of professional development and the capability of developing ethical values among nursing students : A correlational research study

Date of Acceptance: 08/04/2015 The paper presents, in part, the results of a broader non-profit development project entitled “Advance level of knowledge for quality in clinical mentorship — professional ethics and continuously professional development”. The project was financed by the Ministry of Higher Education, Science and Sport of the Republic of Slovenia (contract no. 3211-11-000263, the number of project OP RCV_VS-11-14). The members of the development group of the project were: Brigita Skela-Savič (leader), Karmen Romih, Sanela Pivač, Katja Skinder Savić and Andreja Prebil. The research report for the entire project is available on the online bibliographic database COBIB.si, at the Faculty of Health Care Jesenice and at the Ministry of Higher Education, Science and Sport of the Republic of Slovenia.

Self-assessment of clinical nurse mentors as dimensions of professional development and the capability of developing ethical values among nursing students : A correlational research study

Date of Acceptance: 08/04/2015 The paper presents, in part, the results of a broader non-profit development project entitled “Advance level of knowledge for quality in clinical mentorship — professional ethics and continuously professional development”. The project was financed by the Ministry of Higher Education, Science and Sport of the Republic of Slovenia (contract no. 3211-11-000263, the number of project OP RCV_VS-11-14). The members of the development group of the project were: Brigita Skela-Savič (leader), Karmen Romih, Sanela Pivač, Katja Skinder Savić and Andreja Prebil. The research report for the entire project is available on the online bibliographic database COBIB.si, at the Faculty of Health Care Jesenice and at the Ministry of Higher Education, Science and Sport of the Republic of Slovenia.

Self-assessment of clinical nurse mentors as dimensions of professional development and the capability of developing ethical values among nursing students : A correlational research study

Date of Acceptance: 08/04/2015 The paper presents, in part, the results of a broader non-profit development project entitled “Advance level of knowledge for quality in clinical mentorship — professional ethics and continuously professional development”. The project was financed by the Ministry of Higher Education, Science and Sport of the Republic of Slovenia (contract no. 3211-11-000263, the number of project OP RCV_VS-11-14). The members of the development group of the project were: Brigita Skela-Savič (leader), Karmen Romih, Sanela Pivač, Katja Skinder Savić and Andreja Prebil. The research report for the entire project is available on the online bibliographic database COBIB.si, at the Faculty of Health Care Jesenice and at the Ministry of Higher Education, Science and Sport of the Republic of Slovenia.

A pilot study of orthopaedic resident self-assessment using a milestones' survey just prior to milestones implementation.

OBJECTIVE: To pilot test if Orthopaedic Surgery residents could self-assess their performance using newly created milestones, as defined by the Accreditation Council on Graduate Medical Education. METHODS: In June 2012, an email was sent to Program Directors and administrative coordinators of the 154 accredited Orthopaedic Surgery Programs, asking them to send their residents a link to an online survey. The survey was adapted from the Orthopaedic Surgery Milestone Project. Completed surveys were aggregated in an anonymous, confidential database. SAS 9.3 was used to perform the analyses. RESULTS: Responses from 71 residents were analyzed. First and second year residents indicated through self-assessment that they had substantially achieved Level 1 and Level 2 milestones. Third year residents reported they had substantially achieved 30/41, and fourth year residents, all Level 3 milestones. Fifth year, graduating residents, reported they had substantially achieved 17 Level 4 milestones, and were extremely close on another 15. No milestone was rated at Level 5, the maximum possible. Earlier in training, Patient Care and Medical Knowledge milestones were rated lower than the milestones reflecting the other four competencies of Practice Based Learning and Improvement, Systems Based Practice, Professionalism, and Interpersonal Communication. The gap was closed by the fourth year. CONCLUSIONS: Residents were able to successfully self-assess using the 41 Orthopaedic Surgery milestones. Respondents' rate improved proficiency over time. Graduating residents report they have substantially, or close to substantially, achieved all Level 4 milestones. Milestone self-assessment may be a useful tool as one component of a program's overall performance assessment strategy.

The Optimality of Decision Making During Motor Learning

In our daily lives, we often must predict how well we are going to perform in the future based on an evaluation of our current performance and an assessment of how much we will improve with practice. Such predictions can be used to decide whether to invest our time and energy in learning and, if we opt to invest, what rewards we may gain. This thesis investigated whether people are capable of tracking their own learning (i.e. current and future motor ability) and exploiting that information to make decisions related to task reward. In experiment one, participants performed a target aiming task under a visuomotor rotation such that they initially missed the target but gradually improved. After briefly practicing the task, they were asked to select rewards for hits and misses applied to subsequent performance in the task, where selecting a higher reward for hits came at a cost of receiving a lower reward for misses. We found that participants made decisions that were in the direction of optimal and therefore demonstrated knowledge of future task performance. In experiment two, participants learned a novel target aiming task in which they were rewarded for target hits. Every five trials, they could choose a target size which varied inversely with reward value. Although participants’ decisions deviated from optimal, a model suggested that they took into account both past performance, and predicted future performance, when making their decisions. Together, these experiments suggest that people are capable of tracking their own learning and using that information to make sensible decisions related to reward maximization.

Cooperative or collaborative learning: Is there a difference in university students’ perceptions?

The hypothesis that the same educational objective, raised as cooperative or collaborative learning in university teaching does not affect students’ perceptions of the learning model, leads this study. It analyses the reflections of two students groups of engineering that shared the same educational goals implemented through two different methodological active learning strategies: Simulation as cooperative learning strategy and Problem-based Learning as a collaborative one. The different number of participants per group (eighty-five and sixty-five, respectively) as well as the use of two active learning strategies, either collaborative or cooperative, did not show differences in the results from a qualitative perspective.

A First Step Towards Synthesising Rubrics and Video for the Formative Assessment of Complex Skills

Abstract. The performance objectives used for the formative assessment of com- plex skills are generally set through text-based analytic rubrics[1]. Moreover, video modeling examples are a widely applied method of observational learning, providing students with context-rich modeling examples of complex skills that act as an analogy for problem solving [1]. The purpose of this theoretical paper is to synthesize the components of video modeling and rubrics to support the formative assessment of complex skills. Based on theory, we argue that application of the developed Video Enhanced Rubrics (VER) fosters learners’ development of mental models, quality of provided feedback by various actors and finally, the learners mastery of complex skills.

Viewbrics: Formative Assessment of Complex Skills with Video-Enhanced Rubrics (VER) in Dutch Secondary Education

To learn complex skills, like collaboration, learners need to acquire a concrete and consistent mental model of what it means to master this skill. If learners know their current mastery level and know their targeted mastery level, they can better determine their subsequent learning activities. Rubrics support learners in judging their skill performance as they provide textual descriptions of skills’ mastery levels with performance indicators for all constituent subskills. However, text-based rubrics have a limited capacity to support the formation of mental models with contextualized, time-related and observable behavioral aspects of a complex skill. This paper outlines the design of a study that intends to investigate the effect of rubrics with video modelling examples compared to text-based rubrics on skills acquisition and feedback provisioning. The hypothesis is that video-enhanced rubrics, compared to text based rubrics, will improve mental model formation of a complex skill and improve the feedback quality a learner receives (from e.g. teachers, peers) while practicing a skill, hence positively effecting final mastery of a skill.

Learning for self-regulation: Improving instructional benefits for pupils, teachers, parents, schools, and society at large

Compulsory education laws oblige primary and secondary schools to give each pupil positive encouragement in, for example, social, emotional, cognitive, creative, and ethical respects. This is a fairly smooth process for most pupils, but it is not as easy to achieve with others. A pattern of pupil, home or family, and school variables turns out to be responsible for a long-term process that may lead to a pupil’s dropping out of education. A systemic approach will do much to introduce more clarity into the diagnosis, potential reduction and possible prevention of some persistent educational problems that express themselves in related phenomena, for example low school motivation and achievement; forced underachievement of high ability pupils; concentration of bullying and violent behaviour in and around some types of classes and schools; and drop-out percentages that are relatively constant across time. Such problems have a negative effect on pupils, teachers, parents, schools, and society alike. In this address, I would therefore like to clarify some of the systemic causes and processes that we have identified between specific educational and pupil characteristics. Both theory and practice can assist in developing, implementing, and checking better learning methods and coaching procedures, particularly for pupils at risk. This development approach will take time and require co-ordination, but it will result in much better processes and outcomes than we are used to. First, I will diagnose some systemic aspects of education that do not seem to optimise the learning processes and school careers of some types of pupils in particular. Second, I will specify cognitive, social, motivational, and self-regulative aspects of learning tasks and relate corresponding learning processes to relevant instructional and wider educational contexts. I will elaborate these theoretical notions into an educational design with systemic instructional guidelines and multilevel procedures that may improve learning processes for different types of pupils. Internet-based Information and Communication Technology, or ICT, also plays a major role here. Third, I will report on concrete developments made in prototype research and trials. The development process concerns ICT-based differentiation of learning materials and procedures, and ICT-based strategies to improve pupil development and learning. Fourth, I will focus on the experience gained in primary and secondary educational practice with respect to implementation. We can learn much from such practical experience, in particular about the conditions for developing and implementing the necessary changes in and around schools. Finally, I will propose future research. As I hope to make clear, theory-based development and implementation research can join forces with systemic innovation and differentiated assessment in educational practice, to pave the way for optimal “learning for self-regulation” for pupils, teachers, parents, schools, and society at large.