Addressing Multilevel Program Complexity by Evaluation Design

In this paper, we present the evaluation design for a complex multilevel program recently introduced in Switzerland. The evaluation embraces the federal level, the cantonal program level, and the project level where target groups are directly addressed. We employ Pawson and Tilley’s realist evaluation approach, in order to do justice to the varying context factors that impact the cantonal programs leading to varying effectiveness of the implemented activities. The application of the model to the canton of Uri shows that the numerous vertical and horizontal relations play a crucial role for the program’s effectiveness. As a general learning for the evaluation of complex programs, we state that there is a need to consider all affected levels of a program and that no monocausal effects can be singled out in programs where multiple interventions address the same problem. Moreover, considering all affected levels of a program can mean going beyond the borders of the actual program organization and including factors that do not directly interfere with the policy delivery as such. In particular, we found that the relationship between the cantonal and the federal level was a crucial organizational factor influencing the effectiveness of the cantonal program.

Differentiating the Multipoint Expected Improvement for Optimal Batch Design

This work deals with parallel optimization of expensive objective functions which are modelled as sample realizations of Gaussian processes. The study is formalized as a Bayesian optimization problem, or continuous multi-armed bandit problem, where a batch of q > 0 arms is pulled in parallel at each iteration. Several algorithms have been developed for choosing batches by trading off exploitation and exploration. As of today, the maximum Expected Improvement (EI) and Upper Confidence Bound (UCB) selection rules appear as the most prominent approaches for batch selection. Here, we build upon recent work on the multipoint Expected Improvement criterion, for which an analytic expansion relying on Tallis’ formula was recently established. The computational burden of this selection rule being still an issue in application, we derive a closed-form expression for the gradient of the multipoint Expected Improvement, which aims at facilitating its maximization using gradient-based ascent algorithms. Substantial computational savings are shown in application. In addition, our algorithms are tested numerically and compared to state-of-the-art UCB-based batchsequential algorithms. Combining starting designs relying on UCB with gradient-based EI local optimization finally appears as a sound option for batch design in distributed Gaussian Process optimization.

Context Aware e-Learning Objects and their Types from the Perspective of the Object-Oriented Paradigm

The contribution of this article demonstrates how to identify context-aware types of e-Learning objects (eLOs) derived from the subject domains. This perspective is taken from an engineering point of view and is applied during requirements elicitation and analysis relating to present work in constructing an object-oriented (OO), dynamic, and adaptive model to build and deliver packaged e-Learning courses. Consequently, three preliminary subject domains are presented and, as a result, three primitive types of eLOs are posited. These types educed from the subject domains are of structural, conceptual, and granular nature. Structural objects are responsible for the course itself, conceptual objects incorporate adaptive and logical interoperability, while granular objects congregate granular assets. Their differences, interrelationships, and responsibilities are discussed. A major design challenge relates to adaptive behaviour. Future research addresses refinement on the subject domains and adaptive hypermedia systems.

The Comprehensive Assessment of Leadership for Learning: A Next Generation Formative Evaluation and Feedback System

Recent developments in federal policy have prompted the creation of state evaluation frameworks for principals and teachers that hold educators accountable for effective practices and student outcomes. These changes have created a demand for formative evaluation instruments that reflect current accountability pressures and can be used by schools to focus school improvement and leadership development efforts. The Comprehensive Assessment of Leadership for Learning (CALL) is a next generation, 360-degree on-line assessment and feedback system that reflect best practices in feedback design. Some unique characteristics of CALL include a focus on: leadership distributed throughout the school rather than as carried out by an individual leader; assessment of leadership tasks rather than perceptions of leadership practice; a focus on larger complex systems of middle and high school; and transparency of assessment design. This paper describes research contributing to the design and validation of the CALL survey instrument.

Educational orientation regarding vocabulary and literacy access : Evaluating the impact of an intervention program designed to promote early learning at home

El estudio evalúa el impacto de un programa de promoción del desarrollo lingüístico y cognitivo para niños de 5 años implementado según dos modalidades: una que implicó acciones de alfabetización familiar en los hogares de los niños (modalidad intensiva) y otra que incluyó la participación de los niños en las salas de jardín de infantes (modalidad extensiva). La evaluación del impacto se realizó por medio de un diseño pre-test ? post-test. Se tomaron pruebas de vocabulario receptivo (VR), producción de categorías (PC) y escritura a una muestra de 214 niños participantes de la modalidad intensiva, 69 participantes de la modalidad extensiva y un grupo control de no participó del programa (49 niños). Los resultados mostraron que la participación en la modalidad intensiva implicó un mayor incremento en las habilidades infantiles de VR, PC que en la modalidad extensiva. A su vez ambas modalidades experimentales mostraron un mayor incremento en las variables examinadas respecto de las observadas en el grupo control. No se detectaron efectos de la escolaridad de la madre y la asistencia previa al jardín. Los resultados mostraron correlaciones significativas entre todas las variables analizadas y el valor predictivo de los puntajes en VR a principio de año respecto de los puntajes en VR y escritura a fin de año.

Society, family and learning. The role of home literacy environments

This paper explores the relation between society, family, and learning. In particular, it addresses the features of home literacy environments in low income families and their impact on children's pre-literacy skills and knowledge. Sixty-two four/five-year-old children and their mothers were randomly selected for this study. The mothers were interviewed using an adaptation of a family literacy environment survey (Whitehurst, 1992). The children were assessed with specific tests to examine the scope of their 'early literacy'. The results revealed significant variability in the features and practices of home literacy environments as well as in the children's emerging pre-literacy skills and knowledge. The correlation between the two variables shows low to moderate statistical significance. The implications of such findings are discussed. Additionally, the purpose of isolating relevant features of the children and their home environments is to identify specific indicators related to the literacy fostering process. Ultimately, the goal is to design adequate, timely, and systematic intervention strategies aimed at preventing difficulties related to written language learning in children that could be considered at risk.

Educational orientation regarding vocabulary and literacy access : Evaluating the impact of an intervention program designed to promote early learning at home

El estudio evalúa el impacto de un programa de promoción del desarrollo lingüístico y cognitivo para niños de 5 años implementado según dos modalidades: una que implicó acciones de alfabetización familiar en los hogares de los niños (modalidad intensiva) y otra que incluyó la participación de los niños en las salas de jardín de infantes (modalidad extensiva). La evaluación del impacto se realizó por medio de un diseño pre-test ? post-test. Se tomaron pruebas de vocabulario receptivo (VR), producción de categorías (PC) y escritura a una muestra de 214 niños participantes de la modalidad intensiva, 69 participantes de la modalidad extensiva y un grupo control de no participó del programa (49 niños). Los resultados mostraron que la participación en la modalidad intensiva implicó un mayor incremento en las habilidades infantiles de VR, PC que en la modalidad extensiva. A su vez ambas modalidades experimentales mostraron un mayor incremento en las variables examinadas respecto de las observadas en el grupo control. No se detectaron efectos de la escolaridad de la madre y la asistencia previa al jardín. Los resultados mostraron correlaciones significativas entre todas las variables analizadas y el valor predictivo de los puntajes en VR a principio de año respecto de los puntajes en VR y escritura a fin de año.

Society, family and learning. The role of home literacy environments

This paper explores the relation between society, family, and learning. In particular, it addresses the features of home literacy environments in low income families and their impact on children's pre-literacy skills and knowledge. Sixty-two four/five-year-old children and their mothers were randomly selected for this study. The mothers were interviewed using an adaptation of a family literacy environment survey (Whitehurst, 1992). The children were assessed with specific tests to examine the scope of their 'early literacy'. The results revealed significant variability in the features and practices of home literacy environments as well as in the children's emerging pre-literacy skills and knowledge. The correlation between the two variables shows low to moderate statistical significance. The implications of such findings are discussed. Additionally, the purpose of isolating relevant features of the children and their home environments is to identify specific indicators related to the literacy fostering process. Ultimately, the goal is to design adequate, timely, and systematic intervention strategies aimed at preventing difficulties related to written language learning in children that could be considered at risk.

Educational orientation regarding vocabulary and literacy access : Evaluating the impact of an intervention program designed to promote early learning at home

El estudio evalúa el impacto de un programa de promoción del desarrollo lingüístico y cognitivo para niños de 5 años implementado según dos modalidades: una que implicó acciones de alfabetización familiar en los hogares de los niños (modalidad intensiva) y otra que incluyó la participación de los niños en las salas de jardín de infantes (modalidad extensiva). La evaluación del impacto se realizó por medio de un diseño pre-test ? post-test. Se tomaron pruebas de vocabulario receptivo (VR), producción de categorías (PC) y escritura a una muestra de 214 niños participantes de la modalidad intensiva, 69 participantes de la modalidad extensiva y un grupo control de no participó del programa (49 niños). Los resultados mostraron que la participación en la modalidad intensiva implicó un mayor incremento en las habilidades infantiles de VR, PC que en la modalidad extensiva. A su vez ambas modalidades experimentales mostraron un mayor incremento en las variables examinadas respecto de las observadas en el grupo control. No se detectaron efectos de la escolaridad de la madre y la asistencia previa al jardín. Los resultados mostraron correlaciones significativas entre todas las variables analizadas y el valor predictivo de los puntajes en VR a principio de año respecto de los puntajes en VR y escritura a fin de año.

Society, family and learning. The role of home literacy environments

This paper explores the relation between society, family, and learning. In particular, it addresses the features of home literacy environments in low income families and their impact on children's pre-literacy skills and knowledge. Sixty-two four/five-year-old children and their mothers were randomly selected for this study. The mothers were interviewed using an adaptation of a family literacy environment survey (Whitehurst, 1992). The children were assessed with specific tests to examine the scope of their 'early literacy'. The results revealed significant variability in the features and practices of home literacy environments as well as in the children's emerging pre-literacy skills and knowledge. The correlation between the two variables shows low to moderate statistical significance. The implications of such findings are discussed. Additionally, the purpose of isolating relevant features of the children and their home environments is to identify specific indicators related to the literacy fostering process. Ultimately, the goal is to design adequate, timely, and systematic intervention strategies aimed at preventing difficulties related to written language learning in children that could be considered at risk.

Multidisciplinary Learning, Another way of Teaching Maths in Engineering

Multidisciplinary training is widely appreciated in industry and business, and nevertheless usually is not addressed in the early stages of most undergraduate programs. We outline here a multidisciplinary course for undergraduates studying engineering in which mathematics would be the common language, the transverse tool. The goal is motivating students to learn more mathematics and as a result, improve the quality of engineering education. The course would be structured around projects in four branches in engineering: mechanical, electrical, civil and bio-tech. The projects would be chosen among a wide variety of topics in engineering practice selected with the guidance of professional engineers. In these projects mathematics should interact with at least two other basic areas of knowledge in engineering: chemistry, computers science, economics, design or physics.

Integrated learning of computer applications for production engineering

A high productivity rate in Engineering is related to an efficient management of the flow of the large quantities of information and associated decision making activities that are consubstantial to the Engineering processes both in design and production contexts. Dealing with such problems from an integrated point of view and mimicking real scenarios is not given much attention in Engineering degrees. In the context of Engineering Education, there are a number of courses designed for developing specific competencies, as required by the academic curricula, but not that many in which integration competencies are the main target. In this paper, a course devoted to that aim is discussed. The course is taught in a Marine Engineering degree but the philosophy could be used in any Engineering field. All the lessons are given in a computer room in which every student can use each all the treated software applications. The first part of the course is dedicated to Project Management: the students acquire skills in defining, using Ms-PROJECT, the work breakdown structure (WBS), and the organization breakdown structure (OBS) in Engineering projects, through a series of examples of increasing complexity, ending up with the case of vessel construction. The second part of the course is dedicated to the use of a database manager, Ms-ACCESS, for managing production related information. A series of increasing complexity examples is treated ending up with the management of the pipe database of a real vessel. This database consists of a few thousand of pipes, for which a production timing frame is defined, which connects this part of the course with the first one. Finally, the third part of the course is devoted to the work with FORAN, an Engineering Production package of widespread use in the shipbuilding industry. With this package, the frames and plates where all the outfitting will be carried out are defined through cooperative work by the studens, working simultaneously in the same 3D model. In the paper, specific details about the learning process are given. Surveys have been posed to the students in order to get feed-back from their experience as well as to assess their satisfaction with the learning process. Results from these surveys are discussed in the paper

Games based learning for Exploring Cultural Conflict

In this paper we discuss the early stage design of MIXER, a technology enhance educational application focused at supporting children in learning about cultural conflict, achieved through the use of a game with an effective embodied AI agent. MIXER is being developed re-using existing technology applied to a different context and purpose with the aim of creating an educational and enjoyable experience for 9-11 year olds. This paper outlines MIXER’s underpinning technology and theory. It presents early stage design and development, highlighting current research directions.

e-MIS Contents: Multimedia Contents for e-Learning Environments in Minimally Invasive Surgery

This work describes the design and application of multimedia contents for web technologies-based training in minimally invasive surgery (MIS). The chosen strategy allows knowing the deficiencies of the current training methods so new multimedia contents can cover them. This study is concluded with the definition of three different types of multimedia contents accordingly to the development degree and didactic objectives that they present: Didactic resources are basic contents such as videos or documents that can be enhanced with contributions of users. On the other hand, case reports and didactic units have a defined structure. Didactic resources and case reports provide an informal training while didactic units are included in a more regulated training.

Virtual Learning Environments In Faculties Of Education In Spain: Changes On Student Attitude

This paper presents some results of a R+D project entitled “e-Learning system for Practical Training of University students in Education Faculties (ForELearn)”, developed in Spain by the Universidad de Granada and the Universidad Politécnica de Madrid and funded by the Spanish Ministry of Education. In a first phase, through the use of AulaWeb Learning Management System, a set of adaptations and improvements of this software application have been done for the design and development of an experimental course of Practicum supervision. Next, the implementation of this course by means of a group of face to face and online seminars provides experimental data for the analysis and discussion about the point of view of users (preservice teachers) that have tracked their practice supervision with AulaWeb.