Evaluation of online higher education: learning, interaction and technology

The work presents a theoretical framework for the evaluation of e-Teaching that aims at positioning the online activities designed and developed by the teacher as to the Learning, Interaction and Technology Dimensions. The theoretical research that underlies the study was developed reflecting current thinking on the promotion of quality of teaching and of the integration of information and communication tools into the curriculum in Higher Education (HE), i.e., bearing in mind some European guidelines and policies on this subject. This way, an answer was sought to be given to one of the aims put forward in this study, namely to contribute towards the development of a conceptual framework to support research on evaluation of e-teaching in the context of HE. Based on the theoretical research carried out, an evaluation tool (SCAI) was designed, which integrates the two questionnaires developed to collect the teachers' and the students' perceptions regarding the development of e-activities. Consequently, an empirical study was structured and carried out, allowing SCAI tool to be tested and validated in real cases. From the comparison of the theoretical framework established and the analysis of the data obtained, we found that the differences in teaching should be valued and seen as assets by HE institutions rather than annihilated in a globalizing perspective.

Virtual Mobility and Learning for PhD students of six European Countries: students’ programme evaluation

In this paper, the authors, as teachers of the Virtual Mobility and Learning ERASMUS Intensive Programme (VML–IP), put forward an analysis of the student’s final evaluation of the Programme as to the most important competences they have developed. In terms of methodology, this study has an exploratory and descriptive nature; hence, being based on empiric evidence. Thus, in the last face-to-face session, students were asked by the Programme’s coordination to present an overall evaluation of their experience in the VML–IP. Data were collected in loco, i.e. through the posters created by each group, as well as the video of the students’ oral presentations. They were later analysed using content analysis as data analysis technique. The results unveil that, although the main goal was fulfilled – i.e. to be able to design and implement a course on a ‘Virtual Mobility and Learning’ topic underpinned by solid theoretical background in the area –, the fact is that every group also pointed out several soft competences as a very important part of their experiences, and crucial for their development as students and future professionals.

Avaliação em contextos de blended learning no ensino superior

The increasing complexity of the Information Society and the Bologna Declaration in the European context has led Higher Education (HE) institutions to revise their curricula courses, as far as the adoption of new strategies for teaching and learning as well as evaluation are concerned. It can also be emphasized that there has been a growing use of eLearning and of blended learning (bLearning) in HE, since these modes of training seem to be a very convenient option for lifelong learning. In this context, quality is taken as an essential goal in the development of the European Space for Education and Training, where HE institutions compete among themselves, and where evaluation is determinant as a promoter of this quality. Considering the problems summarized above, the research developed, based on four published scientific papers, intended to answer a set of research questions related to evaluation of bLearning contexts in HE. The study used diverse techniques and instruments (questionnaires, document analysis, and observation mediated technologies) spanning two methodological approaches: i) study of descriptive and exploratory nature and ii) case studies of bLearning modules. In the first approach an evaluation model for bLearning courses was developed, where we collected and analyzed, at a national level, the opinions of teachers with bLearning experience about the model dimensions. The case studies presented are post graduation curricular units, where bLearning teaching, learning and evaluation strategies were explored and evaluated, namely peer assessment. The main contributions of the first approach are: the process of questioning around the evaluation of bLearning courses, namely the quality assurance criteria for bLearning, as well as the model developed, providing a framework of theoretical, methodological and empirical elements that can be adapted in similar contexts. From the case studies emerged: the developed evaluation guidelines and the data collection instruments, in order to disseminate evaluation “best practices” that may be useful for other units in similar contexts. Regarding the recommendations about the evaluation of teaching of bLearning courses we emphasize: the use of versatile evaluation objects; the evaluation throughout the process and not just at the end; and the involvement of multiple evaluators, including students (whose feedback is essential to monitor the quality of teaching and learning). From the case studies we highlight: the need for discussion of evaluation frameworks to explore, and consequent increase in the transparency of the evaluation process; the increased interaction between groups; and the peer assessment as a strategy to promote active and autonomous learning. In addition to the contributions and recommendations for practice and research in the area of evaluation in bLearning contexts in HE, listed above, it also emerged from this study useful guidelines regarding educational evaluation in bLearning contexts, in order to improve the quality of teaching, learning and evaluation in such contexts.

European student mobility and intercultural learning at a portuguese university

The purpose of this study is to understand, impact and evaluate the development of intercultural communicative competencies among European credit-seeking exchange students and other sojourners through purposeful intercultural pedagogy. This pedagogy encompasses intentional intercultural- educational approaches which aim to support and enhance sojourners’ intercultural learning throughout the study abroad cycle (pre-departure, in-country and reentry phases). To test and validate these pedagogies a 20-hour intervention was designed and implemented among two cohorts of 31 sojourners during the in-country phase of their sojourn in Portugal. The process to develop and validate the intercultural intervention was driven by a mixed-methods methodology which combined quantitative and qualitative data to triangulate, complement and expand research results from a pragmatic stance. The mixed methods research design adopted is multi-phased and encompasses a multi-case study and an evaluative component. The multi-case component is embodied by sojourner cohorts: (1) the primary case study involves 19 incoming students at the University of Aveiro (Portugal) as participants in the European exchange program Campus Europae; (2) the second case study comprises three incoming Erasmus students and nine highly skilled immigrants at the same university. All 31 sojourners attended two intermediate Portuguese as Foreign Language classrooms where the intervention was employed. Data collection was extensive and involved collecting, analyzing and mixing quantitative and qualitative strands across four research phases. These phases refer to the: (1) development, (2) implementation and (3) evaluation of the intervention, as well as to (4) a stakeholder analysis of the external value of the intervention and of the Campus Europae program. Data collection instruments included pre and posttest questionnaires and semi-structured interviews. Results confirm the intercultural effectiveness of the intervention and the positive impact upon research participants’ intercultural gains. This impact was, however, greater in case study 2. Among explanatory variables, three stand out: (1) participant meaning-making abilities, (2) host language proficiency and related variables, and (3) type of sojourn or exchange programs. Implications for further research highlight the need to systematize purposeful intercultural pedagogy in sojourner populations in general, and in European credit student mobility in particular. In the latter case, these pedagogies should be part of the design and delivery of credit-bearing exchange programs in pre- departure, in-country and re-entry phases. Implications for practice point to the urge to improve intercultural practices in: macro (higher education institutions), mezzo (exchange programs) and micro (sojourner language classrooms) contexts where this research took place, and wider social scenarios they represent.

Master in Innovative Tourism Development: a blended learning experience in the Polytechnic Institute of Viana do Castelo

This chapter analyses a Portuguese HEI’s first experience with blended learning. Focusing on the Master in Innovative Tourism Development currently being held at the Superior School of Technology and Management of the Polytechnic Institute of Viana do Castelo, it presents the institutional background and rationale behind the course’s implementation, identifying its strengths and weaknesses, as well as areas of potential development. Based on an evaluation research carried out throughout the course’s first three editions and that involved students, faculty and institutional leaders, it summarizes the main results of a long term-study, putting forth a set of recommendations for improvements and defining potential areas of intervention in future editions of the course.