How teachers think about the role of digital technologies in student assessment in mathematics

This study concerns teachers’ use of digital technologies in student assessment, and how the learning that is developed through the use of technology in mathematics can be evaluated. Nowadays math teachers use digital technologies in their teaching, but not in student assessment. The activities carried out with technology are seen as ‘extra-curricular’ (by both teachers and students), thus students do not learn what they can do in mathematics with digital technologies. I was interested in knowing the reasons teachers do not use digital technology to assess students’ competencies, and what they would need to be able to design innovative and appropriate tasks to assess students’ learning through digital technology. This dissertation is built on two main components: teachers and task design. I analyze teachers’ practices involving digital technologies with Ruthven’s Structuring Features of Classroom Practice, and what relation these practices have to the types of assessment they use. I study the kinds of assessment tasks teachers design with a DGE (Dynamic Geometry Environment), using Laborde’s categorization of DGE tasks. I consider the competencies teachers aim to assess with these tasks, and how their goals relate to the learning outcomes of the curriculum. This study also develops new directions in finding how to design suitable tasks for student mathematical assessment in a DGE, and it is driven by the desire to know what kinds of questions teachers might be more interested in using. I investigate the kinds of technology-based assessment tasks teachers value, and the type of feedback they give to students. Finally, I point out that the curriculum should include a range of mathematical and technological competencies that involve the use of digital technologies in mathematics, and I evaluate the possibility to take advantage of technology feedback to allow students to continue learning while they are taking a test.

The Clearing Storm: A Re-Assessment of the Climate for Collaboration between Academic and Student Affairs

There is increasing recognition among those in higher education that it is no longer adequate to train students in a specific field or industry. Instead, the push is more towards producing well-rounded students. In order to do so, all of a university’s resources must come together and the climate on campus must be one that supportscollaboration. This report is a re-examination of the climate for collaboration on the campus of a private liberal arts university in the Mid-Atlantic region of the United States. It is a follow up to a similar investigation conducted on the same campus by Victor Arcelus(2008) five years earlier. In the interim, the university had re-configured its organizational structure, combining separate academic and student affairs divisions into a single unit overseen by the Provost. Additionally, the university had experienced turnover in several key leadership positions, including those of the President and the chief academic and student affairs officers. The purpose of this investigation, therefore, was to gauge the immediate impact of these changes on conditions for collaboration, which when present, advance student learning and development. Through interviews with six men and women, information was collected on the perceived climate for collaboration between academic and student affairs personnel.Analysis of the interview transcripts revealed that, depending on the position of the interviewee within the university, conditions on campus were seen as either improved or largely unchanged as a result of the transition in leadership and the structural merger of the two divisions.

Studying students' opinions : using surveys in writing program assessment

Administrators of writing programs are regularly faced with the problem of assessing the learning that students gain in their coursework. Many methods of assessment exist, but most have some problems associated with them related to the amount of time it takes to perform the study or the scope of the knowledge gained relative to number of participants or volume of information collected. This pilot study investigates the use of surveys of student opinion for their potential to assess composition instruction at Michigan Technological University. The primary goal of this pilot study is to test the effectiveness of using data collected in surveys to make recommendations for improvement of the composition program at Michigan Tech. The report concludes with recommendations for additional study and refinements to the instruments used.

Embedding e-portfolios for effective lifelong learning:a case study

Lifelong learning is a ‘keystone’ of educational policies (Faure, 1972) where the emphasis on learning shifts from teacher to learner. Higher Education (HE) institutions should be committed to developing lifelong learning, that is promoting learning that is flexible, diverse and relevant at different times, and in different places, and is pursued throughout life. Therefore the HE sector needs to develop effective strategies to encourage engagement in meaningful learning for diverse student populations. The use of e-portfolios, as a ‘purposeful aggregation of digital items’ (Sutherland & Powell, 2007), can meet the needs of the student community by encouraging reflection, the recording of experiences and achievements, and personal development planning (PDP). The use of e-portfolios also promotes inclusivity in learning as it provides students with the opportunity to articulate their aspirations and take the first steps along the pathway of lifelong learning. However, ensuring the uptake of opportunities within their learning is more complex than the students simply having access to the software. Therefore it is argued here that crucial to the effective uptake and engagement of the e-portfolio is embedding it purposefully within the curriculum. In order to investigate effective implementation of e-portfolios an explanatory case study on their use was carried out, initially focusing on 3 groups of students engaged in work-based learning and professional practice. The 3 groups had e-Portfolios embedded and assessed at different levels. Group 1 did not have the e-Portfolio embedded into their curriculum nor was the e-Portfolio assessed. Group 2 had the e-Portfolio embedded into the curriculum and formatively assessed. Group 3 also had the e-Portfolio embedded into the curriculum and were summatively assessed. Results suggest that the use of e-Portfolios needs to be integral to curriculum design in modules rather than used as an additional tool. In addition to this more user engagement was found in group 2 where the e-Portfolio was formatively assessed only. The implications of this case study are further discussed in terms of curriculum development.

The Library of Birmingham project:lifelong learning for the digital age

The Library of Birmingham (LoB) is a £193million project designed to provide a new space for lifelong learning and knowledge growth, a physical and virtual portal for Birmingham's citizens to the wider world. In cooperation with a range of private, public, and third-sector bodies, as well as individual citizens, the library, due to open in June 2013, will articulate a continuing process of organic growth and emergence. Key delivery themes focus on: arts and creativity, citizenship and community, enterprise and innovation, learning and skills and the new media ecology. A landmark design in the heart of the cultural district of the city, the LoB aims to stimulate sustainable economic growth, urban regeneration and social inclusion by offering a wide range of new digital learning services, real and virtual community spaces, and new opportunities for interpreting and exploiting internationally significant collections of documentary archives, photography, moving image, and rare printed books. Additionally, the LoB will offer physical space for creative, cultural, enterprise, and knowledge development. This paper outlines the cultural and educational thinking that informs the project and the challenges experienced in developing innovative service redesign.

Arts for Learning/Miami Professional Development Program: Does It Measure Up?

This paper examines the relationship between student achievement, teacher practice, and professional development programs for teachers. A theoretical program model is then created and used to evaluate the Arts for Learning/Miami program model.

Content Analysis of Outcome Assessment of Global Learning Foundations Courses: A Case Study

This study used content analysis to interpret and evaluate outcome evaluation matrices of undergraduate Global Learning foundations courses. The findings revealed a lack of uniformity in the faculty members’ interpretation and implementation of global learning components in the coursework. Successful teaching practices and challenges were identified and classified.

Authentic Experiences Assessment Instrument: The Case of Millennial Students and Cultural Attractions in Central Florida

Three types of authenticity were chosen to analyze cultural attractions—they were: staged or real authenticity, sensory authenticity, and existential authenticity. A group of millennium students that visited Orlando’s cultural attractions from the University of Central Florida were part of this study. Results show that the term “culture” is unclear among students. Also gender might play a role in determining what is perceived as “authenticity.” In general the focus group discussion had a consensus that these three types of authenticity were the right ones to measured cultural attractions, people, and behaviors.

'Lines of flight': digital musical instruments, inclusive music bands, meaningful engagement in music-making and learning

In this study I examine the development of three inclusive music bands in Cork city. Derived from Jellison’s research on inclusive music education, inclusive music bands involve students with disabilities coming together with typically developing peers to make and learn music that is meaningful (Jellison, 2012). As part of this study, I established three inclusive music bands to address the lack of inclusive music making and learning experiences in Cork city. Each of these bands evolved and adapted in order to be socio-culturally relevant within formal and informal settings: Circles (community education band), Till 4 (secondary school band) and Mish Mash (third level and community band). I integrated Digital Musical Instruments into the three bands, in order to ensure access to music making and learning for band members with profound physical disabilities. Digital Musical Instruments are electronic music devices that facilitate active music making with minimal movement. This is the first study in Ireland to examine the experiences of inclusive music making and learning using Digital Musical Instruments. I propose that the integration of Digital Musical Instruments into inclusive music bands has the potential to further the equality and social justice agenda in music education in Ireland. In this study, I employed qualitative research methodology, incorporating participatory action research methodology and case study design. In this thesis I reveal the experiences of being involved in an inclusive music band in Cork city. I particularly focus on examining whether the use of this technology enhances meaningful music making and learning experiences for members with disabilities within inclusive environments. To both inform and understand the person centered and adaptable nature of these inclusive bands, I draw theoretical insights from Sen’s Capabilities Approach and Deleuze and Guatarri’s Rhizome Theory. Supported by descriptive narrative from research participants and an indepth examination of literature, I discover the optimum conditions and associated challenges of inclusive music practice in Cork city.

Digital anthropology and educational eGames: learning through behavioural patterns in digital, game-based contexts

The selected publications are focused on the relations between users, eGames and the educational context, and how they interact together, so that both learning and user performance are improved through feedback provision. A key part of this analysis is the identification of behavioural, anthropological patterns, so that users can be clustered based on their actions, and the steps taken in the system (e.g. social network, online community, or virtual campus). In doing so, we can analyse large data sets of information made by a broad user sample,which will provide more accurate statistical reports and readings. Furthermore, this research is focused on how users can be clustered based on individual and group behaviour, so that a personalized support through feedback is provided, and the personal learning process is improved as well as the group interaction. We take inputs from every person and from the group they belong to, cluster the contributions, find behavioural patterns and provide personalized feedback to the individual and the group, based on personal and group findings. And we do all this in the context of educational games integrated in learning communities and learning management systems. To carry out this research we design a set of research questions along the 10-year published work presented in this thesis. We ask if the users can be clustered together based on the inputs provided by them and their groups; if and how these data are useful to improve the learner performance and the group interaction; if and how feedback becomes a useful tool for such pedagogical goal; if and how eGames become a powerful context to deploy the pedagogical methodology and the various research methods and activities that make use of that feedback to encourage learning and interaction; if and how a game design and a learning design must be defined and implemented to achieve these objectives, and to facilitate the productive authoring and integration of eGames in pedagogical contexts and frameworks. We conclude that educational games are a resourceful tool to provide a user experience towards a better personalized learning performance and an enhance group interaction along the way. To do so, eGames, while integrated in an educational context, must follow a specific set of user and technical requirements, so that the playful context supports the pedagogical model underneath. We also conclude that, while playing, users can be clustered based on their personal behaviour and interaction with others, thanks to the pattern identification. Based on this information, a set of recommendations are provided Digital Anthropology and educational eGames 6 /216 to the user and the group in the form of personalized feedback, timely managed for an optimum impact on learning performance and group interaction level. In this research, Digital Anthropology is introduced as a concept at a late stage to provide a backbone across various academic fields including: Social Science, Cognitive Science, Behavioural Science, Educational games and, of course, Technology-enhance learning. Although just recently described as an evolution of traditional anthropology, this approach to digital behaviour and social structure facilitates the understanding amongst fields and a comprehensive view towards a combined approach. This research takes forward the already existing work and published research onusers and eGames for learning, and turns the focus onto the next step — the clustering of users based on their behaviour and offering proper, personalized feedback to the user based on that clustering, rather than just on isolated inputs from every user. Indeed, this pattern recognition in the described context of eGames in educational contexts, and towards the presented aim of personalized counselling to the user and the group through feedback, is something that has not been accomplished before.

The potential contributions of concept maps for learning website to assessment for learning practices

The purpose of this paper is to examine the promising contributions of the Concept Maps for Learning (CMfL) website to assessment for learning practices. The CMfL website generates concept maps from relatedness degree of concepts pairs through the Pathfinder Scaling Algorithm. This website also confirms the established principles of effective assessment for learning, for it is capable of automatically assessing students' higher order knowledge, simultaneously identifying strengths and weaknesses, immediately providing useful feedback and being user-friendly. According to the default assessment plan, students first create concept maps on a particular subject and then they are given individualized visual feedback followed by associated instructional material (e.g., videos, website links, examples, problems, etc.) based on a comparison of their concept map and a subject matter expert's map. After studying the feedback and instructional material, teachers can monitor their students' progress by having them create revised concept maps. Therefore, we claim that the CMfL website may reduce the workload of teachers as well as provide immediate and delayed feedback on the weaknesses of students in different forms such as graphical and multimedia. For the following study, we will examine whether these promising contributions to assessment for learning are valid in a variety of subjects.

Barnsley College: Rethinking assessment of work-based learning

Barnsley College’s level 3 and 4 diplomas in digital learning design are delivered in one year, enabling apprentices to be employed alongside their studies in the college’s innovative learning design company, Elephant Learning Designs. The limited time this allows for delivery and assessment has prompted course leaders to rethink their approach to course structure, assessment and feedback design, and the role of technology in evidence collection.

An Assessment of Professional Development for Astronomy and Physics Faculty: Expanding Our Vision of How to Support Faculty's Learning About Teaching

In this thesis, we will explore approaches to faculty instructional change in astronomy and physics. We primarily focus on professional development (PD) workshops, which are a central mechanism used within our community to help faculty improve their teaching. Although workshops serve a critical role for promoting more equitable instruction, we rarely assess them through careful consideration of how they engage faculty. To encourage a shift towards more reflective, research-informed PD, we developed the Real-Time Professional Development Observation Tool (R-PDOT), to document the form and focus of faculty's engagement during workshops. We then analyze video-recordings of faculty's interactions during the Physics and Astronomy New Faculty Workshop, focusing on instances where faculty might engage in pedagogical sense-making. Finally, we consider insights gained from our own local, team-based effort to improve a course sequence for astronomy majors. We conclude with recommendations for PD leaders and researchers.

Best-practice model for technology enhanced learning in the creative arts

This paper presents a best-practice model for the redesign of virtual learning environments (VLEs) within creative arts to augment blended learning. In considering a blended learning best-practice model, three factors should be considered: the conscious and active human intervention, good learning design and pedagogical input, and the sensitive handling of the process by trained professionals. This study is based on a comprehensive VLE content analysis conducted across two academic schools within the creative arts at one Post-92 higher education (HE) institution. It was found that four main barriers affect the use of the VLE within creative arts: lack of flexibility in relation to navigation and interface, time in developing resources, competency level of tutors (confidence in developing online resources balanced against other flexible open resources) and factors affecting the engagement of ‘digital residents’. The experimental approach adopted in this study involved a partnership between the learning technology advisor and academic staff, which resulted in a VLE best-practice model that focused directly on improving aesthetics and navigation. The approach adopted in this study allowed a purposive sample of academic staff to engage as participants, stepping back cognitively from their routine practices in relation to their use of the VLE and questioning approaches to how they embed the VLE to support teaching and learning. The model presented in this paper identified a potential solution to overcome the challenges of integrating the VLE within creative arts. The findings of this study demonstrate positive impact on staff and student experience and provide a sustainable model of good practice for the redesign of the VLE within creative disciplines.