Implementation of an integrated, technology-based, discovery mode assessment item involving an incubation period to enhance learning outcomes for engineering maths students

In this paper we discuss our current efforts to develop and implement an exploratory, discovery mode assessment item into the total learning and assessment profile for a target group of about 100 second level engineering mathematics students. The assessment item under development is composed of 2 parts, namely, a set of "pre-lab" homework problems (which focus on relevant prior mathematical knowledge, concepts and skills), and complementary computing laboratory exercises which are undertaken within a fixed (1 hour) time frame. In particular, the computing exercises exploit the algebraic manipulation and visualisation capabilities of the symbolic algebra package MAPLE, with the aim of promoting understanding of certain mathematical concepts and skills via visual and intuitive reasoning, rather than a formal or rigorous approach. The assessment task we are developing is aimed at providing students with a significant learning experience, in addition to providing feedback on their individual knowledge and skills. To this end, a noteworthy feature of the scheme is that marks awarded for the laboratory work are primarily based on the extent to which reflective, critical thinking is demonstrated, rather than the amount of CBE-style tasks completed by the student within the allowed time. With regard to student learning outcomes, a novel and potentially critical feature of our scheme is that the assessment task is designed to be intimately linked to the overall course content, in that it aims to introduce important concepts and skills (via individual student exploration) which will be revisited somewhat later in the pedagogically more restrictive formal lecture component of the course (typically a large group plenary format). Furthermore, the time delay involved, or "incubation period", is also a deliberate design feature: it is intended to allow students the opportunity to undergo potentially important internal re-adjustments in their understanding, before being exposed to lectures on related course content which are invariably delivered in a more condensed, formal and mathematically rigorous manner. In our presentation, we will discuss in more detail our motivation and rationale for trailing such a scheme for the targeted student group. Some of the advantages and disadvantages of our approach (as we perceived them at the initial stages) will also be enumerated. In a companion paper, the theoretical framework for our approach will be more fully elaborated, and measures of student learning outcomes (as obtained from eg. student provided feedback) will be discussed.

Harnessing assessment and feedback in the first year to support learning success, engagement and retention

It has been argued that intentional first year curriculum design has a critical role to play in enhancing first year student engagement, success and retention (Kift, 2008). A fundamental first year curriculum objective should be to assist students to make the successful transition to assessment in higher education. Scott (2006) has identified that ‘relevant, consistent and integrated assessment … [with] prompt and constructive feedback’ are particularly relevant to student retention generally; while Nicol (2007) suggests that ‘lack of clarity regarding expectations in the first year, low levels of teacher feedback and poor motivation’ are key issues in the first year. At the very minimum, if we expect first year students to become independent and self-managing learners, they need to be supported in their early development and acquisition of tertiary assessment literacies (Orrell, 2005). Critical to this attainment is the necessity to alleviate early anxieties around assessment information, instructions, guidance, and performance. This includes, for example:  inducting students thoroughly into the academic languages and assessment genres they will encounter as the vehicles for evidencing learning success; and  making expectations about the quality of this evidence clear. Most importantly, students should receive regular formative feedback of their work early in their program of study to aid their learning and to provide information to both students and teachers on progress and achievement. Leveraging research conducted under an ALTC Senior Fellowship that has sought to articulate a research-based 'transition pedagogy' (Kift & Nelson, 2005) – a guiding philosophy for intentional first year curriculum design and support that carefully scaffolds and mediates the first year learning experience for contemporary heterogeneous cohorts – this paper will discuss theoretical and practical strategies and examples that should be of assistance in implementing good assessment and feedback practices across a range of disciplines in the first year.

Writing together, learning together : the value and effectiveness of a research writing group for doctoral students

The high level of scholarly writing required for a doctoral thesis is a challenge for many research students. However, formal academic writing training is not a core component of many doctoral programs. Informal writing groups for doctoral students may be one method of contributing to the improvement of scholarly writing. In this paper, we report on a writing group that was initiated by an experienced writer and higher degree research supervisor to support and improve her doctoral students’ writing capabilities. Over time, this group developed a workable model to suit their varying needs and circumstances. The model comprised group sessions, an email group, and individual writing. Here, we use a narrative approach to explore the effectiveness and value of our research writing group model in improving scholarly writing. The data consisted of doctoral students’ reflections to stimulus questions about their writing progress and experiences. The stimulus questions sought to probe individual concerns about their own writing, what they had learned in the research writing group, the benefits of the group, and the disadvantages and challenges to participation. These reflections were analysed using thematic analysis. Following this analysis, the supervisor provided her perspective on the key themes that emerged. Results revealed that, through the writing group, members learned technical elements (e.g., paragraph structure), non-technical elements (e.g., working within limited timeframes), conceptual elements (e.g., constructing a cohesive arguments), collaborative writing processes, and how to edit and respond to feedback. In addition to improved writing quality, other benefits were opportunities for shared writing experiences, peer support, and increased confidence and motivation. The writing group provides a unique social learning environment with opportunities for: professional dialogue about writing, peer learning and review, and developing a supportive peer network. Thus our research writing group has proved an effective avenue for building doctoral students’ capability in scholarly writing. The proposed model for a research writing group could be applicable to any context, regardless of the type and location of the university, university faculty, doctoral program structure, or number of postgraduate students. It could also be used within a group of students with diverse research abilities, needs, topics and methodologies. However, it requires a group facilitator with sufficient expertise in scholarly writing and experience in doctoral supervision who can both engage the group in planned writing activities and also capitalise on fruitful lines of discussion related to students’ concerns as they arise. The research writing group is not intended to replace traditional supervision processes nor existing training. However it has clear benefits for improving scholarly writing in doctoral research programs particularly in an era of rapidly increasing student load.

Assessment for learning : a sociocultural approach

Assessment for Learning (AfL) is a title given to classroom evaluative practices that share the purpose of diagnosing and informing teachers and students about learning progress, during the learning process. These practices also have the potential to develop learner autonomy by increasing student motivation and mastery through developing the learner's capacity to monitor and plan his or her own learning progress. Yet teacher adoption of the practices is not a straightforward implementation of techniques within an existing classroom repertoire. Recent research highlights a more complex interrelationship between teacher and student beliefs, identities, and traditions of power within assessment and learning in classroom contexts. These often hidden relationships can add layers of complexity for teachers implementing assessment change, and may act as barriers that frustrate efforts to realise the AfL goal of learner autonomy. By interpreting AfL practices from a sociocultural perspective, the social and cultural contexts that influence classroom assessment can be better understood. In turn teachers can thus be better supported in adopting AfL practices within the complexities of the social, cultural and policy contexts of schooling.

Milk : students building mobile learning games in everyday places

This paper explores how mobile games can transform everyday places into dynamic learning spaces filled with information and inspiration. It discusses the motivation inherent in playing games and creating games for others, and how this stimulates an iterative process of creation and reflection and evokes a natural desire to engage in learning. The use of MiLK at the Adelaide Botanic Gardens is offered as a case in point. MiLK is an authoring tool that allows students and teachers to create and share SMS games for mobile phones. A group of South Australian high school students used MiLK to play a game, create their own games and play each other’s games during a day at the gardens. This paper details the learning processes involved in these activities and how the students reflected on their learning, conducted peer assessment, and engaged in a two-way discussion with their teacher about new technologies and their implications for learning. The paper concludes with a discussion of the needs and requirements of 21st Century learners and how MiLK can support constructivist and connectivist teaching methods that engage learners and may produce an appropriately skilled future workforce.

Case study of collaborative learning in two contexts : what do students gain?

This book presents important research advances in the study of teaching and teacher research as well as a review of motivation in education; mentoring; an evaluation of online learning; educational change and computer-assisted teaching.

Scaffolding large units for small group collaborative learning : a case study.

Undergraduates working in teams can be a problematic endeavour, sometimes exacerbated for the student by poor prior experiences, a predisposition to an individual orientation of assessment, and simply the busyness that now typifies the life of a student. But effort in pedagogical design is worthwhile where team work is often a prerequisite in terms of graduate capabilities, robust learning, increased motivation, and indeed in terms of equipping individuals for emergent knowledge-age work practice, often epitomised by collaborative effort in both blended and virtual contexts. Through an iterative approach, based extensively on the established literature, we have developed a successful scaffold which is workable with a large cohort group (n >800), such that it affords students the lived experience of being a part of a learning network. Individuals within teams work together, to develop individual components that are subsequently aggregated and reified to an overall team knowledge artefact. We describe our case and propose a pedagogical model of scaffolding based on three perspectives: conceptual, rule-based and community-driven. This model provides designers with guidelines for producing and refining assessment tasks for team-based learning.

Observational assessment and maternal reports of motivation in children and adolescents with Down Syndrome

Despite a lack of consistent empirical evidence, there has been an ongoing assumption that intellectual disability is associated with reduced levels of motivation. The participants in this study were 33 children with Down syndrome ages 10–15 years and 33 typically developing 3–8-year-old children. Motivation was measured through observational assessments of curiosity, preference for challenge, and persistence, as well as maternal reports. There were no significant group differences on motivation tasks, but mothers of children with Down syndrome rated their children significantly lower on motivation than did parents of typically developing children. There were some intriguing group differences in the pattern of correlations among observations and parent reports. The findings challenge long-held views that individuals with intellectual disability are invariably deficient in motivation.

Assessment for learning - Why the theory needs the practice

Assessment for Learning is a pedagogical practice with anticipated gains of increased student motivation, mastery and autonomy as learners develop their capacity to monitor and plan their own learning progress. Assessment for Learning (AfL) differs from Assessment of learning in its timing, occurring within the regular flow of learning rather than end point, in its purpose of improving student learning rather than summative grading and in the ownership of the learning where the student voice is heard in judging quality. Since Black and Wiliam (1998) highlighted the achievement gains that AfL practices seem to bring to all learners in classrooms, it has become part of current educational policy discourse in Australia, yet teacher adoption of the practices is not a straightforward implementation of techniques within an existing classroom repertoire. As can be seen from the following meta-analysis, recent research highlights a more complex interrelationship between teacher and student beliefs about learning and assessment, and the social and cultural interactions in and contexts of the classroom. More research is needed from a sociocultural perspective that allows meaning to emerge from practice. Before another policy push, we need to understand better the many factors within the assessment relationship. We need to hear from teachers and students through long-term AfL case studies both to inform AfL theory and to shed light on the complexities of pedagogical change for enhancing learner autonomy.

Scaffolding techniques : a teacher training for cooperative learning in Thailand primary education

In general, the benefits of using cooperative learning include academic achievement, communication skills, problem-solving, social skills and student motivation. Yet cooperative learning as a Western educational concept may be ineffective in a different learning system. The study aims to investigate scaffolding techniques for cooperative learning in Thailand primary education. The program was designed to foster Thai primary school teachers’ cooperative learning implementation that includes the basic tenets of cooperative learning and socio-cognitive based learning. Two teachers were invited to participate in this experimental teacher training program for one and a half weeks. Then the teachers implemented a cooperative learning in their mathematics class for six weeks. The data from teacher interview and classroom observation indicated that the both teachers are able to utilise questions to scaffold their students’ engagement in cooperative learning. This initiative study showed that difficulty or failure of implementing cooperative learning in Thailand education may not be derived from cultural difference. The paper discussed the techniques the participant teachers applied with proactive scaffolding, reactive scaffolding and scaffolding questions that can be used to facilitate the implementation of cooperative learning in Thai school.

Perceptions of online learning in an Australian university : Malaysian students' perspectives

Several researchers have reported that cultural and language differences can affect online interactions and communications between students from different cultural backgrounds. Other researchers have asserted that online learning is a tool that can improve teaching and learning skills, but, its effectiveness depends on how the tool is used. Therefore, this study aims to investigate the kinds of challenges encountered by the international students and how they actually cope with online learning. To date little research exists on the perceptions of online learning environments by international Asian students, in particular Malaysian students who study in Australian Universities; hence this study aims to fill this gap. A mixed-method approach was used to collect quantitative and qualitative data using a modified Online Learning Environment Survey (OLES) instrument and focus group interviews. The sample comprised 76 international students from a university in Brisbane. Thirty-five domestic Australian students were included for comparison. Contrary to assumptions from previous research, the findings revealed that there were few differences between the international Asian students from Malaysia and Australian students with regard to their perceptions of online learning. Another cogent finding that emerged was that online learning was most effective when included within blended learning environments. The students clearly indicated that when learning in a blended environment, it was imperative that appropriate features are blended in and customised to suit the particular needs of international students. The study results indicated that the university could improve the quality of the blended online learning environment by: 1) establishing and maintaining a sense of learning community; 2) enhancing the self motivation of students; and 3) professional development of lecturers/tutors, unit coordinators and learning support personnel. Feedback from focus group interviews, highlighted the students‘ frustration with a lack of cooperative learning, strategies and skills which were expected of them by their lecturers/tutors in order to work productively in groups. They indicated a strong desire for lecturers/tutors to provide them prior training in these strategies and skills. The students identified four ways to optimise learning opportunities in cross-cultural spaces. These were: 1) providing preparatory and ongoing workshops focusing on the dispositions and roles of students within student-centred online learning environments; 2) providing preparatory and ongoing workshops on collaborative group learning strategies and skills; 3) providing workshops familiarising students with Australian culture and language; and 4) providing workshops on strategies for addressing technical problems. Students also indicated a strong desire for professional development of lecturers/tutors focused on: 1) teacher attributes, 2) ways to culturally sensitive curricula, and 3) collaborative learning and cooperative working strategies and skills, and 4) designing flexible program structures. Recommendations from this study will be useful to Australian universities where Asian international students from Malaysia study in blended learning environments. An induction program (online skills, collaborative and teamwork skills, study expectations plus familiarisation with Australian culture) for overseas students at the commencement of their studies; a cultural awareness program for lecturers (cultural sensitivity, ways to communicate and a better understanding of Asian educational systems), upskilling of lecturers‘ ability to structure their teaching online and to apply strong theoretical underpinnings when designing learning activities such as discussion forums, and consistency with regards to how content is located and displayed in a learning management system like Blackboard. Through addressing the research questions in this study, the researcher hopes to contribute to and advance the domain of knowledge related to online learning, and to better understand how international Malaysian students‘ perceive online learning environments. These findings have theoretical and pragmatic significance.

Creating better learning environments by cross-disciplinary collaboration : a civil engineering and surveying linkage

Many of the teaching elements in Civil and Environmental Engineering and Spatial Science/Surveying are strongly related to multidisciplinary real-world situations. Professionals in each discipline commonly work collaboratively, knowing each other’s professional and technical limitations and requirements. Replication of such real-world situations allows students to gain an insight and acquire knowledge of professional practice for both civil engineering and spatial science disciplines. However, replication of an authentic design project is not always possible in a single unit basis where empirical project situations are often created with controlled sets of constraints, inputs and outputs. A cross-disciplinary design-based project that is designed to promote active student learning, engagement and professional integration would be the preferred option. The central aim of this collaborative project was to create positive and inclusive environments to promote engaging learning opportunities that cater for a range of learning styles with a two-way linkage involving third-year civil engineering and spatial science (surveying) students. This paper describes the cross-disciplinary project developed and delivered in 2010 and 2011. A survey was conducted at completion of the project to assess the degree of improvement in student engagement and their learning experiences. Improvements were assessed in a range of dimensions including student motivation, learning by cross-disciplinary collaboration and learning by authentic design project experiences. In this specific cross-disciplinary linkage project, the study findings showed that teaching approaches utilised have been effective in promoting active student learning and increasing engagement.

New perspectives on context-based chemistry education : using a dialectical sociocultural approach to view teaching and learning

Context-based chemistry education aims to improve student interest and motivation in chemistry by connecting canonical chemistry concepts with real-world contexts. Implementation of context-based chemistry programmes began 20 years ago in an attempt to make the learning of chemistry meaningful for students. This paper reviews such programmes through empirical studies on six international courses, ChemCom (USA), Salters (UK), Industrial Science (Israel), Chemie im Kontext (Germany), Chemistry in Practice (The Netherlands) and PLON (The Netherlands). These studies are categorised through emergent characteristics of: relevance, interest/attitudes motivation and deeper understanding. These characteristics can be found to an extent in a number of other curricular initiatives, such as science-technology-society approaches and problem-based learning or project based science, the latter of which often incorporates an inquiry-based approach to science education. These initiatives in science education are also considered with a focus on the characteristics of these approaches that are emphasised in context-based education. While such curricular studies provide a starting point for discussing context-based approaches in chemistry, to advance our understanding of how students connect canonical science concepts with the real-world context, a new theoretical framework is required. A dialectical sociocultural framework originating in the work of Vygotsky is used as a referent for analysing the complex human interactions that occur in context-based classrooms, providing teachers with recent information about the pedagogical structures and resources that afford students the agency to learn.

Move it, use it : university-school collaboration for learning to teach physical education in primary schools

Reports of increasing numbers of obese Australian children and adolescents have raised the alarm to be proactive in reducing this so called epidemic. It has evoked a call for greater emphasis on teaching physical education in schools, as a measure for attaining fitness not only with obese students but for all students. This paper emphasises how preservice teachers need to be a key target for implementing physical education (PE) reform in schools, as many primary teachers will be generalists and may not be confident enough to implement PE effectively. Through a review of existing literature, teaching practices essential for the effective promotion and implementation of PE were identified under six broad categories: personal-professional skills development, addressing system requirements, pedagogical practices, managing student behaviour, providing feedback to students, and reflecting on practice. Subsequently, the development of these practices in preservice teachers is considered in the context of a university-school collaboration where preservice teachers taught physical education to primary school students for one day per week over a four week period. These authentic teaching experiences provided the preservice teachers with vital opportunities to put theory into practice and interact with “real-world” students. Self-evaluative data from 38 of these preservice teachers, in the form of a five-part Likert scale survey and extended response survey, demonstrated that they were able to develop the majority of the essential teaching practices identified by literature. In particular, the preservice teachers developed self efficacy, enthusiasm, and motivation for teaching PE, facets which are often found to be lacking in generalist primary teachers and yet are essential if children’s perceptions and habits regarding physical activity are to be changed.

The introduction of an interactive teaching and learning activity (TLA) in class and its relationship to students’ learning-outcomes

In the university education arena, it is becoming apparent that traditional methods of conducting classes are not the most effective ways to achieve desired learning outcomes. The traditional class/method involves the instructor verbalizing information for passive, note-taking students who are assumed to be empty receptacles waiting to be filled with knowledge. This method is limited in its effectiveness, as the flow of information is usually only in one direction. Furthermore, “It has been demonstrated that students in many cases can recite and apply formulas in numerical problems, but the actual meaning and understanding of the concept behind the formula is not acquired (Crouch & Mazur)”. It is apparent that memorization is the main technique present in this approach. A more effective method of teaching involves increasing the students’ level of activity during, and hence their involvement in the learning process. This technique stimulates self- learning and assists in keeping these students’ levels of concentration more uniform. In this work, I am therefore interested in studying the influence of a particular TLA on students’ learning-outcomes. I want to foster high-level understanding and critical thinking skills using active learning (Silberman, 1996) techniques. The TLA in question aims to promote self-study by students and to expose them to a situation where their learning-outcomes can be tested. The motivation behind this activity is based on studies which suggest that some sensory modalities are more effective than others. Using various instruments for data collection and by means of a thorough analysis I present evidence of the effectiveness of this action research project which aims to improve my own teaching practices, with the ultimate goal of enhancing student’s learning.