Program Annotations: Feedback for Students Learning to Program

This paper presents a novel program annotation mechanism which enables students to obtain feedback from tutors on their programs in a far simpler and more efficient way than is possible with, for example, email. A common scenario with beginning students is to email tutors with copies of their malfunctioning programs. Unfortunately the emailed program often bears little resemblance to the program the student has been trying to make work; often it is incomplete, a different version and corrupted. We propose an annotation mechanism enabling students to simply and easily annotate their programs with comments asking for help. Similarly our mechanism enables tutors to view students’ programs and to reply to their comments in a simple and structured fashion. This means students can get frequent and timely feedback on their programs; tutors can provide such feedback efficiently, and hence students’ learning is greatly improved.

MILK : the Mobile Informal Learning Kit. Collaborating to design successful mobile learning applications

This paper suggests ways for educators and designers to understand and merge priorities in order to inform the development of mobile learning (m-learning) applications that maximise user experiences and hence learning opportunities. It outlines a User Experience Design (UXD) theory and development process that requires designers to conduct a thorough initial contextual inquiry into a particular domain in order to set project priorities and development guidelines. A matrix that identifies the key contextual considerations namely the social, cultural, spatial, technical and temporal constructs of any domain is presented as a vital tool for achieving successful UXD. The frame of reference provided by this matrix ensures that decisions made throughout the design process are attributable to a desired user experience. To illustrate how the proposed UXD theory and development process supports the creation of effective m-learning applications, this paper documents the development process of MILK (Mobile Informal Learning Kit). MILK is a support tool that allows teachers and students to develop event paths that consist of a series SMS question and answer messages that lead players through a series of checkpoints between point A and point B. These event paths can be designed to suit desired learning scenarios and can be used to explore a particular place or subject. They can also be designed to facilitate formal or informal learning experiences.

Structural differentiation and corporate venturing : the moderating role of formal and informal integration mechanisms

Research has suggested that corporate venturing is crucial to strategic renewal and firm performance, yet scholars still debate the appropriate organizational configurations to facilitate the creation of new businesses in existing organizations. Our study investigates the effectiveness of combining structural differentiation with formal and informal organizational as well as top management team integration mechanisms in establishing an appropriate context for venturing activities. Our findings suggest that structural differentiation has a positive effect on corporate venturing. In addition, our study indicates that a shared vision has a positive effect on venturing in a structurally differentiated context. Socially integrated senior teams and cross-functional interfaces, however, are ineffective integration mechanisms for establishing linkages across differentiated units and for successfully pursuing corporate venturing.

Teacher praise and feedback and students’ perceptions of the classroom environment

The relationships between teacher praise and feedback, and students’ perceptions of the classroom environment were investigated in six rural elementary schools (n 5 747). The Teacher Feedback Scale and My Classroom Scale were developed as part of this study and used to collect the data. Structural equation modelling was used to test a hypothesised model. The results indicated that negative teacher feedback and effort feedback were both related to students’ relationships with their teachers, while ability feedback was associated with perceptions of the classroom environment. Praise was not related to classroom environment or teacher–student relationships. Significant age and gender differences were found. Additionally, differences were found between students who were satisfied with their classroom and those who were dissatisfied. Satisfied students received more general praise, general ability feedback, effort feedback and less negative teacher feedback when compared to dissatisfied students. Research studies have emphasised the influence of signicicant adults (teachers and parents) on students’ personal development (Porlier et al., 1999) and the importance of significant others’ verbal statements when directed at children (Burnett, 1996a). The relationships between negative and positive statements made by teachers, parents, peers and siblings and children’s self-talk have been investigated (Burnett, 1996a) and positive statements (praise) have been found to be more beneficial than verbal criticism (Burnett, 1999). The quality of life in the classroom in recent times has been considered of great importance to students (Thorp et al., 1994) and this is recognised by Baker (1999) who reported a relationship between students’ satisfaction with the learning environment, and differential teacher feedback and praise. This study investigated the relationships between teacher praise and feedback, and how students perceived their classroom and their relationship with their teacher.

Performance measurement and feedback in a public sector program

Establishing a framework for measuring the performance of public sector programs is fraught with dangers. Many public sector organisations are satisfied with measuring activity in programs and fail to see the need for establishing a framework that will meet the needs of participants and measure outcomes as well as activities. This paper explores how a government department in Queensland went about establishing a performance management framework to measure the outcomes and activities in a program that was a public private partnership. Findings indicate that using an iterative consultative approach performance measure can be put in place that are meaningful and assist the participants to review the program.

Property Education : an evaluation of how well undergraduate property students are prepared for commencing their careers

The evolution of property education to adapt to the changing business environment requires changes to course content, method of delivery and assessment. Many universities have a special interest in understanding how the students transition in and transition out of the property programs. The impact of the first year student experience is often easier to assess through students’ progression in the course and performance in their intermediate and advanced units. However, the students’ success in transitioning from university student to property professional is often more difficult to determine. In an environment where many property students commence their professional careers while still completing their undergraduate property qualification, a survey of current final year students was undertaken to identify the students’ perception of their level of preparedness for entry into the professional world. This study has also been informed by feedback received from and informal discussions held with industry representative bodies, alumni and senior members of professional organisations. The QUT UD40 Bachelor of Urban Development, Property Economics course has been designed to achieve graduate capabilities in core technical skills and generic professional skills which are required by property professionals. The results of this study were that some units in the program were perceived to provide direct preparation for students commencing their professional careers whilst the impact of other units was less tangible. Valuable feedback received during the study included an assessment of the relevance of many multi-disciplinary units, the appropriateness of the programming of units within the course and the appropriateness of repetition of content during the course. The further research question arises as to how universities can better assist students in the transition to the professional environment when frequently this occurs prior to completion of the property course.

Harnessing assessment and feedback in the first year to support learning success, engagement and retention

It has been argued that intentional first year curriculum design has a critical role to play in enhancing first year student engagement, success and retention (Kift, 2008). A fundamental first year curriculum objective should be to assist students to make the successful transition to assessment in higher education. Scott (2006) has identified that ‘relevant, consistent and integrated assessment … [with] prompt and constructive feedback’ are particularly relevant to student retention generally; while Nicol (2007) suggests that ‘lack of clarity regarding expectations in the first year, low levels of teacher feedback and poor motivation’ are key issues in the first year. At the very minimum, if we expect first year students to become independent and self-managing learners, they need to be supported in their early development and acquisition of tertiary assessment literacies (Orrell, 2005). Critical to this attainment is the necessity to alleviate early anxieties around assessment information, instructions, guidance, and performance. This includes, for example:  inducting students thoroughly into the academic languages and assessment genres they will encounter as the vehicles for evidencing learning success; and  making expectations about the quality of this evidence clear. Most importantly, students should receive regular formative feedback of their work early in their program of study to aid their learning and to provide information to both students and teachers on progress and achievement. Leveraging research conducted under an ALTC Senior Fellowship that has sought to articulate a research-based 'transition pedagogy' (Kift & Nelson, 2005) – a guiding philosophy for intentional first year curriculum design and support that carefully scaffolds and mediates the first year learning experience for contemporary heterogeneous cohorts – this paper will discuss theoretical and practical strategies and examples that should be of assistance in implementing good assessment and feedback practices across a range of disciplines in the first year.

Writing together, learning together : the value and effectiveness of a research writing group for doctoral students

The high level of scholarly writing required for a doctoral thesis is a challenge for many research students. However, formal academic writing training is not a core component of many doctoral programs. Informal writing groups for doctoral students may be one method of contributing to the improvement of scholarly writing. In this paper, we report on a writing group that was initiated by an experienced writer and higher degree research supervisor to support and improve her doctoral students’ writing capabilities. Over time, this group developed a workable model to suit their varying needs and circumstances. The model comprised group sessions, an email group, and individual writing. Here, we use a narrative approach to explore the effectiveness and value of our research writing group model in improving scholarly writing. The data consisted of doctoral students’ reflections to stimulus questions about their writing progress and experiences. The stimulus questions sought to probe individual concerns about their own writing, what they had learned in the research writing group, the benefits of the group, and the disadvantages and challenges to participation. These reflections were analysed using thematic analysis. Following this analysis, the supervisor provided her perspective on the key themes that emerged. Results revealed that, through the writing group, members learned technical elements (e.g., paragraph structure), non-technical elements (e.g., working within limited timeframes), conceptual elements (e.g., constructing a cohesive arguments), collaborative writing processes, and how to edit and respond to feedback. In addition to improved writing quality, other benefits were opportunities for shared writing experiences, peer support, and increased confidence and motivation. The writing group provides a unique social learning environment with opportunities for: professional dialogue about writing, peer learning and review, and developing a supportive peer network. Thus our research writing group has proved an effective avenue for building doctoral students’ capability in scholarly writing. The proposed model for a research writing group could be applicable to any context, regardless of the type and location of the university, university faculty, doctoral program structure, or number of postgraduate students. It could also be used within a group of students with diverse research abilities, needs, topics and methodologies. However, it requires a group facilitator with sufficient expertise in scholarly writing and experience in doctoral supervision who can both engage the group in planned writing activities and also capitalise on fruitful lines of discussion related to students’ concerns as they arise. The research writing group is not intended to replace traditional supervision processes nor existing training. However it has clear benefits for improving scholarly writing in doctoral research programs particularly in an era of rapidly increasing student load.

Mining Negative Relevance Feedback for Information Filtering

It is a big challenge to clearly identify the boundary between positive and negative streams. Several attempts have used negative feedback to solve this challenge; however, there are two issues for using negative relevance feedback to improve the effectiveness of information filtering. The first one is how to select constructive negative samples in order to reduce the space of negative documents. The second issue is how to decide noisy extracted features that should be updated based on the selected negative samples. This paper proposes a pattern mining based approach to select some offenders from the negative documents, where an offender can be used to reduce the side effects of noisy features. It also classifies extracted features (i.e., terms) into three categories: positive specific terms, general terms, and negative specific terms. In this way, multiple revising strategies can be used to update extracted features. An iterative learning algorithm is also proposed to implement this approach on RCV1, and substantial experiments show that the proposed approach achieves encouraging performance.

An effective model of using negative relevance feedback for information filtering

Over the years, people have often held the hypothesis that negative feedback should be very useful for largely improving the performance of information filtering systems; however, we have not obtained very effective models to support this hypothesis. This paper, proposes an effective model that use negative relevance feedback based on a pattern mining approach to improve extracted features. This study focuses on two main issues of using negative relevance feedback: the selection of constructive negative examples to reduce the space of negative examples; and the revision of existing features based on the selected negative examples. The former selects some offender documents, where offender documents are negative documents that are most likely to be classified in the positive group. The later groups the extracted features into three groups: the positive specific category, general category and negative specific category to easily update the weight. An iterative algorithm is also proposed to implement this approach on RCV1 data collections, and substantial experiments show that the proposed approach achieves encouraging performance.