Do-Rank: DCG optimization for learning-to-rank in tag-based item recommendation systems

Discounted Cumulative Gain (DCG) is a well-known ranking evaluation measure for models built with multiple relevance graded data. By handling tagging data used in recommendation systems as an ordinal relevance set of {negative,null,positive}, we propose to build a DCG based recommendation model. We present an efficient and novel learning-to-rank method by optimizing DCG for a recommendation model using the tagging data interpretation scheme. Evaluating the proposed method on real-world datasets, we demonstrate that the method is scalable and outperforms the benchmarking methods by generating a quality top-N item recommendation list.

International trends in the implementation of assessment for learning: Implications for policy and practice

This paper discusses the emergence of assessment for learning (AfL) across the globe with particular attention given to Western educational jurisdictions. Authors from Australia, Canada, Ireland, Israel, New Zealand, Norway, and the USA explain the genesis of AfL, its evolution and impact on school systems, and discuss current trends in policy directions for AfL within their respective countries. The authors also discuss the implications of these various shifts and the ongoing tensions that exist between AfL and summative forms of assessment within national policy initiatives.

Not learning from the past: Adaptive governance challenges for Australian natural resource management

Australia’s governance arrangements for NRM have evolved considerably over the last thirty years. The impact of changes in governance on NRM planning and delivery requires assessment. We undertake a multi-method program evaluation using adaptive governance principles as an analytical frame and apply this to Queensland to assess the impacts of governance change on NRM planning and governance outcomes. Data to inform our analysis includes: 1) a systematic review of sixteen audits/evaluations of Australian NRM over a fifteen-year period; 2) a review of Queensland’s first generation NRM Plans; and 3) outputs from a Queensland workshop on NRM planning. NRM has progressed from a bottom-up grassroots movement into a collaborative regional NRM model that has been centralised by the Australian Government. We found that while some adaptive governance challenges have been addressed, others remained unresolved. Results show that collaboration and elements of multi-level governance under the regional model were positive moves, but also that NRM arrangements contained structural deficiencies across multiple governance levels in relation to public involvement in decision-making and knowledge production for problem responsiveness. These problems for adaptive governance have been exacerbated since 2008. We conclude that the adaptive governance framework for NRM needs urgent attention so that important environmental management problems can be addressed.

A virtual environment for medical radiation collaborative learning

Asoftware-based environment was developed to provide practical training in medical radiation principles and safety. The Virtual Radiation Laboratory application allowed students to conduct virtual experiments using simulated diagnostic and radiotherapy X-ray generators. The experiments were designed to teach students about the inverse square law, half value layer and radiation protection measures and utilised genuine clinical and experimental data. Evaluation of the application was conducted in order to ascertain the impact of the software on students’ understanding, satisfaction and collaborative learning skills and also to determine potential further improvements to the software and guidelines for its continued use. Feedback was gathered via an anonymous online survey consisting of a mixture of Likert-style questions and short answer open questions. Student feedback was highly positive with 80 % of students reporting increased understanding of radiation protection principles. Furthermore 72 % enjoyed using the software and 87 %of students felt that the project facilitated collaboration within small groups. The main themes arising in the qualitative feedback comments related to efficiency and effectiveness of teaching, safety of environment, collaboration and realism. Staff and students both report gains in efficiency and effectiveness associated with the virtual experiments. In addition students particularly value the visualisation of ‘‘invisible’’ physical principles and increased opportunity for experimentation and collaborative problembased learning. Similar ventures will benefit from adopting an approach that allows for individual experimentation while visualizing challenging concepts.

Active learning: A step towards automating medical concept extraction

Objective This paper presents an automatic active learning-based system for the extraction of medical concepts from clinical free-text reports. Specifically, (1) the contribution of active learning in reducing the annotation effort, and (2) the robustness of incremental active learning framework across different selection criteria and datasets is determined. Materials and methods The comparative performance of an active learning framework and a fully supervised approach were investigated to study how active learning reduces the annotation effort while achieving the same effectiveness as a supervised approach. Conditional Random Fields as the supervised method, and least confidence and information density as two selection criteria for active learning framework were used. The effect of incremental learning vs. standard learning on the robustness of the models within the active learning framework with different selection criteria was also investigated. Two clinical datasets were used for evaluation: the i2b2/VA 2010 NLP challenge and the ShARe/CLEF 2013 eHealth Evaluation Lab. Results The annotation effort saved by active learning to achieve the same effectiveness as supervised learning is up to 77%, 57%, and 46% of the total number of sequences, tokens, and concepts, respectively. Compared to the Random sampling baseline, the saving is at least doubled. Discussion Incremental active learning guarantees robustness across all selection criteria and datasets. The reduction of annotation effort is always above random sampling and longest sequence baselines. Conclusion Incremental active learning is a promising approach for building effective and robust medical concept extraction models, while significantly reducing the burden of manual annotation.

Teaching engineering tribology: Elements of assessment design for different learning styles

This study involves teaching engineering students concepts in lubrication engineering that are heavily dependent on mathematics. Excellent learning outcomes have been observed when assessment tasks are devised for a diversity of learning styles. Providing different pathways to knowledge reduces the probability that a single barrier halts progress towards the ultimate learning objective. The interdisciplinary nature of tribology can be used advantageously to tie together multiple elements of engineering to solve real physical problems—an approach that seems to benefit a majority of engineering students. To put this into practice, various assessment items were devised on the study of hydrodynamics, culminating in a project to provide a summative evaluation of the students’ learning achievement. A survey was also conducted to assess other aspects of students’ learning experiences under the headings: ‘perception of learning’ and ‘overall satisfaction’. High degrees of achievement and satisfaction were observed. An attempt has been made to identify the elements contributing to success so that they may be applied to other challenging concepts in engineering education.

STEM learning through engineering design: fourth-grade students' investigations in aerospace

Background: Internationally, there is a growing concern for developing STEM education to prepare students for a scientifically and technologically advanced society. Despite educational bodies lobbying for an increased focus on STEM, there is limited research on how engineering might be incorporated especially in the elementary school curriculum. A framework of five comprehensive core engineering design processes (problem scoping, idea generation, design and construction, design evaluation, redesign), adapted from the literature on design thinking in young children, served as a basis for the study. We report on a qualitative study of fourth-grade students’ developments in working an aerospace problem, which took place during the first year of a 3-year longitudinal study. Students applied design processes together with their mathematics and science knowledge to the design and redesign of a 3-D model plane. Results: The study shows that through an aerospace engineering problem, students could complete initial designs and redesigns of a model plane at varying levels of sophistication. Three levels of increasing sophistication in students’ sketches were identified in their designs and redesigns. The second level was the most prevalent involving drawings or templates of planes together with an indication of how to fold the materials as well as measurements linked to the plane’s construction. The third level incorporated written instructions and calculations. Students’ engagement with each of the framework’s design processes revealed problem scoping components in their initial designs and redesigns. Furthermore, students’ recommendations for improving their launching techniques revealed an ability to apply their mathematics knowledge in conjunction with their science learning on the forces of flight. Students’ addition of context was evident together with an awareness of constraints and a consideration of what was feasible in their design creation. Interestingly, students’ application of disciplinary knowledge occurred more frequently in the last two phases of the engineering framework (i.e., design evaluation and redesign), highlighting the need for students to reach these final phases to enable the science and mathematics ideas to emerge. Conclusions: The study supports research indicating young learners’ potential for early engineering. Students can engage in design and redesign processes, applying their STEM disciplinary knowledge in doing so. An appropriate balance is needed between teacher input of new concepts and students’ application of this learning in ways they choose. For example, scaffolding by the teacher about how to improve designs for increased detail could be included in subsequent experiences. Such input could enhance students’ application of STEM disciplinary knowledge in the redesign process. We offer our framework of design processes for younger learners as one way to approach early engineering education with respect to both the creation of rich problem experiences and the analysis of their learning.

Caught in the act of collaboration: Students’ experiences of collective learning within a real-world design studio context

This study is an evaluation of design students’ perceptions of the benefits of collective learning in a real-world collaborative design studio. Third year students worked in inter-disciplinary teams representing architecture, interior design, landscape architecture, and industrial design. Responding to a real-world brief and in consultation with an industry partner client and early childhood education pre-service teachers, the teams were required to collectively propose a design response for a community-based child and family centre, on an iconic koala sanctuary site. Data were collected using several methods including a participatory action research method, through the form of a large analogue, collaborative jigsaw puzzle. Using a grounded theory methodology, qualitative data were thematically analysed to reveal six distinct aspects of collaboration, which positively impacted the students’ learning experience. The results of this study include recommendations for improving real world collaboration in the design studio in preparation for students’ transition into professional practice.

Grant application: QUT Learning and Teaching scheme 2012 Cracking the Code - A checklist to complement CRAs for first year Justice students.

Widening participation brings with it increasing diversity, increased variation in the level of academic preparedness (Clarke, 2011; Nelson, Clarke, & Kift 2010). Cultural capital coupled with negotiating the academic culture creates an environment based on many assumptions about academic writing and university culture. Variations in staff and student expectations relating to the teaching and learning experience is captured in a range of national and institutional data (AUSSE, CEQ, LEX). Nationally, AUSSE data (2009) indicates that communication, writing, speaking and analytic skills, staff expectations are quite a bit higher than students. The research team noted a recognisable shift in the changing cohort of students and their understanding and engagement with feedback and CRAs, as well as variations in teaching staff and student expectations. The current reality of tutor and student roles is that: - Students self select when/how they access lectures and tutorials. - Shorter tutorial times result in reduced opportunity to develop rapport with students. - CRAs are not always used consistently by staff (different marking styles and levels of feedback). - Marking is not always undertaken by the student’s tutor/lecturer. - Student support services might be recommended to students once a poor grade has been given. Students can perceive this as remedial and a further sense of failure. - CRA sheet has a mark /grade attached to it. Stigma attached to low mark. Hard to focus on the CRA feedback with a poor mark etched next to it. - Limited opportunities for sessionals to access professional development to assist with engaging students and feedback. - FYE resources exist, however academic time is a factor in exploring and embedding these resources. Feedback is another area with differing expectations and understandings. Sadler (2009) contends that students are not equipped to decode the statements properly. For students to be able to apply feedback, they need to understand the meaning of the feedback statement. They also need to identify, the particular aspects of their work that need attention. The proposed Checklist/guide would be one page and submitted with each assessment piece thereby providing an interface to engage students and tutors in managing first year understandings and expectations around CRAs, feedback, and academic practice.

Creating a standardised teaching and learning framework for social work field placements

Mapping and evaluating a student's progress on placement is a core element of social work education but there has been scant attention to indicate how to effectively create and assess student learning and performance. This paper outlines a project undertaken by the Combined Schools of Social Work to develop a common learning and assessment tool that is being used by all social work schools in Victoria. The paper describes how the Common Assessment Tool (CAT) was developed, drawing on the Australian Association of Social Work Practice Standards, leading to seven key learning areas that form the basis of the assessment of a student's readiness for practice. An evaluation of the usefulness of the CAT was completed by field educators, liaison staff, and students, which confirmed that the CAT was a useful framework for evaluating students' learning goals. The feedback also identified a number of problematic features that were addressed in a revised CAT and rating scale.

Learning Temporal Alignment Uncertainty for Efficient Event Detection

In this paper we tackle the problem of efficient video event detection. We argue that linear detection functions should be preferred in this regard due to their scalability and efficiency during estimation and evaluation. A popular approach in this regard is to represent a sequence using a bag of words (BOW) representation due to its: (i) fixed dimensionality irrespective of the sequence length, and (ii) its ability to compactly model the statistics in the sequence. A drawback to the BOW representation, however, is the intrinsic destruction of the temporal ordering information. In this paper we propose a new representation that leverages the uncertainty in relative temporal alignments between pairs of sequences while not destroying temporal ordering. Our representation, like BOW, is of a fixed dimensionality making it easily integrated with a linear detection function. Extensive experiments on CK+, 6DMG, and UvA-NEMO databases show significant performance improvements across both isolated and continuous event detection tasks.

Design studio terrains: Mapping the learning landscapes of Australian architectural education

It has been nearly 25 years since the problems associated with passive learning in large undergraduate classes were first established by McDermott (1991). STEM education, for example North Carolina State University’s SCALE-UP project, has subsequently been influenced by some unique aspects of design studio education. While there are now many institutions applying SCALE-UP or similar approaches to enable lively interaction, enhanced learning, increased student engagement, and to teach many different content areas to classes of all sizes, nearly all of these have remained in the STEM fields (Beichner, 2008). Architectural education, although originally at the forefront of this field, has arguably been left behind. Architectural practice is undergoing significant change, globally. Access to new technology and the development of specialised architectural documentation software has scaffolded new building procurement methods and allowed consultant teams to work more collaboratively, efficiently and even across different time zones. Up until recently, the spatial arrangements, pedagogical approaches, and project work outcomes in the architectural design studio, have not been dissimilar to its inception. It is not possible to keep operating architectural design studios the same way that they have for the past two hundred years, with this new injection of high-end technology and personal mobile Wi-Fi enabled devices. Employing a grounded theory methodology, this study reviews the current provision of architectural design learning terrains across a range of tertiary institutions, in Australia. Some suggestions are provided for how these spaces could be modified to address the changing nature of the profession, and implications for how these changes may impact the design of future SCALE-UP type spaces outside of the discipline of architecture, are also explored.

Harnessing information from injury narrative in the 'big data' era: Understanding and applying machine learning for injury surveillance

Objective Vast amounts of injury narratives are collected daily and are available electronically in real time and have great potential for use in injury surveillance and evaluation. Machine learning algorithms have been developed to assist in identifying cases and classifying mechanisms leading to injury in a much timelier manner than is possible when relying on manual coding of narratives. The aim of this paper is to describe the background, growth, value, challenges and future directions of machine learning as applied to injury surveillance. Methods This paper reviews key aspects of machine learning using injury narratives, providing a case study to demonstrate an application to an established human-machine learning approach. Results The range of applications and utility of narrative text has increased greatly with advancements in computing techniques over time. Practical and feasible methods exist for semi-automatic classification of injury narratives which are accurate, efficient and meaningful. The human-machine learning approach described in the case study achieved high sensitivity and positive predictive value and reduced the need for human coding to less than one-third of cases in one large occupational injury database. Conclusion The last 20 years have seen a dramatic change in the potential for technological advancements in injury surveillance. Machine learning of ‘big injury narrative data’ opens up many possibilities for expanded sources of data which can provide more comprehensive, ongoing and timely surveillance to inform future injury prevention policy and practice.

Building personas of students accessing a peer-facilitated support for learning program

The modern student represents a change from the traditional learner. More than ever before, additional resources are available online and yet personalised learning and peer-assistance programs are becoming an essential part of tertiary education delivery. This paper presents the first stage in a user-centred design approach to the analysis of the completeness and efficacy of such a personalised, peer-based support for learning program. This approach used an iterative design methodology based on contextual interview, workshops and focus groups to develop personas representing students visiting the program. Initial uses of these developed personas have included training of new personnel as well as the evaluation of the program. Overall the use of this user-centred approach and iterative persona development methodology has yielded an invaluable resource for the design of support for learning programs across the higher education industry within Australia and beyond.

Collaborative learning approach to introduce computational fluid dynamics

This paper presents the design, implementation and evaluation of a collaborative learning activity designed to replace traditional face-to-face lectures in a large classroom. This activity aims to better engage the students with their learning and improve the students’ experience and outcomes. This project is implemented in the Fluid Mechanics unit of the Mechanical Engineering degree at the Queensland University of Technology to introduce students with the concept, terminology and process of Computational Fluid Dynamics (CFD). The approach integrates a constructive collaborative assignment which is a key element in the overall quality of teaching and learning, and an integral component of the students’ experience. A detailed survey, given to the students, showed an overall high level of satisfaction. However, the results also highlighted the gap between students’ expectations both for contents and assignment and teacher expectations. Discussions to address this issue are presented in the paper based on a critical reflection.