A matrix for appropriate assessment of workplace learning in stem disciplines

With increasing interest shown by Universities in workplace learning, especially in STEM disciplines, an issue has arisen amongst educators and industry partners regarding authentic assessment tasks for work integrated learning (WIL) subjects. This paper describes the use of a matrix, which is also available as a decision-tree, based on the features of the WIL experience, in order to facilitate the selection of appropriate assessment strategies. The matrix divides the WIL experiences into seven categories, based on such factors as: the extent to which the experience is compulsory, required for membership of a professional body or elective; whether the student is undertaking a project, or embedding in a professional culture; and other key aspects of the WIL experience. One important variable is linked to the fundamental purpose of the assessment. This question revolves around the focus of the assessment: whether on the person (student development); the process (professional conduct/language); or the product (project, assignment, literature review, report, software). The matrix has been trialed at QUT in the Faculty of Science and Technology, and also at the University of Surrey, UK, and has proven to have good applicability in both universities.

Acquiring search expertise : learning experiences and threshold concepts

Expert searchers engage with information as information brokers, researchers, reference librarians, information architects, faculty who teach advanced search, and in a variety of other information-intensive professions. Their experiences are characterized by a profound understanding of information concepts and skills and they have an agile ability to apply this knowledge to interacting with and having an impact on the information environment. This study explored the learning experiences of searchers to understand the acquisition of search expertise. The research question was: What can be learned about becoming an expert searcher from the learning experiences of proficient novice searchers and highly experienced searchers? The key objectives were: (1) to explore the existence of threshold concepts in search expertise; (2) to improve our understanding of how search expertise is acquired and how novice searchers, intent on becoming experts, can learn to search in more expertlike ways. The participant sample drew from two population groups: (1) highly experienced searchers with a minimum of 20 years of relevant professional experience, including LIS faculty who teach advanced search, information brokers, and search engine developers (11 subjects); and (2) MLIS students who had completed coursework in information retrieval and online searching and demonstrated exceptional ability (9 subjects). Using these two groups allowed a nuanced understanding of the experience of learning to search in expertlike ways, with data from those who search at a very high level as well as those who may be actively developing expertise. The study used semi-structured interviews, search tasks with think-aloud narratives, and talk-after protocols. Searches were screen-captured with simultaneous audio-recording of the think-aloud narrative. Data were coded and analyzed using NVivo9 and manually. Grounded theory allowed categories and themes to emerge from the data. Categories represented conceptual knowledge and attributes of expert searchers. In accord with grounded theory method, once theoretical saturation was achieved, during the final stage of analysis the data were viewed through lenses of existing theoretical frameworks. For this study, threshold concept theory (Meyer & Land, 2003) was used to explore which concepts might be threshold concepts. Threshold concepts have been used to explore transformative learning portals in subjects ranging from economics to mathematics. A threshold concept has five defining characteristics: transformative (causing a shift in perception), irreversible (unlikely to be forgotten), integrative (unifying separate concepts), troublesome (initially counter-intuitive), and may be bounded. Themes that emerged provided evidence of four concepts which had the characteristics of threshold concepts. These were: information environment: the total information environment is perceived and understood; information structures: content, index structures, and retrieval algorithms are understood; information vocabularies: fluency in search behaviors related to language, including natural language, controlled vocabulary, and finesse using proximity, truncation, and other language-based tools. The fourth threshold concept was concept fusion, the integration of the other three threshold concepts and further defined by three properties: visioning (anticipating next moves), being light on one's 'search feet' (dancing property), and profound ontological shift (identity as searcher). In addition to the threshold concepts, findings were reported that were not concept-based, including praxes and traits of expert searchers. A model of search expertise is proposed with the four threshold concepts at its core that also integrates the traits and praxes elicited from the study, attributes which are likewise long recognized in LIS research as present in professional searchers. The research provides a deeper understanding of the transformative learning experiences involved in the acquisition of search expertise. It adds to our understanding of search expertise in the context of today's information environment and has implications for teaching advanced search, for research more broadly within library and information science, and for methodologies used to explore threshold concepts.

Personalized ontology learning for enhancing text mining effectiveness

Over the last decade, the majority of existing search techniques is either keyword- based or category-based, resulting in unsatisfactory effectiveness. Meanwhile, studies have illustrated that more than 80% of users preferred personalized search results. As a result, many studies paid a great deal of efforts (referred to as col- laborative filtering) investigating on personalized notions for enhancing retrieval performance. One of the fundamental yet most challenging steps is to capture precise user information needs. Most Web users are inexperienced or lack the capability to express their needs properly, whereas the existent retrieval systems are highly sensitive to vocabulary. Researchers have increasingly proposed the utilization of ontology-based tech- niques to improve current mining approaches. The related techniques are not only able to refine search intentions among specific generic domains, but also to access new knowledge by tracking semantic relations. In recent years, some researchers have attempted to build ontological user profiles according to discovered user background knowledge. The knowledge is considered to be both global and lo- cal analyses, which aim to produce tailored ontologies by a group of concepts. However, a key problem here that has not been addressed is: how to accurately match diverse local information to universal global knowledge. This research conducts a theoretical study on the use of personalized ontolo- gies to enhance text mining performance. The objective is to understand user information needs by a \bag-of-concepts" rather than \words". The concepts are gathered from a general world knowledge base named the Library of Congress Subject Headings. To return desirable search results, a novel ontology-based mining approach is introduced to discover accurate search intentions and learn personalized ontologies as user profiles. The approach can not only pinpoint users' individual intentions in a rough hierarchical structure, but can also in- terpret their needs by a set of acknowledged concepts. Along with global and local analyses, another solid concept matching approach is carried out to address about the mismatch between local information and world knowledge. Relevance features produced by the Relevance Feature Discovery model, are determined as representatives of local information. These features have been proven as the best alternative for user queries to avoid ambiguity and consistently outperform the features extracted by other filtering models. The two attempt-to-proposed ap- proaches are both evaluated by a scientific evaluation with the standard Reuters Corpus Volume 1 testing set. A comprehensive comparison is made with a num- ber of the state-of-the art baseline models, including TF-IDF, Rocchio, Okapi BM25, the deploying Pattern Taxonomy Model, and an ontology-based model. The gathered results indicate that the top precision can be improved remarkably with the proposed ontology mining approach, where the matching approach is successful and achieves significant improvements in most information filtering measurements. This research contributes to the fields of ontological filtering, user profiling, and knowledge representation. The related outputs are critical when systems are expected to return proper mining results and provide personalized services. The scientific findings have the potential to facilitate the design of advanced preference mining models, where impact on people's daily lives.

Bringing the real world into university learning

Introduction: As part of ongoing quality assurance, all university programs must be regularly reviewed to ensure curriculum is current, meets university and national standards, and for medical science, criteria for AIMS Accreditation. With recent developments at the national and international level also signaling change, a course design team (CDT) was assembled and tasked with developing and implementing a new four year Bachelor of Medical Laboratory Science (BMLS) course at QUT. Method: A whole-of-course approach was adopted, incorporating inverted curriculum and Capstone experience. First, course vision and desired graduate profile are defined as course learning outcomes (CLO), i.e. skills, knowledge, behaviours and attributes graduates must demonstrate. CLO are then back-mapped into introductory, developmental and expected phases from fourth to first year on a course plan and assessment map. Unit learning outcomes (ULO) are then defined, and finally, each unit (subject) designed, directly aligned with assessment. Results: The resulting BMLS course represents a deliberate program of study across four years, which from day one, focuses on the professional aspects of MLS, clinical pathology disciplines, and incrementally developing and assessing the skills, knowledge, behaviours and attributes required to undertake the Work Integrated Learning Internship (WILI) and Capstone experience in final year, and subsequently, graduate from the program. Conclusions: At the start of the year, the BMLS commenced with higher than anticipated enrolments. To date, survey data and feedback is positive, with particular emphasis on the directed nature of the course. The method of course design also ensures university/national standards, and criteria for AIMS Accreditation have been met.

An examination of learning design in elite springboard diving

The overarching aim of this programme of work was to evaluate the effectiveness of the existing learning environment within the Australian Institute of Sport (AIS) elite springboard diving programme. Unique to the current research programme, is the application of ideas from an established theory of motor learning, specifically ecological dynamics, to an applied high performance training environment. In this research programme springboard diving is examined as a complex system, where individual, task, and environmental constraints are continually interacting to shape performance. As a consequence, this thesis presents some necessary and unique insights into representative learning design and movement adaptations in a sample of elite athletes. The questions examined in this programme of work relate to how best to structure practice, which is central to developing an effective learning environment in a high performance setting. Specifically, the series of studies reported in the chapters of this doctoral thesis: (i) provide evidence for the importance of designing representative practice tasks in training; (ii) establish that completed and baulked (prematurely terminated) take-offs are not different enough to justify the abortion of a planned dive; and (iii), confirm that elite athletes performing complex skills are able to adapt their movement patterns to achieve consistent performance outcomes from variable dive take-off conditions. Chapters One and Two of the thesis provide an overview of the theoretical ideas framing the programme of work, and include a review of literature pertinent to the research aims and subsequent empirical chapters. Chapter Three examined the representativeness of take-off tasks completed in the two AIS diving training facilities routinely used in springboard diving. Results highlighted differences in the preparatory phase of reverse dive take-offs completed by elite divers during normal training tasks in the dry-land and aquatic training environments. The most noticeable differences in dive take-off between environments began during the hurdle (step, jump, height and flight) where the diver generates the necessary momentum to complete the dive. Consequently, greater step lengths, jump heights and flight times, resulted in greater board depression prior to take-off in the aquatic environment where the dives required greater amounts of rotation. The differences observed between the preparatory phases of reverse dive take-offs completed in the dry-land and aquatic training environments are arguably a consequence of the constraints of the training environment. Specifically, differences in the environmental information available to the athletes, and the need to alter the landing (feet first vs. wrist first landing) from the take-off, resulted in a decoupling of important perception and action information and a decomposition of the dive take-off task. In attempting to only practise high quality dives, many athletes have followed a traditional motor learning approach (Schmidt, 1975) and tried to eliminate take-off variations during training. Chapter Four examined whether observable differences existed between the movement kinematics of elite divers in the preparation phases of baulked (prematurely terminated) and completed take-offs that might justify this approach to training. Qualitative and quantitative analyses of variability within conditions revealed greater consistency and less variability when dives were completed, and greater variability amongst baulked take-offs for all participants. Based on these findings, it is probable that athletes choose to abort a planned take-off when they detect small variations from the movement patterns (e.g., step lengths, jump height, springboard depression) of highly practiced comfortable dives. However, with no major differences in coordination patterns (topology of the angle-angle plots), and the potential for negative performance outcomes in competition, there appears to be no training advantage in baulking on unsatisfactory take-offs during training, except when a threat of injury is perceived by the athlete. Instead, it was considered that enhancing the athletes' movement adaptability would be a more functional motor learning strategy. In Chapter Five, a twelve-week training programme was conducted to determine whether a sample of elite divers were able to adapt their movement patterns and complete dives successfully, regardless of the perceived quality of their preparatory movements on the springboard. The data indeed suggested that elite divers were able to adapt their movements during the preparatory phase of the take-off and complete good quality dives under more varied take-off conditions; displaying greater consistency and stability in the key performance outcome (dive entry). These findings are in line with previous research findings from other sports (e.g., shooting, triple jump and basketball) and demonstrate how functional or compensatory movement variability can afford greater flexibility in task execution. By previously only practising dives with good quality take-offs, it can be argued that divers only developed strong couplings between information and movement under very specific performance circumstances. As a result, this sample was sometimes characterised by poor performance in competition when the athletes experienced a suboptimal take-off. Throughout this training programme, where divers were encouraged to minimise baulking and attempt to complete every dive, they demonstrated that it was possible to strengthen the information and movement coupling in a variety of performance circumstances, widening of the basin of performance solutions and providing alternative couplings to solve a performance problem even when the take-off was not ideal. The results of this programme of research provide theoretical and experimental implications for understanding representative learning design and movement pattern variability in applied sports science research. Theoretically, this PhD programme contributes empirical evidence to demonstrate the importance of representative design in the training environments of high performance sports programmes. Specifically, this thesis advocates for the design of learning environments that effectively capture and enhance functional and flexible movement responses representative of performance contexts. Further, data from this thesis showed that elite athletes performing complex tasks were able to adapt their movements in the preparatory phase and complete good quality dives under more varied take-off conditions. This finding signals some significant practical implications for athletes, coaches and sports scientists. As such, it is recommended that care should be taken by coaches when designing practice tasks since the clear implication is that athletes need to practice adapting movement patterns during ongoing regulation of multi-articular coordination tasks. For example, volleyball servers can adapt to small variations in the ball toss phase, long jumpers can visually regulate gait as they prepare for the take-off, and springboard divers need to continue to practice adapting their take-off from the hurdle step. In summary, the studies of this programme of work have confirmed that the task constraints of training environments in elite sport performance programmes need to provide a faithful simulation of a competitive performance environment in order that performance outcomes may be stabilised with practice. Further, it is apparent that training environments can be enhanced by ensuring the representative design of task constraints, which have high action fidelity with the performance context. Ultimately, this study recommends that the traditional coaching adage 'perfect practice makes perfect", be reconsidered; instead advocating that practice should be, as Bernstein (1967) suggested, "repetition without repetition".

Air Gondwana and Mosswood Manor : blended learning environments utilising second life machinima to teach negotiation skills

Seminal reports into higher education in Australia and overseas have recognised negotiation as an essential skill of a practising lawyer and have recommended that all law schools include instruction in negotiation theory and practice in their curricula. Effective negotiation training includes the elements of instruction, modelling, practice and feedback. Ideally such training takes place in the context of small groups. However, this does not necessarily mean that negotiation cannot be taught effectively in the context of large groups. This paper discusses two related blended learning environments that provide instruction in negotiation theory and practice as part of the graduate capabilities program of the undergraduate law degree in the School of Law at the Queensland University of Technology in Brisbane, Australia. Air Gondwana, which forms part of the curriculum of the two first year Contract Law subjects, and Mosswood Manor, which forms part of the curriculum of the second year Trusts subject, utilise a common narrative concerning the family of a wealthy industrialist to facilitate learning of negotiation skills. The programs both combine online and in-class components, the online components utilising machinima (computer graphics created without the need for professional software) to depict the narrative. This strategy has enabled the creation of effective, engaging and challenging learning experiences for large cohorts of students studying by different modes (full-time, part-time and distance external). The use of a common narrative, including the same characters and settings, in the two programs also provides a familiar environment in which students advance their learning from one level of attainment to the next.

Let's eat the captain! Thinking, feeling, doing : intercultural language learning through process drama

This research investigated the sustained use of process drama in a middle school foreign language classroom. The experience led to widespread learner engagement, a deeper contextualisation of the language as a socio-cultural practice, and a willingness to use the spoken and written language, regardless of limited proficiency. The drama required that language use be context and culture specific, contingent and multi-modal, which encouraged the beginner students to "mushfake" or improvise spoken and written text. Particularly important was the way the body was used through drama to express emotion, remember language and to illustrate the sociocultural context of its use.

The impact of a social-cognitive teaching strategy on students with learning difficulties

This study examined the impact of a social-cognitive teaching strategy, the community of inquiry, on the functioning of six Year 4 students with learning difficulties. Results indicated that the students became more self-regulated in their learning and developed greater academic self-efficacy and stronger reading comprehension skills. Although the degree of development varied across the group, the results indicated that all six students (in addition to their class peers) benefited from actively engaging in scaffolded opportunities for intellectual and social exchange in a whole class setting. Accordingly, the findings of this study have implications for approaches to supporting the development and learning of students with learning difficulties.

Learning to Teach Primary Science

Many primary teachers and preservice teachers experience a fear of science that translates into a fear of teaching science. Consequently, primary students may not receive a full science education curriculum, particularly as the teaching of science is avoided by many primary teachers, as shown in an Australian report by Goodrum, Hackling and Rennie ( 2001 ). Preservice teachers need to develop confi dence to teach primary science, by understanding what science is, knowing how to plan and assess science learning, and teaching science skills and knowledge in ways that engage students in science education.

Enhancing teacher education : the School-Community Intergrated Learning (SCIL) pathway

National Australian reviews advocate exploring new models for preservice teacher education. This study investigates the outcomes of the School-Community Integrated Learning (SCIL) pathway as a model for advancing preservice teachers’ understandings of teaching. Thirty-two final-year preservice teachers were surveyed with extended written responses on how the SCIL pathway advanced their understandings of teaching. Results indicated 100% agreement on 6 of the 27 survey items. Indeed, 78% or more preservice teachers agreed that they had a range of experiences across the five categories (i.e., personal-professional skill development, understandings of system requirements, teaching practices, student behaviour and reflective practices). Extended responses suggested they had developed understandings around setting up classrooms, whole school planning processes with professional development, the allocation of teacher responsibilities (e.g., playground duties), parent-teacher interviews, diagnostic testing for literacy and numeracy, commencing running records of students’ assessment results, and the development of relationships (students, teachers and parents). Although a longitudinal study is required to determine long-term effects, the SCIL pathway may be viewed as a positive step towards preparing final-year preservice teachers for their first year as fully-fledged teachers.

Bridging the gap between tertiary education and work : situated learning in accountancy

In professions such as teaching, health sciences (medicine, nursing), and built environment, significant work-based learning through practica is an essential element before graduation. However, there is no such requirement in professional accounting education. This paper reports the findings of an exploratory qualitative case study of the implementation of a Workplace Learning Experience Program in Accountancy at the Queensland University of Technology (QUT) in Australia. The interview-based study documents the responses of university students and graduates to this program. The study demonstrates that a 100 hour work placement in Accountancy can enhance student learning. It highlights the potential value of the application of sociocultural theories of learning, especially the concept of situated learning involving legitimate peripheral participation (Lave and Wenger 1991). This research adds to a small body of empirical accounting education literature relating to the benefits of work placements prior to graduation. The effectiveness of this short, for credit, unpaid program should encourage other universities to implement a similar work placement program as a form of pre-graduation learning in professional accounting education.

Students' cultural capital : a study of assessment for learning as a field of exchange

This study was conducted within the context of a flexible education institution where conventional educational assessment practices and tests fail to recognise and assess the creativity and cultural capital of a cohort of marginalised young people. A new assessment model which included an electronic-portfolio-social-networking system (EPS) was developed and trialled to identify and exhibit evidence of students' learning. The study aimed to discern unique forms of cultural capital (Bourdieu, 1986) possessed by students who attend the Edmund Rice Education Australia Flexible Learning Centre Network (EREAFLCN). The EPS was trialled at the case study schools in an intervention and developed a space where students could make evident culturally specific forms of capital and funds of knowledge (Gonzalez, Moll, & Amanti, 2005). These resources were evaluated, modified and developed through dialogic processes utilising assessment for learning approaches (Qualifications and Curriculum Development Agency, 2009) in online and classroom settings. Students, peers and staff engaged in the recognition, judgement, revision and evaluation of students' cultural capital in a subfield of exchange (Bourdieu, 1990). The study developed the theory of assessment for learning as a field of exchange incorporating an online system as a teaching and assessment model. The term efield has been coined to describe this particular capital exchange model. A quasi-ethnographic approach was used to develop a collective case study (Stake, 1995). This case study involved an in-depth exploration of five students' forms of cultural capital and the ways in which this capital could be assessed and exchanged using the efield model. A comparative analysis of the five cases was conducted to identify the emergent issues of students' recognisable cultural capital resources and the processes of exchange that can be facilitated to acquire legitimate credentials for these students in the Australian field of education. The participants in the study were young people at two EREAFLC schools aged between 12 and 18 years. Data was collected through interviews, observations and examination of documents made available by the EREAFLCN. The data was coded and analysed using a theoretical framework based on Bourdieu's analytical tools and a sociocultural psychology theoretical perspective. Findings suggest that processes based on dialogic relationships can identify and recognise students' forms of cultural capital that are frequently misrecognised in mainstream school environments. The theory of assessment for learning as a field of exchange was developed into praxis and integrated in an intervention. The efield model was found to be an effective sociocultural tool in converting and exchanging students' capital resources for legitimated cultural and symbolic capital in the field of education.