How do experts think about statistics? Hints for improving undergraduate and postgraduate training

Experts are increasingly being called upon to quantify their knowledge, particularly in situations where data is not yet available or of limited relevance. In many cases this involves asking experts to estimate probabilities. For example experts, in ecology or related fields, might be called upon to estimate probabilities of incidence or abundance of species, and how they relate to environmental factors. Although many ecologists undergo some training in statistics at undergraduate and postgraduate levels, this does not necessarily focus on interpretations of probabilities. More accurate elicitation can be obtained by training experts prior to elicitation, and if necessary tailoring elicitation to address the expert’s strengths and weaknesses. Here we address the first step of diagnosing conceptual understanding of probabilities. We refer to the psychological literature which identifies several common biases or fallacies that arise during elicitation. These form the basis for developing a diagnostic questionnaire, as a tool for supporting accurate elicitation, particularly when several experts or elicitors are involved. We report on a qualitative assessment of results from a pilot of this questionnaire. These results raise several implications for training experts, not only prior to elicitation, but more strategically by targeting them whilst still undergraduate or postgraduate students.

Too much knowledge for a nurse? Use of physical assessment by final-semester nursing students

There is debate around the scope of physical assessment skills that should be taught in undergraduate nursing programs. Yet this debate is largely uninformed by evidence on what is learned and practiced by nursing students. This study examined the pattern and correlates of physical assessment skill utilization by 208 graduating nursing students at an Australian university, including measures of knowledge, frequency of use and perceived barriers to physical assessment skills during clinical practice. Of the 126 skills surveyed, on average only five were used every time students practiced. Core skills reflected inspection or general observation of the patient; none involved complex palpation, percussion or auscultation. Skill utilization was also shaped by specialty area. Most skills (70%) were, on average, never performed or learned and students perceived nursing physical assessment was marginalized in both university and workplace contexts. Lack of confidence was thus a significant barrier to use of skills. Based on these findings we argue that the current debate must shift to how we might best support students to integrate comprehensive physical assessment into nursing practice.

Preparing engineering graduates for the knowledge economy through blended delivery of mathematics

Contemporary higher education institutions are making significant efforts to develop cohesive, meaningful and effective learning experiences for Science, Technology, Engineering and Mathematics (STEM) curricula to prepare graduates for challenges in the modern knowledge economy, thus enhancing their employability (Carnevale et al, 2011). This can inspire innovative redesign of learning experiences embedded in technology-enhanced educational environments and the development of research-informed, pedagogically reliable strategies fostering interactions between various agents of the learning-teaching process. This paper reports on the results of a project aimed at enhancing students’ learning experiences by redesigning a large, first year mathematics unit for Engineering students at a large metropolitan public university. Within the project, the current study investigates the effectiveness of selected, technology-mediated pedagogical approaches used over three semesters. Grounded in user-centred instructional design, the pedagogical approaches explored the opportunities for learning created by designing an environment containing technological, social and educational affordances. A qualitative analysis of mixed-type questionnaires distributed to students indicated important inter-relations between participants’ frames of references of the learning-teaching process and stressed the importance (and difficulty) of creating appropriate functional context. Conclusions drawn from this study may inform instructional design for blended delivery of STEM-focused programs that endeavor to enhance students’ employability by educating work-ready graduates.

Engaging students (and their teachers) in STEM through robotics

Robotics@QUT is a university outreach program aimed at building pre- and in-service teacher capacity to encourage interest in Science, Technology, Engineering and Mathematics (STEM) subjects with school children from low socio-economic status areas. Currently over 35 schools are involved in the outreach program. Professional Development workshops are provided to teachers to build their knowledge in implementing robotics-based STEM activities in their classrooms, robotics loan kits are provided, and pre-service teacher visits arranged to provide the teachers with on-going support. The program also provides opportunities for school students to engage in robotics-based on-campus activities and competitions and is seen as a way to build aspirations for university. This paper presents an interim evaluation that examines the value of the Robotics@QUT program for the teachers, pre-service teachers and school students participating in the program. Surveys were administered to determine the participants’ perceived benefits of being involved and their perceptions of the program. The data gathered from the teachers showed that they had gained knowledge and confidence and felt that the Robotics@QUT program had assisted them to deliver engaging robotics-based STEM activities in their classrooms. The pre-service teachers’ responses focused on benefits for themselves, for their future teaching careers and for the school students involved. The school students’ responses focused on their increased knowledge and confidence to pursue future STEM studies and careers.

Who are our repeating students? Profiling students persisting after failure

Research on attrition has focused on the economic significance of low graduation rates in terms of costs to students (fees that do not culminate in a credential) and impact on future income. For a student who fails a unit and repeats the unit multiple times, the financial impact is significant and lasting (Bexley, Daroesman, Arkoudis & James 2013). There are obvious advantages for the timely completion of a degree, both for the student and the institution. Advantages to students include fee minimisation, enhanced engagement opportunities, effectual pathway to employment and a sense of worth, morale and cohort-identity benefits. Work undertaken by the QUT Analytics Project in 2013 and 2014 explored student engagement patterns capturing a variety of data sources and specifically, the use of LMS amongst students in 804 undergraduate units in one semester. Units with high failure rates were given further attention and it was found that students who were repeating a unit were less likely to pass the unit than students attempting it for the first time. In this repeating cohort, academic and behavioural variables were consistently more significant in the modelling than were any demographic variables, indicating that a student’s performance at university is far more impacted by what they do once they arrive than it is by where they come from. The aim of this poster session is to examine the findings and commonalities of a number of case studies that articulated the engagement activities of repeating students (which included collating data from Individual Unit Reports, academic and peer advising programs and engagement with virtual learning resources). Understanding the profile of the repeating student cohort is therefore as important as considering the characteristics of successful students so that the institution might be better placed to target the repeating students and make proactive interventions as early as possible.

Students’ well-being and social connections

Description of Workshop/Poster Presentation This presentation will showcase CORE Connections – ‘Creating Opportunities for Resilience and Engagement’ – which is a whole-school approach to mental health promotion. While initially designed to prevent adolescent depression and substance abuse, current thinking suggests that competency enhancement (e.g., autonomy, competence, supportive networks) more widely improves students’ well-being, educational engagement, and learning outcomes. In the presentation, we will provide an overview of the CORE project, describe the CORE intervention, which is conceptualized as a dynamic and penetrating process of social practices, present some preliminary findings from the pilot phase of CORE, and conclude our presentation with an interactive section with the participants. This project will highlight a wellness focus that addresses social engagement within whole school cultures. Purpose of the Presentation Student mental and physical well-being has gained increasing attention. Our presentation will introduce the CORE project, which has a potential to decrease student depression, anxiety, and substance use, and to increase student self-esteem and learning outcomes. In this vein, our presentation will raise the public awareness of the salient role of social connection in student well-being. Specifically, a group of presenters will discuss the impact of social connection on students’ anxiety, mathematics achievement, and perceived racial discrimination. • We will present participants with an alternative way to conceptualize and approach mental health promotion within a school context. In contrast to prescribed programs that are commonly used in today’s schools, CORE is a whole-school approach that is flexibly integrated into all aspects of the classroom and school environment. Our aim is to illustrate the intervention principles of CORE while highlighting examples of mental health outcomes/transformation. • Underutilized in mental health promotion research, social network analysis provides critical information in understanding relationships between social cohesion (e.g., a student’s connectedness to others) and mental health outcomes. This session will showcase how focusing on and strengthening social connections in and out of school can contribute to student well-being, achievement, and mental health. Educational Objectives By the end of the presentation, participants will • obtain a general overview of the CORE program, • understand how psychological health and school performance relate to student well-being, • and understand how social connections in and out of school can contribute to student well-being. Interactive / Participatory Component We will invite audience members to discuss inhibitors and contributors to student well-being and the best ways for schools to help students feel safe, connected, and valued. Presentation Key Points • Overview of the CORE project • Theorization of social connection • Some empirical studies emerging from CORE • Presenter-audience interaction Evidence of Relevance and Utility to Participants Potential participants are adults with significant relationships with students, either as family members, community neighbors, educators, scholars, service providers, or policy makers. Our presentation will inspire these significant adults to construct a welcoming society to help improve student well-being.

'Create a better online you': Designing online learning resources to develop undergraduate social media skills

‘Create a Better Online You’ (CBOY) is an emerging initiative from QUT Library. CBOY focusses on developing the social media skills of undergraduates at QUT. While many students will have encountered ‘cybersafety’ training in primary or secondary school, a comprehensive environmental scan revealed little in the way of social media resources targeted at undergraduates. In particular, there was little to no focus on the ways in which social media could be used strategically to develop a positive online reputation and enhance chances of employability post tertiary education. The resources created as part of CBOY are the result of a literature review, environmental scan, and discussions with staff and students at QUT. Following the comprehensive environmental scan, it appears that CBOY represents one of the first free, openly accessible, interactive resources targeting the social media skills of undergraduates.

‘Just choose the easy option’: Students talk about alcohol use and social influence

Previous research into young people’s drinking behaviour has studied how social practices influence their actions and how they negotiate drinking-related identities. Here, adopting the perspective of discursive psychology we examine how, for young people, social influences are bound up with issues of drinking and of identity. We conducted 19 focus groups with undergraduate students in Australia aged between 18 and 24 years. Thematic analysis of participants’ accounts for why they drink or do not drink was used to identify passages of talk that referred to social influence, paying particular attention to terms such as ‘pressure’ and ‘choice’. These passages were then analysed in fine-grained detail, using discourse analysis, to study how participants accounted for social influence. Participants treated their behaviour as accountable and produced three forms of account that: (1) minimised the choice available to them, (2) explained drinking as culture and (3) described resisting peer pressure. They also negotiated gendered social dynamics related to drinking. These forms of account allowed the participants to avoid individual responsibility for drinking or not drinking. These findings demonstrate that the effects of social influence on young people’s drinking behaviour cannot be assumed, as social influence itself becomes negotiable within local contexts of talk about drinking.

STEM learning through engineering design: fourth-grade students' investigations in aerospace

Background: Internationally, there is a growing concern for developing STEM education to prepare students for a scientifically and technologically advanced society. Despite educational bodies lobbying for an increased focus on STEM, there is limited research on how engineering might be incorporated especially in the elementary school curriculum. A framework of five comprehensive core engineering design processes (problem scoping, idea generation, design and construction, design evaluation, redesign), adapted from the literature on design thinking in young children, served as a basis for the study. We report on a qualitative study of fourth-grade students’ developments in working an aerospace problem, which took place during the first year of a 3-year longitudinal study. Students applied design processes together with their mathematics and science knowledge to the design and redesign of a 3-D model plane. Results: The study shows that through an aerospace engineering problem, students could complete initial designs and redesigns of a model plane at varying levels of sophistication. Three levels of increasing sophistication in students’ sketches were identified in their designs and redesigns. The second level was the most prevalent involving drawings or templates of planes together with an indication of how to fold the materials as well as measurements linked to the plane’s construction. The third level incorporated written instructions and calculations. Students’ engagement with each of the framework’s design processes revealed problem scoping components in their initial designs and redesigns. Furthermore, students’ recommendations for improving their launching techniques revealed an ability to apply their mathematics knowledge in conjunction with their science learning on the forces of flight. Students’ addition of context was evident together with an awareness of constraints and a consideration of what was feasible in their design creation. Interestingly, students’ application of disciplinary knowledge occurred more frequently in the last two phases of the engineering framework (i.e., design evaluation and redesign), highlighting the need for students to reach these final phases to enable the science and mathematics ideas to emerge. Conclusions: The study supports research indicating young learners’ potential for early engineering. Students can engage in design and redesign processes, applying their STEM disciplinary knowledge in doing so. An appropriate balance is needed between teacher input of new concepts and students’ application of this learning in ways they choose. For example, scaffolding by the teacher about how to improve designs for increased detail could be included in subsequent experiences. Such input could enhance students’ application of STEM disciplinary knowledge in the redesign process. We offer our framework of design processes for younger learners as one way to approach early engineering education with respect to both the creation of rich problem experiences and the analysis of their learning.

Social media in higher education: Strategy and support for staff and students

In 2013, social networking was the second most popular online activity after internet banking for Australians (ABS, 2014). The popularity and apparent ubiquity of social media is one of the most obvious and compelling arguments for integrating such technologies into higher education. Already, social media impacts a wide range of activities ranging in scope from marketing and communication to teaching and learning in higher education (Hrastinski & Dennen, 2012). Social media presents many exciting possibilities and opportunities for higher education. This session will focus on one staff focussed and one student focussed social media innovation currently underway at QUT. First, it will focus on the actions of QUT’s social media working group. The working group’s aim is to ensure an overarching social media policy for the university is developed and implemented that supports staff in the use of social media across a range of activities. Second, it will discuss the eResponsible and eProfessional Online resources for students project. The focus of this project is to develop a suite of online resources targeted at the devel opment of social media skills for undergraduate students at QUT. These initiatives are complementary and both aim to minimise risk while maximising opportuniti es for the university

Investigating the effectiveness of an ecological approach to learning design in a first year mathematics for engineering unit

This paper reports on the results of a project aimed at creating a research-informed, pedagogically reliable, technology-enhanced learning and teaching environment that would foster engagement with learning. A first-year mathematics for engineering unit offered at a large, metropolitan Australian university provides the context for this research. As part of the project, the unit was redesigned using a framework that employed flexible, modular, connected e-learning and teaching experiences. The researchers, interested in an ecological perspective on educational processes, grounded the redesign principles in probabilistic learning design (Kirschner et al., 2004). The effectiveness of the redesigned environment was assessed through the lens of the notion of affordance (Gibson, 1977,1979, Greeno, 1994, Good, 2007). A qualitative analysis of the questionnaire distributed to students at the end of the teaching period provided insight into factors impacting on the successful creation of an environment that encourages complex, multidimensional and multilayered interactions conducive to learning.

Motivation and behavioural patterns of students accessing a peer-facilitated support for learning program

This paper describes the development and use of personas, a Human Computer Interaction (HCI) research methodology, within the STIMulate peer learning program, in order to better understand student behaviour patterns and motivations. STIMulate is a support for learning program at the Queensland University of Technology (QUT) in Brisbane, Australia. The program provides assistance in mathematics, science and information technology (IT) for course work students. A STIMulate space is provided for students to study and obtain one-on-one assistance from Peer Learning Facilitators (PLFs), who are experienced students that have excelled in relevant subject areas. This paper describes personas – archetypal users - that represent the motivations and behavioural patterns of students that utilise STIMulate (particularly the IT stream). The personas were developed based on interviews with PLFs, and subsequently validated by a PLF focus group. Seven different personas were developed. The personas enable us to better understand the characteristics of the students utilising the STIMulate program. The research provides a clearer picture of visiting student motivations and behavioural patterns. This has helped us identify gaps in the services provided, and be more aware of our assumptions about students. The personas have been deployed in PLF training programs, to help PLFs provide a better service to the students. The research findings suggest further study on the resonances between some students and PLFs, which we would like to better elicit.

Benefits of blended learning for the first year medical imaging students in preparation for clinical placement

Although there is a plethora of definitions of blended learning, the underlying distinguishing feature is the combination of traditional content delivery and the utilisation of technology. Within Medical Imaging undergraduate education there is evidence of advantages and increased student engagement when utilising a blended learning approach. Although the embedding of technology has been proven to be a useful teaching tool, “Educators should tailor their teaching media to learner’s needs rather than assume that web based learning is intrinsically superior”. This study aims to determine which clinical learning tools are perceived to be the most useful to the student in preparing them for placements.

Informed learning in the undergraduate classroom: The role of information experiences in shaping outcomes

This research aimed to inform the design of effective information literacy lessons in higher education. Phenomenography, a research approach designed to study human experience, was used to explore the experiences of a teacher and undergraduate students using information to learn about language and gender issues. The findings show that the way learners use information influences content-focused learning outcomes, and reveal an instructional pattern for enabling students to use information while becoming aware of the topic they are investigating. Based on the findings, a design model is offered in which learning outcomes are realized through targeted information literacy activities.

Mathematics, programming, and STEM

Learning mathematics is a complex and dynamic process. In this paper, the authors adopt a semiotic framework (Yeh & Nason, 2004) and highlight programming as one of the main aspects of the semiosis or meaning-making for the learning of mathematics. During a 10-week teaching experiment, mathematical meaning-making was enriched when primary students wrote Logo programs to create 3D virtual worlds. The analysis of results found deep learning in mathematics, as well as in technology and engineering areas. This prompted a rethinking about the nature of learning mathematics and a need to employ and examine a more holistic learning approach for the learning in science, technology, engineering, and mathematics (STEM) areas.