Towards a sustainable assessment strategy for digital forensic education and training

In this paper, we show the development and application of a sustainable assessment strategy as an implementation of effective learning for a computer crime and digital forensics unit. The unit is undertaken by undergraduate students as part of an Information Technology Security course at Deakin University. Over a five year period the teaching team has made continuous improvements to the delivery of material and content taking informal student feedback and Faculty review into careful consideration. In addition formal student evaluation of the unit has been extremely positive. As part of reflective teaching practice the teaching team derived a map of the relationship between learning objectives, learning activities, the assessment and the unit outcomes to verify what has led to the favorable student experience and its impact on learning process in order to repeat this strategy for other tertiary courses.

Teaching 3-D geometry - the multi representational way

Sonja Kalbitzer and Esther Loong provide an excellent range of activities that promote geometric thinking through the exploration of three-dimensional objects. They also provide some discussion on assessing the tasks and providing student feedback.

The presence of mathematics anxiety in future primary school teachers and factors affecting abatement

This study reflects on the implementation of various teaching initiatives for reducing anxiety toward mathematics in students studying to become primary school teachers. We highlight similarities between these practices and those promoted by the 'Whole Teacher' approach - in particular, the aim to develop attitudes along with knowledge and skills. Here, the negative past associations with mathematics and anxiety toward mathematics that students bring with them have been a key consideration when designing the subject content and delivery. Given the important role these students will have in shaping mathematics education in the future, we suggest frameworks such as that of the 'Whole Teacher' could be extended to the university setting. We investigate four years of student feedback pertaining to a first year undergraduate mathematics unit, contending that the teaching initiatives introduced over time have helped students develop a positive attitude toward mathematics. We note, however, that the student-teacher relationship was still the most prominent factor directly identified by students who previously had a fear or negative attitude toward mathematics.

Enhancing learning for distance students in an Undergraduate engineering course through real-time web-conferencing

On-line education in engineering has attracted a great deal of interest in recent years. One of the difficulties faced in an on-line engineering program is how to ensure effective communication between lecturers and students, and among the students themselves.Techniques common ten years ago such as email, lecture notes posted to websites, and telephone conversations, are now seen as archaic when compared with opportunities offered by more modern communication technologies, such as real-time web-conferencing.We present our efforts to use the web-conferencing software Elluminate-Live! for delivering tutorials, discussion classes, and even laboratory practicals to groups of students studying engineering off-campus, including students posted overseas. Examples are given from two disciplines. We then compare student feedback across all engineering subjects over the years 2012-2013. Our results show that students welcome web-conferencing as a very effectivemeans to deliver classes to distance students and improve their learning experience.

Attributes of effective business teachers: perceptions of students enrolled in highly rated units

This study employs a widely used attributes of effective teachers framework to guide the coding of written feedback of students (n =169) enrolled in highly rated (top 25 per cent) business units at a large Australian University. This framework also underpins the theoretical interpretation of the data. By focusing on student feedback about effective business teachers, the aim of this study is to identify the most important attributes of these teachers from the perspective of satisfied student. The data is part of a larger survey of student evaluations of teaching and units. Findings from the analysis of feedback from highly-satisfied students reveals that the top five attributes of effective business teachers are related to classroom performance – creative and interesting, knowledgeable, effective communicator, sensitive and persistent, and enthusiastic. The findings provide insights to teachers, students and university administrators. A recommendation for future research is provided.

Selecting, training and assessing new general practice community teachers in UK medical schools

Background: Standards for undergraduate medical education in the UK, published in Tomorrow’s Doctors, include the criterion ‘everyone involved in educating medical students will be appropriately selected, trained, supported and appraised’. Aims: To establish how new general practice (GP) community teachers of medical students are selected, initially trained and assessed by UK medical schools and establish the extent to which Tomorrow’s Doctors standards are being met. Method: A mixed-methods study with questionnaire data collected from 24 lead GPs at UK medical schools, 23 new GP teachers from two medical schools plus a semi-structured telephone interview with two GP leads. Quantitative data were analysed descriptively and qualitative data were analysed informed by framework analysis. Results: GP teachers’ selection is non-standardised. One hundred per cent of GP leads provide initial training courses for new GP teachers; 50% are mandatory. The content and length of courses varies. All GP leads use student feedback to assess teaching, but other required methods (peer review and patient feedback) are not universally used. Conclusions: To meet General Medical Council standards, medical schools need to include equality and diversity in initial training and use more than one method to assess new GP teachers. Wider debate about the selection, training and assessment of new GP teachers is needed to agree minimum standards.

Responding to our customers' needs: modifications to assessment in Obstetrics and Gynaecology over 20 years

Background and Objectives: This paper reports on historical changes in assessment culminating in the experience of one discipline with negotiated student feedback that has helped design and modify assessment to cater for the requirements of both students and teachers. The standard of assessment required to pass Obstetrics and Gynaecology in the four year graduate entry program in the School of Medicine at The University of Queensland, Brisbane, Australia has become less formalised and more collaborative. Changes in assessment in this discipline over the last 20 years reflect the development of an understanding of the educational principles associated with adult teaching and learning. Assessment has evolved from being teacher focussed, with questionable reliability, validity, and emphasis on outcomes, to being focussed on learning and the student. Multiplechoice examinations, combined with a collaborative approach to the reliability and validity of questions and answers and a debrief or feedback session have been found to provide an assessment format that is art acceptable measure oflearning for both teachers and students. Changes in assessment reflect a collaborative process between teachers and students based on principles of adult learning and involving negotiated student feedback. Our experience with this form of negotiated outcome for assessment is presented together with suggestions for improvement and is contrasted with assessment methods used in this department over the last 20 years. Change and refinement will continue as medical programs strive to meet the learning needs of students and assessment outcomes that are acceptable to its teachers.

Jogos de negócio : o que leva o docente de cursos da área de Ciências Sociais Aplicadas a adotar a ferramenta de ensino

The Business Games are a growing teaching strategy and alternative to the academic front through the new process of Teaching and Learning. Through literature review and semi-structured interviews, this work addresses the teachers considering their subjectivity in deciding JN as the three profiles suggested by Faria and Wellington (2004): those who use it, those who stopped using and those who do not. The research corpus is limited to contributions of 22 respondents between master and doctors teachers of Applied Social Sciences area courses in colleges of Brasília (DF), Goiânia (GO), Ribeirão Preto (SP) and Uberlandia (MG). The content analysis of the interviews allowed to infer that: (1) join the teaching strategy is a commitment to a complex planning, with constant training and proactivity related to student feedback; (2) abandons the practice is becoming less common, because managers tend to recommend it and there are more and more software available for specific disciplines. Its discussed also other contributions (motivations) given by respondents of the three groups that were not found in the literature. It is hoped that this work will serve (1) incentive to teachers on the use of Business Games as a teaching strategy (2) consultation by managers when they decide about purchasing simulation software. Finally, stands out that the educational success of JN depends not only on the various motivations of teachers, as well as the interest and commitment of the student.

Evaluation of creative problem solving abilities in undergraduate structural engineers through interdisciplinary problem based learning

For a structural engineer, effective communication and interaction with architects cannot be underestimated as a key skill to success throughout their professional career. Structural engineers and architects have to share a common language and understanding of each other in order to achieve the most desirable architectural and structural designs. This interaction and engagement develops during their professional career but needs to be nurtured during their undergraduate studies. The objective of this paper is to present the strategies employed to engage higher order thinking in structural engineering students in order to help them solve complex problem-based learning (PBL) design scenarios presented by architecture students. The strategies employed were applied in the experimental setting of an undergraduate module in structural engineering at Queen’s University Belfast in the UK. The strategies employed were active learning to engage with content knowledge, the use of physical conceptual structural models to reinforce key concepts and finally, reinforcing the need for hand sketching of ideas to promote higher order problem-solving. The strategies employed were evaluated through student survey, student feedback and module facilitator (this author) reflection. The strategies were qualitatively perceived by the tutor and quantitatively evaluated by students in a cross-sectional study to help interaction with the architecture students, aid interdisciplinary learning and help students creatively solve problems (through higher order thinking). The students clearly enjoyed this module and in particular interacting with structural engineering tutors and students from another discipline

The Evolution of 'Design Build Fly' Led Teaching in Aerospace Engineering

This paper describes the evolution of a ‘Design - Build-Fly’ (DBF) approach to the delivery and assessment of a Stage Three Aircraft Design module. It focuses on the primary learning outcomes around the design and manufacturing functions associated with the development of a remotely controlled aircraft. The work covers a six year period from 2011 to present mapping the transformation of the module from report based assessment to a more hands on approach resulting in a fully functioning remotely controlled aircraft. Results show that both the staff and student experience improved across key performance metrics including student feedback, learning and competency development. Challenges still remain in methods of placing students within teams and maintaining technical rigour in reporting as students develop vocational skills and more reflective writing styles.

Bespoke Radiology e-Learning

Introduction: Foundation doctors are expected to assess and interpret plain x-ray studies of the chest/abdomen before a definitive report is issued by senior staff. The Royal College of Radiologists have published guidelines (RCR curriculum) on the scope of plain film findings medical students should be familiar with.1 Studies have shown that the x-ray interpretation without feedback does not significantly improve diagnostic ability. 2 Queen’s University, Belfast Trust Radiology and Experior Medical developed an online system to assess individual student ability to interpret X-ray findings. Over a series of assessments each student’s profile is built up, identifying strengths and weakness. The system can then create bespoke individual assessments re-evaluating previously identified weak areas and quantifying interpretative skill improvement. Aim: To determine how readily an online system is adopted by senior medical students, investigating if increasing exposure to x-ray interpretation combined with cyclical formative feedback enhances performance. Methods: The system was offered to all 270 final year medical students as an online resource. The system comprised a series of 20 weekly 30 minute assessments, containing normal and abnormal x-rays within the RCR curriculum. After each assessment students were given formative feedback, including their own result, annotated answers, peer group comparison and a breakdown of areas of strength and weakness. Focus groups of 4-5 students addressed student perspectives of the system, including ease of use, image resolution, system performance across different operating platforms, perceived value of formative feedback loops, breakdown of performance and the value of bespoke personalised assessments. Research Ethics Approval was granted for the study. Data analysis was via two-sided one-sample t-test; initial minimal recruitment was estimated as 60 students, to detect a mean 10% change in performance, with a standard deviation of 20%. Results and Discussion: Over 80% (n = XXX/270) of the student cohort engaged with the study. Student baseline average was 39%, increasing to 62% by the exit test. The steadily sustained improvement (57% relative performance in interpretative diagnostic accuracy) was despite increasing test difficulty. Student feedback via focus groups was universally positive throughout the examined domains. Conclusion: The online resource proved to be valuable, with high levels of student engagement, improving performance despite increasingly difficulty testing and positive learner experience with the system. References: 1. Undergraduate Radiology Curriculum, The Royal College of Ra, April 2012. Ref No. BFCR(12)4 The Royal College of Radiologists, April 2012 2. I Satia, S Bashagha, A Bibi, R Ahmed, S Mellor, F Zaman. Assessing the accuracy and certainty in interpretating chest x-rays in the medical division. Clin Med August 2013 Vol.13 no. 4 349-352

Web-based museum trails on PDAs for university-level design students: Design and evaluation

This paper describes the development and evaluation of web-based museum trails for university-level design students to access on handheld devices in the Victoria and Albert Museum (V&A) in London. The trails offered students a range of ways of exploring the museum environment and collections, some encouraging students to interpret objects and museum spaces in lateral and imaginative ways, others more straightforwardly providing context and extra information. In a three-stage qualitative evaluation programme, student feedback showed that overall the trails enhanced students’ knowledge of, interest in, and closeness to the objects. However, the trails were only partially successful from a technological standpoint due to device and network problems. Broader findings suggest that technology has a key role to play in helping to maintain the museum as a learning space which complements that of universities as well as schools. This research informed my other work in visitor-constructed learning trails in museums, specifically in the theoretical approach to data analysis used, in the research design, and in informing ways to structure visitor experiences in museums. It resulted in a conference presentation, and more broadly informed my subsequent teaching practice.

Residential schools in a first-year undergraduate engineering programme

BACKGROUND OR CONTEXT: For over 20 years, Deakin University has delivered an accredited undergraduate engineering course by means of distance education. Prior to 2004, off-campus students were not required to attend classes in person on campus. The course was designed so that the off campus students were able to undertake all study and assessment tasks remotely from the university campus. Offering accredited domestic undergraduate engineering courses via distance education has been seen as an important strategy for helping to provide graduate domestically educated engineers to meet Australia’s current and future needs. From 2000 the Australian accreditation management system for professional engineers, as managed by Engineers Australia, has increased its scrutiny of accredited domestic undergraduate engineering courses that were provided in distance-education mode. This led to a series of policies and recommendations for Australian universities that offer accredited engineering courses in distance-education mode: one of the recommendations was that off campus
enrolled engineering students should periodically attend some campus-based activities throughout the course. During the 2004 accreditation review of engineering courses at Deakin University, the
accreditation panel requested that mandatory campus-based activities be incorporated into the accredited undergraduate engineering course. Specifically the request was that Deakin mandate that all off-campus students enrolled in an accredited undergraduate engineering course provided by university attend in person a residential school at least once during every year of equivalent full-time study load. The accreditation panel suggested a program model for the residential school component of the course as developed by the University of Southern Queensland.
PURPOSE OR GOAL: This paper describes the development of the mandatory residential school component of accredited distance education undergraduate engineering courses at Deakin University with
a particular focus on how the residential school program is implemented at level 1 (first-year full-time equivalent level) of the courses.
APPROACH: To be compliant with accreditation requirements, since 2005 Deakin has conducted residential schools for off-campus students at its Geelong Waurn Ponds Campus. Initially the schools were conducted annually over two-weeks during the first semester, and have transitioned to the current mode where the residential school is conducted as a one week programme in each of the trimesters. During these schools, activities are organised around the respective engineering-course units undertaken by students during the trimester.
DISCUSSION: The minimum requirements for the on-campus components of distance-education-mode accredited engineering courses were developed by Engineers Australia in consultation with members of the Washington Accord (International Education Alliance) and at the time of development, generated considerable debate (Palmer, 2005, 2008). The intended purpose of residential schools was for off-campus enrolled students to have reasonable exposure to a typical “on-the-campus” student experience periodically throughout the course. Elements considered suitable and worthwhile for inclusion in residential school programs included:
• in person engagement with their academic lecturers,
• presentations and interaction with guest speakers from industry,
• industry-based site visits,
• engagement in sole and group-based learning and assessment activities on campus, and
• social interaction with other students.
RECOMMENDATIONS/IMPLICATIONS/CONCLUSION: We have found that advantages to the students who attends a residential school include completing real practical work without the need to assemble their own materials at home, and social engagement with staff and students. Off-campus students leave the residential school with a sense of belonging to a “community”, “one of many doing the same and not the only one”. They have the opportunity to share their often significant professional experience with the generally younger and less experienced on-campus student colleagues. Through this interaction between on-campus and off-campus students, the on-campus students benefit as much as the off-campus students. The disadvantages to the off-campus students is the requirement to travel to Geelong for an extended time, which costs the students both money and time away from work and family. From our experience, we recommend to other institutions starting residential schools of their own that they exploit the mandatory on-campus-presence requirement to enhance learning outcomes, well publicised timetables be available to students before trimester begins (certainly before census date), a standardised academic week during trimester be set for all residential schools, encourage student feedback on the program, and apply a practice of uniformity and consistency in how the programme is managed, especially mandated student attendance. Our residential schools for off-campus-mode students have been running for over 10 years. We have found that the educational and social advantages to the student outweigh the disadvantages.

Moving online with engineering physics at Deakin University – lessons learned in delivering online laboratories in D2L

As part of Deakin’s Course Enhancement Program, The Faculty of Science, Engineering and Built Environment, the School of Engineering and Deakin Learning Futures, combined their resources to produce a series of video presentations to enhance the efficiency of physics practicals in the first-year engineering course. Along the way it was decided the unit also needed a complete overhaul in terms of content layout and delivery. And this was all to be done in a short time frame of a few months before start of Trimester 1, 2014. The end result includes eight professionally developed videos embedded into HTML pages of instruction and information within the CloudDeakin environment, a completely new navigation structure, and templated content pages with links to various resources. The production journey was not without it’s challenges and constraints, but the unit has been delivered, and the student feedback is in.