Understanding graphicacy : students’ making sense of graphics in mathematics assessment tasks

The ability to decode graphics is an increasingly important component of mathematics assessment and curricula. This study examined 50, 9- to 10-year-old students (23 male, 27 female), as they solved items from six distinct graphical languages (e.g., maps) that are commonly used to convey mathematical information. The results of the study revealed: 1) factors which contribute to success or hinder performance on tasks with various graphical representations; and 2) how the literacy and graphical demands of tasks influence the mathematical sense making of students. The outcomes of this study highlight the changing nature of assessment in school mathematics and identify the function and influence of graphics in the design of assessment tasks.

Helping undergraduate students across disciplines and cultures actively engage and collaborate as equal members of a community of scholars : peer review within an e-learning environment

At the international level, the higher education sector is currently being subjected to increased calls for public accountability and the current move by the OECD to rank universities based on the quality of their teaching and learning outcomes. At the national level, Australian universities and their teaching staff face numerous challenges including financial restrictions, increasing student numbers and the reality of an increasingly diverse student population. The Australian higher education response to these competing policy and accreditation demands focuses on precise explicit systems and procedures which are inflexible and conservative and which ignore the fact that assessment is the single biggest influence on how students approach their learning. By seriously neglecting the quality of student learning outcomes, assessment tasks are often failing to engage students or reflect the tasks students will face in the world of practice. Innovative assessment design, which includes new paradigms of student engagement and learning and pedagogically based technologies have the capacity to provide some measure of relief from these internal and external tensions by significantly enhancing the learning experience for an increasingly time-poor population of students. That is, the assessment process has the ability to deliver program objectives and active learning through a knowledge transfer process which increases student participation and engagement. This social constructivist view highlights the importance of peer review in assisting students to participate and collaborate as equal members of a community of scholars with both their peers and academic staff members. As a result of increasing the student’s desire to learn, peer review leads to more confident, independent and reflective learners who also become more skilled at making independent judgements of their own and others' work. Within this context, in Case Study One of this project, a summative, peer-assessed, weekly, assessment task was introduced in the first “serious” accounting subject offered as part of an undergraduate degree. The positive outcomes achieved included: student failure rates declined 15%; tutorial participation increased fourfold; tutorial engagement increased six-fold; and there was a 100% student-based approval rating for the retention of the assessment task. However, in stark contrast to the positive student response, staff issues related to the loss of research time associated with the administration of the peer-review process threatened its survival. This paper contributes to the core conference topics of new trends and experiences in undergraduate assessment education and in terms of innovative, on-line, learning and teaching practices, by elaborating the Case Study Two “solution” generated to this dilemma. At the heart of the resolution is an e-Learning, peer-review process conducted in conjunction with the University of Melbourne which seeks to both create a virtual sense of belonging and to efficiently and effectively meet academic learning objectives with minimum staff involvement. In outlining the significant level of success achieved, student-based qualitative and quantitative data will be highlighted along with staff views in a comparative analysis of the advantages and disadvantages to both students and staff of the staff-led, peer review process versus its on-line counterpart.

Evolution of life drama program

Life Drama is a program of drama-based experiential learning activities involving groups of community leaders and members. The three-year project evolved from a theatre-in-education approach to an intercultural theatre approach incorporating Papua New Guinean performance traditions. It involved Australian, English and Papua New Guinean researchers at four key sites: Tari, Southern Highlands Province; Port Moresby, National Capital District; Madang, Madang Province; and Karkar Island, Madang Province. The project was innovative in a number of ways, including: a Participatory Action Research approach, involving community leaders at various levels as co-researchers; a participatory theatre approach as opposed to a performance approach; emphasis on sexual health promotion and HIV prevention through an experiential learning paradigm; addressing the norms and realities of the community rather than targeting only individual behaviour; an International Theatre Research Laboratory to explore the fusion of traditional cultural elements with contemporary health promotion aims; and an innovative method-assemblage approach to collecting and triangulating quantitative, qualitative, and performative data. The project attracted over $350,000 in funding and support from the Australian Research Council, National AIDS Secretariat in PNG, and private sector and non-government partners. Findings were presented at various conferences and symposia including the annual Medical Symposium in Wewak (2010), the triennial Research in Drama Education conference in Exeter (2011), and the International Research in Drama Education conference (Sydney 2009 and Limerick 2012). A number of peer-reviewed journal articles have been published. Elements of the program have been incorporated into the University of Goroka's compulsory HIV awareness program for undergraduate students. A national dissemination strategy for Life Drama in Papua New Guinea is now underway, with seed funding of AUD$74,000 from the National AIDS Council Secretariat, PNG.

Error correction in second language writing : teachers’ beliefs, practices, and students’ preferences

Error correction is perhaps the most widely used method for responding to student writing. While various studies have investigated the effectiveness of providing error correction, there has been relatively little research incorporating teachers' beliefs, practices, and students' preferences in written error correction. The current study adopted features of an ethnographic research design in order to explore the beliefs and practices of ESL teachers, and investigate the preferences of L2 students regarding written error correction in the context of a language institute situated in the Brisbane metropolitan district. In this study, two ESL teachers and two groups of adult intermediate L2 students were interviewed and observed. The beliefs and practices of the teachers were elicited through interviews and classroom observations. The preferences of L2 students were elicited through focus group interviews. Responses of the participants were encoded and analysed. Results of the teacher interviews showed that teachers believe that providing written error correction has advantages and disadvantages. Teachers believe that providing written error correction helps students improve their proof-reading skills in order to revise their writing more efficiently. However, results also indicate that providing written error correction is very time consuming. Furthermore, teachers prefer to provide explicit written feedback strategies during the early stages of the language course, and move to a more implicit strategy of providing written error correction in order to facilitate language learning. On the other hand, results of the focus group interviews suggest that students regard their teachers' practice of written error correction as important in helping them locate their errors and revise their writing. However, students also feel that the process of providing written error correction is time consuming. Nevertheless, students want and expect their teachers to provide written feedback because they believe that the benefits they gain from receiving feedback on their writing outweigh the apparent disadvantages of their teachers' written error correction strategies.

The moderator effect of cognitive modifiability on a traditional undergraduate admissions test for disadvantaged Black students in South Africa

Contends that South African universities must find admissions criteria, other than high school grades, that are both fair and valid for Black applicants severely disadvantaged by an inferior school education. The use of traditional intellectual assessments and aptitude tests for disadvantaged and minority students remains controversial as a fair assessment; they do not take account of potential for change. In this study, therefore, a measure of students' cognitive modifiability, assessed by means of an interactive assessment model, was added as a moderator of traditional intellectual assessment in predicting 1st-yr university success. Cognitive modifiability significantly moderated the predictive validity of the traditional intellectual assessment for 52 disadvantaged Black students. The higher the level of cognitive modifiability, the less effective were traditional methods for predicting academic success and vice versa.

Challenges of Measuring Learning Outcomes for Property Students Engaged in Work Integrated Learning

Work integrated learning (WIL) or professional practice units are recognised as providing learning experiences that help students make successful transitions to professional practice. These units require students to engage in learning in the workplace; to reflect on this learning; and to integrate it with learning at university. However, an analysis of a recent cohort of property economics students at a large urban university provides evidence that there is great variation in work based learning experiences undertaken and that this impacts on students’capacity to respond to assessment tasks which involve critiquing these experiences in the form of reflective reports. This paper highlights the need to recognise the diversity of work based experiences; the impact this has on learning outcomes; and to find more effective and equitable ways of measuring these outcomes. The paper briefly discusses assessing learning outcomes in WIL and then describes the model of WIL in the Faculty of Built Environment and Engineering at the Queensland University of Technology (QUT). The paper elaborates on the diversity of students’ experiences and backgrounds including variations in the length of work experience, placement opportunities and conditions of employment.For example, the analysis shows that students with limited work experience often have difficulty critiquing this work experience and producing high level reflective reports. On the other hand students with extensive, discipline relevant work experience can be frustrated by assessment requirements that do not take their experience into account. Added to this the Global Financial Crisis (GFC) has restricted both part time and full time placement opportunities for some students. These factors affect students’ capacity to a) secure a relevant work experience, b) reflect critically on the work experiences and c) appreciate the impact the overall experience can have on their learning outcomes and future professional opportunities. Our investigation highlights some of the challenges faced in implementing effective and equitable approaches across diverse student cohorts. We suggest that increased flexibility in assessment requirements and increased feedback from industry may help address these challenges.

Engaging undergraduate nursing students in face-to-face tutorials

Chronic nursing shortages have placed increasing pressure on many nursing schools to recruit greater numbers of students with the consequence of larger class sizes. Larger class sizes have the potential to lead to student disengagement. This paper describes a case study that examined the strategies used by a group of nursing lecturers to engage students and to overcome passivity in a Bachelor of Nursing programme. A non-participant observer attended 20 tutorials to observe five academics deliver four tutorials each. Academics were interviewed both individually and as a group following the completion of all tutorial observations. All observations, field notes, interviews and focus groups were coded separately and major themes identified. From this analysis two broad categories emerged: getting students involved; and engagement as a struggle. Academics used a wide variety of techniques to interest and involve students. Additionally, academics desired an equal relationship with students. They believed that both they and the students had some power to influence the dynamics of tutorials and that neither party had ultimate power. The findings of this study serve to re-emphasise past literature which suggests that to engage students, the academics must also engage.

Front page schools, back page schools : a case study of factors perceived to affect academic performance in five Papua New Guinea secondary schools

Papua New Guinea has reformed its colonial established education system and made huge investments with the help of donors to achieve equal access and quality education for all its citizens. Despite this national aspiration and these policy reforms and investments, secondary schools that enrol grade 9 students who are relatively equal in education ability show huge disparities in their grade 10 academic performances. This study examined perceptions of students, teachers and principals regarding factors affecting the disparity in academic performance in the context of a developing country. The central question for the study is: What are the perceptions of students and teachers of the factors that affect disparities in secondary schools' academic performance? This qualitative case study involved two high and three low academic performing secondary schools in Western Highlands Province of Papua New Guinea. Primary data were collected through focus groups and semi-structured interviews involving 112 participants. Students and teachers are key participants in this study, as it intends to find out the realities of schools, yet they are an under-researched group. A postcolonial and sense of community conceptual framework was developed for the analysis of the participants. perceptions. In addition, scholarship on school effectiveness and equity in education informed the interpretation of the findings. Three themes were evident in participants. views. First, participants expressed their view that differences in academic performance were related to the adequacy and equitability of resources. The inequities in resource inputs led some of them to coin the metaphor of .back page and front page. schools. Second, many expressed the view that deficiencies in implementing bilingual education, given the difficulty of catering for 800 vernacular languages, contribute to poor English proficiency and subsequent poor academic performance. Finally, participants believed that, in order to have a positive school culture, it is necessary for educators to recognise and respect contemporary students. identities, communal/tribal membership and needs. This study has implications for national education policy on resource allocation to address equality and equity, bilingual education and teacher education. Moreover, as the study found that high academic performance in this context is also influenced by intra-school social relationships, these relationships need to be nurtured. When appropriately nurtured, they become an important factor in sustaining quality education for all secondary school students. This thesis has laid the foundations for further research and invites further investigations into policy and implementation of school reforms aimed at improving academic achievement.

Preparing to teach : perceptions of graduate entry teacher education students

International reviews of teaching and teacher education have highlighted the importance of quality teachers in improving the outcomes of students. Teachers may enter the teaching profession through a variety of pathways. Currently in Australia, one pathway is through graduate entry teacher education programs in which people who already hold university degrees outside of education can undertake one-year formal teacher preparation programs. It may be argued that graduate entry teachers value add to the teaching profession as they bring with them a range of careers and wealth of experiences often beyond those of teachers who enter the profession through traditional four-year Bachelor of Education programs. This paper reports on a study that investigated the preparedness to teach of a group of graduate entry teacher education students as they prepared to exit from university and enter the teaching profession. The study concluded that this group of graduating teachers perceived that the field experience components in their formal teacher education programs contributed most to their beginning professional learning. The study revealed also that this group of graduating teachers sought further professional learning opportunities in the canonical skills of teaching. These findings may be used to inform the design of future teacher education programs.

An exploratory study of ethical dilemmas faced by academic leaders in three Australian universities

Being an academic in universities today is characterised by change and increasing complexity in response to a multitude of factors impacting on the university sector. Among the consequences of such changes are that many academics, and academic leaders in particular, are subjected to both increasing stress and scrutiny in many of the decisions they make. Some of these decisions require critical choices that involve contestation of values (including personal, professional, institutional, and community), resulting in ethical dilemmas for the decisionmakers. This article reports on an exploratory study into ethical dilemmas faced by middle-level academic leaders, drawing on the results of an on-line survey distributed to relevant academics in three universities in Australia. Here, middle-level academic leaders are defined as those holding course coordination roles, locating them between senior university staff and other academics on the one hand, and students on the other hand. As a consequence, these diverse groups of staff and students potentially have an array of conflicting interests in, and expectations on, middle-level academics’ decision-making processes. The findings of the study are clear: ethical dilemmas are evident, and commonly so, for many middle-level academic leaders. While exploratory in nature, the findings of this study suggest that much more attention to ethics and ethical dilemmas is needed in our universities.

Verifying a Student Engagement, Success and Retention Maturity Model (SESR-MM): A reality check of the model using data derived from three universities

Australian higher education institutions (HEIs) have entered a new phase of regulation and accreditation which includes performance-based funding relating to the participation and retention of students from social and cultural groups previously underrepresented in higher education. However, in addressing these priorities, it is critical that HEIs do not further disadvantage students from certain groups by identifying them for attention because of their social or cultural backgrounds, circumstances which are largely beyond the control of students. In response, many HEIs are focusing effort on university-wide approaches to enhancing the student experience because such approaches will enhance the engagement, success and retention of all students, and in doing so, particularly benefit those students who come from underrepresented groups. Measuring and benchmarking student experiences and engagement that arise from these efforts is well supported by extensive collections of student experience survey data. However no comparable instrument exists that measures the capability of institutions to influence and/or enhance student experiences where capability is an indication of how well an organisational process does what it is designed to do (Rosemann & de Bruin, 2005). We have proposed that the concept of a maturity model (Marshall, 2010; Paulk, 1999) may be useful as a way of assessing the capability of HEIs to provide and implement student engagement, success and retention activities and we are currently articulating a Student Engagement, Success and Retention Maturity Model (SESR-MM), (Clarke, Nelson & Stoodley, 2012; Nelson, Clarke & Stoodley, 2012). Our research aims to address the current gap by facilitating the development of an SESR-MM instrument that aims (i) to enable institutions to assess the capability of their current student engagement and retention programs and strategies to influence and respond to student experiences within the institution; and (ii) to provide institutions with the opportunity to understand various practices across the sector with a view to further improving programs and practices relevant to their context. Our research extends the generational approach which has been useful in considering the evolutionary nature of the first year experience (FYE) (Wilson, 2009). Three generations have been identified and explored: First generation approaches that focus on co-curricular strategies (e.g. orientation and peer programs); Second generation approaches that focus on curriculum (e.g. pedagogy, curriculum design, and learning and teaching practice); and third generation approaches—also referred to as transition pedagogy—that focus on the production of an institution-wide integrated holistic intentional blend of curricular and co-curricular activities (Kift, Nelson & Clarke, 2010). Our research also moves beyond assessments of students’ experiences to focus on assessing institutional processes and their capability to influence student engagement. In essence, we propose to develop and use the maturity model concept to produce an instrument that will indicate the capability of HEIs to manage and improve student engagement, success and retention programs and strategies. The issues explored in this workshop are (i) whether the maturity model concept can be usefully applied to provide a measure of institutional capability for SESR; (ii) whether the SESR-MM can be used to assess the maturity of a particular set of institutional practices; and (iii) whether a collective assessment of an institution’s SESR capabilities can provide an indication of the maturity of the institution’s SESR activities. The workshop will be approached in three stages. Firstly, participants will be introduced to the key characteristics of maturity models, followed by a discussion of the SESR-MM and the processes involved in its development. Secondly, participants will be provided with resources to facilitate the development of a maturity model and an assessment instrument for a range of institutional processes and related practices. In the final stage of the workshop, participants will “assess” the capability of these practices to provide a collective assessment of the maturity of these processes. References Australian Council for Educational Research. (n.d.). Australasian Survey of Student Engagement. Retrieved from http://www.acer.edu.au/research/ausse/background Clarke, J., Nelson, K., & Stoodley, I. (2012, July). The Maturity Model concept as framework for assessing the capability of higher education institutions to address student engagement, success and retention: New horizon or false dawn? A Nuts & Bolts presentation at the 15th International Conference on the First Year in Higher Education, “New Horizons,” Brisbane, Australia. Department of Education, Employment and Workplace Relations. (n.d.). The University Experience Survey. Advancing quality in higher education information sheet. Retrieved from http://www.deewr.gov.au/HigherEducation/Policy/Documents/University_Experience_Survey.pdf Kift, S., Nelson, K., & Clarke, J. (2010) Transition pedagogy - a third generation approach to FYE: A case study of policy and practice for the higher education sector. The International Journal of the First Year in Higher Education, 1(1), pp. 1-20. Marshall, S. (2010). A quality framework for continuous improvement of e-Learning: The e-Learning Maturity Model. Journal of Distance Education, 24(1), 143-166. Nelson, K., Clarke, J., & Stoodley, I. (2012). An exploration of the Maturity Model concept as a vehicle for higher education institutions to assess their capability to address student engagement. A work in progress. Submitted for publication. Paulk, M. (1999). Using the Software CMM with good judgment, ASQ Software Quality Professional, 1(3), 19-29. Wilson, K. (2009, June–July). The impact of institutional, programmatic and personal interventions on an effective and sustainable first-year student experience. Keynote address presented at the 12th Pacific Rim First Year in Higher Education Conference, “Preparing for Tomorrow Today: The First Year as Foundation,” Townsville, Australia. Retrieved from http://www.fyhe.com.au/past_papers/papers09/ppts/Keithia_Wilson_paper.pdf

Power of engineering : changing the perceptions of year 9 and 10 female school students towards an engineering career

BACKGROUND The engineering profession in Australia has failed to attract young women for the last decade or so despite all the effort that have gone into promoting engineering as a preferred career choice for girls. It is a missed opportunity for the profession to flourish as a heterogeneous team. Many traditional initiatives and programs have failed to make much impact or at best incremental improvement into attracting and retaining more women in the profession. The reasons why girls and young women in most parts of the world show little interest in engineering haven't changed, despite all the efforts to address them, the issue proposed here in this paper is with the perceptions of engineering in the community and the confidence to pursue it. This gender imbalance is detrimental for the engineering profession, and hence an action-based intervention strategy was devised by the Women in Engineering Qld Chapter of Engineers Australia in 2012 to change the perceptions of school girls by redesigning the engagement strategy and key messages. As a result, the “Power of Engineering Inc” (PoE) was established as a not-for-profit organisation, and is a collaborative effort between government, schools, universities, and industry. This paper examines a case study in changing the perceptions of year 9 and 10 school girls towards an engineering career. PURPOSE To evaluate and determine the effectiveness of an intervention in changing the perceptions of year 9 and 10 school girls about engineering career options, but specifically, “What were their perceptions of engineering before today and have those perceptions changed?” DESIGN/METHOD The inaugural Power of Engineering (PoE) event was held on International Women’s Day, Thursday 8 March 2012 and was attended by 131 high school female students (year 9 and 10) and their teachers. The key message of the day was “engineering gives you the power to change the world”. A questionnaire was conducted with the participating high school female students, collecting both quantitative and qualitative data. The survey instrument has not been validated. RESULTS The key to the success of the event was as a result of collaboration between all participants involved and the connection created between government, schools, universities and industry. Of the returned surveys (109 of 131), 91% of girls would now consider a career in engineering and 57% who had not considered engineering before the day would now consider a career in engineering. Data collected found significant numbers of negative and varying perceptions about engineering careers prior to the intervention. CONCLUSIONS The evidence in this research suggests that the intervention assisted in changing the perceptions of year 9 and 10 female school students towards engineering as a career option. Whether this intervention translates into actual career selection and study enrolment is to be determined. In saying this, the evidence suggests that there is a critical and urgent need for earlier interventions prior to students selecting their subjects for year 11 and 12. This intervention could also play its part in increasing the overall pool of students engaged in STEM education.

Curriculum design and higher order skills : challenging assumptions

This paper is based on an Australian Learning & Teaching Council (ALTC) funded evaluation in 13 universities across Australia and New Zealand of the use of Engineers Without Borders (EWB) projects in first-year engineering courses. All of the partner institutions have implemented this innovation differently and comparison of these implementations affords us the opportunity to assemble "a body of carefully gathered data that provides evidence of which approaches work for which students in which learning environments". This study used a mixed-methods data collection approach and a realist analysis. Data was collected by program logic analysis with course co-ordinators, observation of classes, focus groups with students, exit survey of students and interviews with staff as well as scrutiny of relevant course and curriculum documents. Course designers and co-ordinators gave us a range of reasons for using the projects, most of which alluded to their presumed capacity to deliver experience in and learning of higher order thinking skills in areas such as sustainability, ethics, teamwork and communication. For some students, however, the nature of the projects decreased their interest in issues such as ethical development, sustainability and how to work in teams. We also found that the projects provoked different responses from students depending on the nature of the courses in which they were embedded (general introduction, design, communication, or problem-solving courses) and their mode of delivery (lecture, workshop or online).

A known-groups evaluation of the Response Bias Scale in a neuropsychological setting

We evaluated the Minnesota Multiphasic Personality Inventory-Second Edition (MMPI-2) Response Bias Scale (RBS). Archival data from 83 individuals who were referred for neuropsychological assessment with no formal diagnosis (n = 10), following a known or suspected traumatic brain injury (n = 36), with a psychiatric diagnosis (n = 20), or with a history of both trauma and a psychiatric condition (n = 17) were retrieved. The criteria for malingered neurocognitive dysfunction (MNCD) were applied, and two groups of participants were formed: poor effort (n = 15) and genuine responders (n = 68). Consistent with previous studies, the difference in scores between groups was greatest for the RBS (d = 2.44), followed by two established MMPI-2 validity scales, F (d = 0.25) and K (d = 0.23), and strong significant correlations were found between RBS and F (rs = .48) and RBS and K (r = −.41). When MNCD group membership was predicted using logistic regression, the RBS failed to add incrementally to F. In a separate regression to predict group membership, K added significantly to the RBS. Receiver-operating curve analysis revealed a nonsignificant area under the curve statistic, and at the ideal cutoff in this sample of >12, specificity was moderate (.79), sensitivity was low (.47), and positive and negative predictive power values at a 13% base rate were .25 and .91, respectively. Although the results of this study require replication because of a number of limitations, this study has made an important first attempt to report RBS classification accuracy statistics for predicting poor effort at a range of base rates.

Indian students at QUT : expectations and experiences

India currently ranks among the top source countries for the Australian education industry and therefore, a better understanding of the concerns and challenges confronted by Indian students is essential. This study was undertaken to assess the needs and expectations of Indian students enrolled at Queensland University of Technology (QUT) that would inform the formulation of strategies to provide superior service to the current and future cohorts of students coming from India. Data collection was undertaken through surveys and focus group meetings. The findings reveal the acute need for more effective dissemination of information prior to the students commencing their programs on both academic and non-academic aspects of university life as well as the resources and support available at QUT. Usage of English in an academic setting, career related services, accommodation, and networking opportunities were identified as some of the key areas of concern by the participants.