Student responses to questions about assessment practices across three different countries

This dataset relates to the assessment practices used in the RMIT School of Accounting and Law in programs taught in Melbourne, Singapore and Hong Kong between 2005 and 2006. These assessment parctices were examined to determine, first, how they measured students’ attainment of the profession’s generic skills, and second, whether different approaches to assessment were taken across the three locations. The students enrolled in these programs were investigated - their cultural backgrounds, their prior learning experiences, their assessment practices and their performance in assessment. At the same time, consultations were held with teaching staff and with employers across the three locations to determine their views about assessment and student and graduate quality. Finally, as a result of the feedback from the previous stages, a number of different approaches to assessment were trialled and evaluated.

A comparative study of effectiveness of peer assessment of individuals’ contributions to group projects in undergraduate construction management core units

In recent years, various forms of group work have been introduced in university courses across various subject domains, including construction management courses. Although the use of group work in higher education has sound pedagogical reasons and advantages, group work has its own drawbacks. Therefore, the acceptance by students and the success of group work critically depend on a fair and credible assessment of the group process. In this paper, the implementation of different approaches to peer assessment (PA) of individuals’ contributions to group projects in two core units in an undergraduate construction management course in an Australian university is reported. The effectiveness of the adopted PA approaches have been evaluated and validated by students. It has been found that contrary to doubts of the sufficiency of a simplistic approach to PAs, the fairness of a PA approach does not necessarily depend on its complexity. Besides, voluntary group discussions, learning and collaboration are found to aid in improving each of the group’s camaraderie. Hence, it is recommended that academics should develop both a structured methodology to progressively encourage group members to work cohesively in teams and effective PA approaches that measure individual member’s contribution.

Motivation, self-assessment and tacit knowledge in e-learning context selection

Formal consideration of the links between students' Motivation, Self-Assessment abilities and Tacit Knowledge is shown in this paper to provide a useful model (MSATK) for planning postgraduate, Web-based education. The design of effective e-Learning courses requires a Learning Framework that emphasizes contextanalysis within knowledge-mediated processes. Contextual analysis ensures that self-assessment will be effective in complex domains that rely on Web sources of experiential knowledge, usually accessible as Professional practice models that employ diagnostic tools for scenario simulation processes. Demographic trends now facing Japan and Western countries, and the knowledge management support requirements of global e-Learning initiatives are challenging the value of current selfassessment processes. Building a Culture of Critique is highly desirable, but the lack of an Learning Framework that reflects student ownership of their learning process has obscured the need for tools to correctly interpret domain contexts, or for student freedom to drive the need for modified scenarios. The value of a Learning Framework that links motivation, tacit knowledge, selfassessment practice and contextual analysis is examined in this paper with consequential implications for Web support.

A contribution to the history of assessment: how a conversation simulator redeems Socratic method

Assessment in education is a recent phenomenon. Although there were counterparts in former epochs, the term assessment only began to be spoken about in education after the Second World War; and, since that time, views, strategies and concerns over assessment have proliferated according to an uncomfortable dynamic. We fear that, increasingly, education is assessment-led rather than learning-led and ‘counter to what is desired’ in an ugly judgemental spirit whose moral underpinnings deserve scrutiny. In this article, we seek to historicise assessment and the anxieties of credentialising students. Through this longer history, we present a philosophy of assessment which underlies the development of a new method in assessment-as-learning. We hope that our development of a conversation simulator helps restore the innocence of education as learning-led, while still delivering on the incumbencies of assessment.

Transitioning to routine breast cancer risk assessment and management in primary care: what can we learn from cardiovascular disease?

To capitalise on advances in breast cancer prevention, all women would need to have their breast cancer risk formally assessed. With ~85% of Australians attending primary care clinics at least once a year, primary care is an opportune location for formal breast cancer risk assessment and management. This study assessed the current practice and needs of primary care clinicians regarding assessment and management of breast cancer risk. Two facilitated focus group discussions were held with 17 primary care clinicians (12 GPs and 5 practice nurses (PNs)) as part of a larger needs assessment. Primary care clinicians viewed assessment and management of cardiovascular risk as an intrinsic, expected part of their role, often triggered by practice software prompts and facilitated by use of an online tool. Conversely, assessment of breast cancer risk was not routine and was generally patient- (not clinician-) initiated, and risk management (apart from routine screening) was considered outside the primary care domain. Clinicians suggested that routine assessment and management of breast cancer risk might be achieved if it were widely endorsed as within the remit of primary care and supported by an online risk-assessment and decision aid tool that was integrated into primary care software. This study identified several key issues that would need to be addressed to facilitate the transition to routine assessment and management of breast cancer risk in primary care, based largely on the model used for cardiovascular disease.

Life cycle assessment in construction field: A life cycle cost analysis of reinforcement concrete bridge

The present work is included in the context of the assessment of sustainability in the construction field and is aimed at estimating and analyzing life cycle cost of the existing reinforced concrete bridge “Viadotto delle Capre” during its entire life. This was accomplished by a comprehensive data collection and results evaluation. In detail, the economic analysis of the project is performed. The work has investigated possible design alternatives for maintenance/rehabilitation and end-of-life operations, when structural, functional, economic and also environmental requirements have to be fulfilled. In detail, the economic impact of different design options for the given reinforced concrete bridge have been assessed, whereupon the most economically, structurally and environmentally efficient scenario was chosen. The Integrated Life-Cycle Analysis procedure and Environmental Impact Assessment were also discussed in this work. The scope of this thesis is to illustrate that Life Cycle Cost analysis as part of Life Cycle Assessment approach could be effectively used to drive the design and management strategy of new and existing structures. The final objective of this contribution is to show how an economic analysis can influence decision-making in the definition of the most sustainable design alternatives. The designers can monitor the economic impact of different design strategies in order to identify the most appropriate option.

An approach to automatic learning assessment based on the computational theory of perceptions

E-learning systems output a huge quantity of data on a learning process. However, it takes a lot of specialist human resources to manually process these data and generate an assessment report. Additionally, for formative assessment, the report should state the attainment level of the learning goals defined by the instructor. This paper describes the use of the granular linguistic model of a phenomenon (GLMP) to model the assessment of the learning process and implement the automated generation of an assessment report. GLMP is based on fuzzy logic and the computational theory of perceptions. This technique is useful for implementing complex assessment criteria using inference systems based on linguistic rules. Apart from the grade, the model also generates a detailed natural language progress report on the achieved proficiency level, based exclusively on the objective data gathered from correct and incorrect responses. This is illustrated by applying the model to the assessment of Dijkstra’s algorithm learning using a visual simulation-based graph algorithm learning environment, called GRAPHs

Counting Highly Cited Papers for University Research Assessment: Conceptual and Technical Issues

A Kuhnian approach to research assessment requires us to consider that the important scientific breakthroughs that drive scientific progress are infrequent and that the progress of science does not depend on normal research. Consequently, indicators of research performance based on the total number of papers do not accurately measure scientific progress. Similarly, those universities with the best reputations in terms of scientific progress differ widely from other universities in terms of the scale of investments made in research and in the higher concentrations of outstanding scientists present, but less so in terms of the total number of papers or citations. This study argues that indicators for the 1% high-citation tail of the citation distribution reveal the contribution of universities to the progress of science and provide quantifiable justification for the large investments in research made by elite research universities. In this tail, which follows a power low, the number of the less frequent and highly cited important breakthroughs can be predicted from the frequencies of papers in the upper part of the tail. This study quantifies the false impression of excellence produced by multinational papers, and by other types of papers that do not contribute to the progress of science. Many of these papers are concentrated in and dominate lists of highly cited papers, especially in lower-ranked universities. The h-index obscures the differences between higher- and lower-ranked universities because the proportion of h-core papers in the 1% high-citation tail is not proportional to the value of the h-index.

Adherence to antiepileptic medicines in children:a multiple-methods assessment involving dried blood spot sampling

Purpose - To evaluate adherence to prescribed antiepileptic drugs (AEDs) in children with epilepsy using a combination of adherence-assessment methods. Methods - A total of 100 children with epilepsy (≤17 years old) were recruited. Medication adherence was determined via parental and child self-reporting (≥9 years old), medication refill data from general practitioner (GP) prescribing records, and via AED concentrations in dried blood spot (DBS) samples obtained from children at the clinic and via self- or parental-led sampling in children's own homes. The latter were assessed using population pharmacokinetic modeling. Patients were deemed nonadherent if any of these measures were indicative of nonadherence with the prescribed treatment. In addition, beliefs about medicines, parental confidence in seizure management, and the presence of depressed mood in parents were evaluated to examine their association with nonadherence in the participating children. Key Findings - The overall rate of nonadherence in children with epilepsy was 33%. Logistic regression analysis indicated that children with generalized epilepsy (vs. focal epilepsy) were more likely (odds ratio [OR] 4.7, 95% confidence interval [CI] 1.37–15.81) to be classified as nonadherent as were children whose parents have depressed mood (OR 3.6, 95% CI 1.16–11.41). Significance - This is the first study to apply the novel methodology of determining adherence via AED concentrations in clinic and home DBS samples. The present findings show that the latter, with further development, could be a useful approach to adherence assessment when combined with other measures including parent and child self-reporting. Seizure type and parental depressed mood were strongly predictive of nonadherence.

A literature review to Examine the Validity and Reliability of group poster presentations as an assessment method of a module in an undergraduate nursing degree programme

The introduction of a poster presentation as a formative assessment method over a multiple choice examination after the first phase of a three phase “health and well-being” module in an undergraduate nursing degree programme was greeted with a storm of criticism from fellow lecturers stating that poster presentations are not valid or reliable and totally irrelevant to the assessment of learning in the module. This paper seeks to investigate these criticisms by investigating the literature regarding producing nurses fit for practice, nurse curriculum development and wider nurse education, the purpose of assessment, validity and reliability to critically evaluate the poster presentation as a legitimate assessment method for these aims.

How is men's conformity to masculine norms related to their body image? Masculinity and muscularity across western countries

Previous research has suggested that men's conformity to masculine norms (CMN) is an important correlate of men's drive for muscularity. The present study aimed to further delineate the relationship between masculinity and men's body image by examining various dimensions of CMN in relation to various dimensions of men's body image (muscularity, leanness, and fitness) in a cross-national sample. Participants comprised young men from the United States (n = 192), the United Kingdom (n = 141), Australia (n = 160), and Sweden (n = 142). Multigroup path analyses showed that CMN was related to drive for muscularity, leanness, and fitness in all 4 countries, but there were differences across countries in which dimensions of CMN predicted men's body image. Whereas conformity to the masculine norm of winning was a salient predictor across the 4 countries, conformity to the norm of risk-taking was linked to Australian men's body image, and conformity to the norm of violence to British men's body image. The findings support previous research suggesting that men's endorsement of the male gender role plays a significant role in their desire for an ideal body, but the results uniquely document that this relationship may differ across countries.

Developing a participatory impact assessment approach and action research culture within a communication for social change organisation in Nepal

Developing an effective impact evaluation framework, managing and conducting rigorous impact evaluations, and developing a strong research and evaluation culture within development communication organisations presents many challenges. This is especially so when both the community and organisational context is continually changing and the outcomes of programs are complex and difficult to clearly identify.----- This paper presents a case study from a research project being conducted from 2007-2010 that aims to address these challenges and issues, entitled Assessing Communication for Social Change: A New Agenda in Impact Assessment. Building on previous development communication projects which used ethnographic action research, this project is developing, trailing and rigorously evaluating a participatory impact assessment methodology for assessing the social change impacts of community radio programs in Nepal. This project is a collaboration between Equal Access – Nepal (EAN), Equal Access – International, local stakeholders and listeners, a network of trained community researchers, and a research team from two Australian universities. A key element of the project is the establishment of an organisational culture within EAN that values and supports the impact assessment process being developed, which is based on continuous action learning and improvement. The paper describes the situation related to monitoring and evaluation (M&E) and impact assessment before the project began, in which EAN was often reliant on time-bound studies and ‘success stories’ derived from listener letters and feedback. We then outline the various strategies used in an effort to develop stronger and more effective impact assessment and M&E systems, and the gradual changes that have occurred to date. These changes include a greater understanding of the value of adopting a participatory, holistic, evidence-based approach to impact assessment. We also critically review the many challenges experienced in this process, including:----- • Tension between the pressure from donors to ‘prove’ impacts and the adoption of a bottom-up, participatory approach based on ‘improving’ programs in ways that meet community needs and aspirations.----- • Resistance from the content teams to changing their existing M&E practices and to the perceived complexity of the approach.----- • Lack of meaningful connection between the M&E and content teams.----- • Human resource problems and lack of capacity in analysing qualitative data and reporting results.----- • The contextual challenges, including extreme poverty, wide cultural and linguistic diversity, poor transport and communications infrastructure, and political instability.----- • A general lack of acceptance of the importance of evaluation within Nepal due to accepting everything as fate or ‘natural’ rather than requiring investigation into a problem.

Factors associated with the wish to hasten death : a study of patients with terminal illness

Background. There is considerable debate regarding the clinical issues surrounding the wish to hasten death (WTHD) in the terminally ill. The clinical factors contributing to the WTHD need further investigation among the terminally ill in order to enhance understanding of the clinical assessment and treatment needs that underlie this problem. A more detailed understanding may assist with the development of appropriate therapeutic interventions. Method. A sample of terminally ill cancer patients (N=256) recruited from an in-patient hospice unit, home palliative care service and a general hospital palliative care consulting service from Brisbane Australia between 1998–2001 completed a questionnaire assessing psychological (depression and anxiety), social (family relationship, social support, level of burden on others) and the impact of physical symptoms. The association between these factors and the WTHD was investigated. Results. A high WTHD was reported by 14% of patients. A discriminant function analysis revealed that the following variables were associated with a high WTHD (P<0·001): higher levels of depressive symptoms, being admitted to an in-patient hospice setting, a greater perception of being a burden on others, lower family cohesion, lower levels of social support, higher levels of anxiety and greater impact of physical symptoms. Conclusions. Psychological and social factors are related to a WTHD among terminally ill cancer patients. Greater attention needs to be paid to the assessment of psychological and social issues in order to provide appropriate therapeutic interventions for terminally ill patients.

Integrating eco-efficiency assessment of commercial buildings into the design process : LCADesign

The ability to assess a commercial building for its impact on the environment at the earliest stage of design is a goal which is achievable by integrating several approaches into a single procedure directly from the 3D CAD representation. Such an approach enables building design professionals to make informed decisions on the environmental impact of building and its alternatives during the design development stage instead of at the post-design stage where options become limited. The indicators of interest are those which relate to consumption of resources and energy, contributions to pollution of air, water and soil, and impacts on the health and wellbeing of people in the built environment as a result of constructing and operating buildings. 3D object-oriented CAD files contain a wealth of building information which can be interrogated for details required for analysis of the performance of a design. The quantities of all components in the building can be automatically obtained from the 3D CAD objects and their constituent materials identified to calculate a complete list of the amounts of all building products such as concrete, steel, timber, plastic etc. When this information is combined with a life cycle inventory database, key internationally recognised environmental indicators can be estimated. Such a fully integrated tool known as LCADesign has been created for automated ecoefficiency assessment of commercial buildings direct from 3D CAD. This paper outlines the key features of LCADesign and its application to environmental assessment of commercial buildings.

Assessment by interview and portfolio in a Graduate School Program

Assessment plays an integral role in teaching and learning in Higher Education and teachers have a strong interest in debates and commentaries on assessment as and for learning. In a one-year graduate entry teacher preparation program, the temptation is to emphasize assessment in an attempt to ensure students “cover” everything as part of a robust preparation for the profession. The risk is that, for students, assessment drives curriculum, and time spent in the completion of assignments is no guarantee of either effective learning or authentic preparation for teaching. Interviews as assessment provide an opportunity for a learning experience as well as an authentic task, since students will shortly be interviewing for employment in a “real world” situation. This paper reports on a project experimenting with interview panels as authentic assessment with pre-service early childhood teachers. At the end of their first semester of study, students enrolled in the Graduate Diploma of Education program at the Queensland University of Technology in Australia were required to participate in a panel interview where they were graded by a panel made up of three faculty staff and one undergraduate student enrolled in the four-year Bachelor of Education program. Students and panel members completed a questionnaire on their experience after the interview. Results indicated that both students and staff valued the experience and felt it was authentic. Results are discussed in terms of how the assessment interview and portfolio presentation supports graduating students in their preparation for employment interviews, and how this authentic assessment task has benefits for both students and teaching staff.