Respecting local, cultural contexts for assessment practice in an era of globalization

Dissatisfaction, internationally, with existing educational practices and outcomes since the early 1990s has led to increased educational reform. At the same time, there has also been a worldwide shift in control of education away from teachers toward the state for the purposes of restructuring economies. More bureaucratic forms of curriculum and assessment have resulted, with a return to the use of more techno-rational discourse in assessment and evaluation for purposes of efficiency, accountability, impact, and performance management. There has also been an increase in the use of economic and productivity models to study educational outcomes. These models fail to account for the range of outcomes achieved and fail to identify the factors responsible for such diversity in performance.

Australian Indigenous students: addressing equity issues in assessment

This article provides the background and context to the important issue of assessment and equity in relation to Indigenous students in Australia. Questions about the validity and fairness of assessment are raised and ways forward are suggested by attending to assessment questions in relation to equity and culture-fair assessment. Patterns of under-achievement by Indigenous students are reflected in national benchmark data and international testing programmes like the Trends in International Mathematics and Science Sstudy and the Program for International Student Assessment. The argument developed views equity, in relation to assessment, as more of a sociocultural issue than a technical matter. It highlights how teachers need to distinguish the "funds of knowledge" that Indigenous students draw on and how teachers need to adopt culturally responsive pedagogy to open up the curriculum and assessment practice to allow for different ways of knowing and being.

Orals ain't orals : how instruction and assessment practices affect delivery choices with prepared student oral presentations.

Despite an ostensibly technology-driven society, the ability to communicate orally is still seen as an essential ability for students at school and university, as it is for graduates in the workplace. The need to develop effective oral communication skills is often tied to future work-related tasks. One tangible way that educators have assessed proficiency in this area is through prepared oral presentations. While some use the terms oral communication and oral presentation interchangeably, other writers question the role more formal presentations play in the overall development of oral communication skills. Adding to the discussion, this paper is part of a larger study examining the knowledge and skills students bring into the academy from previous educational experiences. The study examines some of the teaching and assessment methods used in secondary schools to develop oral communication skills through the use of formal oral presentations. Specifically, it will look at assessment models and how these are used as a form of instruction as well as how they contribute to an accurate evaluation of student abilities. The purpose of this paper is to explore key terms and identify tensions between expectations and practice. Placing the emphasis on the ‘oral’ aspect of this form of communication this paper will particularly look at the ‘delivery’ element of the process.

Application of the analytic hierarchy process (AHP) in multi-criteria analysis of the selection of intelligent building systems

The availability of innumerable intelligent building (IB) products, and the current dearth of inclusive building component selection methods suggest that decision makers might be confronted with the quandary of forming a particular combination of components to suit the needs of a specific IB project. Despite this problem, few empirical studies have so far been undertaken to analyse the selection of the IB systems, and to identify key selection criteria for major IB systems. This study is designed to fill these research gaps. Two surveys: a general survey and the analytic hierarchy process (AHP) survey are proposed to achieve these objectives. The first general survey aims to collect general views from IB experts and practitioners to identify the perceived critical selection criteria, while the AHP survey was conducted to prioritize and assign the important weightings for the perceived criteria in the general survey. Results generally suggest that each IB system was determined by a disparate set of selection criteria with different weightings. ‘Work efficiency’ is perceived to be most important core selection criterion for various IB systems, while ‘user comfort’, ‘safety’ and ‘cost effectiveness’ are also considered to be significant. Two sub-criteria, ‘reliability’ and ‘operating and maintenance costs’, are regarded as prime factors to be considered in selecting IB systems. The current study contributes to the industry and IB research in at least two aspects. First, it widens the understanding of the selection criteria, as well as their degree of importance, of the IB systems. It also adopts a multi-criteria AHP approach which is a new method to analyse and select the building systems in IB. Further research would investigate the inter-relationship amongst the selection criteria.

Review of vibration-based damage detection and condition assessment of bridge structures using structural health monitoring

As a part of vital infrastructure and transportation networks, bridge structures must function safely at all times. However, due to heavier and faster moving vehicular loads and function adjustment, such as Busway accommodation, many bridges are now operating at an overload beyond their design capacity. Additionally, the huge renovation and replacement costs always make the infrastructure owners difficult to undertake. Structural health monitoring (SHM) is set to assess condition and foresee probable failures of designated bridge(s), so as to monitor the structural health of the bridges. The SHM systems proposed recently are incorporated with Vibration-Based Damage Detection (VBDD) techniques, Statistical Methods and Signal processing techniques and have been regarded as efficient and economical ways to solve the problem. The recent development in damage detection and condition assessment techniques based on VBDD and statistical methods are reviewed. The VBDD methods based on changes in natural frequencies, curvature/strain modes, modal strain energy (MSE) dynamic flexibility, artificial neural networks (ANN) before and after damage and other signal processing methods like Wavelet techniques and empirical mode decomposition (EMD) / Hilbert spectrum methods are discussed here.

Nurse-determined assessment of cardiac output. Comparing a non-invasive cardiac output device and pulmonary artery catheter: a prospective observational study.

Background The accurate measurement of Cardiac output (CO) is vital in guiding the treatment of critically ill patients. Invasive or minimally invasive measurement of CO is not without inherent risks to the patient. Skilled Intensive Care Unit (ICU) nursing staff are in an ideal position to assess changes in CO following therapeutic measures. The USCOM (Ultrasonic Cardiac Output Monitor) device is a non-invasive CO monitor whose clinical utility and ease of use requires testing. Objectives To compare cardiac output measurement using a non-invasive ultrasonic device (USCOM) operated by a non-echocardiograhically trained ICU Registered Nurse (RN), with the conventional pulmonary artery catheter (PAC) using both thermodilution and Fick methods. Design Prospective observational study. Setting and participants Between April 2006 and March 2007, we evaluated 30 spontaneously breathing patients requiring PAC for assessment of heart failure and/or pulmonary hypertension at a tertiary level cardiothoracic hospital. Methods SCOM CO was compared with thermodilution measurements via PAC and CO estimated using a modified Fick equation. This catheter was inserted by a medical officer, and all USCOM measurements by a senior ICU nurse. Mean values, bias and precision, and mean percentage difference between measures were determined to compare methods. The Intra-Class Correlation statistic was also used to assess agreement. The USCOM time to measure was recorded to assess the learning curve for USCOM use performed by an ICU RN and a line of best fit demonstrated to describe the operator learning curve. Results In 24 of 30 (80%) patients studied, CO measures were obtained. In 6 of 30 (20%) patients, an adequate USCOM signal was not achieved. The mean difference (±standard deviation) between USCOM and PAC, USCOM and Fick, and Fick and PAC CO were small, −0.34 ± 0.52 L/min, −0.33 ± 0.90 L/min and −0.25 ± 0.63 L/min respectively across a range of outputs from 2.6 L/min to 7.2 L/min. The percent limits of agreement (LOA) for all measures were −34.6% to 17.8% for USCOM and PAC, −49.8% to 34.1% for USCOM and Fick and −36.4% to 23.7% for PAC and Fick. Signal acquisition time reduced on average by 0.6 min per measure to less than 10 min at the end of the study. Conclusions In 80% of our cohort, USCOM, PAC and Fick measures of CO all showed clinically acceptable agreement and the learning curve for operation of the non-invasive USCOM device by an ICU RN was found to be satisfactorily short. Further work is required in patients receiving positive pressure ventilation.

Formative and summative assessment and the notion of constructive alignment

This paper discusses the different perceptions of first year accounting students about their tutorial activities and their engagements in assessment. As the literature suggests, unless participation in learning activities forms part of graded assessment, it is often difficult to engage students in these activities. Using an action research model, this paper reports the study of first year accounting students' responses to action-oriented learning tasks in tutorials. The paper focuses on the importance of aligning curriculum objectives, learning and teaching activities and assessment, i.e. the notion of constructive alignment. However, as the research findings indicate, without support at institutional level, applying constructive alignment to facilitate quality student learning outcomes is a difficult task. Thus, the impacts of policy constraints on curriculum issues are also discussed, focusing on the limitations faced by tutors and their lack of involvement in curriculum development.

Procurement Case Study and Decision-making Strategies

Objectives The procurement research of Sydney Opera House FM Exemplar Project aims to develop innovative methods and guidelines for the procurement of FM services, applicable to iconic and / or performing arts centre facilities, or facilities with similar FM functions. The initial procurement report in June 2005 analysed the strategic objectives and operational requirements that provide ‘demand statements’ as evaluation criteria in the service procurement process. The subsequent interim procurement report in September 2005 discussed the elements contributing to the criteria for decision-making in the service procurement process. This procurement report concentrates on the research on procurement strategies and innovative methods using a case study approach. The objectives of this report are: • to investigate service procurement methods and process in iconic and/or performing arts centre facilities; • to showcase FM innovation in Sydney Opera House through a case study; • to establish a preliminary decision-making framework and guidelines for selection of appropriate FM procurement routes to provide a useful model for FM community. Findings Findings from this procurement research are presented as follows. • FM innovation and experience of Sydney Opera House • Innovative procurement methods and processes, drawn from a case study of Sydney Opera House as exemplar • An integrated performance framework to link maintenance service functions to high level organisational objective and strategies • Procurement methods and contract outcomes, focusing on building maintenance and cleaning services of Sydney Opera House • Multi-dimensional assessment of Service Providers • General decision-making strategies and guidelines for selection of appropriate FM procurement routes Further Research Whilst the Sydney Opera House case study emphasises the experience of Sydney Opera House, a study of procurement strategies and methods from published research and FM good practice will supply facilities managers with alternative procurement routes. Further research on the procurement theme will develop a final decision-making model for the procurement of FM services, drawn from the evaluation of the case study outcomes, as well as FM good practice and findings from current published research.

Capital Works Procurement: The Selection of a Building Procurement Method

The determination of the most appropriate procurement method for capital works projects is a challenging task for the Department of Housing and Works (DHW) and other Western Australian State Government Agencies because of the array of assessment criteria that are considered and the procurement methods that are available. A number of different procurement systems can be used to deliver capital works projects such a traditional, design and construct and management. Sub-classifications of these systems have proliferated and continue to emerge in response to market demands. The selection of an inappropriate procurement method may lead to undesirable project outcomes. To facilitate DHW in selecting an appropriate procurement method for its capital works projects, a six step procurement method selection process is presented. The characteristics of the most common forms of procurement method used in Australia are presented. Case studies where procurement methods have been used for specific types of capital works in Western Australia are offered to provide a reference point and learning opportunity for procurement method selection.

Environmental assessment for commercial buildings: Stakeholder requirements and tool characteristics

The Cooperative Research Centre for Construction Innovation (CRC CI) is a national research, development and implementation centre focused on the needs of the property, design, construction and facility management sectors. Established in 2001 and headquartered at Queensland University of Technology as an unincorporated joint venture under the Australian Government's Cooperative Research Program, the CRC CI is developing key technologies, tools and management systems to improve the effectiveness of the construction industry. The CRC CI is a seven year project funded by a Commonwealth grant and industry, research and other government support. More than 150 researchers and an alliance of 19 leading partner organisations are involved in and support the activities of the CRC CI

Evaluation of functional performance in commercial buildings

This report fully summarises a project designed to enhance commercial real estate performance within both operational and investment contexts through the development of a model aimed at supporting improved decision-making. The model is based on a risk adjusted discounted cash flow, providing a valuable toolkit for building managers, owners, and potential investors for evaluating individual building performance in terms of financial, social and environmental criteria over the complete life-cycle of the asset. The ‘triple bottom line’ approach to the evaluation of commercial property has much significance for the administrators of public property portfolios in particular. It also has applications more generally for the wider real estate industry given that the advent of ‘green’ construction requires new methods for evaluating both new and existing building stocks. The research is unique in that it focuses on the accuracy of the input variables required for the model. These key variables were largely determined by market-based research and an extensive literature review, and have been fine-tuned with extensive testing. In essence, the project has considered probability-based risk analysis techniques that required market-based assessment. The projections listed in the partner engineers’ building audit reports of the four case study buildings were fed into the property evaluation model developed by the research team. The results are strongly consistent with previously existing, less robust evaluation techniques. And importantly, this model pioneers an approach for taking full account of the triple bottom line, establishing a benchmark for related research to follow. The project’s industry partners expressed a high degree of satisfaction with the project outcomes at a recent demonstration seminar. The project in its existing form has not been geared towards commercial applications but it is anticipated that QDPW and other industry partners will benefit greatly by using this tool for the performance evaluation of property assets. The project met the objectives of the original proposal as well as all the specified milestones. The project has been completed within budget and on time. This research project has achieved the objective by establishing research foci on the model structure, the key input variable identification, the drivers of the relevant property markets, the determinants of the key variables (Research Engine no.1), the examination of risk measurement, the incorporation of risk simulation exercises (Research Engine no.2), the importance of both environmental and social factors and, finally the impact of the triple bottom line measures on the asset (Research Engine no. 3).

The comprehensive Australian Study of entrepreneurial emergence (CAUSEE) high potential nascent entrepreneurs : some preliminary findings

Principal Topic The Comprehensive Australian Study of Entrepreneurial Emergence (CAUSEE) represents the first Australian study to employ and extend the longitudinal and large scale systematic research developed for the Panel Study of Entrepreneurial Dynamics (PSED) in the US (Gartner, Shaver, Carter and Reynolds, 2004; Reynolds, 2007). This research approach addresses several shortcomings of other data sets including under coverage; selection bias; memory decay and hindsight bias, and lack of time separation between the assessment of causes and their assumed effects (Johnson et al 2006; Davidsson 2006). However, a remaining problem is that any a random sample of start-ups will be dominated by low potential, imitative ventures. In recognition of this issue CAUSEE supplemented PSED-type random samples with theoretically representative samples of the 'high potential' emerging ventures employing a unique methodology using novel multiple screening criteria. We define new ''high-potential'' ventures as new entrepreneurial innovative ventures with high aspirations and potential for growth. This distinguishes them from those ''lifestyle'' imitative businesses that start small and remain intentionally small (Timmons, 1986). CAUSEE is providing the opportunity to explore, for the first time, if process and outcomes of high potentials differ from those of traditional lifestyle firms. This will allows us to compare process and outcome attributes of the random sample with the high potential over sample of new firms and young firms. The attributes in which we will examine potential differences will include source of funding, and internationalisation. This is interesting both in terms of helping to explain why different outcomes occur but also in terms of assistance to future policymaking, given that high growth potential firms are increasingly becoming the focus of government intervention in economic development policies around the world. The first wave of data of a four year longitudinal study has been collected using these samples, allowing us to also provide some initial analysis on which to continue further research. The aim of this paper therefore is to present some selected preliminary results from the first wave of the data collection, with comparisons of high potential with lifestyle firms. We expect to see owing to greater resource requirements and higher risk profiles, more use of venture capital and angel investment, and more internationalisation activity to assist in recouping investment and to overcome Australia's smaller economic markets Methodology/Key Propositions In order to develop the samples of 'high potential' in the NF and YF categories a set of qualification criteria were developed. Specifically, to qualify, firms as nascent or young high potentials, we used multiple, partly compensating screening criteria related to the human capital and aspirations of the founders as well as the novelty of the venture idea, and venture high technology. A variety of techniques were also employed to develop a multi level dataset of sources to develop leads and firm details. A dataset was generated from a variety of websites including major stakeholders including the Federal and State Governments, Australian Chamber of Commerce, University Commercialisation Offices, Patent and Trademark Attorneys, Government Awards and Industry Awards in Entrepreneurship and Innovation, Industry lead associations, Venture Capital Association, Innovation directories including Australian Technology Showcase, Business and Entrepreneurs Magazines including BRW and Anthill. In total, over 480 industry, association, government and award sources were generated in this process. Of these, 74 discrete sources generated high potentials that fufilled the criteria. 1116 firms were contacted as high potential cases. 331 cases agreed to participate in the screener, with 279 firms (134 nascents, and 140 young firms) successfully passing the high potential criteria. 222 Firms (108 Nascents and 113 Young firms) completed the full interview. For the general sample CAUSEE conducts screening phone interviews with a very large number of adult members of households randomly selected through random digit dialing using screening questions which determine whether respondents qualify as 'nascent entrepreneurs'. CAUSEE additionally targets 'young firms' those that commenced trading from 2004 or later. This process yielded 977 Nascent Firms (3.4%) and 1,011 Young Firms (3.6%). These were directed to the full length interview (40-60 minutes) either directly following the screener or later by appointment. The full length interviews were completed by 594 NF and 514 YF cases. These are the cases we will use in the comparative analysis in this report. Results and Implications The results for this paper are based on Wave one of the survey which has been completed and the data obtained. It is expected that the findings will assist in beginning to develop an understanding of high potential nascent and young firms in Australia, how they differ from the larger lifestyle entrepreneur group that makes up the vast majority of the new firms created each year, and the elements that may contribute to turning high potential growth status into high growth realities. The results have implications for Government in the design of better conditions for the creation of new business, firms who assist high potentials in developing better advice programs in line with a better understanding of their needs and requirements, individuals who may be considering becoming entrepreneurs in high potential arenas and existing entrepreneurs make better decisions.

Final report : tasks 1 and 4: eco-efficiency assessment of building refurbishment

The main objective was to compare the environmental impacts of a building undergoing refurbishment both before and after the refurbishment and to assist in the design of the refurbishment with what is learned.

Final report : feasibility study linking best value procurement assessment to outcome performance indicators

This feasibility study was established to investigate the application of the concept of ‘best value’ in construction procurement in Australia. In the case of ‘best value’ in the business enterprise, ‘best value’ is that which returns greatest value to the business enterprise’s shareholders. However, in the case of the public sector, ‘best value’ is more complex. For that reason, this research project focuses mainly on public sector construction project procurement.