Co-constructed interaction in a paired speaking test : the rater's perspective

The definition and operationalisation of interactional competence in speaking tests that entail co-construction of discourse is an area of language testing requiring further research. This article explores the reactions of four trained raters to paired candidates who oriented to asymmetric patterns of interaction in a discussion task. Through an analysis of candidate discourse combined with rater notes, stimulated verbal recalls, rater discussions and scores awarded for interactional effectiveness, the article examines the extent to which raters compensate or penalise candidates for their role in co-constructing asymmetric interactional patterns. The article argues that key features of the interaction are perceived by the raters as mutual achievements, and it further suggests that the awarding of shared scores for interactional competence is one way of acknowledging the inherently co-constructed nature of interaction in a paired speaking test.

Recommending best answer in a collaborative question answering system

The World Wide Web has become a medium for people to share information. People use Web-based collaborative tools such as question answering (QA) portals, blogs/forums, email and instant messaging to acquire information and to form online-based communities. In an online QA portal, a user asks a question and other users can provide answers based on their knowledge, with the question usually being answered by many users. It can become overwhelming and/or time/resource consuming for a user to read all of the answers provided for a given question. Thus, there exists a need for a mechanism to rank the provided answers so users can focus on only reading good quality answers. The majority of online QA systems use user feedback to rank users’ answers and the user who asked the question can decide on the best answer. Other users who didn’t participate in answering the question can also vote to determine the best answer. However, ranking the best answer via this collaborative method is time consuming and requires an ongoing continuous involvement of users to provide the needed feedback. The objective of this research is to discover a way to recommend the best answer as part of a ranked list of answers for a posted question automatically, without the need for user feedback. The proposed approach combines both a non-content-based reputation method and a content-based method to solve the problem of recommending the best answer to the user who posted the question. The non-content method assigns a score to each user which reflects the users’ reputation level in using the QA portal system. Each user is assigned two types of non-content-based reputations cores: a local reputation score and a global reputation score. The local reputation score plays an important role in deciding the reputation level of a user for the category in which the question is asked. The global reputation score indicates the prestige of a user across all of the categories in the QA system. Due to the possibility of user cheating, such as awarding the best answer to a friend regardless of the answer quality, a content-based method for determining the quality of a given answer is proposed, alongside the non-content-based reputation method. Answers for a question from different users are compared with an ideal (or expert) answer using traditional Information Retrieval and Natural Language Processing techniques. Each answer provided for a question is assigned a content score according to how well it matched the ideal answer. To evaluate the performance of the proposed methods, each recommended best answer is compared with the best answer determined by one of the most popular link analysis methods, Hyperlink-Induced Topic Search (HITS). The proposed methods are able to yield high accuracy, as shown by correlation scores: Kendall correlation and Spearman correlation. The reputation method outperforms the HITS method in terms of recommending the best answer. The inclusion of the reputation score with the content score improves the overall performance, which is measured through the use of Top-n match scores.

The importance of project governance framework in project procurement planning

Project Procurement is a ‘great’ environment for ethical issues with its low-price state of mind and competition. It has many opportunities that could contribute to illegal activities or unethical behavior especially in the construction industry. In 2006 alone, 17.3% of 417 Malaysian government contract projects were considered sick due to the poor performance by the contractors. Therefore it is important to govern the project procurement, especially the plan procurement stage to ensure the accountability and transparency of the decision made in awarding the right contract to the best contractor. This is where project governance framework (PGF) is really needed in project procurement planning. Project governance is a subset of corporate governance focusing on the areas of corporate governance related to project activities, including: portfolio direction, project sponsorship, project and program management and efficiency and disclosure and reporting. This paper highlights the importance of implementing project governance framework (PGF) to ensure that the decision makers are answerable and accountable to the stakeholders, and the decision making is transparent to avoid any ethical issues arises. A comprehensive preliminary literature is carried out to discover the importance of executing PGF in project procurement in Malaysian public sector. By understanding the important of PGF, it is hoped that this will bring a signal to other developing countries to implement the similar method in ensuring the transparency of the decision making in project procurement planning in their countries.

Interactional competence in a paired speaking test : features salient to raters

Paired speaking tests are now commonly used in both high-stakes testing and classroom assessment contexts. The co-construction of discourse by candidates is regarded as a strength of paired speaking tests, as candidates have the opportunity to display a wider range of interactional competencies, including turn taking, initiating topics and engaging in extended discourse with a partner, rather than an examiner. However, the impact of the interlocutor in such jointly negotiated discourse and the implications for assessing interactional competence are areas of concern. This article reports on the features of interactional competence that were salient to four trained raters of 12 paired speaking tests through the analysis of rater notes, stimulated verbal recalls and rater discussions. Findings enabled the identification of features of the performance noted by raters when awarding scores for interactional competence, and the particular features associated with higher and lower scores. A number of these features were seen by the raters as mutual achievements, which raises the issue of the extent to which it is possible to assess individual contributions to the co-constructed performance. The findings have implications for defining the construct of interactional competence in paired speaking tests and operationalising this in rating scales.

Refining animal models in fracture research: Seeking consensus in optimising both animal welfare and scientific validity for appropriate biomedical use

Background In an attempt to establish some consensus on the proper use and design of experimental animal models in musculoskeletal research, AOVET (the veterinary specialty group of the AO Foundation) in concert with the AO Research Institute (ARI), and the European Academy for the Study of Scientific and Technological Advance, convened a group of musculoskeletal researchers, veterinarians, legal experts, and ethicists to discuss, in a frank and open forum, the use of animals in musculoskeletal research. Methods The group narrowed the field to fracture research. The consensus opinion resulting from this workshop can be summarized as follows: Results & Conclusion Anaesthesia and pain management protocols for research animals should follow standard protocols applied in clinical work for the species involved. This will improve morbidity and mortality outcomes. A database should be established to facilitate selection of anaesthesia and pain management protocols for specific experimental surgical procedures and adopted as an International Standard (IS) according to animal species selected. A list of 10 golden rules and requirements for conduction of animal experiments in musculoskeletal research was drawn up comprising 1) Intelligent study designs to receive appropriate answers; 2) Minimal complication rates (5 to max. 10%); 3) Defined end-points for both welfare and scientific outputs analogous to quality assessment (QA) audit of protocols in GLP studies; 4) Sufficient details for materials and methods applied; 5) Potentially confounding variables (genetic background, seasonal, hormonal, size, histological, and biomechanical differences); 6) Post-operative management with emphasis on analgesia and follow-up examinations; 7) Study protocols to satisfy criteria established for a "justified animal study"; 8) Surgical expertise to conduct surgery on animals; 9) Pilot studies as a critical part of model validation and powering of the definitive study design; 10) Criteria for funding agencies to include requirements related to animal experiments as part of the overall scientific proposal review protocols. Such agencies are also encouraged to seriously consider and adopt the recommendations described here when awarding funds for specific projects. Specific new requirements and mandates related both to improving the welfare and scientific rigour of animal-based research models are urgently needed as part of international harmonization of standards.

Damages for personal injuries in Queensland : interest please!

The article revises established principles relating to the awarding of damages to the date of judgment and discusses decisions in the High Court and in the Supreme Court of Queensland which have caused significant changes to the manner of assessments of interest. Its purpose is to provide for practitioners involved in personal injuries litigation in Queensland a current set of guidelines as to the manner in which the wide discretion to award interest may be expected to be exercised.

Costs order against company in liquidation unlikely to be effective indemnity

In Kimtran v Downie [2003] QCA 424, the Queensland Court of Appeal allowed an appeal from the decision of a District Court judge who had ordered costs against a non-party liquidator. It held that the court's decision in relation to the awarding of costs against a liquidator was not constrained by the decision of the of the Court of Appeal in Mahaffey v Belar Pty Ltd [1999] QCA 2 in the manner stated in the District Court.

Comparative analyses of change orders costs in transportation construction

Transportation construction is substantially different from other construction fields due to widespread use of unit price bidding and competitive contract awarding. Thus, the potential for change orders has been the main source of unbalanced bidding for contractors, which can be described as substantial increases in work quantity or reasonable changes to the initial design provided by the State Highway Agencies (SHAs). It is important to understand the causes of the change orders as cost related issues are the main reason for contract disputes. We have analyzed a large dataset from a major SHA to identify project related and environmental factors that affect the change order costs. The results of the study can be instrumental in assessing the increased costs associated with change orders and better management measures can be taken to mitigate their effects.

Evaluation of the Australian Performing Arts Market 2014-2018 - Year One Report

The Australia Council awarded the tender of APAMs 2014, 2016 and 2018 to the Brisbane Powerhouse. The Australia Council, in awarding the contract for the presentation of APAM by Brisbane Powerhouse, stipulated that a formal evaluation of the three iterations of APAM and activity in the intervening years be undertaken. Queensland University of Technology, Creative Industries Faculty, under the leadership of Associate Professor Sandra Gattenhof, were contracted to undertake the formal evaluation. This is the first year report on the Brisbane iteration of the Market. This report has drawn from data collected across a range of sources, drawing on the scoping study undertaken by Justin Macdonnell addressing the Market from 1994–2010; the tender document submitted by the Brisbane Powerhouse; in-person interviews with APAM staff, APAM Stakeholders, Vox Pops from delegates in response to individual sessions, producer company/artist case studies and, most significantly, responses from a detailed online survey sent to all delegates. The main body of the report is organised around three key research aims, as outlined in the Brisbane Powerhouse Tender document (2011). These have been articulated as: Evaluation of international market development outcomes through showcasing work to targeted international presenters and agents Evaluation of national market development outcomes through showcasing work to national presenters and producers Evaluation of the exchange ideas, dialogue, skill 
development, partnerships, collaborations and co- productions and networks with local and international peers. The culmination of the data analysis has been articulated through five key recommendations, which may assist the APAM delivery team for the next version, in 2016. In summary, the recommendations are described as: 1. Indigenous focus to remain central to the conception and delivery of APAM 2. Re-framing APAM’s function and its delivery 3. Logistics and communications in a multi-venue approach, including communications and housekeeping, volunteers, catering, re-calibrating the employment of Brisbane Powerhouse protocols and processes for APAM 4. Presentation and promotion for presenters 5. Strategic targeting of Asian producers.

Streamlined research funding using short proposals and accelerated peer review : an observational study

Background Despite the widely recognised importance of sustainable health care systems, health services research remains generally underfunded in Australia. The Australian Centre for Health Services Innovation (AusHSI) is funding health services research in the state of Queensland. AusHSI has developed a streamlined protocol for applying and awarding funding using a short proposal and accelerated peer review. Method An observational study of proposals for four health services research funding rounds from May 2012 to November 2013. A short proposal of less than 1,200 words was submitted using a secure web-based portal. The primary outcome measures are: time spent preparing proposals; a simplified scoring of grant proposals (reject, revise or accept for interview) by a scientific review committee; and progressing from submission to funding outcomes within eight weeks. Proposals outside of health services research were deemed ineligible. Results There were 228 eligible proposals across 4 funding rounds: from 29% to 79% were shortlisted and 9% to 32% were accepted for interview. Success rates increased from 6% (in 2012) to 16% (in 2013) of eligible proposals. Applicants were notified of the outcomes within two weeks from the interview; which was a maximum of eight weeks after the submission deadline. Applicants spent 7 days on average preparing their proposal. Applicants with a ranking of reject or revise received written feedback and suggested improvements for their proposals, and resubmissions composed one third of the 2013 rounds. Conclusions The AusHSI funding scheme is a streamlined application process that has simplified the process of allocating health services research funding for both applicants and peer reviewers. The AusHSI process has minimised the time from submission to notification of funding outcomes.

Making the profitable transition towards sustainable business practice

The last three decades have been difficult for companies and industry. In an increasingly competitive international business climate with shifting national environmental regulations, higher standards are being demanded by the consumer and community groups, not-to-mention the escalating cost of primary resources such as water, steel and minerals. The cause of these pressures is the traditional notion held by business executives and engineers that there is an inherent trade off between eco-efficiency and improving the economic bottom line. However there is significant evidence and examples of best practice to show that there is in fact no trade-off between the environment and the economy if sustainable development through continual improvement is adopted. It is highly possible therefore for companies to make a profitable transition towards sustainable business practice, where along the transition significant business opportunities can be taken advantage of. Companies are by their very nature dynamic, influential and highly capable of adapting to change. Making an organisational transformation to a sustainable business is not outside the capacity of the typical company, who know much of what is needed already to change their activities to satisfy current market demands while achieving competitiveness. However in order to make the transition towards sustainable business practice companies require some key mechanisms such as accurate information on methodologies and opportunities, understanding of the financial and non-financial incentives, permission from stakeholders and shareholders, understanding of the emerging market opportunities, a critical mass of leaders in their sector and demonstrated case studies, and awarding appropriate risk-taking activities undertaken by engineers and CEOs. Satisfying these requirements will adopt an innovative culture within the company that strives for continual improvement and successfully transforms itself to achieve competitiveness in the 21st Century. This paper will summarise the experiences of The Natural Edge Project (TNEP) and its partners in assisting organisations to make a profitable transition towards sustainable business practice through several initiatives. The Natural Advantage of Nations publication provides the critical information required by business leaders and engineers to set the context of sustainable business practice. The Profiting in a Carbon Constrained World report, developed with Natural Capitalism Inc led by Hunter Lovins, summarises the opportunities available to companies to take advantage of the carbon trading market mechanisms such as the Chicago Climate Exchange and European Climate Exchange. The Sustainability Helix then guides the company through the transition by identifying the key tools and methodologies required by companies to reduce environmental loading while dramatically improving resource productivity and achieving competitiveness. Finally, the Engineering Sustainable Solutions Program delivers the key engineering information required by companies and university departments to deliver sustainable engineering solutions. The initiatives are of varying complexity and level of application, however all are designed to provide key staff the critical information required to make a profitable transition towards sustainable business practice. It is then their responsibility to apply and teach their knowledge to the rest of the organisation.

Scoring rules and abnormally low bids criteria in construction tenders: A taxonomic review

In the global construction context, the Best Value or Most Economically Advantageous Tender is becoming a widespread approach for contractor selection, as an alternative to other traditional awarding criteria such as the Lowest Price. In these multi-attribute tenders, the owner or auctioneer solicits proposals containing both a price bid and additional technical features. Once the proposals are received, each bidder's price bid is given an economic score according to a scoring rule, generally called an Economic Scoring Formula (ESF) and a technical score according to pre-specified criteria. Eventually, the contract is awarded to the bidder with the highest weighted overall score (economic + technical). However, Economic Scoring Formula selection by auctioneers is invariably and paradoxically a highly intuitive process in practice, involving few theoretical or empirical considerations, despite having being considered traditionally and mistakenly as objective, due to its mathematical nature. This paper provides a taxonomic classification of a wide variety of ESF and Abnormally Low Bid Criteria (ALBC) gathered in several countries with different tendering approaches. Practical implications concern the optimal design of price scoring rules in construction contract tenders, as well as future analyses of the effects of ESF and ALBC on competitive bidding behaviour.

Evaluation of Australian Performing Arts Market 2014-2018: APAM inter-year report 2015

In the awarding of the tender for APAM by the Australia Council to Brisbane Powerhouse for the delivery of the market in 2014-2018, a requirement is that a formal evaluation of the three iterations of APAM be undertaken by the Queensland University of Technology, Creative Industries Faculty, under the leadership of Associate Professor Sandra Gattenhof. The agreed research model delivers reporting on outcomes not only in the year in which APAM is delivered (2014, 2016, 2018) but also in the years between (2015, 2017). This inter-year report focuses on the domestic and international touring outcomes resulting from engagement in the 2014 Market and responds two of the three key research foci for the evaluation that are articulated in the Brisbane Powerhouse Tender (2011) document as: • Evaluation of international market development outcomes through showcasing work to targeted international presenters and agents • Evaluation of national market development outcomes through showcasing work to national presenters and producers. The reporting for mid-year 2015, a non-APAM year, collects data from two key sources – six identified case study productions that have been tracked for eighteen months, and an online survey delivered to all APAM 2014 delegates. This inter-year report is a six month follow-up with delegates and identified case studies companies that track the ongoing progress of market outcomes and levers for ongoing improvement of the APAM delivery model that was tabled in the Year One Report delivered to Brisbane Powerhouse in October 2014.

A randomized trial of fellowships for early career researchers finds a high reliability in funding decisions

Objectives Funding for early career researchers in Australia's largest medical research funding scheme is determined by a competitive peer-review process using a panel of four reviewers. The purpose of this experiment was to appraise the reliability of funding by duplicating applications that were considered by separate grant review panels. Study Design and Methods Sixty duplicate applications were considered by two independent grant review panels that were awarding funding for Australia's National Health and Medical Research Council. Panel members were blinded to which applications were included in the experiment and to whether it was the original or duplicate application. Scores were compared across panels using Bland–Altman plots to determine measures of agreement, including whether agreement would have impacted on actual funding. Results Twenty-three percent of the applicants were funded by both panels and 60 percent were not funded by both, giving an overall agreement of 83 percent [95% confidence interval (CI): 73%, 92%]. The chance-adjusted agreement was 0.75 (95% CI: 0.58, 0.92). Conclusion There was a comparatively high level of agreement when compared with other types of funding schemes. Further experimental research could be used to determine if this higher agreement is due to nature of the application, the composition of the assessment panel, or the characteristics of the applicants.

On the construction of costs: McDermott v Robinson Helicopter Company (No.2) [2014] QSC 213

The decision in McDermott v Robinson Helicopter Company (No 2) [2014] QSC 213 involves an extensive examination of authorities on the general principle relating to the awarding of costs to a successful party. The court concluded that there was a predilection in favour of distributing costs according to the outcome or 'event' of particular issues in the action.