Relative ranking: A biased rating

Reviewers' ratings have become one of the most influential parameters when making a decision to purchase or rent the products or services from the online vendors. Star Rating system is the de-facto standard for rating a product. It is regarded as one of the most visually appealing rating systems that directly interact with the consumers; helping them find products they will like to purchase as well as register their views on the product. It offers visual advantage to pick the popular or most rated product. Any system that is not as appealing as star system will have a chance of rejection by online business community. This paper argues that, the visual advantage is not enough to declare star rating system as a triumphant, the success of a ranking system should be measured by how effectively the system helps customers make decisions that they, retrospectively, consider correct. This paper argues and suggests a novel approach of Relative Ranking within the boundaries of star rating system to overcome a few inherent disadvantages the former system comes with. © Springer Science+Business Media B.V. 2010.

In-training assessment - Its potential in enhancing clinical teaching

Context In-training assessment (ITA) has established its place alongside formative and summative assessment at both the undergraduate and postgraduate level. In this paper the authors aimed to identify those characteristics of ITA that could enhance clinical teaching. Methods A literature review and discussions by an expert working group at the Ninth Cambridge Conference identified the aspects of ITA that could enhance clinical teaching. Results The features of ITA identified included defining the specific benefits to the learner, teacher and institution, and highlighting the patient as the context for ITA and clinical teaching. The ‘mapping’ of a learner’s progress towards the clinical teaching objectives by using multiple assessments over time, by multiple observers in both a systematic and opportunistic way correlates with the incremental nature of reaching clinical competence. Conclusions The importance of ITA based on both direct and indirect evidence of what the learner actually does in the real clinical setting is emphasized. Particular attention is given to addressing concerns in the more controversial areas of assessor training, ratings and documentation for ITA. Areas for future research are also identified.

Comprehending adverbs of doubt and certainty in health communication: A multidimensional scaling approach

This research explored the feasibility of using multidimensional scaling (MDS) analysis in novel combination with other techniques to study comprehension of epistemic adverbs expressing doubt and certainty (e.g., evidently, obviously, probably) as they relate to health communication in clinical settings. In Study 1, Australian English speakers performed a dissimilarity-rating task with sentence pairs containing the target stimuli, presented as "doctors' opinions". Ratings were analyzed using a combination of cultural consensus analysis (factor analysis across participants), weighted-data classical-MDS, and cluster analysis. Analyses revealed strong within-community consistency for a 3-dimensional semantic space solution that took into account individual differences, strong statistical acceptability of the MDS results in terms of stress and explained variance, and semantic configurations that were interpretable in terms of linguistic analyses of the target adverbs. The results confirmed the feasibility of using MDS in this context. Study 2 replicated the results with Canadian English speakers on the same task. Semantic analyses and stress decomposition analysis were performed on the Australian and Canadian data sets, revealing similarities and differences between the two groups. Overall, the results support using MDS to study comprehension of words critical for health communication, including in future studies, for example, second language speaking patients and/or practitioners. More broadly, the results indicate that the techniques described should be promising for comprehension studies in many communicative domains, in both clinical settings and beyond, and including those targeting other aspects of language and focusing on comparisons across different speech communities.

Trial of the Primary Care Practice Improvement Tool: Building organisational performance in Australian general practice and primary health care

Objective: To nationally trial the Primary Care Practice Improvement Tool (PC-PIT), an organisational performance improvement tool previously co-created with Australian primary care practices to increase their focus on relevant quality improvement (QI) activities. Design: The study was conducted from March to December 2015 with volunteer general practices from a range of Australian primary care settings. We used a mixed-methods approach in two parts. Part 1 involved staff in Australian primary care practices assessing how they perceived their practice met (or did not meet) each of the 13 PC-PIT elements of high-performing practices, using a 1–5 Likert scale. In Part 2, two external raters conducted an independent practice visit to independently and objectively assess the subjective practice assessment from Part 1 against objective indicators for the 13 elements, using the same 1–5 Likert scale. Concordance between the raters was determined by comparing their ratings. In-depth interviews conducted during the independent practice visits explored practice managers’ experiences and perceived support and resource needs to undertake organisational improvement in practice. Results: Data were available for 34 general practices participating in Part 1. For Part 2, independent practice visits and the inter-rater comparison were conducted for a purposeful sample of 19 of the 34 practices. Overall concordance between the two raters for each of the assessed elements was excellent. Three practice types across a continuum of higher- to lower-scoring practices were identified, with each using the PC-PIT in a unique way. During the in-depth interviews, practice managers identified benefits of having additional QI tools that relate to the PC-PIT elements. Conclusions: The PC-PIT is an organisational performance tool that is acceptable, valid and relevant to our range of partners and the end users (general practices). Work is continuing with our partners and end users to embed the PC-PIT in existing organisational improvement programs.