Learner-focused evaluation cycles : facilitating learning using feedforward, concurrent and feedback evaluation

There is a growing trend to offer students learning opportunities that are flexible, innovative and engaging. As educators embrace student-centred agile teaching and learning methodologies, which require continuous reflection and adaptation, the need to evaluate students’ learning in a timely manner has become more pressing. Conventional evaluation surveys currently dominate the evaluation landscape internationally, despite recognition that they are insufficient to effectively evaluate curriculum and teaching quality. Surveys often: (1) fail to address the issues for which educators need feedback, (2) constrain student voice, (3) have low response rates and (4) occur too late to benefit current students. Consequently, this paper explores principles of effective feedback to propose a framework for learner-focused evaluation. We apply a three-stage control model, involving feedforward, concurrent and feedback evaluation, to investigate the intersection of assessment and evaluation in agile learning environments. We conclude that learner-focused evaluation cycles can be used to guide action so that evaluation is not undertaken simply for the benefit of future offerings, but rather to benefit current students by allowing ‘real-time’ learning activities to be adapted in the moment. As a result, students become co-producers of learning and evaluation becomes a meaningful, responsive dialogue between students and their instructors.

Percutaneous coronary intervention with drug-eluting stents or coronary artery bypass surgery in subjects with type 2 diabetes : evaluation of: Farkouth ME, Domanski M, Sleeper LA, et al. Strategies for multivessel revascularization in patients with diabetes. N Engl J Med 2012;367(25):2375-84, and Contini GA, Nicolini F, Fortuna D, et al. Five-year outcomes of surgical or percutaneous myocardial revascularization in diabetic patients. Int J Cardiol 2012. [Epub ahead of print]

There is debate as to whether percutaneous coronary intervention (PCI) with drug-eluting stents or coronary artery bypass surgery (CABG) is the best procedure for subjects with type 2 diabetes and coronary artery disease requiring revascularization. There is some evidence that following these procedures there is less further revascularization with CABG than PCI in subjects with diabetes. Two recent studies; the FREEDOM (Future Revascularization Evaluation in patients with Diabetes mellitus: Optimal Management of Multivessel Disease) trial, and a trial using a real world diabetic population from a Registry, have shown that the benefits of CABG over PCI in subjects with type 2 diabetes extends to lower rates of death and myocardial infarct, in addition to lower rates of revascularization. However, the rates of stroke may be higher with CABG than PCI with drug-eluting stents in this population. Thus, if CABG is going to be preferred to PCI in subjects with type 2 diabetes and multivessel coronary disease, consideration should be given to how to reduce the rates of stroke with CABG.

Exploring the Possibilities and Methodological Challenges of Evaluation Practice : A Democratic Question

In our exploration of the methodological possibilities and challenges of evaluation practice that foregrounds a democratic approach, we argue that having sensitivity to participants’ different positions, ideological perspectives, and values, and an understanding of the existing power relationships are paramount for the evaluators if the evaluation is to achieve its goals. This chapter draws on our experiences as evaluators in Australia, where school leaders and teachers are currently experiencing significant curriculum and assessment changes, and now work in a context of heightened accountability. Our evaluation practices with schools are used to illustrate how democratic practices can be incorporated into evaluation in ways that provide opportunities and support for school self-evaluation. It is paramount to recognise that evaluation is a political and ideological practice, and therefore is not a neutral process. Our argument is that it remains the responsibility of evaluators to design spaces that build sustainable relationships with participants and the targets of the programmes being evaluated; ensure that dialogue and deliberation are valued between all stakeholders; represent a range of interests; and give a service back to the evaluated communities by offering understandings and promoting reflective practice and informed decision-making throughout programme implementation.

Coexpression of epidermal growth factor receptor with related factors is associated with a poor prognosis in non-small-cell lung cancer

The epidermal growth factor receptor (EGFR) is commonly expressed in non-small-cell lung cancer (NSCLC) and promotes a host of mechanisms involved in tumorigenesis. However, EGFR expression does not reliably predict prognosis or response to EGFR-targeted therapies. The data from two previous studies of a series of 181 consecutive surgically resected stage I-IIIA NSCLC patients who had survived in excess of 60 days were explored. Of these patients, tissue was available for evaluation of EGFR in 179 patients, carbonic anhydrase (CA) IX in 177 patients and matrix metalloproteinase-9 (MMP-9) in 169 patients. We have previously reported an association between EGFR expression and MMP-9 expression. We have also reported that MMP-9 (P=0.001) and perinuclear (p)CA IX (P=0.03) but not EGFR expression were associated with a poor prognosis. Perinuclear CA IX expression was also associated with EGFR expression (P<0.001). Multivariate analysis demonstrated that coexpression of MMP-9 with EGFR conferred a worse prognosis than the expression of MMP-9 alone (P<0.001) and coexpression of EGFR and pCA IX conferred a worse prognosis than pCA IX alone (P=0.05). A model was then developed where the study population was divided into three groups: group 1 had expression of EGFR without coexpression of MMP-9 or pCA IX (number=21); group 2 had no expression of EGFR (number=75); and group 3 had coexpression of EGFR with pCA IX or MMP-9 or both (number=70). Group 3 had a worse prognosis than either groups 1 or 2 (P=0.0003 and 0.027, respectively) and group 1 had a better prognosis than group 2 (P=0.036). These data identify two cohorts of EGFR-positive patients with diametrically opposite prognoses. The group expressing either EGFR and or both MMP-9 and pCA IX may identify a group of patients with activated EGFR, which is of clinical relevance with the advent of EGFR-targeted therapies. © 2004 Cancer Research UK.

Tumour necrosis is an independent prognostic marker in non-small cell lung cancer : correlation with biological variables

Background Tumour necrosis (TN) is recognized to be a consequence of chronic cellular hypoxia. TN and hypoxia correlate with poor prognosis in solid tumours. Methods In a retrospective study the prognostic implications of the extent of TN was evaluated in non-small cell lung cancer (NSCLC) and correlated with clinicopathological variables and expression of epidermal growth factor receptor, Bcl-2, p53 and matrix metalloproteinase-9 (MMP-9). Tissue specimens from 178 surgically resected cases of stage I-IIIA NSCLC with curative intent were studied. The specimens were routinely processed, formalin-fixed and paraffin-embedded. TN was graded as extensive or either limited or absent by two independent observers; disagreements were resolved using a double-headed microscope. The degree of reproducibility was estimated by re-interpreting 40 randomly selected cases after a 4 month interval. Results Reproducibility was attained in 36/40 cases, Kappa score=0.8 P<0.001. TN correlated with T-stage (P=0.001), platelet count (P=0.004) and p53 expression (P=0.031). Near significant associations of TN with N-stage (P=0.063) and MMP-9 expression (P=0.058) were seen. No association was found with angiogenesis (P=0.98). On univariate (P=0.0016) and multivariate analysis (P=0.023) TN was prognostic. Conclusion These results indicate that extensive TN reflects an aggressive tumour phenotype in NSCLC and may improve the predictive power of the TMN staging system. The lack of association between TN and angiogenesis may be important although these variables were not evaluated on serial sections. © 2002 Elsevier Science Ireland Ltd. All rights reserved.

An evaluation of different features and learning models for anomalous event detection

The huge amount of CCTV footage available makes it very burdensome to process these videos manually through human operators. This has made automated processing of video footage through computer vision technologies necessary. During the past several years, there has been a large effort to detect abnormal activities through computer vision techniques. Typically, the problem is formulated as a novelty detection task where the system is trained on normal data and is required to detect events which do not fit the learned ‘normal’ model. There is no precise and exact definition for an abnormal activity; it is dependent on the context of the scene. Hence there is a requirement for different feature sets to detect different kinds of abnormal activities. In this work we evaluate the performance of different state of the art features to detect the presence of the abnormal objects in the scene. These include optical flow vectors to detect motion related anomalies, textures of optical flow and image textures to detect the presence of abnormal objects. These extracted features in different combinations are modeled using different state of the art models such as Gaussian mixture model(GMM) and Semi- 2D Hidden Markov model(HMM) to analyse the performances. Further we apply perspective normalization to the extracted features to compensate for perspective distortion due to the distance between the camera and objects of consideration. The proposed approach is evaluated using the publicly available UCSD datasets and we demonstrate improved performance compared to other state of the art methods.

Biological values of acupuncture and Chinese herbal medicine : impact on the life science

Editorial paper

Aboriginal dietary intake and a successful nutrition intervention project in a Northern Territory community

This paper summarises the development and testing of the 'store-turnover' method, a non-invasive dietary survey methodology for quantitative measurement of food and nutrient intake in remote, centralised Aboriginal communities. It then describes the use of the method in planning, implementation and evaluation of a community-based nutrition intervention project in a small Aboriginal community in the Northern Territory. During this project marked improvements in both the dietary intake of the community and biological indicators of nutritional health (including vitamin status and the degree and prevalence of several risk factors for non-communicable disease) were measured in the community over a 12-month period following the development of intervention strategies with the community. Although these specific strategies are presented, emphasis is directed towards the process involved, particularly the evaluation procedures used to monitor all stages of the project with the community.

A methodology for effective implementation of lean strategies and its performance evaluation in manufacturing organizations

Purpose – The purpose of this paper is to develop an effective methodology for implementing lean manufacturing strategies and a leanness evaluation metric using continuous performance measurement (CPM). Design/methodology/approach – Based on five lean principles, a systematic lean implementation methodology for manufacturing organizations has been proposed. A simplified leanness evaluation metric consisting of both efficiency and effectiveness attributes of manufacturing performance has been developed for continuous evaluation of lean implementation. A case study to validate the proposed methodology has been conducted and proposed CPM metric has been used to assess the manufacturing leanness. Findings – Proposed methodology is able to systematically identify manufacturing wastes, select appropriate lean tools, identify relevant performance indicators, achieve significant performance improvement and establish lean culture in the organization. Continuous performance measurement matrices in terms of efficiency and effectiveness are proved to be appropriate methods for continuous evaluation of lean performance. Research limitations/implications – Effectiveness of the method developed has been demonstrated by applying it in a real life assembly process. However, more tests/applications will be necessary to generalize the findings. Practical implications – Results show that applying the methods developed, managers can successfully identify and remove manufacturing wastes from their production processes. By improving process efficiency, they can optimize their resource allocations. Manufacturers now have a validated step by step methodology for successfully implementing lean strategies. Originality/value – According to the authors’ best knowledge, this is the first known study that proposed a systematic lean implementation methodology based on lean principles and continuous improvement techniques. Evaluation of performance improvement by lean strategies is a critical issue. This study develops a simplified leanness evaluation metric considering both efficiency and effectiveness attributes and integrates it with the lean implementation methodology.

Pooled biological specimens for human biomonitoring of environmental chemicals : opportunities and limitations

Biomonitoring has become the ‘gold standard’ in assessing chemical exposures, and plays an important role in risk assessment. The pooling of biological specimens – combining multiple individual specimens into a single sample – can be used in biomonitoring studies to monitor levels of exposure and identify exposure trends, or to identify susceptible populations in a cost-effective manner. Pooled samples provide an estimate of central tendency, and may also reveal information about variation within the population. The development of a pooling strategy requires careful consideration of the type and number of samples collected, the number of pools required, and the number of specimens to combine per pool in order to maximize the type and robustness of the data. Creative pooling strategies can be used to explore exposure-outcome associations, and extrapolation from other larger studies can be useful in identifying elevated exposures in specific individuals. The use of pooled specimens is advantageous as it saves significantly on analytical costs, may reduce the time and resources required for recruitment, and in certain circumstances, allows quantification of samples approaching the limit of detection. In addition, use of pooled samples can provide population estimates while avoiding ethical difficulties that may be associated with reporting individual results.

Evaluation framework for green procurement in road construction

Purpose Most barriers and enablers of sustainable projects are related to procurement. This study proposes a framework for evaluating green procurement practices throughout the lifecycle of road construction projects and demonstrates its application through an Australian case study. Design/methodology/approach The study is based on linking the phases of road construction with incentive mechanisms for proactively motivating behavioural change. A holistic view on utilised and potential incentives is attempted with a literature review and a state-of-practice review. The latter is based on interviews and 90 policy and procurement documents across five Australian states. Findings An evaluation framework with seven procurement stages is suggested to describe current state green procurement incentives throughout the delivery lifecycle of road construction projects. The Australian case study was found to provide useful data to identify gaps and strong points of the different states regarding their level of integration of sustainability and greenhouse gas emissions GHG) reduction elements in their procurement practices. This understanding was used to draw recommendations on future advancement of green procurement. Originality/value: Government entities across the globe can impact considerably the achievement of sustainability and GHG targets, by using their procurement practices and requirements to create incentives for contractors and suppliers to engage in more GHG conscious practices. The present study provides a systematic account of how green procurement practices can be underpinned using the Australian road construction industry as a case study, and distinguish between strong and weak links in the green procurement chain to draw recommendations for future initiatives.

Teacher Evidence Matrix : an evaluation using multiple lines of evidence

Welcome to the Teacher evidence matrix. This matrix is designed for highly qualified discipline experts to evaluate their teaching in a systematic manner. The primary purpose of the Teacher evidence matrix is to provide a tool that an academic staff member at university can annually review their teaching. The annual review will result in you being ready for performance, planning and review; promotion; awards; or employment application. This tool is designed for individual use and will lead to an action plan for implementation.

Facilitating local stories in post-disaster regional communities : evaluation in narrative-driven oral history projects

Cyclone Yasi struck the Cassowary Coast of Northern Queensland, Australia, in the early hours of February 3, 2011, destroying many homes and property, including the destruction of the Cardwell and district historical society’s premises. With their own homes flattened, many residents were forced to live in mobile accommodation, with extended family, or leave the area altogether. The historical society members seemed, however, particularly devastated by their flattened foreshore museum and loss of their precious collection of material. A call for assistance was made through the Oral History Association of Australia’s Queensland branch (OHAA Qld), which along with a Queensland University of Technology (QUT) research team sponsored a trip to best plan how they could start to pick up the pieces to rebuild the museum. This chapter highlights the need for communities to gather, preserve and present their own stories, in a way that is sustainable and meaningful to them – whether that be because of a disaster, or as they go about life in their contemporary communities – the key being that good advice, professional support and embedded evaluation practices at crucial moments along the way can be critically important.

Molecular dynamics investigation on shearing between osteopontin and hydroxyapatite in biological materials

Bone, a hard biological material, possesses a combination of high stiffness and toughness, even though the main basic building blocks of bone are simply mineral platelets and protein molecules. Bone has a very complex microstructure with at least seven hierachical levels. This unique material characteristic attracts great attention, but the deformation mechanisms in bone have not been well understood. Simulation at nano-length scale such as molecular dynamics (MD) is proven to be a powerful tool to investigate bone nanomechanics for developing new artificial biological materials. This study focuses on the ultra large and thin layer of extrafibrillar protein matrix (thickness = ~ 1 nm) located between mineralized collagen fibrils (MCF). Non-collagenous proteins such as osteopontin (OPN) can be found in this protein matrix, while MCF consists mainly of hydroxyapatite (HA) nanoplatelets (thickness = 1.5 – 4.5 nm). By using molecular dynamics method, an OPN peptide was pulled between two HA mineral platelets with water in presence. Periodic boundary condition (PBC) was applied. The results indicate that the mechanical response of OPN peptide greatly depends on the attractive electrostatics interaction between the acidic residues in OPN peptide and HA mineral surfaces. These bonds restrict the movement of OPN peptide, leading to a high energy dissipation under shear loading.

Visually impaired drivers who use bioptic telescopes : self-assessed driving skills and agreement with on-road driving evaluation

Purpose. To compare self-assessed driving habits and skills of licensed drivers with central visual loss who use bioptic telescopes to those of age-matched normally sighted drivers, and to examine the association between bioptic drivers' impressions of the quality of their driving and ratings by a “backseat” evaluator. Methods. Participants were licensed bioptic drivers (n = 23) and age-matched normally sighted drivers (n = 23). A questionnaire was administered addressing driving difficulty, space, quality, exposure, and, for bioptic drivers, whether the telescope was helpful in on-road situations. Visual acuity and contrast sensitivity were assessed. Information on ocular diagnosis, telescope characteristics, and bioptic driving experience was collected from the medical record or in interview. On-road driving performance in regular traffic conditions was rated independently by two evaluators. Results. Like normally sighted drivers, bioptic drivers reported no or little difficulty in many driving situations (e.g., left turns, rush hour), but reported more difficulty under poor visibility conditions and in unfamiliar areas (P < 0.05). Driving exposure was reduced in bioptic drivers (driving 250 miles per week on average vs. 410 miles per week for normally sighted drivers, P = 0.02), but driving space was similar to that of normally sighted drivers (P = 0.29). All but one bioptic driver used the telescope in at least one driving task, and 56% used the telescope in three or more tasks. Bioptic drivers' judgments about the quality of their driving were very similar to backseat evaluators' ratings. Conclusions. Bioptic drivers show insight into the overall quality of their driving and areas in which they experience driving difficulty. They report using the bioptic telescope while driving, contrary to previous claims that it is primarily used to pass the vision screening test at licensure.