Reliability and validity of query intent assessments

In most intent recognition studies, annotations of query intent are created post hoc by external assessors who are not the searchers themselves. It is important for the field to get a better understanding of the quality of this process as an approximation for determining the searcher's actual intent. Some studies have investigated the reliability of the query intent annotation process by measuring the interassessor agreement. However, these studies did not measure the validity of the judgments, that is, to what extent the annotations match the searcher's actual intent. In this study, we asked both the searchers themselves and external assessors to classify queries using the same intent classification scheme. We show that of the seven dimensions in our intent classification scheme, four can reliably be used for query annotation. Of these four, only the annotations on the topic and spatial sensitivity dimension are valid when compared with the searcher's annotations. The difference between the interassessor agreement and the assessor-searcher agreement was significant on all dimensions, showing that the agreement between external assessors is not a good estimator of the validity of the intent classifications. Therefore, we encourage the research community to consider using query intent classifications by the searchers themselves as test data.

International assessments of science learning : their positive and negative contributions to science education

The establishment and continuity of two international comparative assessments of science learning—the IEA’s TIMSS project and the OECD’s PISA project—have meant that there are now high-status reference points for other national and more local approaches to assessing the efficacy of science teaching and learning. Both projects, albeit with very different senses of what the outcome of science learning should be, have contributed positively and negatively to the current state of assessment of school science. The TIMSS project looks back at the science that is commonly included in the curricula of the participating countries. It is thus not about established school science nor about innovations in it. PISA is highly innovative looking, prospectively forward to see how students can use their science learning in everyday life situations. In this chapter some of these positives and negatives are discussed.

A preliminary investigation into technology and processes facilitating the assurance of learning

This paper reports on the outcomes from a preliminary evaluation of technologies and processes intended to support the Assurance of Learning initiative in the business faculty of an Australian university. The study investigated how existing institutional information systems and operational processes could be used to support direct measures of student learning and the attainment of intended learning goals. The levels at which learning outcomes had been attained were extracted from the University Learning Management System (LMS), based on rubric data for three assessments in two units. Spreadsheets were used to link rubric criteria to the learning goals associated with the assessments as identified in a previous curriculum mapping exercise, and to aggregate the outcomes. Recommendations arising from this preliminary study are made to inform a more comprehensive pilot based on this approach, and manage the quality of student learning experiences in the context of existing processes and reporting structures.

Disentangling the Complexity of Early-Stage Technology Acquisitions

While tools have been developed to assist firms' decision making for bringing known products and components into the supply chain, fewer tools are available to guide the acquisition of earlier-stage technologies, which is a riskier proposition due to higher technological and market uncertainties. Through synthesis of literature in technology sourcing, open innovation, alliances, mergers and acquisitions, outsourcing, and technology and knowledge transfer and consultation with industry, this paper identifies critical issues that decision makers should consider before making an early-stage technology acquisition. Sixteen questions emerge to guide decision making, comprising internal, technology, and partner assessments. These questions allow a firm to disentangle the complexity of early-stage technology acquisitions and select the most appropriate targets.

Comprehensive Property Retrieval and Measurement of Concrete Spalling Using Machine Vision for Post-Earthquake Safety Assessments

Active vibration control (AVC) is a relatively new technology for the mitigation of annoying human-induced vibrations in floors. However, recent technological developments have demonstrated its great potential application in this field. Despite this, when a floor is found to have problematic floor vibrations after construction the unfamiliar technology of AVC is usually avoided in favour of more common techniques, such as Tuned Mass Dampers (TMDs) which have a proven track record of successful application, particularly for footbridges and staircases. This study aims to investigate the advantages and disadvantages that AVC has, when compared with TMDs, for the application of mitigation of pedestrian-induced floor vibrations in offices. Simulations are performed using the results from a finite element model of a typical office layout that has a high vibration response level. The vibration problems on this floor are then alleviated through the use of both AVC and TMDs and the results of each mitigation configuration compared. The results of this study will enable a more informed decision to be made by building owners and structural engineers regarding suitable technologies for reducing floor vibrations.

Expert assessments of retrofitting coal-fired power plants with carbon dioxide capture technologies

A set of 13 US based experts in post-combustion and oxy-fuel combustion CO2 capture systems responded to an extensive questionnaire asking their views on the present status and future expected performance and costs for amine-based, chilled ammonia, and oxy-combustion retrofits of coal-fired power plants. This paper presents the experts' responses for technology maturity, ideal plant characteristics for early adopters, and the extent to which R&D and deployment incentives will impact costs. It also presents the best estimates and 95% confidence limits of the energy penalties associated with amine-based systems. The results show a general consensus that amine-based systems are closer to commercial application, but potential for improving performance and lowering costs is limited; chilled ammonia and oxy-combustion offer greater potential for cost reductions, but not without greater uncertainty regarding scale and technical feasibility. © 2011 Elsevier Ltd.

Making geography mobile: using location aware technology to improve student performance in physical geography

With the increased availability of new technologies, geography educators are revisiting their pedagogical approaches to teaching and calling for opportunities to share local and international practices which will enhance the learning experience and improve students’ performance. This paper reports on the use of handheld mobile devices, fitted with GPS, by secondary (high) school pupils in geography. Two location-aware activities were completed over one academic year (one per semester) and pre-test and post-test scores for both topics revealed a statistically significant increase in pupils’ performance as measured by the standard national assessments. A learner centred educational approach was adopted with the first mobile learning activity being created by the teacher as an exemplar of effective mobile learning design. Pupils built on their experiences of using mobile learning when they were required to created their own location aware learning task for peer use. An analysis of the qualitative data from the pupils’ journals, group diaries and focus group interviews revealed the five pillars of learner centred education are addressed when using location aware technologies and the use of handheld mobile devices offered greater flexibility and autonomy to the pupils thus altering the level of power and control away from the teacher. Due to the relatively small number of participants in the study, the results are more informative than generalisable however in light of the growing interest in geo-spatial technologies in geography education, this paper offers encouragement and insight into the use of location aware technology in a compulsory school context

Application of neural network to rock slope stability assessments

It is known that rock masses are inhomogeneous, discontinuous media composed of rock material and naturally occurring discontinuities such as joints, fractures and bedding planes. These features make any analysis very difficult using simple theoretical solutions. Generally speaking, back analysis technique can be used to capture some implicit parameters for geotechnical problems. In order to perform back analyses, the procedure of trial and error is generally required. However, it would be time-consuming. This study aims at applying a neural network to do the back analysis for rock slope failures. The neural network tool will be trained by using the solutions of finite element upper and lower bound limit analysis methods. Therefore, the uncertain parameter can be obtained, particularly for rock mass disturbance.

Teleconsultation/telediagnosis using teledentistry technology: a pilot feasibility study

This study assessed the feasibility of ateledentistry model for teleconsultation and telediagnosis inResidential Aged Care Facilities. Study feasibility was definedby the ability to develop remote treatment plans. Reliability ofthe remote assessments was assessed by comparing with thoseperformed by traditional face-to-face oral examinations. Anintraoral camera was operated by trained teledentistryassistants with the aim of screening residents for oral diseasesand pathological conditions. The model was supported bytraning and an instructional kit for the introral cameraoperators. The structure, content and delivery of the program,was evaluated. Residents’ views about the structure, contentand delivery of the program were also evaluated. A total of 50residents participated in this assessment. Results indicated thatthe proposed teledentistry approach for oral health screeningis feasible and reliable as an alternative to traditional oralhealth examination. Residents expressed high levels ofsatisfaction with the teledentistry service. This study providesan innovative solution towards closing the service delivery gapin the provision of sustainable oral health care services tounderserviced populations (e.g., nursing homes, rural areas).

Product development process: Using real options for assessments and to support the decision-making at decision gates

Enterprises need continuous product development activities to remain competitive in the marketplace. Their product development process (PDP) must manage stakeholders' needs - technical, financial, legal, and environmental aspects, customer requirements, Corporate strategy, etc. -, being a multidisciplinary and strategic issue. An approach to use real option to support the decision-making process at PDP phases in taken. The real option valuation method is often presented as an alternative to the conventional net present value (NPV) approach. It is based on the same principals of financial options: the right to buy or sell financial values (mostly stocks) at a predetermined price, with no obligation to do so. In PDP, a multi-period approach that takes into account the flexibility of, for instance, being able to postpone prototyping and design decisions, waiting for more information about technologies, customer acceptance, funding, etc. In the present article, the state of the art of real options theory is prospected and a model to use the real options in PDP is proposed, so that financial aspects can be properly considered at each project phase of the product development. Conclusion is that such model can provide more robustness to the decisions processes within PDP.

Energy technology characterizations handbook : environmental pollution and control factors /

Rev. ed. of the Office of Environmental Assessments' Technology characterizations (1981). Includes 13 additional ECIRs (Environmental Characterization Information Reports).

Technology valuation within the context of transfer collaborations with Chinese machine tool companies

The point of departure for this study was a recognition of the differences in suppliers' and acquirers' judgements of the value of technology when transferred between the two, and the significant impacts of technology valuation on the establishment of technology partnerships and effectiveness of technology collaborations. The perceptions, transfer strategies and objectives, perceived benefits and assessed technology contributions as well as associated costs and risks of both suppliers and acquirers were seen to be the core to these differences. This study hypothesised that the capability embodied in technology to yield future returns makes technology valuation distinct from the process of valuing manufacturing products. The study hence has gone beyond the dimensions of cost calculation and price determination that have been discussed in the existing literature, by taking a broader view of how to achieve and share future added value from transferred technology. The core of technology valuation was argued as the evaluation of the 'quality' of the capability (technology) in generating future value and the effectiveness of the transfer arrangement for best use of such a capability. A dynamic approach comprising future value generation and realisation within the context of specific forms of collaboration was therefore adopted. The research investigations focused on the UK and China machine tool industries, where there are many technology transfer activities and the value issue has already been recognised in practice. Data were gathered from three groups: machine tool manufacturing technology suppliers in the UK and acquirers in China, and machine tool users in China. Data collecting methods included questionnaire surveys and case studies within all the three groups. The study has focused on identifying and examining the major factors affecting value as well as their interactive effects on technology valuation from both the supplier's and acquirer's point of view. The survey results showed the perceptions and the assessments of the owner's value and transfer value from the supplier's and acquirer's point of view respectively. Benefits, costs and risks related to the technology transfer were the major factors affecting the value of technology. The impacts of transfer payment on the value of technology by the sharing of financial benefits, costs and risks between partners were assessed. The close relationship between technology valuation and transfer arrangements was established by which technical requirements and strategic implications were considered. The case studies reflected the research propositions and revealed that benefits, costs and risks in the financial, technical and strategic dimensions interacted in the process of technology valuation within the context of technology collaboration. Further to the assessment of factors affecting value, a technology valuation framework was developed which suggests that technology attributes for the enhancement of contributory factors and their contributions to the realisation of transfer objectives need to be measured and compared with the associated costs and risks. The study concluded that technology valuation is a dynamic process including the generation and sharing of future value and the interactions between financial, technical and strategic achievements.

Self-service technology and the service encounter

Self-service technology is affecting the service encounter. The potential reduction in personal contact through self-service technology may affect assessments of consumer satisfaction and commitment, making it necessary to investigate self-service technology usage, particularly the long-term impact on consumers' relationships with service organisations. Thus, this paper presents a framework for investigating the impact of self-service technology on consumer satisfaction and on a multi-dimensional measure of consumer commitment. Illustrative quotes from exploratory in-depth interviews support the framework and lead to a set of propositions. Future research directions for testing the framework are also discussed, and potential implications of this research are outlined.