Reliability and validity of query intent assessments

In most intent recognition studies, annotations of query intent are created post hoc by external assessors who are not the searchers themselves. It is important for the field to get a better understanding of the quality of this process as an approximation for determining the searcher's actual intent. Some studies have investigated the reliability of the query intent annotation process by measuring the interassessor agreement. However, these studies did not measure the validity of the judgments, that is, to what extent the annotations match the searcher's actual intent. In this study, we asked both the searchers themselves and external assessors to classify queries using the same intent classification scheme. We show that of the seven dimensions in our intent classification scheme, four can reliably be used for query annotation. Of these four, only the annotations on the topic and spatial sensitivity dimension are valid when compared with the searcher's annotations. The difference between the interassessor agreement and the assessor-searcher agreement was significant on all dimensions, showing that the agreement between external assessors is not a good estimator of the validity of the intent classifications. Therefore, we encourage the research community to consider using query intent classifications by the searchers themselves as test data.

Designing mobile systems for social navigation in urban public places

This thesis presents social requirements and design considerations from a study evaluating interactive approaches to social navigation and user-generated information sharing in urban environments using mobile devices. It investigates innovative ways to leverage mobile information and communication technology in order to provide a social navigation platform for residents and visitors in and for public urban places. Through a design case study this work presents CityFlocks, a mobile information system that offers an easy way for information-seeking new residents or visitors to access tacit knowledge from local people about their new community. It is intended to enable visitors and new residents in a city to tap into the knowledge and experiences of local residents in order to gather information about their new environment. Its design specifically aims to lower existing barriers of access and facilitate social navigation in urban places. In various user tests it evaluates two general user interaction alternatives – direct and indirect social navigation – and analyses which interaction method works better for people using a mobile device to socially navigate urban environments. The outcomes are relevant for the user interaction design of future mobile information systems that leverage the social navigation approach.

Towards a visually enhanced medical search engine

This paper presents the prototype of an information retrieval system for medical records that utilises visualisation techniques, namely word clouds and timelines. The system simplifies and assists information seeking tasks within the medical domain. Access to patient medical information can be time consuming as it requires practitioners to review a large number of electronic medical records to find relevant information. Presenting a summary of the content of a medical document by means of a word cloud may permit information seekers to decide upon the relevance of a document to their information need in a simple and time effective manner. We extend this intuition, by mapping word clouds of electronic medical records onto a timeline, to provide temporal information to the user. This allows exploring word clouds in the context of a patient’s medical history. To enhance the presentation of word clouds, we also provide the means for calculating aggregations and differences between patient’s word clouds.

Overview of INEX 2014

INEX investigates focused retrieval from structured documents by providing large test collections of structured documents, uniform evaluation measures, and a forum for organizations to compare their results. This paper reports on the INEX 2014 evaluation campaign, which consisted of three tracks: The Interactive Social Book Search Track investigated user information seeking behavior when interacting with various sources of information, for realistic task scenarios, and how the user interface impacts search and the search experience. The Social Book Search Track investigated the relative value of authoritative metadata and user-generated content for search and recommendation using a test collection with data from Amazon and LibraryThing, including user profiles and personal catalogues. The Tweet Contextualization Track investigated tweet contextualization, helping a user to understand a tweet by providing him with a short background summary generated from relevant Wikipedia passages aggregated into a coherent summary. INEX 2014 was an exciting year for INEX in which we for the third time ran our workshop as part of the CLEF labs. This paper gives an overview of all the INEX 2014 tracks, their aims and task, the built test-collections, the participants, and gives an initial analysis of the results.

Using internet search queries for infectious disease surveillance: screening diseases for suitability

Background Internet-based surveillance systems provide a novel approach to monitoring infectious diseases. Surveillance systems built on internet data are economically, logistically and epidemiologically appealing and have shown significant promise. The potential for these systems has increased with increased internet availability and shifts in health-related information seeking behaviour. This approach to monitoring infectious diseases has, however, only been applied to single or small groups of select diseases. This study aims to systematically investigate the potential for developing surveillance and early warning systems using internet search data, for a wide range of infectious diseases. Methods Official notifications for 64 infectious diseases in Australia were downloaded and correlated with frequencies for 164 internet search terms for the period 2009–13 using Spearman’s rank correlations. Time series cross correlations were performed to assess the potential for search terms to be used in construction of early warning systems. Results Notifications for 17 infectious diseases (26.6%) were found to be significantly correlated with a selected search term. The use of internet metrics as a means of surveillance has not previously been described for 12 (70.6%) of these diseases. The majority of diseases identified were vaccine-preventable, vector-borne or sexually transmissible; cross correlations, however, indicated that vector-borne and vaccine preventable diseases are best suited for development of early warning systems. Conclusions The findings of this study suggest that internet-based surveillance systems have broader applicability to monitoring infectious diseases than has previously been recognised. Furthermore, internet-based surveillance systems have a potential role in forecasting emerging infectious disease events, especially for vaccine-preventable and vector-borne diseases

Info-active and info-passive: The new type of consumer classification

Social media platforms, that foster user generated content, have altered the ways consumers search for product related information. Conducting online searches, reading product reviews, and comparing products ratings, is becoming a more common information seeking pathway. This research demonstrates that info-active consumers are becoming less reliant on information provided by retailers or manufacturers, hence marketing generated online content may have a reduced impact on their purchasing behaviour. The results of this study indicate that beyond traditional methods of segmenting consumers, in the online context, new classifications such as info-active and info-passive would be beneficial in digital marketing. This cross-sectional, mixed-methods study is based on 43 in-depth interviews and an online survey with 500 consumers from 30 countries.

Twitter as a medium for professional networking

This study aims to explore the use of Twitter for professional purposes. The researcher discovered that Twitter is widely perceived as an information ground in online spaces. Information grounds are social settings where information, people, and places come together to create an information flow within a physical environment. Twitter provides a sense of place as well as a sense of belonging that enables IT professionals to use Twitter for professional development. The data for this study were collected using online observations and interviews. The online observations helped the researcher to distinguish the ‘information behaviours’ (the objective and observable actions) of the participants. The interviews were used to understand the way IT professionals use Twitter for professional purposes through their own individual perspectives. The data were analysed using a constructive grounded theory. The findings show that building professional networking is extremely important to IT professionals; rather than the information-seeking and information-sharing aspects of Twitter. Building professional networking in microblogging has a significant influence on an individual’s professional development. The results also demonstrate that IT professionals are more likely to exploit their weak-ties rather than their strong-ties on Twitter. In short, these users experience Twitter as a real place or ‘information grounds’ where they meet and socialise with experts.

Evaluating information systems

The book within which this chapter appears is published as a research reference book (not a coursework textbook) on Management Information Systems (MIS) for seniors or graduate students in Chinese universities. It is hoped that this chapter, along with the others, will be helpful to MIS scholars and PhD/Masters research students in China who seek understanding of several central Information Systems (IS) research topics and related issues. The subject of this chapter - ‘Evaluating Information Systems’ - is broad, and cannot be addressed in its entirety in any depth within a single book chapter. The chapter proceeds from the truism that organizations have limited resources and those resources need to be invested in a way that provides greatest benefit to the organization. IT expenditure represents a substantial portion of any organization’s investment budget and IT related innovations have broad organizational impacts. Evaluation of the impact of this major investment is essential to justify this expenditure both pre- and post-investment. Evaluation is also important to prioritize possible improvements. The chapter (and most of the literature reviewed herein) admittedly assumes a blackbox view of IS/IT1, emphasizing measures of its consequences (e.g. for organizational performance or the economy) or perceptions of its quality from a user perspective. This reflects the MIS emphasis – a ‘management’ emphasis rather than a software engineering emphasis2, where a software engineering emphasis might be on the technical characteristics and technical performance. Though a black-box approach limits diagnostic specificity of findings from a technical perspective, it offers many benefits. In addition to superior management information, these benefits may include economy of measurement and comparability of findings (e.g. see Part 4 on Benchmarking IS). The chapter does not purport to be a comprehensive treatment of the relevant literature. It does, however, reflect many of the more influential works, and a representative range of important writings in the area. The author has been somewhat opportunistic in Part 2, employing a single journal – The Journal of Strategic Information Systems – to derive a classification of literature in the broader domain. Nonetheless, the arguments for this approach are believed to be sound, and the value from this exercise real. The chapter drills down from the general to the specific. It commences with a highlevel overview of the general topic area. This is achieved in 2 parts: - Part 1 addressing existing research in the more comprehensive IS research outlets (e.g. MISQ, JAIS, ISR, JMIS, ICIS), and Part 2 addressing existing research in a key specialist outlet (i.e. Journal of Strategic Information Systems). Subsequently, in Part 3, the chapter narrows to focus on the sub-topic ‘Information Systems Success Measurement’; then drilling deeper to become even more focused in Part 4 on ‘Benchmarking Information Systems’. In other words, the chapter drills down from Parts 1&2 Value of IS, to Part 3 Measuring Information Systems Success, to Part 4 Benchmarking IS. While the commencing Parts (1&2) are by definition broadly relevant to the chapter topic, the subsequent, more focused Parts (3 and 4) admittedly reflect the author’s more specific interests. Thus, the three chapter foci – value of IS, measuring IS success, and benchmarking IS - are not mutually exclusive, but, rather, each subsequent focus is in most respects a sub-set of the former. Parts 1&2, ‘the Value of IS’, take a broad view, with much emphasis on ‘the business Value of IS’, or the relationship between information technology and organizational performance. Part 3, ‘Information System Success Measurement’, focuses more specifically on measures and constructs employed in empirical research into the drivers of IS success (ISS). (DeLone and McLean 1992) inventoried and rationalized disparate prior measures of ISS into 6 constructs – System Quality, Information Quality, Individual Impact, Organizational Impact, Satisfaction and Use (later suggesting a 7th construct – Service Quality (DeLone and McLean 2003)). These 6 constructs have been used extensively, individually or in some combination, as the dependent variable in research seeking to better understand the important antecedents or drivers of IS Success. Part 3 reviews this body of work. Part 4, ‘Benchmarking Information Systems’, drills deeper again, focusing more specifically on a measure of the IS that can be used as a ‘benchmark’3. This section consolidates and extends the work of the author and his colleagues4 to derive a robust, validated IS-Impact measurement model for benchmarking contemporary Information Systems (IS). Though IS-Impact, like ISS, has potential value in empirical, causal research, its design and validation has emphasized its role and value as a comparator; a measure that is simple, robust and generalizable and which yields results that are as far as possible comparable across time, across stakeholders, and across differing systems and systems contexts.

Libr@ries : changing information space and practice

This volume examines the social, cultural, and political implications of the shift from traditional forms of print-based libraries to the delivery of online information in educational contexts. Despite the central role of libraries in literacy and learning, research of them has, in the main, remained isolated within the disciplinary boundaries of information and library science. By contrast, this book problematizes and thereby mainstreams the field. It brings together scholars from a wide range of academic fields to explore the dislodging of library discourse from its longstanding apolitical, modernist paradigm. Collectively, the authors interrogate the presuppositions of current library practice and examine how library as place and library as space blend together in ways that may be both complementary and contradictory. Seeking a suitable term to designate this rapidly evolving and much contested development, the editors devised the word “libr@ary,” and use the term arobase to signify the conditions of formation of new libraries within contexts of space, knowledge, and capital.

Teachers-as-writers: Writing information texts in English and vernacular

Our contribution to this volume is not on the work of the teacher who inspires the child writer, but the teacher as the writer and illustrator of multilingual texts for classroom use that inspires the child reader. This chapter focuses on a first time teacher writer from Fiji, Bereta , who participated in a two day writing workshop known as the Information Text Awareness Project (hereafter ITAP). This chapter commences with an overview of the ITAP which was conducted in Nadi, Fiji, in 2012 with Bereta and 17 teachers from urban, semi-urban and rural contexts within the Nadi educational district. The politics of presenting Western ways of knowing to teachers from diverse cultural and linguistic contexts via a Western pedagogical approach is explored in the second section. We believe that this work involves a moral dimension that needs careful consideration. The third section outlines the eight stages of ITAP where teacher writers such as Bereta produced an English and a vernacular information text for use in their classrooms. The outline of the eight stages of ITAP is justified with links to the research literature. The final section recounts Bereta’s interview data where she talks about using the newly created English and vernacular information texts in the classroom and the community’s response to her inaugural publications. The findings may be of interest to those seeking to establish an adult writing cooperative to produce English and vernacular information texts for classroom use.

Integration of clinical information systems in Saudi Arabian health care contexts: A grounded theory exploration

This research examined the implementation of clinical information system technology in a large Saudi Arabian health care organisation. The research was underpinned by symbolic interactionism and grounded theory methods informed data collection and analysis. Observations, a review of policy documents and 38 interviews with registered nurses produced in-depth data. Analysis generated three abstracted concepts that explained how imported technology increased practice and health care complexity rather than enhance quality patient care. The core category, Disseminating Change, also depicted a hierarchical and patriarchal culture that shaped the implementation process at the levels of government, organisation and the individual.

Business Process Redesign in Information Technology Incident Management: A teaching case

This paper consists of a detailed case narrative on how a leading Australian Finance organisation has utilised contemporary Business Process Management (BPM) concepts for improving the IT incident management processes within the whole organisation. The target audience includes practitioners who are interested in BPM case studies and Academics who may be seeking case studies for innovative teaching practices.

An instrument for assessing primary students’ knowledge of information graphics in mathematics

Information graphics have become increasingly important in representing, organising and analysing information in a technological age. In classroom contexts, information graphics are typically associated with graphs, maps and number lines. However, all students need to become competent with the broad range of graphics that they will encounter in mathematical situations. This paper provides a rationale for creating a test to measure students’ knowledge of graphics. This instrument can be used in mass testing and individual (in-depth) situations. Our analysis of the utility of this instrument informs policy and practice. The results provide an appreciation of the relative difficulty of different information graphics; and provide the capacity to benchmark information about students’ knowledge of graphics. The implications for practice include the need to support the development of students’ knowledge of graphics, the existence of gender differences, the role of cross-curriculum applications in learning about graphics, and the need to explicate the links among graphics.

Innovative Practices in the Australian Built Environment Sector : An Information Resource for Industry

PROJECT BRIEF Information provided by the Built Environment Industry Innovation Council as background to this project includes the following information on construction and innovation within the industry. • The construction industry contributes around $67 billion to GDP and employs around 970,000 and generates exports of nearly $150 million. • The industry has one of the lowest innovation rates of any industry in Australia, ranking third last across all Australian industries in terms of its proportion of business expenditure on innovation, and second last in terms of the proportion of income generated from innovation (ABS, 2006). • Key innovation challenges include addressing energy and water use efficiency, and housing costs in preparing for the implementation of the Carbon Pollution Reduction Scheme. The sector will need to build its capability and capacity to deliver the technical and operational expertise required.The broader Built Environment Innovation Project aims to address the following two objectives: 1. Identify current innovative practice across the Built Environment industry. 2. Develop a knowledge exchange strategy for this information to be disseminated to all industry stakeholders. Industry practice issues are critical to the built environment industry’s ability to innovate, and the BRITE project from the CRC for Construction Innovation has previously undertaken work to identify the key factors that drive innovation. Part 1 of the current project aims to extend this work by conducting a stocktake of current and emerging innovative practices within the built environment industry. Part 2 of the project addresses the second of these objectives, that is, to recommend a knowledge exchange strategy for promoting the wider uptake of innovative practices that makes the information identified in Part 1 of the study (on emerging innovative practices) accessible to Australian built environment industry stakeholders. The project brief was for the strategy to include a mechanism to enable this information resource to be updated as new initiatives/practices are developed. A better understanding of the built environment industry’s own knowledge infrastructure also has the potential to enhance innovation outcomes for the industry. This project will develop a coordinated knowledge exchange strategy, informed by the best available information on current innovation practices within the industry and suggest directions for gaining a better understanding of: the industry contexts that lead to innovative practices; the industry (including enterprise and individual) drivers for innovation; and appropriate knowledge exchange pathways for delivering future industry innovation. A deliverable of Part 2 will be a recommendation for a knowledge exchange strategy to accelerate adoption of innovative practices in the built environment industry, including resource implications and how such a recommendation could be taken forward as an ongoing resource.

Community information literacy : developing an Australian research agenda

The majority of information literacy (IL) research has been con ducted within the confi nes of educational or workplace settings. Little to no research has explored IL in community contexts. This paper will consider the current state of IL research within the community setting. The paper uses three re cent IL studies as a vehicle for developing an Australian com munity IL research agenda. Three observations are made about community information literacy (CIL) and CIL research: (i) it is multi- and inter-disciplinary; (ii) it has a learning lens; and (iii) it has a pluralistic approach. The CIL research agenda should be seen as practical and real – it is about real people, doing real things in real life contexts. To achieve this we must bring to gether a research community that is ready to cross boundar ies and forge relationships with other groups. In addition a coherent and structured research agenda should be established.