Importance of literature profiling: An archival analysis with illustrative examples for IS researchers

The importance of a thorough and systematic literature review has long been recognised across academic domains as critical to the foundation of new knowledge and theory evolution. Driven by an exponentially growing body of knowledge in the IS discipline, there has been a recent influx of guidance on how to conduct a literature review. As literature reviews are emerging as a standalone research method in itself, increasingly these method focused guidelines are of great interest, receiving acceptance at top tier IS publication outlets. Nevertheless, the finer details which offer justification for the selected content, and the effective presentation of supporting data has not been widely discussed in these method papers to date. This paper addresses this gap by exploring the concept of ‘literature profiling’ while arguing that it is a key aspect of a comprehensive literature review. The study establishes the importance of profiling for managing aspects such as quality assurance, transparency and the mitigation of selection bias. And then discusses how profiling can provide a valid basis for data analysis based on the attributes of selected literature. In essence, this study has conducted an archival analysis of literature (predominately from the IS domain) to present its main argument; the value for literature profiling, with supporting exemplary illustrations.

A randomized trial of fellowships for early career researchers finds a high reliability in funding decisions

Objectives Funding for early career researchers in Australia's largest medical research funding scheme is determined by a competitive peer-review process using a panel of four reviewers. The purpose of this experiment was to appraise the reliability of funding by duplicating applications that were considered by separate grant review panels. Study Design and Methods Sixty duplicate applications were considered by two independent grant review panels that were awarding funding for Australia's National Health and Medical Research Council. Panel members were blinded to which applications were included in the experiment and to whether it was the original or duplicate application. Scores were compared across panels using Bland–Altman plots to determine measures of agreement, including whether agreement would have impacted on actual funding. Results Twenty-three percent of the applicants were funded by both panels and 60 percent were not funded by both, giving an overall agreement of 83 percent [95% confidence interval (CI): 73%, 92%]. The chance-adjusted agreement was 0.75 (95% CI: 0.58, 0.92). Conclusion There was a comparatively high level of agreement when compared with other types of funding schemes. Further experimental research could be used to determine if this higher agreement is due to nature of the application, the composition of the assessment panel, or the characteristics of the applicants.

The impact of a streamlined funding application process on application time: Two cross-sectional surveys of Australian researchers

Objective: To examine if streamlining a medical research funding application process saved time for applicants. Design: Cross-sectional surveys before and after the streamlining. Setting: The National Health and Medical Research Council (NHMRC) of Australia. Participants: Researchers who submitted one or more NHMRC Project Grant applications in 2012 or 2014. Main outcome measures: Average researcher time spent preparing an application and the total time for all applications in working days. Results: The average time per application increased from 34 working days before streamlining (95% CI 33 to 35) to 38 working days after streamlining (95% CI 37 to 39; mean difference 4 days, bootstrap p value <0.001). The estimated total time spent by all researchers on applications after streamlining was 614 working years, a 67-year increase from before streamlining. Conclusions: Streamlined applications were shorter but took longer to prepare on average. Researchers may be allocating a fixed amount of time to preparing funding applications based on their expected return, or may be increasing their time in response to increased competition. Many potentially productive years of researcher time are still being lost to preparing failed applications.

Parents as co-researchers at home: Using an observational method to document young children’s use of technology

This paper discusses the use of observational video recordings to document young children’s use of technology in their homes. Although observational research practices have been used for decades, often with video-based techniques, the participant group in this study (i.e., very young children) and the setting (i.e., private homes), provide a rich space for exploring the benefits and limitations of qualitative observation. The data gathered in this study point to a number of key decisions and issues that researchers must face in designing observational research, particularly where non-researchers (in this case, parents) act as surrogates for the researcher at the data collection stage. The involvement of parents and children as research videographers in the home resulted in very rich and detailed data about children’s use of technology in their daily lives. However, limitations noted in the dataset (e.g., image quality) provide important guidance for researchers developing projects using similar methods in future. The paper provides recommendations for future observational designs in similar settings and/or with similar participant groups.

The open access advantage for researchers: Reflections on experience and challenges

This paper focuses on the advantages of Open Access, (OA) particularly from the point of view of individual researchers, research centres and disciplines, and institutions. The advantage described by the phrase “OA advantage”, is multifaceted. The experience of Queensland University of Technology in Australia in pioneering OA as preferred practice in an institution with a growing research profile and energy, has seen evidence of the OA advantage develop in the experience of our researchers. The University has witnessed the development of practical evidence about improved recognition and impact, and this has occurred in the context of sector wide activity and policy where fresh approaches and leadership will result in even greater rewards for researchers whose outputs are “in the open”.

Capacity building of early career researchers through cross-institutional mentoring

Most early career researchers in the first five years following doctoral qualification are faced with research challenges and opportunities, which necessitate the ability to navigate and overcome barriers, and to identify and benefit from possibilities. In this chapter, the authors outline an intentional mentoring initiative aimed at building the capacity of early career researchers within the Excellence in Research in Early Years Education Collaborative Research Network (CRN) in Australia. The initiative involved partnering early career researchers with experienced researchers and the inclusion of an early career representative on the network planning committee. The chapter discusses the many benefits for the mentee arising from the initiative including increased publication, momentum and confidence, as well as exposure to new methodologies, theoretical frameworks, and productive collaborative partnerships. It is hoped, however, that the findings will be of relevance to similar and diverse (funded/unfunded) research programs and collaborative networks wherever mentoring is applied as a capacity building strategy to assist researchers.

Complimentary collaborations: Teachers and researchers co-developing best practices in art education

Australia is currently experiencing a huge cultural shift as it moves from a State-based curriculum, to a national education system. The Australian State-based bodies that currently manage teacher registration, teacher education course accreditation, curriculum frameworks and syllabi are often complex organisations that hold conflicting ideologies about education and teaching. The development of a centralised system, complete with a single accreditation body and a national curriculum can be seen as a reaction to this complexity. At the time of writing, the Australian Curriculum is being rolled out in staggered phases across the states and territories of Australia. Phase one has been implemented, introducing English, Mathematics, History and Science. Subsequent phases (Humanities and Social Sciences, the Arts, Technologies, Health and Physical Education, Languages, and year 9-10 work studies) are intended to follow. Forcing an educational shift of this magnitude is no simple task; not least because the States and Territories have and continue to demonstrate varying levels of resistance to winding down their own curricula in favour of new content with its unfamiliar expectations and organisations. The full implementation process is currently far from over, and far from being fully resolved. The Federal Government has initiated a number of strategies to progress the implementation, such as the development of the Australian Institute for Teaching and School Leadership (AITSL) to aid professional educators to implement the new curriculum. AITSL worked with professional and peak specialist bodies to develop Illustrations of Practice (hereafter IoP) for teachers to access and utilise. This paper tells of the building of one IoP, where a graduate teacher and a university lecturer collaborated to construct ideas and strategies to deliver visual arts lessons to early childhood students in a low Socio- Economic Status [SES] regional setting and discusses the experience in terms of its potential for professional learning in art education.

How do Researchers Find and Retrieve Scientific Publications – A Case study of the Impact of the Internet on the Construction IT and Construction Management Research Communities

The World Wide Web provides the opportunity for a radically changed and much more efficient communication process for scientific results. A survey in the closely related domains of construction information technology and construction management was conducted in February 2000, aimed at measuring to what extent these opportunities are already changing the scientific information exchange and how researchers feel about the changes. The paper presents the results based on 236 replies to an extensive Web based questionnaire. 65% of the respondents stated their primary research interest as IT in A/E/C and 20% as construction management and economics. The questions dealt with how researchers find, access and read different sources; how much and what publications they read; how often and to which conferences they travel; how much they publish, and what are the criteria for where they eventually decide to publish. Some of the questions confronted traditional and electronic publishing with one final section dedicated to opinions about electronic publishing. According to the survey researchers already download half of the material that they read digitally from the Web. The most popular method for retrieving an interesting publication is downloading it for free from the author’s or publisher’s website. Researchers are not particularly willing to pay for electronic scientific publications. There is much support for a scenario of electronic journals available totally freely on the Web, where the costs could be covered by for instance professional societies or the publishing university. The shift that the Web is causing seems to be towards the "just in time" reading of literature. Also, frequent users of the Web rely less on scientific publications and tend to read fewer articles. If available with little effort, papers published in traditional journals are preferred; if not, the papers should be on the Web. In these circumstances, the role of paper-based journals published by established publishers is shifting from the core "information exchange" to the building of authors' prestige. The respondents feel they should build up their reputations by publishing in journals and relevant conferences, but then make their work freely available on the Web.

Connecting researchers and research

Libraries have long held an established role in the scholarly research process; however the process of scholarly communication is evolving. Citation management software, institutional repositories, open access and open data mandates have opened up new opportunities and new challenges. Researchers have more responsibility for managing their work, but less time to do it. Libraries are struggling to remain an active part of the scholarly communication process. It has become increasingly difficult for institutions to identify their scholarly output. This presentation will show how MBLWHOI is attempting to meet this challenge with the implementation of, Bibapp, an open source tool to manage campus research.

Measuring ICLARM's impact on research and researchers

For a research organization such as ICLARM which carries out long-term basic research, justifying money spent can be a difficult exercise. This articles examines different ways by which impact of ICLARM research can be measured.