Formative and reflective measurement and validation mismatch in survey research : an archival analysis of information systems success constructs 1985-2007

The generic IS-success constructs first identified by DeLone and McLean (1992) continue to be widely employed in research. Yet, recent work by Petter et al (2007) has cast doubt on the validity of many mainstream constructs employed in IS research over the past 3 decades; critiquing the almost universal conceptualization and validation of these constructs as reflective when in many studies the measures appear to have been implicitly operationalized as formative. Cited examples of proper specification of the Delone and McLean constructs are few, particularly in light of their extensive employment in IS research. This paper introduces a four-stage formative construct development framework: Conceive > Operationalize > Respond > Validate (CORV). Employing the CORV framework in an archival analysis of research published in top outlets 1985-2007, the paper explores the extent of possible problems with past IS research due to potential misspecification of the four application-related success dimensions: Individual-Impact, Organizational-Impact, System-Quality and Information-Quality. Results suggest major concerns where there is a mismatch of the Respond and Validate stages. A general dearth of attention to the Operationalize and Respond stages in methodological writings is also observed.

The genesis of science education research in Australasia

Although the sciences were being taught in Australian schools well before the Second World War, the only evidence of research studies of this teaching is to be found in the report, published by ACER in 1932 of Roy Stanhope’s survey of the teaching of chemistry in New South Wales and a standardized test he had developed. Roy Stanhope was a science teacher with a research masters degree in chemistry. He had won a scholarship to go to Stanford University for doctoral studies, but returned after one year when his scholarship was not extended. He went on to be a founder in 1943 of the Australian Science Teachers Association (ASTA), which honours this remarkable pioneer through its annual Stanhope Oration. In his retirement Stanhope undertook a comparative study of science

Rephrasing voice : art, practice-led research and the limits and sites of articulacy

While my PhD is practice-led research, it is my contention that such an inquiry cannot develop as long as it tries to emulate other models of research. I assert that practice-led research needs to account for an epistemological unknown or uncertainty central to the practice of art. By focusing on what I call the artist's 'voice,' I will show how this 'voice' is comprised of a dual motivation—'articulate' representation and 'inarticulate' affect—which do not even necessarily derive from the artist. Through an analysis of art-historical precedents, critical literature (the work of Jean-François Lyotard and Andrew Benjamin, the critical methods of philosophy, phenomenology and psychoanalysis) as well as of my own painting and digital arts practice, I aim to demonstrate how this unknown or uncertain aspect of artistic inquiry can be mapped. It is my contention that practice-led research needs to address and account for this dualistic 'voice' in order to more comprehensively articulate its unique contribution to research culture.

Lifting the lifegiving dollar : case samples of creative practice in health and medical research philanthropy

This study aims to stimulate thought, debate and action for change on this question of more vigorous philanthropic funding of Australian health and medical research (HMR). It sharpens the argument with some facts and ideas about HMR funding from overseas sources. It also reports informed opinions from those working, giving and innovating in this area. It pinpoints the range of attitudes to HMR giving, both positive and negative. The study includes some aspects of Government funding as part of the equation, viewing Government as major HMR givers, with particular ability to partner, leverage and create incentives. Stimulating new philanthropy takes active outreach. The opportunity to build more dialogue between the HMR industry and the wider community is timely given the ‘licence to practice’ issues and questioned trust that applies currently somewhat both to science and to the charitable sector. This interest in improving HMR philanthropy also coincides with the launch last year by the Federal Government of Nonprofit Australia Limited (NAL), a group currently assessing infrastructure improvements to the charitable sector. History suggests no one will create this change if Research Australia does not. However, interest in change exists in various quarters. For Research Australia to successfully change the culture of Australian HMR giving, the process will drive the outcomes. Obviously stakeholder buy-in and partners will be needed and the ultimate blueprint for greater philanthropic HMR funding here will not be this document. Instead it will be the one that wears the handprint and ‘mindprint’ of the many architects and implementers interested in promoting HMR philanthropy, from philanthropists to nonprofit peaks to government policy arms. As the African proverb says, ‘If you want to go fast, go alone; but if you want to go far, go with others’.

Coordinated research support services at Queensland University of Technology, Australia

Queensland University of Technology (QUT) is a large multidisciplinary university located in Brisbane, Queensland, Australia. QUT is increasing its research focus and is developing its research support services. It has adopted a model of collaboration between the Library, High Performance Computing and Research Support (HPC) and more broadly with Information Technology Services (ITS). Research support services provided by the Library include the provision of information resources and discovery services, bibliographic management software, assistance with publishing (publishing strategies, identifying high impact journals, dealing with publishers and the peer review process), citation analysis and calculating authors’ H Index. Research data management services are being developed by the Library and HPC working in collaboration. The HPC group within ITS supports research computing infrastructure, research development and engagement activities, researcher consultation, high speed computation and data storage systems , 2D/ 3D (immersive) visualisation tools, parallelisation and optimization of research codes, statistics/ data modeling training and support (both qualitative and quantitative) and support for the university’s central Access Grid collaboration facility. Development and engagement activities include participation in research grants and papers, student supervision and internships and the sponsorship, incubation and adoption of new computing technologies for research. ITS also provides other services that support research including ICT training, research infrastructure (networking, data storage, federated access and authorization, virtualization) and corporate systems for research administration. Seminars and workshops are offered to increase awareness and uptake of new and existing services. A series of online surveys on eResearch practices and skills and a number of focus groups was conducted to better inform the development of research support services. Progress towards the provision of research support is described within the context organizational frameworks; resourcing; infrastructure; integration; collaboration; change management; engagement; awareness and skills; new services; and leadership. Challenges to be addressed include the need to redeploy existing operational resources toward new research support services, supporting a rapidly growing research profile across the university, the growing need for the use and support of IT in research programs, finding capacity to address the diverse research support needs across the disciplines, operationalising new research support services following their implementation in project mode, embedding new specialist staff roles, cross-skilling Liaison Librarians, and ensuring continued collaboration between stakeholders.

A connective model for the practice-led research exegesis : an analysis of content and structure

Since the formal recognition of practice-led research in the 1990s, many higher research degree candidates in art, design and media have submitted creative works along with an accompanying written document or ‘exegesis’ for examination. Various models for the exegesis have been proposed in university guidelines and academic texts during the past decade, and students and supervisors have experimented with its contents and structure. With a substantial number of exegeses submitted and archived, it has now become possible to move beyond proposition to empirical analysis. In this article we present the findings of a content analysis of a large, local sample of submitted exegeses. We identify the emergence of a persistent pattern in the types of content included as well as overall structure. Besides an introduction and conclusion, this pattern includes three main parts, which can be summarized as situating concepts (conceptual definitions and theories); precedents of practice (traditions and exemplars in the field); and researcher’s creative practice (the creative process, the artifacts produced and their value as research). We argue that this model combines earlier approaches to the exegesis, which oscillated between academic objectivity, by providing a contextual framework for the practice, and personal reflexivity, by providing commentary on the creative practice. But this model is more than simply a hybrid: it provides a dual orientation, which allows the researcher to both situate their creative practice within a trajectory of research and do justice to its personally invested poetics. By performing the important function of connecting the practice and creative work to a wider emergent field, the model helps to support claims for a research contribution to the field. We call it a connective model of exegesis.

A discussion of the research performance evaluation in building and construction management discipline : the journal impact factors and SCI-index journals

The trend of diminished funding, demands for greater efficiency and higher public accountability have led to a rapid expansion of interest in the bibliometric assessment of research performance of universities. A pilot research is conducted to provide a preliminary overview of the research performance of the building and construction schools or departments through the analysis of bibliometric indicators including the journal impact factor (JIF) published by Institute for Scientific Information (ISI). The suitability of bibliometric evaluation approaches as a measure of research quality in building and construction management research field is discussed.

Ways of telling : research methodology for fashion textiles design

Research methodology in the discipline of Art & Design has been a topic for much debate in the academic community. The result of such avid and ongoing discussion appears to be a disciplinary obsession with research methodologies and a culture of adopting and adapting existing methodologies from more established disciplines. This has eventuated as a means of coping with academic criticism and as an attempt to elevate Art & Design to a ‘real academic status’. Whilst this adoption has had some effect in tempering the opinion of Art & Design research from more ‘serious’ academics the practice may be concealing a deeper problem for this discipline. Namely, that knowledge transfer within creative practice, particularly in fashion textiles design practice, is largely tacit in nature and not best suited to dissemination through traditional means of academic writing and publication. ----- ----- There is an opportunity to shift the academic debate away from appropriate (or inappropriate) use of methodologies and theories to demonstrate the existence (or absence) of rigor in creative practice research. In particular, the changing paradigms for the definitions of research to support new models for research quality assessment (such as the RAE in the United Kingdom and ERA in Australia) require a re-examination of the traditions of academic writing and publication in relation to this form of research. It is now appropriate to test the limits of tacit knowledge. It has been almost half a century since Michael Polanyi wrote “we know more than we can tell” (Polanyi, 1967 p.4) at a time when the only means of ‘telling’ was through academic writing and publishing in hardcopy format. ----- ----- This paper examines the academic debate surrounding research methodologies for fashion textiles design through auto-ethnographic case study and object analysis. The author argues that, while this debate is interesting, the focus should be to ask: are there more effective ways for creative practitioner researchers to disseminate their research? The aim of this research is to examine the possibilities of developing different, more effective methods of ‘telling’ to support the transfer of tacit knowledge inherent in the discipline of Fashion Textiles Design.

Panel studies of new venture creation: a methods-focused review and suggestions for future research

Longitudinal panel studies of large, random samples of business start-ups captured at the pre-operational stage allow researchers to address core issues for entrepreneurship research, namely, the processes of creation of new business ventures as well as their antecedents and outcomes. Here, we perform a methods-orientated review of all 83 journal articles that have used this type of data set, our purpose being to assist users of current data sets as well as designers of new projects in making the best use of this innovative research approach. Our review reveals a number of methods issues that are largely particular to this type of research. We conclude that amidst exemplary contributions, much of the reviewed research has not adequately managed these methods challenges, nor has it made use of the full potential of this new research approach. Specifically, we identify and suggest remedies for context-specific and interrelated methods challenges relating to sample definition, choice of level of analysis, operationalization and conceptualization, use of longitudinal data and dealing with various types of problematic heterogeneity. In addition, we note that future research can make further strides towards full utilization of the advantages of the research approach through better matching (from either direction) between theories and the phenomena captured in the data, and by addressing some under-explored research questions for which the approach may be particularly fruitful.

The future of entrepreneurship research

In the summer of 2008, the Jönköping International Business School invited a selection of prominent (and not yet past-zenith) scholars of our field to a workshop at which they were asked to present their visions about where the future of entrepreneurship research is headed. An important inspiration for this initiative was a similar gathering in Jönköping 10 years earlier, which led to a special issue of Entrepreneurship Theory and Practice that has become one of the most cited in the history of the journal (see Davidsson, Low, &Wright, 2001). Similarly, the current special issue is based on the ideas that were first presented at the 2008 workshop, although they have since been thoroughly discussed and developed through extensive commentary and revisions.

A literature review on research methodologies of gross pollutant traps

This paper presents a comprehensive review of scientific and grey literature on gross pollutant traps (GPTs). GPTs are designed with internal screens to capture gross pollutants—organic matter and anthropogenic litter. Their application involves professional societies, research organisations, local city councils, government agencies and the stormwater industry—often in partnership. In view of this, the 113 references include unpublished manuscripts from these bodies along with scientific peer-reviewed conference papers and journal articles. The literature reviewed was organised into a matrix of six main devices and nine research areas (testing methodologies) which include: design appraisal study, field monitoring/testing, experimental flow fields, gross pollutant capture/retention characteristics, residence time calculations, hydraulic head loss, screen blockages, flow visualisations and computational fluid dynamics (CFD). When the fifty-four item matrix was analysed, twenty-eight research gaps were found in the tabulated literature. It was also found that the number of research gaps increased if only the scientific literature was considered. It is hoped, that in addition to informing the research community at QUT, this literature review will also be of use to other researchers in this field.

Enhancing research productivity of TEFL academics in China

As research has become an important indicator of TEFL academics’ overall performance in Chinese higher education institutions, it is critical that TEFL academics are able to meet the expectation of conducting research. This mixedmethod study investigated research productivity of Chinese TEFL academics and associated influences, with the ultimate objective of constructing a framework to help build their research capacity in the future. Using an initial survey, the study provided a snapshot of research productivity of 182 TEFL academics from three Chinese higher education institutions, and individual and institutional characteristics that influenced their research productivity. Using interviews and documents as the data sources, the subsequent qualitative case study of two purposively-sampled Chinese TEFL departments provided insights into Chinese TEFL academics’ perceptions about research, and individual, institutional and departmental efforts in meeting the research expectation. The findings from this study revealed that the 182 Chinese TEFL academics’ research productivity during 2004-2008 was relatively low as a whole as was the quality of their research. This study identified four influences that impacted on Chinese TEFL academics’ research productivity: TEFL disciplinary influences, institutional and departmental research environments, individual characteristics desirable for research, and TEFL academics’ perceptions about research. Drawing upon the above findings from this study, a Framework towards Enhancing Chinese TEFL Academics’ Research Productivity (FECTARP) was constructed. The FECTARP synthesised the findings from the study, and presented a framework for Chinese institutions and TEFL departments to enhance their TEFL academics’ research capacity.

Pedagogy of feedback on student academic writing : research supervisor practices for the end of the research degree candidature

All academic writing is advanced with the benefit of feedback about the writing. In the case of the academic writing genres of the research proposal and the dissertation, feedback is usually provided by the research supervisor. Given that academic writing development is a process, and in the case of the research proposal and dissertation, writing which develops over time, it seems likely that the nature of feedback on drafts written early in the candidature may be different from feedback provided by the research supervisor later in a student’s candidature. ----- ----- When a research supervisor has been reading a student’s writing over a period of time, their own familiarity with the writing generates a risk to their ability to provide critical and objective feedback. Particularly by the end of a student’s candidature, the research supervisor’s familiarity with the work may cause them to miss elements of writing improvement. ----- ----- The author, as a research supervisor, has developed a feedback grid to facilitate feedback on the final drafts of a dissertation. This feedback grid is generated by the embedded promises in the early sections of the dissertation, which are then used to audit the content of the final sections of the dissertation to ascertain whether promises made have been fulfilled. This provides a strategy for the research supervisor to step back from the work and read the dissertation with the agenda of a dissertation examiner. ----- ----- The grid is one strategy within a broader pedagogy of providing feedback on writing samples.