Formative and reflective measurement and validation mismatch in survey research : an archival analysis of information systems success constructs 1985-2007

The generic IS-success constructs first identified by DeLone and McLean (1992) continue to be widely employed in research. Yet, recent work by Petter et al (2007) has cast doubt on the validity of many mainstream constructs employed in IS research over the past 3 decades; critiquing the almost universal conceptualization and validation of these constructs as reflective when in many studies the measures appear to have been implicitly operationalized as formative. Cited examples of proper specification of the Delone and McLean constructs are few, particularly in light of their extensive employment in IS research. This paper introduces a four-stage formative construct development framework: Conceive > Operationalize > Respond > Validate (CORV). Employing the CORV framework in an archival analysis of research published in top outlets 1985-2007, the paper explores the extent of possible problems with past IS research due to potential misspecification of the four application-related success dimensions: Individual-Impact, Organizational-Impact, System-Quality and Information-Quality. Results suggest major concerns where there is a mismatch of the Respond and Validate stages. A general dearth of attention to the Operationalize and Respond stages in methodological writings is also observed.

Public awareness of ‘green’ residential property – an empirical survey based on data from New Zealand and Germany

Over the last few years more stringent environmental laws (e.g. the German “Energie¬ein-sparverordnung ENEV” - Energy Performance of Buildings Directive) and soaring energy prices has increased the need for the real estate industry to react and participate in overall energy reduction through efficient house construction and design, as well as upgrading the existing housing stock to be more energy efficient. Therefore the Property Economics Group at Queensland University of Technology in Australia and Nuertingen-Geislingen University in Germany are carrying out research in relation to sustainable housing construction and public awareness of “green” residential property. Part of this research is to gain an understanding of the level of knowledge and importance of these issues to the house buyer and to determine the importance of sustainable housing to the general public. The paper compares data from two different empirical studies; one of studies analyzes the situation in New Zealand, the other is focused on Germany.

Current rural valuation practice : a survey of valuers and agribusiness managers on farm management and sustainable rural land use

Over the past 20 years the nature of rural valuation practice has required most rural valuers to undertake studies in both agriculture (farm management) and valuation, especially if carrying out valuation work for financial institutions. The additional farm financial and management information obtained by rural valuers exceeds that level of information required to value commercial, retail and industrial by the capitalisation of net rent/profit valuation method and is very similar to the level of information required for the valuation of commercial and retail property by the Discounted Cash Flow valuation method. On this basis the valuers specialising in rural valuation practice have the necessary skills and information to value rural properties by an income valuation method, which can focus on the long term environmental and economic sustainability of the property being valued. This paper will review the results of an extensive survey carried out by rural property valuers in Australia, in relation to the impact of farm management on rural property values and sustainable rural land use. A particular focus of the research relates to the increased awareness of the problems of rural land degradation in Australia and the subsequent impact such problems have on the productivity of rural land. These problems of sustainable land use have resulted in the need to develop an approach to rural valuation practice that allows the valuer to factor the past management practices on the subject rural property into the actual valuation figure. An analysis of the past farm management and the inclusion of this data into the valuation methodology provides a much more reliable indication of farm sustainable economic value than the existing direct comparison valuation methodology.

Current rural valuation practice : a survey of NSW valuers and agribusiness managers

Despite the advances that have been made in relation to the valuation of Commercial, Industrial and retail property, there has not been the same progress in relation to the valuation of rural property. Although number of rural property valuations also require the valuer to carry out a full analysis of the economic performance of the farming operations, as well as the long term environmental viability of the farm, this information is rarely used to assess the value of the property, nor is it even used for a secondary valuation method. Over the past 20 years the nature of rural valuation practice has required most rural valuers to undertake studies in both agriculture (farm management) and valuation, especially if carrying out valuation work for financial institutions. The additional farm financial and management information obtained by rural valuers exceeds that level of information required to value commercial, retail and industrial by the capitalisation of net rent/profit valuation method and is very similar to the level of information required for the valuation of commercial and retail property by the Discounted Cash Flow valuation method. On this basis the valuers specialising in rural valuation practice have the necessary skills and information to value rural properties by an income valuation method. Although the direct comparison method of valuation has been sufficient in the past to value rural properties the future use of the method as the main valuation method is limited and valuers need to adopt an income valuation method as at least a secondary valuation method to overcome the problems associated with the use of direct comparison as the only rural property valuation method, especially in view of the impact that farm technical, financial and environmental .management can have on rural property values. This paper will review the results of an extensive survey carried out by rural property valuers and agribusiness managers in NSW, in relation to the impact of farm management on rural property values and rural property valuation practice.

When 'listeners can't talk' : comparing active listening in opening sequences of telephone and online counselling

While there is growing use of online counselling, little is known about its interactional organisation and how it compares to telephone counselling. This is despite past research suggesting that both counsellors and clients report the impact of the different modalities on the presentation and management of the counselling interaction. This paper compares the interactional affordances of telephone and online web counselling in opening sequences on Kids Help Line, a 24-hour Australian counselling service for children and young people up to the age of 25. We examine two ways that counsellors show active listening through response tokens and formulations. The analysis describes how counsellors’ use of minimal response tokens facilitate the clients’ problem presentation and are used in the management of turn taking and sequence organisation. For example, counsellors use the response token Mm hm to show that they understand that the client’s unit of talk to is not yet complete, and to affirm or invite the client to continue speaking. Formulations in phone and web counselling are another way that counsellors display active listening to re-present stretches of the clients’ preceding talk. In phone and web counselling, however, the respective modalities can complicate matters of turn transition and sequence organisation. By examining actual phone and online counselling sessions, this paper offers empirical demonstrations of the interactional affordances of phone and online counselling, and shows how the institutional practice of active listening is accomplished across different counselling modalities

Construction virtual prototyping : a survey of use

Purpose –The introduction of Building Information Model tools over the last 20 years is resulting in radical changes in the Architectural, Engineering and Construction industry. One of these changes concerns the use of Virtual Prototyping - an advanced technology integrating BIM with realistic graphical simulations. Construction Virtual Prototyping (CVP) has now been developed and implemented on ten real construction projects in Hong Kong in the past three years. This paper reports on a survey aimed at establishing the effects of adopting this new technology and obtaining recommendations for future development. Design/methodology/approach – A questionnaire survey was conducted in 2007 of 28 key participants involved in four major Hong Kong construction projects – these projects being chosen because the CVP approach was used in more than one stage in each project. In addition, several interviews were conducted with the project manager, planning manager and project engineer of an individual project. Findings –All the respondents and interviewees gave a positive response to the CVP approach, with the most useful software functions considered to be those relating to visualisation and communication. The CVP approach was thought to improve the collaboration efficiency of the main contractor and sub-contractors by approximately 30 percent, and with a concomitant 30 to 50 percent reduction in meeting time. The most important benefits of CPV in the construction planning stage are the improved accuracy of process planning and shorter planning times, while improved fieldwork instruction and reducing rework occur in the construction implementation stage. Although project teams are hesitant to attribute the use of CVP directly to any specific time savings, it was also acknowledged that the workload of project planners is decreased. Suggestions for further development of the approach include incorporation of automatic scheduling and advanced assembly study. Originality/value –Whilst the research, development and implementation of CVP is relatively new in the construction industry, it is clear from the applications and feedback to date that the approach provides considerable added value to the organisation and management of construction projects.

Unsupervised speaker adaptation for telephone call transcription

The use of the PC and Internet for placing telephone calls will present new opportunities to capture vast amounts of un-transcribed speech for a particular speaker. This paper investigates how to best exploit this data for speaker-dependent speech recognition. Supervised and unsupervised experiments in acoustic model and language model adaptation are presented. Using one hour of automatically transcribed speech per speaker with a word error rate of 36.0%, unsupervised adaptation resulted in an absolute gain of 6.3%, equivalent to 70% of the gain from the supervised case, with additional adaptation data likely to yield further improvements. LM adaptation experiments suggested that although there seems to be a small degree of speaker idiolect, adaptation to the speaker alone, without considering the topic of the conversation, is in itself unlikely to improve transcription accuracy.

The roles and importance of formal and informal sources of business support in young firms : evidence from the UK’s 2008 Federation of Small Business Survey

Objectives This research explores the relationship between young firms, their growth orientation-intention and a range of relationships which can be seen to provide business support. Prior-work Research indicates that networks impact the firm’s ability to secure resources (Sirmon and Hitt 2003; Liao and Welsch. 2004; Hanlon and Saunders 2007). Networks have been evaluated in a number of ways ranging from simple counts to characteristics of their composition (Davidsson and Honig 2003), strength of relationships (Granovetter 1973) and network diversity (Carter et al 2003). By providing access to resources and knowledge (from start-up assistance and raising capital, (e.g. Smallbone et al, 2003), networks may assist in enabling continued persistence during those times where firms may experience resource constraints owing to firm growth (Baker and Nelson 2005). Approach The data used in this research was generated in the 2008 UK Federation of Small Businesses (FSB) survey. Over 1,000 of the firms responding were found to fall into the category of “young”, ((defined as firms under 4 years old). Firms were considered the unit of analysis with the entrepreneur being the chief spokesperson for the firm. Preliminary data analysis considered key demographic characteristics and industry classifications, comparing the FSB data with that of the UK government’s own (BERR) Small Business Surveys of 2007 and 2008, to establish some degree of representativeness of the respondents. The analysis then examined networks with varying potential ability to provide support for young firms, the networks measured in terms of number, diversity, characteristic and strength in its relationship to young firm growth orientation. The diversity of business-support-related relationships ranged from friends and family, through professional services, customers and suppliers, and government business services, to trade associations and informal business networks. The characteristics of these formal and informal sources of support for new businesses are examined across a range of business support-type activities for new firms. The number of relationships and types of business support are also explored. Finally, the strength of these relationships is examined by analysis of the source of business support, type of business support, and links to the growth orientation-intention of the firm, after controlling for a number of key variables related to firm and industry status and owner characteristics. Results Preliminary analysis of the data by means of univariate analysis showed that average number of sources of advice was around 2.5 (from a potential total of 6). In terms of the diversity of relationships, universities had by far the smallest percentage of firms receiving beneficial advice from them. Government business services were beneficially used by 40% of young firms, the other relationship types being around the 50-55% mark. In terms of characteristics of the advice, the average number of areas in which benefit was achieved was around 5.5 of a maximum of 15. Start-up advice has by far the highest percentage of firms obtaining beneficial advice, with increasing sales, improving contacts and improving confidence being the other categories at or around the 50% mark. Other market-focused areas where benefits were also received were in the areas of new markets, existing product improvements and new product improvements, where around 40% of the young responding firms obtained benefit. Regression techniques evaluating the strength of these relationships in terms of the links between business support (by source of support, type of support, and range of support) and firm growth orientation-intention focus highlighted a number of significant relationships, even after controlling for a range of other explanatory variables identified in the literature. Specifically, there was found to be a positive relationship between receiving business advice generally (regardless of type or source) and growth orientation. This relationship was seen to be stronger, however, when looking at the number of types of beneficial advice received, and stronger again for the number of sources of this advice. In terms of individual sources of advice, customers and suppliers had the strongest relationship with growth, with Government business services also found to be significant. Combining these two sources was also seen to increase the strength of the relationship between these two sources of advice and growth orientation. In considering areas of support, growth was most strongly positively related to advice that benefited the development of new products and services, and also business confidence, but was negatively related to advice linked to business recovery. Finally, amalgamating the 4 key types and sources of advice to examine the impact of combinations of these types and sources of advice also improved the strength of the relationship. Implications The findings will assist in the understanding of young firms in general and growth more specifically, particularly the role and importance of specific sources, types and combinations of business support used more extensively by new young growth-oriented firms. Value This research may assist in processes designed to allow entrepreneurs to make better decisions; educators and support organizations to develop better advice and assistance, and Governments design better conditions for the creation of new growth-oriented businesses.

Prevalence and determinants of sunburn in Queensland

Issue addressed: Australia records the highest incidence of skin cancer in the world. In response to this public education campaigns have incorporated messages about reducing sun exposure and avoiding sunburn. This study sought to describe the prevalence of and factors associated with sunburn in Queensland residents. Methods: The Queensland Cancer Risk Study was a population-based, cross-sectional survey of 9,298 respondents conducted via computer-assisted telephone interview during 2004. Sunburn prevalence and its association with sociodemographics and skin cancer risk variables were examined. Results: More than two-thirds (70.4%) of respondents reported at least one episode of sunburn in the past 12 months, and one in ten respondents reported at least one episode of sever sunburn in the past 12 months. Experiences of sunburn on two or more occasions were reported more frequently by males than females (57.6% versus 46.5%, p < 0.001), and by nearly two-thirds (65.8%) of those aged 20-39 years compared to 48.0% of 40-59 year olds, and 26.7% of 60-75 year olds (p < 0.001). Episodes of sunburn were strongly associated with being male (OR=2.20 95%CI 1.84-2.63) and being aged 20 to 39 years compared to 60 to 75 years (OR=9.79, 95%CI=7.66-12.50). Conclusions: Sunburn remains highly prevalent among Queensland residents particularly among men and in the younger age groups. So what? More effective strategies and methods may be required to extend the influence of health promotion campaigns.

Measurement properties of the Australian Women's Activity Survey

Purpose: The Australian Women’s Activity Survey (AWAS) was developed based on a systematic review and qualitative research on how to measure activity patterns of women with young children (WYC). AWAS assesses activity performed across five domains (planned activities, employment, childcare, domestic responsibilities and transport), and intensity levels (sitting, light-intensity, brisk walking, moderate-intensity and vigorous-intensity) in a typical week in the past month. The purpose of this study was to assess the test-retest reliability and criterion validity of the AWAS. Methods: WYC completed the AWAS on two occasions 7-d apart (test-retest reliability protocol) and/or wore an MTI ActiGraph accelerometer for 7-d in between (validity protocol). Forty WYC (mean age 35 ± 5yrs) completed the test-retest reliability protocol and 75 WYC (mean age 33 ± 5yrs) completed the validity protocol. Interclass Correlation Coefficients (ICC) between AWAS administrations and Spearman’s Correlation Coefficients (rs) between AWAS and MTI data were calculated. Results: AWAS showed good test-retest reliability (ICC=0.80 (0.65-0.89)) and acceptable criterion validity (rs= 0.28, p=0.01) for measuring weekly health-enhancing physical activity. AWAS also provided repeatable and valid estimates of sitting time (test-retest reliability ICC=0.42 (0.13-0.64), and criterion validity (rs= 0.32, p=0.006)). Conclusion: The measurement properties of the AWAS are comparable to those reported for existing self-report measures of physical activity. However, AWAS offers a more comprehensive and flexible alternative for accurately assessing different domains and intensities of activity relevant to WYC. Future research should investigate whether the AWAS is a suitable measure of intervention efficacy by examining its sensitivity to change.

Cost-effectiveness of a telephone-delivered intervention for physical activity and diet

Background: Given escalating rates of chronic disease, broad-reach and cost-effective interventions to increase physical activity and improve dietary intake are needed. The cost-effectiveness of a Telephone Counselling intervention to improve physical activity and diet, targeting adults with established chronic diseases in a low socio-economic area of a major Australian city was examined. Methodology/Principal Findings: A cost-effectiveness modelling study using data collected between February 2005 and November 2007 from a cluster-randomised trial that compared Telephone Counselling with a “Usual Care” (brief intervention) alternative. Economic outcomes were assessed using a state-transition Markov model, which predicted the progress of participants through five health states relating to physical activity and dietary improvement, for ten years after recruitment. The costs and health benefits of Telephone Counselling, Usual Care and an existing practice (Real Control) group were compared. Telephone Counselling compared to Usual Care was not cost-effective ($78,489 per quality adjusted life year gained). However, the Usual Care group did not represent existing practice and is not a useful comparator for decision making. Comparing Telephone Counselling outcomes to existing practice (Real Control), the intervention was found to be cost-effective ($29,375 per quality adjusted life year gained). Usual Care (brief intervention) compared to existing practice (Real Control) was also cost-effective ($12,153 per quality adjusted life year gained). Conclusions/Significance: This modelling study shows that a decision to adopt a Telephone Counselling program over existing practice (Real Control) is likely to be cost-effective. Choosing the ‘Usual Care’ brief intervention over existing practice (Real Control) shows a lower cost per quality adjusted life year, but the lack of supporting evidence for efficacy or sustainability is an important consideration for decision makers. The economics of behavioural approaches to improving health must be made explicit if decision makers are to be convinced that allocating resources toward such programs is worthwhile.

Is the new age phenomenon connected to delusion-like experiences? Analysis of survey data from Australia

Recent studies have shown that delusion-like experiences (DLEs) are common among general populations. This study investigates whether the prevalence of these experiences are linked to the embracing of New Age thought. Logistic regression analyses were performed using data derived from a large community sample of young adults (N = 3777). Belief in a spiritual or higher power other than God was found to be significantly associated with endorsement of 16 of 19 items from Peters et al. (1999b) Delusional Inventory following adjustment for a range of potential confounders, while belief in God was associated with endorsement of four items. A New Age conception of the divine appears to be strongly associated with a wide range of DLEs. Further research is needed to determine a causal link between New Age philosophy and DLEs (e.g. thought disturbance, suspiciousness, and delusions of grandeur).

Differences between students and non-students’ willingness to donate to a charitable organisation

This paper reports on a comparative study of students and non-students that investigates which psycho-social factors influence intended donation behaviour within a single organisation that offers multiple forms of donation activity. Additionally, the study examines which media channels are more important to encourage donation. A self-administered survey instrumentwas used and a sample of 776 respondents recruited. Logistic regressions and a Chow test were used to determine statistically significant differences between the groups. For donatingmoney, importance of charity and attitude towards charity influence students, whereas only importance of need significantly influences non-students. For donating time, no significant influences were found for non-students, however, importance of charity and attitude towards charity were significant for students. Importance of need was significant for both students and non-students for donating goods, with importance of charity also significant for students. Telephone and television channels were important for both groups. However, Internet, email and short messaging services were more important for students, providing opportunities to enhance this group’s perceptions of the importance of the charity, and the importance of the need, which ultimately impacts on their attitudes towards the charity. These differences highlight the importance of charities focussing on those motivations and attitudes that are important to a particular target segment and communicating through appropriate media channels for these segments.

Survey research

This book aims to provide an overview of approaches to assist researchers and practitioners to explore ways of undertaking research in the information literacy field. The first chapter provides an introductory overview of research by Dr Kirsty Williamson (author of Research Methods for Students, Academics and Professionals: Information Management and Systems) and this sets the scene for the rest of the chapters where each author explores the key aspects of a specific method and explains how it may be applied in practice. The methods covered include those representing qualitative, quantitative and mixed methods. Both a chapter on the topical evidence-based practice approach, and another critiquing it, are also included. The final chapter points the way towards potential new directions for the burgeoning field