Characteristics and benefits of professional work - Assessment of their importance over a 30-year career

The Professions in Australia Study is the first longitudinal investigation of the professions in Australia; it spans 33 years. Self-administered questionnaires were distributed on at least eight occasions between 1965 and 1998 to cohorts of students and later practitioners from the professions of engineering, law and medicine. The longitudinal design of this study has allowed for an investigation of individual change over time of three archetypal characteristics of the professions, service, knowledge and autonomy and two of the benefits of professional work, financial rewards and prestige. A cumulative logit random effects model was used to statistically assess changes in the ordinal response scores for measuring importance of the characteristics and benefits through stages of the career path. Individuals were also classified by average trends in response scores over time and hence professions are described through their members' tendency to follow a particular path in attitudes either of change or constancy, in relation to the importance of the five elements (characteristics and benefits). Comparisons in trends are also made between the three professions.

Evaluation of NHMRC funded research completed in 1992, 1997 and 2003: gains in knowledge, health and wealth

Objective: To report on strategies for, and outcomes of, evaluation of knowledge (publications), health and wealth (commercial) gains from medical research funded by the Australian Government through the National Health and Medical Research Council (NHMRC). Design and methods: End-of-grant reports submitted by researchers within 6 months of completion of NHMRC funded project grants which terminated in 2003 were used to capture self-reported publication number, health and wealth gains. Self-reported gains were also examined in retrospective surveys of grants completed in 1992 and 1997 and awards primarily supporting people (“people awards”) held between 1992 and 2002. Results: The response rate for the 1992 sample was too low for meaningful analysis. The mean number of publications per grant in the basic biomedical, clinical and health services research areas was very similar in 1997 and 2003. The publication output for population health was somewhat higher in the 2003 than in the 1997 analysis. For grants completed in 1997, 24% (31/131) affected clinical practice; 14% (18/131) public health practice; 9% (12/131) health policy; and 41% (54/131) had commercial potential with 20% (26/131) resulting in patents. Most respondents (89%) agreed that NHMRC people awards improved their career prospects. Interpretation is limited by the relatively low response rates (50% or less). Conclusions: A mechanism has been developed for ongoing assessment of NHMRC funded research. This process will improve accountability to the community and to government, and refine current funding mechanisms to most efficiently deliver health and economic returns for Australia.

Science-policy in environmental and health risk assessment: if we cannot do without, can we do better?

How can empirical evidence of adverse effects from exposure to noxious agents, which is often incomplete and uncertain, be used most appropriately to protect human health? We examine several important questions on the best uses of empirical evidence in regulatory risk management decision-making raised by the US Environmental Protection Agency (EPA)'s science-policy concerning uncertainty and variability in human health risk assessment. In our view, the US EPA (and other agencies that have adopted similar views of risk management) can often improve decision-making by decreasing reliance on default values and assumptions, particularly when causation is uncertain. This can be achieved by more fully exploiting decision-theoretic methods and criteria that explicitly account for uncertain, possibly conflicting scientific beliefs and that can be fully studied by advocates and adversaries of a policy choice, in administrative decision-making involving risk assessment. The substitution of decision-theoretic frameworks for default assumption-driven policies also allows stakeholder attitudes toward risk to be incorporated into policy debates, so that the public and risk managers can more explicitly identify the roles of risk-aversion or other attitudes toward risk and uncertainty in policy recommendations. Decision theory provides a sound scientific way explicitly to account for new knowledge and its effects on eventual policy choices. Although these improvements can complicate regulatory analyses, simplifying default assumptions can create substantial costs to society and can prematurely cut off consideration of new scientific insights (e.g., possible beneficial health effects from exposure to sufficiently low 'hormetic' doses of some agents). In many cases, the administrative burden of applying decision-analytic methods is likely to be more than offset by improved effectiveness of regulations in achieving desired goals. Because many foreign jurisdictions adopt US EPA reasoning and methods of risk analysis, it may be especially valuable to incorporate decision-theoretic principles that transcend local differences among jurisdictions.

Managing knowledge in tourism planning: How to assess your capability

This paper explores the theme of strategic planning in a State Tourism Organization (STO) from a knowledge management perspective. It highlights the value of knowledge in strategy making and the importance of an organisation's knowledge management agenda in facilitating a strategic planning process. In particular, it considers the capability of an STO to implement knowledge management as the key to a successful strategic planning exercise. In order to develop greater insight into the factors that impact on planning competence, the key aim of this paper is to develop a framework on which the capability of a STO to implement a knowledge-based agenda in strategic planning can be assessed. Research on knowledge management in the field of tourism is limited and there is little practical account of the application of knowledge management principles in tourism planning. Further, there is no apparent tool or instrument that allows for the assessment of an STO's capability to implement knowledge management in planning initiatives. Based on a literature review, a three-point framework of assessment is developed. The three elements of the framework are identified as: 1. Integration of knowledge management objectives with strategic imperatives; 2. A planning approach that balances top-down (outcome focused) with bottom-up (process focused) planning processes; and 3. Organisational capacity, including leadership, people and culture, process, technology, content and continuous improvement. The framework is tested through application to a practical case study - a planning initiative undertaken by a leading tourism STO in Australia. The results demonstrate that the framework is a useful means to evaluate organisational capability in knowledge-led strategic planning exercises and would be of practical value as a point of reference for future knowledge- based strategic planning projects. Copyright © by The Haworth Press, Inc. All rights reserved.

Social epistemology: A journal of knowledge, culture and policy

Provides a forum for philosophical and social scientific enquiry that incorporates the work of scholars from a variety of disciplines who share a concern with the production, assessment and validation of knowledge.

The graying of R&D workgroups: The effects of age diversity on developing publicly usable knowledge

Does the graying of scientific research teams matter? This study addresses how workgroup processes and external environmental factors contribute and inhibit the effect of age diversity in R&D project groups on the production of innovative publicly usable knowledge outcomes in the form of publication outputs. We examined the relationships between group age diversity (age cohort diversity, mean age, age dispersion), R&D workgroup member self-ratings of workgroup processes, their supervisor�s assessment of the external environmental factors the project groups faced, and their supervisor�s ratings of group performance, the number of scientific publicly available publications produced by the group and the use of multiple authorships on publications. Usable data was obtained from 32 R&D workgroups of a large Government Agricultural Research and Development Agency. Consistent with the literature, workgroup processes and external environmental factors were found to directly effect innovation outcomes. Contrary to expectation, but consistent with Social Identity theory, workgroup age diversity generally negatively impacted upon innovation outcomes. An exception was where multiple authorship on publications for project groups increased as the dispersion of age within groups increased. Importantly, workgroups that were both more age homogeneous and perceived to have optimally functioning work processes produced more R&D innovation outcomes than other groups. Generally, these differences appear to be related to the greater division of labor practices (and less multi-tasking) employed by the older and more homogeneous workgroups. Implications for R&D workgroup resource theory and practices are discussed.

'Worldmarks': Web guidelines for socially and culturally responsive assessment in university classrooms

In the early 21st century, we need to prepare university students to navigate local and global cultures effectively and sensitively. These future professionals must develop comprehensive intercultural communication skills and understanding. Yet university assessment in Australia is often based on a western template of knowledge, which automatically places International, Indigenous, as well as certain groups of local students at a study disadvantage. It also ensures that Australian students from dominant groups are not given the opportunity to develop these vital intercultural skills. This paper explores the issues embedded in themes 1 and 4 of this conference and provides details of an innovative website developed at Queensland University of Technology in Brisbane, Australia, which encourages academic staff to investigate the hidden assumptions that can underpin their assessment practices. The website also suggests strategies academics can use to ensure that their assessment becomes more socially and culturally responsive.

An expert system for the development of a health and safety policy/risk assessment in the plastics industry

Health and safety policies may be regarded as the cornerstone for positive prevention of occupational accidents and diseases. The Health and Safety at Work, etc Act 1974 makes it a legal duty for employers to prepare and revise a written statement of a general policy with respect to the health and safety at work of employees as well as the organisation and arrangements for carrying out that policy. Despite their importance and the legal equipment to prepare them, health and safety policies have been found, in a large number of plastics processing companies (particularly small companies), to be poorly prepared, inadequately implemented and monitored. An important cause of these inadequacies is the lack of necessary health and safety knowledge and expertise to prepare, implement and monitor policies. One possible way of remedying this problem is to investigate the feasibility of using computers to develop expert system programs to simulate the health and safety (HS) experts' task of preparing the policies and assisting companies implement and monitor them. Such programs use artificial intelligence (AI) techniques to solve this sort of problems which are heuristic in nature and require symbolic reasoning. Expert systems have been used successfully in a variety of fields such as medicine and engineering. An important phase in the feasibility of development of such systems is the engineering of knowledge which consists of identifying the knowledge required, eliciting, structuring and representing it in an appropriate computer programming language.

An assessment of factors affecting performance and growth of new technology based firms in the UK

New Technology Based Firms (NTBF) are considered to be important for the economic development of a country in regards to both employment growth and innovative activity. The latter is believed to contribute significantly to the increase in productivity and therefore the competitiveness of UK’s economy. This study contributes to the above literature by investigating two of the factors believed to limit the growth of such firms in the UK. The first concerns the existence of a ‘knowledge gap’ while the second the existence of a ‘financial gap’. These themes are developed along three main research lines. Firstly, based upon the human capital theory initially proposed by Backer (1964) new evidence is provided on the human capital characteristics (experience and education) of the current UK NTBF entrepreneurs. Secondly, the causal relationship between general and specific human capital (as well as their interactions) upon the company performance and growth is investigated via its traditional direct effect as well as via its indirect effect upon the access to external finance. Finally, more light is shed on the financial structure and the type of financial constraints that high-tech firms face at start-up. In particular, whether a financial gap exists is explored by distinguishing between the demand and the supply of external finance as well as by type of external source of financing. The empirical testing of the various research hypotheses has been obtained by carrying out an original survey of new technology based firms defined as independent companies, established in the past 25 years in R&D intensive sectors. The resulting dataset contains information for 412 companies on a number of general company characteristics and the characteristics of their entrepreneurs in 2004. Policy and practical implications for future and current entrepreneurs and also providers of external finance are provided.

Assessment of the impact of discharges from surface water sewers on receiving water quality

A broad based approach has been used to assess the impact of discharges to rivers from surface water sewers, with the primary objective of determining whether such discharges have a measurable impact on water quality. Three parameters, each reflecting the effects of intermittent pollution, were included in a field work programme of biological and chemical sampling and analysis which covered 47 sewer outfall sites. These parameters were the numbers and types of benthic macroinvertebrates upstream and downstream of the outfalls, the concentrations of metals in sediments, and the concentrations of metals in algae upstream and downstream of the outfalls. Information on the sewered catchments was collected from Local Authorities and by observation of the time of sampling, and includes catchment areas, land uses, evidence of connection to the foul system, and receiving water quality classification. The methods used for site selection, sampling, laboratory analysis and data analysis are fully described, and the survey results presented. Statistical and graphical analysis of the biological data, with the aid of BMWP scores, showed that there was a small but persistent fall in water quality downstream of the studied outfalls. Further analysis including the catchment information indicated that initial water quality, sewered catchment size, receiving stream size, and catchment land use were important factors in determining the impact. Finally, the survey results were used to produce guidelines for the estimation of surface water sewer discharge impacts from knowledge of the catchment characteristics, so that planning authorities can consider water quality when new drainage systems are designed.

User interface design support for the development of knowledge-based systems

The present scarcity of operational knowledge-based systems (KBS) has been attributed, in part, to an inadequate consideration shown to user interface design during development. From a human factors perspective the problem has stemmed from an overall lack of user-centred design principles. Consequently the integration of human factors principles and techniques is seen as a necessary and important precursor to ensuring the implementation of KBS which are useful to, and usable by, the end-users for whom they are intended. Focussing upon KBS work taking place within commercial and industrial environments, this research set out to assess both the extent to which human factors support was presently being utilised within development, and the future path for human factors integration. The assessment consisted of interviews conducted with a number of commercial and industrial organisations involved in KBS development; and a set of three detailed case studies of individual KBS projects. Two of the studies were carried out within a collaborative Alvey project, involving the Interdisciplinary Higher Degrees Scheme (IHD) at the University of Aston in Birmingham, BIS Applied Systems Ltd (BIS), and the British Steel Corporation. This project, which had provided the initial basis and funding for the research, was concerned with the application of KBS to the design of commercial data processing (DP) systems. The third study stemmed from involvement on a KBS project being carried out by the Technology Division of the Trustees Saving Bank Group plc. The preliminary research highlighted poor human factors integration. In particular, there was a lack of early consideration of end-user requirements definition and user-centred evaluation. Instead concentration was given to the construction of the knowledge base and prototype evaluation with the expert(s). In response to this identified problem, a set of methods was developed that was aimed at encouraging developers to consider user interface requirements early on in a project. These methods were then applied in the two further projects, and their uptake within the overall development process was monitored. Experience from the two studies demonstrated that early consideration of user interface requirements was both feasible, and instructive for guiding future development work. In particular, it was shown a user interface prototype could be used as a basis for capturing requirements at the functional (task) level, and at the interface dialogue level. Extrapolating from this experience, a KBS life-cycle model is proposed which incorporates user interface design (and within that, user evaluation) as a largely parallel, rather than subsequent, activity to knowledge base construction. Further to this, there is a discussion of several key elements which can be seen as inhibiting the integration of human factors within KBS development. These elements stem from characteristics of present KBS development practice; from constraints within the commercial and industrial development environments; and from the state of existing human factors support.

Substances hazardous to health:the nature of the expertise associated with competent risk assessment

This research investigated expertise in hazardous substance risk assessment (HSRA). Competent pro-active risk assessment is needed to prevent occupational ill-health caused by hazardous substance exposure occurring in the future. In recent years there has been a strong demand for HSRA expertise and a shortage of expert practitioners. The discipline of Occupational Hygiene was identified as the key repository of knowledge and skills for HSRA and one objective of this research was to develop a method to elicit this expertise from experienced occupational hygienists. In the study of generic expertise, many methods of knowledge elicitation (KE) have been investigated, since this has been relevant to the development of 'expert systems' (thinking computers). Here, knowledge needed to be elicited from human experts, and this stage was often a bottleneck in system development, since experts could not explain the basis of their expertise. At an intermediate stage, information collected was used to structure a basic model of hazardous substance risk assessment activity (HSRA Model B) and this formed the basis of tape transcript analysis in the main study with derivation of a 'classification' and a 'performance matrix'. The study aimed to elicit the expertise of occupational hygienists and compare their performance with other health and safety professionals (occupational health physicians, occupational health nurses, health and safety practitioners and trainee health and safety inspectors), as evaluated using the matrix. As a group, the hygienists performed best in the exercise, and this group were particularly good at process elicitation and at recommending specific control measures, although the other groups also performed well in selected aspects of the matrix and the work provided useful findings and insights. From the research, two models of HSRA have been derived, an HSRA aid, together with a novel videotape KE technique and interesting research findings. The implications of this are discussed with respect to future training of HS professionals and wider application of the videotape KE method.

Cues and knowledge structures used by mental-health professionals when making risk assessments

Background: Research into mental-health risks has tended to focus on epidemiological approaches and to consider pieces of evidence in isolation. Less is known about the particular factors and their patterns of occurrence that influence clinicians’ risk judgements in practice. Aims: To identify the cues used by clinicians to make risk judgements and to explore how these combine within clinicians’ psychological representations of suicide, self-harm, self-neglect, and harm to others. Method: Content analysis was applied to semi-structured interviews conducted with 46 practitioners from various mental-health disciplines, using mind maps to represent the hierarchical relationships of data and concepts. Results: Strong consensus between experts meant their knowledge could be integrated into a single hierarchical structure for each risk. This revealed contrasting emphases between data and concepts underpinning risks, including: reflection and forethought for suicide; motivation for self-harm; situation and context for harm to others; and current presentation for self-neglect. Conclusions: Analysis of experts’ risk-assessment knowledge identified influential cues and their relationships to risks. It can inform development of valid risk-screening decision support systems that combine actuarial evidence with clinical expertise.

A method for automatically eliciting node weights in a hierarchical knowledge-based structure for reasoning with uncertainty

Hierarchical knowledge structures are frequently used within clinical decision support systems as part of the model for generating intelligent advice. The nodes in the hierarchy inevitably have varying influence on the decisionmaking processes, which needs to be reflected by parameters. If the model has been elicited from human experts, it is not feasible to ask them to estimate the parameters because there will be so many in even moderately-sized structures. This paper describes how the parameters could be obtained from data instead, using only a small number of cases. The original method [1] is applied to a particular web-based clinical decision support system called GRiST, which uses its hierarchical knowledge to quantify the risks associated with mental-health problems. The knowledge was elicited from multidisciplinary mental-health practitioners but the tree has several thousand nodes, all requiring an estimation of their relative influence on the assessment process. The method described in the paper shows how they can be obtained from about 200 cases instead. It greatly reduces the experts’ elicitation tasks and has the potential for being generalised to similar knowledge-engineering domains where relative weightings of node siblings are part of the parameter space.