Performance Information and Innovation in the Canadian Government (Working Paper 43)

The presentation made at the conference addressed the issue of linkages between performance information and innovation within the Canadian federal government1. This is a three‐part paper prepared as background to that presentation. • Part I provides an overview of three main sources of performance information - results-based systems, program evaluation, and centrally driven review exercises – and reviews the Canadian experience with them. • Part II identifies and discusses a number of innovation issues that are common to the literature reviewed for this paper. • Part III examines actual and potential linkages between innovation and performance information. This section suggests that innovation in the Canadian federal government tends to cluster into two groups: smaller initiatives driven by staff or middle management; and much larger projects involving major programs, whole departments or whole-of-government. Readily available data on smaller innovation projects is skimpy but suggests that performance information does not play a major role in stimulating these initiatives. In contrast, two of the examples of large-scale innovation show that performance information plays a critical role at all stages. The paper concludes by supporting the contention of others writing on this topic: that more research is needed on innovation, particularly on its link to performance information. In that context, other conclusions drawn in this paper are tentative but suggest that the quality of performance information is as important for innovation as it is for performance management. However, innovation is likely to require its own particular performance information that may not be generated on a routine basis for purposes of performance management, particularly in the early stages of innovation. And, while the availability of performance information can be an important success factor in innovation, it does not stand alone. The commonality of a number of other factors identified in the literature surveyed for this paper strongly suggests that equal if not greater priority needs to be given to attenuating factors that inhibit innovation and to nurturing incentives.

Building Information Modelling in UK Construction Projects: A State of the Art Review

This paper aims to present a state-of-the-art review of the scope and practical implications of the Building Information Modelling (BIM) platform in the UK construction practice. Theoretical developments suggest that BIM is an integration of both product and process innovation, not just a disparate set of software tools. BIM provides effective collaboration, visual representation and data management, which enable the smooth flow of information throughout the project’s lifecycle. The most frequently reported benefits are related to Capital Cost (capex) and Operational costs (opex) and time savings. Key challenges, however, focus on the interoperability of software, capital installation costs, in-house experience, client preference and cultural issues within design teams and within the organisation. The paper concludes with a critical commentary on the changing roles and a process required to implement BIM in UK construction projects, and suggests areas for further research.

Exploring Auditors’ Perceptions of the Usage and Importance of Audit Information Technology

This study provides novel evidence on the extent to which auditors perceive the usage and importance of audit technology in an emerging market. It explores the types of audit technology tools used and factors influencing the use of these; it tests the association between the perceived use and importance of the tools and firm-specific/ auditor-specific characteristics. Using interviews and questionnaires from auditors at Big 4 and international non-Big 4 audit firms, the findings reflect the highly perceived importance of using audit technology in technical and administrative procedures, specifically to assess risk. We find that the perceived use and importance of audit technology is relatively higher for those in Big 4 firms, with less years of auditor experience and higher auditor technology expertise, and those in management positions. The results provide policy makers with guidance on the opportunities and challenges of using information technology in the audit process.

The day surgery experience from a service users perspective

Although health policy would suggest that day surgery is the best service for patients undergoing a surgical procedure, it is important to consider the patient and whether this type of service is what they want. This information can be generated through a service evaluation with the results used to inform local decision-making, changes to care delivery and improvements in patient care. This article describes the results of a service evaluation performed in a single-site day surgery unit.

The influence of genotype information on psychiatrists' treatment recommendations: more experienced clinicians know better what to ignore

Objectives: To assess if psychiatrists were influenced by a patient’s genetic information, even when the patient’s response to treatment was already known to them. Methods: Sixty-seven psychiatrists were presented with patients' pre and post-treatment scores on the PANSS for two hypothetical treatments for schizophrenia. Psychiatrists were also informed whether the patient possessed a genotype linked to hyper-responsiveness to one of the treatments, and were asked to recommend one of these two treatments. Attribute non-attendance assessed whether the information on genotype influenced psychiatrists' treatment recommendations. Results: Years of experience predicted whether psychiatrists were influenced by the genetic information. Psychiatrists with one year or less of experience had a 46% probability of considering genetic information, while psychiatrists with at least 15 years of experience had a lower probability (7%). Conclusions: Psychiatrists and other clinicians should be cautious about allowing a patient's genetic information to carry unnecessary weight in their clinical decision making.

Developing a Theory of Pervasive Information Capture, Processing, Visualization and Documentation

Developing a theoretical framework for pervasive information environments is an enormous goal. This paper aims to provide a small step towards such a goal. The following pages report on our initial investigations to devise a framework that will continue to support locative, experiential and evaluative data from ‘user feedback’ in an increasingly pervasive information environment. We loosely attempt to outline this framework by developing a methodology capable of moving from rapid-deployment of software and hardware technologies, towards a goal of realistic immersive experience of pervasive information. We propose various technical solutions and address a range of problems such as; information capture through a novel model of sensing, processing, visualization and cognition.

Improving Patients’ Experience and Outcome of Total Joint Replacement: the RESTORE Programme

BACKGROUND: Total hip replacements (THRs) and total knee replacements (TKRs) are common elective procedures. In the REsearch STudies into the ORthopaedic Experience (RESTORE) programme, we explored the care and experiences of patients with osteoarthritis after being listed for THR and TKR up to the time when an optimal outcome should be expected. OBJECTIVE: To undertake a programme of research studies to work towards improving patient outcomes after THR and TKR. METHODS: We used methodologies appropriate to research questions: systematic reviews, qualitative studies, randomised controlled trials (RCTs), feasibility studies, cohort studies and a survey. Research was supported by patient and public involvement. RESULTS: Systematic review of longitudinal studies showed that moderate to severe long-term pain affects about 7–23% of patients after THR and 10–34% after TKR. In our cohort study, 10% of patients with hip replacement and 30% with knee replacement showed no clinically or statistically significant functional improvement. In our review of pain assessment few research studies used measures to capture the incidence, character and impact of long-term pain. Qualitative studies highlighted the importance of support by health and social professionals for patients at different stages of the joint replacement pathway. Our review of longitudinal studies suggested that patients with poorer psychological health, physical function or pain before surgery had poorer long-term outcomes and may benefit from pre-surgical interventions. However, uptake of a pre-operative pain management intervention was low. Although evidence relating to patient outcomes was limited, comorbidities are common and may lead to an increased risk of adverse events, suggesting the possible value of optimising pre-operative management. The evidence base on clinical effectiveness of pre-surgical interventions, occupational therapy and physiotherapy-based rehabilitation relied on small RCTs but suggested short-term benefit. Our feasibility studies showed that definitive trials of occupational therapy before surgery and post-discharge group-based physiotherapy exercise are feasible and acceptable to patients. Randomised trial results and systematic review suggest that patients with THR should receive local anaesthetic infiltration for the management of long-term pain, but in patients receiving TKR it may not provide additional benefit to femoral nerve block. From a NHS and Personal Social Services perspective, local anaesthetic infiltration was a cost-effective treatment in primary THR. In qualitative interviews, patients and health-care professionals recognised the importance of participating in the RCTs. To support future interventions and their evaluation, we conducted a study comparing outcome measures and analysed the RCTs as cohort studies. Analyses highlighted the importance of different methods in treating and assessing hip and knee osteoarthritis. There was an inverse association between radiographic severity of osteoarthritis and pain and function in patients waiting for TKR but no association in THR. Different pain characteristics predicted long-term pain in THR and TKR. Outcomes after joint replacement should be assessed with a patient-reported outcome and a functional test. CONCLUSIONS: The RESTORE programme provides important information to guide the development of interventions to improve long-term outcomes for patients with osteoarthritis receiving THR and TKR. Issues relating to their evaluation and the assessment of patient outcomes are highlighted. Potential interventions at key times in the patient pathway were identified and deserve further study, ultimately in the context of a complex intervention.

Early stage memory loss interventions: utilization, impact, and the experience of living alone.

Thesis (Ph.D.)--University of Washington, 2016-08

Information and communication technology demands at work : the association with job strain, effort-reward imbalance and self-rated health in different socio-economic strata

PURPOSE: The use of information and communication technology (ICT) is common in modern working life. ICT demands may give rise to experience of work-related stress. Knowledge about ICT demands in relation to other types of work-related stress and to self-rated health is limited. Consequently, the aim of this study was to examine the association between ICT demands and two types of work-related stress [job strain and effort-reward imbalance (ERI)] and to evaluate the association between these work-related stress measures and self-rated health, in general and in different SES strata. METHODS: This study is based on cross-sectional data from the Swedish Longitudinal Occupational Survey of Health collected in 2014, from 14,873 gainfully employed people. ICT demands, job strain, ERI and self-rated health were analysed as the main measures. Sex, age, SES, lifestyle factors and BMI were used as covariates. RESULTS: ICT demands correlated significantly with the dimensions of the job strain and ERI models, especially with the demands (r = 0.42; p < 0.01) and effort (r = 0.51; p < 0.01) dimensions. ICT demands were associated with suboptimal self-rated health, also after adjustment for age, sex, SES, lifestyle and BMI (OR 1.49 [95 % CI 1.36-1.63]), but job strain (OR 1.93 [95 % CI 1.74-2.14) and ERI (OR 2.15 [95 % CI 1.95-2.35]) showed somewhat stronger associations with suboptimal self-rated health. CONCLUSION: ICT demands are common among people with intermediate and high SES and associated with job strain, ERI and suboptimal self-rated health. ICT demands should thus be acknowledged as a potential stressor of work-related stress in modern working life.

Assisting digital forensic analysis via exploratory information visualisation

Background: Digital forensics is a rapidly expanding field, due to the continuing advances in computer technology and increases in data stage capabilities of devices. However, the tools supporting digital forensics investigations have not kept pace with this evolution, often leaving the investigator to analyse large volumes of textual data and rely heavily on their own intuition and experience. Aim: This research proposes that given the ability of information visualisation to provide an end user with an intuitive way to rapidly analyse large volumes of complex data, such approached could be applied to digital forensics datasets. Such methods will be investigated; supported by a review of literature regarding the use of such techniques in other fields. The hypothesis of this research body is that by utilising exploratory information visualisation techniques in the form of a tool to support digital forensic investigations, gains in investigative effectiveness can be realised. Method:To test the hypothesis, this research examines three different case studies which look at different forms of information visualisation and their implementation with a digital forensic dataset. Two of these case studies take the form of prototype tools developed by the researcher, and one case study utilises a tool created by a third party research group. A pilot study by the researcher is conducted on these cases, with the strengths and weaknesses of each being drawn into the next case study. The culmination of these case studies is a prototype tool which was developed to resemble a timeline visualisation of the user behaviour on a device. This tool was subjected to an experiment involving a class of university digital forensics students who were given a number of questions about a synthetic digital forensic dataset. Approximately half were given the prototype tool, named Insight, to use, and the others given a common open-source tool. The assessed metrics included: how long the participants took to complete all tasks, how accurate their answers to the tasks were, and how easy the participants found the tasks to complete. They were also asked for their feedback at multiple points throughout the task. Results:The results showed that there was a statistically significant increase in accuracy for one of the six tasks for the participants using the Insight prototype tool. Participants also found completing two of the six tasks significantly easier when using the prototype tool. There were no statistically significant different difference between the completion times of both participant groups. There were no statistically significant differences in the accuracy of participant answers for five of the six tasks. Conclusions: The results from this body of research show that there is evidence to suggest that there is the potential for gains in investigative effectiveness when information visualisation techniques are applied to a digital forensic dataset. Specifically, in some scenarios, the investigator can draw conclusions which are more accurate than those drawn when using primarily textual tools. There is also evidence so suggest that the investigators found these conclusions to be reached significantly more easily when using a tool with a visual format. None of the scenarios led to the investigators being at a significant disadvantage in terms of accuracy or usability when using the prototype visual tool over the textual tool. It is noted that this research did not show that the use of information visualisation techniques leads to any statistically significant difference in the time taken to complete a digital forensics investigation.

Fingolimod real world experience

Fingolimod is a Multiple Sclerosis treatment licensed in Europe since 2011. Its efficacy has been demonstrated in three large phase III trials, used in the regulatory submissions throughout the world. As usual, in these trials the inclusion and exclusion criteria were designed to obtain a homogeneous population, with interchangeable characteristics in the different treatment arms. Although this is the best strategy to achieve a robust answer to the investigation question, it does not guaranty the treatment efficacy in the clinical practice, since in the real world there are concomitant treatments, comorbidities, adherence and persistence challenges. But, to make informed treatment decision for a real life patient, we need to have evidence of the treatment efficacy, what has been called treatment effectiveness. This work aims to review fingolimod effectiveness, using as source of information abstracts, posters and manuscripts. This unorthodox strategy was developed because more than half of the published experience with fingolimod is still on abstracts and posters. Only a small part of the studies reviewed are already published in peer reviewed journals. Fingolimod seems to be, at least, as effective and safe as it was on clinical trials, and with its long term experience no new safety signals were observed. In the Portuguese hospital perspective, early treatment with fingolimod is expected to result in better clinical outcomes associated with a more efficient healthcare resources allocation.

Master in Innovative Tourism Development: a blended learning experience in the Polytechnic Institute of Viana do Castelo

This chapter analyses a Portuguese HEI’s first experience with blended learning. Focusing on the Master in Innovative Tourism Development currently being held at the Superior School of Technology and Management of the Polytechnic Institute of Viana do Castelo, it presents the institutional background and rationale behind the course’s implementation, identifying its strengths and weaknesses, as well as areas of potential development. Based on an evaluation research carried out throughout the course’s first three editions and that involved students, faculty and institutional leaders, it summarizes the main results of a long term-study, putting forth a set of recommendations for improvements and defining potential areas of intervention in future editions of the course.

Increased hospital-based physical rehabilitation and information provision after intensive care unit discharge: the RECOVER randomized clinical trial.

Importance: critical illness results in disability and reduced health-related quality of life (HRQOL), but the optimum timing and components of rehabilitation are uncertain. Objective: to evaluate the effect of increasing physical and nutritional rehabilitation plus information delivered during the post–intensive care unit (ICU) acute hospital stay by dedicated rehabilitation assistants on subsequent mobility, HRQOL, and prevalent disabilities. Design, Setting, and Participants: a parallel group, randomized clinical trial with blinded outcome assessment at 2 hospitals in Edinburgh, Scotland, of 240 patients discharged from the ICU between December 1, 2010, and January 31, 2013, who required at least 48 hours of mechanical ventilation. Analysis for the primary outcome and other 3-month outcomes was performed between June and August 2013; for the 6- and 12-month outcomes and the health economic evaluation, between March and April 2014. Interventions: during the post-ICU hospital stay, both groups received physiotherapy and dietetic, occupational, and speech/language therapy, but patients in the intervention group received rehabilitation that typically increased the frequency of mobility and exercise therapies 2- to 3-fold, increased dietetic assessment and treatment, used individualized goal setting, and provided greater illness-specific information. Intervention group therapy was coordinated and delivered by a dedicated rehabilitation practitioner. Main Outcomes and Measures: the Rivermead Mobility Index (RMI) (range 0-15) at 3 months; higher scores indicate greater mobility. Secondary outcomes included HRQOL, psychological outcomes, self-reported symptoms, patient experience, and cost-effectiveness during a 12-month follow-up (completed in February 2014). Results: median RMI at randomization was 3 (interquartile range [IQR], 1-6) and at 3 months was 13 (IQR, 10-14) for the intervention and usual care groups (mean difference, −0.2 [95% CI, −1.3 to 0.9; P = .71]). The HRQOL scores were unchanged by the intervention (mean difference in the Physical Component Summary score, −0.1 [95% CI, −3.3 to 3.1; P = .96]; and in the Mental Component Summary score, 0.2 [95% CI, −3.4 to 3.8; P = .91]). No differences were found for self-reported symptoms of fatigue, pain, appetite, joint stiffness, or breathlessness. Levels of anxiety, depression, and posttraumatic stress were similar, as were hand grip strength and the timed Up & Go test. No differences were found at the 6- or 12-month follow-up for any outcome measures. However, patients in the intervention group reported greater satisfaction with physiotherapy, nutritional support, coordination of care, and information provision. Conclusions and Relevance: post-ICU hospital-based rehabilitation, including increased physical and nutritional therapy plus information provision, did not improve physical recovery or HRQOL, but improved patient satisfaction with many aspects of recovery.

IVIS: Search and visualization on heterogeneous information networks

We build a system to support search and visualization on heterogeneous information networks. We first build our system on a specialized heterogeneous information network: DBLP. The system aims to facilitate people, especially computer science researchers, toward a better understanding and user experience about academic information networks. Then we extend our system to the Web. Our results are much more intuitive and knowledgeable than the simple top-k blue links from traditional search engines, and bring more meaningful structural results with correlated entities. We also investigate the ranking algorithm, and we show that the personalized PageRank and proposed Hetero-personalized PageRank outperform the TF-IDF ranking or mixture of TF-IDF and authority ranking. Our work opens several directions for future research.

Cultural citizenship and its implications for citizenship education: Chinese university students’ civic experience in relation to mass media and the university citizenship curriculum

A growing body of research has argued that university citizenship curricula are inefficient in promoting civic participation, while there is a tendency towards a broader citizenship understanding and new forms of civic engagements and citizenship learning in everyday life. The notion of cultural citizenship in this thesis concentrates on media practices’ relation to civic expression and civic engagement. This research thus argues that not enough attention has been paid to the effects of citizenship education policy on students and students’ active citizenship learning in China. This thesis examines the civic experience of university students in China in the parallel contexts of widespread adoption of mass media and of university citizenship education courses, which have been explicitly mandatory for promoting civic morality education in Chinese universities since 2007. This research project raises significant questions about the meditating influences of these two contexts on students’ perceptions of civic knowledge and civic participation, with particular interest to examine whether and how the notion of cultural citizenship could be applied in the Chinese context and whether it could provide certain implications for citizenship education in China. University students in one university in Beijing contributed to this research by providing both quantitative and qualitative data collected from mixed-methods research. 212 participants contributed to the questionnaire data collection and 12 students took part in interviews. Guided by the theoretical framework of cultural citizenship, a central focus of this study is to explore whether new forms of civic engagement and civic learning and a new direction of citizenship understanding can be identified among university students’ mass media use. The study examines the patterns of students’ mass media use and its relationship to civic participation, and also explores the ways in which mass media shape students and how they interact and perform through the media use. In addition, this study discusses questions about how national context, citizenship tradition and civic education curricula relate to students’ civic perceptions, civic participation and civic motivation in their enactment of cultural citizenship. It thus tries to provide insights and identify problems associated with citizenship courses in Chinese universities. The research finds that Chinese university students can also identify civic issues and engage in civic participation through the influence of mass media, thus indicating the application of cultural citizenship in the wider higher education arena in China. In particular, the findings demonstrate that students’ citizenship knowledge has been influenced by their entertainment experiences with TV programs, social networks and movies. However, the study argues that the full enactment of cultural citizenship in China is conditional with regards to characteristics related to two prerequisites: the quality of participation and the influence of the public sphere in the Chinese context. Most students in the study are found to be inactive civic participants in their everyday lives, especially in political participation. Students express their willingness to take part in civic activities, but they feel constrained by both the current citizenship education curriculum in universities and the strict national policy framework. They mainly choose to accept ideological and political education for the sake of personal development rather than to actively resist it, however, they employ creative ways online to express civic opinions and conduct civic discussion. This can be conceptualised as the cultural dimension of citizenship observed from students who are not passively prescribed by traditional citizenship but who have opportunities to build their own civic understanding in everyday life. These findings lead to the conclusion that the notion of cultural citizenship not only provides a new mode of civic learning for Chinese students but also offers a new direction for configuring citizenship in China. This study enriches the existing global literature on cultural citizenship by providing contemporary evidence from China which is a developing democratic country, as well as offering useful information for Chinese university practitioners, policy makers and citizenship researchers on possible directions for citizenship understanding and citizenship education. In particular, it indicates that it is important for efforts to be made to generate a culture of authentic civic participation for students in the university as well as to promote the development of the public sphere in the community and the country generally.