Reframe : QUT's evaluation framework survey business rules

Reframe is changing our approach to the evaluation of courses, units, teaching and student experience at QUT. We are moving away from a single survey tool to a richer, more holistic and customisable approach. This approach will help our academics design and deliver high-quality learning experiences, and review the impact of their teaching practice on student learning. Through it, we will also be able to provide more timely access to specialised support and meet external reporting requirements.

Making usability affordable in the design of e-government services: User-centred design for public sector websites

E-government provides a platform for governments to implement web-enabled services that facilitate communication between citizens and the government. However, technology-driven design approach and limited understanding of citizens' requirements have led to a number of critical usability problems on the government websites. Hitherto, there has been no systematic attempt to analyse the way in which theory of User-Centred Design (UCD) can contribute to address the usability issues of government websites. This research seeks to fill this gap by synthesising perspectives drawn from the study of UCD and examining them based on the empirical data derived from case study of the Scottish Executive (SE) website. The research employs a qualitative approach in the collection and analysis of data. The triangulated analysis of the findings reveals that e-government web designers take commercial development approach and focus only on technical implementations, which lead to websites that do not meet citizens' expectations. The research identifies that e-government practitioners can overcome web usability issues by transferring the theory of UCD to practice. © Copyright 2010 Inderscience Enterprises Ltd.

User centred design for engineering e-government web usability

E-government provides a platform for governments to implement web enabled services that facilitate communication between citizens and the government. However, technology driven design approach and limited understanding of citizens' requirements, have led to a number of critical usability problems on the government websites. Hitherto, there has been no systematic attempt to analyse the way in which theory of User Centred Design (UCD) can contribute to address the usability issues of government websites. This research seeks to fill this gap by synthesising perspectives drawn from the study of User Centred Design and examining them based on the empirical data derived from case study of the Scottish Executive website. The research employs a qualitative approach in the collection and analysis of data. The triangulated analysis of the findings reveals that e-government web designers take commercial development approach and focus only on technical implementations which lead to websites that do not meet citizens' expectations. The research identifies that e-government practitioners can overcome web usability issues by transferring the theory of UCD to practice.

Hybridized writing for scientific literacy : pedagogy and evidence

Disengagement of students in science and the scientific literacy of young adults are interrelated international concerns. One way to address these concerns is to engage students imaginatively in activities designed to improve their scientific literacy. Our ongoing program of research has focused on the effects of a sequence of activities that require students to transform scientific information on important issues for their communities from government websites into narrative text suitable for a lay reader. These hybridized stories we call BioStories. Students upload their stories for peer review to a dedicated website. Peer reviews are intended to help students refine their stories. Reviewing BioStories also gives students access to a wider range of scientific topics and writing styles. We have conducted separate studies with students from Grade 6, Grade 9 and Grade 12, involving case study and quasi-experimental designs. The results from the 6th grade study support the argument that writing the sequence of stories helped the students become more familiar with the scientific issue, develop a deeper understanding of related biological concepts, and improve their interest in science. Unlike the Grade 6 study, it was not possible to include a control group for the study conducted across eight 9th grade classes. Nevertheless, these results suggest that hybridized writing developed more positive attitudes toward science and science learning, particularly in terms of the students’ interest and enjoyment. In the most recent case study with Grade 12 students, we found that pride, strength, determination, interest and alertness were among the positive emotions most strongly elicited by the writing project. Furthermore, the students expressed enhanced feelings of self-efficacy in successfully writing hybridized scientific narratives in science. In this chapter, we describe the pedagogy of hybridized writing in science, overview the evidence to support this approach, and identify future developments.

Evaluation of knowledge management performance: An organic approach

Knowledge management (KM) strategy is the planned or actual coordination of a firm's major goals and learning in time; this coordination continually co-aligns the firm's knowledge-based resources with the environment. Based on the organic perspective of strategy, a KM performance evaluation approach should be able to 1) review the knowledge governance mechanisms and learning routines that underpin the KM strategy, as well as the performance outcomes driven by the strategy, and 2) predict the evolution of performance drivers and outcomes into the future to facilitate strategic planning. This study combined a survey study and a system dynamics (SD) simulation to demonstrate the transformation from a mechanistic to an organic perspective on KM strategy and performance evaluation. The survey study was conducted based on a sample of 143 construction contractors and used structural equation modeling (SEM) techniques to develop a KM performance index for reviewing the key elements that underpin KM strategy. The SD simulation predicted the development of KM strategy configurations and the evolution of KM performance over time. The organic KM performance evaluation approach demonstrated by this study has significant potential to improve the alignment of KM strategy within an increasingly dynamic business environment.

Evaluation of Australian Performing Arts Market 2014-2018 REPORT TWO APAM inter-year report 2015 DECEMBER

The report follows up on data and trends tabled in August 2015 that collected data from two key sources – six identified case study productions that have been tracked for eighteen months, and an online survey delivered to all APAM 2014 delegates. The comparative report has been constructed through an analysis of data reported from the August 2015 and the most recent online survey to all 2104 PM delegates conducted in late November 2015. The report highlights six key trends emerging from the data: The majority of survey respondents will return to APAM 2016; The central reason for attending is the networking opportunities the Market affords; Respondents are confident that a range of new relationships forged at the Market will afford long-term interest and buying opportunities and that as a result of the 2014 event, real touring outcomes were realised for some respondents; Respondents would like to see greater attention to a greater number of networking activities within the program to enable touring outcomes; The multi-venue model is still of concern, and is a recurrent issue from earlier surveys; The level of expense incurred by producers to present work at APAM. Throughout the report, extracted data from the online survey responses will be tabled to develop a narrative in response to the key research aims outlined in the Brisbane Powerhouse Tender document (2011). A full version of the collated responses to the survey questions can be found in the appendices of the report.

Valid and reliable assessment of wellness among adolescents : do you know what you’re measuring?

Measuring wellness among adolescents is an emerging trend among professionals and researchers endeavouring to influence youth as they establish lifestyle patterns in this critical period of life. This discussion highlights instruments used to measure wellness among adolescents, and considers the empirical data supporting their validity and reliability amongst adolescents. In summary, Adolescent wellness is an important indicator of future health and lifestyle habits. There are a number of tools available to measure wellness, each with its own focus, depending on the definition or model from which it was developed. This may cause debate regarding the appropriateness of some instruments for evaluating wellness. The majority of wellness evaluation approaches reported among adolescents have less than ideal validation. A ‘gold standard’ definition could lead to the standardisation of a theoretical model against which wellness instruments could be validated. The absence of peer reviewed studies reporting psychometric testing for wellness evaluation instruments among adolescents is concerning given their growing popularity and highlights a priority area for future research in this field.

Development of hospital disaster resilience : conceptual framework and potential measurement

Objective Despite ‘hospital resilience’ gaining prominence in recent years, it remains poorly defined. This article aims to define hospital resilience, build a preliminary conceptual framework and highlight possible approaches to measurement. Methods Searches were conducted of the commonly used health databases to identify relevant literature and reports. Search terms included ‘resilience and framework or model’ or ‘evaluation or assess or measure and hospital and disaster or emergency or mass casualty and resilience or capacity or preparedness or response or safety’. Articles were retrieved that focussed on disaster resilience frameworks and the evaluation of various hospital capacities. Result A total of 1480 potentially eligible publications were retrieved initially but the final analysis was conducted on 47 articles, which appeared to contribute to the study objectives. Four disaster resilience frameworks and 11 evaluation instruments of hospital disaster capacity were included. Discussion and conclusion Hospital resilience is a comprehensive concept derived from existing disaster resilience frameworks. It has four key domains: hospital safety; disaster preparedness and resources; continuity of essential medical services; recovery and adaptation. These domains were categorised according to four criteria, namely, robustness, redundancy, resourcefulness and rapidity. A conceptual understanding of hospital resilience is essential for an intellectual basis for an integrated approach to system development. This article (1) defines hospital resilience; (2) constructs conceptual framework (including key domains); (3) proposes comprehensive measures for possible inclusion in an evaluation instrument, and; (4) develops a matrix of critical issues to enhance hospital resilience to cope with future disasters.

Opinions, attitudes and driving experiences of car and racing "enthusiasts" : results of the Ontario Car and Racing Club Survey

In recent years, car club and racing websites and forums have become an increasingly popular way for car enthusiasts to access racing and car club news, chat-rooms and message boards. However, no North American research has been found that has examined opinions and driving experiences of car and racing enthusiasts. The purpose of this study was to examine car club members’ opinions about and experiences with various aspects of driving, road safety and traffic legislation, with a particular focus on street racing. A web-based questionnaire (Survey Monkey) was developed using the expert panel method and was primarily based on validated instruments or questions that were developed from other surveys. The questionnaire included: 1) driver concerns regarding traffic safety issues and legislation; 2) attitudes regarding various driving activities; 3) leisure-time activities, including club activities; 4) driving experiences, including offences and collisions; and 5) socio-demographic questions. The survey was pre- tested and piloted. Electronic information letters were sent out to an identified list of car clubs and forums situated in southern Ontario. Car club participants were invited to fill out the questionnaire. This survey found that members of car clubs share similar concerns regarding various road safety issues with samples of Canadian drivers, although a smaller percentage of car club members are concerned about speeding-related driving. Car club members had varied opinions regarding Ontario’s Street Racers, Stunt and Aggressive Drivers Legislation. The respondents agreed the most with the new offences regarding not sitting in the driver’s seat, having a person in the trunk, or driving as close as possible to another vehicle, pedestrian or object on or near the highway without a reason. The majority disagreed with police powers of impoundment and on-the-spot licence suspensions. About three quarters of respondents reported no collisions or police stops for traffic offences in the past five years. Of those who had been stopped, the most common offence was reported as speeding. This study is the first in Canada to examine car club members’ opinions about and experiences with various aspects of driving, road safety and traffic legislation. Given the ubiquity of car clubs and fora in Canada, insights on members’ opinions and practices provide important information to road safety researchers.

Post occupancy evaluations relating to discomfort glare : a study of green buildings in Brisbane

Glare indices have yet to be extensively tested in daylit open plan offices, as such there is no effective method to predict discomfort glare within these spaces. This study into discomfort glare in open plan green buildings targeted full-time employees, working under their everyday lighting conditions. Three green buildings in Brisbane were used for data collection, two were Green Star accredited and the other contained innovative daylighting strategies. Data were collected on full-time employees, mostly aged between 30 and 50 years, who broadly reflect the demographics of the wider working population in Australia. It was discovered 36 of the 64 respondents experienced discomfort from both electric and daylight sources at their workspace. The study used a specially tailored post-occupancy evaluation (POE) survey to help assess discomfort glare. Luminance maps extracted from High Dynamic Range (HDR) images were used to capture the luminous environment of the occupants. These were analysed using participant data and the program Evalglare. The physical results indicated no correlation with other developed glare metrics for daylight within these open plan green buildings, including the recently developed Daylight Glare Probability (DGP) Index. The strong influence of vertical illuminance, Ev in the DGP precludes the mostly contrast-based glare from windows observed in this investigation from forming a significant part of this index. Furthermore, critical assessment of the survey techniques used are considered. These will provide insight for further research into discomfort glare in the endeavour to fully develop a suitable glare metric.

Researching quality and equity in assessment for improved learner outcomes

Quality and equity issues as they relate to assessment practices and policy are becoming increasingly important as Australia introduces a national curriculum and achievement standards. In a context of high-stakes accountability, concerns regarding equity and quality have important implications for teachers‘ practice for the improvement of learner outcomes. This article is based on three research projects that were conducted over the past four years and were funded by the Australian Federal Government. The research focus, emergent questions, the educational contexts, and the rationale for the studies are discussed prior to the presentation of the analysis of the research findings and the implications for teachers‘ practice and policy reform.

Survey and Mapping Infrastructure Regulation 2004- Comments Relating to a 10-Year Review

Democratic governments raise taxes and charges and spend revenue on delivering peace, order and good government. The delivery process begins with a legislature as that can provide a framework of legally enforceable rules enacted according to the government’s constitution. These rules confer rights and obligations that allow particular people to carry on particular functions at particular places and times. Metadata standards as applied to public records contain information about the functioning of government as distinct from the non-government sector of society. Metadata standards apply to database construction. Data entry, storage, maintenance, interrogation and retrieval depend on a controlled vocabulary needed to enable accurate retrieval of suitably catalogued records in a global information environment. Queensland’s socioeconomic progress now depends in part on technical efficiency in database construction to address queries about who does what, where and when; under what legally enforceable authority; and how the evidence of those facts is recorded. The Survey and Mapping Infrastructure Act 2003 (Qld) addresses technical aspects of where questions – typically the officially recognised name of a place and a description of its boundaries. The current 10-year review of the Survey and Mapping Regulation 2004 provides a valuable opportunity to consider whether the Regulation makes sense in the context of a number of later laws concerned with management of Public Sector Information (PSI) as well as policies for ICT hardware and software procurement. Removing ambiguities about how official place names are to be regarded on a whole-of-government basis can achieve some short term goals. Longer-term goals depend on a more holistic approach to information management – and current aspirations for more open government and community engagement are unlikely to occur without such a longer-term vision.

The distribution of absorptive capacity among construction supply chain participants

The absorptive capacity of organisations is one of the key drivers of innovation performance in any industry. This research seeks to refine our understanding of the relationship between absorptive capacity and innovation performance, with a focus on characterising the absorptive capacity of the different participant groups within the Australian road industry supply chain. One of the largest and most comprehensive surveys ever undertaken of innovation in road construction was completed in 2011 by the Queensland University of Technology (QUT), based on the Australian road industry. The survey of over 200 construction industry participants covered four sectors, comprising suppliers (manufacturers and distributors), consultants (engineering consultants), contractors (head and subcontractors) and clients (state government road agencies). The survey measured the absorptive capacity and innovation activity exhibited by organisations within each of these participant groups, using the perceived importance of addressing innovation obstacles as a proxy for innovation activity. One of the key findings of the survey is about the impact of participant competency on product innovation activity. The survey found that the absorptive capacity of industry participants had a significant and positive relationship with innovation activity. Regarding the distribution of absorptive capacity, the results indicate that suppliers are more likely to have high levels of absorptive capacity than the other participant groups, with 32% of suppliers showing high absorptive capacity, ahead of contractors (18%), consultants (11%), and clients (7%). These results support the findings of previous studies in the literature and suggest the importance of policies to enhance organisational learning, particularly in relation to openness to new product ideas.

Access to commercial destinations within the neighbourhood and walking among Australian older adults

BACKGROUND: Physical activity, particularly walking, is greatly beneficial to health; yet a sizeable proportion of older adults are insufficiently active. The importance of built environment attributes for walking is known, but few studies of older adults have examined neighbourhood destinations and none have investigated access to specific, objectively-measured commercial destinations and walking. METHODS: We undertook a secondary analysis of data from the Western Australian state government's health surveillance survey for those aged 65--84 years and living in the Perth metropolitan region from 2003--2009 (n = 2,918). Individual-level road network service areas were generated at 400 m and 800 m distances, and the presence or absence of six commercial destination types within the neighbourhood service areas identified (food retail, general retail, medical care services, financial services, general services, and social infrastructure). Adjusted logistic regression models examined access to and mix of commercial destination types within neighbourhoods for associations with self-reported walking behaviour. RESULTS: On average, the sample was aged 72.9 years (SD = 5.4), and was predominantly female (55.9%) and married (62.0%). Overall, 66.2% reported some weekly walking and 30.8% reported sufficient walking (>=150 min/week). Older adults with access to general services within 400 m (OR = 1.33, 95% CI = 1.07-1.66) and 800 m (OR = 1.20, 95% CI = 1.02-1.42), and social infrastructure within 800 m (OR = 1.19, 95% CI = 1.01-1.40) were more likely to engage in some weekly walking. Access to medical care services within 400 m (OR = 0.77, 95% CI = 0.63-0.93) and 800 m (OR = 0.83, 95% CI = 0.70-0.99) reduced the odds of sufficient walking. Access to food retail, general retail, financial services, and the mix of commercial destination types within the neighbourhood were all unrelated to walking. CONCLUSIONS: The types of neighbourhood commercial destinations that encourage older adults to walk appear to differ slightly from those reported for adult samples. Destinations that facilitate more social interaction, for example eating at a restaurant or church involvement, or provide opportunities for some incidental social contact, for example visiting the pharmacy or hairdresser, were the strongest predictors for walking among seniors in this study. This underscores the importance of planning neighbourhoods with proximate access to social infrastructure, and highlights the need to create residential environments that support activity across the life course.