Social research: strength of evidence rating tool

This document provides guidelines for the Victorian Auditor-General's Office when it comes to propose or evaluate social research in the areas of sampling, questionnaires, interviews, focus groups, consulting with a group, descriptive and inferential statistics, document reviews and non-participatory observation.

Practitioner perspectives on the family risk evaluation tool : an aide to decision making or 'just another form to fill in'?

The findings of research that explored how child protection practitioners in Queensland used the Structured Decision Making (SDM) tools are presented, focusing on how the Family Risk Evaluation tool (FRET) was used in decision making. The main finding was that the FRET was not used to assist the decision making of practitioners and consequently was ineffective in targeting the children most in need of a service. For practitioners, it was 'just another form to fill in'. As suggested by the participants in this research, a better strategy than the implementation of the SDM tools to improve decision making is the development of practitioner expertise through higher education.

The content validity of the behaviour support plan quality evaluation tool (BSP-QEII) and its potential application in accommodation and day-support services for adults with intellectual disability

Background The quality of support provided to people with disability who show challenging behaviour could be influenced by the quality of the behaviour support plans (BSPs) on which staff rely for direction. This study investigated the content validity of the Behaviour Support Plan Quality Evaluation tool (BSP-QEII), originally developed to guide the development of BSPs for children in school settings, and evaluated its application for use in accommodation and day-support services for adults with intellectual disability.

Method A three-round Delphi study involving a purposive sample of experienced behaviour support practitioners (n = 30) was conducted over an 8-week period. The analyses included deductive content analysis and descriptive statistics.

Results The 12 quality domains of the BSP-QEII were affirmed as valid for application in adult accommodation and day-support service settings. Two additional quality domains were suggested, relating to the provision of detailed background on the client and the need for plans to reflect contemporary service philosophy. Furthermore, the results suggest that some issues previously identified in the literature as being important for inclusion in BSPs might not currently be a priority for practitioners. These included: the importance of specifying replacement or alternative behaviours to be taught, descriptions of teaching strategies to be used, reinforcers, and the specification of objective goals against which to evaluate the success of the intervention programme.

Conclusions The BSP-QEII provides a potentially useful framework to guide and evaluate the development of BSPs in services for adults with intellectual disability. Further research is warranted to investigate why practitioners are potentially giving greater attention to some areas of intervention practice than others, even where research has demonstrated these others areas of practice could be important to achieving quality outcomes.

Marketing research performance and strategy

Purpose - To investigate whether strategic orientation affects the evaluation of specific market research projects in for-profit firms.
Design/methodology/approach - A small-scale follow-up survey was conducted, building on qualitative and quantitative research among a sample of the top-1,000 marketing managers in Australia. The study used an existing market research evaluation tool, the USER scale and items generated from the qualitative research, to investigate the firm's most recent market research project.
Findings - Four market research performance factors were identified - market research as a knowledge enhancing (KE) function, the internal political use of market research, the misuse of market research and the generation of market understanding. The Miles and Snow strategy types were related to these factors, with Prospector types more likely to use market research rationally and less likely to use it for internal political purposes. Tactical projects were more likely to be misused than were those with a strategic orientation. Prospectors were far less likely and analysers far more likely to misuse tactical research projects. Prospectors were more often satisfied with the performance of their most recent market research. The Porter typology was less successful in predicting market research performance.
Research limitations/implications - The study was based on a small sample of market research projects in Australian for-profit firms. Future studies need to study these phenomena more intensively using ethnographic methods and more extensively using larger multi-country samples.
Practical implications - Market research suppliers should learn the nature of their client's strategic intent to improve their effectiveness. Defender firms should carefully monitor the use of market research, especially that of a tactical nature, which may be wasted or misused.
Originality/value - Contributes to an understanding of how strategic orientation relates to the ways market research information is used within the firm.

Mobile Architecture and Built Environment Laboratory (MABEL) - a building performance evaluation tool

This paper describes the Mobile Architecture and Built Environment Laboratory (MABEL) and its application for systematic building performance evaluation for compliance testing, commissioning, strategic and operational facility management and continuous improvement in the built environment.

The first part of the paper introduces the application areas of on-site building performance evaluation and discusses the shortcomings in this regard in current practice. It emphasises the need for on-site investigations to generate information on 'as built performance' for the 'feedback' loop between design, operation and occupancy of new buildings, retrofit or adjustment.

The second part introduces the Energy-Comfort-Behaviour Framework for 'across-the-board' building evaluation and discusses MABEL's role in this scheme. MABEL's objectives, procedures and the performance measurement matrix are explained and discussed.

Ecosystem services of tropical dry forests : insights from longterm ecological and social research on the Pacific coast of Mexico

In the search for an integrated understanding of the relationships among productive activities, human well-being, and ecosystem functioning, we evaluated the services delivered by a tropical dry forest (TDF) ecosystem in the Chamela Region, on the Pacific Coast of Mexico. We synthesized information gathered for the past two decades as part of a long-term ecosystem research study and included social data collected in the past four years using the Millennium Ecosystem Assessment (MA) conceptual framework as a guide. Here we identify the four nested spatial scales at which information has been obtained and emphasize one of them through a basin conceptual model. We then articulate the biophysical and socio-economic constraints and drivers determining the delivery of ecosystem services in the Region. We describe the nine most important services, the stakeholders who benefit from those services, and their degree of awareness of such services. We characterize spatial and temporal patterns of the services’ delivery as well as trade-offs among services and stakeholders. Finally, we contrast three alternative future scenarios on the delivery of ecosystem services and human well-being. Biophysical and socioeconomic features of the study site strongly influence human−ecosystem interactions, the ecosystem services delivered, the possible future trajectories of the ecosystem, and the effect on human well-being. We discuss future research approaches that will set the basis for an integrated understanding of human−ecosystem interactions and for constructing sustainable management strategies for the TDF.

Incorrigible and undisciplined lines in visual social research : ways of ‘writing’ and ‘drawing’ at the interstices

In this paper the author traces the possibilities afforded by engaging with the aesthetic, historic and socio-political nature of shodo (Japanese calligraphy) as an intersectional space. Shodo literally translated as 'the way of writing' is an artistic practice bringing together ink, brush and paper. It is simultaneously a juncture between studied discipline and an ongoing mediation of subjectivities. The calligrapher/writer/drawer communicates to the reader through the bold or subtle brush strokes, the pressure and movement at the completion of each stroke. The calligrapher/writer/drawer draws across the boundaries of text and image to meet the reader blurring the lines between subject and object. This discussion re-examines the hierarchical binaries of writing/drawing, text/image, self/Other as they play out from vanishing lines of distinction between truth and conjecture. Crossing these binaries opens up opportunity for decentring and questioning representational practice by enabling other possible meanings and practices to emerge (Lather, 2007). I work from a stance of theoretical promiscuity in order to disrupt constitutive discourses and restore the liminal in social research. Drawing across the fragments of research projects I illustrate the generative and speculative space of visualising pedascapes in educational research.

Children's media use : perspectives from social research

The paper explains the impacts of digital media on previously observed developmental patterns of time choices for the current generation of young children, age 5-11. It shows that work and family routines still influence patterns of media use, rather than just broadcast media schedules and access to digital and mobile devices. Contrary to previous research on digital natives that predicted that interactive media would eventually displace traditional linear media, these findings from a nationally-representative study show that time-use of 'lean back media' and 'lean forward media' run in parallel for Australian children 5-11.