Research challenges inherent in determining improvement in university teaching

Using a recent study that examined the effectiveness of a particular approach to improving individual university teaching as a case study, this paper examines some of the challenges inherent in educational research, particularly research examining the effects of interventions to improve teaching. Aspects of the research design and methodology and of the analysis of results are discussed and recommendations for improvements for future research are made.

Research designs and scientific identity in marketing journals: review and evaluation

Purpose - This research is based upon the assumption that the empirical research designs and the scientific identity of a journal are related. The objective is to review and evaluate the empirical research design of papers to determine the scientific identity of a selection of academic marketing journals. Design/methodology/approach – The journal sample consists of the Australasian Marketing Journal (AMJ), the European Journal of Marketing (EJM) and the Journal of Marketing (JM). The review and evaluation considers a six-year period, namely 2000-2005. The content analysis consisted of 811 papers. Findings – The scientific identity of JM may be seen as built upon quantitative research designs and the North American paradigm of research values. The scientific identity of AMJ is based upon a mix of empirical research designs and the Australian paradigm of research values. The scientific identity of EJM is also based upon a mix of empirical research designs, but a multi-continental paradigm of research values. Research limitations/implications – The leading continental journals in marketing maintain a scientific identity based upon the continental paradigm of research values. If it is driven to the extremes, a paradigmatic myopia and inertia of research designs may evolve that limit the scientific identity to be dogmatic and narrow-focused rather than variable and broad-focused. Originality/value – A cross-continental eview and evaluation of research designs and scientific identity of academic marketing journals is presented.

Ethics guidelines for international multi-centre research involving people with intellectual disabilities

This position statement endorsed by the International Association for the Scientific Study of Intellectual Disabilities is designed to promote and facilitate research projects affecting and involving people with intellectual disabilities. The paucity of dedicated research infrastructure and expert ethical review processes to oversee research in this field, especially in developing countries, is asserted as a major issue to be addressed by both the scientific community and governments. International multicenter collaboration has been proposed as a means of addressing these problems. The statement draws on internationally recognized documents outlining the ethical considerations involved in human research activities. It interprets these documents in light of the particular needs and interests of people with intellectual disabilities and incorporates international consultation involving researchers from a variety of disciplines. It affirms the importance of ethical decision making in local communities. Specific recommendations are made concerning ethical review processes, research design considerations, consent processes and the conduct of research involving and affecting people with intellectual disabilities, their families and communities. Research proposals, especially those for international, multicenter projects, need to take into account cultural diversity among participants and differing legal requirements across jurisdictions, while at the same time maintaining the scientific rigor of the research protocol. Promoting partnerships between researchers and people with intellectual disability, together with their families, advocates and local communities are important considerations when developing research projects. Similarly, the development of strategies to both communicate findings to participants and their communities, and to promote their community's access to the benefits of these findings are all important ethical considerations.

Changing teacher professional learning : transitioning from train - the trainer to participatory action research

Diffusion-adoption professional learning models which position teachers ascompliant technicians of policy and practices are limited in their long term effects on teacher professionalism. In contrast, co-researching models of professional learning hold the potential to engage teachers and researchers in explorations of mutual concern which impact on professionalism and contribute to development of both theory and practice.

This article describes professional learning within the context of an Australian state department of education during a period of reform. The contextual influences and design of a collaborative, film-driven participatory action research design which explored teacher learning and application of multiliteracies theory are explored. A spiral of cycles of action research incorporated engagentent with multiliteracies theory and collaborative planning; filming of teacher classroom 'action' and reflective interviews; collaborative observation of and reflection on the resultant filmic artefacts.

The filmic artefacts offered rich multimodal examples of teaching practices,
incorporatíng visual, audio, gestural and spatial classroom information, far beyond the purely linguistic recounts and descriptions which characterise many professional development workshops. Incorporation of collaborative filmic research techniques enabled multimodal observation of teaching practices across a number of sites, with observation unrestricted by temporal or physical parameters.

Reflections on conducting educational research projects in Papua New Guinea

This article discusses how work on an AusAID-funded impact study of major elementary school reforms influenced the research design of a subsequent Australian Development Research Award project investigating the development of sustainable professional learning communities for primary school teachers in remote places of PNG. The authors reflect on how their different backgrounds, roles, experiences and expertise influenced the design and conduct of the projects and, in particular, how the experiences of the action research and survey methods used on the first project shaped the design of the second. The participating elementary school teachers were encouraged, through action research approaches, to develop self reflexive attitudes to their professional work, and to engage in critical reflection of their roles and practices. Accordingly, this article adopts a self-reflexive position towards the authors’ work as academics and researchers as they endeavoured to produce methodologies that are academically rigorous, contextually suitable, and epistemologically appropriate for PNG.

Using action research to improve the quality of teaching in basic education in remote schools in PNG.

This paper discusses the use of action research with teachers in remote primary schools in PNG to provide sustainable professional learning to help improve the quality of schooling. It arises from an ADRA research project being undertaken by the authors. The paper describes the project’s research design and its implementation to investigate the introduction, implementation and feasibility of teachers using action research to solve their own problems related to providing basic education in remote communities. If successful, action research may prove to be an effective approach to sustaining professional learning communities in locations where traditional approaches and means of professional development are difficult or impossible to sustain.

The paper describes the research team’s approach to identifying and engaging schools in remote districts of Western and East Sepik provinces, surveying teachers in those districts about their professional learning needs and circumstances, identifying schools to trial action research, and to undertake the fieldwork to implement action research and to study its implementation. The teachers’ experiences with using action research are presented in the context of their particular research topics chosen for their school. To date, the findings suggest that teachers can use action research to help them improve the quality of the education they provide for children. However, the initiation and sustainability of such an action research approach is influenced by the capacities and commitment of head teachers and standards officers, in particular, valuing and understanding reflective practice and action research for professional learning in school communities.

Development of enhanced curriculum through student-based research

The introduction of the new “Early Years Learning Framework” (DEEWR, 2009 has shifted, the focus in Early Childhood Centres (ECC) from incidental learning through play, to planning curriculum with play as the vehicle to achieve learning. Our Teaching and Learning Grant Project was intended to identify instances of educator practice that fit with the new framework, and video practitioners’ sessions to select vignettes to use as part of an Early Childhood Science Education Unit. The method of identifying and collecting such illustrations is examined here for its feasibility as a research design to collect data to explore a range of educator practices that fit with the new framework. The data collection method was found useful for these purposes.

Inclusion in participatory research: what were the whitefellas doing in an Aboriginal health project?

Health research in indigenous communities, like many interactions between such communities and white-dominated institutions, has a chequered history leading to a three-fold decrement: suspicion and resistance to research that is seen as coming from outside of the community; a shortage of research generators and leaders within the community; and cumulative gaps in the research evidence base, both in terms of coverage of topics and in terms of meeting the priorities of the community.

Additionally, these decrements have been mistakenly located as problems being caused from within the community, rather than recognising that these are outcomes of wider contextual, historical and institutional factors and failings. Good research, as culturally appropriate, inclusive of community voices and meeting the needs and priorities of the community, is necessary in an increasingly evidence-based-practice culture within policy and health settings. Culturally safe research with and for indigenous communities has the potential to be empowering, and to bring community voices, views and experiences into the influential realm of'evidence.

This process of developing safe, appropriate and inclusive research is not straightforward: the decrements are recursive, with a shortage of connections between the community, its priorities and research. However, as the Healing Stories project that we discuss here has shown, it is possible to develop culturally safe participatory research by working with Elders from within the community and with leaders from within white institutions, in a spirit of reconciliation. The methods and findings of Healing Stories have been reported elsewhere, with an emphasis on the voices from the community; this chapter explores some of the 'behind the scenes' processes, from the perspective of the white researchers working from within white- dominated institutions.

After briefly describing the Healing Stories project, this chapter reflects on three parts of the participatory research process: getting started, leading together, and working together. The first of these considers laying the foundations for participatory research, working with Elders and leaders, and planning for inclusion, examining participatory research as a recognisable research design, with potential for rigour, cultural safety and inclusion. The second explores developing participatory methods, working with communities, and opportunities and choices for inclusion. The third examines the process of being participatory, working together and engaging in inclusion across the long-term commitment to the project.

‘The project cannot be approved in its current form’: feminist visual research meets the human research ethics committee

This article reflects on a university human research ethics committee’s unease regarding a feminist visual pilot study within the field of education. The small exploratory study proposed to explore a migrant mother’s production of her son’s identity through her family photograph collection. The committee requested substantial changes to the research design which centred primarily on their concerns regarding risk of harm to pre-existing relationships, and also issues of anonymity and consent. I consider the combined liberal individualist, utilitarian and positivist biomedical basis for the ethics committee’s discomfort with the proposed research which was to involve members of my family. I draw on my experience of the review process to critique the human research ethics committee paradigm which constructs the ideal researcher as an objective and disinterested observer, hinges on a weighing of risks and benefits, and considers humans to be independent and equal. I demonstrate how the blanket application of these values acts to problematise some kinds of research, and how these values can be inappropriate, incompatible and even destructive when applied to research proposals that are exploratory, visual, and/or involve the researcher’s family members as participants.

Creating communities of practice : scoping purposeful design

Purpose – This paper seeks to scope the nature and form of practices, understandings and institutional arrangements that might contribute to the successful “design” and continuity of Communities of Practice (CoP) in a state government department in Australia. The study aims to provide research evidence to support the design and establishment of a CoP based on systems thinking within this department. Design/methodology/approach – A total of 13 semi-structured interviews were undertaken involving 14 informants. The interviewer also attended one CoP meeting. An emergent approach to research design was adopted with data analysis guided by previous studies on CoPs. Findings – The research revealed the existence of six CoPs that were purposefully created internally by the department. Six “design” and practice considerations were suggested for practitioners aiming to create and sustain successful CoPs. Research limitations/implications – Interview material was the only source of primary data and it was gathered from one organisation only – a state government department in Australia. Findings indicate that the role of the CoP coordinator is still not fully understood. Practical implications – The results from this study can be used in re-designing a systems thinking CoP to support systems thinking within the department. The study also revealed that purposefully designing CoPs is possible and useful for practitioners aiming to collaborate and share expertise across disciplinary and divisional boundaries. Originality/value – This study provides some guidance for the purposeful design of CoPs, which has been under-examined in the literature.

Appropriate or appropriate? Strategic considerations when representing indigenous culture in communication design and branding

Appropriate, ethical, respectful depiction and referencing of Indigenous visual iconography has become an important issue around the world - especially when designers and their clients choose to visually represent national identity. This chapter for the book titled, agIdeas Research, Design for Business, highlights the need for governments, the private sector and the design community to show leadership in regard to appropriate representation and engagement with Indigenous knowledge. It is a sensitive area where guidance is needed to assist designers and their clients to engage appropriately with Indigenous culture when required.

Consensual commitment: a grounded theory of the meso-level influence of organizational design on leadership and decision-making

This research examined the relationship between organizational design and leadership in decision-making teams. It used a grounded theory-based qualitative research design. The validity of the research was enhanced by data triangulation, wherein quantitative psychometric data augmented the qualitative data that are traditionally used. The research was based upon two organizations within the substantive setting of the knowledge industry. The higher order category of consensual commitment explained effective decision-making. At the meso-level of leadership modeling, organizational design influenced both leadership style and decision-making. Specifically, an organizational design that generated lateral job roles and a relational leadership orientation was found to enhance consensual commitment, and provided a level of assurance against dysfunctional team dynamics. © 2009 Elsevier Inc. All rights reserved.

Sport and social media research: a review

The emergence of social media has profoundly impacted the delivery and consumption of sport. In the current review we analysed the existing body of knowledge of social media in the field of sport management from a service-dominant logic perspective, with an emphasis on relationship marketing. We reviewed 70 journal articles published in English-language sport management journals, which investigated new media technologies facilitating interactivity and co-creation that allow for the development and sharing of user-generated content among and between brands and individuals (i.e., social media). Three categories of social media research were identified: strategic, operational, and user-focussed. The findings of the review demonstrate that social media research in sport management aligns with service-dominant logic and illustrates the role of social media in cultivating relationships among and between brands and individuals. Interaction and engagement play a crucial role in cultivating these relationships. Discussion of each category, opportunities for future research as well as suggestions for theoretical approaches, research design and context are advanced.

Power, effects, confidence, and significance: an investigation of statistical practices in nursing research

Objectives: To (a) assess the statistical power of nursing research to detect small, medium, and large effect sizes; (b) estimate the experiment-wise Type I error rate in these studies; and (c) assess the extent to which (i) a priori power analyses, (ii) effect sizes (and interpretations thereof), and (iii) confidence intervals were reported. Design: Statistical review. Data sources: Papers published in the 2011 volumes of the 10 highest ranked nursing journals, based on their 5-year impact factors. Review methods: Papers were assessed for statistical power, control of experiment-wise Type I error, reporting of a priori power analyses, reporting and interpretation of effect sizes, and reporting of confidence intervals. The analyses were based on 333 papers, from which 10,337 inferential statistics were identified. Results: The median power to detect small, medium, and large effect sizes was .40 (interquartile range [. IQR]. = .24-.71), .98 (IQR= .85-1.00), and 1.00 (IQR= 1.00-1.00), respectively. The median experiment-wise Type I error rate was .54 (IQR= .26-.80). A priori power analyses were reported in 28% of papers. Effect sizes were routinely reported for Spearman's rank correlations (100% of papers in which this test was used), Poisson regressions (100%), odds ratios (100%), Kendall's tau correlations (100%), Pearson's correlations (99%), logistic regressions (98%), structural equation modelling/confirmatory factor analyses/path analyses (97%), and linear regressions (83%), but were reported less often for two-proportion z tests (50%), analyses of variance/analyses of covariance/multivariate analyses of variance (18%), t tests (8%), Wilcoxon's tests (8%), Chi-squared tests (8%), and Fisher's exact tests (7%), and not reported for sign tests, Friedman's tests, McNemar's tests, multi-level models, and Kruskal-Wallis tests. Effect sizes were infrequently interpreted. Confidence intervals were reported in 28% of papers. Conclusion: The use, reporting, and interpretation of inferential statistics in nursing research need substantial improvement. Most importantly, researchers should abandon the misleading practice of interpreting the results from inferential tests based solely on whether they are statistically significant (or not) and, instead, focus on reporting and interpreting effect sizes, confidence intervals, and significance levels. Nursing researchers also need to conduct and report a priori power analyses, and to address the issue of Type I experiment-wise error inflation in their studies. © 2013 .

Sport and social media research: a review

The emergence of social media has profoundly impacted the delivery and consumption of sport. In the current review we analysed the existing body of knowledge of social media in the field of sport management from a service-dominant logic perspective, with an emphasis on relationship marketing. We reviewed 70 journal articles published in English-language sport management journals, which investigated new media technologies facilitating interactivity and co-creation that allow for the development and sharing of user-generated content among and between brands and individuals (i.e., social media). Three categories of social media research were identified: strategic, operational, and user-focussed. The findings of the review demonstrate that social media research in sport management aligns with service-dominant logic and illustrates the role of social media in cultivating relationships among and between brands and individuals. Interaction and engagement play a crucial role in cultivating these relationships. Discussion of each category, opportunities for future research as well as suggestions for theoretical approaches, research design and context are advanced.