Suggestions for developing a reliable evidence base for the efficacy of dimensions of learning implementations

This paper advocates the development of an empirical evidence base to guide and enhance Dimensions of Learning (DoL) implementations. The discussion is two-fold. The American research evidence base supporting DoL is outlined and categorized in relation to specific Dimensions. The paper then discusses two approaches to how extant data might be used to shed light on the efficacy of DoL implementations in this country. The paper argues that using these approaches will enable the development of a situated, empirical evidence base reliable enough to guide and enhance DoL implementations in Australia.

Dimensions of University Student Learning in Medicine and Pharmacy

Study orientations in higher education consist of various dimensions, such as approaches to learning, conceptions of learning and knowledge (i.e. epistemologies), self-regulation, and motivation. They have also been measured in different ways. The main orientations typically reported are reproducing and meaning orientations. The present study explored dimensions of study orientations, focusing in particular on pharmacy and medicine. New versions of self-report instruments were developed and tested in various contexts and in two countries. Furthermore, the linkages between study orientations and students epistemological development were explored. The context of problem-based (PBL) small groups was investigated in order to better understand how collaboration contributes to the quality of learning. The participants of Study I (n=66) were pharmacy students, who were followed during a three-year professionally oriented program in terms of their study orientations and epistemologies. A reproducing orientation to studying diminished during studying, whereas only a few students maintained their original level of meaning orientation. Dualism was found to be associated with a reproducing orientation. In Study II practices associated with deep and surface approaches to learning were measured in two differing ways, in order to better distinguish between what students believed to be useful in studying, and the extent to which they applied their beliefs to practice when preparing for examinations. Differences between domains were investigated by including a sample of Finnish and Swedish medical students (n=956) and a Finnish non-medical sample of university students (n=865). Memorizing and rote learning appeared as differing components of a surface approach to learning, while understanding, relating, and critical evaluation of knowledge emerged as aspects of a deep approach to learning. A structural model confirmed these results in both student samples. Study III explored a wide variety of dimensions of learning in medical education. Swedish medical students (n=280) answered the questionnaire. The deep approach to learning was strongly related to collaboration and reflective learning, whereas the surface approach was associated with novice-like views of knowledge and the valuing of certain and directly applicable knowledge. PBL students aimed at understanding, but also valued the role of memorization. Study IV investigated 12 PBL tutorial groups of students (n=116) studying microbiology and pharmacology in a medical school. The educational application was expected to support a deep approach to learning: Group members course grades in a final examination were related to the perceived functioning of the PBL tutorial groups. Further, the quality of cases that had been used as triggers for learning, was associated with the quality of small group functioning. New dimensions of study orientations were discovered. In particular, novel, finer distinctions were found within the deep approach component. In medicine, critical evaluation of knowledge appeared to be less valued than understanding and relating. Further, collaboration appeared to be closely related to the deep approach, and it was also important in terms of successful PBL studying. The results of the studies confirmed the previously found associations between approaches to learning and study success, but showed interesting context- and subgroup-related differences in this respect. Students ideas about the nature of knowledge and their approaches to learning were shown to be closely related. The present study expanded our understanding of the dimensions of study orientations, of their development, and their contextual variability in pharmacy and medicine.

What’s in a name: Dimensions of social learning in teacher groups

Induced by a literature review, this paper presents a framework of dimensions and indicators highlighting the underpinning aspects and values of social learning within teacher groups. Notions of social networks, communities of practice and learning teams were taken as the main perspectives to influence this social learning framework. The review exercise resulted in four dimensions: (1) practice, (2) domain and value creation, (3) collective identity and (4) organization. The indicators corresponding to these dimensions serve as the foundation for understanding social learning in practice. The framework of dimensions and indicators can be of assistance for researchers as well as teacher groups that aim to assess their views on social learning and analyse whether these views fit the learning goals of the group, or that adjustments are required. In this way, learning processes within groups of teachers can be improved.

Learning in social action : the informal and social learning dimensions of circumstantial and lifelong activists

This paper explores the informal and social learning dimensions of activists as they learn skills and knowledge through participating in social action. In doing this I draw on Lave and Wenger's epistemology of situated learning and Bourdieu's theory of "habitus". I argue activists learn an array of community development skills in the social environment of activism. I claim activists' learning is cognitive, embodied and situated in practice. This paper is based on empirical research in Australia, where in-depth interviews were conducted with activists to uncover their important pedagogy. It explores the learning dimensions of two groups of activists. "Lifelong activists" who have generally been involved in student politics and have participated in activism over many years, and "circumstantial activists" who become involved in protest due to a series of life circumstances. This paper claims that while both groups' learning is social and informal, lifelong activists tend to develop their skills incrementally by being involved in the fertile site of student politics. On the other hand, circumstantial activists, not having had the benefit of early immersion in a community of practice, are rapid learners. They are frequently taken out of their comfort zone as activists and need to acquire new knowledge and skills urgently in order to practise effectively. Some circumstantial activists remain on the periphery of activism and never fully immerse themselves in the practices of activism. I argue there is much to be gained from understanding learning in social action, an epistemology of adult learning which deserves greater prominence in current adult education discourse.

The strategic and operational dimensions of staff training and professional development for information professionals : what neXus2 has revealed

The paper seeks to continue the debate about the need for professionals in the library and information services (LIS) sector to continually engage in career-long learning to sustain and develop their knowledge and skills in a dynamic industry. Aims: The neXus2 workforce study has been funded by the ALIA and the consortium of National and State Libraries Australasia (NSLA). It builds on earlier research work (the neXus census) that looked at the demographic, educational and career perspectives of individual library and information professions, to critically examine institutional policies and practices associated with the LIS workforce. The research aims to develop a clearer understanding of the issues impacting on workforce sustainability, workforce capability and workforce optimisation. Methods: The research methodology involved an extensive online survey conducted in March 2008 which collected data on organisational and general staffing; recruitment and retention; staff development and continuing professional education; and succession planning. Encouragement to participate was provided by key industry groups, including academic, public, health, law and government library and information agencies, with the result that around 150 institutions completed the questionnaire. Results: The paper will specifically discuss the research findings relating to training and professional development, to measure the scope and distribution of training activities across the workforce, to consider the interrelationship between the strategic and operational dimensions of staff development in individual institutions and to analyse the common and distinctive factors evident in the different sectors of the profession. Conclusion: The neXus2 project has successfully engaged LIS institutions in the collection of complex industry data that is relevant to the future education and workforce strategies for all areas of the profession. Cross-sector forums such as Information Online 2009 offer the opportunity for stimulating professional dialogue on the key issues.

Information literacy research : dimensions of the emerging collective consciousness

Information literacy researchers are beginning to develop a collective consciousness, a consciousness that represents the newly appearing territory of information literacy research. This paper analyses the information literacy research territory as it is represented by the emerging collective consciousness of information literacy researchers. Five dimensions of the collective consciousness are proposed: 1) the sectoral location of the research, 2) ways of seeing information literacy, 3) ‘what’ is being investigated; that is the research object, 4) ‘how’ the object is being investigated; that is the research approaches and paradigms, and 5) disciplinary influences. These dimensions are used to: 1) reveal the character of the information literacy research territory which is in early stages of construction; 2) show how different kinds of research approaches can shed different kinds of light on the object of research; and 3) demonstrate how the five dimensions work together in the development of new studies.

Influencing pre-service teachers, skills and attitudes towards diversity. Is DOL the Answer?

Abstract: This paper reports on a preliminary investigation into the success of an undergraduate course, in helping preservice teachers at a regional university develop the skills and attitudes necessary to design inclusive learning environments that cater for, and celebrate, difference. The study is particularly relevant given recommendations by the Education Queensland Ministerial Taskforce (Queensland Government, 2004) that all pre-service teacher education programs must ensure that inclusive education is a pervasive theme. The paper starts by providing an overview of inclusive contexts and a rationale for inclusive education including critical elements. This leads into an overview of the undergraduate course EDED11400 Managing Diversity and discussion, based on feedback from the teaching team, on the capacity for the course to help pre-service teachers develop inclusive curriculum and pedagogical practices. The pedagogical framework Dimensions of Learning* is then discussed, with consideration given to whether this framework with its focus on critical thinking and habits of mind, might improve future learning outcomes in the course EDED11400 Managing Diversity. (*Dimensions of Learning is a pedagogical framework designed to teach thinking skills (Marzano et al., 1988). It explores five types of thinking represented in the framework by five dimensions of learning.)

The two dimensions of virtual and collocated project teams or what project team members WANT and GET : an empirical study

The current paper compares and investigates the discrepancies in motivational drives of project team members with respect to their project environment in collocated and distributed (virtual) project teams. The set of factors, which in this context are called ‘Sense of Ownership’, is used as a scale to measure these discrepancies using one tailed t tests. These factors are abstracted from theories of motivation, team performance, and team effectiveness and are related to ‘Nature of Work’, ‘Rewards’, and ‘Communication’. It has been observed that ‘virtual ness’ does not seem to impact the motivational drives of the project team members or the way the project environments provide or support those motivational drives in collocated and distributed projects. At a more specific level in terms of the motivational drives of the project team (‘WANT’) and the ability of the project environment to provide or support those factors (‘GET’), in collocated project teams, significant discrepancies were observed with respect to financial and non financial rewards, learning opportunities, nature of work and project specific communication, while in distributed teams, significant discrepancies with respect to project centric communication, followed by financial rewards and nature of work. Further, distributed project environments seem to better support the team member motivation than collocated project environments. The study concludes that both the collocated and distributed project environments may not be adequately supporting the motivational drives of its project team members, which may be frustrating to them. However, members working in virtual team environments may be less frustrated than their collocated counterparts as virtual project environments are better aligned with the motivational drives of their team members vis-à-vis the collocated project environments.

The two dimensions of virtual and collocated project teams or what project team members WANT and GET : empirical evidence

The current paper compares and investigates the discrepancies in motivational drives of project team members with respect to their project environment in collocated and distributed (virtual) project teams. The set of factors, which in this context are called ‘Sense of Ownership’, is used as a scale to measure these discrepancies using one tailed t tests. These factors are abstracted from theories of motivation, team performance, and team effectiveness and are related to ‘Nature of Work’, ‘Rewards’, and ‘Communication’. It has been observed that ‘virtualness’ does not seem to impact the motivational drives of the project team members or the way the project environments provide or support those motivational drives in collocated and distributed projects. At a more specific level in terms of the motivational drives of the project team (‘WANT’) and the ability of the project environment to provide or support those factors (‘GET’), in collocated project teams, significant discrepancies were observed with respect to financial and non financial rewards, learning opportunities, nature of work and project specific communication, while in distributed teams, significant discrepancies with respect to project centric communication, followed by financial rewards and nature of work. Further, distributed project environments seem to better support the team member motivation than collocated project environments. The study concludes that both the collocated and distributed project environments may not be adequately supporting the motivational drives of its project team members, which may be frustrating to them. However, members working in virtual team environments may be less frustrated than their collocated counterparts as virtual project environments are better aligned with the motivational drives of their team members vis-à-vis the collocated project environments.

Reframing evaluation of learning and teaching: An approach to change

Evaluation practices in the Higher Education sector have been criticised for having unclear purpose and principles; ignoring the complexity and changing nature of learning and teaching and the environments in which they occur; relying almost exclusively on student ratings of teachers working in classroom settings; lacking reliability and validity; using data for inappropriate purposes; and focusing on accountability and marketing rather than the improvement of learning and teaching. In response to similar criticism from stakeholders, in 2011 Queensland University of Technology (QUT) began a project which aims to reframe the organisation’s approach to the evaluation of learning and teaching. This paper describes the existing evaluation system; the emergence and early development of the project; and formulation of a conceptual framework identifying key dimensions of evaluation. It then compares the draft framework with other conceptualisations and models of evaluation identified in the literature, to determine its validity and suitability for supporting QUT’s plans for the future. Overall, the paper represents a structured evaluation of the REFRAME project at a particular point in its lifecycle. Given that the project follows an evidence based, practice-led process and applies an ongoing action research cycle, the findings are presented in the belief that QUT’s experience is broadly applicable to other institutions which may be contemplating change in relation to evaluation of learning and teaching.

Not all dimensions of work self-efficacy are equal : understanding the role of tertiary work placements in the development of the elements of work self-efficacy

This paper examines the relationship between a final year tertiary work placement for criminology students at Griffith University in Brisbane and the development of their work self-efficacy. Using a work self-efficacy instrument developed by Professor Joe Raelin at Northeastern University in Boston, a pilot phase in 2006 and a larger study in 2007 investigated the students’ responses across seven self-efficacy factors of learning, problem-solving, teamwork, sensitivity, politics, pressure, and role expectations. Both studies utilised a pre- and post-test and comparisons between these indicated that they believed their abilities to participate constructively in their professional work contexts significantly improved as a result of their placement experience except in the areas of learning, teamwork and sensitivity. This finding will allow us to continue to refine the processes of work placements in order to ensure the integrity of this method for student learning.

Dimensions of effectiveness and efficiency: A case study on industry–school partnerships

Internationally, the delivery of vocational education and training is being challenged by increasing skills shortages in certain industries and/or rapidly changing skill requirements. To respond to this challenge, rigid and centralised state bureaucracies are increasingly adopting partnerships between schools and industry as a strategy to encourage school-to-work transition programmes to address the local labour market demand. Drawing on experiences in Australia, this paper reports on a case study of government led partnerships between schools and industry. The Queensland Gateway to industry schools initiative currently involves over 120 schools. The study investigated how two commonly used partnership principles were understood by the Gateway to industry partners. Twelve school–industry partnerships from four industry sectors were analysed in terms of the principles of ‘efficiency’ and ‘effectiveness’ derived from the public–private partnership literature. The study found that some evidence of partnership activities associated with efficiency and effectiveness may be assigned to Gateway schools projects. However, little evidence was found that the above underlying principles were addressed systematically. Some of these partnerships were tenuously facilitated by individuals who had limited infrastructure or strategic support. Implications are that industry–school partnership stakeholders would benefit from applying partnership principles regarding implementation and management to ensure the sustainability of partnerships.