Assessing the structure of learning outcomes from counselling using the SOLO taxonomy: an exploratory study

Thirty-five clients who had received counselling completed a letter to a friend describing in as much detail as possible what they had learned from counselling. The participants' written responses were analysed and classified using the Structure of Learning Outcomes (SOLO) taxonomy. The results suggested that an expanded SOLO offers a promising and exciting way to view the outcomes of counselling within a learning framework. If the SOLO taxonomy is found to be stable in subsequent research, and clients are easily able to be classified using the taxonomy, then this approach may have implications for the process of counselling. To maximise the learning outcomes, counsellors could use strategies and techniques to enhance their clients' learning.

Students perceptions of learning outcomes from group-based, problem-based teaching and learning activities

Objective: A study aimed at exploring the variation in perceptions of learning outcomes reported by undergraduate nursing students enrolled in a problem-based learning subject in a pre-registration Bachelor of Nursing course (BN).
Method: Students were asked to respond to four open-ended questions which focussed on their learning outcomes in the different teaching/learning modalities of the subject. Data were analysed in two phases using a modified phenomenographic analysis. In the first phase a set of categories of description were developed from the student responses to questions related to the learning modalities. In the second phase the individual responses were classified in terms of the categories. Finally, correlations between the learning modalities were identified. In this paper the approach to analysis, the process of category identification and the correlations between the learning modalities will be described and the implications for further research and teaching will be discussed.
Results: The findings indicated that there were two distinct groups of student responses. Inward focussed students who described outcomes in terms of their own learning and students whose focus was outward i.e. describing learning in terms of patient care and how learning relates to that care. Another important result shows the relationship between the learning modalities and outcomes. From the students' perspective, the most sophisticated outcomes of the lectures and laboratories were ideas and skills to be used and applied in clinical settings. Whereas, the group-based activities in which clinical problems were presented to the students in the form of Situation Improvement Packages (SIPS) focussed their attention on the clinical setting which constituted a preparation for the realities of clinical practice.
Conclusion: The findings from this study indicate that students perceive their learning in the group based teaching/learning modality (SIPS) as effective in focussing them on the reality of their role in the clinical practice environment while lectures and laboratories provided the skills and knowledge required for this setting.

Assessment of learning outcomes in computing studies

The assessment of learning outcomes is a key concept in the European Credit Transfer and Accumulation System (ECTS) since credits are awarded when the assessment shows the competences which were aimed at have been developed at an appropriate level. This paper describes a study which was first part of the project of the Bologna Experts Team-Spain and then developed as an independent study. It was carried out with the overall goal to gain experience in the assessment of learning outcomes. More specifically it aimed at 1) designing procedures for the assessment of learning outcomes related to these compulsory generic competences; 2) testing some basic psychometric features that an assessment device with some consequences for the subjects being evaluated needs to prove; 3) testing different procedures of standard setting, and 4) using assessment results as orienting feedback to students and their tutors. The process of development of tests to carry out the assessment of learning outcomes related to these competences, as well as some basic features regarding their reliability and validity is described and first results on the comparison of results achieved at two academic levels, will also be described at a later stage.

The impact of learning outcomes in business education: assessing value, relevance and graduate ability in a multi-country study of employers and business graduates

This paper discusses critical findings from a two-year EU-funded research project involving four European countries: Austria, England, Slovenia and Romania. The project had two primary aims. The first of these was to develop a systematic procedure for assessing the balance between learning outcomes acquired in education and the specific needs of the labour market. The second aim was to develop and test a set of meta-level quality indicators aimed at evaluating the linkages between education and employment. The project was distinctive in that it combined different partners from Higher Education, Vocational Training, Industry and Quality Assurance. One of the key emergent themes identified in exploratory interviews was that employers and recent business graduates in all four countries want a well-rounded education which delivers a broad foundation of key business knowledge across the various disciplines. Both groups also identified the need for personal development in critical skills and competencies. Following the exploratory study, a questionnaire was designed to address five functional business areas, as well as a cluster of 8 business competencies. Within the survey, questions relating to the meta-level quality indicators assessed the impact of these learning outcomes on the workplace, in terms of the following: 1) value, 2) relevance and 3) graduate ability. This paper provides an overview of the study findings from a sample of 900 business graduates and employers. Two theoretical models are proposed as tools for predicting satisfaction with work performance and satisfaction with business education. The implications of the study findings for education, employment and European public policy are discussed.

Leadership and Pedagogical Interaction as Predictors of Learning Outcomes in Physical Education

This research aims to understand the relative contribution of leadership styles and teacher-student and student-student pedagogical interaction concerning learning performance and academic achievement in Physical Education. A quantitative methodology was implemented, comprising a sample of 447 students attending a school grouping located in the coastal region of central Portugal. In order to verify the nature, the strength and the direction of the relations among the variables, correlation and multiple regression analyses were used. For this, scales already validated and used in other researches were applied. The results show that the learning performance and the academic achievement are significantly associated with teacher leadership styles and teacher-student and student-student pedagogical interaction. A stronger association was obtained with leadership styles, especially the democratic one. It should be mentioned that these factors provide a higher relative contribution to the learning performance than to the academic achievement. The analysis conducted highlights the importance of the democratic teacher leadership style and of the pedagogical interaction established within the classroom towards the improvement of students’ ability to understand the gains and the effort made in learning.

Leadership and Pedagogical Interaction as Predictors of Learning Outcomes in Physical Education

Problem Statement: This research aims to understand the relative contribution of leadership styles and teacher-student and student-student pedagogical interaction concerning the learning performance and academic achievement in physical education. Research Questions: Are the teacher leadership style and the teacher-student and student-student pedagogical interaction related to the learning performance and academic achievement in physical education in basic schooling? Purpose of Study: There are several factors that contribute for the explanation of learning outcomes, namely teacher leadership styles in the classroom, as well as teacher-student and student-student pedagogical interactions. These factors are considered to be essential in the teaching-learning process and in the subsequent improvement of educational outcomes. Research Methods: A quantitative methodology was implemented, comprising a sample of 447 students attending a School Grouping located in the Central Region of Portugal. In order to verify the nature, the strength and the direction of the relations among the variables, correlation and multiple regression analyses were used. For this, scales already validated and used in other researches were applied. Findings: The results show that the learning performance and the academic achievement are significantly associated with teacher leadership styles and teacher-student and student-student pedagogical interaction. A stronger association was obtained with leadership styles, especially the democratic one. It should be mentioned that these factors provide a higher relative contribution to the learning performance than to the academic achievement. Conclusions: This study sought to deepen the understanding of the explanatory factors of academic success concerning the teaching-learning process in physical education. The analysis conducted highlights the importance of the democratic teacher leadership style and of the pedagogical interaction established within the classroom towards the improvement of students' ability to understand the gains and the effort made in learning.

‘Works well with others’ : examining the different types of small group learning approaches and their implications for law student learning outcomes

In the current regulatory climate, there is increasing expectation that law schools will be able to demonstrate students’ acquisition of learning outcomes regarding collaboration skills. We argue that this is best achieved through a stepped and structured whole-of-curriculum approach to small group learning. ‘Group work’ provides deep learning and opportunities to develop professional skills, but these benefits are not always realised for law students. An issue is that what is meant by ‘group work’ is not always clear, resulting in a learning regime that may not support the attainment of desired outcomes. This paper describes different types of ‘group work', each associated with distinct learning outcomes. It suggests that ‘group work’ as an umbrella term to describe these types is confusing, as it provides little indication to students and teachers of the type of learning that is valued and is expected to take place. ‘Small group learning’ is a preferable general descriptor. Identifying different types of small group learning allows law schools to develop and demonstrate a scaffolded, sequential and incremental approach to fostering law students’ collaboration skills. To support learning and the acquisition of higherorder skills, different types of small group learning are more appropriate at certain stages of the program. This structured approach is consistent with social cognitive theory, which suggests that with the guidance of a supportive teacher, students can develop skills and confidence in one type of activity which then enhances motivation to participate in another.

Perceptions of the learning context and learning approaches : implications for quality learning outcomes in accounting

This study analyses learning approaches, course perceptions and learning outcomes of a group of second year accounting students at an Australian university using qualitative data analysis techniques. The research method involves the development of a series of matrices linking types of motives and strategies used by students in their study, together with their perceptions of the learning context associated with learning outcomes. The study focuses on assessing the links between learning approaches and a qualitative assessment of students' conceptual understanding of aspects of financial accounting studied at the undergraduate level. The results confirm how individual differences in the perceptions of the learning context relate to study motives and strategies. The findings show how different forms of memorisation relate to study strategies and how the completion of accounting tasks link to students' perceptions of course requirements. There was also some evidence that, in terms of learning outcomes, students with sophisticated levels of understanding of concepts, tended to have consistent deep and achieving approaches to learning. This result was compared with students' academic performance as a measure of learning outcome. Discrepancies between these two measures of learning outcome are highlighted in the conclusions. The findings strengthen the case for further investigation of the use of measures other than academic performance in examining relationships between learning approaches and learning outcomes.

Does calibration reduce variability in the assessment of accounting learning outcomes?

Reliable, consistent assessment process that produces comparable assessment grades between assessors and institutions is a core activity and an ongoing challenge with which universities have failed to come to terms. In this paper, we report results from an experiment that tests the impact of an intervention designed to reduce grader variability and develop a shared understanding of national threshold learning standards by a cohort of reviewers. The intervention involved consensus moderation of samples of accounting students’ work, with a focus on three research questions. First, what is the quantifiable difference in grader variability on the assessment of learning outcomes in ‘application skills’ and ‘judgement’? Second, does participation in the workshops lead to reduced disparity in the assessment of the students’ learning outcomes in ‘application skills’ and ‘judgement’? Third, does participation in the workshops lead to greater confidence by reviewers in their ability to assess students’ skills in application skills and judgement? Our findings suggest consensus moderation does reduce variability across graders and also builds grader confidence.

The SOLO Taxonomy as a means of shaping and assessing learning in higher education

This paper is a discussion of the use of the SOLO (Structure of Observed Learning Outcomes) Taxonomy (Biggs & Collis, 1982, 1989; Biggs, 1991, 1992a, 1992b; Boulton‐Lewis, 1992, 1994) as a means of developing and assessing higher order thinking in Higher Education. It includes a summary of the research into its use to date as an instrument to find out what students know and believe about their own learning, to assess entering knowledge in a discipline, to present examples of structural organization of knowledge in a discipline, to provide models of levels of desired learning outcomes, and in particular to assess learning outcomes. A proposal is made for further research.

The design of a syllabus for translation students: learning outcomes in the subjects of spanish language

[EN]In the new design of educational programs in European Higher Education Area (EHEA), what defines a subject it is Learning Outcomes (LO). These LO, as explicit and precise declarations, turn into the center of teaching and learning process. Keeping this change is mind, our research examines the Educational Guides (EG) of Spanish Language (SL) through a list of verbs, according to the graduation of educacionational objectives of Bllom's Taxonomy (2014-2015)

The effectiveness of workplace coaching:A meta-analysis of learning and performance outcomes; scale development; theoretical model of individual differences and longitudinal study

The extant literature on workplace coaching is characterised by a lack of theoretical and empirical understanding regarding the effectiveness of coaching as a learning and development tool; the types of outcomes one can expect from coaching; the tools that can be used to measure coaching outcomes; the underlying processes that explain why and how coaching works and the factors that may impact on coaching effectiveness. This thesis sought to address these substantial gaps in the literature with three linked studies. Firstly, a meta-analysis of workplace coaching effectiveness (k = 17), synthesizing the existing research was presented. A framework of coaching outcomes was developed and utilised to code the studies. Analysis indicated that coaching had positive effects on all outcomes. Next, the framework of outcomes was utilised as the deductive start-point to the development of the scale measuring perceived coaching effectiveness. Utilising a multi-stage approach (n = 201), the analysis indicated that perceived coaching effectiveness may be organised into a six factor structure: career clarity; team performance; work well-being; performance; planning and organizing and personal effectiveness and adaptability. The final study was a longitudinal field experiment to test a theoretical model of individual differences and coaching effectiveness developed in this thesis. An organizational sample of 84 employees each participated in a coaching intervention, completed self-report surveys, and had their job performance rated by peers, direct reports and supervisors (a total of 352 employees provided data on participant performance). The results demonstrate that compared to a control group, the coaching intervention generated a number of positive outcomes. The analysis indicated that coachees’ enthusiasm, intellect and orderliness influenced the impact of coaching on outcomes. Mediation analysis suggested that mastery goal orientation, performance goal orientation and approach motivation in the form of behavioural activation system (BAS) drive, were significant mediators between personality and outcomes. Overall, the findings of this thesis make an original contribution to the understanding of the types of outcomes that can be expected from coaching, and the magnitude of impact coaching has on outcomes. The thesis also provides a tool for reliably measuring coaching effectiveness and a theoretical model to understand the influence of coachee individual differences on coaching outcomes.

Implementation of an integrated, technology-based, discovery mode assessment item involving an incubation period to enhance learning outcomes for engineering maths students

In this paper we discuss our current efforts to develop and implement an exploratory, discovery mode assessment item into the total learning and assessment profile for a target group of about 100 second level engineering mathematics students. The assessment item under development is composed of 2 parts, namely, a set of "pre-lab" homework problems (which focus on relevant prior mathematical knowledge, concepts and skills), and complementary computing laboratory exercises which are undertaken within a fixed (1 hour) time frame. In particular, the computing exercises exploit the algebraic manipulation and visualisation capabilities of the symbolic algebra package MAPLE, with the aim of promoting understanding of certain mathematical concepts and skills via visual and intuitive reasoning, rather than a formal or rigorous approach. The assessment task we are developing is aimed at providing students with a significant learning experience, in addition to providing feedback on their individual knowledge and skills. To this end, a noteworthy feature of the scheme is that marks awarded for the laboratory work are primarily based on the extent to which reflective, critical thinking is demonstrated, rather than the amount of CBE-style tasks completed by the student within the allowed time. With regard to student learning outcomes, a novel and potentially critical feature of our scheme is that the assessment task is designed to be intimately linked to the overall course content, in that it aims to introduce important concepts and skills (via individual student exploration) which will be revisited somewhat later in the pedagogically more restrictive formal lecture component of the course (typically a large group plenary format). Furthermore, the time delay involved, or "incubation period", is also a deliberate design feature: it is intended to allow students the opportunity to undergo potentially important internal re-adjustments in their understanding, before being exposed to lectures on related course content which are invariably delivered in a more condensed, formal and mathematically rigorous manner. In our presentation, we will discuss in more detail our motivation and rationale for trailing such a scheme for the targeted student group. Some of the advantages and disadvantages of our approach (as we perceived them at the initial stages) will also be enumerated. In a companion paper, the theoretical framework for our approach will be more fully elaborated, and measures of student learning outcomes (as obtained from eg. student provided feedback) will be discussed.

Student perceptions of the impact of online discussion forum participation on learning outcomes

Choosing the “right” type of technology, either synchronous or asynchronous, to facilitate learning outcomes is a new challenge as the pace of emerging technologies increases and diversifies. Teachers are encouraged to design courses that require collaboration in online learning communities to facilitate the development of higher order thinking skills for life long learning. It is therefore important to gather evidence of the kinds of opportunities afforded to students and whether the students themselves endorse collaborative online tools as a legitimate method of assisting in their learning. This paper outlines the way in which one secondary school has used an online discussion forum to support students in the International Baccalaureate (IB) Diploma Program in enhancing research skills and skills for lifelong learning. The paper considers whether online collaborative tools are perceived by students as a positive way to improve learning outcomes.