Assessment in education : principles, policy and practice

The English examination system provides a market in which a limited number of providers are accredited to offer curriculum-based examinations in many subject areas and at several levels. The most significant are the General Certificate of Secondary Education (GCSE) and the General Certificate of Education, Advanced (A level). Because these examinations are used for high-stakes purposes, including higher education and employment selection for individuals and programme evaluation for institutions, it is desired that scores from various exams be ‘comparable’ in several respects: across syllabuses and examination boards within a subject area, across years, and even across subject areas. Just how to accomplish this goal has been a topic of continual research and debate for over 50 years, through many changes of examination and institutional structures. But ever year, tens of thousands of scores must be reported, and every year, users expect them to ‘be comparable’ and use them as if they are.

Building sustainable and effective assurance of learning process in a changing higher education environment

In a study of assuring learning in Australian Business Schools, 25 Teaching and Learning Associate Deans were interviewed to identify current issues in developing and measuring the quality of teaching and learning outcomes. Results indicate that for most institutions developing a perspective on graduate attributes and mapping assessments to measure outcomes across an entire program required knowledge creation and the building of new inclusive processes. Common elements of effective practice, namely those which offered consistently superior outcomes, included: inclusive processes; embedded graduate attributes throughout a program; alongside consistent and appropriate assessment. Results indicate that assurance of learning processes are proliferating nationally while quality of teaching and learning outcomes and in the processes for assuring it is increasing as a result.

Users Acceptance of Online Enrollment Processes in a Higher Education Institution

Little is known about students’ perceptions of online enrollment processes. Student satisfaction is part of the assessment required for accreditation, but evidence suggests that college administrators are oriented to retention and graduation rates rather than to consumer perception. The purpose of this descriptive quantitative study was to develop and validate a model that enables the measurement of online enrollment processes by the analysis of the students’ perceptions. The theoretical framework used to support this study was the process virtualization theory while the conceptual framework was based on Technology Acceptance Model (TAM). TAM is the most valid framework for studying user acceptance of technology and virtual processes. The model was modified, adding a new variable to fit this study. Research questions were used to determine if an institution knows how its students perceive online enrollment processes and how they can become more efficient and effective, improving usage and satisfaction. Descriptive data were collected and analyzed in phases: the pilot study phase, data collection phase, and analysis phases. Inferential statistics were used to draw information from sampled observations of the population; a Cronbach Alpha was conducted to determine the reliability and validity of the model. The study demonstrated that the modified TAM is valid, reliable, and fit to assess the perceptions of the users of online enrollment processes. This study will effect positive social change by providing enrollment managers and administrators information on how to analyze the acceptance their online enrollment processes from the perspective of their students as customers of an institution of higher learning.

Higher Education - Border or Boundary? Can Theatre in Education Help Promote a University Education?

With the expansion and increased availability of Higher Education the progression to study for an undergraduate degree has been viewed as a simple stepping stone with examination success a straight - forward border pass. Changes in the funding of degree courses has established a series of more challenging boundaries to entry which demand a rigorous assessment of the benefits of Higher Education. The Widening Participation Unit at The University of Worcester has sought to ease this border crossing for pupils whose parents have not been to university. Their experience from previous projects was that school pupils more easily relate to undergraduate students whose experience of Higher Education is recent and relevant. With this in mind they commissioned the Drama and Performance Department to create a Theatre in Education programme that introduced an awareness of post sixteen options and future choices to challenge Higher Education stereotypes. As a result of this collaboration Why Bother? was created, directed by myself and devised and researched with four students who were studying drama. Their own experiences were used to inform the character development and dealt with worrying as a mature student about integration into full – time education, loss of income after working, the pressures of emotional commitments to partners and being away from home. The programme toured to two thousand year 9 – 11 pupils in Worcestershire and Herefordshire schools in January and May 2011. Devising and touring Why Bother provided students with an opportunity to work as a professional paid TIE team that it is not possible for them to do as part of their undergraduate degree course. My initial research looks at the effectiveness and limitations of this project based on pupil questionnaires and the experiences of the team which are explored within the broader context of TIE and its potential for affecting attitudinal change. This has given rise to a number of questions that need consideration in the development of a new TIE programme aimed at raising the awareness of sixth form students who are about to make the decision whether to apply to university or not. Collaboration with university students in exploring the value of an education that they have subscribed to raises issues of bias and whether their powers of persuasion actually prevent pupils from making their own individual decision. The ethics of promoting a “free” university education seem much less complex than the decision required now which involves balancing the real value against the high financial cost suggested in the working title of Is it Worth it? This paper will present my first attempts to develop research methods and methodologies that will enable me to evaluate the success of this and future TIE.

Managerial effectiveness for a new millennium in the global higher education sector

With the global tertiary education environment undergoing some of the most rapid changes it has experienced since the 1980s, a technology-driven new millennium is requiring an unprecedented capacity for change on a number of fronts, one of these being the way managers manage. This article discusses some of the new realities facing tertiary education organizations, one of which is a realization that "knowledge capital" is the lifeline of an organization. It ultimately vests in the people whom successful organizations will lead, motivate, develop, and value in a manner sensitive to global trends of convergent social, cultural, and organizational change. This article suggests that the effective leadership of people will return as the touchstone for success, the technological age notwithstanding, and notes recent theory on increased reliance upon organizational integrity in the form of value-based policy and practice. This article draws on management and futurist theory to suggest some of the "flexibility imperatives" in managing the potentially different-looking work force of the future.

Authentic and conventional assessment in Singapore schools : an empirical study of teacher assignments and student work

This is an empirical examination of the quality of teacher assignments and student work in Singapore schools. Using a theoretical framework based on principles of authentic assessment and intellectual quality, two sets of criteria and scoring rubrics were developed for the training of expert teachers to judge the quality of assignments and student work. Following rigorous training, the inter-rater reliability of expert teacher scoring was high. Samples of teacher assignments and student work were collected in English, social studies, mathematics, and science subject areas from a random stratified sample of 30 elementary schools and 29 high schools. For both grade levels, there were significant differences for the authentic intellectual quality of teachers’ assignments by subject area. Likewise, the differences of authentic intellectual quality for student work were significant and varied by subject area. Subject area effect was large. The correlations between the quality of teachers’ assignment tasks and student work were strong and significant at both grade levels. Where teachers set more intellectually demanding tasks, students were more likely to generate work or artefacts judged to be of higher quality. The findings suggest that teacher professional development in authentic intellectual assessment task design can contribute to the improvement of student learning and performance. It is argued that this will be a key requisite of educational systems like Singapore that are seeking to expand pedagogy and student outcomes beyond a focus on factual and rote knowledge.

Dancing between diversity and consistency : refining assessment in postgraduate degrees in dance

This publication is the culmination of a 2 year Australian Learning and Teaching Council's Project Priority Programs Research Grant which investigates key issues and challenges in developing flexible guidelines lines for best practice in Australian Doctoral and Masters by Research Examination, encompassing the two modes of investigation, written and multi-modal (practice-led/based) theses, their distinctiveness and their potential interplay. The aims of the project were to address issues of assessment legitimacy raised by the entry of practice-orientated dance studies into Australian higher degrees; examine literal embodiment and presence, as opposed to cultural studies about states of embodiment; foreground the validity of questions around subjectivity and corporeal intelligence/s and the reliability of artistic/aesthetic communications, and finally to celebrate ‘performance mastery’(Melrose 2003) as a rigorous and legitimate mode of higher research. The project began with questions which centred around: the functions of higher degree dance research; concepts of 'master-ness’ and ‘doctorateness’; the kinds of languages, structures and processes which may guide candidates, supervisors, examiners and research personnel; the purpose of evaluation/examination; addressing positive and negative attributes of examination. Finally the study examined ways in which academic/professional, writing/dancing, tradition/creation and diversity/consistency relationships might be fostered to embrace change. Over two years, the authors undertook a qualitative national study encompassing a triangulation of semi-structured face to face interviews and industry forums to gather views from the profession, together with an analysis of existing guidelines, and recent literature in the field. The most significant primary data emerged from 74 qualitative interviews with supervisors, examiners, research deans and administrators, and candidates in dance and more broadly across the creative arts. Qualitative data gathered from the two primary sources, was coded and analysed using the NVivo software program. Further perspectives were drawn from international consultant and dance researcher Susan Melrose, as well as publications in the field, and initial feedback from a draft document circulated at the World Dance Alliance Global Summit in July 2008 in Brisbane. Refinement of data occurred in a continual sifting process until the final publication was produced. This process resulted in a set of guidelines in the form of a complex dynamic system for both product and process oriented outcomes of multi-modal theses, along with short position papers on issues which arose from the research such as contested definitions, embodiment and ephemerality, ‘liveness’ in performance research higher degrees, dissolving theory/practice binaries, the relationship between academe and industry, documenting practices and a re-consideration of the viva voce.

Assessment by interview and portfolio in a Graduate School Program

Assessment plays an integral role in teaching and learning in Higher Education and teachers have a strong interest in debates and commentaries on assessment as and for learning. In a one-year graduate entry teacher preparation program, the temptation is to emphasize assessment in an attempt to ensure students “cover” everything as part of a robust preparation for the profession. The risk is that, for students, assessment drives curriculum, and time spent in the completion of assignments is no guarantee of either effective learning or authentic preparation for teaching. Interviews as assessment provide an opportunity for a learning experience as well as an authentic task, since students will shortly be interviewing for employment in a “real world” situation. This paper reports on a project experimenting with interview panels as authentic assessment with pre-service early childhood teachers. At the end of their first semester of study, students enrolled in the Graduate Diploma of Education program at the Queensland University of Technology in Australia were required to participate in a panel interview where they were graded by a panel made up of three faculty staff and one undergraduate student enrolled in the four-year Bachelor of Education program. Students and panel members completed a questionnaire on their experience after the interview. Results indicated that both students and staff valued the experience and felt it was authentic. Results are discussed in terms of how the assessment interview and portfolio presentation supports graduating students in their preparation for employment interviews, and how this authentic assessment task has benefits for both students and teaching staff.

Reflective learning through social network sites in design education

Reflective learning is vital for successful practice-led education such as animation, multimedia design and graphic design, and social network sites can accommodate various learning styles for effective reflective learning. In this paper, the researcher studies reflective learning through social network sites with two animation units. These units aim to provide students with an understanding of the tasks and workflows involved in the production of style sheets, character sheets and motion graphics for use in 3D productions for film and television and game design. In particular, an assessment in these units requires students to complete their online reflective journals throughout the semester. The reflective learning has been integrated within the unit design and students are encouraged to reflect weekly learning processes and outcomes. A survey evaluating for students’ learning experience was conducted, and its outcomes indicate that social network site based reflective learning will not be effective without considering students’ learning circumstances and designing peer-to-peer interactions.

Learning approach and perception of learning context in economics education : a causality test

In the study of student learning literature, the traditional view holds that when students are faced with heavy workload, poor teaching, and content that they cannot relate to – important aspects of the learning context, they will more likely utilise the surface approach to learning due to stresses, lack of understanding and lack of perceived relevance of the content (Kreber, 2003; Lizzio, Wilson, & Simons, 2002; Ramdsen, 1989; Ramsden, 1992; Trigwell & Prosser, 1991; Vermunt, 2005). For example, in studies involving health and medical sciences students, courses that utilised student-centred, problem-based approaches to teaching and learning were found to elicit a deeper approach to learning than the teacher-centred, transmissive approach (Patel, Groen, & Norman, 1991; Sadlo & Richardson, 2003). It is generally accepted that the line of causation runs from the learning context (or rather students’ self reported data on the learning context) to students’ learning approaches. That is, it is the learning context as revealed by students’ self-reported data that elicit the associated learning behaviour. However, other research studies also found that the same teaching and learning environment can be perceived differently by different students. In a study of students’ perceptions of assessment requirements, Sambell and McDowell (1998) found that students “are active in the reconstruction of the messages and meanings of assessment” (p. 391), and their interpretations are greatly influenced by their past experiences and motivations. In a qualitative study of Hong Kong tertiary students, Kember (2004) found that students using the surface learning approach reported heavier workload than students using the deep learning approach. According to Kember if students learn by extracting meanings from the content and making connections, they will more likely see the higher order intentions embodied in the content and the high cognitive abilities being assessed. On the other hand, if they rote-learn for the graded task, they fail to see the hierarchical relationship in the content and to connect the information. These rote-learners will tend to see the assessment as requiring memorising and regurgitation of a large amount of unconnected knowledge, which explains why they experience a high workload. Kember (2004) thus postulate that it is the learning approach that influences how students perceive workload. Campbell and her colleagues made a similar observation in their interview study of secondary students’ perceptions of teaching in the same classroom (Campbell et al., 2001). The above discussions suggest that students’ learning approaches can influence their perceptions of assessment demands and other aspects of the learning context such as relevance of content and teaching effectiveness. In other words, perceptions of elements in the teaching and learning context are endogenously determined. This study attempted to investigate the causal relationships at the individual level between learning approaches and perceptions of the learning context in economics education. In this study, students’ learning approaches and their perceptions of the learning context were measured. The elements of the learning context investigated include: teaching effectiveness, workload and content. The authors are aware of existence of other elements of the learning context, such as generic skills, goal clarity and career preparation. These aspects, however, were not within the scope of this present study and were therefore not investigated.