A view of the Assessment and Feedback Landscape: baseline analysis of policy and practice from the JISC Assessment and Feedback programme

Assessment and feedback lies at the heart of the learning experience, and forms a significant part of both academic and administrative workload. It remains however the single biggest source of student dissatisfaction with the higher education experience. The JISC Assessment and Feedback programme (Sept 2011-Aug 2014) is supporting large-scale changes in assessment and feedback practice, supported by technology, with the aim of enhancing the learning and teaching process and delivering efficiencies and quality improvements. This report summarises baseline reviews undertaken by a number of institutions as part of their programme activity.

The pursuit of academic excellence and business engagement: Is it irreconcilable?

Universities currently need to satisfy the demands of different audiences. In light of the increasing policy emphasis on "third mission" activities, universities are attempting to incorporate these into their traditional missions of teaching and research. University strategies to accomplishing its traditional missions are well-honed and routinized, but the incorporation of the third mission is posing important strategic and managerial challenges for universities. This study explores the relationship between university-business collaborations and academic excellence in order to examine the extent to which academic institutions can balance these objectives. Based on data from the UK Research Assessment Exercise 2001 at the level of the university department, we find no systematic positive or negative relationship between scientific excellence and engagement with industry. Across the disciplinary fields reported in the 2001 Research Assessment Exercise (i. e. engineering, hard sciences, biomedicine, social sciences and the humanities) the relationship between academic excellence and engagement with business is largely contingent on the institutional context of the university department. This paper adds to the growing body of literature on university engagement with business by examining this activity for the social sciences and the humanities. Our findings have important implications for the strategic management of university departments and for higher education policy related to measuring the performance of higher education research institutions. © 2013 Akadémiai Kiadó, Budapest, Hungary.

Complying with the NIH Public Access Policy - Copyright Considerations and Options

On January 11, 2008, the National Institutes of Health ('NIH') adopted a revised Public Access Policy for peer-reviewed journal articles reporting research supported in whole or in part by NIH funds. Under the revised policy, the grantee shall ensure that a copy of the author's final manuscript, including any revisions made during the peer review process, be electronically submitted to the National Library of Medicine's PubMed Central ('PMC') archive and that the person submitting the manuscript will designate a time not later than 12 months after publication at which NIH may make the full text of the manuscript publicly accessible in PMC. NIH adopted this policy to implement a new statutory requirement under which: The Director of the National Institutes of Health shall require that all investigators funded by the NIH submit or have submitted for them to the National Library of Medicine's PubMed Central an electronic version of their final, peer-reviewed manuscripts upon acceptance for publication to be made publicly available no later than 12 months after the official date of publication: Provided, That the NIH shall implement the public access policy in a manner consistent with copyright law. This White Paper is written primarily for policymaking staff in universities and other institutional recipients of NIH support responsible for ensuring compliance with the Public Access Policy. The January 11, 2008, Public Access Policy imposes two new compliance mandates. First, the grantee must ensure proper manuscript submission. The version of the article to be submitted is the final version over which the author has control, which must include all revisions made after peer review. The statutory command directs that the manuscript be submitted to PMC 'upon acceptance for publication.' That is, the author's final manuscript should be submitted to PMC at the same time that it is sent to the publisher for final formatting and copy editing. Proper submission is a two-stage process. The electronic manuscript must first be submitted through a process that requires input of additional information concerning the article, the author(s), and the nature of NIH support for the research reported. NIH then formats the manuscript into a uniform, XML-based format used for PMC versions of articles. In the second stage of the submission process, NIH sends a notice to the Principal Investigator requesting that the PMC-formatted version be reviewed and approved. Only after such approval has grantee's manuscript submission obligation been satisfied. Second, the grantee also has a distinct obligation to grant NIH copyright permission to make the manuscript publicly accessible through PMC not later than 12 months after the date of publication. This obligation is connected to manuscript submission because the author, or the person submitting the manuscript on the author's behalf, must have the necessary rights under copyright at the time of submission to give NIH the copyright permission it requires. This White Paper explains and analyzes only the scope of the grantee's copyright-related obligations under the revised Public Access Policy and suggests six options for compliance with that aspect of the grantee's obligation. Time is of the essence for NIH grantees. As a practical matter, the grantee should have a compliance process in place no later than April 7, 2008. More specifically, the new Public Access Policy applies to any article accepted for publication on or after April 7, 2008 if the article arose under (1) an NIH Grant or Cooperative Agreement active in Fiscal Year 2008, (2) direct funding from an NIH Contract signed after April 7, 2008, (3) direct funding from the NIH Intramural Program, or (4) from an NIH employee. In addition, effective May 25, 2008, anyone submitting an application, proposal or progress report to the NIH must include the PMC reference number when citing articles arising from their NIH funded research. (This includes applications submitted to the NIH for the May 25, 2008 and subsequent due dates.) Conceptually, the compliance challenge that the Public Access Policy poses for grantees is easily described. The grantee must depend to some extent upon the author(s) to take the necessary actions to ensure that the grantee is in compliance with the Public Access Policy because the electronic manuscripts and the copyrights in those manuscripts are initially under the control of the author(s). As a result, any compliance option will require an explicit understanding between the author(s) and the grantee about how the manuscript and the copyright in the manuscript are managed. It is useful to conceptually keep separate the grantee's manuscript submission obligation from its copyright permission obligation because the compliance personnel concerned with manuscript management may differ from those responsible for overseeing the author's copyright management. With respect to copyright management, the grantee has the following six options: (1) rely on authors to manage copyright but also to request or to require that these authors take responsibility for amending publication agreements that call for transfer of too many rights to enable the author to grant NIH permission to make the manuscript publicly accessible ('the Public Access License'); (2) take a more active role in assisting authors in negotiating the scope of any copyright transfer to a publisher by (a) providing advice to authors concerning their negotiations or (b) by acting as the author's agent in such negotiations; (3) enter into a side agreement with NIH-funded authors that grants a non-exclusive copyright license to the grantee sufficient to grant NIH the Public Access License; (4) enter into a side agreement with NIH-funded authors that grants a non-exclusive copyright license to the grantee sufficient to grant NIH the Public Access License and also grants a license to the grantee to make certain uses of the article, including posting a copy in the grantee's publicly accessible digital archive or repository and authorizing the article to be used in connection with teaching by university faculty; (5) negotiate a more systematic and comprehensive agreement with the biomedical publishers to ensure either that the publisher has a binding obligation to submit the manuscript and to grant NIH permission to make the manuscript publicly accessible or that the author retains sufficient rights to do so; or (6) instruct NIH-funded authors to submit manuscripts only to journals with binding deposit agreements with NIH or to journals whose copyright agreements permit authors to retain sufficient rights to authorize NIH to make manuscripts publicly accessible.

The student bullying of teachers in Irish second level schools: exploring the influence of historical low state intervention in education on the development of contemporary policy responses in Ireland

The student bullying of teachers (SBT) is a distinct and complex form of bullying with a multiplicity of diverse, changeable and intersecting causes which is experienced by and affects teachers in a variety of ways. SBT is both a national and an international phenomenon which is under-recognised in academic, societal and political spheres, resulting in limited conceptual understanding and awareness of the issue. This study explores teachers’ experiences of SBT behaviours in Irish second level schools as well as teachers’ perceptions regarding training, policies and supports in Ireland to address the issue. Specifically, the study seeks to explore the influence of historical low State intervention in education on contemporary policies and supports to deal with SBT in Ireland. A mixed methods approach involving a survey of 531 second level school teachers and 17 semi-structured interviews with teachers, Year Heads and representatives from teacher trade unions and school management bodies was employed to collect and analyse data. Findings indicate that SBT behaviours are prevalent in many forms in Irish second level schools. The hidden nature of the phenomenon has simultaneously contributed to and is reinforced by limited understanding of the issue as well as teachers’ reluctance to disclose their experiences. Findings reveal that teachers perceive the contemporary policies, training and support structures in Ireland to be inadequate in equipping them to effectively deal with SBT. State intervention in addressing SBT behaviours to date, has been limited, therefore many teachers are forced to respond to the issue based on their own initiatives and assumptions rather than from an informed critically reflective approach, supported by national guidelines and sufficient State investment. This has resulted in a piecemeal, un-coordinated and ad-hoc approach to SBT in Irish schools both in terms of teachers’ management of SBT behaviours and with respect to the supports extended to staff. The potential negative consequences of SBT behaviours on teachers’ wellbeing and professional performance and thus, on the education system itself, underlines the need for a strategic, evidence-based, resourced and integrated approach which includes, as a pivotal component, consultation with teachers, whose contribution to the process is crucial.

A methodological framework for studying policy coherence for development

The purpose of this article is to develop a methodological framework for analyzing Policy Coherence for Development (PCD). With this goal, we analyze different views of PCD in order to establish a comprehensive approach of Coherence adapted to globalization process. In this context, the article proposes a methodological framework based on four dimensions of analysis in CPD. In each dimen-sion, we set the areas and actors to investigate and we put forward research questions that could be use as a guide for a comprehensive approach to study PCD.

Revisioning assessment through a children’s rights approach: implications for policy, process and practice

The linkage between the impact of assessment and compliance with children’s rights is a connection, which although seemingly obvious, is nonetheless rarely made, particularly by governments, which, as signatories to the relevant human rights treaties, have the primary responsibility for ensuring that educational practice is compatible with international children’s rights standards. While some jurisdictions are explicit about an adherence to children’s rights frameworks in general policy documentation, such a commitment rarely features when the focus is on assessment and testing. Thus, in spite of significant public and academic attention given to the consequences of assessment for children and governments committed to working within children’s rights standards, the two are rarely considered together. This paper examines the implications for the policy, process and practice of assessment in light of international human rights standards. Three key children’s rights principles and standards are used as a critical lens to examine assessment policy and practice: (1) best interests; (2) non-discrimination; and (3) participation. The paper seeks new insights into the complexities of assessment practice from the critical perspective of children’s rights and argues that such standards not only provide a convenient benchmark for developing, implementing and evaluating assessment practices, but also acknowledge the significance of assessment in the delivery of children’s rights to, in and through education more generally.

Children's rights and educational policy in Europe: the implementation of the United Nations Convention on the Rights of the Child

This article aims to shed light on the impact of the United Nations Convention on the Rights of the Child (CRC) on education policy in Europe. The findings are based on a documentary analysis of the published reports of the Committee on the Rights of the Child (the Committee) on the implementation of the education rights in the CRC in every EU state. This included: a review of the state of children's rights to education in Europe as perceived by the Committee; a summary of the Committee's key recommendations for governments; and an assessment of whether the CRC can be considered to have influenced domestic education law and policies. The findings suggest that the CRC is having an impact on domestic education policy and that the child rights framework could be harnessed further by those seeking to influence government. The article concludes by reflecting on the factors which affect the processes of translating the CRC into policy and practice and explores the role that educationalists, both academic and practitioners, might play in its implementation.

The Role of Subjectivity and Knowledge Power Struggles in the Formation of Public Policy

There is a growing incentive for sociologists to demonstrate the use value of their research. Research ‘impact’ is a driver of research funding and a measure of academic standing. Academic debate on this issue has intensified since Burawoy’s (2004) call for a ‘public’ sociology. However the academy is no longer the sole or primary producer of knowledge and empirical sociologists need to contend with the ‘huge swathes’ of social data that now exist (Savage and Burrows, 2007). This article furthers these debates by considering power struggles between competing forms of knowledge. Using a case study, it specifically considers the power struggle between normative and empirical knowledge, and how providers of knowledge assert legitimacy for their truth claims. The article concludes that the idea of ‘impact’ and ‘use-value’ are extremely complex and depends in the policy context on knowledge power struggles, and on how policy makers want to view the world. © The Author(s) 2012

Politics, policy preferences and the evolution of Irish bureaucracy:A framework for analysis

Analysis of the Irish state's administrative system is an unaccountably neglected area of systematic academic inquiry. This is all the more difficult to account for in view of the dynamic relationship between government actors and the public bureaucracy in realizing political goals. This paper identifies some distinguishing institutional features and dominant trends in Irish politico-administrative governance, and suggests avenues for future inquiry. The paper begins with an examination of the literature on administrative system change, with a focus on the New Public Management literature. Following this, the Irish case is profiled, identifying the evolution of ministerial departments and of state agencies by successive Irish governments, including patterns of agency creation and termination over time. Particular attention is given to the period 1989-2010, which has been one of quite rapid and complex organizational change within the state's bureaucratic apparatus. © 2012 Political Studies Association of Ireland.

Using evidence in policy: The importance of mediating beliefs and practices

This article argues that to understand the use of evidence in policy, we need to examine how meanings and practices in the civil service shape what is accepted as knowledge, and how differences between the beliefs and values of the academy and the polity can impede the flow and transfer of knowledge. It considers the importance of social context and shared meanings in legitimating knowledge. Who counts as legitimate knowledge providers has expanded and here the role of stakeholder groups and experiential knowledge is of particular interest. How hierarchy, anonymity, and generalist knowledge within the civil service mediate the use of evidence in policy is examined. The difference in values and ideology of the civil service and the academy has implications for how academic research is interpreted and used to formulate policy and for its position in knowledge power struggles. There are particular issues about the social science nature of evidence to inform rural policy being mediated in a government department more used to dealing with natural science knowledge. This article is based on participant observation carried out in a UK Department of Agriculture and Rural Development. © 2013 The Author. Sociologia Ruralis © 2013 European Society for Rural Sociology.

Varieties of Economic Crisis, Varieties of Ideational Change: How and Why Macroeconomic Policy and Financial Regulation Differ

One of the principal tasks facing post-crash academic political economy is to analyse patterns of ideational change and the conditions that produce such change. What has been missing from the existing literature on ideational change at times of crises however, is a sense of how processes of persuasive struggle, and how the success of those ‘norm entrepreneurs’ arguing for ideational change is shaped by two contextual variables: the most immediate material symptoms and problems that a crisis displays (the variety of crisis); and the institutional character of the policy subsystem that agents have to operate within to affect change. Introducing these two variables into our accounts of persuasive struggle and ideational change enables us to deepen our understanding of the dynamics of ideational change at times of crisis. The article identifies that a quite rapid and radical intellectual change has been evident in the field of financial regulation in the form of an embrace of a macroprudential frame. In contrast in the field of macroeconomic policy - both monetary and fiscal policy, many pre-crash beliefs remain prominent, there is evidence of ideational stickiness and inertia, and despite some policy experimentation, overarching policy frameworks and their rationales have not been overhauled. The article applies Peter Hall’s framework of three orders of policy changes to help illuminate and explain the variation in patterns of change in the fields of financial regulation and macroeconomic policy since the financial crash of 2008. The different patterns of ideational change in macroeconomic policy and financial regulation in the post-crash period can be explained by timing and variety of crisis; sequencing of policy change; and institutional political differences between micro policy sub systems and macro policy systems.

Academic selection and Northern Ireland

An overview of research and public policy debate on academic selection in Northern Ireland. The chapter examines the outcomes of the major investigation of the effects of the selective system of secondary education published in 2000, including a consideration of comparative evidence collected in Scotland. The paper outlines the debate which followed the publication of the Burns Report and presents the current state of play in policy and practice.