Local relevancy evaluation in the accreditation bodies for engineering master's programs

Accreditation models in the international context mainly consider the evaluation of learning outcomes and the ability of programs (or higher education institutions) to achieve the educational objectives stated in their mission. However, it is not clear if these objectives and therefore their outcomes satisfy real national and regional needs, a critical point in engineering master's programs, especially in developing countries. The aim of this paper is to study the importance of the local relevancy evaluation of these programs and to analyze the main models of quality assurance and accreditation bodies of USA, Europe and Latin America, in order to ascertain whether the relevancy is evaluated or not. After a literature review, we found that in a free-market economic context and international education, the accreditation of master’s programs follows an international accreditation model, and doesn´t take in account in most cases criteria and indicators for local relevancy. It concludes that it is necessary both, international accreditation to ensure the effectiveness of the program (achievement of learning outcomes) and the national accreditation through which it could ensure local relevancy of programs, for which we are giving some indicators.

The influence of transparency on self-evaluation as part of the university accreditation process in Peru.

In order to show the choice of transparency as the guiding principle of the accreditation process, the article evaluates its influence on the fundamental subprocess of self-evaluation, thereby confirming that transparency is an essential tool for continuous improvement of academic processes and those of educational quality management. It fosters educational innovation and permits the sustainability of the continuous accreditation process over time, resulting in greater probabilities of university self-regulation through systemization of the process, with the objective of continuous improvement of university degree programs. The article analyzes the influence of transparency on each activity of the self-evaluation process according to the Peruvian accreditation model prepared under the total quality approach, as a reference for other accreditation models, proposing concrete transparency actions and evaluating its influence on the stakeholder groups in the self-evaluation process, as well as on the efficiency and effectiveness of the process. It is concluded that transparency has a positive influence on the training of human capital and the formation of the university?s organizational culture, facilitating dissemination, understanding and involvement of the stakeholder groups in the continuous improvement of accreditation activities and increasing their acceptance of change and commitment to the process. It is confirmed that transparency contributes toward increasing the efficiency index of the self-evaluation process by reducing operating costs through adequate, accessible, timely contribution of information by the stakeholders and through the optimization of the time spent gathering relevant information. In addition, it is concluded that transparency contributes toward increasing the effectiveness index of self-evaluation by facilitating the achievement of its objectives through synthetic, useful, reliable interpretation of the education situation and the formulation of feasible improvement plans based on the adequacy, relevance, visibility, pertinence and truthfulness of the information analyzed.

Local relevance evaluation in the accreditation bodies for engineering masters programs

Accreditation models in the international context mainly consider the evaluation of learning outcomes and the ability of programs (or higher education institutions) to achieve the educational objectives stated in their mission. However, it is not clear if these objectives and therefore their outcomes satisfy real national and regional needs, a critical point in engineering master's programs, especially in developing countries. The aim of this paper is to study the importance of the local relevancy evaluation of these programs and to analyze the main models of quality assurance and accreditation bodies of USA, Europe and Latin America, in order to ascertain whether the relevancy is evaluated or not. After a literature review, we found that in a free-market economic context and international education, the accreditation of master's programs follows an international accreditation model, and doesńt take in account in most cases criteria and indicators for local relevancy. It concludes that it is necessary both, international accreditation to ensure the effectiveness of the program (achievement of learning outcomes) and the national accreditation through which it could ensure local relevancy of programs, for which we are giving some indicators.

Propuesta basada en el modelo internacional de tarjetas de acreditación para extranjeros como alternativa para la promoción del turismo en la ciudad de Bogotá

Basados en estadísticas publicadas por entidades oficiales como el Ministerio de Comercio, Industria y Turismo, el DANE y la Alcaldía de Bogotá donde se refleja un aumento significativo en las cifras de visitantes extranjeros y en la participación de la ciudad de Bogotá como principal destino turístico del país. Se comprende que la variación positiva en las cifras publicadas sobre el número de visitantes de todo tipo y eventos internacionales por parte de las entidades oficiales nombradas anteriormente, son el resultado de una gestión y enfoque claro que estos organismos han logrado desarrollar en su intento por hacer más competitivo y sostenible el turismo de la ciudad de Bogotá, dentro del sector turismo en Colombia. Ese enfoque de hacer más competitivo el turismo en Bogotá hace que actualmente la gestión de los programas de desarrollo nacional y distrital brinde oportunidades de acceso, apoyo y tendencia de crecimiento en la oferta turística que hace muy atractiva la inversión en el sector, razón por la cual este documento pretende generar una propuesta para adaptar un modelo de acreditación a extranjeros que actualmente funciona en diferentes capitales del mundo como España o Nueva York, ajustado de acuerdo a un previo análisis del entorno y las características del sector turístico en Bogotá y en Colombia. La propuesta desarrollada estructura todas las características del servicio, su funcionamiento y las políticas de mercadeo. Esta definición permitirá medir la viabilidad a nivel de mercado y los resultados a nivel financiero aterrizando la propuesta a una posible implementación en el corto plazo.

Modelo de gestión para la atención integral de pacientes con enfermedades huérfanas o raras en Colombia

Las enfermedades raras o huérfanas corresponden a aquellas con baja prevalencia en la población, y en varios países tienen una definición distinta de acuerdo con el número de pacientes que afectan en la población. La Organización Mundial de la Salud (OMS), las define como un trastorno que afecta de 650 a 1.000 personas por millón de habitantes, de las que se han identificado alrededor de 7.000. En Colombia su prevalencia es menor de 1 por cada 5.000 personas y comprenden: las enfermedades raras, las ultra-huérfanas y las olvidadas. Los pacientes con este tipo de enfermedades imponen retos a los sistemas sanitarios, pues si bien afectan a un bajo porcentaje de la población, su atención implica una alta carga económica por los costos que involucra su atención, la complejidad en su diagnóstico, tratamiento, seguimiento y rehabilitación. El abordaje de las enfermedades raras requiere un manejo interdisciplinar e intersectorial, lo que implica la organización de cada actor del sistema sanitario para su manejo a través de un modelo que abraque las dinámicas posibles entre ellos y las competencias de cada uno. Por lo anterior, y teniendo en cuenta la necesidad de formular políticas sanitarias específicas para la gestión de estas enfermedades, el presente trabajo presenta una aproximación a la formulación de un modelo de gestión para la atención integral de pacientes con enfermedades raras en Colombia. Esta investigación describe los distintos elementos y características de los modelos de gestión clínica y de las enfermedades raras a través de una revisión de literatura, en la que se incluye la descripción de los distintos actores del Sistema de Salud Colombiano, relacionados con la atención integral de estos pacientes para la documentación de un modelo de gestión integral.

Verifying a Student Engagement, Success and Retention Maturity Model (SESR-MM): A reality check of the model using data derived from three universities

Australian higher education institutions (HEIs) have entered a new phase of regulation and accreditation which includes performance-based funding relating to the participation and retention of students from social and cultural groups previously underrepresented in higher education. However, in addressing these priorities, it is critical that HEIs do not further disadvantage students from certain groups by identifying them for attention because of their social or cultural backgrounds, circumstances which are largely beyond the control of students. In response, many HEIs are focusing effort on university-wide approaches to enhancing the student experience because such approaches will enhance the engagement, success and retention of all students, and in doing so, particularly benefit those students who come from underrepresented groups. Measuring and benchmarking student experiences and engagement that arise from these efforts is well supported by extensive collections of student experience survey data. However no comparable instrument exists that measures the capability of institutions to influence and/or enhance student experiences where capability is an indication of how well an organisational process does what it is designed to do (Rosemann & de Bruin, 2005). We have proposed that the concept of a maturity model (Marshall, 2010; Paulk, 1999) may be useful as a way of assessing the capability of HEIs to provide and implement student engagement, success and retention activities and we are currently articulating a Student Engagement, Success and Retention Maturity Model (SESR-MM), (Clarke, Nelson & Stoodley, 2012; Nelson, Clarke & Stoodley, 2012). Our research aims to address the current gap by facilitating the development of an SESR-MM instrument that aims (i) to enable institutions to assess the capability of their current student engagement and retention programs and strategies to influence and respond to student experiences within the institution; and (ii) to provide institutions with the opportunity to understand various practices across the sector with a view to further improving programs and practices relevant to their context. Our research extends the generational approach which has been useful in considering the evolutionary nature of the first year experience (FYE) (Wilson, 2009). Three generations have been identified and explored: First generation approaches that focus on co-curricular strategies (e.g. orientation and peer programs); Second generation approaches that focus on curriculum (e.g. pedagogy, curriculum design, and learning and teaching practice); and third generation approaches—also referred to as transition pedagogy—that focus on the production of an institution-wide integrated holistic intentional blend of curricular and co-curricular activities (Kift, Nelson & Clarke, 2010). Our research also moves beyond assessments of students’ experiences to focus on assessing institutional processes and their capability to influence student engagement. In essence, we propose to develop and use the maturity model concept to produce an instrument that will indicate the capability of HEIs to manage and improve student engagement, success and retention programs and strategies. The issues explored in this workshop are (i) whether the maturity model concept can be usefully applied to provide a measure of institutional capability for SESR; (ii) whether the SESR-MM can be used to assess the maturity of a particular set of institutional practices; and (iii) whether a collective assessment of an institution’s SESR capabilities can provide an indication of the maturity of the institution’s SESR activities. The workshop will be approached in three stages. Firstly, participants will be introduced to the key characteristics of maturity models, followed by a discussion of the SESR-MM and the processes involved in its development. Secondly, participants will be provided with resources to facilitate the development of a maturity model and an assessment instrument for a range of institutional processes and related practices. In the final stage of the workshop, participants will “assess” the capability of these practices to provide a collective assessment of the maturity of these processes. References Australian Council for Educational Research. (n.d.). Australasian Survey of Student Engagement. Retrieved from http://www.acer.edu.au/research/ausse/background Clarke, J., Nelson, K., & Stoodley, I. (2012, July). The Maturity Model concept as framework for assessing the capability of higher education institutions to address student engagement, success and retention: New horizon or false dawn? A Nuts & Bolts presentation at the 15th International Conference on the First Year in Higher Education, “New Horizons,” Brisbane, Australia. Department of Education, Employment and Workplace Relations. (n.d.). The University Experience Survey. Advancing quality in higher education information sheet. Retrieved from http://www.deewr.gov.au/HigherEducation/Policy/Documents/University_Experience_Survey.pdf Kift, S., Nelson, K., & Clarke, J. (2010) Transition pedagogy - a third generation approach to FYE: A case study of policy and practice for the higher education sector. The International Journal of the First Year in Higher Education, 1(1), pp. 1-20. Marshall, S. (2010). A quality framework for continuous improvement of e-Learning: The e-Learning Maturity Model. Journal of Distance Education, 24(1), 143-166. Nelson, K., Clarke, J., & Stoodley, I. (2012). An exploration of the Maturity Model concept as a vehicle for higher education institutions to assess their capability to address student engagement. A work in progress. Submitted for publication. Paulk, M. (1999). Using the Software CMM with good judgment, ASQ Software Quality Professional, 1(3), 19-29. Wilson, K. (2009, June–July). The impact of institutional, programmatic and personal interventions on an effective and sustainable first-year student experience. Keynote address presented at the 12th Pacific Rim First Year in Higher Education Conference, “Preparing for Tomorrow Today: The First Year as Foundation,” Townsville, Australia. Retrieved from http://www.fyhe.com.au/past_papers/papers09/ppts/Keithia_Wilson_paper.pdf

A model for enhancing assessment and teaching practice at the coalface : Insights from a Fellow-In-Residence engagement program

Australian universities are currently engaging with new governmental policies and regulations that require them to demonstrate enhanced quality and accountability in teaching and research. The development of national academic standards for learning outcomes in higher education is one such instance of this drive for excellence. These discipline-specific standards articulate the minimum, or Threshold Learning Outcomes, to be addressed by higher education institutions so that graduating students can demonstrate their achievement to their institutions, accreditation agencies, and industry recruiters. This impacts not only on the design of Engineering courses (with particular emphasis on pedagogy and assessment), but also on the preparation of academics to engage with these standards and implement them in their day-to-day teaching practice on a micro level. This imperative for enhanced quality and accountability in teaching is also significant at a meso level, for according to the Australian Bureau of Statistics, about 25 per cent of teachers in Australian universities are aged 55 and above and more than 54 per cent are aged 45 and above (ABS, 2006). A number of institutions have undertaken recruitment drives to regenerate and enrich their academic workforce by appointing capacity-building research professors and increasing the numbers of early- and mid-career academics. This nationally driven agenda for quality and accountability in teaching permeates also the micro level of engineering education, since the demand for enhanced academic standards and learning outcomes requires both a strong advocacy for a shift to an authentic, collaborative, outcomes-focused education and the mechanisms to support academics in transforming their professional thinking and practice. Outcomes-focused education means giving greater attention to the ways in which the curriculum design, pedagogy, assessment approaches and teaching activities can most effectively make a positive, verifiable difference to students’ learning. Such education is authentic when it is couched firmly in the realities of learning environments, student and academic staff characteristics, and trustworthy educational research. That education will be richer and more efficient when staff works collaboratively, contributing their knowledge, experience and skills to achieve learning outcomes based on agreed objectives. We know that the school or departmental levels of universities are the most effective loci of changes in approaches to teaching and learning practices in higher education (Knight & Trowler, 2000). Heads of Schools are being increasingly entrusted with more responsibilities - in addition to setting strategic directions and managing the operational and sometimes financial aspects of their school, they are also expected to lead the development and delivery of the teaching, research and other academic activities. Guiding and mentoring individuals and groups of academics is one critical aspect of the Head of School’s role. Yet they do not always have the resources or support to help them mentor staff, especially the more junior academics. In summary, the international trend in undergraduate engineering course accreditation towards the demonstration of attainment of graduate attributes poses new challenges in addressing academic staff development needs and the assessment of learning. This paper will give some insights into the conceptual design, implementation and empirical effectiveness to date, of a Fellow-In-Residence Engagement (FIRE) program. The program is proposed as a model for achieving better engagement of academics with contemporary issues and effectively enhancing their teaching and assessment practices. It will also report on the program’s collaborative approach to working with Heads of Schools to better support academics, especially early-career ones, by utilizing formal and informal mentoring. Further, the paper will discuss possible factors that may assist the achievement of the intended outcomes of such a model, and will examine its contributions to engendering an outcomes-focussed thinking in engineering education.

A critical assessment of the Australian OHS accreditation system's "Body of Knowledge (BoK)"

In response to an increasing perception of poor OHS consultancy quality amongst the Australian public, regulator and OHS professionals, the Safety Institute Australia (SIA) was tasked by the Victorian government to establish an accreditation process for OHS professionals. The OHS accreditation board decided to base its accreditation on a core "body of knowledge" (BoK), against which applicants are assesssed. While the foundation and structure of the BoK is unclear, the BoK consists of a collection of essays from a variety of invited authors. The BoK comprises about 811 pages in 34 chapters, with significant redundancy and considerable subjective components. The SIA BoK is benchmarked against two international best-practices, the German "Core Definition, Object Catalog and Research Domains of Labour Science (Ergonomics)" (Luzcak, Volpert, Raeithel & Schwier, 1989)(100 pages) and the American "Core Competency Model" for the "Master's Degree in Public Health" (Association of Schools of Public Health, 2006) (21 pages). Both "core definition" and "core competency model" are on a comparative level to the BoK. While the German expert panel consisted of 14 eminent professors, the American panel consisted of 135 members, organized in 6 groups chaired by discipline leading academics. The Australian approach employed a broad approach, where 137 professionals, consultants, emerging academics and academics contributed to 8 workshops. Both the German and the American panels maintained an open communication amongst members and with the discipline community throughout the process, whereas SIA applied an open and directed peer-review process. Moreover, the German process involved an analysis of all congress content and journal publications in the scientific domain in a set timeframe, which were then systematically clustered. These results were further expanded by structured interviews with 38 professors in the discpline, grasping their research and teaching practice. The American workgroup however assumed core scientific areas, underlying the domain. Based upon the a-priori assumption, they then established well defined competencies across all areas using a modified Delphi process. Although the BoK attempts to explore the knowledge in the OHS domain without an imposed structure in a bottom-up approach, it does not result in a structured systematic of the science. We conclude that the outcome of the German, rigorous academic approach, and the US American democratic approach under unambiguous academic leadership both outperform the Australian advocacy group approach. This product was determined for both structure and content of the taxonomy delivered through the processes.

A higher education quality assurance model for small states : the Maldives case study

Increasing globalisation and local expansion of Higher Education presents challenges to manage quality of the education services. This study investigated key stakeholders' perspectives on what constitutes key elements and attributes of an effective Quality Assurance (QA) system in Higher Education. The findings highlighted the need for: i) legislation to support a strong QA regulatory framework, ii) independence of the QA agency, iii) development of minimum quality standards through broad stakeholder involvement, and iv) a cyclical approach. The findings of this study proposed a QA model which has implications for strengthening of HE QA systems of Small State.

Moderation practices in a faculty of education : the four discourse model

Moderation of student assessment is a critical component of teaching and learning in contemporary universities. In Australia, moderation is mandated through university policies and through the new national university accreditation authority, Tertiary Education Quality and Standards Agency which began operations in late January 2012 (TEQSA, 2012). The TEQSA requirement to declare details of moderation and any other arrangements used to support consistency and reliability of assessment and grading across each subject in the course of study is a radical step intended to move toward heightened accountability and greater transparency in the tertiary sector as well as entrenching evidence-based practice in the management of Australian academic programs. In light of this reform, the purpose of this project was to investigate and analyse current moderation practices operating within a faculty of education at a large urban university in Queensland, Australia. This qualitative study involved interviews with the unit coordinators (n=21) and tutors (n=8) of core undergraduate education units and graduate diploma units within the faculty. Four distinct discourses of moderation that academics drew on to discuss their practices were identified in the study. These were: equity, justification, community building, and accountability. These discourses, together with recommendations for changes to moderation practices are discussed in this paper.

Federally regulated institutional review boards: The aspects of a "model" IRB---Is the current system in need of a tune up or complete overhaul?

Institutional Review Boards (IRBs) are the primary gatekeepers for the protection of ethical standards of federally regulated research on human subjects in this country. This paper focuses on what general, broad measures that may be instituted or enhanced to exemplify a "model IRB". This is done by examining the current regulatory standards of federally regulated IRBs, not private or commercial boards, and how many of those standards have been found either inadequate or not generally understood or followed. The analysis includes suggestions on how to bring about changes in order to make the IRB process more efficient, less subject to litigation, and create standardized educational protocols for members. The paper also considers how to include better oversight for multi-center research, increased centralization of IRBs, utilization of Data Safety Monitoring Boards when necessary, payment for research protocol review, voluntary accreditation, and the institution of evaluation/quality assurance programs. ^ This is a policy study utilizing secondary analysis of publicly available data. Therefore, the research for this paper focuses on scholarly medical/legal journals, web information from the Department of Health and Human Services, Federal Drug Administration, and the Office of the Inspector General, Accreditation Programs, law review articles, and current regulations applicable to the relevant portions of the paper. ^ Two issues are found to be consistently cited by the literature as major concerns. One is a need for basic, standardized educational requirements across all IRBs and its members, and secondly, much stricter and more informed management of continuing research. There is no federally regulated formal education system currently in place for IRB members, except for certain NIH-based trials. Also, IRBs are not keeping up with research once a study has begun, and although regulated to do so, it does not appear to be a great priority. This is the area most in danger of increased litigation. Other issues such as voluntary accreditation and outcomes evaluation are slowing gaining steam as the processes are becoming more available and more sought after, such as JCAHO accrediting of hospitals. ^ Adopting the principles discussed in this paper should promote better use of a local IRBs time, money, and expertise for protecting the vulnerable population in their care. Without further improvements to the system, there is concern that private and commercial IRBs will attempt to create a monopoly on much of the clinical research in the future as they are not as heavily regulated and can therefore offer companies quicker and more convenient reviews. IRBs need to consider the advantages of charging for their unique and important services as a cost of doing business. More importantly, there must be a minimum standard of education for all IRB members in the area of the ethical standards of human research and a greater emphasis placed on the follow-up of ongoing research as this is the most critical time for study participants and may soon lead to the largest area for litigation. Additionally, there should be a centralized IRB for multi-site trials or a study website with important information affecting the trial in real time. There needs to be development of standards and metrics to assess the performance of the IRBs for quality assurance and outcome evaluations. The boards should not be content to run the business of human subjects' research without determining how well that function is actually being carried out. It is important that federally regulated IRBs provide excellence in human research and promote those values most important to the public at large.^

Can accreditation work as a tool for quality improvement in public health? A critical review

Public health departments play an important role in promoting and preserving the health of communities. The lack of a system to ensure their quality and accountability led to the development of a national voluntary accreditation program by Public Health Accreditation Board (PHAB). The concept that accreditation will lead to quality improvement in public health which will ultimately lead to healthy communities seems intuitive but lacks a robust body of evidence. A critical review of literature was conducted to explore if accreditation can lead to quality improvement in public health. The articles were selected from publically available databases using a specific set of criteria for inclusion, exclusion, and appraisal. To understand the relationship between accreditation and quality improvement, the potential strengths and limitations of accreditation process were evaluated. Recommendations for best practices are suggested so that public health accreditation can yield maximum benefits. A logic model framework to help depict the impact of accreditation on various levels of public health outcomes is also discussed in this thesis. The literature review shows that existing accreditation programs in other industries show limited but encouraging evidence that accreditation will improve quality and strengthen the delivery of public health services. While progress in introducing accreditation in public health can be informed by other accredited industries, the public health field has its own set of challenges. Providing incentives, creating financing strategies, and having a strong leadership will allow greater access to accreditation by all public health departments. The suggested recommendations include that continuous evaluation, public participation, systems approach, clear vision, and dynamic standards should become hallmarks of the accreditation process. Understanding the link between accreditation, quality improvement, and health outcomes will influence the successful adoption and implementation of the public health accreditation program. This review of literature suggests that accreditation is an important step in improving the quality of public health departments and in ultimately improving the health of communities. However, accreditation should be considered in an integrated system of tools and approaches to improve the public health practice. Hence, it is a means to an end - not an end unto itself.^

A component model of methods for evaluation of the quality in education

Report published in the Proceedings of the National Conference on "Education in the Information Society", Plovdiv, May, 2013

Using accreditation criteria for collaborative quality enhancement

This paper describes a process to enhance the quality of higher education. At the heart of the process is a cross-sparring collaborative model, whereby institutions are critical friends. This is based on a prior self-evaluation, where the institution / programme identifies quality criteria it wants to improve. Part of the process is to ensure the documentation of best practices so that they can be shared with others in a so called market place. Linking the best practices to a criterion makes them searchable on a large scale. Optimal pairings of institutions can then take place for the cross-sparring activities.