A risk-based approach to course quality assurance

A decade ago, Queensland University of Technology (QUT) developed an innovative annual Courses Performance Report, but through incremental change, this report became quite labour-intensive. A new risk-based approach to course quality assurance, that consolidates voluminous data in a simple dashboard, responds to the changing context of the higher education sector. This paper will briefly describe QUT’s context and outline the second phase of implementation of this new approach to course quality assurance. The main components are: Individual Course Reports (ICRs), the Consolidated Courses Performance Report (CCPR), Underperforming Courses Status Update and the Strategic Faculty Courses Update (SFCU). These components together form a parsimonious and strategic annual cycle of reporting and place QUT in a positive position to respond to future sector change

Future directions in course quality assurance

The Course Quality Assurance System at Queensland University of Technology (QUT) has as its centrepiece an exemplar of data visualisation known as the Individual Course Report (ICR). This report provides every course coordinator with an annual snapshot of their performance data evaluated against QUT and national benchmarks. In this article, the impact of the ICR is explored through the case study of one undergraduate course identified as underperforming. The case study features an innovative, ethnographic approach to working with course teams and highlights the importance of context, collaboration and appropriate support in creating evidence-based action plans for course improvement.

Course quality assurance at a glance

From 2014, QUT will be adopting a life-cycle approach to Course Quality Assurance informed by a wider and richer range of historic, ‘live’ and ‘predictive’ course data. Key data elements continue to be grouped according to the three broad categories – Viability, Quality of Learning Environment and Outcomes – and are further supported with analytic data presented within tables and charts. Course Quality Assurance and this Consolidated Courses Performance Report illuminate aspects of courses from a data evidence base highlighting the strengths and weaknesses of our courses. It provides the framework and tools to achieve QUT's commitment to excellent graduate outcomes by drawing attention and focus to the quality of our courses and providing a structured approach for bringing about change. Our portfolio of courses forms a vital part of QUT, generating almost $600 million in 2013 alone. Real world courses are fundamental to the strength of the Institution; they are what our many thousands of current and future students are drawn to and invest their time and aspirations in. As we move through a period of some regulatory and deregulatory uncertainty, there is a greater need for QUT to monitor and respond to the needs and expectations of our students. The life-cycle approach, with its rich and predicative data, provides the best source of evidence we have had, to date, to assure the quality of our courses and their relevance in a rapidly changing higher education context.

Course evidence matrix : a collaborative evaluation using multiple lines of evidence

Welcome to the Evaluation of course matrix. This matrix is designed for highly qualified discipline experts to evaluate their course, major or unit in a systemic manner. The primary purpose of the Evaluation of course matrix is to provide a tool that a group of academic staff at universities can collaboratively review the assessment within a course, major or unit annually. The annual review will result in you being ready for an external curricula review at any point in time. This tool is designed for use in a workshop format with one, two or more academic staff, and will lead to an action plan for implementation. I hope you find this tool useful in your assessment review.

Acceptability, impact and sustainability of the national pilot quality assurance system for self management programs

Chronic condition self-management education and training interventions such as the Stanford Self Management Programs (SMP) have the capacity to improve health and quality of life of people with chronic conditions whilst reducing the use of health services. This is in line with the outcomes from the recent Council of Australian Governments’ meeting where it was indicated that self-management will be a centrepiece in forthcoming chronic disease initiatives.
Aim: report on a large national pilot quality assurance program involving the implementation and of an evaluation and quality monitoring system for SMPs including the provision of structured feedback to courses course leaders and service providers. During 2005/06 the quality assurance program was implemented at 11 diverse organisations across Australia. The program involved assisting organisations apply the 42-item Health Education Impact Questionnaire (HEIQ), a chronic disease health education outcome measure, and then observe and evaluate the value and impact of the quality program. Interviews with course leaders (n=60) and course participants (n=35) have elicited views about course quality and feedback processes.
Results: The evaluation revealed enablers and barriers to effective implementation and sustainability. Important enablers were:
- Course Leaders and organisations valued an Australia-wide system that provided feedback on course
quality and the impact on participants.
- Course Leaders were strongly personally motivated to respond appropriately to HEI-Q course
report feedback.
- Completing the questionnaire provided participants with the opportunity to reflect on issues that
emerge in the course content and reflect on their progression at the end of the SSMP.
Sustainability issues included:
- Organisations and course leaders require support, training and flexibility on how to administer and
manage the use of the HEI-Q.
- Availability of administrative resources in organisations to support the quality assurance activities.
- The requirement that course leaders are trained in interpreting HEI-Q course report data.
A quality improvement framework was developed which identified the actions required of key stakeholders to
support effective implementation.
Discussion: With the increasing endorsement of SMP across sectors it is important that course quality is known, is acceptable, and is communicated to stakeholders to inform and engender confidence in the SSMP. To effectively implement and sustain a quality improvement program for SMP, the processes and tools for measuring outcomes need to be responsive, flexible and easily integrated into the organisation and delivery of programs.

Online and Hybrid Course Prioritization Guide: 10 Strategies for Promoting Enrollment Growth and Student Success

Institutions of all shapes and sizes are investing significant sums to expand their portfolio of online and hybrid courses without specific institutional priorities in mind, often resulting in a mix of arbitrary, sub-scale offerings. This creates an unsustainably expensive disconnect between the institution’s online portfolio (largely steered by unit-level interests and capacity) and its overarching interest in using technology to increase access, improve student success, and grow revenue. This guide is designed to help institutional leaders prioritize scarce resources devoted to online and hybrid course development toward the most promising available opportunities. By targeting specific curricular "gaps," institutions can improve retention, reduce time-to-degree, regain or expand their share of currently enrolled student credit hours, or even attract new students to existing programs.

A holistic, institution-wide approach to building sessional staff capacity

Sessional Academics enhance students’ learning experience by bringing a diverse range of perspectives and expertise into the classroom. As industry specialists, research students, and recent graduates who have excelled in their courses, they complement the discipline expertise of career academics. With increasing casualization of the academic workforce, Sessional Academics now deliver the majority of face-to-face undergraduate teaching in Australian Universities. To enable them to realize their full potential as effective contributors to student learning and course quality, universities need to offer effective training and access to advice and support and facilitate engagement in university life. However, in the face of complex and diverse contexts, overwhelming numbers, and the transitory nature of sessional cohorts, few universities have developed a comprehensive, systematic approach. During the past three years at QUT, we have set out to develop a multifaceted approach to Sessional Academic support and development. In this paper I will explain why and how we have done so, and describe the range of strategies and programs we have developed. They include a central academic development program, which is structured and scaffolded with learning objectives and outcomes, and aligned with a graduate certificate in Academic Practice; a Sessional Academic Success program, which deploys experienced, school-based sessional academic success advisors to provide local support, build a sense of community, and offer discipline focused academic development; an online, dialogic communication strategy; and opportunities to present and be acknowledged for good learning and teaching practices. Together, these strategies have impacted on sessional academics’ confidence, learning and teaching capacity, reflection and engagement.

A study visit to a vitual company

To integrate study visits to different workplaces in higher education implies important benefits for the course quality. The study visit gives the students a better understanding for the real situations they will meet in working life. However for practical and economical reasons is that not always possible. The purpose of this project is to create a virtual company that shall replace the real one for study visits. The goal is to create a realistic picture and that intended use of it can come as close as possible to a real study visit. It is also important to facilitate linking theory and practice. The virtual company is built up by pictures, videos and text. All material is made available on a web page and when entering the students will meet a layout of the company. From that position is it possible to walk around and look at videos from different workstations. Besides that can they also listen to interviews with managers and representatives of staff as well as reading reports concerning productivity and the work environment. The focus of the study visit is work sciences, therefore the material also include some visualized information about work hazards. On the web page there are also a number of tasks for the students to carry out. Until the autumn 2011, 132 students at Dalarna University have visited and produced reports from the virtual company. They were studying in programs for mechanical engineering, production technicians and human resource management. An evaluation among some ten students showed that the study visit to the virtual company is flexible in time and effective, but that students wish to have even more detailed information about the company. Experiences from four years of use in a number of classes show that the concept is worth further development. Furthermore with production of new material the concept is likely to be applicable for other purposes.

A role for workforce competencies in evidence-based health promotion education

Education programs should be based on research about the knowledge and skills required for practice, rather than on intuition or tradition, but there is limited published curriculum research on health promotion education. This paper describes a case study of how workforce competencies have been used to assist evidence-based health promotion education in the areas of curriculum design, selection of assessment tasks and continuous quality assurance processes in an undergraduate program at an Australian university. A curriculum-competency mapping process successfully identified gaps and areas of overlap in an existing program. Previously published health promotion workforce competencies were effectively used in the process of selecting assessment items, providing clear guidelines for curriculum revision and a useful method to objectively assess competency content in an evidence informed framework. These health promotion workforce competencies constituted an additional tool to assess course quality. We recommend other tertiary institutions consider curriculum-competency mapping and curriculum based assessment selection as quality and evidence based curriculum review strategies.

Designing an e-portfolio for assurance of learning focusing on adoptability and learning analytics

The Assurance of Learning for Graduate Employability framework is a quality assurance model for curriculum enhancement for graduate employability, enabling graduates to achieve "the skills, understandings and personal attributes that make [them] more likely to secure employment and be successful in their chosen occupations to the benefit of themselves, the workforce, the community and the economy" (Yorke, 2006). Of particular note is the framework's dependence on three foundations, including easy access to integrated and accessible tools for staff and student self-management. In other words, this approach to curriculum quality depends on staff and student access to tools that enable them to self-manage their learning. This paper examines two aspects which informed the design of a student e-portfolio system, iPortfolio, intended for students' self-management of their learning, particularly recording evidence of their achievement of capabilities. The paper focuses on two particular considerations in the design of the iPortfolio: adoptability and learning analytics. Adoptability means the phase preceding adoption, whether students have the devices, platforms and technology skills to be able to use such an innovation. The iPortfolio also facilitates learning analytics: it has the capability to gather data related to learning indicators for course quality assurance purposes. Both adoptability and analytics are very dynamic fields: new devices, platforms and applications constantly spark changes in user habits, and policy changes mean institutions need to be able to provide new data, often at short notice. In the conclusion, the paper suggests how tools such as the iPortfolio can be designed for 'future proofing' and sustainability.

Engaging Faculty in Online Education: Rightsizing Incentives and Optimizing Support

: Colleges and universities of all types are pursuing increasingly ambitious goals for online education for a range of reasons—enhancing learning, increasing access, growing enrollment, managing costs. However, concerns about workload, support resources, autonomy, and course quality leave many faculty skeptical of online instruction, and most institutions expanding online offerings are struggling to get sufficient numbers of faculty both willing and prepared to teach online. This study presents best practices in managing the strategic and operational challenges associated with increasing the number of fully online and hybrid courses

A percepção de docentes, discentes e egressos do curso de engenharia civil - campus de Bauru: sobre algumas questões curriculares

Pós-graduação em Educação - FFC

Report on the practice based culminating experience as teaching assistant for "Pathology and Public Health" class taught at University of Texas School of Public Health, Houston

Objectives. The objectives of this report were to describe current best standards in online education, class competencies, class objectives, class activities and to compare the class competencies, objectives and activities undertaken with the current best practices in online teaching and to provide a list of recommendations based on the most efficacious practices. ^ Methods. Utilizing the key words- online teaching, national standards, quality, online courses, I: (1) conducted a search on Google to find the best standard for quality online courses; the search yielded National Standards for Quality Online Teaching as the gold standard in online course quality; (2) specified class objectives and competencies as well as major activities undertaken as a part of the class. Utilizing the Southern Regional Education Board evaluation checklist for online courses, I: (1) performed an analysis comparing the class activities, objectives, and competencies with the current best standards; (2) utilized the information obtained from the analysis and class experiences to develop recommendations for the most efficacious online teaching practices. ^ Results. The class met the criteria set by the Southern Regional Education Board for evaluating online classes completely in 75%, partially in 16% and did not meet the criteria in 9% cases. The majority of the parameters in which the class did not meet the standards (4 of 5) were due to technological reasons beyond the scope of the class instructor, teaching assistant and instructional design. ^ Discussion. Successful online teaching requires awareness of technology, good communication, methods, collaboration, reflection and flexibility. Creation of an online community, engaging online learners and utilizing different learning styles and assessment methods promote learning. My report proposes that online teaching should actively engage the students and teachers with multiple interactive strategies as evidenced from current best standards of online education and my “hands-on” work experience. ^ Conclusion. The report and the ideas presented are intended to create a foundation for efficacious practice on the online teaching platform. By following many of the efficacious online practices described in the report and adding from their own experiences, online instructors and teaching assistants can contribute to effective online learning. ^

Evaluación de la calidad pedagógica de los MOOC

Los MOOC han irrumpido de forma acelerada en el ámbito de la educación. Las principales universidades estadounidenses primero y, posteriormente, muchas otras –entre ellas, algunas españolas— están desarrollando a través de diversas plataformas en Internet, cursos bajo este formato. Al encontrarnos en una situación inicial de desarrollo de MOOC, son escasos los estudios sobre su evaluación. Por ello, el presente estudio ha realizado 129 evaluaciones a 52 MOOC ofertados por 10 plataformas. Se han analizado sus características pedagógicas a partir del Cuestionario de evaluación de la calidad de cursos virtuales (Arias, 2007). Del mismo modo se aborda la hipótesis de la existencia de diferencias estadísticamente significativas en cuanto a la calidad de los cursos en función de la plataforma que contiene los MOOC, analizando la influencia que el idioma o la presencia de una guía didáctica adecuada tiene sobre dicha calidad. Los resultados obtenidos en el presente trabajo no evidencian diferencias de forma generalizada entre los cursos, pero sí existen diferencias estadísticamente significativas en 5 de los 36 indicadores de calidad pedagógica propuestos.

Factors influencing university performance of associate in arts graduates transferring to the state university system

The purpose of this study was to examine the factorsbehind the failure rates of Associate in Arts (AA)graduates from Miami-Dade Community College (M-DCC) transferring to the Florida State University System (SUS). In M-DCC's largest disciplines, the university failure rate was 13% for Business & Management, 13% for Computer Science, and 14% for Engineering. Hypotheses tested were: Hypothesis 1 (H1): The lower division (LD) overall cumulative GPA and/or the LD major field GPA for AA graduates are predictive of the SUS GPA for the Business Management, Computer Science, and Engineering disciplines. Hypothesis 2 (H2): Demographic variables (age, race, gender) are predictive of performance at the university among M-DCC AA graduates in Engineering, Business & Management, and Computer Science. Hypothesis 3 (H3): Administrative variables (CLAST -College Level Academic Skills Test subtests) are predictive of university performance (GPA) for the Business/Management, Engineering, and Computer Science disciplines. Hypothesis 4 (H4): LD curriculum variables (course credits, course quality points) are predictive of SUS performance for the Engineering, Business/Management and Computer Science disciplines. Multiple Regression was the inferential procedureselected for predictions. Descriptive statistics weregenerated on the predictors. Results for H1 identified the LD GPA as the most significant variable in accounting for the variability of the university GPA for the Business & Management, Computer Science, and Engineering disciplines. For H2, no significant results were obtained for theage and gender variables, but the ethnic subgroups indicated significance at the .0001 level. However, differentials in GPA may not have been due directly to the race factor but, rather, to curriculum choices and performance outcomes while in the LD. The CLAST computation variable (H3) was a significant predictor of the SUS GPA. This is most likely due to the mathematics structure pervasive in these disciplines. For H4, there were two curriculum variables significant in explaining the variability of the university GPA (number of required critical major credits completed and quality of the student's performance for these credits). Descriptive statistics on the predictors indicated that 78% of those failing in the State University System had a LD major GPA (calculated with the critical required university credits earned and quality points of these credits) of less than 3.0; and 83% of those failing at the university had an overall community college GPA of less than 3.0.