A component model of methods for evaluation of the quality in education

Report published in the Proceedings of the National Conference on "Education in the Information Society", Plovdiv, May, 2013

Asleep or not asleep? Evaluation of the Quality of Patients’ Sleep in Critical Care Nursing

Sleep is important for the recovery of a critically ill patient, as lack of sleep is known to influence negatively a person’s cardiovascular system, mood, orientation, and metabolic and immune function and thus, it may prolong patients’ intensive care unit (ICU) and hospital stay. Intubated and mechanically ventilated patients suffer from fragmented and light sleep. However, it is not known well how non-intubated patients sleep. The evaluation of the patients’ sleep may be compromised by their fatigue and still position with no indication if they are asleep or not. The purpose of this study was to evaluate ICU patients’ sleep evaluation methods, the quality of non-intubated patients’ sleep, and the sleep evaluations performed by ICU nurses. The aims were to develop recommendations of patients’ sleep evaluation for ICU nurses and to provide a description of the quality of non-intubated patients’ sleep. The literature review of ICU patients’ sleep evaluation methods was extended to the end of 2014. The evaluation of the quality of patients’ sleep was conducted with four data: A) the nurses’ narrative documentations of the quality of patients’ sleep (n=114), B) the nurses’ sleep evaluations (n=21) with a structured observation instrument C) the patients’ self-evaluations (n=114) with the Richards-Campbell Sleep Questionnaire, and D) polysomnographic evaluations of the quality of patients’ sleep (n=21). The correspondence of data A with data C (collected 4–8/2011), and data B with data D (collected 5–8/2009) were analysed. Content analysis was used for the nurses’ documentations and statistical analyses for all the other data. The quality of non-intubated patients’ sleep varied between individuals. In many patients, sleep was light, awakenings were frequent, and the amount of sleep was insufficient as compared to sleep in healthy people. However, some patients were able to sleep well. The patients evaluated the quality of their sleep on average neither high nor low. Sleep depth was evaluated to be the worst and the speed of falling asleep the best aspect of sleep, on a scale 0 (poor sleep) to 100 (good sleep). Nursing care was mostly performed while the patients were awake, and thus the disturbing effect was low. The instruments available for nurses to evaluate the quality of patients’ sleep were limited and measured mainly the quantity of sleep. Nurses’ structured observatory evaluations of the quality of patients’ sleep were correct for approximately two thirds of the cases, and only regarding total sleep time. Nurses’ narrative documentations of the patients’ sleep corresponded with patients’ self-evaluations in just over half of the cases. However, nurses documented several dimensions of sleep that are not included in the present sleep evaluation instruments. They could be classified according to the components of the nursing process: needs assessment, sleep assessment, intervention, and effect of intervention. Valid, more comprehensive sleep evaluation methods for nurses are needed to evaluate, document, improve and study patients’ quality of sleep.

TEACHNJ: An Evaluation of Two Years Implementation

The Teacher Effectiveness and Accountability for the Children of New Jersey (TEACHNJ) Act was adopted by the New Jersey legislature in August 2012 with the intent to raise student achievement by improving the overall quality of instruction. As a result of this act, new teacher evaluation systems are being introduced in school districts across the state in an effort to more accurately assess teacher performance. The new teacher evaluations will be based on multiple classroom observations as well as the academic achievement of their students as measured on standardized tests. In addition, professional development opportunities are likely to change under this legislation, with schools customizing professional development programs to more effectively meet the needs of their teachers. The overarching question that informs our research is what impact will TEACH NJ have on the overall value of teacher evaluations and the quality of professional development opportunities offered to teachers. Data collected through survey research presents the pre-implementation practices (2011-2012 school year) as well as one year post-implementation practices (2013-2014) taking place in school districts throughout New Jersey. The findings reflect teachers’ perceptions of the value of the current teacher evaluation practices, the quality of the current professional development opportunities and the value the school administration places on teacher evaluations.

An evaluation of the impact of Inner City Development's Cooperative Home School: An educational alternative program to increase the quality and level of education in San Antonio's West Side community

The research study was intended to evaluate the effectiveness of Inner City Development's (I.C.D.) Cooperative Home School, an educational alternative program to the Title I public schools of San Antonio's West Side community. The study investigated students', parents' and tutors' perception of parental involvement and educational resources. The study also investigated each student's academic achievement. ^ The study found that students progressed toward expected math proficiency at a faster rate than they did in reading proficiency. However, because the target population size was small and a comparison group was not used, the results of this study are only suggestive. This research also indicated that study subjects believed students' quality and level of education increased substantially since program exposure. Study subjects mainly attributed the students' strides in academic performance to the increased amount of individualized attention students received in the small twelve-student class size. Study subjects were more satisfied with the home school's educational resources than those of the Title I public schools. Study subjects also perceived that parental involvement both at home and at school increased since enrollment in the home school program because: (1) there were more opportunities for involvement in the home school; and (2) parents felt closer to the tutors than the teachers in public school. ^ This evaluation also suggested improvements to program operations. With the help of additional volunteers, I.C.D. program operators could improve collection and organization of academic records. Furthermore, as suggested by program participants, science could be added to the curriculum. Lastly, a formal tutor orientation could be implemented to familiarize and train tutors on classroom management procedures. ^

School effectiveness: new managerialism, quality and the Japanisation of education

School effectiveness is a microtechnology of change. It is a relay device, which transfers macro policy into everyday processes and priorities in schools. It is part of the growing apparatus of performance evaluation. Change is brought about by a focus on the school as a site-based system to be managed. There has been corporate restructuring in response to the changing political economy of education. There are now new work regimes and radical changes in organizational cultures. Education, like other public services, is now characterized by a range of structural realignments, new relationships between purchasers and providers and new coalitions between management and politics. In this article, we will argue that the school effectiveness movement is an example of new managerialism in education. It is part of an ideological and technological process to industrialize educational productivity. That is to say, the emphasis on standards and standardization is evocative of production regimes drawn from industry. There is a belief that education, like other public services can be managed to ensure optimal outputs and zero defects in the educational product.

Evaluation of the Flanagan Quality of Life Scale for older adults

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)

Quality evaluation of the available Internet information regarding pain during orthodontic treatment

OBJECTIVE To investigate the quality of the data disseminated via the Internet regarding pain experienced by orthodontic patients. MATERIALS AND METHODS A systematic online search was performed for 'orthodontic pain' and 'braces pain' separately using five search engines. The first 25 results from each search term-engine combination were pooled for analysis. After excluding advertising sites, discussion groups, video feeds, and links to scientific articles, 25 Web pages were evaluated in terms of accuracy, readability, accessibility, usability, and reliability using recommended research methodology; reference textbook material, the Flesch Reading Ease Score; and the LIDA instrument. Author and information details were also recorded. RESULTS Overall, the results indicated a variable quality of the available informational material. Although the readability of the Web sites was generally acceptable, the individual LIDA categories were rated of medium or low quality, with average scores ranging from 16.9% to 86.2%. The orthodontic relevance of the Web sites was not accompanied by the highest assessment results, and vice versa. CONCLUSIONS The quality of the orthodontic pain information cited by Web sources appears to be highly variable. Further structural development of health information technology along with public referral to reliable sources by specialists are recommended.

Health outcomes, quality improvement and cost-effectiveness of the Community Diabetes Education (CoDE) program: Results of a randomized controlled trial

The objectives of this dissertation were to evaluate health outcomes, quality improvement measures, and the long-term cost-effectiveness and impact on diabetes-related microvascular and macrovascular complications of a community health worker-led culturally tailored diabetes education and management intervention provided to uninsured Mexican Americans in an urban faith-based clinic. A prospective, randomized controlled repeated measures design was employed to compare the intervention effects between: (1) an intervention group (n=90) that participated in the Community Diabetes Education (CoDE) program along with usual medical care; and (2) a wait-listed comparison group (n=90) that received only usual medical care. Changes in hemoglobin A1c (HbA1c) and secondary outcomes (lipid status, blood pressure and body mass index) were assessed using linear mixed-models and an intention-to-treat approach. The CoDE group experienced greater reduction in HbA1c (-1.6%, p<.001) than the control group (-.9%, p<.001) over the 12 month study period. After adjusting for group-by-time interaction, antidiabetic medication use at baseline, changes made to the antidiabetic regime over the study period, duration of diabetes and baseline HbA1c, a statistically significant intervention effect on HbA1c (-.7%, p=.02) was observed for CoDE participants. Process and outcome quality measures were evaluated using multiple mixed-effects logistic regression models. Assessment of quality indicators revealed that the CoDE intervention group was significantly more likely to have received a dilated retinal examination than the control group, and 53% achieved a HbA1c below 7% compared with 38% of control group subjects. Long-term cost-effectiveness and impact on diabetes-related health outcomes were estimated through simulation modeling using the rigorously validated Archimedes Model. Over a 20 year time horizon, CoDE participants were forecasted to have less proliferative diabetic retinopathy, fewer foot ulcers, and reduced numbers of foot amputations than control group subjects who received usual medical care. An incremental cost-effectiveness ratio of $355 per quality-adjusted life-year gained was estimated for CoDE intervention participants over the same time period. The results from the three areas of program evaluation: impact on short-term health outcomes, quantification of improvement in quality of diabetes care, and projection of long-term cost-effectiveness and impact on diabetes-related health outcomes provide evidence that a community health worker can be a valuable resource to reduce diabetes disparities for uninsured Mexican Americans. This evidence supports formal integration of community health workers as members of the diabetes care team.^

Evaluation of online tools as didactic resource in the university education

Recently, many efforts have been made in the academic world to adapt the new degrees to the new European Higher Education Area (EHEA). New technologies have been the most important factor to carry out this adaptation. In particular, the tools 2.0 have been spreading quickly, not just the Web 2.0, but even in all the educational levels. Nevertheless, it is now necessary to evaluate whether all these efforts and all the changes, carried out in order to obtain improved academic performance among students, have provided good results. Therefore, the aim of this paper is focused on studying the impact of the implementation of information and communication technologies (ICTs) in a subject belonging to a Master from the University of Alicante in the academic year (2010-2011). In special, it is an elective course called "Advanced Visual Ergonomics" from the Master of Clinical Optometry and Vision. The methodology used to teach this course differs from the traditional one in many respects. For example, one of the resources used for the development of this course is a blog developed specifically to coordinate a series of virtual works, whose purpose is that the student goes into specific aspects of the current topic. Next, the student participates in an active role by writing a personal assessment on the blog. However, in the course planning, there is an attendance to lessons, where the teacher presents certain issues in a more traditional way, that is, with a lecture supported with audiovisual materials, such as materials generated in powerpoint. To evaluate the quality of the results achieved with this methodology, in this work the personal assessment of the students, who have completed this course during this academic year, are collected. In particular, we want to know their opinion about the used resources, as well as the followed methodology. The tool used to collect this information was a questionnaire. This questionnaire evaluates different aspects of the course: a general opinion, quality of the received information, satisfaction about the followed methodology and the student´s critical awareness. The design of this questionnaire is very important to get conclusive information about the methodology followed in the course. The questionnaire has to have an adequate number of questions; whether it has many questions, it might be boring for the student who would pay no enough attention. The questions should be well-written, with a clear structure and message, to avoid confusion and an ambiguity. The questions should be objectives, without any suggestion for a desired answer. In addition, the questionnaire should be interesting to encourage the student´ s interest. In conclusion, this questionnaire developed for this subject provided good information to evaluate whether the methodology was a useful tool to teach "Advanced Visual Ergonomics". Furthermore, the student´s opinion collected by this questionnaire might be very helpful to improve this didactic resource.

Survey of Illinois school districts on the service quality provided by the Illinois State Board of Education and the Regional Offices of Education annual report.

"Pursuant to Public Act 89-212, enacted in 1995. The Act specifies that the survey should annually evaluate the nature and quality ..."

About Electronic Assessment, Accreditation and Management of the Quality of Teaching in Higher Education

The article examines the main approaches to external evaluation and accreditation in higher education. It also presents COMPASS-OK: a social network for electronic evaluation and management of the quality of education, which utilizes mechanisms for management of documentation flows and supports tools for modeling of evaluation methods and procedures.

A Soft Computing Approach to Quality Evaluation of General Chemistry Learning in Higher Education

In contemporary societies higher education must shape individuals able to solve problems in a workable and simpler manner and, therefore, a multidisciplinary view of the problems, with insights in disciplines like psychology, mathematics or computer science becomes mandatory. Undeniably, the great challenge for teachers is to provide a comprehensive training in General Chemistry with high standards of quality, and aiming not only at the promotion of the student’s academic success, but also at the understanding of the competences/skills required to their future doings. Thus, this work will be focused on the development of an intelligent system to assess the Quality-of-General-Chemistry-Learning, based on factors related with subject, teachers and students.

Evaluation of the quality of the teaching-learning process in undergraduate courses in Nursing

Objective: to identify aspects of improvement of the quality of the teaching-learning process through the analysis of tools that evaluated the acquisition of skills by undergraduate students of Nursing. Method: prospective longitudinal study conducted in a population of 60 second-year Nursing students based on registration data, from which quality indicators that evaluate the acquisition of skills were obtained, with descriptive and inferential analysis. Results: nine items were identified and nine learning activities included in the assessment tools that did not reach the established quality indicators (p<0.05). There are statistically significant differences depending on the hospital and clinical practices unit (p<0.05). Conclusion: the analysis of the evaluation tools used in the article "Nursing Care in Welfare Processes" of the analyzed university undergraduate course enabled the detection of the areas for improvement in the teaching-learning process. The challenge of education in nursing is to reach the best clinical research and educational results, in order to provide improvements to the quality of education and health care.

Applying The Maternal Near Miss Approach For The Evaluation Of Quality Of Obstetric Care: A Worked Example From A Multicenter Surveillance Study.

To assess quality of care of women with severe maternal morbidity and to identify associated factors. This is a national multicenter cross-sectional study performing surveillance for severe maternal morbidity, using the World Health Organization criteria. The expected number of maternal deaths was calculated with the maternal severity index (MSI) based on the severity of complication, and the standardized mortality ratio (SMR) for each center was estimated. Analyses on the adequacy of care were performed. 17 hospitals were classified as providing adequate and 10 as nonadequate care. Besides almost twofold increase in maternal mortality ratio, the main factors associated with nonadequate performance were geographic difficulty in accessing health services (P < 0.001), delays related to quality of medical care (P = 0.012), absence of blood derivatives (P = 0.013), difficulties of communication between health services (P = 0.004), and any delay during the whole process (P = 0.039). This is an example of how evaluation of the performance of health services is possible, using a benchmarking tool specific to Obstetrics. In this study the MSI was a useful tool for identifying differences in maternal mortality ratios and factors associated with nonadequate performance of care.