Assessing university students' prior knowledge

The aim of this dissertation was to explore how different types of prior knowledge influence student achievement and how different assessment methods influence the observed effect of prior knowledge. The project started by creating a model of prior knowledge which was tested in various science disciplines. Study I explored the contribution of different components of prior knowledge on student achievement in two different mathematics courses. The results showed that the procedural knowledge components which require higher-order cognitive skills predicted the final grades best and were also highly related to previous study success. The same pattern regarding the influence of prior knowledge was also seen in Study III which was a longitudinal study of the accumulation of prior knowledge in the context of pharmacy. The study analysed how prior knowledge from previous courses was related to student achievement in the target course. The results implied that students who possessed higher-level prior knowledge, that is, procedural knowledge, from previous courses also obtained higher grades in the more advanced target course. Study IV explored the impact of different types of prior knowledge on students’ readiness to drop out from the course, on the pace of completing the course and on the final grade. The study was conducted in the context of chemistry. The results revealed again that students who performed well in the procedural prior-knowledge tasks were also likely to complete the course in pre-scheduled time and get higher final grades. On the other hand, students whose performance was weak in the procedural prior-knowledge tasks were more likely to drop out or take a longer time to complete the course. Study II explored the issue of prior knowledge from another perspective. Study II aimed to analyse the interrelations between academic self-beliefs, prior knowledge and student achievement in the context of mathematics. The results revealed that prior knowledge was more predictive of student achievement than were other variables included in the study. Self-beliefs were also strongly related to student achievement, but the predictive power of prior knowledge overruled the influence of self-beliefs when they were included in the same model. There was also a strong correlation between academic self-beliefs and prior-knowledge performance. The results of all the four studies were consistent with each other indicating that the model of prior knowledge may be used as a potential tool for prior knowledge assessment. It is useful to make a distinction between different types of prior knowledge in assessment since the type of prior knowledge students possess appears to make a difference. The results implied that there indeed is variation between students’ prior knowledge and academic self-beliefs which influences student achievement. This should be taken into account in instruction.

Kemian ylioppilaskokeen tehtävät summatiivisen arvioinnin välineenä

The main purpose of the research was to illustrate chemistry matriculation examination questions as a summative assessment tool, and represent how the questions have evolved over the years. Summative assessment and its various test item classifications, Finnish goal-oriented curriculum model, and Bloom’s Revised Taxonomy of Cognitive Objectives formed the theoretical framework for the research. The research data consisted of 257 chemistry questions from 28 matriculation examinations between 1996 and 2009. The analysed test questions were formulated according to the national upper secondary school chemistry curricula 1994, and 2003. Qualitative approach and theory-driven content analysis method were employed in the research. Peer review was used to guarantee the reliability of the results. The research was guided by the following questions: (a) What kinds of test item formats are used in chemistry matriculation examinations? (b) How the fundamentals of chemistry are included in the chemistry matriculation examination questions? (c) What kinds of cognitive knowledge and skills do the chemistry matriculation examination questions require? The research indicates that summative assessment was used diversely in chemistry matriculation examinations. The tests included various test item formats, and their combinations. The majority of the test questions were constructed-response items that were either verbal, quantitative, or experimental questions, symbol questions, or combinations of the aforementioned. The studied chemistry matriculation examinations seldom included selected-response items that can be either multiple-choice, alternate choice, or matching items. The relative emphasis of the test item formats differed slightly depending on whether the test was a part of an extensive general studies battery of tests in sciences and humanities, or a subject-specific test. The classification framework developed in the research can be applied in chemistry and science education, and also in educational research. Chemistry matriculation examinations are based on the goal-oriented curriculum model, and cover relatively well the fundamentals of chemistry included in the national curriculum. Most of the test questions related to the symbolism of chemical equation, inorganic and organic reaction types and applications, the bonding and spatial structure in organic compounds, and stoichiometry problems. Only a few questions related to electrolysis, polymers, or buffer solutions. None of the test questions related to composites. There were not any significant differences in the emphasis between the tests formulated according to the national curriculum 1994 or 2003. Chemistry matriculation examinations are cognitively demanding. The research shows that the majority of the test questions require higher-order cognitive skills. Most of the questions required analysis of procedural knowledge. The questions that only required remembering or processing metacognitive knowledge, were not included in the research data. The required knowledge and skill level varied slightly between the test questions in the extensive general studies battery of tests in sciences and humanities, and subject-specific tests administered since 2006. The proportion of the Finnish chemistry matriculation examination questions requiring higher-order cognitive knowledge and skills is very large compared to what is discussed in the research literature.

Current Care Guidelines for Cardiopulmonary Resuscitation : Implementation, skills and attitudes

Background: The national resuscitation guidelines were published in Finland in 2002 and are based on international guidelines published in 2000. The main goal of the national guidelines, available on the Internet free of charge, is early defibrillation by nurses in an institutional setting. Aim: To study possible changes in cardiopulmonary resuscitation (CPR) practices, especially concerning early defibrillation, nurses and students attitudes of guideline implementation and nurses and students ability to implement the guideline recommendations in clinical practices after publication of the Current Care (CC) guidelines for CPR 2002. Material and methods: CPR practices in Finnish health centres; especially concerning rapid defibrillation programmes, as well as the implementation of CC guidelines for CPR was studied in a mail survey to chief physicians of every health centre in Finland (Study I). The CPR skills using an automated external defibrillator (AED) were compared in a study including Objective stuctured clinical examination (OSCE) of resuscitation skills of nurses and nursing students in Finnish and Swedish hospital and institution (Studies II, III). Attitudes towards CPR-D and CPR guidelines among medical and nursing students and secondary hospital nurses were studied in surveys (Studies IV, V). The nurses receiving different CPR training were compared in a randomized trial including OSCE of CPR skills of nurses in Finnish Hospital (Study VI). Results: Two years after the publication, 40.7% of Finnish health centres used national resuscitation guidelines. The proportion of health centres having at least one AED (66%) and principle of nurse-performed defibrillation without the presence of a physician (42%) had increased. The CPR-D training was estimated to be insufficient regarding basic life support and advanced life support in the majority of health centres (Study I). CPR-D skills of nurses and nursing students in two specific Swedish and Finnish hospitals and institutions (Study II and III) were generally inadequate. The nurses performed better than the students and the Swedish nurses surpassed the Finnish ones. Geriatric nurses receiving traditional CPR-D training performed better than those receiving an Internet-based course but both groups failed to defibrillate within 60 s. Thus, the performance was not satisfactory even two weeks after traditional training (Study VI). Unlike the medical students, the nursing students did not feel competent to perform procedures recommended in the cardiopulmonary resuscitation guidelines including the defibrillation. However, the majority of nursing students felt confident about their ability to perform basic life support. The perceived ability to defibrillate correlated significantly with a positive attitude towards nurse-performed defibrillation and negatively with fear of damaging the patient s heart by defibrillation (Study IV). After the educational intervention, the nurses found their level of CPR-D capability more sufficient than before and felt more confident about their ability to perform defibrillation themselves. A negative attitude toward defibrillation correlated with perceived negative organisational attitudes toward cardiopulmonary resuscitation guidelines. After CPR-D education in the hospital, the majority (64%) of nurses hesitated to perform defibrillation because of anxiety and 27 % hesitated because of fear of injuring the patient. Also a negative personal attitude towards guidelines increased markedly after education (Study V). Conclusions: Although a significant change had occurred in resuscitation practices in primary health care after publication of national cardiopulmonary resuscitation guidelines the participants CPR-D skills were not adequate according to the CPR guidelines. The current way of teaching is unlikely to result in participants being able to perform adequate and rapid CPR-D. More information and more frequent training are needed to diminish anxiety concerning defibrillation. Negative beliefs and attitudes toward defibrillation affect the nursing students and nurses attitudes toward cardiopulmonary resuscitation guidelines. CPR-D education increased the participants self-confidence concerning CPR-D skills but it did not reduce their anxiety. AEDs have replaced the manual defibrillators in most institutions, but in spite of the modern devices the anxiety still exists. Basic education does not provide nursing students with adequate CPR-D skills. Thus, frequent training in the workplace has vital importance. This multi-professional program supported by the administration might provide better CPR-D skills. Distance learning alone cannot substitute for traditional small-group learning, tutored hands-on training is needed to learn practical CPR-D skills. Standardized testing would probably help controlling the quality of learning. Training of group-working skills might improve CPR performance.

Future chemistry teachers use of knowledge dimensions and high-order cognitive skills in pre-laboratory concept maps

This poster describes a pilot case study, which aim is to study how future chemistry teachers use knowledge dimensions and high-order cognitive skills (HOCS) in their pre-laboratory concept maps to support chemistry laboratory work. The research data consisted of 168 pre-laboratory concept maps that 29 students constructed as a part of their chemistry laboratory studies. Concept maps were analyzed by using a theory based content analysis through Anderson & Krathwohls' learning taxonomy (2001). This study implicates that novice concept mapper students use all knowledge dimensions and applying, analyzing and evaluating HOCS to support the pre-laboratory work.