Kemian ylioppilaskokeen tehtävät summatiivisen arvioinnin välineenä

The main purpose of the research was to illustrate chemistry matriculation examination questions as a summative assessment tool, and represent how the questions have evolved over the years. Summative assessment and its various test item classifications, Finnish goal-oriented curriculum model, and Bloom’s Revised Taxonomy of Cognitive Objectives formed the theoretical framework for the research. The research data consisted of 257 chemistry questions from 28 matriculation examinations between 1996 and 2009. The analysed test questions were formulated according to the national upper secondary school chemistry curricula 1994, and 2003. Qualitative approach and theory-driven content analysis method were employed in the research. Peer review was used to guarantee the reliability of the results. The research was guided by the following questions: (a) What kinds of test item formats are used in chemistry matriculation examinations? (b) How the fundamentals of chemistry are included in the chemistry matriculation examination questions? (c) What kinds of cognitive knowledge and skills do the chemistry matriculation examination questions require? The research indicates that summative assessment was used diversely in chemistry matriculation examinations. The tests included various test item formats, and their combinations. The majority of the test questions were constructed-response items that were either verbal, quantitative, or experimental questions, symbol questions, or combinations of the aforementioned. The studied chemistry matriculation examinations seldom included selected-response items that can be either multiple-choice, alternate choice, or matching items. The relative emphasis of the test item formats differed slightly depending on whether the test was a part of an extensive general studies battery of tests in sciences and humanities, or a subject-specific test. The classification framework developed in the research can be applied in chemistry and science education, and also in educational research. Chemistry matriculation examinations are based on the goal-oriented curriculum model, and cover relatively well the fundamentals of chemistry included in the national curriculum. Most of the test questions related to the symbolism of chemical equation, inorganic and organic reaction types and applications, the bonding and spatial structure in organic compounds, and stoichiometry problems. Only a few questions related to electrolysis, polymers, or buffer solutions. None of the test questions related to composites. There were not any significant differences in the emphasis between the tests formulated according to the national curriculum 1994 or 2003. Chemistry matriculation examinations are cognitively demanding. The research shows that the majority of the test questions require higher-order cognitive skills. Most of the questions required analysis of procedural knowledge. The questions that only required remembering or processing metacognitive knowledge, were not included in the research data. The required knowledge and skill level varied slightly between the test questions in the extensive general studies battery of tests in sciences and humanities, and subject-specific tests administered since 2006. The proportion of the Finnish chemistry matriculation examination questions requiring higher-order cognitive knowledge and skills is very large compared to what is discussed in the research literature.

Reduced withdrawal and failure rates of accelerated nursing students enrolled in pharmacology is associated with a supportive intervention

Background To reduce nursing shortages, accelerated nursing programs are available for domestic and international students. However, the withdrawal and failure rates from these programs may be different than for the traditional programs. The main aim of our study was to improve the retention and experience of accelerated nursing students. Methods The academic background, age, withdrawal and failure rates of the accelerated and traditional students were determined. Data from 2009 and 2010 were collected prior to intervention. In an attempt to reduce the withdrawal of accelerated students, we set up an intervention, which was available to all students. The assessment of the intervention was a pre-post-test design with non-equivalent groups (the traditional and the accelerated students). The elements of the intervention were a) a formative website activity of some basic concepts in anatomy, physiology and pharmacology, b) a workshop addressing study skills and online resources, and c) resource lectures in anatomy/physiology and microbiology. The formative website and workshop was evaluated using questionnaires. Results The accelerated nursing students were five years older than the traditional students (p < 0.0001). The withdrawal rates from a pharmacology course are higher for accelerated nursing students, than for traditional students who have undertaken first year courses in anatomy and physiology (p = 0.04 in 2010). The withdrawing students were predominantly the domestic students with non-university qualifications or equivalent experience. The failure rates were also higher for this group, compared to the traditional students (p = 0.05 in 2009 and 0.03 in 2010). In contrast, the withdrawal rates for the international and domestic graduate accelerated students were very low. After the intervention, the withdrawal and failure rates in pharmacology for domestic accelerated students with non-university qualifications were not significantly different than those of traditional students. Conclusions The accelerated international and domestic graduate nursing students have low withdrawal rates and high success rates in a pharmacology course. However, domestic students with non-university qualifications have higher withdrawal and failure rates than other nursing students and may be underprepared for university study in pharmacology in nursing programs. The introduction of an intervention was associated with reduced withdrawal and failure rates for these students in the pharmacology course.

Creating employability skills in SMEs: Modification through interaction

This paper is concerned with the degree to which the graduate skills required by industry are developed in Australian universities. Despite acknowledgement of the need to increase the graduate skills of students, it would seem that the stated intentions of Australian universities in this respect do not yet meet the expectations of industry. The development of an enterprise program at the University of Tasmania provides by way of example, support that the development of industry-desired skills is possible alongside the desirable knowledge outcomes of a university. It is argued that lecturers and students must give and accept more responsibility for learning to enable the development of desirable graduate skills.

Constructive alignment: A journey for new eyes

The needs of students engaged in enterprise education programs are of ever growing importance. This paper considers the pedagogical challenges that confront the designers of such-programs. It is argued that it is the designer's mindset that will most likely determine the program's outcomes. That, regardless of where such programs reside, their development should be guided by a learner-centred approach. The recently developed hic et nunc framework, provides an example of such a student-centred approach. The process through which student learning outcomes occur is argued to be essentially Darwinian in nature. Taking into account both knowledge and skills, it is also argued that assessment of desirable learning outcomes should occur in visible interaction spaces. That the failure to eliminate invisible interaction spaces from such programs is an invitation for criticism from those who favour a more traditional lecturer-centred approach to teaching and learning.

Intranet Alman käytettävyydestä

Usability testing is a productive and reliable method for evaluating the usability of software. Planning and implementing the test and analyzing its results is typically considered time-consuming, whereas applying usability methods in general is considered difficult. Because of this, usability testing is often priorized lower than more concrete issues in software engineering projects. Intranet Alma is a web service, users of which consist of students and personnel of the University of Helsinki. Alma was published in 2004 at the opening ceremony of the university. It has 45 000 users, and it replaces several former university network services. In this thesis, the usability of intranet Alma is evaluated with usability testing. The testing method applied has been lightened to make its taking into use as easy as possible. In the test, six students each tried to solve nine test tasks with Alma. As a result concrete usability problems were described in the final test report. Goal-orientation was given less importance in the applied usability testing. In addition, the system was tested only with test users from the largest user group. Usability test found general usability problems that occurred no matter the task or the user. However, further evaluation needs to be done: in addition to the general usability problems, there are task-dependent problems, solving of which requires thorough gathering of users goals. In the basic structure and central functionality of Alma, for example in navigation, there are serious and often repeating usability problems. It would be of interest to verify the designed user interface solutions to these problems before taking them into use. In the long run, the goals of the users, that the software is planned to support, are worth gathering, and the software development should be based on these goals.

Transitioning from university to the workplace: Stakeholder perceptions of academic and professional writing demands

This study provides a detailed insight into the changing writing demands from the last year of university study to the first year in the workforce of engineering and accounting professionals. The study relates these to the demands of the writing component of IELTS, which is increasingly used for exit testing. The number of international and local students whose first language is not English and who are studying in English-medium universities has increased significantly in the past decade. Many of these students aim to start working in the country they studied in; however, some employers have suggested that graduates seeking employment have insufficient language skills. This study provides a detailed insight into the changing writing demands from the last year of university study to the first year in the workforce of engineering and accounting professionals (our two case study professions). It relates these to the demands of the writing component of IELTS, which is increasingly used for exit or professional entry testing, although not expressly designed for this purpose. Data include interviews with final year students, lecturers, employers and new graduates in their first few years in the workforce, as well as professional board members. Employers also reviewed both final year assignments, as well as IELTS writing samples at different levels. Most stakeholders agreed that graduates entering the workforce are underprepared for the writing demands in their professions. When compared with the university writing tasks, the workplace writing expected of new graduates was perceived as different in terms of genre, the tailoring of a text for a specific audience, and processes of review and editing involved. Stakeholders expressed a range of views on the suitability of the use of academic proficiency tests (such as IELTS) as university exit tests and for entry into the professions. With regard to IELTS, while some saw the relevance of the two writing tasks, particularly in relation to academic writing, others questioned the extent to which two timed tasks representing limited genres could elicit a representative sample of the professional writing required, particularly in the context of engineering. The findings are discussed in relation to different test purposes, the intersection between academic and specific purpose testing and the role of domain experts in test validation.

Insights into students' conceptual understanding using textual analysis: A case study in signal processing

Concept inventory tests are one method to evaluate conceptual understanding and identify possible misconceptions. The multiple-choice question format, offering a choice between a correct selection and common misconceptions, can provide an assessment of students' conceptual understanding in various dimensions. Misconceptions of some engineering concepts exist due to a lack of mental frameworks, or schemas, for these types of concepts or conceptual areas. This study incorporated an open textual response component in a multiple-choice concept inventory test to capture written explanations of students' selections. The study's goal was to identify, through text analysis of student responses, the types and categorizations of concepts in these explanations that had not been uncovered by the distractor selections. The analysis of the textual explanations of a subset of the discrete-time signals and systems concept inventory questions revealed that students have difficulty conceptually explaining several dimensions of signal processing. This contributed to their inability to provide a clear explanation of the underlying concepts, such as mathematical concepts. The methods used in this study evaluate students' understanding of signals and systems concepts through their ability to express understanding in written text. This may present a bias for students with strong written communication skills. This study presents a framework for extracting and identifying the types of concepts students use to express their reasoning when answering conceptual questions.

A systematic review of instruments for assessment of capacity in activities of daily living in children with developmental co-ordination disorder

Children with developmental co-ordination disorder (DCD) face evident motor difficulties in activities of daily living (ADL). Assessment of their capacity in ADL is essential for diagnosis and intervention, in order to limit the daily consequences of the disorder. The aim of this study is to systematically review potential instruments for standardized and objective assessment of children's capacity in ADL, suited for children with DCD. As a first step, databases of MEDLINE, EMBASE, CINAHL and PsycINFO were searched to identify studies that described instruments with potential for assessment of capacity in ADL. Second, instruments were included for review when two independent reviewers agreed that the instruments: (1) are standardized and objective; (2) assess at activity level and comprise items that reflect ADL, and; (3) are applicable to school-aged children that can move independently. Out of 1507 publications, 66 publications were selected, describing 39 instruments. Seven of these instruments were found to fulfil the criteria and were included for review: the Bruininks-Oseretsky Test of Motor Performance-2 (BOT2); the Do-Eat (Do-Eat); the Movement Assessment Battery for Children-2 (MABC2); the school-Assessment of Motor and Process Skills (schoolAMPS); the Tuffts Assessment of Motor Performance (TAMP); the Test of Gross Motor Development (TGMD); and the Functional Independence Measure for Children (WeeFIM). As a third step, for the included instruments, suitability for children with DCD was discussed based on the ADL comprised, ecological validity and other psychometric properties. We concluded that current instruments do not provide comprehensive and ecologically valid assessment of capacity in ADL as required for children with DCD.

Development and psychometric properties of the DCDDaily: a new test for clinical assessment of capacity in activities of daily living in children with developmental coordination disorder

Objective To develop the DCDDaily, an instrument for objective and standardized clinical assessment of capacity in activities of daily living (ADL) in children with developmental coordination disorder (DCD), and to investigate its usability, reliability, and validity. Subjects Five to eight-year-old children with and without DCD. Main measures The DCDDaily was developed based on thorough review of the literature and extensive expert involvement. To investigate the usability (assessment time and feasibility), reliability (internal consistency and repeatability), and validity (concurrent and discriminant validity) of the DCDDaily, children were assessed with the DCDDaily and the Movement Assessment Battery for Children-2 Test, and their parents filled in the Movement Assessment Battery for Children-2 Checklist and Developmental Coordination Disorder Questionnaire. Results 459 children were assessed (DCD group, n = 55; normative reference group, n = 404). Assessment was possible within 30 minutes and in any clinical setting. For internal consistency, Cronbach’s α = 0.83. Intraclass correlation = 0.87 for test–retest reliability and 0.89 for inter-rater reliability. Concurrent correlations with Movement Assessment Battery for Children-2 Test and questionnaires were ρ = −0.494, 0.239, and −0.284, p < 0.001. Discriminant validity measures showed significantly worse performance in the DCD group than in the control group (mean (SD) score 33 (5.6) versus 26 (4.3), p < 0.001). The area under curve characteristic = 0.872, sensitivity and specificity were 80%. Conclusions The DCDDaily is a valid and reliable instrument for clinical assessment of capacity in ADL, that is feasible for use in clinical practice.

The gradual release of responsibility: A case study of teaching science inquiry skills

This thesis investigated how a year-4 teacher used a pedagogical approach referred to as the Gradual Release of Responsibility (GRR) model of instruction for teaching Science Inquiry Skills in a primary classroom. Through scaffolding her students' learning using the GRR, the teacher guided her students towards developing an understanding about Scientific Inquiry leading to the foundations of scientific literacy. A learning environment was established in which students engaged in rich conversations, designed and conducted experiments using fair testing procedures, analysed and offered justifications for results, and negotiated knowledge claims in ways similar to some of those in the scientific community.

'Create a Better Online You': Designing online learning resources to develop undergraduate social media skills

This article charts the development of the 'Create a Better Online You' (CBOY) project. The focus of CBOY was the social media skills of undergraduate students at QUT. While many students will have encountered 'cybersafety' training in primary or secondary school, however, a comprehensive environmental scan revealed little in the way of social media resources targeted at undergraduate students. In particular, there was little to no focus on the ways in which social media could be used strategically to develop a positive online reputation and enhance chances of employability post tertiary education. The resources created as part of CBOY were the result of a comprehensive literature review, environmental scan, interviews with key internal and external stakeholders, and in discussion with undergraduate students at Queensland University of Technology (QUT). Following the comprehensive environmental scan, it appears that CBOY represents one of the first free, openly accessible, interactive resources targeting the social media skills of undergraduates.

Formalising the vernacular: Social media skills in higher education

This paper discusses the issue of social media skills using a literacy framework. Firstly, it argues that social media skills are a form of vernacular, or ‘everyday’, literacy and articulates the issues associated with trying to formalise these skills within the curriculum. Secondly, it calls for greater explicit attention to social media skills within higher education, by arguing that social media literacies are a part of new literacies. It evaluates QUT’s “Create a Better Online You” suite of social media resources in light of this framework, and discusses the role of libraries in addressing social media skills.

Literacy leadership and accountability practices: Holding onto ethics in ways that count

Despite the rhetoric of schools serving the needs of specific communities, it is evident that the work of teachers and principals is shaped by government imperatives to demonstrate success according to a set of standard ‘benchmarks’. In this chapter, we draw from our current study of new forms of educational leadership emerging in South Australian public primary schools to explore the ways in which test-based accountability requirements are being mediated by principals in schools that serve high poverty communities. Taking an institutional ethnography approach we focus on the everyday work of a principal and a literacy leader in one suburban primary school to show the complexity of the impact of national testing on practices of literacy leadership. We elaborate on the inescapable textual framings and tasks faced by the principal and literacy leader, and those that they create and modify – such as a common literacy agreement and ‘literacy chats’ between a literacy leader and classroom teacher – in order to ‘hold on to ethics’. We argue that while leaders’ and teachers’ everyday work is regulated by ‘ruling relations’ (Smith, 1999), it is also organic and responsive to the local context. We conclude with a reflection on the important situated work that school leaders do in mediating trans-local policies that might otherwise close down possibilities for engaging ethically with students and their learning in a particular school.