How Good Am I? Crude Self-Assessment vs. Examination

With the new academic year structure encouraging more in-term assessment to replace end-of-year examinations one of the problems we face is assessing students and keeping track of individual student learning without overloading the students and staff with excessive assessment burdens.
In the School of Electronics, Electrical Engineering and Computer Science, we have constructed a system that allows students to self-assess their capability on a simple Yes/No/Don’t Know scale against fine grained learning outcomes for a module. As the term progresses students update their record as appropriately, including selecting a Learnt option to reflect improvements they have gained as part of their studies.
In the system each of the learning outcomes are linked to the relevant teaching session (lectures and labs) and to online resources that students can access at any time. Students can structure their own learning experience to their needs and preferences in order to attain the learning outcomes.
The system keeps a history of the student’s record, allowing the lecturer to observe how the students’ abilities progress over the term and to compare it to assessment results. The system also keeps of any of the resource links that student has clicked on and the related learning outcome.
The initial work is comparing the accuracy of the student self-assessments with their performance in the related questions in the traditional end-of-year examination.

A 'before and after' study of nursing students' self-assessed competence in identifying the needs of older patients in hospital using an educational workbook.

Background: A core component of nurse education is clinical practice in order to support the development of clinical skills and competence. Assessment and measurement of the clinical competence of nursing students is important to gauge their professional development and educational needs.

Aim: To evaluate the impact of an Older Persons’ Assessment Educational Workbook (OPAEW) and explore second year nursing students’ competence and their opinions and use of the workbook.

Methods: A ‘before and after’ pre-experimental design was undertaken with n=6 second year nursing students. Outcome measures were the Nursing Competencies Questionnaire and the Self-efficacy in Clinical Performance Scale. Content analysis of workbooks and a survey (n=5) of opinions regarding the workbook was undertaken.

Findings: Pre and post test results for the study (n=5) were tested to determine if there was a relationship between changes in the NCQ and SECP repeated measures and use of an OPAEW. Testing identified evidence of a statistically significant difference for both SECP measures (SECP28 p=0.043; SECP7 p=0.042), with no clear statistical evidence of a difference for the NCQ (p=0.08). A weak negative association (NCQ ρ=-0.600 p=0.285; SECP28 ρ=-0.300 p=0.624; SECP7 ρ=-0.205 p=0.741), was found indicating that those participants who scored the lowest scores at the start of the study, benefited most from the workbook.

Content analysis of the OPAEW (n=5) found that 3 of the 5 participants completed all components of the workbook, with a mean of 1051 words used (SD 281.8). Through the survey (n=5) students reported the workbook as a useful guide when undertaking a patient assessment.

Conclusions: The OPAEW showed potential as an intervention to support the development of nursing students’ competence in older person assessment skills.

A 'before and after' study of nursing students' self-assessed competence in identifying the needs of older patients in hospital using an educational workbook.

Background: A core component of nurse education is clinical practice in order to support the development of clinical skills and competence. Assessment and measurement of the clinical competence of nursing students is important to gauge their professional development and educational needs.

Aim: To evaluate the impact of an Older Persons’ Assessment Educational Workbook (OPAEW) and explore second year nursing students’ competence and their opinions and use of the workbook.

Methods: A ‘before and after’ pre-experimental design was undertaken with n=6 second year nursing students. Outcome measures were the Nursing Competencies Questionnaire and the Self-efficacy in Clinical Performance Scale. Content analysis of workbooks and a survey (n=5) of opinions regarding the workbook was undertaken.

Findings: Pre and post test results for the study (n=5) were tested to determine if there was a relationship between changes in the NCQ and SECP repeated measures and use of an OPAEW. Testing identified evidence of a statistically significant difference for both SECP measures (SECP28 p=0.043; SECP7 p=0.042), with no clear statistical evidence of a difference for the NCQ (p=0.08). A weak negative association (NCQ ρ=-0.600 p=0.285; SECP28 ρ=-0.300 p=0.624; SECP7 ρ=-0.205 p=0.741), was found indicating that those participants who scored the lowest scores at the start of the study, benefited most from the workbook.

Content analysis of the OPAEW (n=5) found that 3 of the 5 participants completed all components of the workbook, with a mean of 1051 words used (SD 281.8). Through the survey (n=5) students reported the workbook as a useful guide when undertaking a patient assessment.

Conclusions: The OPAEW showed potential as an intervention to support the development of nursing students’ competence in older person assessment skills.