Assessing evaluative measures for Internet-based courseware

Although there is a consensus in th~ literature on the many uses of the Internet in education, as well as the unique features of the Internet for presenting facts and information, there is no consensus on a standardized method for evaluating Internetbased courseware. Educators rarely have the opportunity to participate in the development of Internet-based courseware, yet they are encouraged to use the technology in their learning environments. This creates a need for summative evaluation methods for Internet-based health courseware. The purpose ofthis study was to assess evaluative measures for Internet-based courseware. Specifically, two entities were evaluated within the study: a) the outcome of the Internet-based courseware, and b) the Internet-based courseware itself. To this end, the Web site www.bodymatters.com was evaluated using two different approaches by two different cohorts. The first approach was a performance appraisal by a group of endusers. A positive, statistically significant change in the students performance was observed due to the intervention ofthe Web site. The second approach was a productoriented evaluation ofthe Web site with the use of a criterion-based checklist and an open-ended comments section. The findings indicate that a summative, criterion-based evaluation is best completed by a multidisciplinary team. The findi~gs also indicated that the two different cohorts reported different product-oriented appraisals of the Web site. The current research confirmed previous research that found that experts returning a poor evaluation of a Web site did not have a relationship to whether or not the end-users performance improved due to the intervention of the Web site.

Education in the halls : students' perspectives on cultural expression and resistance

This research is a qualitative study of cultural reproduction and resistance from students' perspectives. Thirteen teenagers (eight in attendance in regular high schools and five drop-outs) were recruited to take part and were involved to varying degrees through interviews, journal writing, and group interactive sessions. A purposive sampling design was used initially to recruit individuals known to the researcher through contacts in an alternate education setting. Other participants were recruited throughout the research phase. The theoretical aspects are premised on the work of Paul Willis, Michel Foucault, and Pierre Bourdieu. The reflexive praxeology of Bourdieu reflects the position taken as one way of understanding how students construct and respond to the situations of cultural dominance they experience in schools. The same reflexivity is offered for suggestions as to how teachers can respond to their own position in the education system.

Education, sport and myth in the community of Glengarry, Ontario : the athletic career of Roderick R. McLennan. 260 St. Catharines, Ont. : Faculty of Education, Brock University ;

This study examined how the athletic career of Roderick R. McLennan contributed to the popularization and subsequent development of Caledonian games in Ontario during the latter nineteenth century. Initially, the development of Caledonian games during the 1800s was examined to provide a contextual framework for McLennan's career. This investigation revealed that the games emerged from rural athletic events at pioneer working bees in the first quarter of the nineteenth century to regional sporting events by the mid-1800s, and finally into annual federated Caledonian games in 1870. Noteworthy primary source material for this chapter included the John MacGillivray Papers at the National Archives of Canada, the Scottish American Journal (NY) and the files retained by the Glengarry Sport Hall of Fame in Maxville, Ontario. Following the investigation of Caledonian games, McLennan's early athletic career was studied. Analysis of the Roderick and Farquhar McLennan Papers at the Archives of Ontario and the newspapers from the period revealed that McLennan rose to popularity in 1865 through a "Championship of the World" hammer throwing match in Cornwall and two "Starring Tours". The next chapter examined the height of McLennan's career through an investigation of the Roderick McLennan versus Donald Dinnie rivalry of the early .. n 1870s. It was detennined that the rivalry between McLennan and Dinnie, the champion athlete of Highland games in Scotland, was a popular attraction and had an impact on the Toronto and Montreal games of 1870 and the Toronto games of 1872. Finally, the athletic records established by McLennan during the 1860s and 1870s were investigated. These records were examined through the context of a media controversy over McLennan's feats that developed in the early 1880s between two newspapers. This controversy erupted between the Toronto Mail and the Spirit of the Times. Caledonian games in Canada have only been briefly examined and a thorough examination of prominent Canadian figures in this context has yet to be undertaken. This study unearths a prominent Canadian athlete of Scottish decent and details his involvement in the Caledonian games of nineteenth century Ontario.

Effectiveness of computer training on attentional skills

This paper presents two studies, both examining the efficacy of a computer programme (Captain's Log) in training attentional skills. The population of interest is the traumatically brain injured. Study #1 is a single-case design that offers recommendations for the second, .larger (N=5) inquiry. Study #2 is an eight-week hierarchical treatment programme with a multi-based testing component. Attention, memory, listening comprehension, locus-of-control, self-esteem, visuo-spatial, and general outcome measures are employed within the testing schedule. Results suggest that any improvement was a result of practice effects. With a few single-case exceptions, the participants showed little improvement in the dependent measures.

For whom the cruiser rolls: a retrospective analysis of factors relating to recidivism in a sample of graduates from a court-ordered alcohol education and awareness program

This study investigated, retrospectively, whether recidivism in a sample of court-ordered'graduates of an alcohol education and awareness program could be predicted. This alcohol education program was based on adult education principles and was philosophically akin to the thoughts of Drs. Jack Mezirow, Stephen Brookfield, and Patricia Cranton. Data on the sample of 214 Halton IDEA (Impaired Driver Education and Awareness) graduates were entered into a spread sheet. Descriptive statistics were generated. Each of the 214 program graduates had taken several tests during the course of the IDEA program. These tests measured knowledge, attitude about impaired driving, and degree of alcohol involvement. Test scores were analyzed to determine whether those IDEA graduates who recidivated differed in any measurable way from those who had no further criminal convictions after a period of at least three years. Their criminal records were obtained from the Canadian Police Information Centre (CPIC). Those program graduates who reoffended were compared to the vast majority who did not reoffend. Results of the study indicated that there was no way to determine who would recidivate from the data that were collected. Further studies could use a qualitative model. Follow-up interviews could be used to determine what impact, if any, attendance at the IDEA program had on the life of the graduates.

Identification and description of the development of the relationships between mentor and mentee teachers in the Halton Board of Education "Partners in the Classroom" Program

Fifteen mentoring pairs of teachers were randomly selected from each group of teachers that had participated in the Halton Board of Education "Partners in the Classroom" program during 1988/89, 1989/90, and 1990/91. Each teacher was personally interviewed. Interviews were recorded, transcriptions were prepared and examined and analyzed. During the first part of the interview questions were asked regarding personal and professional demographics. The purpose of the second part of the interview was to gain information relating to the development of the relationships, over a three-year period, between mentor and mentee teacher participants in the "Partners in the Classroom" program. The analysis of the data suggest that there are identifiable changes in the development of the relationship between the mentor teacher and the mentee teacher over time. Implications from the study results that could enhance the induction program for new teachers are discussed.

Implementation of hospital-wide computer information system :a case study of this change process

This case study examines the impact of a computer information system as it was being implemented in one Ontario hospital. The attitudes of a cross section of the hospital staff acted as a barometer to measure their perceptions of the implementation process. With The Mississauga Hospital in the early stages of an extensive computer implementation project, the opportunity existed to identify staff attitudes about the computer system, overall knowledge and compare the findings with the literature. The goal of the study was to develop a greater base about the affective domain in the relationship between people and the computer system. Eight exploratory questions shaped the focus of the investigation. Data were collected from three sources: a survey questionnaire, focused interviews, and internal hospital documents. Both quantitative and qualitative data were analyzed. Instrumentation in the study consisted of a survey distributed at two points in time to randomly selected hospital employees who represented all staff levels.Other sources of data included hospital documents, and twenty-five focused interviews with staff who replied to both surveys. Leavitt's socio-technical system, with its four subsystems: task, structure, technology, and people was used to classify staff responses to the research questions. The study findings revealed that the majority of respondents felt positive about using the computer as part of their jobs. No apparent correlations were found between sex, age, or staff group and feelings about using the computer. Differences in attitudes, and attitude changes were found in potential relationship to the element of time. Another difference was found in staff group and perception of being involved in the decision making process. These findings and other evidence about the role of change agents in this change process help to emphasize that planning change is one thing, managing the transition is another.

Instructor support for self-directed learning in higher education

This study addressed the problem of instructor support for self-directed learning, specifically, learner-directed program planning, within a classroom setting in higher education. A combination of survey, interview, document analysis, and observation was used to assess and evaluate the attitudes and practices of a sample of full-time faculty at an Ontario university. Eighty-seven percent of the study sample reported instructional beliefs, values, and expectations that were not supportive of self-directed learning, especially in terms of student participation in program planning. Planning was seen as the responsibility of the instructor. Instructors were least open to student participation in the planning of the evaluation of learning. However, there was considerable stated support for other of the basic principles of adult education. The remaining 13% of the study sample reported instructional beliefs, values, and expectations that were fully supportive of self-directed learning. Instructional practices were analyzed in relation to the instructors' stated beliefs. Although practices reflected, in many instances, instructors' statements of support, there were some significant discrepancies between apparent support for the concept of self-directed learning and actual classroom practice. Both beliefs and practice were compared to a research model of self-directed learning. Most instructors did not have a concept of self-directed learning as comprehensive as that described in the research model. Instructor support for self-directed learning was profoundly influenced by the university setting. It was concluded that more strenuous attempts to research, enhance, and promote instructional and institutional support for self-directed learning in higher education are warranted.

Management decision-making in nursing

This study developed a new, valid and reliable evaluation instrument to measure the level, type and pattern of management decisions of fifteen nursing students. The management decision score achieved using this instrument was correlated with two psychological determinants of management decision making: creativity and problem-solving ability. The instrument was a written patient management problem in case format, answered by a free form written response. The student responses were classified for type of management decision according to the sub-categories of technical, inter-personal, environmental and unique. Using statistical analysis a significant difference was found in the type of management decisions most frequently selected by the study sample. The students predominantly selected technical type decisions. This preference for one type of management decision may be due to a number of psychological and environmental factors. These factors may program and mold the type of management decisions student nurses make early in their career. Low but positive correlations were found between the total management score and the two psychological tests. This finding supports the authors cited in the literature who state that although creativity augments the type of management decision making, it is not present or encouraged widely in the nursing profession. These factors are worth considering when the profession becomes concerned over ritualization and lack of individuality in patient care. The tool is easy to administer, lends itself to a variety of professional settings and shows promise with further refinement for computer application.

Marketing Brock University in the 1980's: assessing freshman student feedback in strategic planning approach

Universities have entered a period of rapid change and upheaval due to an external environment beyond their control which includes shifting demographic patterns, accelerating technology, funding shortages, and keener competition for students. Strategic planning, a comprehensive vision which challenges universities to take bold and creative measures to meet the threats and opportunities of the future, is an institutional imperative in the 1980's. This paper examines freshman student feedback in an effort to incorporate this important element into a strategic plan for Brock University, a small, predominantly liberal arts university in St. Catharines, Ontario. The study was designed to provide information on the characteristics of the 1985-86 pool of freshman registrants: their attitudes towards Brock's recruitment measures, their general university priorities, and their influences in regard to university selection (along with other demographical and attitudinal data). A survey involving fixed-alternative questions of a subjective and objective nature was administered in two large freshman classes at Brock in which a broad cross-section of academic programs was anticipated. Computer analysis of the data for the 357 respondents included total raw frequencies and rounded percentages, as well as subgroup cross-tabulation by geographic home area of respondent, academic major, and high school graduating average. The four directional hypotheses put forward were all substantiatied by the survey data, indicating that 1) the university's current recruitment program had been a positive influence during their university search 2) parents were the most influential group in the students' decisions related to university 3) respondents viewed institutional reputation as less of a priority than an enjoyable university lifestyle in a personal learning atmosphere 4) students had a decided preference for co-operative study and internship programs. Strategic planning recommendations included a reduction in the faculty/student ratio through faculty hirings to restore the close rapport between professors and students, increased recruitment presentations in Ontario high schools to enlarge the applicant pool, creation of an Office of Co-operative Study and Internship Programs, institutional emphasis on a "customer orientation", and an extension of research into student demographics and attitudinal data.

Novice teachers' perceptions of the extent to which the Brock University teacher education program focused on methods of promoting responsibility in students

The purpose of this study was to determine novice t~ache~s' perceptions of th~ extent to which the Brock University teacher education program focused on strategies for promoting responsibility in students. Individual interviews were conducted with ten randomly selected teachers who were graduates of this teacher education program between the years of 1989 and 1992, and a follow-up group discussion activity, with the same teachers, was also held. Findings revealed that the topic of personal responsibility was discussed within various components of the program, including counselling group sessions, but that these discussions were often brief, indirect and inconsistent. Some of the strategies which the teachers used in their own classrooms to promote responsibility in students were ones which they had acquired from those counselling group °sessions or from associate teachers. Various strategies included: setting ~lear expectations of students with positive and negative consequences for behaviour (e.g., material rewards and detentions, respectively), cemmunic?ting'with other teachers an~ parents, and -. suspending students from school. A teacher's choice of any particular strategy seemed to be affected by his or her personality, teaching sUbject and region of employment, as well as certain aspects of the teacher education program. It was concluded that many of the teachers appeared to be controlling rude and vio~ent- behaviour, as opposed to promoting responsible behaviour. Recommendations were made for the pre-service program, as well as induction and inservice programs, to increase teacher preparedness for promoting responsible student behaviour. One of these recommendations addressed the need to help teachers learn how to effectively communicate with their students.

Participation of registered nurses in continuing education

This correlational study investigated the psychological types, learning style preferences, readiness for self-directed learning, demographic and continuing education participation data of 154 registered nurses at two different Southern Ontario hospitals. One hospital was a large tertiary care university-affiliated teaching centre (Cityview) and the other was a smaller secondary care community hospital (Waterview). The instruments used in the study were the PET Type Check, Kolb's Learning Style Inventory, the Self-Directed Readiness Scale (SDLRS), and a Nursing Survey developed by the researcher. Descriptive statistics, crosstabulations and correlational analyses were calculated. The most common psychological types identified among this sample of nurses were extraverted thinking, introverted intuitive and extraverted intuitive. There were no significant differences between the two hospitals. The accommodator learning style was preferred overall, with more nurses at Waterview Hospital preferring the diverger learning style, and more nurses at Cityview Hospital preferring the accommodator learning style. The majority of nurses scored in the average and above average categories on the SDLRS, indicating that they perceive themselves as ready to engage in self-directed learning. At Cityview Hospital there were more nurses in the average and high readiness categories, whereas at Waterview Hospital more nurses scored in the below average category. No significant correlations were found for learning style with psychological type, or for learning style with SDLRS scores. A positive correlation was found to exist between SDLRS scores and each of the psychological types extraverted feelings, extraverted thinking, and introverted intuitive.The only significant correlation for psychological type and continuing education activity was a positive correlation between extraverted thinking types and participation in informal discussion or study groups. Positive correlations were found for SDLRS scores with each of the following continuing education activities; number of hours per month spent reading journals; journal reading; attendance at credit courses; watching videos; using reference texts. Further details of the results are included as well as a discussion of the findings and implications for future research.

The assessment of self-directed learning among pre-service students in an Ontario faculty of education

The study determined students' perceptions of self-directed learning in their courses. Tests to assess perceptions are not being used in many programs. Assessments such as the Self-Directed Readiness Scale (SDLRS) and the Oddi continuing Learning Inventory (OCLI) have weaknesses that may have affected the use of tests. In this study, the creation of the Self-Directed Learning Test (SDLT) monitored students' perceptions by addressing what students were told before registration, how much input students had in developing the structure of the course, how much input students have in determining the evaluation for the course, what style of learning is taking place, and the characteristics of learning found among students. Fifty-one students in the pre-service program at Brock University completed the SDLT. Results showed that 47.1% of the sample liked self-directed learning. Several students who stated that they did not like selfdirected learning did not know what self-directed learning was. Results supported Brookfield's (1986) claim for more education on what self-directed learning is. The study did not support Knowles' (1980) assumption that adult students know and want to follow self-directed approaches to learning. The SDLT is a good method for monitoring self-directed learning and how students perceive their courses.

The effectiveness of a computer program on career planning for university students

This study investigated the effectiveness of a computer program, PERSONAL CAREER DIRECTIONS (PC DIRECTIONS) (Anderson, Welborn, & Wright, 1983) on career planning and exploration for twenty-four Brock University students (18 women and 6 men) who requested career planning assistance at the Career/Placement Services of the Counselling Centre. A one-group pretest/posttest design was used in the study_ Progress in career planning and exploration was measured by Career Planning (CP) and Career Exploration (CE) scales of the Career Development Inventory (College and University Form) (Super, Thompson, Lindeman, Jordaan, & Myers, 1981). A paired samples 2-tailed t test for Career Development Attitudes (CDA) , the combined CP and CE scales, revealed the posttest scores were significantly higher than the pretest scores, t(23) = 3.74, 2 < .001. Student progress was also assessed by self-report lists of job titles which reflected positive changes after students used PC DIRECTIONS. In response to several questions, students' attitudes were more positive than negative toward the program. Implications are that PC DIRECTIONS is an effective component in promoting career planning for university students. Further studies may reveal that different types of students may benefit from different interventions in the career planning process.

The quality of life in the Master of Education program, Brock University

This study addressed the problem of the quality of life in the Brock Master of Education program. Survey and interview data were used to gain an understanding of satisfaction with the learning achieved and student life experienced. Eighty-seven percent of the study sample reported satisfaction with the program overall. Results suggested the higher the overall satisfaction with a program, the greater the likelihood learning and student life satisfaction were also more positive. Student reflections suggested satisfaction with the quality of life in the program was associated with the program's focus on the student, the use of self-directed learning, and the support of professors to meet student needs. Comparison of the Brock Master of Education survey with the Brock Pre-Service Teacher Education program showed both student groups shared a similar satisfaction with student life in the Faculty. Comparison of Master of Education programs suggested the difference between two programs, a difference which may be influenced by time in the program. The results from the three programs suggested that students beyond the first undergraduate degree favored the school domains of learning acquisition. Supplementary data on the relationship between cognitive and affective opinions suggested the more positive the affective dimension of learning, the greater the likelihood the cognitive dimensions of student life were also more positive. It was concluded that time was a chief factor influencing part-time student satisfaction with both learning and student life in the program. Part-time students, as. the majority in the survey, expressed comments about the need for clarity of communication between the organization and student to promote the effective use of limited time.