Assessing evaluative measures for Internet-based courseware

Although there is a consensus in th~ literature on the many uses of the Internet in education, as well as the unique features of the Internet for presenting facts and information, there is no consensus on a standardized method for evaluating Internetbased courseware. Educators rarely have the opportunity to participate in the development of Internet-based courseware, yet they are encouraged to use the technology in their learning environments. This creates a need for summative evaluation methods for Internet-based health courseware. The purpose ofthis study was to assess evaluative measures for Internet-based courseware. Specifically, two entities were evaluated within the study: a) the outcome of the Internet-based courseware, and b) the Internet-based courseware itself. To this end, the Web site www.bodymatters.com was evaluated using two different approaches by two different cohorts. The first approach was a performance appraisal by a group of endusers. A positive, statistically significant change in the students performance was observed due to the intervention ofthe Web site. The second approach was a productoriented evaluation ofthe Web site with the use of a criterion-based checklist and an open-ended comments section. The findings indicate that a summative, criterion-based evaluation is best completed by a multidisciplinary team. The findi~gs also indicated that the two different cohorts reported different product-oriented appraisals of the Web site. The current research confirmed previous research that found that experts returning a poor evaluation of a Web site did not have a relationship to whether or not the end-users performance improved due to the intervention of the Web site.

Rethinking a learning environment strategy

I have committed a significant period of time (in my case five years) to the purpose development of learning environments, with the belief that it would improve the self-actualisation and self-motivation of students and teachers alike. I consider it important to record and measure performance as we progressed toward such an outcome. Education researchers and practitioners alike, in the higher (university/tertiary) education systems, are seeking among new challenges to engage students and teachers in learning (James, 2001). However, studies to date show a confusing landscape littered with a multiplicity of interpretations and terms, successes and failures. As the discipline leader of the Information Technology, Systems and Multimedia (ITSM) Discipline, Swinburne University of Technology, Lilydale, I found myself struggling with this paradigm. I also found myself being torn between what presents as pragmatic student learning behaviour and the learner-centred teaching ideal reflected in the Swinburne Lilydale mission statement. The research reported in this folio reflects my theory and practice as discipline leader of the ITSM Discipline and the resulting learning environment evolution during the period 1997/8 to 2003. The study adds to the material evidence of extant research through firstly, a meta analysis of the learning environment implemented by the ITSM Discipline as recorded in peer reviewed and published papers; and secondly, a content analysis of student learning approaches, conducted on data reported from a survey of ‘learning skills inventory’ originally conducted by the ITSM Discipline staff in 2002. In 1997 information and communication technologies (ICT) were beginning to provide plausible means for electronic distribution of learning materials on a flexible and repeatable basis, and to provide answers to the imperative of learning materials distribution relating to an ITSM Discipline new course to begin in 1998. A very short time frame of three months was available prior to teaching the course. The ITSM Discipline learning environment development was an evolutionary process I began in 1997/8 initially from the requirement to publish print-based learning guide materials for the new ITSM Discipline subjects. Learning materials and student-to-teacher reciprocal communication would then be delivered and distributed online as virtual learning guides and virtual lectures, over distance as well as maintaining classroom-based instruction design. Virtual here is used to describe the use of ICT and Internet-based approaches. No longer would it be necessary for students to attend classes simply to access lecture content, or fear missing out on vital information. Assumptions I made as discipline leader for the ITSM Discipline included, firstly, that learning should be an active enterprise for the students, teachers and society; secondly, that each student comes to a learning environment with different learning expectations, learning skills and learning styles; and thirdly, that the provision of a holistic learning environment would encourage students to be self-actualising and self-motivated. Considerable reading of research and publications, as outlined in this folio, supported the update of these assumptions relative to teaching and learning. ITSM Discipline staff were required to quickly and naturally change their teaching styles and communication of values to engage with the emergent ITSM Discipline learning environment and pedagogy, and each new teaching situation. From a student perspective such assumptions meant students needed to move from reliance upon teaching and prescriptive transmission of information to a self-motivated and more self-actualising and reflective set of strategies for learning. In constructing this folio, after the introductory chaperts, there are two distinct component parts; • firstly, a Descriptive Meta analysis (Chapter Three) that draws together several of my peer reviewed professional writings and observations that document the progression of the ITSM Discipline learning environment evolution during the period 1997/8 to 2003. As the learning environment designer and discipline leader, my observations and published papers provide insight into the considerations that are required when providing an active, flexible and multi-modal learning environment for students and teachers; and • secondly, a Dissertation (Chapter Four), as a content analysis of a learning skills inventory data collection, collected by the ITSM Discipline in the 2002 Swinburne Lilydale academic year, where students were encouraged to complete reflective journal entries via the ITSM Discipline virtual learning guide subject web-site. That data collection included all students in a majority of subjects supported by the ITSM Discipline for both semesters one and two 2002. The original purpose of the journal entries was to have students reflectively involved in assessing their learning skills and approaches to learning. Such perceptions were tested using a well-known metric, the ‘learning skills inventory’ (Knowles, 1975), augmented with a short reflective learning approach narrative. The journal entries were used by teaching staff originally and then made available to researchers as a desensitised data in 2003 for statistical and content analysis relative to student learning skills and approaches. The findings of my research support a view of the student and teacher enculturation as utilitarian, dependent and pragmatically self-motivated. This, I argue, shows little sign of abatement in the early part of the 21st Century. My observation suggests that this is also independent of the pedagogical and educational philosophy debate or practice as currently presented. As much as the self-actualising, self-motivated learning environment can be justified philosophically, the findings observed from this research, reported in this folio, cannot. Part of the reason for this originates from the debate by educational researchers as to the relative merits of liberal and vocational philosophies for education combined with the recent introduction of information and communication technologies, and commodification of higher education. Challenging students to be participative and active learners, as proposed by educationalists Meyers and Jones (1993), i.e. self-motivated and self-actualising learners, has proved to be problematic. This, I will argue, will require a change to a variable/s (not yet identified) of higher education enculturation on multiple fronts, by students, teachers and society in order to bridge the gap. This research indicates that tertiary educators and educational researchers should stop thinking simplistically of constructivist and/or technology-enabled approaches, students learning choices and teachers teaching choices. Based on my research I argue for a far more holistic set of explanations of student and staff expectations and behaviour, and therefore pedagogy that supports those expectations.

Learning as knowledge networking : conceptual foundations for revised uses of the internet in higher education

This paper argues that the inherent characteristics of knowledge work, when combined with the operation of the Internet in contemporary society, produce a change in the dominant paradigm of what constitutes knowledge work. Since learning is a form of knowledge work, therefore this change will affect university education. The paper further argues that, because of the way in which online learning initially developed in universities, in most cases, the current approach to the Internet and higher education does not account for the changed conditions of knowledge in a network society. It concludes that new directions are needed which will allow us to make technology and pedagogy choices for future education better suited to a network society.

Promoting a functional physical self-concept in physical education: Evaluation of a 10-week intervention

Most physical education intervention studies on the positive effect of sports on self-concept development have attempted to increase schoolchildren’s self-concept without taking the veridicality of the self-concept into account. The present study investigated whether a 10-week intervention in physical education would lead to an increase not only in the general level of self-concept of endurance and self-concept of strength but also in its veridicality in those who had previously under- or overestimated their abilities. A total of 464 primary schoolchildren (246 boys, 218 girls, Mage = 11.9) either participated in the intervention or served as controls. The intervention group received endurance and strength training during physical education lessons carried out with a consistent individualized teacher frame of reference (iTFR). Results showed that this specific intervention was associated with increases not only in the general level of self-concept but also in its veridicality in under- and overestimators. Results are discussed in terms of didactic methods to promote functional self-concepts in physical education.

Evaluation of an application for managing microcredits in education

One of the major problems in developing countries is minority access to higher education. Traditional scholarships usually focus on paying eventually tuition fees or bringing brilliant students to develop countries. Additionally, these systems used to be opaque and, consequently, a corruption source. We propose a system of student loans to pay tuition fees in exchange for work. We also provide UBURYO. It is the FOSS, that we have developed, to manage this loan system in a simple, trustworthy, fair and efficient way. We deployed the loan system in the University of Ngozi (UNG, Burundi). A shallow evaluation demonstrates that system sustainability is feasible.

Level of involvement of clinical nurses in the evaluation of competence of nursing students

Objective. To determine the level of involvement of clinical nurses accredited by the Universitat Jaume I (Spain) as mentors of practice (Reference Nurses) in the evaluation of competence of nursing students. Methodolgy. Cross-sectional study, in which the “Clinical Practice Assessment Manual” (CPAM) reported by reference 41 nurses (n=55) were analyzed. Four quality criteria for completion were established: with information at least 80% of the required data, the presence of the signature and final grade in the right place. Verification of learning activities was also conducted. Data collection was performed concurrently reference for nurses and teachers of the subjects in the formative evaluations of clinical clerkship period in the matter “Nursing Care in Healthcare Processes “, from March to June 2013. Results. 63% of CPAM were completed correctly, without reaching the quality threshold established (80%). The absence of the signature is the main criteria of incorrect completion (21%). Nine learning activities do not meet the quality threshold set (80%) (p < 0.05). There are significant differences according to clinical units p < 0.05. From the 30 learning activities evaluated in the CPAM, it can be stated that nine of them do not reach the verification threshold established (80%), therefore it cannot be assumed that these activities had been completed by students and evaluated by the RefN throughout the clinical clerkship period. Conclusion. The level of involvement of Reference Nurse cannot be considered adequate, although strategies to encourage involvement through collaboration and training must be developed.

An electronic record system in nursing education: evaluation and utilization

The main objective of the present work is to analyze the results of the utilization and evaluation of the LORETO Record System (LRS), providing improvement areas in the teaching-learning process and technology, in second year nursing students. A descriptive, prospective, cross sectional study using inferential statics has been carried out on all electronic records reported by 55 nursing students during clinical internships (April 1º-June 26º, 2013). Electronic record average rated 7.22 points (s=0.6; CV=0.083), with differences based on the clinical practice units (p<0,05). Three items assessed did not exceed the quality threshold set at 0.7 (p<0.05). Record Rate exceeds the quality threshold set at 80% for the overall sample, with differences based on the practice units. Only two clinical practice units rated above the minimum threshold (p <0.05). Record of care provision every 3 days did not reach the estimated quality threshold (p <0.05). There is a dichotomy between qualitative and quantitative results of LRS. Improvement areas in theoretical education have been identified. The LRS seems an appropriate learning and assessment tool, although the development of a new APP version and the application of principles of gamification should be explored.

The Driver Education Evaluation Program (DEEP) study. A report to the Congress.

Mode of access: Internet.

The Driver Education Evaluation Program (DEEP) study. Report to Congress. Second.

Mode of access: Internet.

Antecedents and consequences of service quality in consumer evaluation of self-service internet technologies

Advances in technology coupled with increasing labour costs have caused service firms to explore self-service delivery options. Although some studies have focused on self-service and use of technology in service delivery, few have explored the role of service quality in consumer evaluation of technology-based self-service options. By integrating and extending the self-service quality framework the service evaluation model and the Technology Acceptance Model the authors address this emerging issue by empirically testing a comprehensive model that captures the antecedents and consequences of perceived service quality to predict continued customer interaction in the technology-based self-service context of Internet banking. Important service evaluation constructs like perceived risk, perceived value and perceived satisfaction are modelled in this framework. The results show that perceived control has the strongest influence on service quality evaluations. Perceived speed of delivery, reliability and enjoyment also have a significant impact on service quality perceptions. The study also found that even though perceived service quality, perceived risk and satisfaction are important predictors of continued interaction, perceived customer value plays a pivotal role in influencing continued interaction.