Rethinking a learning environment strategy

I have committed a significant period of time (in my case five years) to the purpose development of learning environments, with the belief that it would improve the self-actualisation and self-motivation of students and teachers alike. I consider it important to record and measure performance as we progressed toward such an outcome. Education researchers and practitioners alike, in the higher (university/tertiary) education systems, are seeking among new challenges to engage students and teachers in learning (James, 2001). However, studies to date show a confusing landscape littered with a multiplicity of interpretations and terms, successes and failures. As the discipline leader of the Information Technology, Systems and Multimedia (ITSM) Discipline, Swinburne University of Technology, Lilydale, I found myself struggling with this paradigm. I also found myself being torn between what presents as pragmatic student learning behaviour and the learner-centred teaching ideal reflected in the Swinburne Lilydale mission statement. The research reported in this folio reflects my theory and practice as discipline leader of the ITSM Discipline and the resulting learning environment evolution during the period 1997/8 to 2003. The study adds to the material evidence of extant research through firstly, a meta analysis of the learning environment implemented by the ITSM Discipline as recorded in peer reviewed and published papers; and secondly, a content analysis of student learning approaches, conducted on data reported from a survey of ‘learning skills inventory’ originally conducted by the ITSM Discipline staff in 2002. In 1997 information and communication technologies (ICT) were beginning to provide plausible means for electronic distribution of learning materials on a flexible and repeatable basis, and to provide answers to the imperative of learning materials distribution relating to an ITSM Discipline new course to begin in 1998. A very short time frame of three months was available prior to teaching the course. The ITSM Discipline learning environment development was an evolutionary process I began in 1997/8 initially from the requirement to publish print-based learning guide materials for the new ITSM Discipline subjects. Learning materials and student-to-teacher reciprocal communication would then be delivered and distributed online as virtual learning guides and virtual lectures, over distance as well as maintaining classroom-based instruction design. Virtual here is used to describe the use of ICT and Internet-based approaches. No longer would it be necessary for students to attend classes simply to access lecture content, or fear missing out on vital information. Assumptions I made as discipline leader for the ITSM Discipline included, firstly, that learning should be an active enterprise for the students, teachers and society; secondly, that each student comes to a learning environment with different learning expectations, learning skills and learning styles; and thirdly, that the provision of a holistic learning environment would encourage students to be self-actualising and self-motivated. Considerable reading of research and publications, as outlined in this folio, supported the update of these assumptions relative to teaching and learning. ITSM Discipline staff were required to quickly and naturally change their teaching styles and communication of values to engage with the emergent ITSM Discipline learning environment and pedagogy, and each new teaching situation. From a student perspective such assumptions meant students needed to move from reliance upon teaching and prescriptive transmission of information to a self-motivated and more self-actualising and reflective set of strategies for learning. In constructing this folio, after the introductory chaperts, there are two distinct component parts; • firstly, a Descriptive Meta analysis (Chapter Three) that draws together several of my peer reviewed professional writings and observations that document the progression of the ITSM Discipline learning environment evolution during the period 1997/8 to 2003. As the learning environment designer and discipline leader, my observations and published papers provide insight into the considerations that are required when providing an active, flexible and multi-modal learning environment for students and teachers; and • secondly, a Dissertation (Chapter Four), as a content analysis of a learning skills inventory data collection, collected by the ITSM Discipline in the 2002 Swinburne Lilydale academic year, where students were encouraged to complete reflective journal entries via the ITSM Discipline virtual learning guide subject web-site. That data collection included all students in a majority of subjects supported by the ITSM Discipline for both semesters one and two 2002. The original purpose of the journal entries was to have students reflectively involved in assessing their learning skills and approaches to learning. Such perceptions were tested using a well-known metric, the ‘learning skills inventory’ (Knowles, 1975), augmented with a short reflective learning approach narrative. The journal entries were used by teaching staff originally and then made available to researchers as a desensitised data in 2003 for statistical and content analysis relative to student learning skills and approaches. The findings of my research support a view of the student and teacher enculturation as utilitarian, dependent and pragmatically self-motivated. This, I argue, shows little sign of abatement in the early part of the 21st Century. My observation suggests that this is also independent of the pedagogical and educational philosophy debate or practice as currently presented. As much as the self-actualising, self-motivated learning environment can be justified philosophically, the findings observed from this research, reported in this folio, cannot. Part of the reason for this originates from the debate by educational researchers as to the relative merits of liberal and vocational philosophies for education combined with the recent introduction of information and communication technologies, and commodification of higher education. Challenging students to be participative and active learners, as proposed by educationalists Meyers and Jones (1993), i.e. self-motivated and self-actualising learners, has proved to be problematic. This, I will argue, will require a change to a variable/s (not yet identified) of higher education enculturation on multiple fronts, by students, teachers and society in order to bridge the gap. This research indicates that tertiary educators and educational researchers should stop thinking simplistically of constructivist and/or technology-enabled approaches, students learning choices and teachers teaching choices. Based on my research I argue for a far more holistic set of explanations of student and staff expectations and behaviour, and therefore pedagogy that supports those expectations.

Computer-simulated environment for training : challenge of efficacy evaluation

Computer-assisted instruction has been around for decades. There has been much speculation about the benefits of computer-mediated learning. Numerous applications have been developed in different domains incorporated with emerging technologies. In recently years, advanced technologies, such as Augmented Reality (AR) and Virtual Reality (VR), have received much attention in their potential of creating interactive learning experience for the users. However, related literature and empirical studies indicated that learning effects in computer-simulated environments or Virtual Environments (VEs) are not systematically tested. Furthermore, the performance and learning in computer-simulated learning environment need to be evaluated through more rigorous methods. This paper suggests that 1) the efficacy of VEs is subject to a close examination, not only in terms of how VE-based training systems are easy of use, but also in terms of how effective learning is; 2) evaluation of learning in computer simulated learning environments is required to be reconsidered in terms of theoretical basis and evaluation methodologies that are relevant to the measurement of training effectiveness in computer-simulated virtual learning environment. This paper explains on how learning can be assessed in VEs through the lens of training evaluation.

Does the use of computer assisted learning packages improve performance in accounting?

This study examines the factors affecting student performance in an undergraduate financial accounting course, utilising Computer Assisted Learning (CAL). Multiple regression analysis on student performance shows that positive perceptions of the usefulness of CAL significantly influenced performance. It was also found that International students had significantly poorer performance than local students. This result may be attributed to transitional problems experienced by these students, given their different pathways to university study Prior studies of accounting and computing at secondary school level, together with gender, were not significant influences on performance. The results have implications for accounting educators utilising CAL in courses as a means of improving students understanding of accounting concepts and as a means of providing efficient and effective educational instruction to maximise learning outcomes in accounting.

The role of computer assisted learning packages in determining learning outcomes of accounting students

This study examines the factors affecting student performance in an undergraduate financial accounting course, utilising Computer Assisted Learning (CAL) and use of a commercial software package. Multiple regression analysis was undertaken to examine the influences of perceptions of CAL and QuickBooks Pro, together with background variables such as gender, entry pathway and prior knowledge had on student performance. The results show that perceptions of CAL together with entry pathway were significant predictors of student performance. However, perceptions of the ,usefulness of QuickBooks Pro, prior studies of accounting and computing, together with gender, were not significant influences on performance. In terms of entry pathway it was found that International students, many of whom entered the university at the second year level having obtained advanced standing credits, had significantly poorer performance than local students. This result may be attributed to transitional problems experienced by these students, given their different pathways to university study.

The results have implications for accounting educators utilising CAL in courses as a means of improving students understanding of accounting concepts. The study also provides reflections on the use of CAL and a commercial software package as a means of providing efficient and effective educational instruction to maximise learning outcomes in accounting.

Evaluation of Australian undergraduate engineering management education for flexible delivery

This thesis examines issues in Australian undergraduate engineering management studies in the context of flexible learning delivery. It is proposed that, within an Australian context: a) the management skills and competencies required by graduate engineers can be determined and classified on a rational basis, permitting an educational focus on those elements most appropriate for graduates; and b) on-line and other computer-based technologies are a practical and effective method for the support of undergraduate engineering management studies. The doctoral project incorporates: • an examination of the nature of engineering management; • a review of the relevant literature establishing the importance of management studies in undergraduate engineering courses; • a review of historical and recent developments in Australian undergraduate engineering management studies; • an investigation of the management skills and competencies required by graduate engineers - based on original research; • an examination of flexible delivery of engineering education - based on professional practice experience; and • an evaluation of case studies of flexible delivery of engineering management education - based on original research and professional practice experience. A framework of ranked classified management skills is developed. Broadly, the ranking framework is generic professional skills, followed by general management skills and technical discipline specific management skills, followed by other professional discipline skills and theoretical skills. This framework provides a rational basis for design of undergraduate engineering management studies. This is supplemented by consideration of the management skills required for the future of engineering practice. It is concluded that undergraduate engineering management education is well suited to delivery and support by on-line and computer-based technology. Recent developments in improved access to the Internet, software systems for on-line collaboration and changes in copyright legislation to create a broad-based right to communication via on-line media have contributed to the facilitation of on-line delivery of teaching and learning. It is noted that though many on-line infrastructure issues have been satisfactorily resolved, higher level issues will emerge as being crucial, including the academic staff development and reward for operating in an online teaching environment and the financial sustainability of on-line development and delivery of courses.

Praxis modelling : an evaluation of and extension to feature based modelling

This thesis presents Relation Based Modelling as an extension to the Feature Based Modelling approach to student modelling. Relation Based Modelling dynamically creates new terms allowing the instructional designer to specify a set of primitives and operators from which the modelling system will create the necessary elements. Focal modelling is a new technique devised to manipulate and coordinate the addition of new terms. The thesis presents an evaluation of student modelling systems based on predictive accuracy.

The impact of computer-assisted learning on academic grades: an assessment of students' perceptions

This study examines student perceptions of the usefulness of Computer-Assisted Learning (CAL) packages in learning accounting concepts in terms of the influence on academic performance. Various additional factors  affecting academic performance [such as gender, prior studies of  accounting, and computer systems, together with entry background] are incorporated in the development of a multiple regression model, together with perceptions of CAL. The study uses a sample of 280 second-year undergraduate accounting students from an Australian university to test the model. In contrast to prior studies (e.g. Lane and Porch, 2002, Accounting Education: an international journal, 11(3), pp. 217-233), this study showed that positive perceptions of the usefulness of CAL significantly influenced performance. Additionally, it was found that international students, many of whom enter university at the second year level having obtained advanced standing credits, had significantly poorer performance than local students. The findings show that gender, prior studies of accounting and computing systems were not significant influences on academic performance. Overall, the results have implications for accounting educators utilising CAL in courses as a means of improving students' understanding of accounting concepts and academic performance.

Use and cost effectiveness of computer based training in the insurance industry

Training is essential to the growth and economic well-being of a nation. This need for training pervades all levels of industry, from a national level where a country’s well being is enhanced by training, to each company where productivity is improved, down to the individual whose skills are enhanced and as a result improve their position in the employment marketplace. The Australian Bureau of Statistics report ‘Training and Education Experience –Australia’ (ABS 1993) indicates that training in Australia is undertaken at a significant level with some 86% of employers undertaking some form of training. This is slightly higher in the Finance industry at a little over 89%. On the job training is undertaken by 82% of employers and off the job training is used by 47% of employers. In 80% of the off the job cases these courses were conducted in a conventional manner using an instructor. The remaining 20% of cases were either self paced (14%) or instructor based (6%). These latter cases could involve Computer Based Training (CBT). The report, referred to in the last paragraph, also indicates that a significant aspect of business in Australia is that 95% of businesses have less than 20 staff. This poses significant problems in that the ability to deliver effective training is limited. With businesses as small as these their size does not permit them to carry specialist training personnel so this role falls to the senior staff. These people already have a full workload and their ability to be able to take on training duties is limited. In addition these people were employed for their technical skills, not training. It may be that their ability to fill the role of a trainer is not good and as a result the training may not be very effective. In addition, small business has difficulty in releasing staff for training, The difficulties faced by small business were recognised by the Australian National Training Authority in their 1995 report which indicated that there was a need to develop a ‘training culture’ among small business employers. The authority made a commitment to provide flexible delivery strategies. This includes Computer Based Training (CBT). CBT has existed since the 1970’s. It came on to the scene with a flourish and tended to provide ‘page turning’ programs or ‘drill and practice programs’. In limited areas this form of training became popular but its popularity waned in the 80’s. With the advent of better graphical displays, larger and faster memory, and improved programs in the 1990’s the quality of CBT today is superior to those offered in the 70’s and has greater appeal. Today, still photographs and video clips can be displayed and made interactive. Because of this CBT is making a comeback and starting to have a greater impact. The insurance industry covers a wide range of companies in Australia, these companies vary in size from companies with employees in the thousands to companies with less than five staff. While the needs of the employees of each are similar the ability of these companies to deliver the training varies significantly. Any training can be divided into two parts. Internal or on the job training and external. External training deals with those aspects that concern the industry as a whole whereas internal training affects the individual company. Internal training would deal with matters like company procedures, company products and the like. External training deals with matters such as legislation, products generally, and the like. In the insurance industry the major problem arises with the small companies. Insurance companies would tend to be large in size and able to cover their training costs but the insurance brokers who would make up, numerically, the major number of companies would have a significant number of companies that fall into the 20 staffer less category. In fact many would have a staff of less than 5. While CBT can benefit all companies it is these small companies that could benefit from it the most. This thesis examines: • The place of CBT in training, its cost and effectiveness. • The incidence of CBT in the insurance industry and how the industry determines its effectiveness. • If a program that meets an industry need is able to be produced at a realistic price?

Instructional strategies integrating cognitive style construct : a meta-knowledge processing model

The overarching goal of this dissertation was to evaluate the contextual components of instructional strategies for the acquisition of complex programming concepts. A meta-knowledge processing model is proposed, on the basis of the research findings, thereby facilitating the selection of media treatment for electronic courseware. When implemented, this model extends the work of Smith (1998), as a front-end methodology, for his glass-box interpreter called Bradman, for teaching novice programmers. Technology now provides the means to produce individualized instructional packages with relative ease. Multimedia and Web courseware development accentuate a highly graphical (or visual) approach to instructional formats. Typically, little consideration is given to the effectiveness of screen-based visual stimuli, and curiously, students are expected to be visually literate, despite the complexity of human-computer interaction. Visual literacy is much harder for some people to acquire than for others! (see Chapter Four: Conditions-of-the-Learner) An innovative research programme was devised to investigate the interactive effect of instructional strategies, enhanced with text-plus-textual metaphors or text-plus-graphical metaphors, and cognitive style, on the acquisition of a special category of abstract (process) programming concept. This type of concept was chosen to focus on the role of analogic knowledge involved in computer programming. The results are discussed within the context of the internal/external exchange process, drawing on Ritchey's (1980) concepts of within-item and between-item encoding elaborations. The methodology developed for the doctoral project integrates earlier research knowledge in a novel, interdisciplinary, conceptual framework, including: from instructional science in the USA, for the concept learning models; British cognitive psychology and human memory research, for defining the cognitive style construct; and Australian educational research, to provide the measurement tools for instructional outcomes. The experimental design consisted of a screening test to determine cognitive style, a pretest to determine prior domain knowledge in abstract programming knowledge elements, the instruction period, and a post-test to measure improved performance. This research design provides a three-level discovery process to articulate: 1) the fusion of strategic knowledge required by the novice learner for dealing with contexts within instructional strategies 2) acquisition of knowledge using measurable instructional outcome and learner characteristics 3) knowledge of the innate environmental factors which influence the instructional outcomes This research has successfully identified the interactive effect of instructional strategy, within an individual's cognitive style construct, in their acquisition of complex programming concepts. However, the significance of the three-level discovery process lies in the scope of the methodology to inform the design of a meta-knowledge processing model for instructional science. Firstly, the British cognitive style testing procedure, is a low cost, user friendly, computer application that effectively measures an individual's position on the two cognitive style continua (Riding & Cheema,1991). Secondly, the QUEST Interactive Test Analysis System (Izard,1995), allows for a probabilistic determination of an individual's knowledge level, relative to other participants, and relative to test-item difficulties. Test-items can be related to skill levels, and consequently, can be used by instructional scientists to measure knowledge acquisition. Finally, an Effect Size Analysis (Cohen,1977) allows for a direct comparison between treatment groups, giving a statistical measurement of how large an effect the independent variables have on the dependent outcomes. Combined with QUEST's hierarchical positioning of participants, this tool can assist in identifying preferred learning conditions for the evaluation of treatment groups. By combining these three assessment analysis tools into instructional research, a computerized learning shell, customised for individuals' cognitive constructs can be created (McKay & Garner,1999). While this approach has widespread application, individual researchers/trainers would nonetheless, need to validate with an extensive pilot study programme (McKay,1999a; McKay,1999b), the interactive effects within their specific learning domain. Furthermore, the instructional material does not need to be limited to a textual/graphical comparison, but could be applied to any two or more instructional treatments of any kind. For instance: a structured versus exploratory strategy. The possibilities and combinations are believed to be endless, provided the focus is maintained on linking of the front-end identification of cognitive style with an improved performance outcome. My in-depth analysis provides a better understanding of the interactive effects of the cognitive style construct and instructional format on the acquisition of abstract concepts, involving spatial relations and logical reasoning. In providing the basis for a meta-knowledge processing model, this research is expected to be of interest to educators, cognitive psychologists, communications engineers and computer scientists specialising in computer-human interactions.

The 're-skilling' of tertiary teachers for new learning environments

This thesis investigates three online professional development activities for university teachers and student support staff, conducted between 1994 and 1996. The key research question was: 'What can we realistically expect of teachers and participants in online learning?' The inquiry produced instruments of use in the evaluation of online teaching.

Computer-assisted image analysis of liver collagen: relationship to Ishak scoring and hepatic venous pressure gradient

Histopathological scoring of disease stage uses descriptive categories without measuring the amount of fibrosis. Collagen, the major component of fibrous tissue, can be quantified by computer-assisted digital image analysis (DIA) using histological sections. We determined relationships between DIA, Ishak stage, and hepatic venous pressure gradient (HVPG) reflecting severity of fibrosis. One hundred fifteen patients with hepatitis C virus (HCV) who had undergone transplantation had 250 consecutive transjugular liver biopsies combined with HVPG (median length, 22 mm; median total portal tracts, 12), evaluated using the Ishak system and stained with Sirus red for DIA. Liver collagen was expressed as collagen proportionate area (CPA). Median CPA was 6% (0.2-45), correlating with Ishak stage (stage 6 range, 13%-45%), and with HVPG (r = 0.62; P < 0.001). Median CPA was 4.1% when HVPG was less than 6 mm Hg and 13.8% when HVPG was 6 mm Hg or more (P < 0.0001) and 6% when HVPG was less than 10 mm Hg and 17.3% when HVPG was 10 mm Hg or higher (P < 0.0001). Only CPA, not Ishak stage/grade, was independently associated by logistic regression, with HVPG of 6 mm Hg or more [odds ratio, 1.206; 95% confidence interval (CI), 1.094-1.331; P < 0.001], or HVPG of 10 mm Hg or more (odds ratio, 1.105; 95% CI, 1.026-1.191; P = 0.009). CPA increased by 50% (3.6%) compared with 20% in HVPG (1 mm Hg) in 38 patients with repeated biopsies. Conclusion: CPA assessed by DIA correlated with Ishak stage scores and HVPG measured contemporaneously. CPA was a better histological correlate with HVPG than Ishak stage, had a greater numerical change when HVPG was low, and resulted in further quantitation of fibrosis in cirrhosis.

A behavioural analysis of enforced delays in computerised programmed instruction

To evaluate the putative advantages of student self pacing in automated instruction,the studies in this thesis compare the effects of self-paced, and externally-paced, programmed instruction on student accuracy, retention, efficiency, and satisfaction. The results of the experiments show that self-pacing reduced accuracy, retention, and workrates compared to external pacing and indicated that learners often make poor choices about optimum learning conditions. They also show that small changes in the learning environment can result in consistent and substantial changes in learner performance, and that behaviour analysts have an important role to play in the design and implementation of instructional material.