Students' use of online academic resources within a course web site and its relationship with their course performance : an exploratory study

Prior research suggests that the online provision of course materials can have a positive impact on students' examination performance. This study adds to the existing literature by investigating the link between the students' use of different forms of online course provisions and tools (i.e. course materials, links and discussion forums) and the final examination performance of students in a second year undergraduate accounting course. Findings indicate a positive association between the number of online files viewed by students, the number of online discussion messages posted by them, and their examination performance. A significant relationship was not found between examination performance and the amount of time spent on the subject's web site, the viewing of links to web sites that were not core to the course being studied, or the passive reading of discussion messages. These findings support the benefits to be gained by providing course materials online and encouraging students to access the materials posted and to participate actively in online discussion.

Entry-level college mathematics success predictors : developmental performance, 'stopping-out' and demographics

Institutionally collected data identifying student demographics, course performance in both the precollege mathematics course and the college-level mathematics course, and 'stopping-out' time between the pre-college course and the college-level course were used to create a predictive model of academic success for 'high risk' college-level mathematics students. The two most significant factors were the pre-college mathematics course grade and the student's over-all college GPA.

Academic performance of college students in financial management and related prerequisite courses: A comparison of senior high school and commercial high school graduates attending Tamsui Oxford University College in Taiwan

In Taiwan, the college freshmen are recruited graduates of both senior high school and senior vocational school. The Ministry of Education (MOE) of the Republic of China prescribes the standards of curriculum and equipment for schools at all levels and categories. There exists a considerably different curriculum arrangement for senior high schools and vocational high schools in Taiwan at the present time. The present study used a causal-comparative research design to identify the influences of different post-secondary educational background on specialized course performance of college business majors. ^ The students involved in this study were limited to the students of four business-related departments at Tamsui Oxford University College in Taiwan. Students were assigned to comparison groups based on their post-secondary educational background as senior high school graduates and commercial high school graduates. The analysis of this study included a comparison of students' performance on lower level courses and a comparison of students' performance in financial management. The analysis also considered the relationship between the students' performance in financial management and its related prerequisite courses. The Kolb Learning Style Inventory (LSI) survey was administered to categorize subjects' learning styles and to compare the learning styles between the two groups in this study. The applied statistical methods included t-test, correlation, multiple regression, and Chi-square. ^ The findings of this study indicated that there were significant differences between the commercial high school graduates and the senior high school graduates on academic performances in specialized courses but not in general courses. There were no significant differences in learning styles between the two groups. These findings lead to the conclusion that business majors' academic performance in specialized courses were influenced by their post-secondary educational background. ^

Personality and performance: Assessing the mediating role of mental model formation in the personality-performance relationship

Personality has long been linked to performance. Evolutions in this relationship have brought forward new questions regarding the true nature of how personality impacts performance. Both direct and indirect relationships have been proven significant. This study further investigated potential indirect relationships by including a mediating variable, mental model formation, in the personality-performance relationship. Undergraduate students were assessed in a 6-week period, Time 1 - Time 2 experiment. Conceptualizations of personality included measures of the Big 5 model and Self-efficacy, with performance measured by content quiz and overall course scores. Findings showed that the Big 5 personality traits, extraversion and agreeableness, positively and significantly impacted commonality with the instructor's mental model. However, commonality with the instructor's mental model did not impact performance. In comparison, commonality with an expert mental model positively and significantly impacted performance for both the content quiz and overall course score. Furthermore, similarity with an expert mental model positively and significantly impacted overall course performance. Hypothesized full mediation of mental model formation for the personality-performance relationship was not supported due to a lack of direct effect relationships required for mediation. However, a revised conceptualization of results emerged. Findings from the current study point to the novel and unique role mental models play in the personality-performance relationship. While personality traits do impact mental model formation, accuracy in the mental models formed is critical to performance.

Personality and Performance: Assessing the Mediating Role of Mental Model Formation in the Personality-Performance Relationship

Personality has long been linked to performance. Evolutions in this relationship have brought forward new questions regarding the true nature of how personality impacts performance. Both direct and indirect relationships have been proven significant. This study further investigated potential indirect relationships by including a mediating variable, mental model formation, in the personality-performance relationship. Undergraduate students were assessed in a 6-week period, Time 1 - Time 2 experiment. Conceptualizations of personality included measures of the Big 5 model and Self-efficacy, with performance measured by content quiz and overall course scores. Findings showed that the Big 5 personality traits, extraversion and agreeableness, positively and significantly impacted commonality with the instructor’s mental model. However, commonality with the instructor’s mental model did not impact performance. In comparison, commonality with an expert mental model positively and significantly impacted performance for both the content quiz and overall course score. Furthermore, similarity with an expert mental model positively and significantly impacted overall course performance. Hypothesized full mediation of mental model formation for the personality-performance relationship was not supported due to a lack of direct effect relationships required for mediation. However, a revised conceptualization of results emerged. Findings from the current study point to the novel and unique role mental models play in the personality-performance relationship. While personality traits do impact mental model formation, accuracy in the mental models formed is critical to performance.

Multidisciplinary students on Property core units : comparative analysis of introductory and advanced units

The composition of many professional services firms in the Urban Development area has moved away from a discipline specific ‘silo’ structure to a more multidisciplinary environment. The benefits of multidisciplinarity have been seen in industry by providing synergies across many of the related disciplines. Similarly, the Queensland University of Technology, Bachelor of Urban Development degree has sought to broaden the knowledge base of students and achieve a greater level of synergy between related urban development disciplines through the introduction of generic and multidisciplinary units. This study aims to evaluate the effectiveness of delivering core property units in a multidisciplinary context. A comparative analysis has been undertaken between core property units and more generic units offered in a multidisciplinary context from introductory, intermediate and advanced years within the property program. This analysis was based on data collected from course performance surveys, student performance results, a student focus group and was informed by a reflective process from the student perspective and lecturer/ tutor feedback. The study showed that there are many benefits associated with multidisciplinary unit offerings across the QUT Urban Development program particularly in the more generic units. However, these units require a greater degree of management. It is more difficult to organise, teach and coordinate multidisciplinary student cohorts due to a difference in prior knowledge and experience between each of the discipline groups. In addition, the interaction between lecturers/ tutors and the students frequently becomes more limited. A perception exists within the student body that this more limited face to face contact with academic staff is not valuable which may be exacerbated by the quality of complimentary online teaching materials. For many academics, non-attendance at lectures was coupled with an increase in email communication. From the limited data collected during the study there appears to be no clear correlation between large multidisciplinary student classes and student academic performance or satisfaction.

Reframe QUT's evaluation framework : a case study of planning, policy and positioning leading to educational best practice

Every university in Australia has a set of policies that guide the institution in its educational practices, however, the policies are often developed in isolation to each other. Now imagine a space where policies are evidence-based, refined annually, cohesively interrelated, and meet stakeholders’ needs. Is this happenstance or the result of good planning? Culturally, Queensland University of Technology (QUT) is a risk-averse institution that takes pride in its financial solvency and is always keen to know “how are we going?” With a twenty-year history of annual reporting that assures the quality of course performance through multiple lines of evidence, QUT’s Learning and Teaching Unit went one step further and strategically aligned a suite of policies that take into consideration the needs of their stakeholders, collaborate with other areas across the institution and use multiple lines of evidence to inform curriculum decision-making. In QUT’s experience, strategic planning can lead to policy that is designed to meet stakeholders’ needs, not manage them; where decision-making is supported by evidence, not rhetoric; where all feedback is incorporated, not ignored; and where policies are cohesively interrelated, not isolated. While many may call this ‘policy nirvana’, QUT has positioned itself to demonstrate good educational practice through Reframe, its evaluation framework. In this case, best practice was achieved through the application of a theory of change and a design-led logic model that allows for transition to other institutions with different cultural specificity. The evaluation approach follows Seldin’s (2003) notion to offer depth and breadth to the evaluation framework along with Berk’s (2005) concept of multiple lines of evidence. In summary, this paper offers university executives, academics, planning and quality staff an opportunity to understand the critical steps that lead to strategic planning and design of evidence-based educational policy that positions a university for best practice in learning and teaching.

Does the discussion help? The impact of a formally assessed online discussion on final student results

While there is agreement that participation in online asynchronous discussions can enhance student learning, it has also been identified that there is a need to investigate the impact of participation in online discussions on student course performance. This paper presents a case study based on an undergraduate engineering management unit employing a formally assessed online discussion area. It was observed that while many students read a significant number of discussion postings, generally, the posting of new and reply messages occurred at the minimum level required to qualify for the assignment marks. Based on correlation and multiple regression analysis, it was observed that two variables were significantly related to a student's final unit mark—prior academic ability and the number of new postings made to the online discussion. Each new posting contributed three times as much to the final unit mark as its nominal assessment value, suggesting that the work in preparing their new discussion postings assisted students in the completion of a range of assessable tasks for the unit. The number of postings read was not significantly correlated with the final unit mark, suggesting that passive lurking in this online discussion did not significantly contribute to student learning outcomes.

Comparative evaluation of PBL and traditional lecturebased teaching in undergraduate engineering courses : evidence from controlled learning environment

Project and problem-based learning (PBL) has been widely recognised as an active, collaborative, cumulative and integrative learning approach that engages learners, motivates team creativity and centres on practical education. On the other hand, traditional lecture-tutorial teaching is often criticised for being a passive, surface learning and exam-focused approach. In spite of these evidence-based observations and claims over the years, the traditional lecture-tutorial teaching approach still dominates as the preferred teaching approach at Australian universities. This study sets up a control environment to compare these two teaching and learning approaches by analysing data from students' actual performance, course evaluation and expectation in two large undergraduate engineering courses in 2009 and 2010. The evidence reported in this study is broadly interesting in that both courses were taught by the same teaching staff using two entirely different learning and teaching approaches to the same cohort of students in the same semester within the same degree program. The analysis shows that there are significant differences between the students' actual performance, course evaluation and their expectation. Such conflicting differences may be some of the reasons that may negatively impact teaching staff deterring them from switching to PBL from traditional lecture-tutorial teaching.

Development and measurement properties of a putting skill test for high-level golf

Despite a recent increase in the amount of research investigating performance in golf, a comprehensive putting skill test has not been reported in the peer-reviewed literature. In this study, the Golf Australia Putting Test (GAPT) was developed and a series of measurement properties were assessed. Elite (n = 18) and high-level amateur (HLA; n = 22) participants completed six single putts from various areas on six concentric circles (circle radii = 0.9, 1.5, 3.0, 4.6, 6.1 and 7.6 m). Using a scoring system that rewarded participants for holing putts from longer distances, the maximum score from a single round of the test (i.e. 36 putts) was 27 points. After two rounds of the test were completed by all players, a subsample of participants (elite, n = 15; HLA, n = 7) had their putting performance recorded during tournament play for a period of 90 days to assess criterion (predictive) validity of the test. The reliability, sensitivity and discriminative validity of the GAPT were also assessed. Better agreement between Rounds 1 and 2 scores was noted in the elite group, whilst reliability values were similar for both groups. Further, the GAPT scores were shown to predict players from the elite and high-ability groups with a low classification error. An equation for predicting on-course performance from GAPT scores was also developed. Findings from this study indicate that the GAPT is a valid and reliable tool for high-level players and the GAPT may be used for player evaluation in the field.

Aspetos da vida universitária e a síndrome de burnout

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)

The impact of the Florida state -mandated Basic Skills Exit Tests at Miami -Dade Community College

The purpose of this study was to explore the impact of the Florida State-mandated Basic Skills Exit Tests (BSET) on the effectiveness of remedial instruction programs to adequately serve the academically underprepared student population. The primary research question concerned whether the introduction of the BSET has resulted in remedial completers who are better prepared for college-level coursework. ^ This study consisted of an ex post facto research design to examine the impact of the BSET on student readiness for subsequent college-level coursework at Miami-Dade Community College. Two way analysis of variance was used to compare the performance of remedial and college-ready students before and after the introduction of the BSET requirement. Chi-square analysis was used to explore changes in the proportion of students completing and passing remedial courses. Finally, correlation analysis was used to explore the utility of the BSET in predicting subsequent college-level course performance. Differences based on subject area and race/ethnicity were explored. ^ The introduction of the BSET did not improve the performance of remedial completers in subsequent college-level courses in any of the subject areas. The BSET did have a negative impact on the success rate of students in remedial reading and mathematics courses. There was a significant decrease in minority students' likelihood of passing remedial reading and mathematics courses after the BSET was introduced. The reliability of the BSET is unacceptably low for all subject areas, based on estimates derived from administrations at M-DCC. Nevertheless, there was a significant positive relationship between BSET score and grade point average in subsequent college-level courses. This relationship varied by subject area and ethnicity, with the BSET reading score having no relationship with subsequent course performance for Black non-Hispanic students. ^ The BSET had no discernable positive effect on remedial student performance in subsequent college-level courses. In other words, the BSET has not enhanced the effectiveness of the remedial programs to prepare students for later coursework at M-DCC. The BSET had a negative impact on the progress and success of students in remedial reading and mathematics. ^

The impact of the Florida state-mandated basic skills exit test at Miami-Dade Community College

The purpose of this study was to explore the impact of the Florida State-mandated Basic Skills Exit Tests (BSET) on the effectiveness of remedial instruction programs to adequately serve the academically underprepared student population. The primary research question concerned whether the introduction of the BSET has resulted in remedial completers who are better prepared for college-level coursework. This study consisted of an ex post facto research design to examine the impact of the BSET on student readiness for subsequent college-level coursework at Miami- Dade Community College. Two way analysis of variance was used to compare the performance of remedial and college-ready students before and after the introduction of the BSET requirement. Chi-square analysis was used to explore changes in the proportion of students completing and passing remedial courses. Finally, correlation analysis was used to explore the utility of the BSET in predicting subsequent college-level course performance. Differences based on subject area and race/ethnicity were explored.

Caminhos para a avaliação da formação em odontologia: desenvolvimento, validação e aplicação de critérios

The need for universal access to health and the failure of the pedagogical model centered on the transmission of knowledge has led to changes in the training of health professionals. The objective of this study was to provide a new alternative for evaluating dental students through the development, validation and application of evaluation criteria based on the National Curriculum Guidelines (DCN in Brazil). Therefore, the study was conducted in three phases: development and validation of evaluation criteria of Dentistry courses based on the DCN; a pilot study to verify the applicability of the validated criteria and evaluation of the dentistry courses in the Northeast. In the first stage, a logical model was formulated, allowing for the construction of a criteria matrix, validated by a modified Delphi consensus technique. The validated matrix has the following dimensions: Profile of graduates, health care guidance, teaching and service integration, and pedagogical approach. The pilot study was conducted in five dental courses through a documentary study of the pedagogical project course (PPC), and application of validated questionnaires and interviews with course coordinators. The results of the pilot study indicate the possibility of being verified by means of validated criteria and using different methodological proposals, advances and curricular limitations facing the proposed reorientation of training recommended by DCN. The evaluation of Northeast Dentistry courses was carried out by applying a questionnaire validating a matrix of 30 course coordinators, including public and private institutions. The data were submitted to descriptive analysis, and also tested the difference between means and the correlation between the assessment of the coordinators in the dimensions and sub-dimensions with each other, among the general evaluation of courses and between the following variables: administrative category, time since last curriculum updating, participation in reorienting the training of health professionals programs, ENADE and CPC (Preliminary Concepts of the Course) scores in the year 2013. Positive correlation (p <0.01) was found between the means obtained by the perception of the coordinators in most dimensions, and also between them and the overall performance of the course. There were no significant differences between the coordinators’ perception about course performance and the administrative category (public / private). This difference is slightly higher when the average performance is compared with respect to time due to the last curriculum update, getting better performance in courses with the latest updated curriculum, even with there not 11 being this significant difference between dimensions. Better averages of performance were obtained in courses that do not participate in reorientation programs of professional training, with a significant difference (p<0.05) for the overall score and for all dimensions except the dimensions of teaching-service Integration (p = 0.064). There was no significant correlation between the assessment of coordinators in all dimensions, in the overall assessment or ENADE and CPC scores in 2013. The final instrument proposed in this study is a different alternative assessment for health training of both dentists and other professionals, considering that the DCN providing for the training and graduation of professionals is focused on the health needs of the population, integrated with the SUS (the National Brazilian Health System) and based on student-centered learning.