Collaborative design of assessment criteria to improve undergraduate student engagement and performance

Student engagement is vital in enhancing the student experience and encouraging deeper learning. Involving students in the design of assessment criteria is one way in which to increase student engagement. In 2011, a marking matrix was used at Aston University (UK) for logbook assessment (Group One) in a project-based learning module. The next cohort of students in 2012 (Group Two) were asked to collaboratively redesign the matrix and were given a questionnaire about the exercise. Group Two initially scored a lower average logbook mark than Group One. However, Group Two showed the greatest improvement between assessments, and the quality of, and commitment to, logbooks was noticeably improved. Student input resulted in a more defined, tougher mark scheme. However, this provided an improved feedback system that gave more scope for self-improvement. The majority of students found the exercise incorporated their ideas, enhanced their understanding, and was useful in itself.

Uncovering the root cause of ethnic difference in ability testing:differential test functioning, test familiarity and trait optimism as explanations of ethnic group differences

The present research represents a coherent approach to understanding the root causes of ethnic group differences in ability test performance. Two studies were conducted, each of which was designed to address a key knowledge gap in the ethnic bias literature. In Study 1, both the LR Method of Differential Item Functioning (DIF) detection and Mixture Latent Variable Modelling were used to investigate the degree to which Differential Test Functioning (DTF) could explain ethnic group test performance differences in a large, previously unpublished dataset. Though mean test score differences were observed between a number of ethnic groups, neither technique was able to identify ethnic DTF. This calls into question the practical application of DTF to understanding these group differences. Study 2 investigated whether a number of non-cognitive factors might explain ethnic group test performance differences on a variety of ability tests. Two factors – test familiarity and trait optimism – were able to explain a large proportion of ethnic group test score differences. Furthermore, test familiarity was found to mediate the relationship between socio-economic factors – particularly participant educational level and familial social status – and test performance, suggesting that test familiarity develops over time through the mechanism of exposure to ability testing in other contexts. These findings represent a substantial contribution to the field’s understanding of two key issues surrounding ethnic test performance differences. The author calls for a new line of research into these performance facilitating and debilitating factors, before recommendations are offered for practitioners to ensure fairer deployment of ability testing in high-stakes selection processes.

Corporate identity at the stakeholder group level:a conceptual model of front-line employee corporate identity

There is a paucity of literature regarding the construction and operation of corporate identity at the stakeholder group level. This article examines corporate identity from the perspective of an individual stakeholder group, namely, front-line employees. A stakeholder group that is central to the development of an organization’s corporate identity as it spans an organization’s boundaries, frequently interacts with both internal and external stakeholders, and influences a firm’s financial performance by building customer loyalty and satisfaction. The article reviews the corporate identity, branding, services and social identity literatures to address how corporate identity manifests within the front-line employee stakeholder group, identifying what components comprise front-line employee corporate identity and assessing what contribution front-line employees make to constructing a strong and enduring corporate identity for an organization. In reviewing the literature the article develops propositions that, in conjunction with a conceptual model, constitute the generation of theory that is recommended for empirical testing.

The effectiveness of workplace coaching:A meta-analysis of learning and performance outcomes; scale development; theoretical model of individual differences and longitudinal study

The extant literature on workplace coaching is characterised by a lack of theoretical and empirical understanding regarding the effectiveness of coaching as a learning and development tool; the types of outcomes one can expect from coaching; the tools that can be used to measure coaching outcomes; the underlying processes that explain why and how coaching works and the factors that may impact on coaching effectiveness. This thesis sought to address these substantial gaps in the literature with three linked studies. Firstly, a meta-analysis of workplace coaching effectiveness (k = 17), synthesizing the existing research was presented. A framework of coaching outcomes was developed and utilised to code the studies. Analysis indicated that coaching had positive effects on all outcomes. Next, the framework of outcomes was utilised as the deductive start-point to the development of the scale measuring perceived coaching effectiveness. Utilising a multi-stage approach (n = 201), the analysis indicated that perceived coaching effectiveness may be organised into a six factor structure: career clarity; team performance; work well-being; performance; planning and organizing and personal effectiveness and adaptability. The final study was a longitudinal field experiment to test a theoretical model of individual differences and coaching effectiveness developed in this thesis. An organizational sample of 84 employees each participated in a coaching intervention, completed self-report surveys, and had their job performance rated by peers, direct reports and supervisors (a total of 352 employees provided data on participant performance). The results demonstrate that compared to a control group, the coaching intervention generated a number of positive outcomes. The analysis indicated that coachees’ enthusiasm, intellect and orderliness influenced the impact of coaching on outcomes. Mediation analysis suggested that mastery goal orientation, performance goal orientation and approach motivation in the form of behavioural activation system (BAS) drive, were significant mediators between personality and outcomes. Overall, the findings of this thesis make an original contribution to the understanding of the types of outcomes that can be expected from coaching, and the magnitude of impact coaching has on outcomes. The thesis also provides a tool for reliably measuring coaching effectiveness and a theoretical model to understand the influence of coachee individual differences on coaching outcomes.

Az exportteljesítmények és a hátterükben álló vállalati jellemzők elemzése (Export performance clusters of the Hungarian enterprises)

A tanulmány célja a Magyarországon működő exportáló vállalatok jellemzőinek feltárása volt a 2009-es vállalati versenyképességi felmérés alapján. Több tanulmány vizsgálta a vállalatok exportteljesítményét vállalati méret és tulajdonosi szerkezet szerinti bontásban, az elemzésben a szerző viszont ettől eltérő szemléletmódot alkalmazott. A vállalatok exportteljesítménye áll (exportértékesítés volumene, aránya, exportárbevétel változása, jövedelmezőség), a vállalati csoportképzés, klaszterelemzés középpontjában. Három jól elkülöníthető klasztert sikerült azonosítani: a jelentős exporthányaddal és folyamatos növekedéssel jellemezhető sikeres exportáló vállalatok csoportját, a stagnálással, s gyakran csökkenő exportértékesítéssel jellemezhető vállalatcsoportot, s végül a harmadik klasztert azok a jelenleg még alacsony export-ár bevétellel és alacsony exportaránnyal jellemezhető vállalatok képezték, melyekre a növekedés és a kiugróan magas jövedelmezőség volt a jellemző. Az elemzés egyediségét az adja, hogy a vállalati versenyképességi felmérés adatbázisa lehetővé tette a különböző exportteljesítmények hátterében álló működési jellemzők vizsgálatát, amelynek eredményeit a cikk bemutatja. Fő következtetésként megállapítható, hogy a sikeres exportáló vállalatok csoportja mindegyik jellemző szerint jobb működési jellemzőkkel rendelkezik a másik két csoporthoz viszonyítva. / === / The purpose of the paper is to reveal the main characteristics of the Hungarian export oriented firms. It is based on the Hungarian Competitiveness Research Survey 2009. 85% of enterprises were small or medium size in the sample. The aim of the analysis was to identify main factors and tendencies of the overall export performance. Several papers discussed the export activities of firms according to their size and ownership structure in Hungary. A different method was used here. The overall export performance (measured by volume, change, and share of export revenues, and firm profitability ratios) was put in the centre of cluster analysis. Three different clusters were identified. Firms in the firstcluster had significant export performance and growth rate. The second cluster was the group of stagnating firms and the third one contained those whose export performance was low but signaled growth with excellent profitability ratios. The uniqueness of the paper derived from the Competitiveness Research Survey because it provided an opportunity to analyse the connection between export performance and other management and operational characteristics of enterprises. The paper may induce futher research in exploring main enterprise level factors of export performance of the Hungarian firms.

Az exportpiac-orientáció előzményei és annak exportteljesítményre gyakorolt hatása a magyar felsőoktatási intézményekben (Antecedents to the export market orientation of Hungarian higher education institutions, and their export performance consequences)

A felsőoktatás nemzetközi versenyképességének vizsgálata azt mutatja, hogy egyre szélesebb körben alkalmazzák a sikeres egyetemek azokat a megközelítéseket, amelyeket az elmúlt fél évszázadban a menedzsmentirodalom az üzleti szférában meghonosított. A szerzők a felsőoktatási ágazatra terjesztik ki az exportpiac- orientáció elméletét, és azt vizsgálják, hogy milyen előzmények vezetnek annak kialakulásához. Elemzik továbbá, hogy az exportpiac-orientáció milyen hatással van a felsőoktatási intézmények exportteljesítményére. A tanulmány továbbá kitér az exportpiac-orientáció és az exportteljesítmény kapcsolatát befolyásoló környezeti tényezők hatásának vizsgálatára is. A szerzők az említett összefüggéseket két almintán vizsgálják (a nemzetköziesedésben és a tudományos kutatásban vezető egyetemek vs. az előbbi dimenziókban gyengébben teljesítő felsőoktatási intézmények). Az eredmények alapján megállapítják, hogy az exporttapasztalat mindkét egyetemi csoportnál az exportteljesítmény szignifikáns előrejelzője, míg az exportkoordináció csupán a nemzetköziesedésben gyengébben teljesítő egyetemek csoportjánál magyarázza az exportpiac-orientáció változását. Megfigyelhető továbbá, hogy az exportpiac-orientáció exportteljesítményre gyakorolt hatása erősebb a nemzetköziesedésben vezető magyar egyetemeknél, míg a nemzetközi piacokon tapasztalható verseny intenzitása fokozza a nemzetközi irányultság kialakulását ugyanezen csoportnál. ______ The authors extend the theory of export market orientation to the higher education sector, and explore the association between export coordination, export experience, export market orientation, export performance and the competitive environment in the context of Hungarian higher education sector. The aforementioned relations are analyzed on two subsamples (universities with a top performance vs. universities with a lower performance in regard of internationalization and scientific research). Based on the results, the authors conclude that export experience is a significant predictor of export performance in both groups of institutions, while export coordination can only explain changes in export market orientation for the group comprising the universities that lag behind in terms of internationalization. They observe, moreover, that export market orientation becomes stronger as competitive forces in the environment intensify.

The effects of writing process instruction on the writing and reading performance of students with learning disabilities

The purpose of this study was to determine the efficacy of a writing process approach for the instruction of language arts with learning disabled elementary students. A nonequivalent control group design was used. The sample included 24 students with learning disabilities who were in second and third grade. All students were instructed in resource room settings for ninety minutes per day in language arts. The students in the treatment group received instruction using the writing process steps to create complete meaningful compositions on self-chosen topics. A literature-based reading program accompanied instruction in writing to provide examples of good writing and to provide a basis for topic selection. The students in the control group received instruction through the use of the county-adopted textbooks and accompanying worksheets. The teacher followed basic textbook and curriculum guide suggestions which consisted mainly of fill in the blank and matching type exercises. The treatment group consisted of 12 students: five second-graders and seven third-graders. The control group consisted of 12 students: four second-graders and eight third-graders. All students were pretested and posttested using the Woodcock-Johnson Tests of Achievement-Revised (WJ-R ACH) for writing samples and the Woodcock Reading Mastery Test (WRMT) for reading achievement. T-tests were also done to investigate the gain from pre to post for each reading or writing variable for each group separately. The results showed a highly significant difference from pretest to posttest for all writing and reading variables for both groups. Analysis of Covariance showed that the population mean posttest achievement scores for all variables adjusted for the pretest were higher for the treatment group than those for the control group.

A comparison of the academic performance of students with General Educational Development credentials and high school diplomas at a selected community college

This study compared the performance of students who earned GED credentials in Florida with that of graduates of Florida high schools, when members of both groups enrolled for the first time in fall 1992 at an urban multicultural community college in south Florida. GED's and HSD's were matched on gender, race, age range, placement levels, and enrollment in college preparatory courses (reading, English, mathematics). The paired samples t-test compared course grades, first semester GPA, and total college GPA for the groups and subgroups of matched students at a probability level of .05. The McNemar test compared how many students in each group and subgroup re-enrolled for a second and third term, or ever; how many were placed on special academic status during their college enrollment; and how many graduated within 16 semesters. Differences between groups were found only for placement on probation—with HSD's on probation in significantly higher proportion than GED's. ^ Additional findings among subgroups revealed that male and Caucasian HSD subjects earned higher math grades than their GED counterparts. Male HSD's were more likely than male GED's to return to the college at some point after the first term. However, male HSD's were placed on probation in greater proportion than the GED's with whom they were matched. ^ Female GED's earned higher English grades and higher first semester and cumulative GPA's and returned to the college in greater proportion than their HSD counterparts. Black GED's earned higher first-semester GPA's, re-enrolled in terms 2 and 3 and graduated from the college in higher percentages than Black HSD's. Black HSD's were placed on probation in higher proportion than Black GED's. Lastly, greater percentages of HSD than GED subjects in the lowest age range (16–19) were placed on probation. ^ Results connected to the performance of Black GED subjects are likely to have been affected by the fact that 50% of Black study subjects had been born in Jamaica. The place of the GED in the constellation of methods for earning credit by examination is explored, future implications are discussed, and further study is recommended. ^

Group participative budgeting: The effect of information asymmetry on group work standards

The complexity of many organizational tasks requires perspectives, expertise, and talents that are often not found in a single individual. Organizations have therefore been placing employees into groups, assigning them to tasks they would formally have undertaken individually. The use of these groups, known as workgroups, has become an important strategy for managing this increased complexity. Empirical research on participative budgeting however has been limited almost exclusively to individuals. This dissertation empirically examines the effect of the information that management and workgroups have about group members' performance capabilities, on the work standards that workgroups select during the participative budgeting process. ^ A laboratory experiment was conducted in which two hundred and forty undergraduate business students were randomly assigned to three-member groups. The study provides empirical evidence which suggests that when management is unaware of group members' performance capabilities, workgroups select higher work standards and have higher performance levels than when management is aware of their performance capabilities. ^

The effects of the outdoor experiential ropes course on perceived team performance

The purpose of this quasi-experimental study was to explore the perceived effects of the Ropes Course on the performance of intact work teams. The dependent variable, team performance, was measured by the Team Performance Assessment, a 20 question inventory. The Ropes Course, the independent variable, was an outdoor experiential training program presently marketed as a highly effective team building training program. Issues the team addressed in the highly emotional and physical environment were purported to transfer back to the work environment and act as a catalyst for change The Ropes Course in this study consisted of a day long series of outdoor mental, emotional and physical exercises addressing the issues of goal-setting, role expectations, accountability, trust, respect, communication, problem-solving and decision-making. The 68 subjects, 37 in the treatment group and 31 in the control were employees of a large international financial institution. They were not chosen by random selection. The work teams' managers recognized a need to improve team morale, performance and functioning due to corporate reengineering and downsizing resulting in team members' job losses. Control teams were partially matched to the treatment teams on the basis of professional composition and similar job descriptions. The pretest of the Team Performance Assessment was given the morning of the Ropes Course treatment and the posttest was given three to five weeks later. The control teams received the pretests and posttests at about the same time intervals at their work location but received no Ropes Course treatment. The treatment teams' scores and the control teams' scores were statistically compared using the Multivariate Analysis of Variance (MANOVA) and the Multivariate Analysis of Covariance (MANCOVA) at the .05 level of significance. The statistical analysis revealed a significant difference between the control and experimental teams after the team building Ropes Course training as measured by the Team Performance Assessment (Gilbert, 1996). ^

Black middle school students' perceptions of success and their influence on academic performance

The purpose of the study was to investigate the perceptions of success held by Black middle school students in a Miami-Dade County (FL) public school and how these perceptions influence academic performance. The study sought to determine if differences exist among African-American, Haitian-American, and Haitian immigrant subgroups of the Black student population. ^ The study combined qualitative and quantitative methodology in data collection and analysis. The qualitative data consisted of three focus group interviews. Using a semi-structured protocol, questions focused on the student's perceptions of the characteristics of successful people, definitions of success, behaviors associated with achieving success, and peer, family and school support. The quantitative data comprised the responses of 352 Black middle school students to the Inventory of Student Motivation (ISM) developed to measure mastery, performance and social goal orientations. Response similarities and differences were examined using a series of two-way ANOVAs on the success scales by gender and culture. A three-way repeated measures ANOVA was conducted on mastery, performance and social general goal scales by culture and gender. ^ The results of the ISM revealed no statistically significant differences among African-American, Haitian-American, and Haitian students in their mastery, performance or social goal orientations. All three cultural groups scored significantly high on the mastery goal scale. There was a significant effect for gender on the mastery general scale with the females being more concerned with mastery than the males. Qualitative focus group interview results included varying definitions of success. African-American and Haitian-American students defined success in materialistic terms. Haitian students defined success in scholastic achievement terms. All students indicated hard work, persistence and goal setting through completion as important to achieving success. Negative influences included peer pressure, teacher and societal expectations, and classroom environment. Parental reaction to low academic performance varied by culture. ^

A comparative analysis of self-determined evaluations of work performance and support needs by adults with mental retardation in supported work and in sheltered workshop environments

The purpose of this study was to determine if there was a difference in the self-determined evaluations of work performance and support needs by adults with mental retardation in supported employment and in sheltered workshop environments. The instrument, Job Observation and Behavior Scale: Opportunity for Self-Determination (JOBS: OSD; Brady, Rosenberg, & Frain, 2006), was administered to 38 adults with mental retardation from sheltered workshops and 32 adults with mental retardation from supported employment environments. Cross-tabulations with Chi-square tests and independent samples t-tests were conducted to evaluate differences between the two groups, sheltered workshop and supported work. Two Multivariate Analyses of Variance (MANOVAs) were conducted to determine the effect of work environment on Quality of Performance (QP) and Types of Support (TS) test scores and their subscales. ^ This study found that there were significant differences between the groups on the QP Behavior and Job Duties subscales. The sheltered workshop group perceived themselves as performing significantly better on job duties than the supported work group. Conversely, the supported work group perceived themselves to have better behavior than the sheltered workshop group. However, there were no significant differences between groups in their perception of support needs for the three subscales. ^ The findings imply that work environment affects the self-determined evaluations of work performance by adults with mental retardation. Recommendations for further study include (a) detailing the characteristics of supported work and sheltered workshops that support and/or discourage self-determined behaviors, (b) exploring the behavior of adults with mental retardation in sheltered workshops and supported work environments, and (c) analysis of the support needs for and understanding of them by adults with mental retardation in sheltered workshops and in supported work environments. ^

Effect of performance feedback on perceived knowledge and likelihood to pursue continuing education

The purpose of this study was to assess the effect of performance feedback on Athletic Trainers’ (ATs) perceived knowledge (PK) and likelihood to pursue continuing education (CE). The investigation was grounded in the theories of “the definition of the situation” (Thomas & Thomas, 1928) and the “illusion of knowing,” (Glenberg, Wilkinson, & Epstein, 1982) suggesting that PK drives behavior. This investigation measured the degree to which knowledge gap predicted CE seeking behavior by providing performance feedback designed to change PK. A pre-test post-test control-group design was used to measure PK and likelihood to pursue CE before and after assessing actual knowledge. ATs (n=103) were randomly sampled and assigned to two groups, with and without performance feedback. Two independent samples t-tests were used to compare groups on the difference scores of the dependent variables. Likelihood to pursue CE was predicted by three variables using multiple linear regression: perceived knowledge, pre-test likelihood to pursue CE, and knowledge gap. There was a 68.4% significant difference (t101=2.72, p=0.01, ES=0.45) between groups in the change scores for likelihood to pursue CE because of the performance feedback (Experimental group=13.7% increase; Control group=4.3% increase). The strongest relationship among the dependent variables was between pre-test and post-test measures of likelihood to pursue CE (F2,102=56.80, p<0.01, r=0.73, R2=0.53). The pre- and post-test predictive relationship was enhanced when group was included in the model. In this model [YCEpost=0.76XCEpre-0.34 Xgroup+2.24+E], group accounted for a significant amount of unique variance in predicting CE while the pre-test likelihood to pursue CE variable was held constant (F3,102=40.28, p<0.01, r=0.74, R2=0.55). Pre-test knowledge gap, regardless of group allocation, was a linear predictor of the likelihood to pursue CE (F1,102=10.90, p=.01, r=.31, R2=.10). In this investigation, performance feedback significantly increased participants’ likelihood to pursue CE. Pre-test knowledge gap was a significant predictor of likelihood to pursue CE, regardless if performance feedback was provided. ATs may have self-assessed and engaged in internal feedback as a result of their test-taking experience. These findings indicate that feedback, both internal and external, may be necessary to trigger CE seeking behavior.

Measuring effectiveness in international financial crime prevention: Can we agree on a performance metric?

The attempts at carrying out terrorist attacks have become more prevalent. As a result, an increasing number of countries have become particularly vigilant against the means by which terrorists raise funds to finance their draconian acts against human life and property. Among the many counter-terrorism agencies in operation, governments have set up financial intelligence units (FIUs) within their borders for the purpose of tracking down terrorists’ funds. By investigating reported suspicious transactions, FIUs attempt to weed out financial criminals who use these illegal funds to finance terrorist activity. The prominent role played by FIUs means that their performance is always under the spotlight. By interviewing experts and conducting surveys of those associated with the fight against financial crime, this study investigated perceptions of FIU performance on a comparative basis between American and non-American FIUs. The target group of experts included financial institution personnel, civilian agents, law enforcement personnel, academicians, and consultants. Questions for the interview and surveys were based on the Kaplan and Norton’s Balanced Scorecard (BSC) methodology. One of the objectives of this study was to help determine the suitability of the BSC to this arena. While FIUs in this study have concentrated on performance by measuring outputs such as the number of suspicious transaction reports investigated, this study calls for a focus on outcomes involving all the parties responsible for financial criminal investigations. It is only through such an integrated approach that these various entities will be able to improve performance in solving financial crime. Experts in financial intelligence strongly believed that the quality and timeliness of intelligence was more important than keeping track of the number of suspicious transaction reports. Finally, this study concluded that the BSC could be appropriately applied to the arena of financial crime prevention even though the emphasis is markedly different from that in the private sector. While priority in the private sector is given to financial outcomes, in this arena employee growth and internal processes were perceived as most important in achieving a satisfactory outcome.

Group presence in virtual worlds: Supporting collaborative e-learning

Even though e-learning endeavors have significantly proliferated in recent years, current e-learning technologies provide poor support for group-oriented learning. The now popular virtual world's technologies offer a possible solution. Virtual worlds provide the users with a 3D - computer generated shared space in which they can meet and interact through their virtual representations. Virtual worlds are very successful in developing high levels of engagement, presence and group presence in the users. These elements are also desired in educational settings since they are expected to enhance performance. The goal of this research is to test the hypothesis that a virtual world learning environment provides better support for group-oriented collaborative e-learning than other learning environments, because it facilitates the emergence of group presence. To achieve this, a quasi-experimental study was conducted and data was gathered through the use of various survey instruments and a set of collaborative tasks assigned to the participants. Data was gathered on the dependent variables: Engagement, Group Presence, Individual Presence, Perceived Individual Presence, Perceived Group Presence and Performance. The data was analyzed using the statistical procedures of Factor Analysis, Path Analysis, Analysis of Variance (ANOVA) and Multivariate Analysis of Variance (MANOVA). The study provides support for the hypothesis. The results also show that virtual world learning environments are better than other learning environments in supporting the development of all the dependent variables. It also shows that while only Individual Presence has a significant direct effect on Performance; it is highly correlated with both Engagement and Group Presence. This suggests that these are also important in regards to performance. Developers of e-learning endeavors and educators should incorporate virtual world technologies in their efforts in order to take advantage of the benefit they provide for e-learning group collaboration.