The impact of pre -training interventions on cognitive, skill, and affective learning outcomes: A meta -analytic examination of four decades of research

Technological advancements and the ever-evolving demands of a global marketplace may have changed the way in which training is designed, implemented, and even managed, but the ultimate goal of organizational training programs remains the same: to facilitate learning of a knowledge, skill, or other outcome that will yield improvement in employee performance on the job and within the organization (Colquitt, LePine, & Noe, 2000; Tannenbaum & Yukl, 1992). Studies of organizational training have suggested medium to large effect sizes for the impact of training on employee learning (e.g., Arthur, Bennett, Edens, & Bell, 2003; Burke & Day, 1986). However, learning may be differentially affected by such factors as the (1) level and type of preparation provided prior to training, (2) targeted learning outcome, (3) training methods employed, and (4) content and goals of training (e.g., Baldwin & Ford, 1988). A variety of pre-training interventions have been identified as having the potential to enhance learning from training and practice (Cannon-Bowers, Rhodenizer, Salas, & Bowers, 1998). Numerous individual studies have been conducted examining the impact of one or more of these pre-training interventions on learning. ^ I conducted a meta-analytic examination of the effect of these pre-training interventions on cognitive, skill, and affective learning. Results compiled from 359 independent studies (total N = 37,038) reveal consistent positive effects for the role of pre-training interventions in enhancing learning. In most cases, the provision of a pre-training intervention explained approximately 5–10% of the variance in learning, and in some cases, explained up to 40–50% of variance in learning. Overall attentional advice and meta-cognitive strategies (as compared with advance organizers, goal orientation, and preparatory information) seem to result in the most consistent learning gains. Discussion focuses on the most beneficial match between an intervention and the learning outcome of interest, the most effective format of these interventions, and the most appropriate circumstances under which these interventions should be utilized. Also highlighted are the implications of these results for practice, as well as propositions for important avenues for future research. ^

Vocabulary learning through use of the picture-word inductive model for young English learners in China: A mixed methods examination using Cognitive Load Theory

English has been taught as a core and compulsory subject in China for decades. Recently, the demand for English in China has increased dramatically. China now has the world's largest English-learning population. The traditional English-teaching method cannot continue to be the only approach because it merely focuses on reading, grammar and translation, which cannot meet English learners and users' needs (i.e., communicative competence and skills in speaking and writing). ^ This study was conducted to investigate if the Picture-Word Inductive Model (PWIM), a new pedagogical method using pictures and inductive thinking, would benefit English learners in China in terms of potential higher output in speaking and writing. With the gauge of Cognitive Load Theory (CLT), specifically, its redundancy effect, I investigated whether processing words and a picture concurrently would present a cognitive overload for English learners in China. ^ I conducted a mixed methods research study. A quasi-experiment (pretest, intervention for seven weeks, and posttest) was conducted using 234 students in four groups in Lianyungang, China (58 fourth graders and 57 seventh graders as an experimental group with PWIM and 59 fourth graders and 60 seventh graders as a control group with the traditional method). No significant difference in the effects of PWIM was found on vocabulary acquisition based on grade levels. Observations, questionnaires with open-ended questions, and interviews were deployed to answer the three remaining research questions. A few students felt cognitively overloaded when they encountered too many writing samples, too many new words at one time, repeated words, mismatches between words and pictures, and so on. Many students listed and exemplified numerous strengths of PWIM, but a few mentioned weaknesses of PWIM. The students expressed the idea that PWIM had a positive effect on their English teaching. ^ As integrated inferences, qualitative findings were used to explain the quantitative results that there were no significant differences of the effects of the PWIM between the experimental and control groups in both grade levels, from four contextual aspects: time constraints on PWIM implementation, teachers' resistance, how to use PWIM and PWIM implemented in a classroom over 55 students.^

Vocabulary Learning through Use of the Picture-Word Inductive Model for Young English Learners in China: A Mixed Methods Examination Using Cognitive Load Theory

English has been taught as a core and compulsory subject in China for decades. Recently, the demand for English in China has increased dramatically. China now has the world’s largest English-learning population. The traditional English-teaching method cannot continue to be the only approach because it merely focuses on reading, grammar and translation, which cannot meet English learners and users’ needs (i.e., communicative competence and skills in speaking and writing). This study was conducted to investigate if the Picture-Word Inductive Model (PWIM), a new pedagogical method using pictures and inductive thinking, would benefit English learners in China in terms of potential higher output in speaking and writing. With the gauge of Cognitive Load Theory (CLT), specifically, its redundancy effect, I investigated whether processing words and a picture concurrently would present a cognitive overload for English learners in China. I conducted a mixed methods research study. A quasi-experiment (pretest, intervention for seven weeks, and posttest) was conducted using 234 students in four groups in Lianyungang, China (58 fourth graders and 57 seventh graders as an experimental group with PWIM and 59 fourth graders and 60 seventh graders as a control group with the traditional method). No significant difference in the effects of PWIM was found on vocabulary acquisition based on grade levels. Observations, questionnaires with open-ended questions, and interviews were deployed to answer the three remaining research questions. A few students felt cognitively overloaded when they encountered too many writing samples, too many new words at one time, repeated words, mismatches between words and pictures, and so on. Many students listed and exemplified numerous strengths of PWIM, but a few mentioned weaknesses of PWIM. The students expressed the idea that PWIM had a positive effect on their English teaching. As integrated inferences, qualitative findings were used to explain the quantitative results that there were no significant differences of the effects of the PWIM between the experimental and control groups in both grade levels, from four contextual aspects: time constraints on PWIM implementation, teachers’ resistance, how to use PWIM and PWIM implemented in a classroom over 55 students.

The effect of cooperative learning on the attitudes toward science and the achievement of students in a non-science majors' general biology laboratory course at an urban community college

The purpose of this study was to evaluate the effect of cooperative learning strategies on students' attitudes toward science and achievement in BSC 1005L, a non-science majors' general biology laboratory course at an urban community college. Data were gathered on the participants' attitudes toward science and cognitive biology level pre and post treatment in BSC 1005L. Elements of the Learning Together model developed by Johnson and Johnson and the Student Team-Achievement Divisions model created by Slavin were incorporated into the experimental sections of BSC 1005L.^ Four sections of BSC 1005L participated in this study. Participants were enrolled in the 1998 spring (January) term. Students met weekly in a two hour laboratory session. The treatment was administered to the experimental group over a ten week period. A quasi-experimental pretest-posttest control group design was used. Students in the cooperative learning group (n$\sb1$ = 27) were administered the Test of Science-Related Attitudes (TOSRA) and the cognitive biology test at the same time as the control group (n$\sb2$ = 19) (at the beginning and end of the term).^ Statistical analyses confirmed that both groups were equivalent regarding ethnicity, gender, college grade point average and number of absences. Independent sample t-tests performed on pretest mean scores indicated no significant differences in the TOSRA scale two or biology knowledge between the cooperative learning group and the control group. The scores of TOSRA scales: one, three, four, five, six, and seven were significantly lower in the cooperative learning group. Independent sample t-tests of the mean score differences did not show any significant differences in posttest attitudes toward science or biology knowledge between the two groups. Paired t-tests did not indicate any significant differences on the TOSRA or biology knowledge within the cooperative learning group. Paired t-tests did show significant differences within the control group on TOSRA scale two and biology knowledge. ANCOVAs did not indicate any significant differences on the post mean scores of the TOSRA or biology knowledge adjusted by differences in the pretest mean scores. Analysis of the research data did not show any significant correlation between attitudes toward science and biology knowledge. ^

Assessing the construct validity of a measure of learning agility

This study examined the construct validity of the Choices questionnaire that purported to support the theory of Learning Agility. Specifically, Learning Agility attempts to predict an individual's potential performance in new tasks. The construct validity will be measured by examining the convergent/discriminant validity of the Choices Questionnaire against a cognitive ability measure and two personality measures. The Choices Questionnaire did tap a construct that is unique to the cognitive ability and the personality measures, thus suggesting that this measure may have considerable value in personnel selection. This study also examined the relationship of this pew measure to job performance and job promotability. Results of this study found that the Choices Questionnaire predicted job performance and job promotability above and beyond cognitive ability and personality. Data from 107 law enforcement officers, along with two of their co-workers and a supervisor resulted in a correlation of .08 between Learning Agility and cognitive ability. Learning Agility correlated .07 with Learning Goal Orientation and. 17 with Performance Goal Orientation. Correlations with the Big Five Personality factors ranged from −.06 to. 13 with Conscientiousness and Openness to Experience, respectively. Learning Agility correlated .40 with supervisory ratings of job promotability and correlated .3 7 with supervisory ratings of overall job performance. Hierarchical regression analysis found incremental validity for Learning Agility over cognitive ability and the Big Five factors of personality for supervisory ratings of both promotability and overall job performance. A literature review was completed to integrate the Learning Agility construct into a nomological net of personnel selection research. Additionally, practical applications and future research directions are discussed. ^

Improving novice analyst performance in modeling the sequence diagram in systems analysis: A cognitive complexity approach

The Unified Modeling Language (UML) has quickly become the industry standard for object-oriented software development. It is being widely used in organizations and institutions around the world. However, UML is often found to be too complex for novice systems analysts. Although prior research has identified difficulties novice analysts encounter in learning UML, no viable solution has been proposed to address these difficulties. Sequence-diagram modeling, in particular, has largely been overlooked. The sequence diagram models the behavioral aspects of an object-oriented software system in terms of interactions among its building blocks, i.e. objects and classes. It is one of the most commonly-used UML diagrams in practice. However, there has been little research on sequence-diagram modeling. The current literature scarcely provides effective guidelines for developing a sequence diagram. Such guidelines will be greatly beneficial to novice analysts who, unlike experienced systems analysts, do not possess relevant prior experience to easily learn how to develop a sequence diagram. There is the need for an effective sequence-diagram modeling technique for novices. This dissertation reports a research study that identified novice difficulties in modeling a sequence diagram and proposed a technique called CHOP (CHunking, Ordering, Patterning), which was designed to reduce the cognitive load by addressing the cognitive complexity of sequence-diagram modeling. The CHOP technique was evaluated in a controlled experiment against a technique recommended in a well-known textbook, which was found to be representative of approaches provided in many textbooks as well as practitioner literatures. The results indicated that novice analysts were able to perform better using the CHOP technique. This outcome seems have been enabled by pattern-based heuristics provided by the technique. Meanwhile, novice analysts rated the CHOP technique more useful although not significantly easier to use than the control technique. The study established that the CHOP technique is an effective sequence-diagram modeling technique for novice analysts.

Contingency, contiguity, and development: The ontogeny of contingency learning in northern bobwhite (Colinus virginianus) chicks

The purpose of this study was to investigate the ontogeny of auditory learning via operant contingency in Northern bobwhite (Colinus virginianus ) hatchlings and possible interaction between attention, orienting and learning during early development. Chicks received individual 5 min training sessions in which they received a playback of a bobwhite maternal call at a single delay following each vocalization they emitted. Playback was either from a single randomly chosen speaker or switched back and forth semi-randomly between two speakers during training. Chicks were tested 24 hrs later in a simultaneous choice test between the familiar and an unfamiliar maternal call. It was found that day-old chicks showed a significant time-specific decrement in auditory learning when trained with delays in the range of 470–910 ms between their vocalizations and call playback only when training involved two speakers. Two-day-old birds showed an even more sustained disruption of learning than day-old chicks, whereas three-day-old chicks showed a pattern of intermittent interference with their learning when trained at such delays. A similar but less severe decrement in auditory learning was found when chicks were provided with motor training in which playback was contingent upon chicks entering and exiting one of two colored squares placed on the floor of the arena. Chicks provided with playback of the call at randomly chosen delays each time they vocalized exhibited large fluctuations in their responsivity to the auditory stimulus as a function of delay—fluctuations which were correlated significantly with measures of chick learning, particularly at two-days-of-age. When playback was limited to a single location chicks no longer showed a time-specific disruption of their learning of the auditory stimulus. Sequential analyses revealed several patterns suggesting that an attentional process similar or analogous to attentional blink may have contributed both to the observed fluctuations in chick responsivity to the auditory stimulus as a function of delay and to the time-specific learning deficit shown by chicks provided with two-speaker training. The study highlights that learning can be substantially modulated by processes of orienting and attention and has a number of important implications for research within cognitive neuroscience, animal behavior and learning.

The effectiveness of an enhanced cognitive behavioral intervention in improving behavioral outcomes related to HIV prevention

This study analyzed outcomes of an enhanced cognitive-behavioral intervention with dually diagnosed severely mentally ill adults. It specifically addressed the improvement of attitudes, skills, self-efficacy to use condoms and the heightening of condom use. The data were analyzed via a randomized three-group repeated measures design composed of the experimental (E-CB), standard care (SC) comparison or a no-treatment control condition as the between-subjects variable and pre-post measure as the within-subjects variable. The E-CB focused on cooperative, application, hands-on, skill-building and role-playing activities for sexual assertiveness, negotiation in risk-taking and proper condom use. The SC comparison, was didactic in its approach and addressed risk-taking and proper condom use in one session, but did not involve application approaches to problem-solving risky situations or condom use. Multiple assessments were conducted at pre-, post- and six months post-intervention. ^ The analysis indicated that the E-CB intervention led to more favorable attitudes toward condoms and to improved and maintained skills regarding their use by participants six months after the intervention compared to the standard care and control groups. No significant improvements in self-efficacy were found. A repeated measures ANOVA conducted on the transformed values of percentage of vaginal condom use indicated no significant differences between the experimental and standard care conditions but both had a significantly higher mean percentage vaginal condom use than the control group, averaged across pre- and six-month post-intervention. No gender differences were seen in attitudes, skills or self-efficacy to use condoms. ^ This study shed light upon the effectiveness of the instructional approach for the enhancement of attitudes, skills and self-efficacy outcomes related to HIV prevention. For heightened effectiveness, future approaches must address multiple factors impacting learning in this population. ^

Cognitive performance and the thymus among HIV-infected subjects receiving HAART

Objective: To evaluate the impact of alcohol use, which is widespread in human immunodeficiency virus (HIV)+ individuals, on highly active antiretroviral therapy (HAART)-associated immune and cognitive improvements and the relationship between those two responses. Methods: In a case-control longitudinal study, thymic volume, cognition, and immune responses were evaluated at baseline and after 6 months therapy in HIV+ and HIV- controls. Cognitive performance was evaluated using the HIV Dementia Score (HDS) and the California Verbal Learning Test (CVLT). Results: Prior to HAART, thymic volume varied considerably from 2.7 to 29.3 cm3 (11 ± 7.2 cm3). Thymic volume at baseline showed a significantly inverse correlation with the patient’s number of years of drinking (r2 = 0.207; p < 0.01), as well as HDS and the CVLT scores in both HIV-infected (r2 = 0.37, p = 0.03) and noninfected (r2 = 0.8, p = 0.01). HIV-infected individuals with a small thymic volume scored in the demented range, as compared with those with a larger thymus (7 ± 2.7 vs. 12 ± 2.3, p = 0.005). After HAART, light/moderate drinkers exhibited thymus size twice that of heavy drinkers (14.8 ± 10.4 vs. 6.9 ± 3.3 cm3). Conclusions: HAART-associated increases of thymus volume appear to be negatively affected by alcohol consumption and significantly related to their cognitive status. This result could have important clinical implications.

Effects of worked examples and algebra problem -solving skill on error and cognitive load

This study determined the levels of algebra problem solving skill at which worked examples promoted learning of further problem solving skill and reduction of cognitive load in college developmental algebra students. Problem solving skill was objectively measured as error production; cognitive load was subjectively measured as perceived mental effort. ^ Sixty-three Ss were pretested, received homework of worked examples or mass problem solving, and posttested. Univarate ANCOVA (covariate = previous grade) were performed on the practice and posttest data. The factors used in the analysis were practice strategy (worked examples vs. mass problem solving) and algebra problem solving skill (low vs. moderate vs. high). Students in the practice phase who studied worked examples exhibited (a) fewer errors and reduced cognitive load, at moderate skill; (b) neither fewer errors nor reduced cognitive load, at low skill; and (c) only reduced cognitive load, at high skill. In the posttest, only cognitive load was reduced. ^ The results suggested that worked examples be emphasized for developmental students with moderate problem solving skill. Areas for further research were discussed. ^

Validation study of the Colorado Learning Attitudes about Science Survey at a Hispanic-serving institution

The Colorado Learning Attitudes about Science Survey (CLASS) has been widely acknowledged as a useful measure of student cognitive attitudes about science and learning. The initial University of Colorado validation study included only 20% non-Caucasian student populations. In this Brief Report we extend their validation to include a predominately under-represented minority population. We validated the CLASS instrument at Florida International University, a Hispanic-serving institution, by interviewing students in introductory physics classes using a semistructured protocol, examining students’ responses on the CLASS item statements, and comparing them to the items’ intended meaning. We find that in our predominately Hispanic population, 94% of the students’ interview responses indicate that the students interpret the CLASS items correctly, and thus the CLASS is a valid instrument. We also identify one potentially problematic item in the instrument which one third of the students interviewed consistently misinterpreted.

Undergraduate Students’ Perceptions of Study Abroad and Their Level of Achievement of Global Learning Outcomes

This study expanded on current research on study abroad and global learning, using the Global Perspective Inventory (GPI), and conducted at Florida International University (FIU) in Miami, FL. The GPI assesses the holistic development of a global perspective in higher education within three domains and their respective FIU-determined equivalents: cognitive (global awareness), intrapersonal (global perspective), and interpersonal (global engagement). The main purpose of this study was to assess FIU’s undergraduate students’ perceptions of study abroad on their level of achievement of global awareness, global perspective, and global engagement. The secondary purpose was to determine how the students described their study abroad experience and achievement of global learning. The research design for this study consisted of parallel mixed methods. The quantitative component was an ex post facto with hypothesis design, using a pretest/posttest nonequivalent group methodology. FIU undergraduates (N=147) who studied abroad for one semester or more completed the GPI pre- and post-tests. Descriptive statistics and paired t-tests were conducted to compare the means. The interviews included 10 students, and were analyzed through Structural coding, Saldaña’s In Vivo coding, and Value coding. Quantitative analyses indicated positive changes in the students’ global awareness and global perspective. These analyses also showed that the FIU students achieved higher post-test means on all the domains of the GPI compared to other studies. Qualitative analyses showed that the students’ experiences incorporated all three global learning outcomes, most notably global awareness and perspective.

Investigating the Effects of Cognitive Apprenticeship-Based Instructional Coaching on Science Teaching Efficacy Beliefs

The overall purpose of this collected papers dissertation was to examine the utility of a cognitive apprenticeship-based instructional coaching (CAIC) model for improving the science teaching efficacy beliefs (STEB) of preservice and inservice elementary teachers. Many of these teachers perceive science as a difficult subject and feel inadequately prepared to teach it. However, teacher efficacy beliefs have been noted as the strongest indicator of teacher quality, the variable most highly correlated with student achievement outcomes. The literature is scarce on strong, evidence-based theoretical models for improving STEB. This dissertation is comprised of two studies. STUDY #1 was a sequential explanatory mixed-methods study investigating the impact of a reformed CAIC elementary science methods course on the STEB of 26 preservice teachers. Data were collected using the Science Teaching Efficacy Belief Instrument (STEBI-B) and from six post-course interviews. A statistically significant increase in STEB was observed in the quantitative strand. The qualitative data suggested that the preservice teachers perceived all of the CAIC methods as influential, but the significance of each method depended on their unique needs and abilities. STUDY #2 was a participatory action research case study exploring the utility of a CAIC professional development program for improving the STEB of five Bahamian inservice teachers and their competency in implementing an inquiry-based curriculum. Data were collected from pre- and post-interviews and two focus group interviews. Overall, the inservice teachers perceived the intervention as highly effective. The scaffolding and coaching were the CAIC methods portrayed as most influential in developing their STEB, highlighting the importance of interpersonal relationship aspects in successful instructional coaching programs. The teachers also described the CAIC approach as integral in supporting their learning to implement the new inquiry-based curriculum. The overall findings hold important implications for science education reform, including its potential to influence how preservice teacher training and inservice teacher professional development in science are perceived and implemented. Additionally, given the noteworthy results obtained over the relatively short durations, CAIC interventions may also provide an effective means of achieving improvements in preservice and inservice teachers’ STEB more expeditiously than traditional approaches.

Improving Novice Analyst Performance in Modeling the Sequence Diagram in Systems Analysis: A Cognitive Complexity Approach

The Unified Modeling Language (UML) has quickly become the industry standard for object-oriented software development. It is being widely used in organizations and institutions around the world. However, UML is often found to be too complex for novice systems analysts. Although prior research has identified difficulties novice analysts encounter in learning UML, no viable solution has been proposed to address these difficulties. Sequence-diagram modeling, in particular, has largely been overlooked. The sequence diagram models the behavioral aspects of an object-oriented software system in terms of interactions among its building blocks, i.e. objects and classes. It is one of the most commonly-used UML diagrams in practice. However, there has been little research on sequence-diagram modeling. The current literature scarcely provides effective guidelines for developing a sequence diagram. Such guidelines will be greatly beneficial to novice analysts who, unlike experienced systems analysts, do not possess relevant prior experience to easily learn how to develop a sequence diagram. There is the need for an effective sequence-diagram modeling technique for novices. This dissertation reports a research study that identified novice difficulties in modeling a sequence diagram and proposed a technique called CHOP (CHunking, Ordering, Patterning), which was designed to reduce the cognitive load by addressing the cognitive complexity of sequence-diagram modeling. The CHOP technique was evaluated in a controlled experiment against a technique recommended in a well-known textbook, which was found to be representative of approaches provided in many textbooks as well as practitioner literatures. The results indicated that novice analysts were able to perform better using the CHOP technique. This outcome seems have been enabled by pattern-based heuristics provided by the technique. Meanwhile, novice analysts rated the CHOP technique more useful although not significantly easier to use than the control technique. The study established that the CHOP technique is an effective sequence-diagram modeling technique for novice analysts.

User Interface Design for Electronic Learning Software: Promoting Usability and Facilitating Learning for Children

Computing devices have become ubiquitous in our technologically-advanced world, serving as vehicles for software applications that provide users with a wide array of functions. Among these applications are electronic learning software, which are increasingly being used to educate and evaluate individuals ranging from grade school students to career professionals. This study will evaluate the design and implementation of user interfaces in these pieces of software. Specifically, it will explore how these interfaces can be developed to facilitate the use of electronic learning software by children. In order to do this, research will be performed in the area of human-computer interaction, focusing on cognitive psychology, user interface design, and software development. This information will be analyzed in order to design a user interface that provides an optimal user experience for children. This group will test said interface, as well as existing applications, in order to measure its usability. The objective of this study is to design a user interface that makes electronic learning software more usable for children, facilitating their learning process and increasing their academic performance. This study will be conducted by using the Adobe Creative Suite to design the user interface and an Integrated Development Environment to implement functionality. These are digital tools that are available on computing devices such as desktop computers, laptops, and smartphones, which will be used for the development of software. By using these tools, I hope to create a user interface for electronic learning software that promotes usability while maintaining functionality. This study will address the increasing complexity of computing software seen today – an issue that has risen due to the progressive implementation of new functionality. This issue is having a detrimental effect on the usability of electronic learning software, increasing the learning curve for targeted users such as children. As we make electronic learning software an integral part of educational programs in our schools, it is important to address this in order to guarantee them a successful learning experience.