Iowa Adult Literacy Local Program Monitoring Guidelines Revised, July 2007

The purpose of this document is to provide guidelines for the annual monitoring and evaluation of Iowa’s adult literacy funded local programs. Section 224(b)(3) of the Adult Education and Family Literacy Act (AEFLA) states that the State Education Agency (SEA) will provide “a description of how the eligible agency [Iowa Department of Education] will evaluate annually the effectiveness of the adult education and literacy activities based on the performance measures described in section 212.” In compliance with that mandate, the following describes the Iowa Department of Education’s procedures for local adult literacy program evaluation strategies.

A qualitative analysis of the congruency of Jungian psychological preferences identified by the Myers-Briggs Type Indicator (MBTI) and the human resource development role of instructor/facilitator

The purpose of this ethnographic study was to describe and explain the congruency of psychological preferences identified by the Myers-Briggs Type Indicator (MBTI) and the human resource development (HRD) role of instructor/facilitator. This investigation was conducted with 23 HRD professionals who worked in the Miami, Florida area as instructors/facilitators with adult learners in job-related contexts.^ The study was conducted using qualitative strategies of data collection and analysis. The research participants were selected through a purposive sampling strategy. Data collection strategies included: (a) administration and scoring of the MBTI, Form G, (b) open-ended and semi-structured interviews, (c) participant observations of the research subjects at their respective work sites and while conducting training sessions, (d) field notes, and (e) contact summary sheets to record field research encounters. Data analysis was conducted with the use of a computer program for qualitative analysis called FolioViews 3.1 for Windows. This included: (a) coding of transcribed interviews and field notes, (b) theme analysis, (c) memoing, and (d) cross-case analysis.^ The three major themes that emerged in relation to the congruency of psychological preferences and the role of instructor/facilitator were: (1) designing and preparing instruction/facilitation, (2) conducting training and managing group process, and (3) interpersonal relations and perspectives among instructors/facilitators.^ The first two themes were analyzed through the combination of the four Jungian personality functions. These combinations are: sensing-thinking (ST), sensing-feeling (SF), intuition-thinking (NT), and intuition-feeling (NF). The third theme was analyzed through the combination of the attitudes or energy focus and the judgment function. These combinations are: extraversion-thinking (ET), extraversion-feeling (EF), introversion-thinking (IT), and introversion-feeling (IF).^ A last area uncovered by this ethnographic study was the influence exerted by a training and development culture on the instructor/facilitator role. This professional culture is described and explained in terms of the shared values and expectations reported by the study respondents. ^

Mindmapping as an adult learning notetaking strategy to increase the encoding of information in a corporate training course

A study was conducted to investigate the effectiveness, as measured by performance on course posttests, of mindmapping versus traditional notetaking in a corporate training class. The purpose of this study was to increase knowledge concerning the effectiveness of mindmapping as an information encoding tool to enhance the effectiveness of learning. Corporations invest billions of dollars, annually, in training programs. Given this increased demand for effective and efficient workplace learning, continual reliance on traditional notetaking is questionable for the high-speed and continual learning required on workers.^ An experimental, posttest-only control group design was used to test the following hypotheses: (1) there is no significant difference in posttest scores on an achievement test, administered immediately after the course, between adult learners using mindmapping versus traditional notetaking methods in a training lecture, and (2) there is no significant difference in posttest scores on an achievement test, administered 30 days after the course, between adult learners using mindmapping versus traditional notetaking methods in a training lecture. After a 1.5 hour instruction on mindmapping, the treatment group used mindmapping throughout the course. The control group used traditional notetaking. T-tests were used to determine if there were significant differences between mean posttest scores between the two groups. In addition, an attitudinal survey, brain hemisphere dominance survey, course dynamics observations, and course evaluations were used to investigate preference for mindmapping, its perceived effect on test performance, and the effectiveness of mindmapping instruction.^ This study's principal finding was that although the mindmapping group did not perform significantly higher on posttests administered immediately and 30 days after the course, than the traditional notetaking group, the mindmapping group did score higher on both posttests and reported higher ratings of the course on every evaluation criteria. Lower educated, right brain dominant learners reported a significantly positive learning experience. These results suggest that mindmapping enhances and reinforces the preconditions of learning. Recommendations for future study are provided. ^

Effects of using manipulative materials to teach remedial algebra to community college students on achievement and attitudes towards mathematics

This dissertation derived hypotheses from the theories of Piaget, Bruner and Dienes regarding the effects of using Algebra Tiles and other manipulative materials to teach remedial algebra to community college students. The dependent variables measured were achievement and attitude towards mathematics. The Piagetian cognitive level of the students in the study was measured and used as a concomitant factor in the study.^ The population for the study was comprised of remedial algebra students at a large urban community college. The sample for the study consisted of 253 students enrolled in 10 sections of remedial algebra at three of the six campuses of the college. Pretests included administration of an achievement pre-measure, Aiken's Mathematics Attitude Inventory (MAI), and the Group Assessment of Logical Thinking (GALT). Posttest measures included a course final exam and a second administration of the MAI.^ The results of the GALT test revealed that 161 students (63.6%) were concrete operational, 65 (25.7%) were transitional, and 27 (10.7%) were formal operational. For the purpose of analyzing the data, the transitional and formal operational students were grouped together.^ Univariate factorial analyses of covariance ($\alpha$ =.05) were performed on the posttest of achievement (covariate = achievement pretest) and the MAI posttest (covariate = MAI pretest). The factors used in the analysis were method of teaching (manipulative vs. traditional) and cognitive level (concrete operational vs. transitional/formal operational).^ The analyses for achievement revealed a significant difference in favor of the manipulatives groups in the computations by campus. Significant differences were not noted in the analysis by individual instructors.^ The results for attitude towards mathematics showed a significant difference in favor of the manipulatives groups for the college-wide analysis and for one campus. The analysis by individual instructor was not significant. In addition, the college-wide analysis was significant in favor of the transitional/formal operational stage of cognitive development. However, support for this conclusion was not obtained in the analyses by campus or individual instructor. ^

Working adult students' perspectives on persisting in college

The purpose of this study was to describe and explain working adult undergraduate students' perspectives on persistence in college in order to address the applicability of retention theory to a specific group of college students. Retention of college students is a major concern in higher education where persistence rates have continued to decline for the last 16 years and changing student demographics have influenced enrollment patterns. ^ A qualitative research design was used. Data were collected through in-depth semi-structured interviews with nine working adult undergraduate students. The participants were selected to include diversity in age, race/ethnicity, family roles, career/work levels, college majors, and educational histories. ^ Triangulation was performed on data from the interviews, participant data forms, and a research journal. Open and axial coding were used to generate emerging themes. Member checking was used to verify the interpretation of the participants' perspectives. A peer reviewer corroborated the data analysis. Three major themes emerged from the data which explained how the students stayed motivated, engaged in learning, and managed the institutional aspects of college. ^ Five conclusions were drawn from the findings of this study. First, working adult students described their core experience of college as both positive and negative, creating tensions and often conflicts that influenced their persistence. Second, persistence factors associated with working adult students included personal aspects, such as having clear career/life goals, self management skills, and supportive relationships; learning aspects, such as interactive teaching methods, connections to prior learning, and relevance to career/life goals; and institutional aspects, such as customer service orientation of staff, flexibility of policies and procedures, and convenient access to information. Third, current retention theory was applicable to working adult students. However, working adult students described their experience of academic and social integration differently from that of traditional college students found in the literature. Fourth, findings from this study supported the developmental components of the Adult Persistence in Learning model (MacKinnon-Slaney, 1994). Finally, the study findings indicated a clearly active role required of the institution in the persistence of working adult students by providing flexibility and accessibility in procedures and services. ^

Selected psychosocial and demographic factors affecting levels of pre-retirement planning

In September 2002, the State of Florida implemented a new retirement structure for those employed in the Florida Public School System. Teachers were given the option to maintain their existing defined benefit plan or choose the newly offered defined contribution plan. The variables that affect planning for retirement are innumerable. Identifying the most significant variables is essential to understanding how one plans for retirement. ^ This study examined the relationship between hypothesized psychosocial and demographic factors and an individual's level of pre-retirement planning. The criterion variable, the level of pre-retirement planning, comprised two concepts. First, the time spent thinking about retirement was determined by the score an individual received on a pre-retirement planning scale. This scale included the concepts of information gathering, goals, anticipated resources, and long-range planning. Second, implementation of retirement plan procedures was determined by the percentage an individual annually deferred to retirement. ^ The survey used for data collection contained 50 close-ended items. It was distributed to all full-time teachers in nine randomly selected elementary, middle, and senior high schools throughout Miami-Dade County Public Schools. Multiple regression and crosstabulation indicated that math anxiety, general risk, years of service, and total family income were significant predictors of the level of pre-retirement planning, as measured by the pre-retirement planning scale. In addition, the statistical analysis indicated that math anxiety, internal locus of control, years of service, and total family income were significant predictors of the level pre-retirement planning, as measured by the amount deferred to retirement. An individual's level of math anxiety and family income were the two factors that were the most significant predictors for both concepts on the level of pre-retirement planning. ^ Based on the findings of the study, recommendations focused on assessing an individual's level of math anxiety and educating teachers, particularly pre-service candidates, about the factors that affect pre-retirement planning. Further research should investigate the benefit of such educational programs. ^

Effects of cooperative and individual integrated learning system on attitudes and achievement in mathematics

This study compares the effects of cooperative delivery (CD) and individual delivery (ID) of integrated learning system (ILS) instruction in mathematics on achievement, attitudes and behaviors in adult (16-21 yrs.) high school students (grades 9-13). The study was conducted in an urban adult high school in Miami-Dade County Public Schools using a pre-test/post-test design. Achievement was measured using the Test of Adult Basic Education (TABE) by CTB MC-Graw-Hill and Compass Learning. An attitudinal survey measured attitudes towards mathematics, the computer-related lessons, and attitudes toward group activities. Behavior was assessed using computer lab observations. ^ Two-way analyses of variance (ANOVA) were conducted on achievement (TABE and Compass) by group and time (pre and post). A one-way ANOVA was conducted on the overall attitude by group on the five components (i.e., content mathematics, delivery/computers, cooperative, partners, and self efficacy) and a one-way ANOVA was conducted on the on-task behavior by group. ^ The results of the study revealed that CD and ID students working on mathematics activities delivered by the ILS performed similarly on achievement tests of the TABE. The CD-ILS students had significantly better overall mathematics attitudes than the ID-ILS students and the ID-ILS group was on-task significantly more than the CD-ILS group. This study concludes that regularity and period of time over which the ILS is used may prove to be important variables although there were insufficient data to fully investigate the impact of models of use. Additionally, a minimum amount of time-on-system is necessary before gains can become apparent in innumeracy and increasing exposure to the system may have beneficial effects on learning. ^

An analysis of student and instructor perceptions of students' writing skills at the university level

This study examined university students' writing skills as perceived by university students and their English instructors. The goal of the study was to provide English instructors with objective, quantified information about writing perceptions from both the students' and instructors' viewpoints. ^ A survey instrument was developed based on a survey instrument created by Newkirk, Cameron, and Selfe (1977) to identify instructors' perceived knowledge of student writing skills. The present study used a descriptive statistical design. It examined five writing skill areas: attitude, content, grammar and mechanics, literary considerations, and the writing process through a questionnaire completed by a convenience sample of summer and fall admitted freshmen who were enrolled in Essay Writing and Freshman Composition courses and English Department instructors at a large South Florida public university. ^ The study consisted of five phases. The first phase was modifying of the Newkirk, Cameron, and Selfe (1977) questionnaire. Two versions of the revised survey were developed - one for instructors and one for students. The second phase was pilot testing the questionnaire for evaluation of administration and scoring. The third phase was administering the questionnaire to 1,280 students and 48 instructors. The fourth phase was analyzing the data. The study found a significant difference in the perceptions of students and instructors in all areas of writing skills examined by the survey. Responses to 29 of 30 questions showed that students felt they had better attitudes toward writing and better writing skills than instructors thought. ^ The final phase was developing recommendations for practice. Based on findings and theory and empirical evidence drawn from the fields of adult education and composition research, learner-centered, self-directed curriculum guidelines are offered. ^ By objectively quantifying student and instructor perceptions of students' writing skills, this study contributes to a growing body of literature that: (a) encourages instructors to acknowledge the perception disparities between instructors and students; (b) gives instructors a better understanding of how to communicate with students; and (c) recommends the development of new curriculum, placement tests, and courses that meet the needs of students and enables English instructors to provide meaningful instruction. ^

Team Primacy Concept-based employee evaluation and job performance

This qualitative case study explored how employees learn from Team Primacy Concept (TPC)-based employee evaluation and how they apply the knowledge in their job performance. Kolb's experiential learning model (1974) served as a conceptual framework for the study to reveal the process of how employees learn from TPC evaluation, namely, how they experience, reflect, conceptualize and act on performance feedback. TPC based evaluation is a form of multirater evaluation that consists of three components: self-feedback, supervisor's feedback, and peer feedback. The distinctive characteristic of TPC based evaluation is the team evaluation component during which the employee's professional performance is discussed by one's peers in a face-to-face team setting, while other forms of multirater evaluation are usually conducted in a confidential and anonymous manner.^ Case study formed the methodological framework. The case was the Southeastern Virginia (SEVA) region of the Institute for Family Centered Services, and the participants were eight employees of the SEVA region. Findings showed that the evaluation process was anxiety producing for employees, especially the process of peer evaluation in a team setting. Preparation was found to be an important phase of TPC evaluation. Overall, the positive feedback delivered in a team setting made team members feel acknowledged. The study participants felt that honesty in providing feedback and openness to hearing challenges were significant prerequisites to the TPC evaluation process. Further, in the planning phase, employees strove to develop goals for themselves that were meaningful. Also, the catalyst for feedback implementation appeared to stem from one's accountability to self and to the client or community. Generally, the participants identified a number of performance improvement goals that they attained during their employment with IFCS, which were supported by their developmental plans.^ In conclusion, the study identified the process by which employees learned from TPC-based employee evaluation and the ways in which they used the knowledge to improve their job performance. Specifically, the study examined how participants felt and what they thought about TPC-based feedback, in what ways they reflected and made meaning of the feedback, and how they used the feedback to improve their job performance.^

Examining a proposed job retention model for adult workers with mental retardation in supported employment

This quantitative study investigated the predictive relationships and interaction between factors such as work-related social behaviors (WRSB), self-determination (SD), person-job congruency (PJC), job performance (JP), job satisfaction (JS), and job retention (JR). A convenience sample of 100 working adults with MR were selected from supported employment agencies. Data were collected using a survey test battery of standardized instruments. The hypotheses were analyzed using three multiple regression analyses to identify significant relationships. Beta weights and hierarchical regression analysis determined the percentage of the predictor variables contribution to the total variance of the criterion variables, JR, JP, and JS. ^ The findings highlight the importance of self-determination skills in predicting job retention, satisfaction, and performance for employees with MR. Consistent with the literature and hypothesized model, there was a predictive relationship between SD, JS and JR. Furthermore, SD and PJC were predictors of JP. SD and JR were predictors of JS. Interestingly, the results indicated no significant relationship between JR and JP, or between JP and JS, or between PJC and JS. This suggests that there is a limited fit between the hypothesized model and the study's findings. However, the theoretical contribution made by this study is that self-determination is a particularly relevant predictor of important work outcomes including JR, JP, and JS. This finding is consistent with Deci's (1992) Self-Determination Theory and Wehmeyer's (1996) argument that SD skills in individuals with disabilities have important consequences for the success in transitioning from school to adult and work life. This study provides job retention strategies that offer rehabilitation and HR professionals a useful structure for understanding and implementing job retention interventions for people with MR. ^ The study concluded that workers with mental retardation who had more self-determination skills were employed longer, more satisfied, and better performers on the job. Also, individuals whose jobs were matched to their interests and abilities (person-job congruency) were better at self-determination skills. ^

A comparative analysis of self-determined evaluations of work performance and support needs by adults with mental retardation in supported work and in sheltered workshop environments

The purpose of this study was to determine if there was a difference in the self-determined evaluations of work performance and support needs by adults with mental retardation in supported employment and in sheltered workshop environments. The instrument, Job Observation and Behavior Scale: Opportunity for Self-Determination (JOBS: OSD; Brady, Rosenberg, & Frain, 2006), was administered to 38 adults with mental retardation from sheltered workshops and 32 adults with mental retardation from supported employment environments. Cross-tabulations with Chi-square tests and independent samples t-tests were conducted to evaluate differences between the two groups, sheltered workshop and supported work. Two Multivariate Analyses of Variance (MANOVAs) were conducted to determine the effect of work environment on Quality of Performance (QP) and Types of Support (TS) test scores and their subscales. ^ This study found that there were significant differences between the groups on the QP Behavior and Job Duties subscales. The sheltered workshop group perceived themselves as performing significantly better on job duties than the supported work group. Conversely, the supported work group perceived themselves to have better behavior than the sheltered workshop group. However, there were no significant differences between groups in their perception of support needs for the three subscales. ^ The findings imply that work environment affects the self-determined evaluations of work performance by adults with mental retardation. Recommendations for further study include (a) detailing the characteristics of supported work and sheltered workshops that support and/or discourage self-determined behaviors, (b) exploring the behavior of adults with mental retardation in sheltered workshops and supported work environments, and (c) analysis of the support needs for and understanding of them by adults with mental retardation in sheltered workshops and in supported work environments. ^

An investigation of the effects of mothers' participation in adult literacy classes on interactive literacy activities (ILAs) at home

The National Center for Family Literacy (2003a) and the National Even Start Association (2005) have stated that the single most effective and influential factor in increasing student academic achievement is parental involvement. The purpose of this qualitative study was to determine how participation in adult literacy courses influences parent-child interaction in various educationally related activities known as Interactive Literacy Activities (ILAs). This study investigated ILAs from the mothers? perspective, and examines the changes that occur in parental involvement or ILAs when immigrant parents of a limited educational background participate in an adult education program. The principal method of data collection was key informant interviews (Gall, Borg, & Gall, 1996). Other methods of data collection included observations of parent-child interactions and field observations. Data analysis methods included Memo-ing (Miles & Huberman, 1994), within case analysis and cross-case analysis. ^ Findings demonstrate that changes occurred in the parent-child relationship when mothers of a limited educational background participated in an adult literacy course. When participating in ILAs or English literacy activities related to second language acquisition (including reading and speaking for comprehension and pronunciation), the children of these mothers took on the role of the adult. Participation in literacy activities was often initiated by the child and the children were frequently concerned with their mother's literacy acquisition. Mothers reported that their children were more confident, worked harder on school related activities and were more open to communication. ^ It can be concluded from this study that, in the case of these immigrant families, a mother's participation in adult literacy classes is influential in the relationship between mother and child. These children participated in ILAs for the benefit of their mothers and initiated literacy activities more frequently. The children responded better to their parents during literacy activities because there was a positive change in the relationship between mother and child. The relationship between mother and child appeared to be strengthened by greater trust, a sense of pride and more communication. ^

An investigation of the strategies used by organizations participating in the welfare-to-work network program and correlation of the strategies with the retention data to determine best practices for job retention among former welfare recipients

This ex post facto study (N = 209) examined the relationships between employer job strategies and job retention among organizations participating in Florida welfare-to-work network programs and associated the strategies with job retention data to determine best practices. ^ An internet-based self-report survey battery was administered to a heterogeneous sampling of organizations participating in the Florida welfare-to-work network program. Hypotheses were tested through correlational and hierarchical regression analytic procedures. The partial correlation results linked each of the job retention strategies to job retention. Wages, benefits, training and supervision, communication, job growth, work/life balance, fairness and respect were all significantly related to job retention. Hierarchical regression results indicated that the training and supervision variable was the best predictor of job retention in the regression equation. ^ The size of the organization was also a significant predictor of job retention. Large organizations reported higher job retention rates than small organizations. There was no statistical difference between the types of organizations (profit-making and non-profit) and job retention. The standardized betas ranged from to .26 to .41 in the regression equation. Twenty percent of the variance in job retention was explained by the combination of demographic and job retention strategy predictors, supporting the theoretical, empirical, and practical relevance of understanding the association between employer job strategies and job retention outcomes. Implications for adult education and human resource development theory, research, and practice are highlighted as possible strategic leverage points for creating conditions that facilitate the development of job strategies as a means for improving former welfare workers’ job retention.^

A determination of the effects of a ropes course on the self -esteem of undergraduate and graduate students

The purpose of this study was to evaluate the impact of the ropes course on the self-esteem of undergraduate and graduate students. The ropes course provides challenging experiential activities that facilitate personal confidence and group teamwork. The study relates to adult education, experiential education, and program evaluation within the context of hospitality and tourism management education. Quantitative data were based on the assessment of self-esteem through the completion of the Coopersmith Self-Esteem Inventory (SEI-C) modified for this study. Qualitative data were based on assessment of participants' reflective papers stating their perceptions of the ropes course. ^ The study compared a treatment group (31 undergraduate and 25 graduate students) which participated in the ropes course, and a control group (31 undergraduate and 25 graduate students) which did not participate. Both groups completed the pre- and post-treatment SEI-C at the same time intervals. The quantitative data were analyzed using a two-way repeated-measures analysis of variance (ANOVA). The qualitative data, comprised of reflective papers voluntarily written by 44 (79%) of the treatment group, were coded using four major themes reflecting the students' perceptions about the ropes course. ^ Scores on the pretest and posttest of the SEI-C were not significantly different for the two groups. The qualitative data showed a favorable impact of the ropes course. The discrepancy in the outcomes based on these two measures suggests that the SEI-C self-report paper-and-pencil instrument may not be sufficiently refined to evaluate the complex issue of self-esteem. The SEI-C, if used, should be supplemented by other evaluation measures, since the two measures may be evaluating different components of self-esteem. They may be also differentially affected by bias in scoring, or by statistical characteristics of reliability and validity. ^

School Leader Update, January 1, 2005

Monthly newsletter produced by Iowa Department of Education