A critical evaluation and comparison of two formative measures of system quality using criterion variables

Evaluating the validity of formative variables has presented ongoing challenges for researchers. In this paper we use global criterion measures to compare and critically evaluate two alternative formative measures of System Quality. One model is based on the ISO-9126 software quality standard, and the other is based on a leading information systems research model. We find that despite both models having a strong provenance, many of the items appear to be non-significant in our study. We examine the implications of this by evaluating the quality of the criterion variables we used, and the performance of PLS when evaluating formative models with a large number of items. We find that our respondents had difficulty distinguishing between global criterion variables measuring different aspects of overall System Quality. Also, because formative indicators “compete with one another” in PLS, it may be difficult to develop a set of measures which are all significant for a complex formative construct with a broad scope and a large number of items. Overall, we suggest that there is cautious evidence that both sets of measures are valid and largely equivalent, although questions still remain about the measures, the use of criterion variables, and the use of PLS for this type of model evaluation.

A critical evaluation and comparison of two formative measures of system quality using criterion variables

Evaluating the validity of formative variables has presented ongoing challenges for researchers. In this paper we use global criterion measures to compare and critically evaluate two alternative formative measures of System Quality. One model is based on the ISO-9126 software quality standard, and the other is based on a leading information systems research model. We find that despite both models having a strong provenance, many of the items appear to be non-significant in our study. We examine the implications of this by evaluating the quality of the criterion variables we used, and the performance of PLS when evaluating formative models with a large number of items. We find that our respondents had difficulty distinguishing between global criterion variables measuring different aspects of overall System Quality. Also, because formative indicators “compete with one another” in PLS, it may be difficult to develop a set of measures which are all significant for a complex formative construct with a broad scope and a large number of items. Overall, we suggest that there is cautious evidence that both sets of measures are valid and largely equivalent, although questions still remain about the measures, the use of criterion variables, and the use of PLS for this type of model evaluation.

Differential predictability of four dimensions of affect intensity.

Individual differences in affect intensity are typically assessed with the Affect Intensity Measure (AIM). Previous factor analyses suggest that the AIM is comprised of four weakly correlated factors: Positive Affectivity, Negative Reactivity, Negative Intensity and Positive Intensity or Serenity. However, little data exist to show whether its four factors relate to other measures differently enough to preclude use of the total scale score. The present study replicated the four-factor solution and found that subscales derived from the four factors correlated differently with criterion variables that assess personality domains, affective dispositions, and cognitive patterns that are associated with emotional reactions. The results show that use of the total AIM score can obscure relationships between specific features of affect intensity and other variables and suggest that researchers should examine the individual AIM subscales.

The effect of statistics anxiety on students’ predicted and actual test scores

This study investigated the effect of statistics anxiety and attitudes on first year psychology students’ predicted and actual statistics class test scores. A total of 52 students completed the Statistics Anxiety Rating Scale and estimated their class test scores one week before their test at the end of first year. Regression models were conducted with the six attitude and anxiety subscales as predictors and the predicted and actual test scores as criterion variables. The results showed that computation self concept and fear of asking for help accounted for 37% of the variance in predicted test scores. However, when actual test scores were analysed the significant predictors were worth of statistics and interpretation anxiety, which accounted for 20% of the variance. These results suggested that while statistics anxiety does influence students’ perceptions of their competence it appears to have less effect on their actual performance. Results also suggested that students were unaware of their own statistical competence. Remedial action is required to address the level of statistics anxiety experienced by first year undergraduate psychology students, as it appears to result in unrealistic assessments of their ability and has detrimental effects on their statistics self-efficacy.

Obsessive-compulsive symptoms and attentional bias: An eye-tracking methodology

Background and objectives: Cognitive models suggest that attentional biases are integral in the maintenance of obsessive-compulsive symptoms (OCS). Such biases have been established experimentally in anxiety disorders; however, the evidence is unclear in Obsessive Compulsive disorder (OCD). In the present study, an eye-tracking methodology was employed to explore attentional biases in relation to OCS.
Methods: A convenience sample of 85 community volunteers was assessed on OCS using the Yale-Brown Obsessive Compulsive Scale-self report. Participants completed an eye-tracking paradigm where they were exposed to OCD, Aversive and Neutral visual stimuli. Indices of attentional bias were derived from the eye-tracking data.
Results: Simple linear regressions were performed with OCS severity as the predictor and eye-tracking measures of the different attentional biases for each of the three stimuli types were the criterion variables. Findings revealed that OCS severity moderately predicted greater frequency and duration of fixations on OCD stimuli, which reflect the maintenance attentional bias. No significant results were found in support of other biases.
Limitations: Interpretations based on a non-clinical sample limit the generalisability of the conclusions, although use of such samples in OCD research has been found to be comparable to clinical populations. Future research would include both clinical and sub-clinical participants.
Conclusions: Results provide some support for the theory of maintained attention in OCD attentional biases, as opposed to vigilance theory. Individuals with greater OCS do not orient to OCD stimuli any faster than individuals with lower OCS, but once a threat is identified, these individuals allocate more attention to OCS-relevant stimuli.

Vulnerability to adverse consequences of drinking and problem drinker status as predicted by risky drinking behaviours, drug use, sex differences and affect : a test of multiple models /

Although alcohol problems and alcohol consumption are related, consumption does not fully account for differences in vulnerability to alcohol problems. Therefore, other factors should account for these differences. Based on previous research, it was hypothesized that risky drinking behaviours, illicit and prescription drug use, affect and sex differences would account for differences in vulnerability to alcohol problems while statistically controlling for overall alcohol consumption. Four models were developed that were intended to test the predictive ability of these factors, three of which tested the predictor sets separately and a fourth which tested them in a combined model. In addition, two distinct criterion variables were regressed on the predictors. One was a measure of the frequency that participants experienced negative consequences that they attributed to their drinking and the other was a measure of the extent to which participants perceived themselves to be problem drinkers. Each of the models was tested on four samples from different populations, including fIrst year university students, university students in their graduating year, a clinical sample of people in treatment for addiction, and a community sample of young adults randomly selected from the general population. Overall, support was found for each of the models and each of the predictors in accounting for differences in vulnerability to alcohol problems. In particular, the frequency with which people become intoxicated, frequency of illicit drug use and high levels of negative affect were strong and consistent predictors of vulnerability to alcohol problems across samples and criterion variables. With the exception of the clinical sample, the combined models predicted vulnerability to negative consequences better than vulnerability to problem drinker status. Among the clinical and community samples the combined model predicted problem drinker status better than in the student samples.

Prospecção e formação no domínio das competências e habilidades em tecnologia da informação: o caso do projeto metrópole digital em Natal/RN

This study deals with cognitive competences and abilities that are relevant to selection and education regarding Information Technology (IT). These competences relate to problem solving, decision making, and practical intelligence that regard scholar and extracurricular knowledge mobilization. The research aimed to contribute for the improvement of a selection instrument, consisting of five arrays of skills (dealing with objectives and prospection), as well as the development and comprehension of those skills that are involved in IT education. This is done by means of an analysis on the selection instrument used in the first selective process that occurred at Metropole Digital an Institute at the Federal University of Rio Grande do Norte in Brazil. This was evaluated aiming to acknowledge IT education (with basic training and emphasis on Web programming and electronics). The methodology used was of quantitative method involving performance scores relating education delivery. An Anova analysis of variance was done along with descriptive analysis involving socioeconomic data that was not observed in the meaningful relations between parental instruction and student performance in the graduate course. These analyses were able to point out the importance and need of the policies for vacancy reservation on behalf of public school students. A Spearman correlation analysis was done considering the instrument selection performance in the training course. The instrument is presented as a predictor that is significantly moderate and presents a good performance in the course as a whole. A Cluster and Regression analysis was also realized in the process. The first analysis allowed finding performance groups (Clusters) that ranged from medium and inferior. The regression analysis was able to point out association amongst criterion variables and the (average performance in basic and advanced modules) and explanatory (five matrixes). Regression analysis indicated that matrix 1 and matrix 3 were pointed out as being the strongest ones. In all the above analysis, the correlation between the instrument and the course was considered moderate. Thus this can be related in some of the aspects present in the course such as emphasis on evaluation itself as well as in technical contents and practical skills (educational ones) and competences and selection skills. It is known that the mediation of technological artifact in cultural context can foster the development of skills and abilities relevant to IT training. This study provides subsidies to reflect on the adoption of selection instrument and IT training in the Institute. Thus the research offers means to achieve a interdisciplinary discussion and enriching of areas such as Psychology and Information Technology; all of which regarding competencies and skills relevant in IT training

Psychometric properties of the Spanish version of the mindful attention awareness scale (MAAS) in patients with fibromyalgia

Background Mindful-based interventions improve functioning and quality of life in fibromyalgia (FM) patients. The aim of the study is to perform a psychometric analysis of the Spanish version of the Mindful Attention Awareness Scale (MAAS) in a sample of patients diagnosed with FM. Methods The following measures were administered to 251 Spanish patients with FM: the Spanish version of MAAS, the Chronic Pain Acceptance Questionnaire, the Pain Catastrophising Scale, the Injustice Experience Questionnaire, the Psychological Inflexibility in Pain Scale, the Fibromyalgia Impact Questionnaire and the Euroqol. Factorial structure was analysed using Confirmatory Factor Analyses (CFA). Cronbach's α coefficient was calculated to examine internal consistency, and the intraclass correlation coefficient (ICC) was calculated to assess the test-retest reliability of the measures. Pearson’s correlation tests were run to evaluate univariate relationships between scores on the MAAS and criterion variables. Results The MAAS scores in our sample were low (M = 56.7; SD = 17.5). CFA confirmed a two-factor structure, with the following fit indices [sbX2 = 172.34 (p < 0.001), CFI = 0.95, GFI = 0.90, SRMR = 0.05, RMSEA = 0.06. MAAS was found to have high internal consistency (Cronbach’s α = 0.90) and adequate test-retest reliability at a 1–2 week interval (ICC = 0.90). It showed significant and expected correlations with the criterion measures with the exception of the Euroqol (Pearson = 0.15). Conclusion Psychometric properties of the Spanish version of the MAAS in patients with FM are adequate. The dimensionality of the MAAS found in this sample and directions for future research are discussed.

Performance of an abbreviated version of the Lubben Social Network Scale among three European community-dwelling older adult populations

PURPOSE: There is a need for valid and reliable short scales that can be used to assess social networks and social supports and to screen for social isolation in older persons. DESIGN AND METHODS: The present study is a cross-national and cross-cultural evaluation of the performance of an abbreviated version of the Lubben Social Network Scale (LSNS-6), which was used to screen for social isolation among community-dwelling older adult populations in three European countries. Based on the concept of lack of redundancy of social ties we defined clinical cut-points of the LSNS-6 for identifying persons deemed at risk for social isolation. RESULTS: Among all three samples, the LSNS-6 and two subscales (Family and Friends) demonstrated high levels of internal consistency, stable factor structures, and high correlations with criterion variables. The proposed clinical cut-points showed good convergent validity, and classified 20% of the respondents in Hamburg, 11% of those in Solothurn (Switzerland), and 15% of those in London as at risk for social isolation. IMPLICATIONS: We conclude that abbreviated scales such as the LSNS-6 should be considered for inclusion in practice protocols of gerontological practitioners. Screening older persons based on the LSNS-6 provides quantitative information on their family and friendship ties, and identifies persons at increased risk for social isolation who might benefit from in-depth assessment and targeted interventions.

Psychoendocrine validation of a short measure for assessment of perceived stress management skills in different non-clinical populations

BACKGROUND: We investigated the psychometric properties of a short questionnaire for combined assessment of different perceived stress management skills in the general population and tested whether scores relate to physiological stress reactivity. METHODS: For psychometric evaluation, we determined the factor structure of the questionnaire and investigated its measurement invariance in the participant groups and over time in three different independent samples representing the general population (total N=332). Reliability was tested by estimating test-retest reliability, internal consistency, and item reliabilities. We examined convergent and criterion validity using selected criterion variables. For endocrine validation, 35 healthy non-smoking and medication-free men in a laboratory study and 35 male and female employees in a workplace study underwent an acute standardized psychosocial stress task. We assessed stress management skills and measured salivary cortisol before and several times up to 60 min (workplace study) and 120 min (laboratory study) after stress. Potential confounders were controlled. RESULTS: The factor structure of the questionnaire consists of five scales reflecting acceptably distinct stress management skills such as cognitive strategies, use of social support, relaxation strategies, anger regulation, and perception of bodily tension. This factor structure was stable across participant groups and over time. Internal consistencies, item reliabilities, and test-retest reliabilities met established statistical requirements. Convergent and criterion validity were also established. In both endocrine validation studies, higher stress management skills were independently associated with lower cortisol stress reactivity (p's<.029). CONCLUSIONS: Our findings suggest that the questionnaire has good psychometric properties and that it relates to subjective psychological and objective physiological stress indicators. Therefore, the instrument seems a suitable measure for differential assessment of stress management skills in the general population.

Antecedents and consequences of new product development and international new product rollout timeliness:an examination of mediating and moderating influences

The study examined the relationships between antecedents, timeliness in NPD and INPR, and consequences. A conceptual framework was tested using 232 new products from South Korean firms. The hypothesized relationships among the constructs in the model were evaluated by multiple regression and hierarchal regression analyses using SPSS 12 as well as by structural equation modelling (SEM) using SIMPLIS LISREL. In addition, confirmatory factor analysis (CFA) was carried out using SIMPLIS LISREL. In the direct relationships, cross-functional linkages and marketing synergy exhibited a statistically significant effect on NPD timeliness. The results also supported the influences of the HQ-subsidiary/agent relationship and NPD timeliness on INPR timeliness as well as INPR timeliness on performance. In the mediating effect tests, marketing proficiency significantly accounts for the relationships between cross-functional linkages and NPD timeliness, between marketing synergy and NPD timeliness, and between the HQ-subsidiary/agent relationship and INPR timeliness. Technical proficiency also mediates the effect of the HQ-subsidiary/agent relationship on INPR timeliness. The influence of NPD timeliness on new product performance in target markets is attributed to INPR timeliness. As for the results of the external environmentals and standardization influences, competitive intensity moderates the relationship between NPD timeliness and new product performance. Technology change also moderates the relationship between cross-functional linkages and NPD timeliness and between timeliness in NPD and INPR and performance. Standardization has a moderating role on the relationship between NPD timeliness and INPR timeliness. This study presents the answers to research questions which concern what factors are predictors of criterion variables, how antecedents influence timeliness in NPD and INPR and when the direct relationships in the INPR process are strengthened.

The predictive power of homework assignments on student achievement in grade three

Homework has been a controversial issue in education for the past century. Research has been scarce and has yielded results at both ends of the spectrum. This study examined the relationship between homework performance (percent of homework completed and percent of homework correct), student characteristics (SAT-9 score, gender, ethnicity, and socio-economic status), perceptions, and challenges and academic achievement determined by the students' average score on weekly tests and their score on the FCAT NRT mathematics assessment. ^ The subjects for this study consisted of 143 students enrolled in Grade 3 at a suburban elementary school in Miami, Florida. Pearson's correlations were used to examine the associations of the predictor variables with average test scores and FCAT NRT scores. Additionally, simultaneous regression analyses were carried out to examine the influence of the predictor variables on each of the criterion variables. Hierarchical regression analyses were performed on the criterion variables from the predictor variables. ^ Homework performance was significantly correlated with average test score. Controlling for the other variables homework performance was highly related to average test score and FCAT NRT score. ^ This study lends support to the view that homework completion is highly related to student academic achievement at the lower elementary level. It is suggested that at the elementary level more consideration be given to the amount of homework completed by students and to utilize the information in formulating intervention strategies for student who may not be achieving at the appropriate levels. ^

Examining a proposed job retention model for adult workers with mental retardation in supported employment

This quantitative study investigated the predictive relationships and interaction between factors such as work-related social behaviors (WRSB), self-determination (SD), person-job congruency (PJC), job performance (JP), job satisfaction (JS), and job retention (JR). A convenience sample of 100 working adults with MR were selected from supported employment agencies. Data were collected using a survey test battery of standardized instruments. The hypotheses were analyzed using three multiple regression analyses to identify significant relationships. Beta weights and hierarchical regression analysis determined the percentage of the predictor variables contribution to the total variance of the criterion variables, JR, JP, and JS. ^ The findings highlight the importance of self-determination skills in predicting job retention, satisfaction, and performance for employees with MR. Consistent with the literature and hypothesized model, there was a predictive relationship between SD, JS and JR. Furthermore, SD and PJC were predictors of JP. SD and JR were predictors of JS. Interestingly, the results indicated no significant relationship between JR and JP, or between JP and JS, or between PJC and JS. This suggests that there is a limited fit between the hypothesized model and the study's findings. However, the theoretical contribution made by this study is that self-determination is a particularly relevant predictor of important work outcomes including JR, JP, and JS. This finding is consistent with Deci's (1992) Self-Determination Theory and Wehmeyer's (1996) argument that SD skills in individuals with disabilities have important consequences for the success in transitioning from school to adult and work life. This study provides job retention strategies that offer rehabilitation and HR professionals a useful structure for understanding and implementing job retention interventions for people with MR. ^ The study concluded that workers with mental retardation who had more self-determination skills were employed longer, more satisfied, and better performers on the job. Also, individuals whose jobs were matched to their interests and abilities (person-job congruency) were better at self-determination skills. ^

The relationship between prekindergarten social and emotional development and academic success among Hispanic children from low-income families

Social and emotional development has been considered an important factor in child development which has been placed at the end of the learning spectrum due to high stakes testing. Social and emotional development consists of the relationships an individual has with others, the level of self-control, and the motivation and perseverance a person has during an activity (Bandura, 1989). This study examined the relationship between Hispanic children’s prekindergarten social and emotional development and their academic success. Hispanic children from a large southeastern city whose parents were receiving subsidized child-care were followed from their prekindergarten year through third grade (N=1,978). Several hierarchical regressions were run to determine the relationship between children’s social and emotional development, during their prekindergarten year using the DECA (Devereaux Early Childhood Assessment), and the their academic success, as measured by kindergarten through third grade end of the year reading and mathematics academic grades, second grade SAT (Stanford Achievement Test) scores, and third grade FCAT (Florida Comprehensive Assessment Test) and NRT (Norm Referenced Test) scores. Hierarchical regressions were conducted for each grade and subject in order to control for demographics and prior achievement. The results of this study revealed that for Hispanic children from low-income families, the best predictor for academic success was the children’s prior academic achievement. Social and emotional development showed no significant predictive value for the third grade criterion variables as well as end of the year academic grades in second grade and kindergarten reading. Evidence did suggest that for first grade end of the year academic grades and kindergarten math, social and emotional development had a small predictive value. Further research must be conducted as to why social and emotional development, after controlling for demographics and previous academic achievement, bears such a small predictive value when it is clear that many professionals feel it is the most important factor for school readiness.

Moderating effects of gender in the relationships between daily stress, coping styles and hopelessness depression in adolescents

The hopelessness depression (HD) theory assumes a number of contributing factors to the development of hopelessness expectations and HD symptoms. Studies carried out to test HD theory have generally supported the prediction that a negative attributional style contributes to the development of hopelessness expectations and HD symptoms, although the evidence is less consistent for adolescents. Due to these inconsistent results, as well as the assumption advanced by HD theory that other factors aside from attributional style may contribute to the development of HD, in this study we examined the potential role of adolescents’ daily stress and coping styles as contributing factors to HD at these ages, and the effects of gender on these relationships. Seiffge-Krenke (1995) showed that stress in daily life plays a particularly relevant role during adolescence and described three coping styles used by adolescents to face daily stress: active and internal approach-oriented styles, which are considered functional and complementary, and avoidant style, considered dysfunctional. In this study, secondary students (N = 480; aged 13–17) completed the Hopelessness Scale (Beck, Weissman, Lester, & Trexler, 1974), the Hopelessness Depression Symptoms Questionnaire (Metalsky & Joiner, 1997), the Problem Questionnaire ((Seiffge-Krenke, 1995) and the Coping Across Situations Questionnaire (Seiffge-Krenke, 1995). To test the role of daily stress and coping styles in the prediction of hopelessness expectations and HD symptoms, two four-step hierarchical multiple regression analyses were conducted. In these analyses, gender was introduced first, daily stress was introduced second, the three coping styles were entered in a third step, and the moderating effects of gender on the associations of the predictor variables (daily stress and each coping style) with the criterion variables (hopelessness expectations or HD symptoms) were introduced in a fourth step. Results showed a moderating effect of gender on the relationship between daily stress and hopelessness expectations, which revealed a significant effect for boys despite the fact that girls experienced more daily stress than boys, thus suggesting an inoculation effect in girls. It was also found a gender-dependent role of coping styles in the prediction of HD symptoms, revealing a protective effect for the active style in girls and for the internal style in boys. This suggests that girls would benefit from being more action-prone and boys more reflection-prone in order to prevent HD. These findings indicate that programmes aimed to promote coping skills in adolescents would benefit from being gender-adapted.