Scoring Methods for Ordinal Multidimensional Forced-Choice Items

In most psychological tests and questionnaires, a test score is obtained by taking the sum of the item scores. In virtually all cases where the test or questionnaire contains multidimensional forced-choice items, this traditional scoring method is also applied. We argue that the summation of scores obtained with multidimensional forced-choice items produces uninterpretable test scores. Therefore, we propose three alternative scoring methods: a weak and a strict rank preserving scoring method, which both allow an ordinal interpretation of test scores; and a ratio preserving scoring method, which allows a proportional interpretation of test scores. Each proposed scoring method yields an index for each respondent indicating the degree to which the response pattern is inconsistent. Analysis of real data showed that with respect to rank preservation, the weak and strict rank preserving method resulted in lower inconsistency indices than the traditional scoring method; with respect to ratio preservation, the ratio preserving scoring method resulted in lower inconsistency indices than the traditional scoring method

Traditional scores versus IRT estimates on forced-choice tests based on a dominance model

Resumen tomado de la publicaci??n

Survival analysis statistics applied to threshold data obtained from the ascending forced-choice method of limits

Sensory thresholds are often collected through ascending forced-choice methods. Group thresholds are important for comparing stimuli or populations; yet, the method has two problems. An individual may correctly guess the correct answer at any concentration step and might detect correctly at low concentrations but become adapted or fatigued at higher concentrations. The survival analysis method deals with both issues. Individual sequences of incorrect and correct answers are adjusted, taking into account the group performance at each concentration. The technique reduces the chance probability where there are consecutive correct answers. Adjusted sequences are submitted to survival analysis to determine group thresholds. The technique was applied to an aroma threshold and a taste threshold study. It resulted in group thresholds similar to ASTM or logarithmic regression procedures. Significant differences in taste thresholds between younger and older adults were determined. The approach provides a more robust technique over previous estimation methods.

`Don`t call me sweetie!` patients differ from nurses in their perceptions of caring

Effective nursing care relies on congruent nurse-patient perception of needs. This study used Q methodology to compare nurses' and patients' perceptions of important nursing care behaviour. Q methodology applies statistical analysis to qualitative data through a technique of comparative rating using a forced choice format. The Care Q Sort, comprising fifty statements of nursing behaviour, was administered to nurses and patients from medical wards. Participants ranked the nursing behaviours from most to least important. Analysis was completed on 74 rankings. There was agreement for many behaviours but bimodal distributions for nurses' scores for some statements which may be attributable to different professional levels. An additional open comments section provided an experiential dimension to the research results. The findings will inform nursing practice and patient care planning.

Theory of mind and central coherence in adults with high-functioning autism or Asperger syndrome

The study investigated theory of mind and central coherence abilities in adults with high-functioning autism (HFA) or Asperger syndrome (AS) using naturalistic tasks. Twenty adults with HTA/AS correctly answered significantly fewer theory of mind questions than 20 controls on a forced-choice response task. On a narrative task, there were no differences in the proportion of mental state words between the two groups, although the participants with HFA/AS were less inclined to provide explanations for characters' mental states. No between-group differences existed on the central coherence questions of the forced-choice response task, and the participants with HTA/AS included an equivalent proportion of explanations for non-mental state phenomena in their narratives as did controls. These results support the theory of mind deficit account of autism spectrum disorders, and suggest that difficulties in mental state attribution cannot be exclusively attributed to weak central coherence.

Low fat loss response after medium-term supervised exercise in obese is associated with exercise-induced increase in food reward

Objective: To examine exercise-induced changes in the reward value of food during medium-term supervised exercise in obese individuals. ---------- Subjects/Methods: The study was a 12-week supervised exercise intervention prescribed to expend 500 kcal/day, 5 d/week. 34 sedentary obese males and females were identified as responders (R) or non-responders (NR) to the intervention according to changes in body composition relative to measured energy expended during exercise. Food reward (ratings of liking and wanting, and relative preference by forced choice pairs) for an array of food images was assessed before and after an acute exercise bout. ---------- Results. 20 responders and 14 non-responders were identified. R lost 5.2 kg±2.4 of total fat mass and NR lost 1.7 kg±1.4. After acute exercise, liking for all foods increased in NR compared to no change in R. Furthermore, NR showed an increase in wanting and relative preference for high-fat sweet foods. These differences were independent of 12-weeks regular exercise and weight loss. ---------- Conclusion. Individuals who showed an immediate post-exercise increase in liking and increased wanting and preference for high-fat sweet foods displayed a smaller reduction in fat mass with exercise. For some individuals, exercise increases the reward value of food and diminishes the impact of exercise on fat loss.

A survey to evaluate the implementation of a national clinical assessment form

Purpose: The Australian Universities Radiation Therapy Student Clinical Assessment Form (AURTSCAF) was designed to assess the clinical skills of radiation therapy (RT) students from the six universities that offer entry level RT programs. Given the AURTSCAF has now been in use for over two years, the Radiation Therapy Program Coordinators (RTPC) group initiated a post implementation evaluation survey. This formed the final phase of the AURTSCAF project and was funded by the Radiation Oncology Division of the Department of Health and Ageing. Methods: A cross-sectional designed survey using purposive sampling was distributed via email to all RT clinical sites. The survey asked questions about the requirements of a pass grade for students at different stages of their program, and the addition of a new category of assessment related to fitness to practise. Response types included both forced choice closed ended responses and open ended responses. There was also a section for open comments about the AURTSCAF. Results: There were 100 responses (55%) from clinicians who had utilised the assessment form over the previous 12 month period. Responses highlighted several positives with regard to the utility and implementation of the form. Comments regarding areas for improvement with the standardisation of the grading of students and consensus for the addition of a new domain in fitness for practise have informed the recommended changes proposed for 2012. Conclusion: This evaluation has provided a representative sample of the views of clinicians involved in assessing students on clinical placement. Recommendations include the addition of the sixth domain of assessment: Fitness for practise, the addition of descriptors and prompts for this domain in the user guide, the addition of a consensus statement about the use of the rating scale and dissemination of the proposed changes nationally.

Response Specificity to Advertisement Vocalization in the Chinese Alligator (Alligator sinensis)

Stringency in the identification of conspecific call properties is essential among sympatric species to ensure conspecific mating, as the risk of improper recognition and heterospecific mating is high. In this study we investigated the basic signal structure required for intraspecies communication in the Chinese alligator (Alligator sinensis), a species that has no relatives living in sympatry, by playback of signals modified in the temporal (truncating original bellows with first 1/4, 1/2, 3/4 or last 1/4, 1/2, 3/4 portion) or frequency domain (with low- or high-pass filters at frequencies 100, 250, 500 and 1000 Hz), or by reversal of natural bellows. The playback experiments revealed that relatively large modifications in bellow temporal or frequency structure failed to impair Chinese alligators' bellowing behavior; even reversed bellows effectively evoked a positive response. In general, the first half of the bellow in temporal domain and frequencies below 500 Hz were critical for behavioral induction, while the last half of the bellow in temporal domain and frequencies above 500 Hz failed to produce a single positive response, implying a potential functional signal redundancy. The observed high tolerance to bellow variations in Chinese alligators may be an evolutionary adaptation to (1) the acoustic constraints of propagation imposed by dense vegetative habitats; or (2) a lack of selection pressure due to the low risk of incorrect conspecific recognition and heterospecific mating.

More than just a problem with faces: Altered body perception in a group of congenital prosopagnosics

It has been estimated that one out of forty people in the general population suffer from congenital prosopagnosia (CP), a neurodevelopmental disorder characterized by difficulty identifying people by their faces. CP involves impairment in recognising faces, although the perception of non-face stimuli may also be impaired. Given that social interaction does not only depend on face processing, but also the processing of bodies, it is of theoretical importance to ascertain whether CP is also characterised by body perception impairments. Here, we tested eleven CPs and eleven matched control participants on the Body Identity Recognition Task (BIRT), a forced-choice match-to-sample task, using stimuli that require processing of body, not clothing, specific features. Results indicated that the group of CPs was as accurate as controls on the BIRT, which is in line with the lack of body perception complaints by CPs. However the CPs were slower than controls, and when accuracy and response times were combined into inverse efficiency scores (IES), the group of CPs were impaired, suggesting that the CPs could be using more effortful cognitive mechanisms to be as accurate as controls. In conclusion, our findings demonstrate CP may not generally be limited to face processing difficulties, but may also extend to body perception

Investigating Behaviour and Face Encoding in a Hypothetical Real-World Social Contract: Handwashing in Hazardous Health Settings

Investigations into the evolutionary origins of human cognition has shown that individuals’ memory for others is influenced by the latter’s behaviour in social contracts. Such research is primarily based on hypothetical or more abstract forms of social contracts, whereas an application of this knowledge to everyday health behaviours can be of great value. To address this, the current study investigated whether participants who were asked to imagine themselves in a hypothetical hazardous health scenario showed differential response sensitivity (d’) and latency (RT) to faces of hospital staff tagged with contrasting hand hygiene before touching patients: clean hands, dirty hands, or unknown hand-washing behaviour (control). The test used a two alternative forced-choice (2AFC: “old/new”) face recognition paradigm. The findings showed that d’ to dirty and clean hands was similar, but higher than for controls. Moreover, d’ was not affected by the occupation of hospital staff (nurses vs porters). The absence of memory gains towards clean or dirty hands points to the need for new strategies to remind patients to observe (and remember) the hand hygiene of others when exposed to hazardous health environments.

What children value : a scale to guide health promotion programs

Objective. Physical activity is important for the health of all human beings. Although it is important to develop good health promotion programs for children to increase participation in physical activity, to date there appear to be no programs based on what kids value beyond health and physical activity itself. This study proposed to create a scale with strong content and face validity that could uncover what any given population of children value in life regardless of their participation in physical activity and that experts feel could be related to physical activity. These findings will allow the development of targeted health promotion programs to increase children's participation in regular physical activity. Method In this study, a combination of qualitative and quantitative approaches was used. Data were gathered from seven experts in the field, sixty-seven children in grades three to five, five parents, and three teachers. From these data response groupings were created and sent to four experts to be given single word names. The resulting nine theme names were re-worked into "child-friendly" language. Four children were then asked to discuss theme names to see if they liked and understood them. The next step involved asking children and experts to rank order the nine themes, the children in general and the experts in terms of relevance to physical activity. From these results, possible versions of the scale were then created using the combined expert/children rankings. Each version was examined for content validity. Two versions of a scale resulted. These were sent to experts, parents, teachers and children in order to determine which one they liked better and to suggest any foreseeable problems. Once this information was collected, a beta (final prototype) version of the scale was created. Results. Nine common theme names were created from the response groupings. All four children agreed that they did understand and like each of the nine theme names. Experts and teachers agreed that full coverage of the content had been achieved. Children suggested a single wording change from "Being Accepted" to "Being Included". Five themes were selected for inclusion. The beta version of the scale included 12 forced choice statements, the first ten comparing all themes against one another followed by two anchor statements. Conclusion. At the outset it was recognized that it is essential to know what children think is important in their lives in order to serve as potential benefits in the development of effective physical activity promotion programs. This study developed a scale which could be used to determine what a population of children feel is important in order to focus health promotion programs for physical activity. The scale has strong face and content validity.

An exploratory descriptive study of factors influencing students to seek or not to seek personal counselling on a college of applied arts and technology campus located in Southern Ontario /

This descriptive-exploratory study examined factors which were perceived by students at a College of Applied Arts and Technology (CAAT) campus as influencing them in choosing to come or not to come for personal counselling and why they would or would not retum. A total of 250 students selected through a sample of convenience were surveyed. A questionnaire survey was conducted with quantitative data collected using a 4-point, forced-choice Likert scale and yes/no questions and qualitative data collected using open-ended questions and invited comments. The responses were analyzed using means and modes for the Likert responses and percentages for the yes/no and check-off questions. The narrative responses were subjected to content analysis to identify themes. The mean score findings on factors influencing students to come for personal counselling were at or close to the mid- point of 2.5. Personal distress was the only variable found to have a negative response, meaning students would not come to counselling if they were in personal distress. On factors that would keep them from choosing to come to counselling, students seemed to trust counsellors and feel accepted by them and rejected the notion that peer pressure or the first session being unhelpful would keep them away from counselling. The counsellor's relationship with the student is the major determinant for repeat sessions. When asked what factors would influence students to not retum for personal counselling, students rejected the variables of peer pressure, the extra time needed for counselling, and not getting what they wanted in a session, but, in one instance, indicated that variables regarding the counselling relationship would keep them from returning.

How self-determined choice facilitates performance: a key role of the ventromedial prefrontal cortex

Recent studies have documented that self-determined choice does indeed enhance performance. However, the precise neural mechanisms underlying this effect are not well understood. We examined the neural correlates of the facilitative effects of self-determined choice using functional magnetic resonance imaging (fMRI). Participants played a game-like task involving a stopwatch with either a stopwatch they selected (self-determined-choice condition) or one they were assigned without choice (forced-choice condition). Our results showed that self-determined choice enhanced performance on the stopwatch task, despite the fact that the choices were clearly irrelevant to task difficulty. Neuroimaging results showed that failure feedback, compared with success feedback, elicited a drop in the vmPFC activation in the forced-choice condition, but not in the self-determined-choice condition, indicating that negative reward value associated with the failure feedback vanished in the self-determined-choice condition. Moreover, the vmPFC resilience to failure in the self-determined-choice condition was significantly correlated with the increased performance. Striatal responses to failure and success feedback were not modulated by the choice condition, indicating the dissociation between the vmPFC and striatal activation pattern. These findings suggest that the vmPFC plays a unique and critical role in the facilitative effects of self-determined choice on performance.

Time to decide? Simplicity and congruity in comparative judgment

What is the relationship between magnitude judgments relying on directly available characteristics versus probabilistic cues? Question frame was manipulated in a comparative judgment task previously assumed to involve inference across a probabilistic mental model (e.g., “which city is largest” – the “larger” question – versus “which city is smallest” – the “smaller” question). Participants identified either the largest or smallest city (Experiments 1a, 2) or the richest or poorest person (Experiment 1b) in a three-alternative forced choice (3-AFC) task (Experiment 1) or 2-AFC task (Experiment 2). Response times revealed an interaction between question frame and the number of options recognized. When asked the smaller question, response times were shorter when none of the options were recognized. The opposite pattern was found when asked the larger question: response time was shorter when all options were recognized. These task-stimuli congruity results in judgment under uncertainty are consistent with, and predicted by, theories of magnitude comparison which make use of deductive inferences from declarative knowledge.

Students

The purpose of this paper was to investigate students' views on models and modelling in science as well as the role that models play in learning, using a theoretical framework of models in learning. Students' views on models in science were investigated using a pencil-and-paper questionnaire given to 275 students from Grade 8 (13 years old) to first-year university students, which enabled both forced choice and an open response. The results provided evidence, improving with increased years of schooling, that many students have a good understanding of the role of models in the process of science, appreciating the representational nature of models, the multiplicity of models and the changing nature of models. However, in contrast to previous studies, many students were also aware of the role of models in their learning of science. While some students had a fascination for true facts and single and correct models, others exhibited more sophisticated epistemologies of science. Mostly students' comments revealed developing understandings of the process of science. Scientific models were associated with students' understanding of the role of scientific models in the process of science and teaching models were more commonly associated with students' understanding of the role of models in the process of learning.