Is confidence in decisions related to feedback? Evidence-and lack of evidence-from random samples of real-world managerial behavior?

Confidence in decision making is an important dimension of managerialbehavior. However, what is the relation between confidence, on the onehand, and the fact of receiving or expecting to receive feedback ondecisions taken, on the other hand? To explore this and related issuesin the context of everyday decision making, use was made of the ESM(Experience Sampling Method) to sample decisions taken by undergraduatesand business executives. For several days, participants received 4 or 5SMS messages daily (on their mobile telephones) at random moments at whichpoint they completed brief questionnaires about their current decisionmaking activities. Issues considered here include differences between thetypes of decisions faced by the two groups, their structure, feedback(received and expected), and confidence in decisions taken as well as inthe validity of feedback. No relation was found between confidence indecisions and whether participants received or expected to receivefeedback on those decisions. In addition, although participants areclearly aware that feedback can provide both confirming and disconfirming evidence, their ability to specify appropriatefeedback is imperfect. Finally, difficulties experienced inusing the ESM are discussed as are possibilities for further researchusing this methodology.

Predictive value of readiness, importance, and confidence in ability to change drinking and smoking.

BACKGROUND: Visual analog scales (VAS) are sometimes used to assess change constructs that are often considered critical for change. Aims of Study: 1.) To determine the association of readiness to change, importance of changing and confidence in ability to change alcohol and tobacco use at baseline with the risk for drinking (more than 21 drinks per week/6 drinks or more on a single occasion more than once per month) and smoking (one or more cigarettes per day) six months later. 2.) To determine the association of readiness, importance and confidence with alcohol (number of drinks/week, number of binge drinking episodes/month) and tobacco (number of cigarettes/day) use at six months. METHODS: This is a secondary analysis of data from a multi-substance brief intervention randomized trial. A sample of 461 Swiss young men was analyzed as a prospective cohort. Participants were assessed at baseline and six months later on alcohol and tobacco use, and at baseline on readiness to change, importance of changing and confidence in ability to change constructs, using visual analog scales ranging from 1-10 for drinking and smoking behaviors. Regression models controlling for receipt of brief intervention were employed for each change construct. The lowest level (1-4) of each scale was the reference group that was compared to the medium (5-7) and high (8-10) levels. RESULTS: Among the 377 subjects reporting unhealthy alcohol use at baseline, mean (SD) readiness, importance and confidence to change drinking scores were 3.9 (3.0), 2.7 (2.2) and 7.2 (3.0), respectively. At follow-up, 108 (29%) reported no unhealthy alcohol use. Readiness was not associated with being risk-free at follow-up, but high importance (OR 2.94; 1.15, 7.50) and high confidence (OR 2.88; 1.46, 5.68) were. Among the 255 smokers at baseline, mean readiness, importance and confidence to change smoking scores were 4.6 (2.6), 5.3 (2.6) and 5.9 (2.7), respectively. At follow-up, 13% (33) reported no longer smoking. Neither readiness nor importance was associated with being a non-smoker, whereas high confidence (OR 3.29; 1.12, 9.62) was. CONCLUSIONS: High confidence in ability to change was associated with favorable outcomes for both drinking and smoking, whereas high importance was associated only with a favorable drinking outcome. This study points to the value of confidence as an important predictor of successful change for both drinking and smoking, and shows the value of importance in predicting successful changes in alcohol use. TRIAL REGISTRATION NUMBER: ISRCTN78822107.

The Effectiveness of Domestic Abuse Protective Orders and Court Practices in Sentencing Violators, July 2011

Deterring abuse is important to ensuring safety among domestic violence and assault victims. Protective orders are tools aimed at restricting contact between the victim and the abuser to prevent subsequent violence. While empirical research has indicated that protective orders are effective, the extent of the effectiveness is uncertain because violation rates have varied widely from study to study. In addition, little research exists to explain how violations of protective orders are handled, which factors are considered when giving penalties, and whether certain situations lead to a given type of penalty.

Predictive Value of Readiness, Importance, and Confidence in Ability to Change Drinking and Smoking

Background: Visual analog scales (VAS) are used to assess readiness to changeconstructs, which are often considered critical for change.Objective: We studied whether 3 constructs -readiness to change, importance of changing and confidence inability to change- predict risk status 6 months later in 20 year-old men with either orboth of two behaviors: risky drinking and smoking. Methods: 577 participants in abrief intervention randomized trial were assessed at baseline and 6 months later onalcohol and tobacco consumption and with three 1-10 VAS (readiness, importance,confidence) for each behavior. For each behavior, we used one regression model foreach constructs. Models controlled for receipt of a brief intervention and used thelowest level (1-4) in each construct as the reference group (vs medium (5-7) and high(8-10) levels).Results: Among the 475 risky drinkers, mean (SD) readiness, importance and confidence to change drinking were 4.0 (3.1), 2.8 (2.2) and 7.2 (3.0).Readiness was not associated with being alcohol-risk free 6 months later (OR 1.3[0.7; 2.2] and 1.4 [0.8; 2.6] for medium and high readiness). High importance andhigh confidence were associated with being risk free (OR 0.9 [0.5; 1.8] and 2.9 [1.2;7.5] for medium and high importance; 2.1 [1.0;4.8] and 2.8 [1.5;5.6] for medium andhigh confidence). Among the 320 smokers, mean readiness, importance andconfidence to change smoking were 4.6 (2.6), 5.3 (2.6) and 5.9 (2.6). Neitherreadiness nor importance were associated with being smoking free (OR 2.1 [0.9; 4.7]and 2.1 [0.8; 5.8] for medium and high readiness; 1.4 [0.6; 3.4] and 2.1 [0.8; 5.4] formedium and high importance). High confidence was associated with being smokingfree (OR 2.2 [0.8;6.6] and 3.4 [1.2;9.8] for medium and high confidence).Conclusions: For drinking and smoking, high confidence in ability to change wasassociated -with similar magnitude- with a favorable outcome. This points to thevalue of confidence as an important predictor of successful change.

Use of GRADE for assessment of evidence about prognosis : rating confidence in estimates of event rates in broad categories of patients.

Main concepts : The Grades of Recommendation, Assessment, Development, and Evaluation (GRADE) approach defines quality of evidence as confidence in effect estimates; this conceptualization can readily be applied to bodies of evidence estimating the risk of future of events (that is, prognosis) in broadly defined populations In the field of prognosis, a body of observational evidence (including single arms of randomized controlled trials) begins as high quality evidence. The five domains GRADE considers in rating down confidence in estimates of treatment effect-that is, risk of bias, imprecision, inconsistency, indirectness, and publication bias-as well as the GRADE criteria for rating up quality, also apply to estimates of the risk of future of events from a body of prognostic studies Applying these concepts to systematic reviews of prognostic studies provides a ful approach to determine confidence in estimates of overall prognosis in broad populations.

The Confidence Information Ontology: a step towards a standard for asserting confidence in annotations.

Biocuration has become a cornerstone for analyses in biology, and to meet needs, the amount of annotations has considerably grown in recent years. However, the reliability of these annotations varies; it has thus become necessary to be able to assess the confidence in annotations. Although several resources already provide confidence information about the annotations that they produce, a standard way of providing such information has yet to be defined. This lack of standardization undermines the propagation of knowledge across resources, as well as the credibility of results from high-throughput analyses. Seeded at a workshop during the Biocuration 2012 conference, a working group has been created to address this problem. We present here the elements that were identified as essential for assessing confidence in annotations, as well as a draft ontology--the Confidence Information Ontology--to illustrate how the problems identified could be addressed. We hope that this effort will provide a home for discussing this major issue among the biocuration community. Tracker URL: https://github.com/BgeeDB/confidence-information-ontology Ontology URL: https://raw.githubusercontent.com/BgeeDB/confidence-information-ontology/master/src/ontology/cio-simple.obo

Hitting emissions targets with (statistical) confidence in multi-instrument Emissions Trading Schemes

A means of assessing, monitoring and controlling aggregate emissions from multi-instrument Emissions Trading Schemes is proposed. The approach allows contributions from different instruments with different forms of emissions targets to be integrated. Where Emissions Trading Schemes are helping meet specific national targets, the approach allows the entry requirements of new participants to be calculated and set at a level that will achieve these targets. The approach is multi-levelled, and may be extended downwards to support pooling of participants within instruments, or upwards to embed Emissions Trading Schemes within a wider suite of policies and measures with hard and soft targets. Aggregate emissions from each instrument are treated stochastically. Emissions from the scheme as a whole are then the joint probability distribution formed by integrating the emissions from its instruments. Because a Bayesian approach is adopted, qualitative and semi-qualitative data from expert opinion can be used where quantitative data is not currently available, or is incomplete. This approach helps government retain sufficient control over emissions trading scheme targets to allow them to meet their emissions reduction obligations, while minimising the need for retrospectively adjusting existing participants’ conditions of entry. This maintains participant confidence, while providing the necessary policy levers for good governance.

A method for assessing confidence in requirements analysis

Context: During development managers, analysts and designers often need to know whether enough requirements analysis work has been done and whether or not it is safe to proceed to the design stage. Objective: This paper describes a new, simple and practical method for assessing our confidence in a set of requirements. Method: We identified 4 confidence factors and used a goal oriented framework with a simple ordinal scale to develop a method for assessing confidence. We illustrate the method and show how it has been applied to a real systems development project. Results: We show how assessing confidence in the requirements could have revealed problems in this project earlier and so saved both time and money. Conclusion: Our meta-level assessment of requirements provides a practical and pragmatic method that can prove useful to managers, analysts and designers who need to know when sufficient requirements analysis has been performed.

Can we have confidence in generic structures?

The system dynamics concept of `generic structure' is dividable into three sub-types. This paper analyses the validity of these three, using both practical and theoretical perspectives. Firstly, a new set of measures is developed for generating validity-`confidence'-amongst a group using generic structures in a practical modelling situation. It is concluded that different confidence criteria are implicitly employed; there is an argument for trading-off model precision and analytical quality for simplicity and ease of use and future research is needed to combine these `process' and `content' aspects of confidence. From a theoretical stance it is shown that with two of the sub-types a scientific notion of confidence is achievable whereas the third (`archetypes') involves merely metaphorical thinking. It is concluded that the theoretical status of archetypes requires further development, whilst ensuring that its benefits are retained.

Confidence in heuristic solutions?

Solutions to combinatorial optimization problems frequently rely on heuristics to minimize an objective function. The optimum is sought iteratively and pre-setting the number of iterations dominates in operations research applications, which implies that the quality of the solution cannot be ascertained. Deterministic bounds offer a mean of ascertaining the quality, but such bounds are available for only a limited number of heuristics and the length of the interval may be difficult to control in an application. A small, almost dormant, branch of the literature suggests using statistical principles to derive statistical bounds for the optimum. We discuss alternative approaches to derive statistical bounds. We also assess their performance by testing them on 40 test p-median problems on facility location, taken from Beasley’s OR-library, for which the optimum is known. We consider three popular heuristics for solving such location problems; simulated annealing, vertex substitution, and Lagrangian relaxation where only the last offers deterministic bounds. Moreover, we illustrate statistical bounds in the location of 71 regional delivery points of the Swedish Post. We find statistical bounds reliable and much more efficient than deterministic bounds provided that the heuristic solutions are sampled close to the optimum. Statistical bounds are also found computationally affordable.

Confidence in Communication: Can My Whole Class Achieve This?

In this action research study of my classroom of Algebra 2 students, I investigated the confidence levels and communication skills of these students. I discovered that students who have higher confidence levels are comfortable in their classroom situations. The students with increased levels of confidence also have more open communication with those they respect. As a result of this research, I plan to continue with the implementation of communication skills. I will also look to next school year as a place to start executing a plan to be more available and involved in the active learning process of my students.