Point estimates and confidence regions for sequential trials involving selection

A number of authors have proposed clinical trial designs involving the comparison of several experimental treatments with a control treatment in two or more stages. At the end of the first stage, the most promising experimental treatment is selected, and all other experimental treatments are dropped from the trial. Provided it is good enough, the selected experimental treatment is then compared with the control treatment in one or more subsequent stages. The analysis of data from such a trial is problematic because of the treatment selection and the possibility of stopping at interim analyses. These aspects lead to bias in the maximum-likelihood estimate of the advantage of the selected experimental treatment over the control and to inaccurate coverage for the associated confidence interval. In this paper, we evaluate the bias of the maximum-likelihood estimate and propose a bias-adjusted estimate. We also propose an approach to the construction of a confidence region for the vector of advantages of the experimental treatments over the control based on an ordering of the sample space. These regions are shown to have accurate coverage, although they are also shown to be necessarily unbounded. Confidence intervals for the advantage of the selected treatment are obtained from the confidence regions and are shown to have more accurate coverage than the standard confidence interval based upon the maximum-likelihood estimate and its asymptotic standard error.

Hitting emissions targets with (statistical) confidence in multi-instrument Emissions Trading Schemes

A means of assessing, monitoring and controlling aggregate emissions from multi-instrument Emissions Trading Schemes is proposed. The approach allows contributions from different instruments with different forms of emissions targets to be integrated. Where Emissions Trading Schemes are helping meet specific national targets, the approach allows the entry requirements of new participants to be calculated and set at a level that will achieve these targets. The approach is multi-levelled, and may be extended downwards to support pooling of participants within instruments, or upwards to embed Emissions Trading Schemes within a wider suite of policies and measures with hard and soft targets. Aggregate emissions from each instrument are treated stochastically. Emissions from the scheme as a whole are then the joint probability distribution formed by integrating the emissions from its instruments. Because a Bayesian approach is adopted, qualitative and semi-qualitative data from expert opinion can be used where quantitative data is not currently available, or is incomplete. This approach helps government retain sufficient control over emissions trading scheme targets to allow them to meet their emissions reduction obligations, while minimising the need for retrospectively adjusting existing participants’ conditions of entry. This maintains participant confidence, while providing the necessary policy levers for good governance.

Depression, confidence, and decision: evidence against depressive realism

This research examined how retrospective self-assessments of performance are affected by major depression. To test the validity of the depressive realism versus the selective processing hypotheses, aggregate posttest performance estimates (PTPEs) were obtained from clinically depressed patients and an age-matched comparison group across 4 decision tasks (object recognition, general knowledge, social judgment, and line-length judgment). As expected on the basis of previous findings, both groups were underconfident in their PTPEs, consistently underestimating the percentage of questions they had answered correctly. Contrary to depressive realism, and in partial support of the selective processing account, this underconfidence effect was not reduced but modestly exacerbated in the depressed patients. Further, whereas the PTPEs of the comparison group exceeded that expected on the basis of chance alone those of the depressed individuals did not. The results provide no support for the depressive realism account and suggest that negative biases contribute to metacognitive information processing in major depression.

A method for assessing confidence in requirements analysis

Context: During development managers, analysts and designers often need to know whether enough requirements analysis work has been done and whether or not it is safe to proceed to the design stage. Objective: This paper describes a new, simple and practical method for assessing our confidence in a set of requirements. Method: We identified 4 confidence factors and used a goal oriented framework with a simple ordinal scale to develop a method for assessing confidence. We illustrate the method and show how it has been applied to a real systems development project. Results: We show how assessing confidence in the requirements could have revealed problems in this project earlier and so saved both time and money. Conclusion: Our meta-level assessment of requirements provides a practical and pragmatic method that can prove useful to managers, analysts and designers who need to know when sufficient requirements analysis has been performed.

Dissociation between the impact of evidence on eye movement target choice and confidence judgements

It has been suggested that the evidence used to support a decision to move our eyes and the confidence we have in that decision are derived from a common source. Alternatively, confidence may be based on further post-decisional processes. In three experiments we examined this. In Experiment 1, participants chose between two targets on the basis of varying levels of evidence (i.e., the direction of motion coherence in a Random-Dot-Kinematogram). They indicated this choice by making a saccade to one of two targets and then indicated their confidence. Saccade trajectory deviation was taken as a measure of the inhibition of the non-selected target. We found that as evidence increased so did confidence and deviations of saccade trajectory away from the non-selected target. However, a correlational analysis suggested they were not related. In Experiment 2 an option to opt-out of the choice was offered on some trials if choice proved too difficult. In this way we isolated trials on which confidence in target selection was high (i.e., when the option to opt-out was available but not taken). Again saccade trajectory deviations were found not to differ in relation to confidence. In Experiment 3 we directly manipulated confidence, such that participants had high or low task confidence. They showed no differences in saccade trajectory deviations. These results support post-decisional accounts of confidence: evidence supporting the decision to move the eyes is reflected in saccade control, but the confidence that we have in that choice is subject to further post-decisional processes.

A comparison of methods for constructing confidence intervals after phase II/III clinical trials

Recently, in order to accelerate drug development, trials that use adaptive seamless designs such as phase II/III clinical trials have been proposed. Phase II/III clinical trials combine traditional phases II and III into a single trial that is conducted in two stages. Using stage 1 data, an interim analysis is performed to answer phase II objectives and after collection of stage 2 data, a final confirmatory analysis is performed to answer phase III objectives. In this paper we consider phase II/III clinical trials in which, at stage 1, several experimental treatments are compared to a control and the apparently most effective experimental treatment is selected to continue to stage 2. Although these trials are attractive because the confirmatory analysis includes phase II data from stage 1, the inference methods used for trials that compare a single experimental treatment to a control and do not have an interim analysis are no longer appropriate. Several methods for analysing phase II/III clinical trials have been developed. These methods are recent and so there is little literature on extensive comparisons of their characteristics. In this paper we review and compare the various methods available for constructing confidence intervals after phase II/III clinical trials.

Can we have confidence in generic structures?

The system dynamics concept of `generic structure' is dividable into three sub-types. This paper analyses the validity of these three, using both practical and theoretical perspectives. Firstly, a new set of measures is developed for generating validity-`confidence'-amongst a group using generic structures in a practical modelling situation. It is concluded that different confidence criteria are implicitly employed; there is an argument for trading-off model precision and analytical quality for simplicity and ease of use and future research is needed to combine these `process' and `content' aspects of confidence. From a theoretical stance it is shown that with two of the sub-types a scientific notion of confidence is achievable whereas the third (`archetypes') involves merely metaphorical thinking. It is concluded that the theoretical status of archetypes requires further development, whilst ensuring that its benefits are retained.

Differential effects of neuromuscular blockers on twitches and tetani in the isolated rat muscle: a multiple comparison study using simultaneous confidence intervals

In the present work a comparative quantitative evaluation of the differential effects of neuromuscular blockers on twitches and tetani was performed, encompassing: atracurium, cisatracurium, mivacurium, pancuronium, rocuronium and vecuronium. The sciatic nerve-extensor digitorum longus muscle of the rat was used, in vitro. Twitches were evoked at 0.1 Hz and tetani at 50 Hz. The differential effects of the studied compounds on twitches and tetani were statistically compared using simultaneous confidence intervals for the ratios between mean IC(50) for the block of twitches and mean IC(50) for the block of tetani. The results of ratios of mean IC(50) together with their corresponding 95% simultaneous confidence intervals were: vecuronium: 2.5 (1.8-3.5); mivacurium: 3.8 (3.0-4.9); pancuronium: 3.9 (2.0-7.6); rocuronium: 6.1 (3.8-9.9); atracurium: 9.0 (6.4-12.6); cisatracurium: 13.1 (6.0-28.4). Using the criteria that neuromuscular blockers displaying disjunct confidence intervals for the ratios of mean IC(50) differ statistically with regard to differential effects on twitches and tetani, significant differences in ratios of IC(50) were detected in the following cases: vecuronium vs. rocuronium, vs. atracurium and vs. cisatracurium and mivacurium vs: cisatracurium and vs. atracurium. The results show that the magnitude of the differential effects of neuromuscular blockers on twitches and tetani, as evaluated in the present work in the form of ratios of mean IC(50), does not depend on the chemical structure (comparing steroidal and isoquinolinic compounds), but seems to depend on differential pre- and post-synaptic effects of the compounds. It is also suggested that the greater the ability of a compound to block twitches and tetani in a differential manner, the safer is the compound from the clinical anesthesiology viewpoint.

Confidence in heuristic solutions?

Solutions to combinatorial optimization problems frequently rely on heuristics to minimize an objective function. The optimum is sought iteratively and pre-setting the number of iterations dominates in operations research applications, which implies that the quality of the solution cannot be ascertained. Deterministic bounds offer a mean of ascertaining the quality, but such bounds are available for only a limited number of heuristics and the length of the interval may be difficult to control in an application. A small, almost dormant, branch of the literature suggests using statistical principles to derive statistical bounds for the optimum. We discuss alternative approaches to derive statistical bounds. We also assess their performance by testing them on 40 test p-median problems on facility location, taken from Beasley’s OR-library, for which the optimum is known. We consider three popular heuristics for solving such location problems; simulated annealing, vertex substitution, and Lagrangian relaxation where only the last offers deterministic bounds. Moreover, we illustrate statistical bounds in the location of 71 regional delivery points of the Swedish Post. We find statistical bounds reliable and much more efficient than deterministic bounds provided that the heuristic solutions are sampled close to the optimum. Statistical bounds are also found computationally affordable.

The Role of Motivational Strategies in the Upper Elementary Classroom : A systematic literature review about teacher strategies that promote self-confidence, motivation and a conducive learning environment

The aim of this literature review is to investigate which strategies teachers use to motivate pupils to communicate orally in English. The literature review also investigates how these teacher strategies affect pupils. The methodology used for this investigation is a systematic literature review. Various databases have been used when searching for literature. Scientific articles and theses have been searched for. They have also been read and analyzed before they have become a part of this review. The results indicate that some teachers feel insecure when speaking English. Therefore Swedish is spoken in many language classrooms. Teachers speaking in front of the class is the traditional way of teaching, and it does not seem to be a strategy who influences pupils positively. If teachers speak the target language among pupils they often get more motivated and focused pupils who feel comfortable speaking English. Young pupils are fast learners. By exposing them to the English language in early ages they receive great opportunities to learn a foreign language and strengthen their self-confidence. Drama, songs and rhymes are preferable strategies to use when teaching young learners. What position teachers decide to take in the classroom is also a significant element when teaching foreign languages.