Modeling Efficient Classification as a Process of Confidence Assessment and Delegation

In visual object detection and recognition, classifiers have two interesting characteristics: accuracy and speed. Accuracy depends on the complexity of the image features and classifier decision surfaces. Speed depends on the hardware and the computational effort required to use the features and decision surfaces. When attempts to increase accuracy lead to increases in complexity and effort, it is necessary to ask how much are we willing to pay for increased accuracy. For example, if increased computational effort implies quickly diminishing returns in accuracy, then those designing inexpensive surveillance applications cannot aim for maximum accuracy at any cost. It becomes necessary to find trade-offs between accuracy and effort. We study efficient classification of images depicting real-world objects and scenes. Classification is efficient when a classifier can be controlled so that the desired trade-off between accuracy and effort (speed) is achieved and unnecessary computations are avoided on a per input basis. A framework is proposed for understanding and modeling efficient classification of images. Classification is modeled as a tree-like process. In designing the framework, it is important to recognize what is essential and to avoid structures that are narrow in applicability. Earlier frameworks are lacking in this regard. The overall contribution is two-fold. First, the framework is presented, subjected to experiments, and shown to be satisfactory. Second, certain unconventional approaches are experimented with. This allows the separation of the essential from the conventional. To determine if the framework is satisfactory, three categories of questions are identified: trade-off optimization, classifier tree organization, and rules for delegation and confidence modeling. Questions and problems related to each category are addressed and empirical results are presented. For example, related to trade-off optimization, we address the problem of computational bottlenecks that limit the range of trade-offs. We also ask if accuracy versus effort trade-offs can be controlled after training. For another example, regarding classifier tree organization, we first consider the task of organizing a tree in a problem-specific manner. We then ask if problem-specific organization is necessary.

Learning Nonlinear Visual Processing from Natural Images

The paradigm of computational vision hypothesizes that any visual function -- such as the recognition of your grandparent -- can be replicated by computational processing of the visual input. What are these computations that the brain performs? What should or could they be? Working on the latter question, this dissertation takes the statistical approach, where the suitable computations are attempted to be learned from the natural visual data itself. In particular, we empirically study the computational processing that emerges from the statistical properties of the visual world and the constraints and objectives specified for the learning process. This thesis consists of an introduction and 7 peer-reviewed publications, where the purpose of the introduction is to illustrate the area of study to a reader who is not familiar with computational vision research. In the scope of the introduction, we will briefly overview the primary challenges to visual processing, as well as recall some of the current opinions on visual processing in the early visual systems of animals. Next, we describe the methodology we have used in our research, and discuss the presented results. We have included some additional remarks, speculations and conclusions to this discussion that were not featured in the original publications. We present the following results in the publications of this thesis. First, we empirically demonstrate that luminance and contrast are strongly dependent in natural images, contradicting previous theories suggesting that luminance and contrast were processed separately in natural systems due to their independence in the visual data. Second, we show that simple cell -like receptive fields of the primary visual cortex can be learned in the nonlinear contrast domain by maximization of independence. Further, we provide first-time reports of the emergence of conjunctive (corner-detecting) and subtractive (opponent orientation) processing due to nonlinear projection pursuit with simple objective functions related to sparseness and response energy optimization. Then, we show that attempting to extract independent components of nonlinear histogram statistics of a biologically plausible representation leads to projection directions that appear to differentiate between visual contexts. Such processing might be applicable for priming, \ie the selection and tuning of later visual processing. We continue by showing that a different kind of thresholded low-frequency priming can be learned and used to make object detection faster with little loss in accuracy. Finally, we show that in a computational object detection setting, nonlinearly gain-controlled visual features of medium complexity can be acquired sequentially as images are encountered and discarded. We present two online algorithms to perform this feature selection, and propose the idea that for artificial systems, some processing mechanisms could be selectable from the environment without optimizing the mechanisms themselves. In summary, this thesis explores learning visual processing on several levels. The learning can be understood as interplay of input data, model structures, learning objectives, and estimation algorithms. The presented work adds to the growing body of evidence showing that statistical methods can be used to acquire intuitively meaningful visual processing mechanisms. The work also presents some predictions and ideas regarding biological visual processing.

Recognition, comorbidity, and outcome of DSM-IV bipolar I and II disorders in psychiatric care

This study is part of an ongoing collaborative bipolar research project, the Jorvi Bipolar Study (JoBS). The JoBS is run by the Department of Mental Health and Alcohol Research of the National Public Health Institute, Helsinki, and the Department of Psychiatry, Jorvi Hospital, Helsinki University Central Hospital (HUCH), Espoo, Finland. It is a prospective, naturalistic cohort study of secondary level care psychiatric in- and outpatients with a new episode of bipolar disorder (BD). The second report also included 269 major depressive disorder (MDD) patients from the Vantaa Depression Study (VDS). The VDS was carried out in collaboration with the Department of Psychiatry of the Peijas Medical Care District. Using the Mood Disorder Questionnaire (MDQ), all in- and outpatients at the Department of Psychiatry at Jorvi Hospital who currently had a possible new phase of DSM-IV BD were sought. Altogether, 1630 psychiatric patients were screened, and 490 were interviewed using a semistructured interview (SCID-I/P). The patients included in the cohort (n=191) had at intake a current phase of BD. The patients were evaluated at intake and at 6- and 18-month interviews. Based on this study, BD is poorly recognized even in psychiatric settings. Of the BD patients with acute worsening of illness, 39% had never been correctly diagnosed. The classic presentations of BD with hospitalizations, manic episodes, and psychotic symptoms lead clinicians to correct diagnosis of BD I in psychiatric care. Time of follow-up elapsed in psychiatric care, but none of the clinical features, seemed to explain correct diagnosis of BD II, suggesting reliance on cross- sectional presentation of illness. Even though BD II was clearly less often correctly diagnosed than BD I, few other differences between the two types of BD were detected. BD I and II patients appeared to differ little in terms of clinical picture or comorbidity, and the prevalence of psychiatric comorbidity was strongly related to the current illness phase in both types. At the same time, the difference in outcome was clear. BD II patients spent about 40% more time depressed than BD I patients. Patterns of psychiatric comorbidity of BD and MDD differed somewhat qualitatively. Overall, MDD patients were likely to have more anxiety disorders and cluster A personality disorders, and bipolar patients to have more cluster B personality disorders. The adverse consequences of missing or delayed diagnosis are potentially serious. Thus, these findings strongly support the value of screening for BD in psychiatric settings, especially among the major depressive patients. Nevertheless, the diagnosis must be based on a clinical interview and follow-up of mood. Comorbidity, present in 59% of bipolar patients in a current phase, needs concomitant evaluation, follow-up, and treatment. To improve outcome in BD, treatment of bipolar depression is a major challenge for clinicians.

Accuracy of absorbed dose in external photon beam radiotherapy : what level is sufficient and how to approach it?

Radiation therapy (RT) plays currently significant role in curative treatments of several cancers. External beam RT is carried out mostly by using megavoltage beams of linear accelerators. Tumor eradication and normal tissue complications correlate to dose absorbed in tissues. Normally this dependence is steep and it is crucial that actual dose within patient accurately correspond to the planned dose. All factors in a RT procedure contain uncertainties requiring strict quality assurance. From hospital physicist´s point of a view, technical quality control (QC), dose calculations and methods for verification of correct treatment location are the most important subjects. Most important factor in technical QC is the verification that radiation production of an accelerator, called output, is within narrow acceptable limits. The output measurements are carried out according to a locally chosen dosimetric QC program defining measurement time interval and action levels. Dose calculation algorithms need to be configured for the accelerators by using measured beam data. The uncertainty of such data sets limits for best achievable calculation accuracy. All these dosimetric measurements require good experience, are workful, take up resources needed for treatments and are prone to several random and systematic sources of errors. Appropriate verification of treatment location is more important in intensity modulated radiation therapy (IMRT) than in conventional RT. This is due to steep dose gradients produced within or close to healthy tissues locating only a few millimetres from the targeted volume. The thesis was concentrated in investigation of the quality of dosimetric measurements, the efficacy of dosimetric QC programs, the verification of measured beam data and the effect of positional errors on the dose received by the major salivary glands in head and neck IMRT. A method was developed for the estimation of the effect of the use of different dosimetric QC programs on the overall uncertainty of dose. Data were provided to facilitate the choice of a sufficient QC program. The method takes into account local output stability and reproducibility of the dosimetric QC measurements. A method based on the model fitting of the results of the QC measurements was proposed for the estimation of both of these factors. The reduction of random measurement errors and optimization of QC procedure were also investigated. A method and suggestions were presented for these purposes. The accuracy of beam data was evaluated in Finnish RT centres. Sufficient accuracy level was estimated for the beam data. A method based on the use of reference beam data was developed for the QC of beam data. Dosimetric and geometric accuracy requirements were evaluated for head and neck IMRT when function of the major salivary glands is intended to be spared. These criteria are based on the dose response obtained for the glands. Random measurement errors could be reduced enabling lowering of action levels and prolongation of measurement time interval from 1 month to even 6 months simultaneously maintaining dose accuracy. The combined effect of the proposed methods, suggestions and criteria was found to facilitate the avoidance of maximal dose errors of up to even about 8 %. In addition, their use may make the strictest recommended overall dose accuracy level of 3 % (1SD) achievable.

Very Low Birth Weight Infants as Young Adults : Focus on aspects of cognition, behavior and sleep

Major advances in the treatment of preterm infants have occurred during the last three decades. Survival rates have increased, and the first generations of preterm infants born at very low birth weight (VLBW; less than 1500 g) who profited from modern neonatal intensive care are now in young adulthood. The literature shows that VLBW children achieve on average lower scores on cognitive tests, even after exclusion of individuals with obvious neurosensory deficits. Evidence also exists for an increased risk in VLBW children for various neuropsychiatric disorders such as attention-deficit hyperactivity disorder (ADHD) and related behavioral symptoms. Up till now, studies extending into adulthood are sparse, and it remains to be seen whether these problems persist into adulthood. The aim of this thesis was to study ADHD-related symptoms and cognitive and executive functioning in young adults born at VLBW. In addition, we aimed to study sleep disturbances, known to adversely affect both cognition and attention. We hypothesized that preterm birth at VLBW interferes with early brain development in a way that alters the neuropsychological phenotype; this may manifest itself as ADHD symptoms and impaired cognitive abilities in young adulthood. In this cohort study from a geographically defined region, we studied 166 VLBW adults and 172 term-born controls born from 1978 through 1985. At ages 18 to 27 years, the study participants took part in a clinic study during which their physical and psychological health was assessed in detail. Three years later, 213 of these individuals participated in a follow-up. The current study is part of a larger research project (The Helsinki Study of Very Low Birth Weight Adults), and the measurements of interest for this particular study include the following: 1) The Adult Problem Questionnaire (APQ), a self-rating scale of ADHD-related symptoms in adults; 2) A computerized cognitive test battery designed for population studies (CogState®) which measures core cognitive abilities such as reaction time, working memory, and visual learning; 3) Sleep assessment by actigraphy, the Basic Nordic Sleep Questionnaire, and the Morningness-Eveningness Questionnaire. Actigraphs are wrist-worn accelerometers that separate sleep from wakefulness by registering body movements. Contrary to expectations, VLBW adults as a group reported no more ADHD-related behavioral symptoms than did controls. Further subdivision of the VLBW group into SGA (small for gestational age) and AGA (appropriate for gestational age) subgroups, however, revealed more symptoms on ADHD subscales pertaining to executive dysfunction and emotional instability among those born SGA. Thus, it seems that intrauterine growth retardation (for which SGA served as a proxy) is a more essential predictor for self-perceived ADHD symptoms in adulthood than is VLBW birth as such. In line with observations from other cohorts, the VLBW adults reported less risk-taking behavior in terms of substance use (alcohol, smoking, and recreational drugs), a finding reassuring for the VLBW individuals and their families. On the cognitive test, VLBW adults free from neurosensory deficits had longer reaction times than did term-born peers on all tasks included in the test battery, and lower accuracy on the learning task, with no discernible effect of SGA status over and above the effect of VLBW. Altogether, on a group level, even high-functioning VLBW adults show subtle deficits in psychomotor processing speed, visual working memory, and learning abilities. The sleep studies provided no evidence for differences in sleep quality or duration between the two groups. The VLBW adults were, however, at more than two-fold higher risk for sleep-disordered breathing (in terms of chronic snoring). Given the link between sleep-disordered breathing and health sequelae, these results suggest that VLBW individuals may benefit from an increased awareness among clinicians of this potential problem area. An unexpected finding from the sleep studies was the suggestion of an advanced sleep phase: The VLBW adults went to bed earlier according to the actigraphy registrations and also reported earlier wake-up times on the questionnaire. In further study of this issue in conjunction with the follow-up three years later, the VLBW group reported higher levels of morningness propensity, further corroborating the preliminary findings of an advanced sleep phase. Although the clinical implications are not entirely clear, the issue may be worth further study, since circadian rhythms are closely related to health and well-being. In sum, we believe that increased understanding of long-term outcomes after VLBW, and identification of areas and subgroups that are particularly vulnerable, will allow earlier recognition of potential problems and ultimately lead to improved prevention strategies.

Analysts' Accuracy of Estimation and the Relative Trading Volume

This study contributes to the neglect effect literature by looking at the relative trading volume in terms of value. The results for the Swedish market show a significant positive relationship between the accuracy of estimation and the relative trading volume. Market capitalisation and analyst coverage have in prior studies been used as proxies for neglect. These measures however, do not take into account the effort analysts put in when estimating corporate pre-tax profits. I also find evidence that the industry of the firm influence the accuracy of estimation. In addition, supporting earlier findings, loss making firms are associated with larger forecasting errors. Further, I find that the average forecast error increased in the year 2000 – in Sweden.

Innate Immune Recognition of RNA-virus infection in human macrophages

Innate immunity and host defence are rapidly evoked by structurally invariant molecular motifs common to microbial world, called pathogen associated molecular patterns (PAMPs). In addition to PAMPs, endogenous molecules released in response to inflammation and tissue damage, danger associated molecular patterns (DAMPs), are required for eliciting the response. The most important PAMPs of viruses are viral nucleic acids, their genome or its replication intermediates, whereas the identity and characteristics of virus infection-induced DAMPs are poorly defined. PAMPs and DAMPs engage a limited set of germ-line encoded pattern recognition receptors (PRRs) in immune and non-immune cells. Membrane-bound Toll-like receptors (TLRs), cytoplasmic retinoic acid inducible gene-I (RIG-I)-like receptors (RLRs) and nucleotide-binding oligomerization domain-like receptor (NLRs) are important PRRs involved in the recognition of the molecular signatures of viral infection, such as double-stranded ribonucleic acids (dsRNAs). Engagement of PRRs results in local and systemic innate immune responses which, when activated against viruses, evoke secretion of antiviral and pro-inflammatory cytokines, and programmed cell death i.e., apoptosis of the virus-infected cell. Macrophages are the central effector cells of innate immunity. They produce significant amounts of antiviral cytokines, called interferons (IFNs), and pro-inflammatory cytokines, such as interleukin (IL)-1β and IL-18. IL-1β and IL-18 are synthesized as inactive precursors, pro-IL-1β and pro-IL-18, that are processed by caspase-1 in a cytoplasmic multiprotein complex, called the inflammasome. After processing, these cytokines are biologically active and will be secreted. The signals and secretory routes that activate inflammasomes and the secretion of IL-1β and IL-18 during virus infections are poorly characterized. The main goal of this thesis was to characterize influenza A virus-induced innate immune responses and host-virus interactions in human primary macrophages during an infection. Methodologically, various techniques of cellular and molecular biology, as well as proteomic tools combined with bioinformatics, were utilized. Overall, the thesis provides interesting insights into inflammatory and antiviral innate immune responses, and has characterized host-virus interactions during influenza A virus-infection in human primary macrophages.

Immunochemical analysis of prolamins in gluten-free foods

People with coeliac disease have to maintain a gluten-free diet, which means excluding wheat, barley and rye prolamin proteins from their diet. Immunochemical methods are used to analyse the harmful proteins and to control the purity of gluten-free foods. In this thesis, the behaviour of prolamins in immunological gluten assays and with different prolamin-specific antibodies was examined. The immunoassays were also used to detect residual rye prolamins in sourdough systems after enzymatic hydrolysis and wheat prolamins after deamidation. The aim was to characterize the ability of the gluten analysis assays to quantify different prolamins in varying matrices in order to improve the accuracy of the assays. Prolamin groups of cereals consist of a complex mixture of proteins that vary in their size and amino acid sequences. Two common characteristics distinguish prolamins from other cereal proteins. Firstly, they are soluble in aqueous alcohols, and secondly, most of the prolamins are mainly formed from repetitive amino acid sequences containing high amounts of proline and glutamine. The diversity among prolamin proteins sets high requirements for their quantification. In the present study, prolamin contents were evaluated using enzyme-linked immunosorbent assays based on ω- and R5 antibodies. In addition, assays based on A1 and G12 antibodies were used to examine the effect of deamidation on prolamin proteins. The prolamin compositions and the cross-reactivity of antibodies with prolamin groups were evaluated with electrophoretic separation and Western blotting. The results of this thesis research demonstrate that the currently used gluten analysis methods are not able to accurately quantify barley prolamins, especially when hydrolysed or mixed in oats. However, more precise results can be obtained when the standard more closely matches the sample proteins, as demonstrated with barley prolamin standards. The study also revealed that all of the harmful prolamins, i.e. wheat, barley and rye prolamins, are most efficiently extracted with 40% 1-propanol containing 1% dithiothreitol at 50 °C. The extractability of barley and rye prolamins was considerably higher with 40% 1-propanol than with 60% ethanol, which is typically used for prolamin extraction. The prolamin levels of rye were lowered by 99.5% from the original levels when an enzyme-active rye-malt sourdough system was used for prolamin degradation. Such extensive degradation of rye prolamins suggest the use of sourdough as a part of gluten-free baking. Deamidation increases the diversity of prolamins and improves their solubility and ability to form structures such as emulsions and foams. Deamidation changes the protein structure, which has consequences for antibody recognition in gluten analysis. According to the resuts of the present work, the analysis methods were not able to quantify wheat gluten after deamidation except at very high concentrations. Consequently, deamidated gluten peptides can exist in food products and remain undetected, and thus cause a risk for people with gluten intolerance. The results of this thesis demonstrate that current gluten analysis methods cannot accurately quantify prolamins in all food matrices. New information on the prolamins of rye and barley in addition to wheat prolamins is also provided in this thesis, which is essential for improving gluten analysis methods so that they can more accurately quantify prolamins from harmful cereals.

DNA damage recognition in the normal epithelium of human prostate and seminal vesicles

Prostate cancer is one of the most prevalent cancer types in men. The development of prostate tumors is known to require androgen exposure, and several pathways governing cell growth are deregulated in prostate tumorigenesis. Recent genetic studies have revealed that complex gene fusions and copy - number alterations are frequent in prostate cancer, a unique feature among solid tumors. These chromosomal aberrations are though to arise as a consequence of faulty repair of DNA double strand breaks (DSB). Most repair mechanisms have been studied in detail in cancer cell lines, but how DNA damage is detected and repaired in normal differentiated human cells has not been widely addressed. The events leading to the gene fusions in prostate cancer are under rigorous studies, as they not only shed light on the basic pathobiologic mechanisms but may also produce molecular targets for prostate cancer treatment and prevention. Prostate and seminal vesicles are part of the male reproductive system. They share similar structure and function but differ dramatically in their cancer incidence. Approximately fifty primary seminal vesicle carcinomas have been reported worldwide. Surprisingly, only little is known on why seminal vesicles are resistant to neoplastic changes. As both tissues are androgen dependent, it is a mystery that androgen signaling would only lead to tumors in prostate tissue. In this work, we set up novel ex vivo human tissue culture models of prostate and seminal vesicles, and used them to study how DNA damage is recognized in normal epithelium. One of the major DNA - damage inducible pathways, mediated by the ATM kinase, was robustly activated in all main cell types of both tissues. Interestingly, we discovered that secretory epithelial cells had less histone variant H2A.X and after DNA damage lower levels of H2AX were phosphorylated on serine 139 (γH2AX) than in basal or stromal cells. γH2AX has been considered essential for efficient DSB repair, but as there were no significant differences in the γH2AX levels between the two tissues, it seems more likely that the role of γH2AX is less important in postmitotic cells. We also gained insight into the regulation of p53, an important transcription factor that protects genomic integrity via multiple mechanisms, in human tissues. DSBs did not lead to a pronounced activation of p53, but treatments causing transcriptional stress, on the other hand, were able to launch a notable p53 response in both tissue types. In general, ex vivo culturing of human tissues provided unique means to study differentiated cells in their relevant tissue context, and is suited for testing novel therapeutic drugs before clinical trials. In order to study how prostate and seminal vesicle epithelial cells are able to activate DNA damage induced cell cycle checkpoints, we used primary cultures of prostate and seminal vesicle epithelial cells. To our knowledge, we are the first to report isolation of human primary seminal vesicle cells. Surprisingly, human prostate epithelial cells did not activate cell cycle checkpoints after DSBs in part due to low levels of Wee1A, a kinase regulating CDK activity, while primary seminal vesicle epithelial cells possessed proficient cell cycle checkpoints and expressed high levels of Wee1A. Similarly, seminal vesicle cells showed a distinct activation of the p53 - pathway after DSBs that did not occur in prostate epithelial cells. This indicates that p53 protein function is under different control mechanisms in the two cell types, which together with proficient cell cycle checkpoints may be crucial in protecting seminal vesicles from endogenous and exogenous DNA damaging factors and, as a consequence, from carcinogenesis. These data indicate that two very similar organs of male reproductive system do not respond to DNA damage similarly. The differentiated, non - replicating cells of both tissues were able to recognize DSBs, but under proliferation human prostate epithelial cells had deficient activation of the DNA damage response. This suggests that prostate epithelium is most vulnerable to accumulating genomic aberrations under conditions where it needs to proliferate, for example after inflammatory cellular damage.