Learning Nonlinear Visual Processing from Natural Images

The paradigm of computational vision hypothesizes that any visual function -- such as the recognition of your grandparent -- can be replicated by computational processing of the visual input. What are these computations that the brain performs? What should or could they be? Working on the latter question, this dissertation takes the statistical approach, where the suitable computations are attempted to be learned from the natural visual data itself. In particular, we empirically study the computational processing that emerges from the statistical properties of the visual world and the constraints and objectives specified for the learning process. This thesis consists of an introduction and 7 peer-reviewed publications, where the purpose of the introduction is to illustrate the area of study to a reader who is not familiar with computational vision research. In the scope of the introduction, we will briefly overview the primary challenges to visual processing, as well as recall some of the current opinions on visual processing in the early visual systems of animals. Next, we describe the methodology we have used in our research, and discuss the presented results. We have included some additional remarks, speculations and conclusions to this discussion that were not featured in the original publications. We present the following results in the publications of this thesis. First, we empirically demonstrate that luminance and contrast are strongly dependent in natural images, contradicting previous theories suggesting that luminance and contrast were processed separately in natural systems due to their independence in the visual data. Second, we show that simple cell -like receptive fields of the primary visual cortex can be learned in the nonlinear contrast domain by maximization of independence. Further, we provide first-time reports of the emergence of conjunctive (corner-detecting) and subtractive (opponent orientation) processing due to nonlinear projection pursuit with simple objective functions related to sparseness and response energy optimization. Then, we show that attempting to extract independent components of nonlinear histogram statistics of a biologically plausible representation leads to projection directions that appear to differentiate between visual contexts. Such processing might be applicable for priming, \ie the selection and tuning of later visual processing. We continue by showing that a different kind of thresholded low-frequency priming can be learned and used to make object detection faster with little loss in accuracy. Finally, we show that in a computational object detection setting, nonlinearly gain-controlled visual features of medium complexity can be acquired sequentially as images are encountered and discarded. We present two online algorithms to perform this feature selection, and propose the idea that for artificial systems, some processing mechanisms could be selectable from the environment without optimizing the mechanisms themselves. In summary, this thesis explores learning visual processing on several levels. The learning can be understood as interplay of input data, model structures, learning objectives, and estimation algorithms. The presented work adds to the growing body of evidence showing that statistical methods can be used to acquire intuitively meaningful visual processing mechanisms. The work also presents some predictions and ideas regarding biological visual processing.

Insights into students' conceptual understanding using textual analysis: A case study in signal processing

Concept inventory tests are one method to evaluate conceptual understanding and identify possible misconceptions. The multiple-choice question format, offering a choice between a correct selection and common misconceptions, can provide an assessment of students' conceptual understanding in various dimensions. Misconceptions of some engineering concepts exist due to a lack of mental frameworks, or schemas, for these types of concepts or conceptual areas. This study incorporated an open textual response component in a multiple-choice concept inventory test to capture written explanations of students' selections. The study's goal was to identify, through text analysis of student responses, the types and categorizations of concepts in these explanations that had not been uncovered by the distractor selections. The analysis of the textual explanations of a subset of the discrete-time signals and systems concept inventory questions revealed that students have difficulty conceptually explaining several dimensions of signal processing. This contributed to their inability to provide a clear explanation of the underlying concepts, such as mathematical concepts. The methods used in this study evaluate students' understanding of signals and systems concepts through their ability to express understanding in written text. This may present a bias for students with strong written communication skills. This study presents a framework for extracting and identifying the types of concepts students use to express their reasoning when answering conceptual questions.

A Comparative Study of Electrochemical Kinetic Parameters by the Potential Step Method. Electrode Reactions of CyDTA and EDTA Complexes of Cu(II) at DME

By using the same current-time (I-t) curves, electrochemical kinetic parameters are determined by two methods, (a) using the ratio of current at a given potential to the diffusion-controlled limiting current and (b) curve fitting method, for the reduction of Cu(II)–CyDTA complex. The analysis by the method (a) shows that the rate determining step involves only one electron although the overall reduction of the complex involves two electrons suggesting thereby the stepwise reduction of the complex. The nature of I-t curves suggests the adsorption of intermediate species at the electrode surface. Under these circumstances more reliable kinetic parameters can be obtained by the method (a) compared to that of (b). Similar observations are found in the case of reduction of Cu(II)–EDTA complex.

Study of third-order non-linear systems- Variation of parameters approach

In this paper, the transient response of a third-order non-linear system is obtained by first reducing the given third-order equation to three first-order equations by applying the method of variation of parameters. On the assumption that the variations of amplitude and phase are small, the functions are expanded in ultraspherical polynomials. The expansion is restricted to the constant term. The resulting equations are solved to obtain the response of the given third-order system. A numerical example is considered to illustrate the method. The results show that the agreement between the approximate and digital solution is good thus vindicating the approximation.

An approximate mathematical procedure for the determination of characteristic parameters for a general case in three dimensional photoelasticity

In cases whazo zotatLon of the seoondazy pztncipal 8tzo,ae axes along tha light path ,exists, it is always poaeible to detezmlna two dizactions along which plane-polazlaad light ,antazlng the model ,amerCe8 as plene-pela~l,aed light fzom the model. Puzth,az the nat zstazdatton Pot any light path is dlff,azant Prom the lntsgtatad zetazd,ation Pat the l£ght path nogZsctlng the ePfsct or z,atation.

A Generalized Approach to Multiresolution Complex SAR Signal Processing

Multiresolution synthetic aperture radar (SAR) image formation has been proven to be beneficial in a variety of applications such as improved imaging and target detection as well as speckle reduction. SAR signal processing traditionally carried out in the Fourier domain has inherent limitations in the context of image formation at hierarchical scales. We present a generalized approach to the formation of multiresolution SAR images using biorthogonal shift-invariant discrete wavelet transform (SIDWT) in both range and azimuth directions. Particularly in azimuth, the inherent subband decomposition property of wavelet packet transform is introduced to produce multiscale complex matched filtering without involving any approximations. This generalized approach also includes the formulation of multilook processing within the discrete wavelet transform (DWT) paradigm. The efficiency of the algorithm in parallel form of execution to generate hierarchical scale SAR images is shown. Analytical results and sample imagery of diffuse backscatter are presented to validate the method.

Mechanisms for alphavirus nonstructural polyprotein processing

Replication and transcription of the RNA genome of alphaviruses relies on a set of virus-encoded nonstructural proteins. They are synthesized as a long polyprotein precursor, P1234, which is cleaved at three processing sites to yield nonstructural proteins nsP1, nsP2, nsP3 and nsP4. All the four proteins function as constitutive components of the membrane-associated viral replicase. Proteolytic processing of P1234 polyprotein is precisely orchestrated and coordinates the replicase assembly and maturation. The specificity of the replicase is also controlled by proteolytic cleavages. The early replicase is composed of P123 polyprotein intermediate and nsP4. It copies the positive sense RNA genome to complementary minus-strand. Production of new plus-strands requires complete processing of the replicase. The papain-like protease residing in nsP2 is responsible for all three cleavages in P1234. This study addressed the mechanisms of proteolytic processing of the replicase polyprotein in two alphaviruses Semliki Forest virus (SFV) and Sindbis virus (SIN) representing different branches of the genus. The survey highlighted the functional relation of the alphavirus nsP2 protease to the papain-like enzymes. A new structural motif the Cys-His catalytic dyad accompanied with an aromatic residue following the catalytic His was described for nsP2 and a subset of other thiol proteases. Such an architecture of the catalytic center was named the glycine specificity motif since it was implicated in recognition of a specific Gly residue in the substrate. In particular, the presence of the motif in nsP2 makes the appearance of this amino acid at the second position upstream of the scissile bond a necessary condition for the cleavage. On top of that, there were four distinct mechanisms identified, which provide affinity for the protease and specifically direct the enzyme to different sites in the P1234 polyprotein. Three factors RNA, the central domain of nsP3 and the N-terminus of nsP2 were demonstrated to be external modulators of the nsP2 protease. Here I suggest that the basal nsP2 protease specificity is inherited from the ancestral papain-like enzyme and employs the recognition of the upstream amino acid signature in the immediate vicinity of the scissile bond. This mechanism is responsible for the efficient processing of the SFV nsP3/nsP4 junction. I propose that the same mechanism is involved in the cleavage of the nsP1/nsP2 junction of both viruses as well. However, in this case it rather serves to position the substrate, whereas the efficiency of the processing is ensured by the capability of nsP2 to cut its own N-terminus in cis. Both types of cleavages are demonstrated here to be inhibited by RNA, which is interpreted as impairing the basal papain-like recognition of the substrate. In contrast, processing of the SIN nsP3/nsP4 junction was found to be activated by RNA and additionally potentiated by the presence of the central region of nsP3 in the protease. The processing of the nsP2/nsP3 junction in both viruses occurred via another mechanism, requiring the exactly processed N-terminus of nsP2 in the protease and insensitive to RNA addition. Therefore, the three processing events in the replicase polyprotein maturation are performed via three distinct mechanisms in each of two studied alphaviruses. Distinct sets of conditions required for each cleavage ensure sequential maturation of P1234 polyprotein: nsP4 is released first, then the nsP1/nsP2 site is cut in cis, and liberation of the nsP2 N-terminus activates the cleavage of the nsP2/nsP3 junction at last. The first processing event occurs differently in SFV and SIN, whereas the subsequent cleavages are found to be similar in the two viruses and therefore, their mechanisms are suggested to be conserved in the genus. The RNA modulation of the alphavirus nonstructural protease activity, discovered here, implies bidirectional functional interplay between the alphavirus RNA metabolism and protease regulation. The nsP2 protease emerges as a signal transmitting moiety, which senses the replication stage and responds with proteolytic cleavages. A detailed hypothetical model of the alphavirus replicase core was inferred from the data obtained in the study. Similar principles in replicase organization and protease functioning are expected to be employed by other RNA viruses.

On the relationship of thermodynamic parameters with the buried surface area in protein-ligand complex formation

Prediction of thermodynamic parameters of protein-protein and antigen-antibody complex formation from high resolution structural parameters has recently received much attention, since an understanding of the contributions of different fundamental processes like hydrophobic interactions, hydrogen bonding, salt bridge formation, solvent reorganization etc. to the overall thermodynamic parameters and their relations with the structural parameters would lead to rational drug design. Using the results of the dissolution of hydrocarbons and other model compounds the changes in heat capacity (DeltaCp), enthalpy (DeltaH) and entropy (DeltaS) have been empirically correlated with the polar and apolar surface areas buried during the process of protein folding/unfolding and protein-ligand complex formation. In this regard, the polar and apolar surfaces removed from the solvent in a protein-ligand complex have been calculated from the experimentally observed values of changes in heat capacity (DeltaCp) and enthalpy (DeltaH) for protein-ligand complexes for which accurate thermodynamic and high resolution structural data are available, and the results have been compared with the x-ray crystallographic observations. Analyses of the available results show poor correlation between the thermodynamic and structural parameters. Probable reasons for this discrepancy are mostly related with the reorganization of water accompanying the reaction which is indeed proven by the analyses of the energetics of the binding of the wheat germ agglutinin to oligosaccharides.

Topological close packed mu phase formation and the determination of diffusion parameters in the Co-Mo system

The study on the formation and growth of topological close packed (TCP) compounds is important to understand the performance of turbine blades in jet engine applications. These deleterious phases grow mainly by diffusion process in the superalloy substrate. Significant volume change was found because of growth of the p phase in Co-Mo system. Growth kinetics of this phase and different diffusion parameters, like interdiffusion, intrinsic and tracer diffusion coefficients are calculated. Further the activation energy, which provides an idea about the mechanism, is determined. Moreover, the interdiffusion coefficient in Co(Mo) solid solution and impurity diffusion coefficient of Mo in Co are determined.

Processing of SeMV polyproteins revisited

Processing of Sesbania mosaic virus (SeMV) polyprotein 2a and 2ab was reanalyzed in the view of the new genome organization of sobemoviruses. Polyprotein 2a when expressed in E coli, from the new cDNA clone, got cleaved at the earlier identified sites E325-T326, E402-T403 and E498-S499 to release protease, VPg, P10 and P8, respectively. Additionally, a novel cleavage was identified within the protease domain at position E132-S133, which was found to be essential for efficient polyprotein processing. Products, corresponding to cleavages identified in E. coli, were also detected in infected Sesbania leaves. Interestingly, though the sites are exactly the same in polyprotein 2ab, it got cleaved between Protease-VPg but not between VPg-RdRp. This indicates to a differential cleavage preference, governed probably by the conformation of 2ab. Also, the studies revealed that, in SeMV, processing is regulated by mode of cleavage and context of the cleavage site.