Learning Nonlinear Visual Processing from Natural Images

The paradigm of computational vision hypothesizes that any visual function -- such as the recognition of your grandparent -- can be replicated by computational processing of the visual input. What are these computations that the brain performs? What should or could they be? Working on the latter question, this dissertation takes the statistical approach, where the suitable computations are attempted to be learned from the natural visual data itself. In particular, we empirically study the computational processing that emerges from the statistical properties of the visual world and the constraints and objectives specified for the learning process. This thesis consists of an introduction and 7 peer-reviewed publications, where the purpose of the introduction is to illustrate the area of study to a reader who is not familiar with computational vision research. In the scope of the introduction, we will briefly overview the primary challenges to visual processing, as well as recall some of the current opinions on visual processing in the early visual systems of animals. Next, we describe the methodology we have used in our research, and discuss the presented results. We have included some additional remarks, speculations and conclusions to this discussion that were not featured in the original publications. We present the following results in the publications of this thesis. First, we empirically demonstrate that luminance and contrast are strongly dependent in natural images, contradicting previous theories suggesting that luminance and contrast were processed separately in natural systems due to their independence in the visual data. Second, we show that simple cell -like receptive fields of the primary visual cortex can be learned in the nonlinear contrast domain by maximization of independence. Further, we provide first-time reports of the emergence of conjunctive (corner-detecting) and subtractive (opponent orientation) processing due to nonlinear projection pursuit with simple objective functions related to sparseness and response energy optimization. Then, we show that attempting to extract independent components of nonlinear histogram statistics of a biologically plausible representation leads to projection directions that appear to differentiate between visual contexts. Such processing might be applicable for priming, \ie the selection and tuning of later visual processing. We continue by showing that a different kind of thresholded low-frequency priming can be learned and used to make object detection faster with little loss in accuracy. Finally, we show that in a computational object detection setting, nonlinearly gain-controlled visual features of medium complexity can be acquired sequentially as images are encountered and discarded. We present two online algorithms to perform this feature selection, and propose the idea that for artificial systems, some processing mechanisms could be selectable from the environment without optimizing the mechanisms themselves. In summary, this thesis explores learning visual processing on several levels. The learning can be understood as interplay of input data, model structures, learning objectives, and estimation algorithms. The presented work adds to the growing body of evidence showing that statistical methods can be used to acquire intuitively meaningful visual processing mechanisms. The work also presents some predictions and ideas regarding biological visual processing.

Insights into students' conceptual understanding using textual analysis: A case study in signal processing

Concept inventory tests are one method to evaluate conceptual understanding and identify possible misconceptions. The multiple-choice question format, offering a choice between a correct selection and common misconceptions, can provide an assessment of students' conceptual understanding in various dimensions. Misconceptions of some engineering concepts exist due to a lack of mental frameworks, or schemas, for these types of concepts or conceptual areas. This study incorporated an open textual response component in a multiple-choice concept inventory test to capture written explanations of students' selections. The study's goal was to identify, through text analysis of student responses, the types and categorizations of concepts in these explanations that had not been uncovered by the distractor selections. The analysis of the textual explanations of a subset of the discrete-time signals and systems concept inventory questions revealed that students have difficulty conceptually explaining several dimensions of signal processing. This contributed to their inability to provide a clear explanation of the underlying concepts, such as mathematical concepts. The methods used in this study evaluate students' understanding of signals and systems concepts through their ability to express understanding in written text. This may present a bias for students with strong written communication skills. This study presents a framework for extracting and identifying the types of concepts students use to express their reasoning when answering conceptual questions.

A Generalized Approach to Multiresolution Complex SAR Signal Processing

Multiresolution synthetic aperture radar (SAR) image formation has been proven to be beneficial in a variety of applications such as improved imaging and target detection as well as speckle reduction. SAR signal processing traditionally carried out in the Fourier domain has inherent limitations in the context of image formation at hierarchical scales. We present a generalized approach to the formation of multiresolution SAR images using biorthogonal shift-invariant discrete wavelet transform (SIDWT) in both range and azimuth directions. Particularly in azimuth, the inherent subband decomposition property of wavelet packet transform is introduced to produce multiscale complex matched filtering without involving any approximations. This generalized approach also includes the formulation of multilook processing within the discrete wavelet transform (DWT) paradigm. The efficiency of the algorithm in parallel form of execution to generate hierarchical scale SAR images is shown. Analytical results and sample imagery of diffuse backscatter are presented to validate the method.

Mechanisms for alphavirus nonstructural polyprotein processing

Replication and transcription of the RNA genome of alphaviruses relies on a set of virus-encoded nonstructural proteins. They are synthesized as a long polyprotein precursor, P1234, which is cleaved at three processing sites to yield nonstructural proteins nsP1, nsP2, nsP3 and nsP4. All the four proteins function as constitutive components of the membrane-associated viral replicase. Proteolytic processing of P1234 polyprotein is precisely orchestrated and coordinates the replicase assembly and maturation. The specificity of the replicase is also controlled by proteolytic cleavages. The early replicase is composed of P123 polyprotein intermediate and nsP4. It copies the positive sense RNA genome to complementary minus-strand. Production of new plus-strands requires complete processing of the replicase. The papain-like protease residing in nsP2 is responsible for all three cleavages in P1234. This study addressed the mechanisms of proteolytic processing of the replicase polyprotein in two alphaviruses Semliki Forest virus (SFV) and Sindbis virus (SIN) representing different branches of the genus. The survey highlighted the functional relation of the alphavirus nsP2 protease to the papain-like enzymes. A new structural motif the Cys-His catalytic dyad accompanied with an aromatic residue following the catalytic His was described for nsP2 and a subset of other thiol proteases. Such an architecture of the catalytic center was named the glycine specificity motif since it was implicated in recognition of a specific Gly residue in the substrate. In particular, the presence of the motif in nsP2 makes the appearance of this amino acid at the second position upstream of the scissile bond a necessary condition for the cleavage. On top of that, there were four distinct mechanisms identified, which provide affinity for the protease and specifically direct the enzyme to different sites in the P1234 polyprotein. Three factors RNA, the central domain of nsP3 and the N-terminus of nsP2 were demonstrated to be external modulators of the nsP2 protease. Here I suggest that the basal nsP2 protease specificity is inherited from the ancestral papain-like enzyme and employs the recognition of the upstream amino acid signature in the immediate vicinity of the scissile bond. This mechanism is responsible for the efficient processing of the SFV nsP3/nsP4 junction. I propose that the same mechanism is involved in the cleavage of the nsP1/nsP2 junction of both viruses as well. However, in this case it rather serves to position the substrate, whereas the efficiency of the processing is ensured by the capability of nsP2 to cut its own N-terminus in cis. Both types of cleavages are demonstrated here to be inhibited by RNA, which is interpreted as impairing the basal papain-like recognition of the substrate. In contrast, processing of the SIN nsP3/nsP4 junction was found to be activated by RNA and additionally potentiated by the presence of the central region of nsP3 in the protease. The processing of the nsP2/nsP3 junction in both viruses occurred via another mechanism, requiring the exactly processed N-terminus of nsP2 in the protease and insensitive to RNA addition. Therefore, the three processing events in the replicase polyprotein maturation are performed via three distinct mechanisms in each of two studied alphaviruses. Distinct sets of conditions required for each cleavage ensure sequential maturation of P1234 polyprotein: nsP4 is released first, then the nsP1/nsP2 site is cut in cis, and liberation of the nsP2 N-terminus activates the cleavage of the nsP2/nsP3 junction at last. The first processing event occurs differently in SFV and SIN, whereas the subsequent cleavages are found to be similar in the two viruses and therefore, their mechanisms are suggested to be conserved in the genus. The RNA modulation of the alphavirus nonstructural protease activity, discovered here, implies bidirectional functional interplay between the alphavirus RNA metabolism and protease regulation. The nsP2 protease emerges as a signal transmitting moiety, which senses the replication stage and responds with proteolytic cleavages. A detailed hypothetical model of the alphavirus replicase core was inferred from the data obtained in the study. Similar principles in replicase organization and protease functioning are expected to be employed by other RNA viruses.

Facile synthesis, ex-vivo and in vitro screening of 3-sulfonamide derivative of 5-(4-chlorophenyl)-1-(2,4-dichlorophenyl)-4-methyl-1H-pyrazole-3-carboxylic acid piperidin-1-ylamide (SR141716) a potent CB1 receptor antagonist

Facile synthesis of biaryl pyrazole sulfonamide derivative of 5-(4-chlorophenyl)-1-(2,4-dichlorophenyl)-4-methyl-1H-pyrazole-3-carboxylic acid piperidin-1-ylamide (SR141716, 1) and an investigation of the effect of replacement of the –CO group in the compound 1 by the –SO2 group in the aminopiperidine region is reported. Primary ex-vivo pharmacological testing and in vitro screening of sulfonamide derivative 2 showed the loss of CB1 receptor antagonism.

In situ pump probe optical absorption studies on Sb/As2S3 nanomultilayered film

We report the in situ optical transmission change in the complete visible region of the electromagnetic spectrum to asses the kinetics of photo induced interdiffusion in Sb/As2S3 nanomultilayered film. The interdiffusion of Sb into As2S3 matrix results in the formation of Sb-As2S3 ternary solid solutions which is explained by the change in optical band gap, absorption coefficients and Tauc parameter (B-1/2) with evolution of time. The wavelength dependence of the time constants provides a better description of photo induced effects. The time evolution of the absorption coefficients and optical band gap are significantly faster in this process. (C) 2009 Elsevier B.V. All rights reserved.

In situ cryocrystallization of low melting chloro and bromo substituted anilines

In situ cryocrystallographic Studies of chloro and bromo substituted anilines have been performed to evaluate the role of halogen...halogen interactions and the subsequent formation of supramolecular assemblies in the solid state. Ortho Cl/Br substituted anilines are isostructural and belong to the trigonal P3(1) space group. Halogen...halogen intermolecular contacts along with stronger N-H center dot center dot center dot N hydrogen bonds generate helical motifs along the crystallographic c-axis. (C) 2009 Elsevier B.V. All rights reserved.

In situ synthesis and characterization of polyaniline-CaCu3Ti4O12 nanocrystal composites

High dielectric constant (ca. 2.4 x 10(6) at 1 kHz) nanocomposite of polyaniline (PANI)/CaCu3Ti4O12 (CCTO) was synthesized using a simple procedure involving in situ polymerization of aniline in dil. HCl. The PANI and the composite were subjected to X-ray diffraction, Fourier transform infrared, thermo gravimetric, scanning electron microscopy and transmission electron microscopy analyses. The presence of the nanocrystallites of CCTO embedded in the nanofibers of PANI matrix was established by TEM. Frequency dependent characteristics of the dielectric constant. dielectric loss and AC conductivity were studied for the PANI and the composites. The dielectric constant increased as the CCTO content increased in PANI but decreased with increasing frequency (100 Hz-1 MHz) of measurement. The dielectric loss was two times less than the value obtained for pure PANI around 100 Hz. The AC conductivity increased slightly up to 2 kHz as the CCTO content increased in the PANI which was attributed to the polarization of the charge carriers.

Elliptical summary randomisation for sensor-based human activity recognition

Many conventional statistical machine learning al- gorithms generalise poorly if distribution bias ex- ists in the datasets. For example, distribution bias arises in the context of domain generalisation, where knowledge acquired from multiple source domains need to be used in a previously unseen target domains. We propose Elliptical Summary Randomisation (ESRand), an efficient domain generalisation approach that comprises of a randomised kernel and elliptical data summarisation. ESRand learns a domain interdependent projection to a la- tent subspace that minimises the existing biases to the data while maintaining the functional relationship between domains. In the latent subspace, ellipsoidal summaries replace the samples to enhance the generalisation by further removing bias and noise in the data. Moreover, the summarisation enables large-scale data processing by significantly reducing the size of the data. Through comprehensive analysis, we show that our subspace-based approach outperforms state-of-the-art results on several activity recognition benchmark datasets, while keeping the computational complexity significantly low.

Processing of SeMV polyproteins revisited

Processing of Sesbania mosaic virus (SeMV) polyprotein 2a and 2ab was reanalyzed in the view of the new genome organization of sobemoviruses. Polyprotein 2a when expressed in E coli, from the new cDNA clone, got cleaved at the earlier identified sites E325-T326, E402-T403 and E498-S499 to release protease, VPg, P10 and P8, respectively. Additionally, a novel cleavage was identified within the protease domain at position E132-S133, which was found to be essential for efficient polyprotein processing. Products, corresponding to cleavages identified in E. coli, were also detected in infected Sesbania leaves. Interestingly, though the sites are exactly the same in polyprotein 2ab, it got cleaved between Protease-VPg but not between VPg-RdRp. This indicates to a differential cleavage preference, governed probably by the conformation of 2ab. Also, the studies revealed that, in SeMV, processing is regulated by mode of cleavage and context of the cleavage site.

Induced higher-order aberrations after laser in situ keratomileusis (LASIK) performed with wavefront-guided IntraLase femtosecond laser in moderate to high astigmatism

Background Wavefront-guided Laser-assisted in situ keratomileusis (LASIK) is a widespread and effective surgical treatment for myopia and astigmatic correction but whether it induces higher-order aberrations remains controversial. The study was designed to evaluate the changes in higher-order aberrations after wavefront-guided ablation with IntraLase femtosecond laser in moderate to high astigmatism. Methods Twenty-three eyes of 15 patients with moderate to high astigmatism (mean cylinder, −3.22 ± 0.59 dioptres) aged between 19 and 35 years (mean age, 25.6 ± 4.9 years) were included in this prospective study. Subjects with cylinder ≥ 1.5 and ≤2.75 D were classified as moderate astigmatism while high astigmatism was ≥3.00 D. All patients underwent a femtosecond laser–enabled (150-kHz IntraLase iFS; Abbott Medical Optics Inc) wavefront-guided ablation. Uncorrected (UDVA), corrected (CDVA) distance visual acuity in logMAR, keratometry, central corneal thickness (CCT) and higher-order aberrations (HOAs) over a 6 mm pupil, were assessed before and 6 months, postoperatively. The relationship between postoperative change in HOA and preoperative mean spherical equivalent refraction, mean astigmatism, and postoperative CCT were tested. Results At the last follow-up, the mean UDVA was increased (P < 0.0001) but CDVA remained unchanged (P = 0.48) and no eyes lost ≥2 lines of CDVA. Mean spherical equivalent refraction was reduced (P < 0.0001) and was within ±0.50 D range in 61 % of eyes. The average corneal curvature was flatter by 4 D and CCT was reduced by 83 μm (P < 0.0001, for all), postoperatively. Coma aberrations remained unchanged (P = 0.07) while the change in trefoil (P = 0.047) postoperatively, was not clinically significant. The 4th order HOAs (spherical aberration and secondary astigmatism) and the HOA root mean square (RMS) increased from −0.18 ± 0.07 μm, 0.04 ± 0.03 μm and 0.47 ± 0.11 μm, preoperatively, to 0.33 ± 0.19 μm (P = 0.004), 0.21 ± 0.09 μm (P < 0.0001) and 0.77 ± 0.27 μm (P < 0.0001), six months postoperatively. The change in spherical aberration after the procedure increased with an increase in the degree of preoperative myopia. Conclusions Wavefront-guided IntraLASIK offers a safe and effective option for vision and visual function improvement in astigmatism. Although, reduction of HOA is possible in a few eyes, spherical-like aberrations are increased in majority of the treated eyes.

A shallow water AUV for benthic and water column observations

Autonomous underwater vehicles (AUVs) are becoming commonplace in the study of inshore coastal marine habitats. Combined with shipboard systems, scientists are able to make in-situ measurements of water column and benthic properties. In CSIRO, autonomous gliders are used to collect water column data, while surface vessels are used to collect bathymetry information through the use of swath mapping, bottom grabs, and towed video systems. Although these methods have provided good data coverage for coastal and deep waters beyond 50m, there has been an increasing need for autonomous in-situ sampling in waters less than 50m deep. In addition, the collection of benthic and water column data has been conducted separately, requiring extensive post-processing to combine data streams. As such, a new AUV was developed for in-situ observations of both benthic habitat and water column properties in shallow waters. This paper provides an overview of the Starbug X AUV system, its operational characteristics including vision-based navigation and oceanographic sensor integration.