Reinforcement learning with reference tracking control in continuous state spaces

The contribution described in this paper is an algorithm for learning nonlinear, reference tracking, control policies given no prior knowledge of the dynamical system and limited interaction with the system through the learning process. Concepts from the field of reinforcement learning, Bayesian statistics and classical control have been brought together in the formulation of this algorithm which can be viewed as a form of indirect self tuning regulator. On the task of reference tracking using a simulated inverted pendulum it was shown to yield generally improved performance on the best controller derived from the standard linear quadratic method using only 30 s of total interaction with the system. Finally, the algorithm was shown to work on the simulated double pendulum proving its ability to solve nontrivial control tasks. © 2011 IEEE.

Distributed flow algorithms for scalable similarity visualization

We describe simple yet scalable and distributed algorithms for solving the maximum flow problem and its minimum cost flow variant, motivated by problems of interest in objects similarity visualization. We formulate the fundamental problem as a convex-concave saddle point problem. We then show that this problem can be efficiently solved by a first order method or by exploiting faster quasi-Newton steps. Our proposed approach costs at most O(|ε|) per iteration for a graph with |ε| edges. Further, the number of required iterations can be shown to be independent of number of edges for the first order approximation method. We present experimental results in two applications: mosaic generation and color similarity based image layouting. © 2010 IEEE.

Transmission properties of electron in quantum rings

We investigated the transmission probability of a single electron transmission through a quantum ring device based on the single-band effective mass approximation method and transfer matrix theory. The time-dependent Schrodinger equation is applied on a Gaussian wave packet passing through the quantum ring system. The electron tunneling resonance peaks split when the electron transmits through a double quantum ring. The splitting energy increases as the distance between the two quantum rings decreases. We studied the tunneling time through the single electron transmission quantum ring from the temporal evolution of the Gaussian wave packet. The electron probability density is sensitive to the thickness of the barrier between the two quantum rings. (C) 2008 American Institute of Physics.

Mode quality factor based on far-field emission for square resonators

The quality factors of modes in square resonators are calculated based on the far-field emission of the analytical field distribution. The obtained quality factors are in reasonable agreement with those calculated by the finite-difference time-domain (FDTD) technique and Pade approximation method. The emission power in the square diagonal directions for whispering-gallery-like modes in square resonators is zero due to the interference cancellation caused by the odd field distributions relative to the diagonal mirror planes, so they have larger quality factors than the modes with even field distribution.

Comparison of free spectral range and quality factor for two-dimensional square and circular microcavities

Free spectral range of whispering-gallery (WG)-like modes in a two-dimensional (2D) square microcavity is found to be twice that in a 2D circular microcavity. The quality factor of the WG-like mode with the low mode number in a 2D square microcavity, calculated by the finite-difference time-domain (FDTD) technique and the Pade approximation method, is found to exceed that of the WG mode in 2D circular microcavity with the same cavity dimension and close mode wavelength.

Modes in square resonators

Modes in square resonators are analyzed and classified according to the irreducible representations of the point group C-4v. If the mode numbers p and q that denote the number of wave nodes in the directions of two orthogonal square sides are unequal and have the same even-odd characteristics, the corresponding double modes are accidentally degenerate and can be combined into two new distributions with definite parities relative to the square diagonal mirror planes. The distributions with odd parities belong to the whispering-gallery-like modes in square resonators. The mode frequencies and quality factors are also calculated by the finite-difference time-domain technique and Pade approximation method. The numerically calculated mode frequencies agree with the theoretical ones very well and the whispering-gallery-like modes have quality factors much higher than other modes, including their accidentally degenerate counterparts in square resonators.

Optical characteristics of DBR with inhomogeneous graded interfaces

Optical properties of Al0.9Ga0.1As/Al gamma Ga1-gamma As/GaAs/Al chi Ga1-chi As DBR with inhomogeneous graded interfaces has been investigated by using characteristic matrix method. The refractive index model and the analytic characteristic matrix of graded interfaces are obtained. The reflectance spectrum and the reflective phase shift are calculated for GaAs/Al-0.9 Ga-0.1 As DBR and graded interfaces DBR by using characteristic matrix method. The effect of graded interfaces on the optical properties of DBR is discussed. The result shows an extra graded phase matching layer must he added in front of the graded interfaces DBR to fulfil the conditions of phase matching at central wavelength. The accurate thickness of phase matching layer is calculated by optical thickness approximation method.

Whispering-gallery-likel modes in square resonators

The mode frequencies and field distributions of whispering-gallery (WG)-like modes of square resonators are obtained analytically, which agree very well with the numerical results calculated by the FDTD technique and Pade approximation method. In the analysis, a perfect electric wall for the transverse magnetic mode or perfect magnetic wall for the transverse electric mode is assumed at the diagonals of the square resonators, which not only provides the transverse mode confinement, but also requires the longitudinal mode number to be an even integer. The WG-like modes of square resonators are nondegenerate modes with high-quality factors, which make them suitable for fabricating single-mode low-threshold semiconductor microcavity lasers.

Thermal annealing behaviour of Ni/Au on n-GaN Schottky contacts

The Schottky behaviour of Ni/Au contact on n-GaN was investigated under various annealing conditions by current-voltage (I-V) measurements. A non-linear fitting method was used to extract the contact parameters from the I-V characteristic curves. Experimental results indicate that high quality Schottky contact with a barrier height and ideality factor of 0.86 +/- 0.02 eV and 1.19 +/- 0.02 eV, respectively, can be obtained under 5 min annealing at 600degreesC in N-2 ambience.

Q的线性密码分析

对NESSIE公布的17个分组密码之一的Q进行了线性密码分析，攻击所需的数据复杂不大于2^118(相应的成功率为0．785），空间复杂度不大于2^33+2^19+2^18+2^12+2^11+2^10。此结果显示Q对线性密码分析是不免疫的。

AC分组密码的差分和线性密码分析

讨论AC分组密码对差分和线性密码分析的安全性，通过估计3轮AC的差分活动盒子的个数下界和12轮AC的线性活动盒子的个数下界，本文得到AC的12轮差分特征概率不大于2－128和线性逼近优势不大于2－67，因此，AC分组密码对差分和线性密码分析是安全的。

Free radial oscillation of a sphere in relativistic elasticity theory

The spherically symmetric free radial oscillation in the first post-Newtonian approximation for a homogeneous and isotropic elastic sphere with a constant density is studied. Based on the Xu, Wu, and Soffel formalism, the relation of the oscillation frequency of the sphere with the radius, mass density, and elastic constants of the sphere is derived by using the successive approximation method.

WANNIER QUANTIZATION OF A SUPERLATTICE SUBBAND UNDER AN ELECTRIC-FIELD

Wavefunctions of electronic Wannier-Stark states in a superlattice are calculated with a finite Kronig-Penney model. Overlap integrals between electron and heavy-hole wavefunctions centred in the same well layer, and in first- and second-neighbour wells are calculated as functions of the applied field. The results show good agreement with experimental results on photoluminescence. The problem is also treated by a one-band approximation method, which gives a closed expression for the wavefunction of the Wannier-Stark states; this is compared with the results of accurate calculations with the Kronig-Penney model.

Theoretical foundation of Zisman's empirical equation for wetting of liquids on solid surfaces

Theories of wetting of liquids on solid surfaces under the condition that van der Waals force is dominant are briefly reviewed. We show theoretically that Zisman's empirical equation for wetting of liquids on solid surfaces is a linear approximation of the Young-van der Waals equation in the wetting region, and we express the two parameters in Zisman's empirical equation in terms of the dielectric polarizabilities of the solid and liquids. The materials contained in this paper are suitable for physics teaching of wetting phenomena for undergraduate, graduate, general physicist, etc.

A proposal design of a multi-hit two-dimensional position-sensitive energy spectrum detector

A new non-linear comparison method of charge-division readout scheme is conceived and the first design of a multi-hit two-dimensional position-sensitive energy spectrum Si(Au) surface barrier detector with a continuous sensitive area is proposed.