New algorithms of the Q-learning type

We propose two algorithms for Q-learning that use the two-timescale stochastic approximation methodology. The first of these updates Q-values of all feasible state–action pairs at each instant while the second updates Q-values of states with actions chosen according to the ‘current’ randomized policy updates. A proof of convergence of the algorithms is shown. Finally, numerical experiments using the proposed algorithms on an application of routing in communication networks are presented on a few different settings.

Domestic violence on #qanda: The “Man” question in live Twitter discussion on the Australian Broadcasting Corporation's Q&A

Domestic violence is currently undergoing a period of heightened visibility in Australia. This article uses social media to analyze public discussions about this violence with respect to a specific theoretical frame, which Adrian Howe has called the “Man” question: where and how are men visible or invisible in narratives about their violence against women? The article presents a qualitative study of the Twitter conversation surrounding a special episode of the Australian Broadcasting Corporation's television program Q&A, themed around family violence, which aired in February 2015. We found that the place of men in this conversation was contested. Some tweets privileged men's voices and concerns, as did the organization and production of the program. However, feminist voices were also highly visible via presenting facts, legitimating survivor voices, and recuperating anti-feminist memes to challenge hegemonic patriarchal discourses on men's violence against women. La violence conjugale connait actuellement une visibilité accrue en Australie. Les auteures du présent article utilisent les réseaux sociaux pour analyser les débats publics sur cette violence selon un cadre théorique précis, qu'Adrian Howe a appelé la question de « l'homme » : où et comment les hommes sont-ils visibles ou invisibles dans les récits de leur violence envers les femmes? L'article présente une étude qualitative d'une conversation sur Twitter au sujet d'un épisode axé sur la famille diffusé en février 2015 dans le cadre de l'émission Q & A, à la télévision nationale d'Australie. Nous avons remarqué que dans cette conversation la place des hommes était remise en question. Certains tweets privilégiaient les voix et les craintes des hommes, comme l'ont fait les organisateurs et les producteurs de l'émission. Cependant, il y avait une forte présence de voix féministes dans la présentation des faits, légitimant le point de vue des survivantes et relevant des éléments culturels antiféministes afin de défier les discours hégémoniques et patriarcaux sur la violence des hommes envers les femmes.

Biosynthesis of coenzyme Q in microorganisms

Incorporation of mevalonate-2-C14, acetate-1-C14, and formate-C14 into the lipids of microorganisms was studied. In the case of four bacteria tested—Agrobacterium tumefaciens, Azotobacter vinelandii, Escherichia coli, and a Pseudomonas species—the various homologues of coenzyme Q present were not labeled with any of the tracers used, although significant amounts of radioactivity were present in the lipids. Both acetate and mevalonate were incorporated into coenzyme Q and sterol of the moulds, Aspergillus niger, Neurospora crassa, Penicillium chrysogenum, and Gibberella fujickuroi, and a yeast, Torulopsis utilis. Mevalonate was incorporated into the side chain but not the ring, whereas acetate was incorporated into both. It appears that the mevalonate pathway for the synthesis of coenzyme Q is operative only in those organisms which also contain other isoprene compounds such as sterol and carotene.

Intracellular distribution of coenzyme Q in rat liver

Coenzyme Q was found to be distributed in rat liver cell fractions. Mitochondria accounted for only 40–60% of the total. The presence of coenzyme Q in nuclei, isolated by several methods, could always be correlated with the presence of oxidative enzymes. It has been established that coenzyme Q is a constituent of microsomes. Administered coenzyme Q10-C14 was preferentially taken up by mitochondrial and microsomal fractions. Exogenous coenzyme Q appears to be rapidly metabolized.

Distribution of coenzyme Q in rat liver cell fractions

COENZYME Q (CoQ), which is widely distributed in animal, plant and microbial sources, has been implicated in electron transport1 and generally assumed to be associated with mitochondria. However, it has also been found in non-mitochondrial fractions of green leaves, although it appears to be concentrated in mitochondria2. A similar distribution has now been demonstrated in rat liver cell fractions.

A Wavelet based Teager Energy Operator for Spike Detection in Microelectrode Array Recordings

Spike detection in neural recordings is the initial step in the creation of brain machine interfaces. The Teager energy operator (TEO) treats a spike as an increase in the `local' energy and detects this increase. The performance of TEO in detecting action potential spikes suffers due to its sensitivity to the frequency of spikes in the presence of noise which is present in microelectrode array (MEA) recordings. The multiresolution TEO (mTEO) method overcomes this shortcoming of the TEO by tuning the parameter k to an optimal value m so as to match to frequency of the spike. In this paper, we present an algorithm for the mTEO using the multiresolution structure of wavelets along with inbuilt lowpass filtering of the subband signals. The algorithm is efficient and can be implemented for real-time processing of neural signals for spike detection. The performance of the algorithm is tested on a simulated neural signal with 10 spike templates obtained from [14]. The background noise is modeled as a colored Gaussian random process. Using the noise standard deviation and autocorrelation functions obtained from recorded data, background noise was simulated by an autoregressive (AR(5)) filter. The simulations show a spike detection accuracy of 90%and above with less than 5% false positives at an SNR of 2.35 dB as compared to 80% accuracy and 10% false positives reported [6] on simulated neural signals.

Broad-Band Coupling of High-Q Resonant Loads

Considering the method of broad-band coupling a series resonant RLC load to a resistive source using a uniform quarter-wave transmission-line inverter, it is shown that the 3-dB bandwidth of the network insertion loss reckoned with respect to a 0-dB loss attains a maximum for a particular value of the center frequency insertion loss in the range 0-3 dB. The center frequency Ioss and the corresponding value of the maximum 3-dB bandwidth are calculated for various loads and the results graphically presented.

Time Dependent Operator-split and Unsplit Schemes for One Dimensional Premixed Flames

This paper is concerned with a study of an operator split scheme and unsplit scheme for the computation of adiabatic freely propagating one-dimensional premixed flames. The study uses unsteady method for both split and unsplit schemes employing implicit chemistry and explicit diffusion, a combination which is stable and convergent. Solution scheme is not sensitive to the initial starting estimate and provides steady state even with straight line profiles (far from steady state) in small number of time steps. Two systems H2-Air and H2-NO (involving complex nitrogen chemistry) are considered in presentinvestigation. Careful comparison shows that the operator split approach is slightly superior than the unsplit when chemistry becomes complex. Comparison of computational times with those of existing steady and unsteady methods seems to suggest that the method employing implicit-explicit algorithm is very efficient and robust.

Q-band beam waveguide

A report of the design, development ana periom~ance characteristics of a Q-band (8 nim) confoal. mned, aielectric lens beam waveguide is presented.

Q-Band beam wave-guide

Consideration is given to a 25-foot long Q-band (8 mm) confocal, zoned dielectric lens beam waveguide. Numerical expressions for the axial and radial fields are presented. The experimental set-up consisted of uniformly spaced zoned dielectric lenses, a transmitting horn and a receiving horn. It was found that: (1) the wave beam is reiterated when confocal, zoned dielectric lenses act as phase transformers in place of smooth surfaced transformers in beam waveguides; (2) the axial field is oscillatory near the source and the oscillation persists for about 25 cm from the source; (3) the oscillation disappears after one lens is used; (4) higher order modes with higher attenuation rates die out faster than fundamental modes; (5) phase transformers do not alter beam modes; (6) without any lens the beam cross-section broadens significantly in the Z-direction; (7) with one lens the beam exhibits the reiteration phenomenon; and (8) inserting a second lens on the axial and cross-sectional field distribution shows further the reiteration principle.