Average control of Markov decision processes with Feller transition probabilities and general action spaces

This paper studies the average control problem of discrete-time Markov Decision Processes (MDPs for short) with general state space, Feller transition probabilities, and possibly non-compact control constraint sets A(x). Two hypotheses are considered: either the cost function c is strictly unbounded or the multifunctions A(r)(x) = {a is an element of A(x) : c(x, a) <= r} are upper-semicontinuous and compact-valued for each real r. For these two cases we provide new results for the existence of a solution to the average-cost optimality equality and inequality using the vanishing discount approach. We also study the convergence of the policy iteration approach under these conditions. It should be pointed out that we do not make any assumptions regarding the convergence and the continuity of the limit function generated by the sequence of relative difference of the alpha-discounted value functions and the Poisson equations as often encountered in the literature. (C) 2012 Elsevier Inc. All rights reserved.

Combined pre- and subtemporal transtentorial approach for epidermoid cysts of the cerebellopontine angle

Objective Epidermoid cysts of the cerebellopontine angle (CPA) can be a surgical challenge for the pediatric neurosurgeon. Ideally, total removal must be achieved; however, occasional adhesions of these tumors to vital neurovascular structures and extension far beyond the midline may preclude their total removal. The aims of this article are to present an alternative surgical approach to these lesions and to provide the rationale for this technique. Material and methods A 16-year-old boy was admitted to our pediatric neurosurgery department with a 1-year history of nonspecific headaches. His neurological examination showed right-sided dysmetria and gait ataxia. Magnetic resonance scans showed a space-occupying lesion on the right CPA with low intensity on T-1-weighted images and high intensity on T-2-weighted images. Results Craniotomy for tumor excision via pre- and subtemporal transtentorial approach was performed disclosing a 3.5 x 3 x 2.8-cm(3) well-encapsulated tumor, which was confirmed to be an epidermoid cyst. The postoperative course was uneventful. Conclusions A combined pre- and subtemporal approach utilizes a wide opening of the tentorium and the option of supratentorial retraction of the cerebellum to provide an excellent angle of approach to CPA lesions involving the anterolateral aspect of the brain stem in children.

Parameter recovery for a skew-normal IRT model under a Bayesian approach: hierarchical framework, prior and kernel sensitivity and sample size

Item response theory (IRT) comprises a set of statistical models which are useful in many fields, especially when there is an interest in studying latent variables (or latent traits). Usually such latent traits are assumed to be random variables and a convenient distribution is assigned to them. A very common choice for such a distribution has been the standard normal. Recently, Azevedo et al. [Bayesian inference for a skew-normal IRT model under the centred parameterization, Comput. Stat. Data Anal. 55 (2011), pp. 353-365] proposed a skew-normal distribution under the centred parameterization (SNCP) as had been studied in [R. B. Arellano-Valle and A. Azzalini, The centred parametrization for the multivariate skew-normal distribution, J. Multivariate Anal. 99(7) (2008), pp. 1362-1382], to model the latent trait distribution. This approach allows one to represent any asymmetric behaviour concerning the latent trait distribution. Also, they developed a Metropolis-Hastings within the Gibbs sampling (MHWGS) algorithm based on the density of the SNCP. They showed that the algorithm recovers all parameters properly. Their results indicated that, in the presence of asymmetry, the proposed model and the estimation algorithm perform better than the usual model and estimation methods. Our main goal in this paper is to propose another type of MHWGS algorithm based on a stochastic representation (hierarchical structure) of the SNCP studied in [N. Henze, A probabilistic representation of the skew-normal distribution, Scand. J. Statist. 13 (1986), pp. 271-275]. Our algorithm has only one Metropolis-Hastings step, in opposition to the algorithm developed by Azevedo et al., which has two such steps. This not only makes the implementation easier but also reduces the number of proposal densities to be used, which can be a problem in the implementation of MHWGS algorithms, as can be seen in [R.J. Patz and B.W. Junker, A straightforward approach to Markov Chain Monte Carlo methods for item response models, J. Educ. Behav. Stat. 24(2) (1999), pp. 146-178; R. J. Patz and B. W. Junker, The applications and extensions of MCMC in IRT: Multiple item types, missing data, and rated responses, J. Educ. Behav. Stat. 24(4) (1999), pp. 342-366; A. Gelman, G.O. Roberts, and W.R. Gilks, Efficient Metropolis jumping rules, Bayesian Stat. 5 (1996), pp. 599-607]. Moreover, we consider a modified beta prior (which generalizes the one considered in [3]) and a Jeffreys prior for the asymmetry parameter. Furthermore, we study the sensitivity of such priors as well as the use of different kernel densities for this parameter. Finally, we assess the impact of the number of examinees, number of items and the asymmetry level on the parameter recovery. Results of the simulation study indicated that our approach performed equally as well as that in [3], in terms of parameter recovery, mainly using the Jeffreys prior. Also, they indicated that the asymmetry level has the highest impact on parameter recovery, even though it is relatively small. A real data analysis is considered jointly with the development of model fitting assessment tools. The results are compared with the ones obtained by Azevedo et al. The results indicate that using the hierarchical approach allows us to implement MCMC algorithms more easily, it facilitates diagnosis of the convergence and also it can be very useful to fit more complex skew IRT models.

ANATOMICAL AND FUNCTIONAL STUDY OF THE MEDIAL COLLATERAL LIGAMENT COMPLEX OF THE ELBOW

Objective: To carry out an anatomical study of the medial collateral ligament, an important elbow stabilizer in different degrees of elbow flexion-extension. Methods: Forty elbows were dissected in order to analyze the functional behavior of the anterior, posterior and transverse ligament bands during valgus stress maneuvers of the elbow in different degrees of flexion and extension. Two groups were determined; in the group GPA the posterior band of the ligament was sectioned initially, then the articular capsule and finally the anterior band; in group GAP this order was reversed. Results: Instability was observed in GPA only in the third stage, when there was a greater mean elbow's opening during the flexion (between 50 degrees and 70 degrees); in GAP the instability was present since the first stage; the degrees of flexion with greater instability were the same as in group GPA. Conclusion: The anterior band of the medial collateral ligament of the elbow is the most important stabilizer of the elbow valgus instability, and its principal action occurs between 50 degrees and 70 degrees of elbow flexion. Level of Evidence III, Diagnostic Studies Investigating a diagnostic test.

Amazon Rainforest Exchange of Carbon and Subcanopy Air Flow: Manaus LBA Site-A Complex Terrain Condition

On the moderately complex terrain covered by dense tropical Amazon Rainforest (Reserva Biologica do Cuieiras-ZF2-02 degrees 36'17.1 '' S, 60 degrees 12'24.4 '' W), subcanopy horizontal and vertical gradients of the air temperature, CO2 concentration and wind field were measured for the dry and wet periods in 2006. We tested the hypothesis that horizontal drainage flow over this study area is significant and can affect the interpretation of the high carbon uptake rates reported by previous works at this site. A similar experimental design as the one by Tota et al. (2008) was used with a network of wind, air temperature, and CO2 sensors above and below the forest canopy. A persistent and systematic subcanopy nighttime upslope (positive buoyancy) and daytime downslope (negative buoyancy) flow pattern on a moderately inclined slope (12%) was observed. The microcirculations observed above the canopy (38 m) over the sloping area during nighttime presents a downward motion indicating vertical convergence and correspondent horizontal divergence toward the valley area. During the daytime an inverse pattern was observed. The microcirculations above the canopy were driven mainly by buoyancy balancing the pressure gradient forces. In the subcanopy space the microcirculations were also driven by the same physical mechanisms but probably with the stress forcing contribution. The results also indicated that the horizontal and vertical scalar gradients (e. g., CO2) were modulated by these micro-circulations above and below the canopy, suggesting that estimates of advection using previous experimental approaches are not appropriate due to the tridimensional nature of the vertical and horizontal transport locally. This work also indicates that carbon budget from tower-based measurement is not enough to close the system, and one needs to include horizontal and vertical advection transport of CO2 into those estimates.

A regional multirnodulus algorithm for blind equalization of QAM signals: Introduction and steady-state analysis

It is well known that constant-modulus-based algorithms present a large mean-square error for high-order quadrature amplitude modulation (QAM) signals, which may damage the switching to decision-directed-based algorithms. In this paper, we introduce a regional multimodulus algorithm for blind equalization of QAM signals that performs similar to the supervised normalized least-mean-squares (NLMS) algorithm, independently of the QAM order. We find a theoretical relation between the coefficient vector of the proposed algorithm and the Wiener solution and also provide theoretical models for the steady-state excess mean-square error in a nonstationary environment. The proposed algorithm in conjunction with strategies to speed up its convergence and to avoid divergence can bypass the switching mechanism between the blind mode and the decision-directed mode. (c) 2012 Elsevier B.V. All rights reserved.

Comparative genomic and transcriptome analyses of pathotypes of Xanthomonas citri subsp. citri provide insights into mechanisms of bacterial virulence and host range

Abstract Background Citrus bacterial canker is a disease that has severe economic impact on citrus industries worldwide and is caused by a few species and pathotypes of Xanthomonas. X. citri subsp. citri strain 306 (XccA306) is a type A (Asiatic) strain with a wide host range, whereas its variant X. citri subsp. citri strain Aw12879 (Xcaw12879, Wellington strain) is restricted to Mexican lime. Results To characterize the mechanism for the differences in host range of XccA and Xcaw, the genome of Xcaw12879 that was completed recently was compared with XccA306 genome. Effectors xopAF and avrGf1 are present in Xcaw12879, but were absent in XccA306. AvrGf1 was shown previously for Xcaw to cause hypersensitive response in Duncan grapefruit. Mutation analysis of xopAF indicates that the gene contributes to Xcaw growth in Mexican lime but does not contribute to the limited host range of Xcaw. RNA-Seq analysis was conducted to compare the expression profiles of Xcaw12879 and XccA306 in Nutrient Broth (NB) medium and XVM2 medium, which induces hrp gene expression. Two hundred ninety two and 281 genes showed differential expression in XVM2 compared to in NB for XccA306 and Xcaw12879, respectively. Twenty-five type 3 secretion system genes were up-regulated in XVM2 for both XccA and Xcaw. Among the 4,370 common genes of Xcaw12879 compared to XccA306, 603 genes in NB and 450 genes in XVM2 conditions were differentially regulated. Xcaw12879 showed higher protease activity than XccA306 whereas Xcaw12879 showed lower pectate lyase activity in comparison to XccA306. Conclusions Comparative genomic analysis of XccA306 and Xcaw12879 identified strain specific genes. Our study indicated that AvrGf1 contributes to the host range limitation of Xcaw12879 whereas XopAF contributes to virulence. Transcriptome analyses of XccA306 and Xcaw12879 presented insights into the expression of the two closely related strains of X. citri subsp. citri. Virulence genes including genes encoding T3SS components and effectors are induced in XVM2 medium. Numerous genes with differential expression in Xcaw12879 and XccA306 were identified. This study provided the foundation to further characterize the mechanisms for virulence and host range of pathotypes of X. citri subsp. citri.

Verbal and visual stimulation effects on rectus femoris and biceps femoris muscles during isometric and concentric

Abstract Background: Coactivation may be both desirable (injury prevention) or undesirable (strength measurement). In this context, different styles of muscle strength stimulus have being investigated. In this study we evaluated the effects of verbal and visual stimulation on rectus femoris and biceps femoris muscles contraction during isometric and concentric. Methods: We investigated 13 men (age =23.1 ± 3.8 years old; body mass =75.6 ± 9.1 kg; height =1.8 ± 0.07 m). We used the isokinetic dynamometer BIODEX device and an electromyographic (EMG) system. We evaluated the maximum isometric and isokinetic knee extension and flexion at 60°/s. The following conditions were evaluated: without visual nor verbal command (control); verbal command; visual command and; verbal and visual command. In relation to the concentric contraction, the volunteers performed five reciprocal and continuous contractions at 60°/s. With respect to isometric contractions it was made three contractions of five seconds for flexion and extension in a period of one minute. Results: We found that the peak torque during isometric flexion was higher in the subjects in the VVC condition (p > 0.05). In relation to muscle coactivation, the subjects presented higher values at the control condition (p > 0.05). Conclusion We suggest that this type of stimulus is effective for the lower limbs.

Constrained least square pre-distortion scheme for multiuser ultra-wideband

The study proposes a constrained least square (CLS) pre-distortion scheme for multiple-input single-output (MISO) multiple access ultra-wideband (UWB) systems. In such a scheme, a simple objective function is defined, which can be efficiently solved by a gradient-based algorithm. For the performance evaluation, scenarios CM1 and CM3 of the IEEE 802.15.3a channel model are considered. Results show that the CLS algorithm has a fast convergence and a good trade-off between intersymbol interference (ISI) and multiple access interference (MAI) reduction and signal-to-noise ratio (SNR) preservation, performing better than time-reversal (TR) pre-distortion.

Decision-directed feedback equalisation for QAM signals

Proposed is a symbol-based decision-directed algorithm for blind equalisation of quadrature amplitude modulation (QAM) signals using a decision feedback scheme. Independently of QAM order, it presents: (i) an error equal to zero when the equaliser output coincides with the transmitted signal; (ii) simultaneous recovery of the modulus and phase of the signal; (iii) a misadjustment close to that of the normalised least-mean squares algorithm; (iv) fast convergence; and (v) the avoidance of degenerative solutions. Additionally, its stability is ensured when the step-size is properly chosen.

Isokinetic analysis of the elbow joint in children with cerebral palsy

The joint torque is an important variable related to children with cerebral palsy. The present study analyzed kinetic parameters during elbow flexion and extension movements in healthy and cerebral palsy children. Ten healthy and 10 cerebral palsy children participated of the study. An isokinetic dynamometer was used to measure the elbow mean peak torque, mean angle peak torque, coefficient of variation and acceleration during flexion and extension movements at different angular speeds. The mean peak torque on extension movement in healthy children group was significant higher compared to the cerebral palsy group. The coefficient of variation on both flexion and extension movements was significantly higher in cerebral palsy group. However there were significantly difference on both groups compared the lowest and highest velocities. Although the results showed no difference in flexor peak torque, the acceleration is significantly lower in lowest and highest angular velocity.

Effect of the rest interval duration between contractions on muscle fatigue

Background: We aimed to investigate the effect of rest interval, between successive contractions, on muscular fatigue. Methods: Eighteen subjects performed elbow flexion and extension (30 repetitions) on an isokinetic dynamometer with 80 degrees of range of motion. The flexion velocity was 120 degrees/s, while for elbow extension we used 5 different velocities (30, 75, 120, 240, 360 degrees/s), producing 5 different rest intervals (2.89, 1.28, 0.85, 0.57 and 0.54 s). Results: We observed that when the rest interval was 2.89 s there was a reduction in fatigue. On the other hand, when the rest interval was 0.54 s the fatigue was increased. Conclusions: When the resting time was lower (0.54 s) the decline of work in the flexor muscle group was higher compared with different rest interval duration.

Influence of high-heeled shoes on venous function in young women

Background: Walking with high-heeled shoes is a common cause of venous complaints such as pain, fatigue, and heavy-feeling legs. The aim of the study was to clarify the influence of high-heeled shoes on the venous return and test the hypothesis that women wearing different styles of high-heeled shoes present an impaired venous return when compared with their values when they are barefoot. Methods: Thirty asymptomatic women (mean age, 26.4 years) wearing appropriately sized shoes were evaluated by air plethysmography (APG), a test that measures changes in air volume on a cuff placed on the calf, while they performed orthostatic flexion and extension foot movements and altered standing up and lying down. The test was repeated in four situations: barefoot (0 cm), medium heels (3.5 cm), stiletto high heels (7 cm), and platform high heels (7 cm). The APG values of venous filling index (VFI), ejection fraction (EF), and residual volume fraction (RVF) were divided into four groups according to heel height and compared by repeated-measures analysis of variance. Results: RVF was increased in the groups wearing high heels (stiletto and platform) compared with the barefoot group (P < .05). RVF was increased in the medium-heel group (3.5 cm) compared with the barefoot group (P < .05), and despite the lack of statistical significance, the medium-heel group showed lower values of RVF compared with the two high-heel groups. The EF parameter followed the opposite tendency, showing higher values for the barefoot group compared with the other three groups (P < .05). Values for VFI were similar in the three situations evaluated. Conclusions: High heels reduce muscle pump function, as demonstrated by reduced EF and increased RVF values. The continuous use of high heels tends to provoke venous hypertension in the lower limbs and may represent a causal factor of venous disease symptoms. (J Vasc Surg 2012;56:1039-44.)

Análise isocinética da articulação do cotovelo em crianças com paralisia cerebral

A quantidade de torque aplicado na articulação é uma medida de aptidão física importante para crianças com paralisia cerebral. O presente estudo analisou parâmetros cinéticos na articulação do cotovelo em crianças saudáveis e com paralisia cerebral. Participaram 10 crianças com paralisia cerebral e 10 crianças sem comprometimento neurológico. Avaliou-se a média do pico de torque, média do ângulo do pico de torque, coeficiente de variação do torque e aceleração angular do movimento de flexo-extensão do cotovelo nas velocidades com um dinamômetro isocinético. A média de pico de torque (extensão), aceleração (flexão) e coeficiente de variação (flexão e extensão) são diferentes entre grupos. Conclui-se que o torque e aceleração sofreram interferências no movimento de flexo-extensão; as principais diferenças encontradas foram entre os extremos das velocidades; não houve diferenças no ângulo do pico de torque. A espasticidade não interferiu na força dos músculos agonistas do movimento de flexão da articulação do cotovelo.

Records of migration in the exoplanet configurations

When compared to our Solar System, many exoplanet systems exhibit quite unusual planet configurations; some of these are hot Jupiters, which orbit their central stars with periods of a few days, others are resonant systems composed of two or more planets with commensurable orbital periods. It has been suggested that these configurations can be the result of a migration processes originated by tidal interactions of the planets with disks and central stars. The process known as planet migration occurs due to dissipative forces which affect the planetary semi-major axes and cause the planets to move towards to, or away from, the central star. In this talk, we present possible signatures of planet migration in the distribution of the hot Jupiters and resonant exoplanet pairs. For this task, we develop a semi-analytical model to describe the evolution of the migrating planetary pair, based on the fundamental concepts of conservative and dissipative dynamics of the three-body problem. Our approach is based on an analysis of the energy and the orbital angular momentum exchange between the two-planet system and an external medium; thus no specific kind of dissipative forces needs to be invoked. We show that, under assumption that dissipation is weak and slow, the evolutionary routes of the migrating planets are traced by the stationary solutions of the conservative problem (Birkhoff, Dynamical systems, 1966). The ultimate convergence and the evolution of the system along one of these modes of motion are determined uniquely by the condition that the dissipation rate is sufficiently smaller than the roper frequencies of the system. We show that it is possible to reassemble the starting configurations and migration history of the systems on the basis of their final states, and consequently to constrain the parameters of the physical processes involved.