THE VANISHING DISCOUNT APPROACH FOR THE AVERAGE CONTINUOUS CONTROL OF PIECEWISE DETERMINISTIC MARKOV PROCESSES

This work is concerned with the existence of an optimal control strategy for the long-run average continuous control problem of piecewise-deterministic Markov processes (PDMPs). In Costa and Dufour (2008), sufficient conditions were derived to ensure the existence of an optimal control by using the vanishing discount approach. These conditions were mainly expressed in terms of the relative difference of the alpha-discount value functions. The main goal of this paper is to derive tractable conditions directly related to the primitive data of the PDMP to ensure the existence of an optimal control. The present work can be seen as a continuation of the results derived in Costa and Dufour (2008). Our main assumptions are written in terms of some integro-differential inequalities related to the so-called expected growth condition, and geometric convergence of the post-jump location kernel associated to the PDMP. An example based on the capacity expansion problem is presented, illustrating the possible applications of the results developed in the paper.

On the Filtering Problem for Continuous-Time Markov Jump Linear Systems with no Observation of the Markov Chain

We consider in this paper the optimal stationary dynamic linear filtering problem for continuous-time linear systems subject to Markovian jumps in the parameters (LSMJP) and additive noise (Wiener process). It is assumed that only an output of the system is available and therefore the values of the jump parameter are not accessible. It is a well known fact that in this setting the optimal nonlinear filter is infinite dimensional, which makes the linear filtering a natural numerically, treatable choice. The goal is to design a dynamic linear filter such that the closed loop system is mean square stable and minimizes the stationary expected value of the mean square estimation error. It is shown that an explicit analytical solution to this optimal filtering problem is obtained from the stationary solution associated to a certain Riccati equation. It is also shown that the problem can be formulated using a linear matrix inequalities (LMI) approach, which can be extended to consider convex polytopic uncertainties on the parameters of the possible modes of operation of the system and on the transition rate matrix of the Markov process. As far as the authors are aware of this is the first time that this stationary filtering problem (exact and robust versions) for LSMJP with no knowledge of the Markov jump parameters is considered in the literature. Finally, we illustrate the results with an example.

Singular Perturbation for the Discounted Continuous Control of Piecewise Deterministic Markov Processes

This paper deals with the expected discounted continuous control of piecewise deterministic Markov processes (PDMP`s) using a singular perturbation approach for dealing with rapidly oscillating parameters. The state space of the PDMP is written as the product of a finite set and a subset of the Euclidean space a""e (n) . The discrete part of the state, called the regime, characterizes the mode of operation of the physical system under consideration, and is supposed to have a fast (associated to a small parameter epsilon > 0) and a slow behavior. By using a similar approach as developed in Yin and Zhang (Continuous-Time Markov Chains and Applications: A Singular Perturbation Approach, Applications of Mathematics, vol. 37, Springer, New York, 1998, Chaps. 1 and 3) the idea in this paper is to reduce the number of regimes by considering an averaged model in which the regimes within the same class are aggregated through the quasi-stationary distribution so that the different states in this class are replaced by a single one. The main goal is to show that the value function of the control problem for the system driven by the perturbed Markov chain converges to the value function of this limit control problem as epsilon goes to zero. This convergence is obtained by, roughly speaking, showing that the infimum and supremum limits of the value functions satisfy two optimality inequalities as epsilon goes to zero. This enables us to show the result by invoking a uniqueness argument, without needing any kind of Lipschitz continuity condition.

CO(2) from Alcoholic Fermentation for Continuous Cultivation of Arthrospira (Spirulina) platensis in Tubular Photobioreactor Using Urea as Nitrogen Source

Carbon dioxide released from alcoholic fermentation accounts for 33% of the whole CO(2) involved in the use of ethanol as fuel derived from glucose. As Arthrospira platensis can uptake this greenhouse gas, this study evaluates the use of the CO(2) released from alcoholic fermentation for the production of Arthrospira platensis. For this purpose, this cyanobacterium was cultivated in continuous process using urea as nitrogen source, either using CO(2) from alcoholic fermentation, without any treatment, or using pure CO(2) from cylinder. The experiments were carried out at 120 mu mol photons m(-2) s(-1) in tubular photobioreactor at different dilution rates (0.2 <= D <= 0.8 d(-1)). Using CO(2) from alcoholic fermentation, maximum steady-state cell concentration (2661 +/- 71 mg L(-1)) was achieved at D 0.2 d(-1), whereas higher dilution rate (0.6 d(-1)) was needed to maximize cell productivity (839 mg L(-1) d(-1)). This value was 10% lower than the one obtained with pure CO(2), and there was no significant difference in the biomass protein content. With D 0.8 d(-1), it was possible to obtain 56% +/- 1.5% and 50% +/- 1.2% of protein in the dry biomass, using pure CO(2) and CO(2) from alcoholic fermentation, respectively. These results demonstrate that the use of such cost free CO(2) from alcoholic fermentation as carbon source, associated with low cost nitrogen source, may be a promising way to reduce costs of continuous cultivation of photosynthetic microorganisms, contributing at the same time to mitigate the greenhouse effect. (C) 2011 American Institute of Chemical Engineers Biotechnol. Prog., 27: 650-656, 2011

Extraction of Ascorbate Oxidase from Cucurbita maxima by Continuous Process in Perforated Rotating Disc Contactor Using Aqueous Two-Phase Systems

The ascorbate oxidase is the enzyme used to determine the content of ascorbic acid in the pharmaceutical and food industries and clinics analyses. The techniques currently used for the purification of this enzyme raise its production cost. Thus, the development of alternative processes and with the potential to reduce costs is interesting. The application of aqueous two-phase system is proposed as an alternative to purification because it enables good separation of biomolecules. The objective of this study was to determine the conditions to continuously pre-purify the enzyme ascorbate oxidase by an aqueous two-phase system (PEG/citrate) using rotating column provided with perforated discs. Under the best conditions (20,000 g/mol PEG molar mass, 10% PEG concentration, and 25% citrate concentration), the system showed satisfactory results (partition coefficient, 3.35; separation efficiency, 54.98%; and purification factor, 1.46) and proved suitable for the pre-purification of ascorbate oxidase in continuous process.

Continuous extraction of alpha-toxin from a fermented broth of Clostridium perfringens Type A in perforated rotating disc contactor using aqueous two-phase PEG-phosphate system

A 2(3-1) factorial experimental design was used to evaluate the performance of a perforated rotating disc contactor to extract alpha-toxin from the fermented broth of Clostridium perfringens Type A by aqueous two-phase system of polyethylene glycol-phosphate salts. The influence of three independent variables, specifically the dispersed phase flowrate, the continuous phase flowrate and the disc rotational speed, was investigated on the hold up, the mass transfer coefficient, the separation efficiency and the purification factor, taken as the response variables. The optimum dispersed phase flowrate was 3.0 mL/min for all these responses. Besides, maximum values of hold up (0.80), separation efficiency (0. 10) and purification factor (2.4) were obtained at this flowrate using the lowest disc rotational speed (35 rpm), while the optimum mass transfer coefficient (0. 165 h(-1)) was achieved at the highest agitation level (140 rpm). The results of this study demonstrated that the dispersed phase flowrate strongly influenced the performance of PRDC, in that both the mass transfer coefficient and hold up increased with this parameter. (c) 2007 Elsevier B. V. All rights reserved.

Lingual kinematic strategies used to increase speech rate: Comparisons between younger and older adults

The primary objective of this study was to assess the lingual kinematic strategies used by younger and older adults to increase rate of speech. It was hypothesised that the strategies used by the older adults would differ from the young adults either as a direct result of, or in response to a need to compensate for, age-related changes in the tongue. Electromagnetic articulography was used to examine the tongue movements of eight young (M526.7 years) and eight older (M567.1 years) females during repetitions of /ta/ and /ka/ at a controlled moderate rate and then as fast as possible. The younger and older adults were found to significantly reduce consonant durations and increase syllable repetition rate by similar proportions. To achieve these reduced durations both groups appeared to use the same strategy, that of reducing the distances travelled by the tongue. Further comparisons at each rate, however, suggested a speed-accuracy trade-off and increased speech monitoring in the older adults. The results may assist in differentiating articulatory changes associated with normal aging from pathological changes found in disorders that affect the older population.

Spectral peak resolution and speech recognition in quiet: Normal hearing, hearing impaired and cochlear implant listeners

Spectral peak resolution was investigated in normal hearing (NH), hearing impaired (HI), and cochlear implant (CI) listeners. The task involved discriminating between two rippled noise stimuli in which the frequency positions of the log-spaced peaks and valleys were interchanged. The ripple spacing was varied adaptively from 0.13 to 11.31 ripples/octave, and the minimum ripple spacing at which a reversal in peak and trough positions could be detected was determined as the spectral peak resolution threshold for each listener. Spectral peak resolution was best, on average, in NH listeners, poorest in CI listeners, and intermediate for HI listeners. There was a significant relationship between spectral peak resolution and both vowel and consonant recognition in quiet across the three listener groups. The results indicate that the degree of spectral peak resolution required for accurate vowel and consonant recognition in quiet backgrounds is around 4 ripples/octave, and that spectral peak resolution poorer than around 1–2 ripples/octave may result in highly degraded speech recognition. These results suggest that efforts to improve spectral peak resolution for HI and CI users may lead to improved speech recognition

Speech recognition in noise for cochlear implant listeners: Benefits of residual hearing

The purpose of this study was to explore the potential advantages, both theoretical and applied, of preserving low-frequency acoustic hearing in cochlear implant patients. Several hypotheses are presented that predict that residual low-frequency acoustic hearing along with electric stimulation for high frequencies will provide an advantage over traditional long-electrode cochlear implants for the recognition of speech in competing backgrounds. A simulation experiment in normal-hearing subjects demonstrated a clear advantage for preserving low-frequency residual acoustic hearing for speech recognition in a background of other talkers, but not in steady noise. Three subjects with an implanted "short-electrode" cochlear implant and preserved low-frequency acoustic hearing were also tested on speech recognition in the same competing backgrounds and compared to a larger group of traditional cochlear implant users. Each of the three short-electrode subjects performed better than any of the traditional long-electrode implant subjects for speech recognition in a background of other talkers, but not in steady noise, in general agreement with the simulation studies. When compared to a subgroup of traditional implant users matched according to speech recognition ability in quiet, the short-electrode patients showed a 9-dB advantage in the multitalker background. These experiments provide strong preliminary support for retaining residual low-frequency acoustic hearing in cochlear implant patients. The results are consistent with the idea that better perception of voice pitch, which can aid in separating voices in a background of other talkers, was responsible for this advantage.

Benefits of amplification for speech recognition in background noise

The purpose of the present study was to examine the benefits of providing audible speech to listeners with sensorineural hearing loss when the speech is presented in a background noise. Previous studies have shown that when listeners have a severe hearing loss in the higher frequencies, providing audible speech (in a quiet background) to these higher frequencies usually results in no improvement in speech recognition. In the present experiments, speech was presented in a background of multitalker babble to listeners with various severities of hearing loss. The signal was low-pass filtered at numerous cutoff frequencies and speech recognition was measured as additional high-frequency speech information was provided to the hearing-impaired listeners. It was found in all cases, regardless of hearing loss or frequency range, that providing audible speech resulted in an increase in recognition score. The change in recognition as the cutoff frequency was increased, along with the amount of audible speech information in each condition (articulation index), was used to calculate the "efficiency" of providing audible speech. Efficiencies were positive for all degrees of hearing loss. However, the gains in recognition were small, and the maximum score obtained by an listener was low, due to the noise background. An analysis of error patterns showed that due to the limited speech audibility in a noise background, even severely impaired listeners used additional speech audibility in the high frequencies to improve their perception of the "easier" features of speech including voicing

Continuous high-frequency turbulence and suspended sediment concentration measurements in an upper estuary

The present study details new turbulence field measurements conducted continuously at high frequency for 50 hours in the upper zone of a small subtropical estuary with semi-diurnal tides. Acoustic Doppler velocimetry was used, and the signal was post-processed thoroughly. The suspended sediment concentration wad further deduced from the acoustic backscatter intensity. The field data set demonstrated some unique flow features of the upstream estuarine zone, including some low-frequency longitudinal oscillations induced by internal and external resonance. A striking feature of the data set is the large fluctuations in all turbulence properties and suspended sediment concentration during the tidal cycle. This feature has been rarely documented.

XSophe-Sophe-XeprView (R). A computer simulation software suite (v. 1.1.3) for the analysis of continuous wave EPR spectra

The XSophe-Sophe-XeprView((R)) computer simulation software suite enables scientists to easily determine spin Hamiltonian parameters from isotropic, randomly oriented and single crystal continuous wave electron paramagnetic resonance (CW EPR) spectra from radicals and isolated paramagnetic metal ion centers or clusters found in metalloproteins, chemical systems and materials science. XSophe provides an X-windows graphical user interface to the Sophe programme and allows: creation of multiple input files, local and remote execution of Sophe, the display of sophelog (output from Sophe) and input parameters/files. Sophe is a sophisticated computer simulation software programme employing a number of innovative technologies including; the Sydney OPera HousE (SOPHE) partition and interpolation schemes, a field segmentation algorithm, the mosaic misorientation linewidth model, parallelization and spectral optimisation. In conjunction with the SOPHE partition scheme and the field segmentation algorithm, the SOPHE interpolation scheme and the mosaic misorientation linewidth model greatly increase the speed of simulations for most spin systems. Employing brute force matrix diagonalization in the simulation of an EPR spectrum from a high spin Cr(III) complex with the spin Hamiltonian parameters g(e) = 2.00, D = 0.10 cm(-1), E/D = 0.25, A(x) = 120.0, A(y) = 120.0, A(z) = 240.0 x 10(-4) cm(-1) requires a SOPHE grid size of N = 400 (to produce a good signal to noise ratio) and takes 229.47 s. In contrast the use of either the SOPHE interpolation scheme or the mosaic misorientation linewidth model requires a SOPHE grid size of only N = 18 and takes 44.08 and 0.79 s, respectively. Results from Sophe are transferred via the Common Object Request Broker Architecture (CORBA) to XSophe and subsequently to XeprView((R)) where the simulated CW EPR spectra (1D and 2D) can be compared to the experimental spectra. Energy level diagrams, transition roadmaps and transition surfaces aid the interpretation of complicated randomly oriented CW EPR spectra and can be viewed with a web browser and an OpenInventor scene graph viewer.

Coding Strategies of Indirect Reported Speech in Typological Perspective

The purpose of this paper is to provide a cross-linguistic survey of the variation of coding strategies that are available for the grammatical distinction between direct and indirect speech representation with a particular focus on the expression of indirect reported speech. Cross-linguistic data from a sample of 42 languages will be provided to illustrate the range of available grammatical coding strategies.