Multilinear and Integer Programming for Markov Decision Processes with Imprecise Probabilities

Markov Decision Processes (MDPs) are extensively used to encode sequences of decisions with probabilistic effects. Markov Decision Processes with Imprecise Probabilities (MDPIPs) encode sequences of decisions whose effects are modeled using sets of probability distributions. In this paper we examine the computation of Γ-maximin policies for MDPIPs using multilinear and integer programming. We discuss the application of our algorithms to “factored” models and to a recent proposal, Markov Decision Processes with Set-valued Transitions (MDPSTs), that unifies the fields of probabilistic and “nondeterministic” planning in artificial intelligence research. 

Selective Multi-Carrier Index Keying OFDM: Error Propagation Rate with Moment Generating Function

We propose a new selective multi-carrier index keying in orthogonal frequency division multiplexing (OFDM) systems that opportunistically modulate both a small subset of sub-carriers and their indices. Particularly, we investigate the performance enhancement in two cases of error propagation sensitive and compromised deviceto-device (D2D) communications. For the performance evaluation, we focus on analyzing the error propagation probability (EPP) introducing the exact and upper bound expressions on the detection error probability, in the presence of both imperfect and perfect detection of active multi-carrier indices. The average EPP results in closedform are generalized for various fading distribution using the moment generating function, and our numerical results clearly show that the proposed approach is desirable for reliable and energy-efficient D2D applications.

Fetal umbilical artery Doppler pulsatility index and childhood neurocognitive outcome at 12 years

OBJECTIVE: To determine whether an elevated fetal umbilical artery Doppler (UAD) pulsatility index (PI) at 28 weeks' gestation, in the absence of fetal growth restriction (FGR) and prematurity, is associated with adverse neurocognitive outcome in children aged 12 years.

METHODS: Prospective cohort study, comparing children with a normal fetal UAD PI (<90th centile) (n=110) and those with an elevated PI (≥90th centile) (n=40). UAD was performed at 28, 32 and 34 weeks gestation. At 12 years of age, all children were assessed under standardised conditions at Queen's University, Belfast, UK to determine cognitive and behavioural outcomes using the British Ability Score-II and Achenbach Child Behavioural Checklist Parent Rated Version under standardised conditions. Regression analysis was performed, controlling for confounders such as gender, socioeconomic status and age at assessment.

RESULTS: The mean age of follow-up was 12.4 years (±0.5 SD) with 44% of children male (n=63). When UAD was assessed at 28 weeks, the elevated fetal UAD group had lower scores in cognitive assessments of information processing and memory. Parameters included (1) recall of objects immediate verbal (p=0.002), (2) delayed verbal (p=0.008) and (3) recall of objects immediate spatial (p=0.0016). There were no significant differences between the Doppler groups at 32 or 34 weeks' gestation.

CONCLUSIONS: An elevated UAD PI at 28 weeks' gestation in the absence of FGR or prematurity is associated with lower scores of declarative memory in children aged 12 years. A potential explanation for this is an element of placental insufficiency in the presence of the appropriately grown fetus, which affects the development of the fetal hippocampus and information processing and memory long-term. These findings, however, had no impact on overall academic ability, mental processing and reasoning or overall behavioural function.