Learning to win process-control games watching game-masters

The present paper focuses on some interesting classes of process-control games, where winning essentially means successfully controlling the process. A master for one of these games is an agent who plays a winning strategy. In this paper we investigate situations in which even a complete model (given by a program) of a particular game does not provide enough information to synthesize—even incrementally—a winning strategy. However, if in addition to getting a program, a machine may also watch masters play winning strategies, then the machine is able to incrementally learn a winning strategy for the given game. Studied are successful learning from arbitrary masters and from pedagogically useful selected masters. It is shown that selected masters are strictly more helpful for learning than are arbitrary masters. Both for learning from arbitrary masters and for learning from selected masters, though, there are cases where one can learn programs for winning strategies from masters but not if one is required to learn a program for the master's strategy itself. Both for learning from arbitrary masters and for learning from selected masters, one can learn strictly more by watching m+1 masters than one can learn by watching only m. Last, a simulation result is presented where the presence of a selected master reduces the complexity from infinitely many semantic mind changes to finitely many syntactic ones.

Effect of pedestrian movement on MIMO-OFDM channel capacity in an indoor environment

The rapid growth of mobile telephone use, satellite services, and now the wireless Internet and WLANs are generating tremendous changes in telecommunication and networking. As indoor wireless communications become more prevalent, modeling indoor radio wave propagation in populated environments is a topic of significant interest. Wireless MIMO communication exploits phenomena such as multipath propagation to increase data throughput and range, or reduce bit error rates, rather than attempting to eliminate effects of multipath propagation as traditional SISO communication systems seek to do. The MIMO approach can yield significant gains for both link and network capacities, with no additional transmitting power or bandwidth consumption when compared to conventional single-array diversity methods. When MIMO and OFDM systems are combined and deployed in a suitable rich scattering environment such as indoors, a significant capacity gain can be observed due to the assurance of multipath propagation. Channel variations can occur as a result of movement of personnel, industrial machinery, vehicles and other equipment moving within the indoor environment. The time-varying effects on the propagation channel in populated indoor environments depend on the different pedestrian traffic conditions and the particular type of environment considered. A systematic measurement campaign to study pedestrian movement effects in indoor MIMO-OFDM channels has not yet been fully undertaken. Measuring channel variations caused by the relative positioning of pedestrians is essential in the study of indoor MIMO-OFDM broadband wireless networks. Theoretically, due to high multipath scattering, an increase in MIMO-OFDM channel capacity is expected when pedestrians are present. However, measurements indicate that some reductions in channel capacity could be observed as the number of pedestrians approaches 10 due to a reduction in multipath conditions as more human bodies absorb the wireless signals. This dissertation presents a systematic characterization of the effects of pedestrians in indoor MIMO-OFDM channels. Measurement results, using the MIMO-OFDM channel sounder developed at the CSIRO ICT Centre, have been validated by a customized Geometric Optics-based ray tracing simulation. Based on measured and simulated MIMO-OFDM channel capacity and MIMO-OFDM capacity dynamic range, an improved deterministic model for MIMO-OFDM channels in indoor populated environments is presented. The model can be used for the design and analysis of future WLAN to be deployed in indoor environments. The results obtained show that, in both Fixed SNR and Fixed Tx for deterministic condition, the channel capacity dynamic range rose with the number of pedestrians as well as with the number of antenna combinations. In random scenarios with 10 pedestrians, an increment in channel capacity of up to 0.89 bits/sec/Hz in Fixed SNR and up to 1.52 bits/sec/Hz in Fixed Tx has been recorded compared to the one pedestrian scenario. In addition, from the results a maximum increase in average channel capacity of 49% has been measured while 4 antenna elements are used, compared with 2 antenna elements. The highest measured average capacity, 11.75 bits/sec/Hz, corresponds to the 4x4 array with 10 pedestrians moving randomly. Moreover, Additionally, the spread between the highest and lowest value of the the dynamic range is larger for Fixed Tx, predicted 5.5 bits/sec/Hz and measured 1.5 bits/sec/Hz, in comparison with Fixed SNR criteria, predicted 1.5 bits/sec/Hz and measured 0.7 bits/sec/Hz. This has been confirmed by both measurements and simulations ranging from 1 to 5, 7 and 10 pedestrians.

Characterization of particle number concentrations and PM2.5 in a school : influence of outdoor air pollution on indoor air

Background, Aim and Scope The impact of air pollution on school children’s health is currently one of the key foci of international and national agencies. Of particular concern are ultrafine particles which are emitted in large quantities, contain large concentrations of toxins and are deposited deeply in the respiratory tract. Materials and methods In this study, an intensive sampling campaign of indoor and outdoor airborne particulate matter was carried out in a primary school in February 2006 to investigate indoor and outdoor particle number (PN) and mass concentrations (PM2.5), and particle size distribution, and to evaluate the influence of outdoor air pollution on the indoor air. Results For outdoor PN and PM2.5, early morning and late afternoon peaks were observed on weekdays, which are consistent with traffic rush hours, indicating the predominant effect of vehicular emissions. However, the temporal variations of outdoor PM2.5 and PN concentrations occasionally showed extremely high peaks, mainly due to human activities such as cigarette smoking and the operation of mower near the sampling site. The indoor PM2.5 level was mainly affected by the outdoor PM2.5 (r = 0.68, p<0.01), whereas the indoor PN concentration had some association with outdoor PN values (r = 0.66, p<0.01) even though the indoor PN concentration was occasionally influenced by indoor sources, such as cooking, cleaning and floor polishing activities. Correlation analysis indicated that the outdoor PM2.5 was inversely correlated with the indoor to outdoor PM2.5 ratio (I/O ratio) (r = -0.49, p<0.01), while the indoor PN had a weak correlation with the I/O ratio for PN (r = 0.34, p<0.01). Discussion and Conclusions The results showed that occupancy did not cause any major changes to the modal structure of particle number and size distribution, even though the I/O ratio was different for different size classes. The I/O curves had a maximum value for particles with diameters of 100 – 400 nm under both occupied and unoccupied scenarios, whereas no significant difference in I/O ratio for PM2.5 was observed between occupied and unoccupied conditions. Inspection of the size-resolved I/O ratios in the preschool centre and the classroom suggested that the I/O ratio in the preschool centre was the highest for accumulation mode particles at 600 nm after school hours, whereas the average I/O ratios of both nucleation mode and accumulation mode particles in the classroom were much lower than those of Aitken mode particles. Recommendations and Perspectives The findings obtained in this study are useful for epidemiological studies to estimate the total personal exposure of children, and to develop appropriate control strategies for minimizing the adverse health effects on school children.

Electronic games: A legitimate diversional therapy intervention for health care consumers?

--

Indoor and outdoor nitrogen dioxide concentration in residential houses in Australia

As part of a larger indoor environmental study, residential indoor and outdoor levels of nitrogen dioxide (NO2) were measured for 14 houses in a suburb of Brisbane, Queensland, Australia. Passive samplers were used for 48-h sampling periods during the winter of 1999. The average indoor and outdoor NO2 levels were 13.8 ± 6.3 and 16.7 ± 4.2 ppb, respectively. The indoor/outdoor NO2 concentration ratio ranged from 0.4 to 2.3, with a median value of 0.82. The results of statistic analyses indicated that there was no significant correlation between indoor and outdoor NO2 concentrations, or between indoor and fixed site NO2 monitoring station concentrations. However, there was a significant correlation between outdoor and fixed site NO2 monitoring station concentrations. There was also a significant correlation between indoor NO2 concentration and indoor submicrometre (0.007–0.808 μm) aerosol particle number concentrations. The results in this study indicated indoor NO2 levels are significantly affected by indoor NO2 sources, such as a gas stove and cigarette smoking. It implies that the outdoor or fixed site monitoring concentration alone is a poor predictor of indoor NO2 concentration.

Human-body shadowing effects on indoor MIMO-OFDM channels at 5.2 GHz

Pedestrian movement is known to cause significant effects on indoor MIMO channels. In this paper, a statistical characterization of the indoor MIMO-OFDM channel subject ot pedestrian movement is reported. The experiment used 4 sending and 4 receiving antennas and 114 sub-carriers at 5.2 GHz. Measurement scenarios varied from zero to ten pedestrians walking randomly between transmitter (tx) and receiver (Rx) arrays. The empirical cumulative distribution function (CDF) of the received fading envelope fits the Ricean distribution with K factors ranging from 7dB to 15 dB, for the 10 pedestrians and vacant scenarios respectively. In general, as the number of pedestrians increase, the CDF slope tends to decrease proportionally. Furthermore, as the number of pedestrians increase, increasing multipath contribution, the dynamic range of channel capacity increases proportionally. These results are consistent with measurement results obtained in controlled scenarios for a fixed narrowband Single-Input Single-Output (SISO) link at 5.2 GHz in previous work. The described empirical characterization provides an insight into the prediction of human-body shadowing effects for indoor MIMO-OFDM channels at 5.2 GHz.

Effects of different practice task constraints on fluctuations of player heart rate in small-sided football games

This paper analyzes effects of different practice task constraints on heart rate (HR) variability during 4v4 smallsided football games. Participants were sixteen football players divided into two age groups (U13, Mean age: 12.4±0.5 yrs; U15: 14.6±0.5). The task consisted of a 4v4 sub-phase without goalkeepers, on a 25x15 m field, of 15 minutes duration with an active recovery period of 6 minutes between each condition. We recorded players’ heart rates using heart rate monitors (Polar Team System, Polar Electro, Kempele, Finland) as scoring mode was manipulated (line goal: scoring by dribbling past an extended line; double goal: scoring in either of two lateral goals; and central goal: scoring only in one goal). Subsequently, %HR reserve was calculated with the Karvonen formula. We performed a time-series analysis of HR for each individual in each condition. Mean data for intra-participant variability showed that autocorrelation function was associated with more short-range dependence processes in the “line goal” condition, compared to other conditions, demonstrating that the “line goal” constraint induced more randomness in HR response. Relative to inter-individual variability, line goal constraints demonstrated lower %CV and %RMSD (U13: 9% and 19%; U15: 10% and 19%) compared with double goal (U13: 12% and 21%; U15: 12% and 21%) and central goal (U13: 14% and 24%; U15: 13% and 24%) task constraints, respectively. Results suggested that line goal constraints imposed more randomness on cardiovascular stimulation of each individual and lower inter-individual variability than double goal and central goal constraints.

GameFlow : a model for evaluating player enjoyment in games

Although player enjoyment is central to computer games, there is currently no accepted model of player enjoyment in games. There are many heuristics in the literature, based on elements such as the game interface, mechanics, gameplay, and narrative. However, there is a need to integrate these heuristics into a validated model that can be used to design, evaluate, and understand enjoyment in games. We have drawn together the various heuristics into a concise model of enjoyment in games that is structured by flow. Flow, a widely accepted model of enjoyment, includes eight elements that, we found, encompass the various heuristics from the literature. Our new model, GameFlow, consists of eight elements -- concentration, challenge, skills, control, clear goals, feedback, immersion, and social interaction. Each element includes a set of criteria for achieving enjoyment in games. An initial investigation and validation of the GameFlow model was carried out by conducting expert reviews of two real-time strategy games, one high-rating and one low-rating, using the GameFlow criteria. The result was a deeper understanding of enjoyment in real-time strategy games and the identification of the strengths and weaknesses of the GameFlow model as an evaluation tool. The GameFlow criteria were able to successfully distinguish between the high-rated and low-rated games and identify why one succeeded and the other failed. We concluded that the GameFlow model can be used in its current form to review games; further work will provide tools for designing and evaluating enjoyment in games.

Working in Australia's digital games industry consolidation report

The Working in Australia’s Digital Games Industry: A Consolidation Report is the outcome of a comprehensive study on the games industry in Australia by Dr Sandra Haukka from the ARC Centre of Excellence for Creative Industries and Innovation (CCI) based at Queensland University of Technology in Brisbane. The study responds to concerns that Australia’s games industry would not reach its full potential due to a lack of local, highly skilled staff, and a lack of appropriately trained graduates with the necessary knowledge and skills. This is the first of two reports produced with the support of the Games Developers’ Association of Australia. Over coming months researchers will develop a future skills strategy report for the industry.

Association between indoor air pollution measurements and respiratory health in women and children in Lao PDR

This article presents the results of a study on the association between measured air pollutants and the respiratory health of resident women and children in Lao PDR, one of the least developed countries in Southeast Asia. The study, commissioned by the World Health Organisation, included PM10, CO and NO2 measurements made inside 181 dwellings in nine districts within two provinces in Lao PDR over a 5- month period (12/05–04/06), and respiratory health information (via questionnaires and peak expiratory flow rate (PEFR) measurements) for all residents in the same dwellings. Adjusted odds ratios were calculated separately for each health outcome using binary logistic regression. There was a strong and consistent positive association between NO2 and CO for almost all questionnaire-based health outcomes for both women and children. Women in dwellings with higher measured NO2 had more than triple of the odds of almost all of the health outcomes, and higher concentrations of NO2 and CO were significantly associated with lower PEFR. This study supports a growing literature confirming the role of indoor air pollution in the burden of respiratory disease in developing countries. The results will directly support changes in health and housing policy in Lao PDR.

Optimal strategies and minimax lower bounds for online convex games

A number of learning problems can be cast as an Online Convex Game: on each round, a learner makes a prediction x from a convex set, the environment plays a loss function f, and the learner’s long-term goal is to minimize regret. Algorithms have been proposed by Zinkevich, when f is assumed to be convex, and Hazan et al., when f is assumed to be strongly convex, that have provably low regret. We consider these two settings and analyze such games from a minimax perspective, proving minimax strategies and lower bounds in each case. These results prove that the existing algorithms are essentially optimal.