Optimistic linear programming gives logarithmic regret for irreducible MDPs

We present an algorithm called Optimistic Linear Programming (OLP) for learning to optimize average reward in an irreducible but otherwise unknown Markov decision process (MDP). OLP uses its experience so far to estimate the MDP. It chooses actions by optimistically maximizing estimated future rewards over a set of next-state transition probabilities that are close to the estimates, a computation that corresponds to solving linear programs. We show that the total expected reward obtained by OLP up to time T is within C(P) log T of the reward obtained by the optimal policy, where C(P) is an explicit, MDP-dependent constant. OLP is closely related to an algorithm proposed by Burnetas and Katehakis with four key differences: OLP is simpler, it does not require knowledge of the supports of transition probabilities, the proof of the regret bound is simpler, but our regret bound is a constant factor larger than the regret of their algorithm. OLP is also similar in flavor to an algorithm recently proposed by Auer and Ortner. But OLP is simpler and its regret bound has a better dependence on the size of the MDP.

Patterning of tailored polycarbonate based non-chemically amplified resists using extreme ultraviolet lithography

A series of high-performance polycarbonates have been prepared with glass-transition temperatures and decomposition temperatures that are tunable by varying the repeat-unit chemical structure. Patterning of the polymers with extreme UV lithography has been achieved by taking advantage of direct photoinduced chain scission of the polymer chains, which results in a molecular-weight based solubility switch. After selective development of the irradiated regions of the polymers, feature sizes as small as 28.6 nm have been printed and the importance of resist-developer interactions for maximizing image quality has been demonstrated.

Adoption of innovative products on Australian road infrastructure projects

Product innovation is an important contributor to the performance of infrastructure projects in the construction industry. Maximizing the potential for innovative product adoption is a challenging task due to the complexities of the construction innovation system. A qualitative methodology involving interviews with major construction project stakeholders is employed to address the research question: ‘What are the main obstacles to the adoption of innovative products in the road industry?’ The characteristics of six key product innovation obstacles in Australian road projects are described. The six key obstacles are: project goal misalignment, client pressures, weak contractual relations, lack of product trialling, inflexible product specifications and product liability concerns. A snapshot of the dynamics underlying these obstacles is provided. There are few such assessments in the literature, despite the imperative to improve construction innovation rates globally in order to deliver road infrastructure projects of increasing size and complexity. Key obstacles are interpreted through an open innovation construct, providing direction for policy to enhance the uptake of innovation across the construction product supply network. Early evidence suggests the usefulness of an open innovation construct that integrates three conceptual lenses: network governance, absorptive capacity and knowledge intermediation, in order to interpret product adoption obstacles in the context of Australian road infrastructure projects. The paper also provides practical advice and direction for government and industry organizations that wish to promote the flow of innovative product knowledge across the construction supply network.

Politicians as experts, electoral control, and fiscal restraints

We establish an argument for fiscal restraints which is based on the idea that politicians are experts in the meaning of the credence good literature. A budget maximizing politician is better informed than the electorate about the necessary spending to ensure the states ability to provide services for the economy. Voters, being able to observe the budget but not the necessary level of spending, attenuate the government’s spending level via electoral control. A fiscal restraint limits the maximum spending a government will choose if the level of spending ensuring the politicians reelection is not sufficient to ensure the state’s ability to provide services to the economy. We determine when such a fiscal restraint improves voter welfare and discuss the role of the opposition in situations where very high levels of spending are required.

Value management in infrastructure project design : unlocking the project team’s creativity

Value Management (VM) is a proven methodology that provides a structured framework using supporting tools and techniques that facilitate effective decision-making in many types of projects, thus achieving ‘best value’ for clients. It offers an exceptionally robust approach to exploring the need and function of projects to be aligned with client’s objectives. The functional analysis and creativity phases of VM are crucial as it focused on utilising innovative thinking to understand the objectives of clients’ projects and provide value-adding solutions at the early discovery stages of projects. There is however a perception of VM as just being another cost-cutting tool, which has overshadowed the fundamental benefits of the method, therefore negating both influence and wider use in the construction industry. This paper describes findings from a series of case studies conducted at project and corporate levels of a current public funded infrastructure projects in Malaysia. The study aims to investigate VM processes practised by the project client organisation and evaluate the effects of project team involvement in VM workshops during the design-stage of these projects. The focus of the study is on how issues related to ‘upstream’ infrastructure design aimed at improving ‘downstream’ construction process on-site, are being resolved through multi-disciplinary team consideration and decision-making. Findings from the case studies indicate that the mix of disciplines of project team members at a design-stage of a VM workshop has minimal influence on improving construction processes. However, the degree of interaction, institutionalized thinking, cultural dimensions and visualization aids adopted, have a significant impact in maximizing creativity amongst project team members during VM workshop. The case studies conducted for this research have focused on infrastructure projects that utilise traditional VM workshop as client’s chosen VM methodology to review and develop designs. Documents review and semi-structured interview with project teams are used as data collection techniques for the case study. The significant outcomes of this research are expected to offer alternative perspectives for construction professionals and clients to minimise the constraints and strengthen strategies for implementing VM on future projects.

Expander graph based key distribution mechanisms in wireless sensor networks

Secure communications between large number of sensor nodes that are randomly scattered over a hostile territory, necessitate efficient key distribution schemes. However, due to limited resources at sensor nodes such schemes cannot be based on post deployment computations. Instead, pairwise (symmetric) keys are required to be pre-distributed by assigning a list of keys, (a.k.a. key-chain), to each sensor node. If a pair of nodes does not have a common key after deployment then they must find a key-path with secured links. The objective is to minimize the keychain size while (i) maximizing pairwise key sharing probability and resilience, and (ii) minimizing average key-path length. This paper presents a deterministic key distribution scheme based on Expander Graphs. It shows how to map the parameters (e.g., degree, expansion, and diameter) of a Ramanujan Expander Graph to the desired properties of a key distribution scheme for a physical network topology.

Optimally increasing secure connectivity in multihop wireless ad hoc networks

We consider the problem of how to maximize secure connectivity of multi-hop wireless ad hoc networks after deployment. Two approaches, based on graph augmentation problems with nonlinear edge costs, are formulated. The first one is based on establishing a secret key using only the links that are already secured by secret keys. This problem is in NP-hard and does not accept polynomial time approximation scheme PTAS since minimum cutsets to be augmented do not admit constant costs. The second one is based of increasing the power level between a pair of nodes that has a secret key to enable them physically connect. This problem can be formulated as the optimal key establishment problem with interference constraints with bi-objectives: (i) maximizing the concurrent key establishment flow, (ii) minimizing the cost. We show that both problems are NP-hard and MAX-SNP (i.e., it is NP-hard to approximate them within a factor of 1 + e for e > 0 ) with a reduction to MAX3SAT problem. Thus, we design and implement a fully distributed algorithm for authenticated key establishment in wireless sensor networks where each sensor knows only its one- hop neighborhood. Our witness based approaches find witnesses in multi-hop neighborhood to authenticate the key establishment between two sensor nodes which do not share a key and which are not connected through a secure path.

Complexity of increasing the secure connectivity in wireless ad hoc networks

We consider the problem of maximizing the secure connectivity in wireless ad hoc networks, and analyze complexity of the post-deployment key establishment process constrained by physical layer properties such as connectivity, energy consumption and interference. Two approaches, based on graph augmentation problems with nonlinear edge costs, are formulated. The first one is based on establishing a secret key using only the links that are already secured by shared keys. This problem is in NP-hard and does not accept polynomial time approximation scheme PTAS since minimum cutsets to be augmented do not admit constant costs. The second one extends the first problem by increasing the power level between a pair of nodes that has a secret key to enable them physically connect. This problem can be formulated as the optimal key establishment problem with interference constraints with bi-objectives: (i) maximizing the concurrent key establishment flow, (ii) minimizing the cost. We prove that both problems are NP-hard and MAX-SNP with a reduction to MAX3SAT problem.

The new governance approach to the devolution of corporate governance

The moral arguments associated with justice, fairness and communitarianism have rejected the exclusivity of cost‐benefit analysis in corporate governance. Particularly, the percepts of new governance (NG) have included distributive aspects in efficiency models focused on maximizing profits. While corporate directors were only assigned to look after the return of investment within the traditional framework of corporate governance (CG), NG has created the scope for them to look beyond the set of contractual liabilities. This article explores how and how far NG notions have contributed to the devolution of CG to create internal strategies focusing on actors, ethics and accountability in corporate self-regulation.

CASNS - A heuristic algorithm for the nesting of irregular-shaped sheet-metal blanks

This article reports on the design and implementation of a computer-aided sheet nesting system (CASNS) for the nesting of two-dimensional irregular-shaped sheet-metal blanks on a given sheet stock or coil stock. The system is designed by considering several constraints of sheet-metal stamping operations, such as bridge width and grain orientation, and design requirements such as maximizing the strength of the part hen subsequent bending is involved, minimization of scrap, and economic justification for'a single or multiple station operation. Through many practical case studies, the system proves its efficiency, effectiveness and usefulness.

Social influences and the physical activity intentions of parents of young-children families: An extended Theory of Planned Behavior Approach

Evidence within Australia and internationally suggests parenthood as a risk factor for inactivity; however, research into understanding parental physical activity is scarce. Given that active parents can create active families and social factors are important for parents’ decision making, the authors investigated a range of social influences on parents’ intentions to be physically active. Parents (N = 580; 288 mothers and 292 fathers) of children younger than 5 years completed an extended Theory of Planned Behavior questionnaire either online or paper based. For both genders, attitude, control factors, group norms, friend general support, and an active parent identity predicted intentions, with social pressure and family support further predicting mothers’ intentions and active others further predicting fathers’ intentions. Attention to these factors and those specific to the genders may improve parents’ intentions to be physically active, thus maximizing the benefits to their own health and the healthy lifestyle practices for other family members.

Industrial land price and its impact on urban growth : a Chinese case study

China is experiencing rapid progress in industrialization, with its own rationale toward industrial land development based on a deliberate change from an extensive to intensive form of urban land use. One result has been concerted attempts by local government to attract foreign investment by a low industrial land price strategy, which has resulted in a disproportionally large amount of industrial land within the total urban land use structure at the expense of the urban sprawl of many cities. This paper first examines “Comparable Benchmark Price as Residential land use” (CBPR) as the theoretical basis of the low industrial land price phenomenon. Empirical findings are presented from a case study based on data from Jinyun County, China. These data are analyzed to reveal the rationale of industrial land price from 2000 to 2010 concerning the CBPR model. We then explore the causes of low industrial land prices in the form of a “Centipede Game Model”, involving two neighborhood regions as “major players” to make a set of moves (or strategies). When one of the players unilaterally reduces the land price to attract investment with the aim to maximize profits arising from the revenues generated from foreign investment and land premiums, a two-player price war begins in the form of a dynamic game, the effect of which is to produce a downward spiral of prices. In this context, the paradox of maximizing profits for each of the two players are not accomplished due to the inter-regional competition of attracted investment leading to a lose-lose situation for both sides’ in competing for land premium revenues. A short-term solution to the problem is offered involving the establishment of inter-regional cooperative partnerships. For the longer term, however, a comprehensive reform of the local financial system, more adroit regional planning and an improved means of evaluating government performance is needed to ensure the government's role in securing pubic goods is not abandoned in favor of one solely concerned with revenue generation.

How distributional preferences shape incentives on (experimental) markets for credence goods

Credence goods markets suffer from inefficiencies caused by superior information of sellers about the surplus-maximizing quality. While standard theory predicts that equal mark-up prices solve the credence goods problem if customers can verify the quality received, experimental evidence indicates the opposite. We identify a lack of robustness of institutional design with respect to heterogeneity in distributional preferences as a possible cause and design new experiments that allow for parsimonious identification of sellers’ distributional types. Our results indicate that less than a fourth of the subjects behave according to standard theory’s assumption, the rest behaving either in line with non-standard selfish or in accordance with non-trivial other-regarding preferences. We discuss consequences of our findings for institutional design and agent selection.

Pedagogy and community engagement in environmental design courses

This article describes an evaluation of student experiences in environmental design courses with a community engagement focus. It aims to identify pedagogical approaches that minimize obstacles faced by students while maximizing learning opportunities. Focus groups composed of undergraduate students in seven classes generated three major findings: (1) learning how to effectively engage with community partners is one of the most beneficial challenges of this type of course; (2) logistical hurdles and course characteristics that limited students’ ability to connect with the community partners or synthesize the social, emotional, technical, and theoretical aspects of the course were perceived as learning obstacles; and (3) social and emotional connections with community partners are the most educationally significant part of the experience for students. The conclusion discusses recommendations for how environmental design instructors can take advantage of the unique social and emotional connections with community partners that facilitated community engagement can foster, while limiting the learning obstacles that students may experience. Areas for future research

Allelic variation at a single gene increases food value in a drought-tolerant staple cereal

The production of adequate agricultural outputs to support the growing human population places great demands on agriculture, especially in light of ever-greater restrictions on input resources. Sorghum is a drought-adapted cereal capable of reliable production where other cereals fail, and thus represents a good candidate to address food security as agricultural inputs of water and arable land grow scarce. A long-standing issue with sorghum grain is that it has an inherently lower digestibility. Here we show that a low-frequency allele type in the starch metabolic gene, pullulanase, is associated with increased digestibility, regardless of genotypic background. We also provide evidence that the beneficial allele type is not associated with deleterious pleiotropic effects in the modern field environment. We argue that increasing the digestibility of an adapted crop is a viable way forward towards addressing food security while maximizing water and land-use efficiency.