Curiosity driven reinforcement learning for motion planning on humanoids

Most previous work on artificial curiosity (AC) and intrinsic motivation focuses on basic concepts and theory. Experimental results are generally limited to toy scenarios, such as navigation in a simulated maze, or control of a simple mechanical system with one or two degrees of freedom. To study AC in a more realistic setting, we embody a curious agent in the complex iCub humanoid robot. Our novel reinforcement learning (RL) framework consists of a state-of-the-art, low-level, reactive control layer, which controls the iCub while respecting constraints, and a high-level curious agent, which explores the iCub's state-action space through information gain maximization, learning a world model from experience, controlling the actual iCub hardware in real-time. To the best of our knowledge, this is the first ever embodied, curious agent for real-time motion planning on a humanoid. We demonstrate that it can learn compact Markov models to represent large regions of the iCub's configuration space, and that the iCub explores intelligently, showing interest in its physical constraints as well as in objects it finds in its environment.

The evolving landscape of natural resource planning and governance in Australia

Australia’s governance of land and natural resources involves multiple polycentric domains of decision-making from global through to local levels. Although certainly complex, these arrangements have not necessarily translated into better decision-making or better environmental outcomes as evidenced by the growing concerns over the health and future of the Great Barrier Reef, (GBR). However within this system, arrangements for natural resource management (NRM) and reef water quality, which both use Australia’s integrated regional NRM model, have showed signs of improving decision-making and environmental outcomes in the GBR. In this paper we describe the latest evolutions in the governance and planning for natural resource use and management in Australia. We begin by reviewing the experience with first generation NRM as published in major audits and evaluations. As our primary interest is the health and future of the GBR, we then consider the impact of changes of second generation planning and governance outcomes in Queensland. We find that first generation plans, although developed under a relatively cohesive governance context, faced substantial problems in target setting, implementation, monitoring and review. Despite this, they were able to progress improvements in water quality in the Great Barrier Reef Regions. Second generation plans, currently being developed, face an even greater risk of failure due to the lack of bilateralism and cross-sectoral cooperation across the NRM governance system. The findings highlight the critical need to re-build and enhance the regional NRM model for NRM planning to have a positive impact on environmental outcomes in the GBR.

Planning and governance approaches for protecting World Heritage Areas: A comparison of the Great Barrier Reef and the Florida Everglades

The focus of this paper is on two World Heritage Areas: the Great Barrier Reef in Queensland, Australia and the Everglades in Florida. While both are World Heritage listed by the UNESCO, the Everglades is on the "World Heritage in Danger" list and the Great Barrier Reef could be on this list within the next year if present pressures continue. This paper examines the planning approaches and governance structures used in these two areas (Queensland and Florida) to manage the growth and development pressures. To make the analysis manageable, given the scale of these World Heritage areas, case studies at the local government level will be used: the Cairns Regional Council in Queensland and Monroe County in Florida. The case study analysis will involve three steps: (1) examination of the various plans at the federal, state, local levels that impact upon environmental quality in the Great Barrier Reef and Everglades; (2) assessing the degree to which these plans have been implemented; and (3) determine if (and how) the plans have improved environmental quality. In addition to the planning analysis we will also examine the governance structures (Lebel et al. 2006) within which planning operates. In any comparative analysis context is important (Hantrais 2009). Contextual differences between Queensland and Florida have previously been examined by Sipe, et al. (2007) and will be used as the starting point for this analysis. Our operating hypothesis and preliminary analysis suggests that the planning approaches and governance structures used in Florida and Queensland are considerably different, but the environmental outcomes may be similar. This is based, in part, on Vella (2004) who did a comparative analysis of environmental practices in the sugar industry in Florida and Queensland. This research re-examines this hypothesis and broadens the focus beyond the sugar industry to growth and development more broadly.

Exploring the usefulness of structural-functional approaches to systematically assess the functionality of governance arrangements for natural resource management planning in two Australian case studies

This research developed and applied an evaluative framework to analyse multiple scales of decision-making for environmental management planning. It is the first exploration of the sociological theory of structural-functionalism and its usefulness to support evidence based decision-making in a planning context. The framework was applied to analyse decision-making in Queensland's Cape York Peninsula and Wet Tropics regions.

Discovering future disaster management capability needs using scenario planning

In recent years disaster risk reduction efforts have focused on disturbances ranging from climate variability, seismic hazards, geo-political instability and public and animal health crises. These factors combined with uncertainty derived from inter-dependencies within and across systems of critical infrastructure create significant problems of governance for the private and public sector alike. The potential for rapid spread of impacts, geographically and virtually, can render a comprehensive understanding of disaster response and recovery needs and risk mitigation issues beyond the grasp of competent authority. Because of such cascading effects communities and governments at local and state-levels are unlikely to face single incidents but rather series of systemic impacts: often appearing concurrently. A further point to note is that both natural and technological hazards can act directly on socio-technical systems as well as being propagated by them: as network events. Such events have been categorised as ‘outside of the box,’ ‘too fast,’ and ‘too strange’ (Lagadec, 2004). Emergent complexities in linked systems can make disaster effects difficult to anticipate and recovery efforts difficult to plan for. Beyond the uncertainties of real world disasters, that might be called familiar or even regular, can we safely assume that the generic capability we use now will suit future disaster contexts? This paper presents initial scoping of research funded by the Bushfire and Natural Hazards Cooperative Research Centre seeking to define future capability needs of disaster management organisations. It explores challenges to anticipating the needs of representative agencies and groups active in before, during and after phases of emergency and disaster situations using capability deficit assessments and scenario assessment.

Achieving intention-centric BPM through automated planning

As a result of the more distributed nature of organisations and the inherently increasing complexity of their business processes, a significant effort is required for the specification and verification of those processes. The composition of the activities into a business process that accomplishes a specific organisational goal has primarily been a manual task. Automated planning is a branch of artificial intelligence (AI) in which activities are selected and organised by anticipating their expected outcomes with the aim of achieving some goal. As such, automated planning would seem to be a natural fit to the BPM domain to automate the specification of control flow. A number of attempts have been made to apply automated planning to the business process and service composition domain in different stages of the BPM lifecycle. However, a unified adoption of these techniques throughout the BPM lifecycle is missing. As such, we propose a new intention-centric BPM paradigm, which aims on minimising the specification effort by exploiting automated planning techniques to achieve a pre-stated goal. This paper provides a vision on the future possibilities of enhancing BPM using automated planning. A research agenda is presented, which provides an overview of the opportunities and challenges for the exploitation of automated planning in BPM.

Proceedings of the 3rd International Subtropical Cities Conference 2011 Subtropical Cities: Subtropical Urbanism -Beyond Climate Change

Climate has been, throughout modern history, a primary attribute for attracting residents to the “Sunshine States” of Florida (USA) and Queensland (Australia). The first major group of settlers capitalized on the winter growing season to support a year-­‐round agricultural economy. As these economies developed, the climate attracted tourism and retirement industries. Yet as Florida and Queensland have blossomed under beneficial climates, the stresses acting on the natural environment are exacting a toll. Southeast Florida and eastern Queensland are among the most vulnerable coastal metropolitan areas in the world. In these places the certainty of sea level rise is measurable with impacts, empirically observable, that will continue to increase regardless of any climate change mitigation.1 The cities of the subtropics share a series of paradoxes relating to climate, resources, environment, and culture. As the subtropical climate entices new residents and visitors there are increasing costs associated with urban infrastructure and the ravages of violent weather. The carefree lifestyle of subtropical cities is increasingly dependent on scarce water and energy resources and the flow of tangible goods that support a trade economy. The natural environment is no longer exploitable as the survival of the human environment is contingent upon the ability of natural ecosystems to absorb the impact of human actions. The quality of subtropical living is challenged by the mounting pressures of population growth and rapid urbanization yet urban form and contemporary building design fail to take advantage of the subtropical zone’s natural attributes of abundant sunshine, cooling breezes and warm temperatures. Yet, by building a global network of local knowledge, subtropical cities like Brisbane, the City of Gold Coast and Fort Lauderdale, are confidently leading the way with innovative and inventive solutions for building resiliency and adaptation to climate change. The Centre for Subtropical Design at Queensland University of Technology organized the first international Subtropical Cities conference in Brisbane, Australia, where the “fault-­‐lines” of subtropical cities at breaking points were revealed. The second conference, held in 2008, shed a more optimistic light with the theme "From fault-­‐lines to sight-­‐lines -­‐ subtropical urbanism in 20-­‐20" highlighting the leadership exemplified in the vitality of small and large works from around the subtropical world. Yet beyond these isolated local actions the need for more cooperation and collaboration was identified as the key to moving beyond the problems of the present and foreseeable future. The spirit of leadership and collaboration has taken on new force, as two institutions from opposite sides of the globe joined together to host the 3rd international conference Subtropical Cities 2011 -­‐ Subtropical Urbanism: Beyond Climate Change. The collaboration between Florida Atlantic University and the Queensland University of Technology to host this conference, for the first time in the United States, forges a new direction in international cooperative research to address urban design solutions that support sustainable behaviours, resiliency and adaptation to sea level rise, green house gas (GHG) reduction, and climate change research in the areas of architecture and urban design, planning, and public policy. With southeast Queensland and southern Florida as contributors to this global effort among subtropical urban regions that share similar challenges, opportunities, and vulnerabilities our mutual aim is to advance the development and application of local knowledge to the global problems we share. The conference attracted over 150 participants from four continents. Presentations by authors were organized into three sub-­‐themes: Cultural/Place Identity, Environment and Ecology, and Social Economics. Each of the 22 papers presented underwent a double-­‐blind peer review by a panel of international experts among the disciplines and research areas represented. The Centre for Subtropical Design at the Queensland University of Technology is leading Australia in innovative environmental design with a multi-­‐disciplinary focus on creating places that are ‘at home’ in the warm humid subtropics. The Broward Community Design Collaborative at Florida Atlantic University's College for Design and Social Inquiry has built an interdisciplinary collaboration that is unique in the United States among the units of Architecture, Urban and Regional Planning, Social Work, Public Administration, together with the College of Engineering and Computer Science, the College of Science, and the Center for Environmental Studies, to engage in funded action research through design inquiry to solve the problems of development for urban resiliency and environmental sustainment. As we move beyond debates about climate change -­‐ now acting upon us -­‐ the subtropical urban regions of the world will continue to convene to demonstrate the power of local knowledge against global forces, thereby inspiring us as we work toward everyday engagement and action that can make our cities more livable, equitable, and green.

Predictive motion planning for AUVs subject to strong time-varying currents and forecasting uncertainties

This paper presents a novel path planning method for minimizing the energy consumption of an autonomous underwater vehicle subjected to time varying ocean disturbances and forecast model uncertainty. The algorithm determines 4-Dimensional path candidates using Nonlinear Robust Model Predictive Control (NRMPC) and solutions optimised using A*-like algorithms. Vehicle performance limits are incorporated into the algorithm with disturbances represented as spatial and temporally varying ocean currents with a bounded uncertainty in their predictions. The proposed algorithm is demonstrated through simulations using a 4-Dimensional, spatially distributed time-series predictive ocean current model. Results show the combined NRMPC and A* approach is capable of generating energy-efficient paths which are resistant to both dynamic disturbances and ocean model uncertainty.

Can social resilience inform SA/SIA for adaptive planning for climate change in vulnerable regions?

This book represents a landmark effort to probe and analyze the theory and empirics of designing water disaster management policies. It consists of seven chapters that examine, in-depth and comprehensively, issues that are central to crafting effective policies for water disaster management. The authors use historical surveys, institutional analysis, econometric investigations, empirical case studies, and conceptual-theoretical discussions to clarify and illuminate the complex policy process. The specific topics studied in this book include a review and analysis of key policy areas and research priority areas associated with water disaster management, community participation in disaster risk reduction, the economics and politics of ‘green’ flood control, probabilistic flood forecasting for flood risk management, polycentric governance and flood risk management, drought management with the aid of dynamic inter-generational preferences, and how social resilience can inform SA/SIA for adaptive planning for climate change in vulnerable areas. A unique feature of this book is its analysis of the causes and consequences of water disasters and efforts to address them successfully through policy-rich, cross-disciplinary and transnational papers. This book is designed to help enrich the sparse discourse on water disaster management policies and galvanize water professionals to craft creative solutions to tackle water disasters efficiently, equitably, and sustainably. This book should also be of considerable use to disaster management professionals, in general, and natural resource policy analysts.

Collaborative learning model of infrastructure construction: A capability perspective

Purpose Performance heterogeneity between collaborative infrastructure projects is typically examined by considering procurement systems and their governance mechanisms at static points in time. The literature neglects to consider the impact of dynamic learning capability, which is thought to reconfigure governance mechanisms over time in response to evolving market conditions. This conceptual paper proposes a new model to show how continuous joint learning of participant organisations improves project performance. Design/methodology/approach There are two stages of conceptual development. In the first stage, the management literature is analysed to explain the Standard Model of dynamic learning capability that emphasises three learning phases for organisations. This Standard Model is extended to derive a novel Circular Model of dynamic learning capability that shows a new feedback loop between performance and learning. In the second stage, the construction management literature is consulted, adding project lifecycle, stakeholder diversity and three organisational levels to the analysis, to arrive at the Collaborative Model of dynamic learning capability. Findings The Collaborative Model should enable construction organisations to successfully adapt and perform under changing market conditions. The complexity of learning cycles results in capabilities that are imperfectly imitable between organisations, explaining performance heterogeneity on projects. Originality/value The Collaborative Model provides a theoretically substantiated description of project performance, driven by the evolution of procurement systems and governance mechanisms. The Model’s empirical value will be tested in future research.

Advance care planning in stroke: Influence of time on engagement in the process

Purpose Individuals who experience stroke have a higher likelihood of subsequent stroke events, making it imperative to plan for future medical care. In the event of a further serious health event, engaging in the process of advanced care planning (ACP) can help family members and health care professionals (HCPs) make medical decisions for individuals who have lost the capacity to do so. Few studies have explored the views and experiences of patients with stroke about discussing their wishes and preferences for future medical events, and the extent to which stroke HCPs engage in conversations around planning for such events. In this study, we sought to understand how the process of ACP unfolded between HCPs and patients post-stroke. Patients and methods Using grounded theory (GT) methodology, we engaged in direct observation of HCP and patient interactions on an acute stroke unit and two stroke rehabilitation units. Using semi-structured interviews, 14 patients and four HCPs were interviewed directly about the ACP process. Results We found that open and continual ACP conversations were not taking place, patients experienced an apparent lack of urgency to engage in ACP, and HCPs were uncomfortable initiating ACP conversations due to the sensitive nature of the topic. Conclusion In this study, we identified lack of engagement in ACP post-stroke, attributable to patient and HCP factors. This encourages us to look further into the process of ACP in order to develop open communication between the patient with stroke, their families, and stroke HCPs.

Evaluating the level of stakeholder involvement during the project planning processes of building projects

The purpose of this study is to examine the current level of stakeholder involvement during the project's planning process. Stakeholders often provide the needed resources and have the ability to control the interaction and resource flows in the network. They also ultimately have strong impact on an organisation's survival, and therefore appropriate management and involvement of key stakeholders should be an important part of any project management plan. A series of literature reviews was conducted to identify and categorise significant phases involved in the planning. For data collection, a questionnaire survey was designed and distributed amongst nearly 200 companies who were involved in the residential building sector in Australia. Results of the analysis demonstrate the engagement levels of the four stakeholder groups involved in the planning process and establish a basis for further stakeholder involvement improvement.

Natural hazards and land use planning: How resilient must a landowner be?

The past decade has seen an increase in the occurrence of natural hazards and the experience in Australia has led to a reconsideration of the planning for natural hazards by government and to the adoption of a whole-of-nation resilience-based approach to disaster management. A key component of creating community resilience is the integration of disaster management with government and community strategic planning in relation to the social, built, economic and natural environments. Joint responsibility of government and the community for ‘land use planning systems and building control arrangements [which] reduce, as far as is practicable, community exposure to unreasonable risks from known hazards’, is a critical element of a resilient community. As the responsibility for the implementation of land use planning policies in Australia is generally with local governments, this paper will examine whether, in light of improved predictive technology, the failure of a local government to adequately foresee and make provision for a known hazard will give rise to liability for damage or loss of property caused by that hazard.

Scenario planning and emerging global trends for the future of roads and automobile transport

Roads and road infrastructure will be faced with multiple challenges over the coming decades – challenges that in many ways bear little resemblance to those previously faced - and as such will require new approaches. The opportunity exists to transform the way road infrastructure is conceived and constructed, as a key part of the process of assisting society to respond to climate change and reduce other environmental pressures. Innovations in road construction, use and management in order to manage these changes can now be seen. Scenario planning is one tool that can take into account emerging challenges, develop or adopt new approaches, and thus help this transformation to occur. The paper explores scenario planning methodologies, global innovations and trends in road construction and maintenance and the findings from stakeholder workshops in Brisbane and Perth. It highlights key opportunities for road agencies to use scenarios to enable planning that, in the face of future uncertainties, facilitates appropriate responses.

An exploratory study into managing value creation in tourism service firms: Understanding value creation phases at the intersection of the tourism service firm and their customers

To satisfy customers, managers of tourism services need to understand their customers' value requirements and then develop a unique service value offering based on those requirements. This understanding underpins their effort to provide superior value to customers and deliver the proposed services through employees. Problematically, previous work on value creation (i.e. customer value) has focused separately on either the firm or customer. This theoretical separation does not allow investigation of whether there may be discrepancies between what value firms offer and what value customers perceive they have received. We bring tourism service firms (manager and employee) and customers together and examine the nature of a tourism service provider's value proposition, its contribution to the value offering, and subsequent impact on customers' perceived-value-in-use. We focus on the important role that employees play as boundary spanning workers in the value creation phases, linking the tourism service provider and customer.