Intelligent physical modelling systems - Why?

“What did you think you were doing?” Was the question posed by the conference organizers to me as the inventor and constructor of the first working Tangible Interfaces over 40 years ago. I think the question was intended to encourage me to talk about the underlying ideas and intentionality rather than describe an endless sequence of electronic bricks and that is what I shall do in this presentation. In the sixties the prevalent idea for a graphics interface was an analogue with sketching which was to somehow be understood by the computer as three dimensional form. I rebelled against this notion for reasons which I will explain in the presentation and instead came up with tangible physical three dimensional intelligent objects. I called these first prototypes “Intelligent Physical Modelling Systems” which is a really dumb name for an obvious concept. I am eternally grateful to Hiroshi Ishii for coining the term “Tangible User Interfaces” - the same idea but with a much smarter name. Another motivator was user involvement in the design process, and that led to the Generator (1979) project with Cedric Price for the world’s first intelligent building capable of organizing itself in response to the appetites of the users. The working model of that project is in MoMA. And the same motivation led to a self builders design kit (1980) for Walter Segal which facilitated self-builders to design their own houses. And indeed as the organizer’s question implied, the motivation and intentionality of these projects developed over the years in step with advancing technology. The speaker will attempt to articulate these changes with medical, psychological and educational examples. Much of this later work indeed stemming from the Media Lab where we are talking. Related topics such as “tangible thinking” and “intelligent teacups” will be introduced and the presentation will end with some speculations for the future. The presentation will be given against a background of images of early prototypes many of which have never been previously published.

Relationships between user experience and intuitiveness of visual and physical interactions

This paper investigates the effects of experience on the intuitiveness of physical and visual interactions performed by airport security screeners. Using portable eye tracking glasses, 40 security screeners were observed in the field as they performed search, examination and interface interactions during airport security x-ray screening. Data from semi structured interviews was used to further explore the nature of visual and physical interactions. Results show there are positive relationships between experience and the intuitiveness of visual and physical interactions performed by security screeners. As experience is gained, security screeners are found to perform search, examination and interface interactions more intuitively. In addition to experience, results suggest that intuitiveness is affected by the nature and modality of activities performed. This inference was made based on the dominant processing styles associated with search and examination activities. The paper concludes by discussing the implications that this research has for the design of visual and physical interfaces. We recommend designing interfaces that build on users’ already established intuitive processes, and that reduce the cognitive load incurred during transitions between visual and physical interactions.

On the Front Line: frontal zones as priority at-sea conservation areas for mobile marine vertebrates

1.Identifying priority areas for marine vertebrate conservation is complex because species of conservation concern are highly mobile, inhabit dynamic habitats and are difficult to monitor. 2.Many marine vertebrates are known to associate with oceanographic fronts – physical interfaces at the transition between water masses – for foraging and migration, making them important candidate sites for conservation. Here, we review associations between marine vertebrates and fronts and how they vary with scale, regional oceanography and foraging ecology. 3.Accessibility, spatiotemporal predictability and relative productivity of front-associated foraging habitats are key aspects of their ecological importance. Predictable mesoscale (10s–100s km) regions of persistent frontal activity (‘frontal zones’) are particularly significant. 4.Frontal zones are hotspots of overlap between critical habitat and spatially explicit anthropogenic threats, such as the concentration of fisheries activity. As such, they represent tractable conservation units, in which to target measures for threat mitigation. 5.Front mapping via Earth observation (EO) remote sensing facilitates identification and monitoring of these hotspots of vulnerability. Seasonal or climatological products can locate biophysical hotspots, while near-real-time front mapping augments the suite of tools supporting spatially dynamic ocean management. 6.Synthesis and applications. Frontal zones are ecologically important for mobile marine vertebrates. We surmise that relative accessibility, predictability and productivity are key biophysical characteristics of ecologically significant frontal zones in contrasting oceanographic regions. Persistent frontal zones are potential priority conservation areas for multiple marine vertebrate taxa and are easily identifiable through front mapping via EO remote sensing. These insights are useful for marine spatial planning and marine biodiversity conservation, both within Exclusive Economic Zones and in the open oceans.

Do oceanic loggerhead turtles Caretta caretta associate with oceanographic fronts? Evidence from the Canary Current Large Marine Ecosystem

ABSTRACT: Oceanographic fronts are physical interfaces between water masses that differ in properties such as temperature, salinity, turbidity and chl a enrichment. Bio-physical coupling along fronts can lead to the development of pelagic biodiversity hotspots. A diverse range of marine vertebrates have been shown to associate with fronts, using them as foraging and migration habitats. Elucidation of the ecological significance of fronts generates a better understanding of marine ecosystem functioning, conferring opportunities to improve management of anthropogenic activities in the oceans. This study presents novel insight into the oceanographic drivers of habitat use in a population of marine turtles characterised by an oceanic-neritic foraging dichotomy. Using satellite tracking data from adult female loggerhead turtles nesting at Cape Verde (n = 12), we test the hypothesis that oceanic-foraging loggerheads associate with mesocale (10s – to 100s of km) thermal fronts. We use high-resolution (1 km) composite front mapping to characterise frontal activity in the Canary Current Large Marine Ecosystem (LME) over 2 temporal scales: (1) seasonal front frequency and (2) 7-day front metrics. Our use-availability analysis indicates that oceanic loggerheads show a preference for the highly productive upwelling region between Cape Verde and mainland Africa, an area of intense frontal activity. Within the upwelling region, turtles appear to forage epipelagically around mesoscale thermal fronts, exploiting profitable foraging opportunities resulting from physical aggregation of prey.

Basking sharks and oceanographic fronts: quantifying associations in the north‐east Atlantic

Understanding the mechanisms linking oceanographic processes and marine vertebrate habitat use is critical to effective management of populations of conservation concern. The basking shark Cetorhinus maximus has been shown to associate with oceanographic fronts – physical interfaces at the transitions between water masses – to exploit foraging opportunities resulting from aggregation of zooplankton. However, the scale, significance and variability of these observed associations have not yet been established. Here, we quantify the influence of mesoscale (10s – 100s km) frontal activity on habitat use over timescales of weeks to months. We use animal-mounted archival tracking with composite front mapping via Earth Observation (EO) remote sensing to provide an oceanographic context to individual shark movements. We investigate levels of association with fronts occurring over two spatio-temporal scales, (i) broad-scale seasonally persistent frontal zones and (ii) contemporaneous mesoscale thermal and chl-a fronts. Using random walk simulations and logistic regression within an iterative generalised linear mixed modelling (GLMM) framework, we find that seasonal front frequency is a significant predictor of shark presence. Temporally-matched oceanographic metrics also indicate that sharks demonstrate a preference for productive regions, and associate with contemporaneous thermal and chl-a fronts more frequently than could be expected at random. Moreover, we highlight the importance of cross-frontal temperature change and persistence, which appear to interact to affect the degree of prey aggregation along thermal fronts. These insights have clear implications for understanding the preferred habitats of basking sharks in the context of anthropogenic threat management and marine spatial planning in the northeast Atlantic.

Do oceanic loggerhead turtles Caretta caretta associate with oceanographic fronts? Evidence from the Canary Current Large Marine Ecosystem

ABSTRACT: Oceanographic fronts are physical interfaces between water masses that differ in properties such as temperature, salinity, turbidity and chl a enrichment. Bio-physical coupling along fronts can lead to the development of pelagic biodiversity hotspots. A diverse range of marine vertebrates have been shown to associate with fronts, using them as foraging and migration habitats. Elucidation of the ecological significance of fronts generates a better understanding of marine ecosystem functioning, conferring opportunities to improve management of anthropogenic activities in the oceans. This study presents novel insight into the oceanographic drivers of habitat use in a population of marine turtles characterised by an oceanic-neritic foraging dichotomy. Using satellite tracking data from adult female loggerhead turtles nesting at Cape Verde (n = 12), we test the hypothesis that oceanic-foraging loggerheads associate with mesocale (10s – to 100s of km) thermal fronts. We use high-resolution (1 km) composite front mapping to characterise frontal activity in the Canary Current Large Marine Ecosystem (LME) over 2 temporal scales: (1) seasonal front frequency and (2) 7-day front metrics. Our use-availability analysis indicates that oceanic loggerheads show a preference for the highly productive upwelling region between Cape Verde and mainland Africa, an area of intense frontal activity. Within the upwelling region, turtles appear to forage epipelagically around mesoscale thermal fronts, exploiting profitable foraging opportunities resulting from physical aggregation of prey.

Basking sharks and oceanographic fronts: quantifying associations in the north-east Atlantic

Understanding the mechanisms linking oceanographic processes and marine vertebrate habitat use is critical to effective management of populations of conservation concern. The basking shark Cetorhinus maximus has been shown to associate with oceanographic fronts – physical interfaces at the transitions between water masses – to exploit foraging opportunities resulting from aggregation of zooplankton. However, the scale, significance and variability of these observed associations have not yet been established. Here, we quantify the influence of mesoscale (10s – 100s km) frontal activity on habitat use over timescales of weeks to months. We use animal-mounted archival tracking with composite front mapping via Earth Observation (EO) remote sensing to provide an oceanographic context to individual shark movements. We investigate levels of association with fronts occurring over two spatio-temporal scales, (i) broad-scale seasonally persistent frontal zones and (ii) contemporaneous mesoscale thermal and chl-a fronts. Using random walk simulations and logistic regression within an iterative generalised linear mixed modelling (GLMM) framework, we find that seasonal front frequency is a significant predictor of shark presence. Temporally-matched oceanographic metrics also indicate that sharks demonstrate a preference for productive regions, and associate with contemporaneous thermal and chl-a fronts more frequently than could be expected at random. Moreover, we highlight the importance of cross-frontal temperature change and persistence, which appear to interact to affect the degree of prey aggregation along thermal fronts. These insights have clear implications for understanding the preferred habitats of basking sharks in the context of anthropogenic threat management and marine spatial planning in the northeast Atlantic.

Basking sharks and oceanographic fronts: quantifying associations in the north-east Atlantic

Understanding the mechanisms linking oceanographic processes and marine vertebrate habitat use is critical to effective management of populations of conservation concern. The basking shark Cetorhinus maximus has been shown to associate with oceanographic fronts – physical interfaces at the transitions between water masses – to exploit foraging opportunities resulting from aggregation of zooplankton. However, the scale, significance and variability of these observed associations have not yet been established. Here, we quantify the influence of mesoscale (10s – 100s km) frontal activity on habitat use over timescales of weeks to months. We use animal-mounted archival tracking with composite front mapping via Earth Observation (EO) remote sensing to provide an oceanographic context to individual shark movements. We investigate levels of association with fronts occurring over two spatio-temporal scales, (i) broad-scale seasonally persistent frontal zones and (ii) contemporaneous mesoscale thermal and chl-a fronts. Using random walk simulations and logistic regression within an iterative generalised linear mixed modelling (GLMM) framework, we find that seasonal front frequency is a significant predictor of shark presence. Temporally-matched oceanographic metrics also indicate that sharks demonstrate a preference for productive regions, and associate with contemporaneous thermal and chl-a fronts more frequently than could be expected at random. Moreover, we highlight the importance of cross-frontal temperature change and persistence, which appear to interact to affect the degree of prey aggregation along thermal fronts. These insights have clear implications for understanding the preferred habitats of basking sharks in the context of anthropogenic threat management and marine spatial planning in the northeast Atlantic.

Smart material interfaces : a new form of physical interaction

Smart Material Interface (SMI) is the latest generation of user interface that makes use of engineered materials and leverages their special properties. SMIs are capable of changing their physical properties such as shape, size and color, and can be controlled under certain (external) conditions. We provide an example of such an SMI in the form of a prototype of a vacuum cleaner. The prototype uses schematic electrochromic polymer at the suction nozzle of the vacuum cleaner, which changes its color depending on the dust level on a floor. We emphasize on the new affordances and communication language supported by SMIs, which challenges the current metaphors of user interfaces in the field of HCI.

Tangible interfaces to explain Gaudi's use of ruled-surface geometries

This paper summarises the development of a machine-readable model series for explaining Gaudi's use of ruled surface geometry in the Sagrada Familia in Barcelona, Spain. The first part discusses the modeling methods underlying the columns of the cathedral and the techniques required to translate them into built structures. The second part discusses the design and development of a tangible machine-readable model to explain column-modeling methods interactively in educational contexts such as art exhibitions. It is designed to explain the principles underlying the column design by means of physical interaction without using mathematical terms or language.

A process for the management of physical infrastructure

Physical infrastructure assets are important components of our society and our economy. They are usually designed to last for many years, are expected to be heavily used during their lifetime, carry considerable load, and are exposed to the natural environment. They are also normally major structures, and therefore present a heavy investment, requiring constant management over their life cycle to ensure that they perform as required by their owners and users. Given a complex and varied infrastructure life cycle, constraints on available resources, and continuing requirements for effectiveness and efficiency, good management of infrastructure is important. While there is often no one best management approach, the choice of options is improved by better identification and analysis of the issues, by the ability to prioritise objectives, and by a scientific approach to the analysis process. The abilities to better understand the effect of inputs in the infrastructure life cycle on results, to minimise uncertainty, and to better evaluate the effect of decisions in a complex environment, are important in allocating scarce resources and making sound decisions. Through the development of an infrastructure management modelling and analysis methodology, this thesis provides a process that assists the infrastructure manager in the analysis, prioritisation and decision making process. This is achieved through the use of practical, relatively simple tools, integrated in a modular flexible framework that aims to provide an understanding of the interactions and issues in the infrastructure management process. The methodology uses a combination of flowcharting and analysis techniques. It first charts the infrastructure management process and its underlying infrastructure life cycle through the time interaction diagram, a graphical flowcharting methodology that is an extension of methodologies for modelling data flows in information systems. This process divides the infrastructure management process over time into self contained modules that are based on a particular set of activities, the information flows between which are defined by the interfaces and relationships between them. The modular approach also permits more detailed analysis, or aggregation, as the case may be. It also forms the basis of ext~nding the infrastructure modelling and analysis process to infrastructure networks, through using individual infrastructure assets and their related projects as the basis of the network analysis process. It is recognised that the infrastructure manager is required to meet, and balance, a number of different objectives, and therefore a number of high level outcome goals for the infrastructure management process have been developed, based on common purpose or measurement scales. These goals form the basis of classifYing the larger set of multiple objectives for analysis purposes. A two stage approach that rationalises then weights objectives, using a paired comparison process, ensures that the objectives required to be met are both kept to the minimum number required and are fairly weighted. Qualitative variables are incorporated into the weighting and scoring process, utility functions being proposed where there is risk, or a trade-off situation applies. Variability is considered important in the infrastructure life cycle, the approach used being based on analytical principles but incorporating randomness in variables where required. The modular design of the process permits alternative processes to be used within particular modules, if this is considered a more appropriate way of analysis, provided boundary conditions and requirements for linkages to other modules, are met. Development and use of the methodology has highlighted a number of infrastructure life cycle issues, including data and information aspects, and consequences of change over the life cycle, as well as variability and the other matters discussed above. It has also highlighted the requirement to use judgment where required, and for organisations that own and manage infrastructure to retain intellectual knowledge regarding that infrastructure. It is considered that the methodology discussed in this thesis, which to the author's knowledge has not been developed elsewhere, may be used for the analysis of alternatives, planning, prioritisation of a number of projects, and identification of the principal issues in the infrastructure life cycle.

Workshop on HCI and game interfaces : a long romance

This full day workshop invites participants to consider the nexus where the interests of game design, the expectations of play and HCI meet: the game interface. Game interfaces seem different to the interface to other software and there have been a number of observations. Shneiderman famously noticed that while most software designers are intent on following the tenets of the “invisible computer” and making access easy for the user, games inter-faces are made for players: they embed challenge. Schell discusses a “strange” relationship between the player and the game enabled by the interface and user interface designers frequently opine that much can be learned from the design of game interfaces. So where does the game interface actually sit? Even more interesting is the question as to whether the history of the relationship and sub-sequent expectations are now limiting the potential of game design as an expressive form. Recent innovations in I/O design such as Nintendo’s Wii, Sony’s Move and Microsoft's Kinect seem to usher in an age of physical player-enabled interaction, experience and embodied, engaged design. This workshop intends to cast light on this often mentioned and sporadically examined area and to establish a platform for new and innovative design in the field.