Context-free and context-sensitive dynamics in recurrent neural networks

Continuous-valued recurrent neural networks can learn mechanisms for processing context-free languages. The dynamics of such networks is usually based on damped oscillation around fixed points in state space and requires that the dynamical components are arranged in certain ways. It is shown that qualitatively similar dynamics with similar constraints hold for a(n)b(n)c(n), a context-sensitive language. The additional difficulty with a(n)b(n)c(n), compared with the context-free language a(n)b(n), consists of 'counting up' and 'counting down' letters simultaneously. The network solution is to oscillate in two principal dimensions, one for counting up and one for counting down. This study focuses on the dynamics employed by the sequential cascaded network, in contrast to the simple recurrent network, and the use of backpropagation through time. Found solutions generalize well beyond training data, however, learning is not reliable. The contribution of this study lies in demonstrating how the dynamics in recurrent neural networks that process context-free languages can also be employed in processing some context-sensitive languages (traditionally thought of as requiring additional computation resources). This continuity of mechanism between language classes contributes to our understanding of neural networks in modelling language learning and processing.

On learning context-free and context-sensitive languages

The long short-term memory (LSTM) is not the only neural network which learns a context sensitive language. Second-order sequential cascaded networks (SCNs) are able to induce means from a finite fragment of a context-sensitive language for processing strings outside the training set. The dynamical behavior of the SCN is qualitatively distinct from that observed in LSTM networks. Differences in performance and dynamics are discussed.

Predictive genetic test decisions for Huntington's disease: context, appraisal and new moral imperatives

Predictive testing is one of the new genetic technologies which, in conjunction with developing fields such as pharmacogenomics, promises many benefits for preventive and population health. Understanding how individuals appraise and make genetic test decisions is increasingly relevant as the technology expands. Lay understandings of genetic risk and test decision-making, located within holistic life frameworks including family or kin relationships, may vary considerably from clinical representations of these phenomena. The predictive test for Huntington's disease (HD), whilst specific to a single-gene, serious, mature-onset but currently untreatable disorder, is regarded as a model in this context. This paper reports upon a qualitative Australian study which investigated predictive test decision-making by individuals at risk for HD, the contexts of their decisions and the appraisals which underpinned them. In-depth interviews were conducted in Australia with 16 individuals at 50% risk for HD, with variation across testing decisions, gender, age and selected characteristics. Findings suggested predictive testing was regarded as a significant life decision with important implications for self and others, while the right not to know genetic status was staunchly and unanimously defended. Multiple contexts of reference were identified within which test decisions were located, including intra- and inter-personal frameworks, family history and experience of HID, and temporality. Participants used two main criteria in appraising test options: perceived value of, or need for the test information, for self and/or significant others, and degree to which such information could be tolerated and managed, short and long-term, by self and/or others. Selected moral and ethical considerations involved in decision-making are examined, as well as the clinical and socio-political contexts in which predictive testing is located. The paper argues that psychosocial vulnerabilities generated by the availability of testing technologies and exacerbated by policy imperatives towards individual responsibility and self-governance should be addressed at broader societal levels. (C) 2003 Elsevier Science Ltd. All rights reserved.

Vertical handover supporting pervasive computing in future wireless networks

A variety of current and future wired and wireless networking technologies can be transformed into a seamless communication environments through application of context-based vertical handovers. Such seamless communication environments are needed for future pervasive/ubiquitous systems. Pervasive systems are context aware and need to adapt to context changes, including network disconnections and changes in network Quality of Service (QoS). Vertical handover is one of many possible adaptation methods. It allows users to roam freely between heterogeneous networks while maintaining the continuity of their applications. This paper proposes a vertical handover mechanism suitable for multimedia applications in pervasive systems. The paper focuses on the handover decision making process which uses context information regarding user devices, user location, network environment and requested QoS. (C) 2004 Elsevier B.V. All rights reserved.

Vertical handovers as adaption methods in pervasive systems

Pervasive systems need to be context aware and need to adapt to context changes, including network disconnections and changes in network Quality of Service (QoS). Vertical handover (handover between heterogeneous networks) is one of possible adaptation methods. It allows users to roam freely between heterogeneous networks while maintaining continuity of their applications. This paper proposes a vertical handover approach suitable for multimedia applications in pervasive systems. It describes the adaptability decision making process which uses vertical handovers to support users mobility and provision of QoS suitable for users’ applications. The process evaluates context information regarding user devices, User location, network environment, and user perceived QoS of applications.

Modelling and using imperfect context information

Most recently developed context-aware software applicationsmake unrealistic assumptions about the quality of the available context information, which can lead to inappropriate actions by the application and frustration on the part of the user. In this paper, we explore the problem of imperfect context information and some of its causes, and propose a novel approach for modelling incomplete and inaccurate information. Additionally, we present a discussion of our experiences in developing a contextaware communication application, highlighting design issues that are pertinent when developing applications that rely on imperfect context information.

Context obfuscation for privacy via ontological descriptions

Context information is used by pervasive networking and context-aware programs to adapt intelligently to different environments and user tasks. As the context information is potentially sensitive, it is often necessary to provide privacy protection mechanisms for users. These mechanisms are intended to prevent breaches of user privacy through unauthorised context disclosure. To be effective, such mechanisms should not only support user specified context disclosure rules, but also the disclosure of context at different granularities. In this paper we describe a new obfuscation mechanism that can adjust the granularity of different types of context information to meet disclosure requirements stated by the owner of the context information. These requirements are specified using a preference model we developed previously and have since extended to provide granularity control. The obfuscation process is supported by our novel use of ontological descriptions that capture the granularity relationship between instances of an object type.

Modelling context information with ORM

Context-aware applications rely on implicit forms of input, such as sensor-derived data, in order to reduce the need for explicit input from users. They are especially relevant for mobile and pervasive computing environments, in which user attention is at a premium. To support the development of context-aware applications, techniques for modelling context information are required. These must address a unique combination of requirements, including the ability to model information supplied by both sensors and people, to represent imperfect information, and to capture context histories. As the field of context-aware computing is relatively new, mature solutions for context modelling do not exist, and researchers rely on information modelling solutions developed for other purposes. In our research, we have been using a variant of Object-Role Modeling (ORM) to model context. In this paper, we reflect on our experiences and outline some research challenges in this area.

Towards a standards-based autonomic context management system

Pervasive computing applications must be sufficiently autonomous to adapt their behaviour to changes in computing resources and user requirements. This capability is known as context-awareness. In some cases, context-aware applications must be implemented as autonomic systems which are capable of dynamically discovering and replacing context sources (sensors) at run-time. Unlike other types of application autonomy, this kind of dynamic reconfiguration has not been sufficiently investigated yet by the research community. However, application-level context models are becoming common, in order to ease programming of context-aware applications and support evolution by decoupling applications from context sources. We can leverage these context models to develop general (i.e., application-independent) solutions for dynamic, run-time discovery of context sources (i.e., context management). This paper presents a model and architecture for a reconfigurable context management system that supports interoperability by building on emerging standards for sensor description and classification.

Experimental manipulation of prior experience: Effects on item and associative recognition

Frequency of exposure to very low- and high-frequency words was manipulated in a three-phase (familiarisation, study, and test) design. During familiarisation, words were presented with their definition (once, four times, or not presented). One week (Experiment 1) or one day (Experiment 2) later, participants studied a list of homogeneous pairs (i.e., pair members were matched on background and familiarisation frequency). Item and associative recognition of high- and very low-frequency words presented in intact, rearranged, old-new, or new-new pairs were tested in Experiment 1. Associative recognition of very low-frequency words was tested in Experiment 2. Results showed that prior familiaris ation improved associative recognition of very low-frequency pairs, but had no effect on high-frequency pairs. The role of meaning in the formation of item-to-item and item-to-context associations and the implications for current models of memory are discussed.

The International Consortium on Mental Health Policy and Services: objectives, design and project implementation

The concept of the burden of disease, introduced and estimated for a broad range of diseases in the World Bank report of 1993 illustrated that mental and neurological disorders not only entail a higher burden than cancer, but are responsible, in developed and developing countries, for more than 15% of the total burden of all diseases. As a consequence, over the past decade, mental disorders have ranked increasingly highly on the international agenda for health. However, the fact that mental health and nervous system disorders are now high on the international health agenda is by no means a guarantee that the fate of patients suffering from these disorders in developing countries will improve. In most developing countries the treatment gap for mental and neurological disorders is still unacceptably high. To address this problem, an international network of collaborating institutions in low-income countries has been set up. The establishment and the achievements of this network-the International Consortium on Mental Health Policy and Services-are reported. Sixteen institutions in developing countries collaborate (supported by a small number of scientific resource centres in industrialized nations) in projects on applied mental health systems research. Over a two-year period, the network produced the key elements of a national mental health policy; provided tools and methods for assessing a country's current mental health status (context, needs and demands, programmes, services and care and outcomes); established a global network of expertise, i.e., institutions and experts, for use by countries wishing to reform their mental health policy, services and care; and generated guidelines and examples for upgrading mental health policy with due regard to the existing mental health delivery system and demographic, cultural and economic factors.

Archaeology and age of a new hominin from Flores in eastern Indonesia

Excavations at Liang Bua, a large limestone cave on the island of Flores in eastern Indonesia, have yielded evidence for a population of tiny hominins, sufficiently distinct anatomically to be assigned to a new species, Homo floresiensis(1). The finds comprise the cranial and some post-cranial remains of one individual, as well as a premolar from another individual in older deposits. Here we describe their context, implications and the remaining archaeological uncertainties. Dating by radiocarbon (C-14), luminescence, uranium-series and electron spin resonance (ESR) methods indicates that H. floresiensis existed from before 38,000 years ago (kyr) until at least 18 kyr. Associated deposits contain stone artefacts and animal remains, including Komodo dragon and an endemic, dwarfed species of Stegodon. H. floresiensis originated from an early dispersal of Homo erectus ( including specimens referred to as Homo ergaster and Homo georgicus)(1) that reached Flores, and then survived on this island refuge until relatively recently. It overlapped significantly in time with Homo sapiens in the region(2,3), but we do not know if or how the two species interacted.