Learning higher-level features with convolutional restricted Boltzmann machines for sentiment analysis

In recent years, learning word vector representations has attracted much interest in Natural Language Processing. Word representations or embeddings learned using unsupervised methods help addressing the problem of traditional bag-of-word approaches which fail to capture contextual semantics. In this paper we go beyond the vector representations at the word level and propose a novel framework that learns higher-level feature representations of n-grams, phrases and sentences using a deep neural network built from stacked Convolutional Restricted Boltzmann Machines (CRBMs). These representations have been shown to map syntactically and semantically related n-grams to closeby locations in the hidden feature space. We have experimented to additionally incorporate these higher-level features into supervised classifier training for two sentiment analysis tasks: subjectivity classification and sentiment classification. Our results have demonstrated the success of our proposed framework with 4% improvement in accuracy observed for subjectivity classification and improved the results achieved for sentiment classification over models trained without our higher level features.

The political discourse and material practice of technology enhanced learning

Technology discloses man’s mode of dealing with Nature, the process of production by which he sustains his life, and thereby also lays bare the mode of formation of his social relations, and of the mental conceptions that flow from them (Marx, 1990: 372) My thesis is a Sociological analysis of UK policy discourse for educational technology during the last 15 years. My framework is a dialogue between the Marxist-based critical social theory of Lieras and a corpus-based Critical Discourse Analysis (CDA) of UK policy for Technology Enhanced Learning (TEL) in higher education. Embedded in TEL is a presupposition: a deterministic assumption that technology has enhanced learning. This conceals a necessary debate that reminds us it is humans that design learning, not technology. By omitting people, TEL provides a vehicle for strong hierarchical or neoliberal, agendas to make simplified claims politically, in the name of technology. My research has two main aims: firstly, I share a replicable, mixed methodological approach for linguistic analysis of the political discourse of TEL. Quantitatively, I examine patterns in my corpus to question forms of ‘use’ around technology that structure a rigid basic argument which ‘enframes’ educational technology (Heidegger, 1977: 38). In a qualitative analysis of findings, I ask to what extent policy discourse evaluates technology in one way, to support a Knowledge Based Economy (KBE) in a political economy of neoliberalism (Jessop 2004, Fairclough 2006). If technology is commodified as an external enhancement, it is expected to provide an ‘exchange value’ for learners (Marx, 1867). I therefore examine more closely what is prioritised and devalued in these texts. Secondly, I disclose a form of austerity in the discourse where technology, as an abstract force, undertakes tasks usually ascribed to humans (Lieras, 1996, Brey, 2003:2). This risks desubjectivisation, loss of power and limits people’s relationships with technology and with each other. A view of technology in political discourse as complete without people closes possibilities for broader dialectical (Fairclough, 2001, 2007) and ‘convivial’ (Illich, 1973) understandings of the intimate, material practice of engaging with technology in education. In opening the ‘black box’ of TEL via CDA I reveal talking points that are otherwise concealed. This allows me as to be reflexive and self-critical through praxis, to confront my own assumptions about what the discourse conceals and what forms of resistance might be required. In so doing, I contribute to ongoing debates about networked learning, providing a context to explore educational technology as a technology, language and learning nexus.

Organisational change and safety culture: the impact of communication

This research examines and explains the links between safety culture and communication. Safety culture is a concept that in recent years has gained prominence but there has been little applied research conducted to investigate the meaning of the concept in 'real life' settings. This research focused on a Train Operating Company undergoing change in a move towards privatisation. These changes were evident in the management of safety, the organisation of the industry and internally in their management. The Train Operating Company's management took steps to improve their safety culture and communications through the development of a cascade communication structure. The research framework employed a qualitative methodology in order to investigate the effect of the new system on safety culture. Findings of the research were that communications in the organisation failed to be effective for a number of reasons, including both cultural and logistical problems. The cultural problems related to a lack of trust in the organisation by the management and the workforce, the perception of communications as management propaganda, and asyntonic communications between those involved, whilst logistical problems related to the inherent difficulties of communicating over a geographically distributed network. An organisational learning framework was used to explain the results. It is postulated that one of the principal reasons why change, either to the safety culture or to communications, did not occur was because of the organisation's inability to learn. The research has also shown the crucial importance of trust between the members of the organisation, as this was one of the fundamental reasons why the safety culture did not change, and why safety management systems were not fully implemented. This is consistent with the notion of mutual trust in the HSC (1993) definition of safety culture. This research has highlighted its relevance to safety culture and its importance for organisational change.

A novel framework of training hidden Markov support vector machines from lightly-annotated data

Natural language understanding (NLU) aims to map sentences to their semantic mean representations. Statistical approaches to NLU normally require fully-annotated training data where each sentence is paired with its word-level semantic annotations. In this paper, we propose a novel learning framework which trains the Hidden Markov Support Vector Machines (HM-SVMs) without the use of expensive fully-annotated data. In particular, our learning approach takes as input a training set of sentences labeled with abstract semantic annotations encoding underlying embedded structural relations and automatically induces derivation rules that map sentences to their semantic meaning representations. The proposed approach has been tested on the DARPA Communicator Data and achieved 93.18% in F-measure, which outperforms the previously proposed approaches of training the hidden vector state model or conditional random fields from unaligned data, with a relative error reduction rate of 43.3% and 10.6% being achieved.

Unresolved issues and new challenges in teaching English to young learners:the case of South Korea

The introduction of languages, especially English, into the primary curriculum around the world has been one of the major language-in-education policy developments in recent years. In countries where English has been compulsory for a number of years, the question arises as to what extent the numerous and well-documented challenges faced by the initial implementation of early language learning policies have been overcome and whether new challenges have arisen as policies have become consolidated. This article therefore focuses on South Korea, where English has been compulsory in primary school since 1997. The issues raised by the introduction of English into the primary curriculum are reviewed and the current situation in South Korea is investigated. The results of a mixed methods study using survey data from 125 Korean primary school teachers, together with data from a small-scale case study of one teacher are presented. The study shows that, while some of the initial problems caused by the introduction of early language learning appear to have been addressed, other challenges persist. Moreover, the data reveal the emergence of a number of new challenges faced by primary school teachers of English as they seek to implement government policy. © 2013 © 2013 Taylor & Francis.

The ‘first three years’ movement and the infant brain:a review of critiques

This article reviews a particular aspect of the critique of the increasing focus on the brain and neuroscience; what has been termed by some, 'neuromania'. It engages with the growing literature produced in response to the 'first three years' movement: an alliance of child welfare advocates and politicians that draws on the authority of neuroscience to argue that social problems such as inequality, poverty, educational underachievement, violence and mental illness are best addressed through 'early intervention' programmes to protect or enhance emotional and cognitive aspects of children's brain development. The movement began in the United States in the early 1990s and has become increasingly vocal and influential since then, achieving international legitimacy in the United States, Canada, New Zealand, Australia, the UK and elsewhere. The movement, and the brain-based culture of expert-led parent training that has grown with it, has been criticised for claiming scientific authority whilst taking a cavalier approach to scientific method and evidence; for being overly deterministic about the early years of life; for focusing attention on individual parental failings rather than societal or structural problems, for adding to the expanding anxieties of parents and strengthening the intensification of parenting and, ultimately, for redefining the parent-child relationship in biologised, instrumental and dehumanised terms. © 2014 John Wiley & Sons Ltd.

Semi-supervised learning of statistical models for natural language understanding

Natural language understanding is to specify a computational model that maps sentences to their semantic mean representation. In this paper, we propose a novel framework to train the statistical models without using expensive fully annotated data. In particular, the input of our framework is a set of sentences labeled with abstract semantic annotations. These annotations encode the underlying embedded semantic structural relations without explicit word/semantic tag alignment. The proposed framework can automatically induce derivation rules that map sentences to their semantic meaning representations. The learning framework is applied on two statistical models, the conditional random fields (CRFs) and the hidden Markov support vector machines (HM-SVMs). Our experimental results on the DARPA communicator data show that both CRFs and HM-SVMs outperform the baseline approach, previously proposed hidden vector state (HVS) model which is also trained on abstract semantic annotations. In addition, the proposed framework shows superior performance than two other baseline approaches, a hybrid framework combining HVS and HM-SVMs and discriminative training of HVS, with a relative error reduction rate of about 25% and 15% being achieved in F-measure.

Early hearing loss and language abilities in children with Down syndrome

BACKGROUND: Although many children with Down syndrome experience hearing loss, there has been little research to investigate its impact on speech and language development. Studies that have investigated the association give inconsistent results. These have often been based on samples where children with the most severe hearing impairments have been excluded and so results do not generalize to the wider population with Down syndrome. Also, measuring children's hearing at the time of a language assessment does not take into account the fluctuating nature of hearing loss in children with Down syndrome or possible effects of losses in their early years. AIMS: To investigate the impact of early hearing loss on language outcomes for children with Down syndrome. METHODS & PROCEDURES: Retrospective audiology clinic records and parent report for 41 children were used to categorize them as either having had hearing difficulties from 2 to 4 years or more normal hearing. Differences between the groups on measures of language expression and comprehension, receptive vocabulary, a narrative task and speech accuracy were investigated. OUTCOMES & RESULTS: After accounting for the contributions of chronological age and nonverbal mental age to children's scores, there were significant differences between the groups on all measures. CONCLUSIONS & IMPLICATIONS: Early hearing loss has a significant impact on the speech and language development of children with Down syndrome. Results suggest that speech and language therapy should be provided when children are found to have ongoing hearing difficulties and that joint audiology and speech and language therapy clinics could be considered for preschool children.

Le prix de l'individualité. Maine de Brian, Samuel Taylor Coleridge et la volonté: Deux postétités distinctes

This thesis is concerned with Maine de Biran’s and Samuel Taylor Coleridge’s conceptions of will, and the way in which both thinkers’ posterities have been affected by the central role of these very conceptions in their respective bodies of thought. The research question that animates this work can therefore be divided into two main parts, one of which deals with will, while the other deals with its effects on posterity. In the first pages of the Introduction, I make the case for a comparison between two philosophers, and show how this comparison can bring one closer to truth, understood not in objective, but in subjective terms. I then justify my choice by underlining that, in spite of their many differences, Maine de Biran and Samuel Taylor Coleridge followed comparable paths, intellectually and spiritually, and came to similar conclusions concerning the essential activity of the human mind. Finally, I ask whether it is possible that this very focus on the human will may have contributed to the state of both thinkers’ works and of the reception of those works. This prologue is followed by five parts. In the first part, the similarities and differences between the two thinkers are explored further. In the second part, the connections between philosophy and singularity are examined, in order to show the ambivalence of the will as a foundation for truth. The third part is dedicated to the traditional division between subject and object in psychology, and its relevance in history and in moral philosophy. The fourth part tackles the complexity of the question of influence, with respect to both Maine de Biran’s and Coleridge’s cases, both thinkers being indebted to many philosophers of all times and places, and having to rely heavily on others for the publication, or the interpretation of their own works. The fifth part is concerned with the different aspects of the faculty of will, and primarily its relationship with interiority, as incommensurability, and actual, conditioned existence in a certain historical and spatial context. It ends with a return to the question of will and posterity and an announcement of what will be covered in the main body of the thesis. The main body is divided into three parts:‘L’émancipation’, ‘L’affirmation, and ‘La projection’. The first part is devoted to the way Maine de Biran and Samuel Taylor Coleridge extricated themselves from one epistemological paradigm to contribute to the foundation of another. It is divided in four chapters. The first chapter deals with the aforementioned change of paradigm, as corresponding to the emergence of two separate but associated movements, Romanticism and what the French philosopher refers to as ‘The Age of History’. The second chapter concerns the movement that preceded them, i.e. the Enlightenment, its main features according to both of our thinkers, and the two epistemological models that prevailed under it and influenced them heavily in their early years: Sensationism (Maine de Biran) and Associationism (Coleridge). The third chapter is about the probable influence of Immanuel Kant and his followers on Maine de Biran and Coleridge, and the various facts that allow us to claim originality for both thinkers’ works. In the fourth chapter, I contrast Maine de Biran and Coleridge with other movements and thinkers of their time, showing that, contrary to their respective thoughts, Maine de Biran and Coleridge could not but break free from the then prevailing systematic approach to truth. The second part of the thesis is concerned with the first part of its research question, namely, Maine de Biran’s and Coleridge’s conceptions of the will. It is divided into four chapters. The first chapter is a reflection on the will as a paradox: on the one hand, the will cannot be caused by any other phenomenon, or it is no longer a will; but it cannot be left purely undetermined, as if it is, it is then not different from chance. It thus needs, in order to be, to be contradictorily already moral. The second chapter is a comparison between Maine de Biran’s and Coleridge’s accounts of the origin of the will, where it is found that the French philosopher only observes that he has a will, whereas the English philosopher postulates the existence of this will. The comparison between Maine de Biran’s and Coleridge’s conceptions of the will is pursued in the third chapter, which tackles the question of the coincidence between the will and the self, in both thinkers’ works. It ends with the fourth chapter, which deals with the question of the relationship between the will and what is other to it, i.e. bodily sensations, passions and desires. The third part of the thesis focuses on the second part of its research question, namely the posterity of Maine de Biran’s and Coleridge’s works. It is divided into four chapters. The first chapter constitutes a continuation of the last chapter of the preceding part, in that that it deals with Maine de Biran’s and Coleridge’s relations to the ‘other’, and particularly their potential and actual audience, and with the way these relations may have affected their writing and publishing practices. The second chapter is a survey of both thinkers’ general reception, where it is found that, while Maine de Biran has been claimed by two important movements of thoughts as their initiator, Coleridge has been neglected by the only real movement he could have, or may indeed have pioneered. The third chapter is more directly concerned with the posterities of Maine de Biran’s and Coleridge’s conceptions of will, and attempts to show that the approach to, and the meaning of the will have evolved throughout the nineteenth century, and in the French Spiritualist and the British Idealist movements, from an essentially personal one to a more impersonal one. The fourth chapter is a partial conclusion, whose aim is to give a precise idea of where Maine de Biran and Coleridge stand, in relation to their century and to the philosophical movements and matters we are concerned with. The conclusion is a recapitulation of what has been found, with a particular emphasis on the dialogue initiated between Maine de Biran and Coleridge on the will, and the relation between will and posterity. It suggests that both thinkers have to pay the price of a problematic reception for the individuality that pervades their respective works, and goes further in suggesting that s/he who chooses to found his individuality on the will is bound to feel this incompleteness in his/her own personal life more acutely than s/he who does not. It ends with a reflection on fixedness and movement, as the two antagonistic states that the theoretician of the will paradoxically aspires to.

Comparative risk of microalbuminuria and proteinuria in UK residents of south Asian and white European ethnic background with type 2 diabetes:a report from UKADS

Objective - This study investigated and compared the prevalence of microalbuminuria and overt proteinuria and their determinants in a cohort of UK resident patients of white European or south Asian ethnicity with type 2 diabetes mellitus. Research design and methods - A total of 1978 patients, comprising 1486 of south Asian and 492 of white European ethnicity, in 25 general practices in Coventry and Birmingham inner city areas in England were studied in a cross-sectional study. Demographic and risk factor data were collected and presence of microalbuminuria and overt proteinuria assessed. Main outcome measures - Prevalences of microalbuminuria and overt proteinuria. Results - Urinary albumin:creatinine measurements were available for 1852 (94%) patients. The south Asian group had a lower prevalence of microalbuminuria, 19% vs. 23% and a higher prevalence of overt proteinuria, 8% vs. 3%, X2?=?15.85, 2df, P?=?0.0004. In multiple logistic regression models, adjusted for confounding factors, significantly increased risk for the south Asian vs. white European patients for overt proteinuria was shown; OR (95% CI) 2.17 (1.05, 4.49), P?=?0.0365. For microalbuminuria, an interaction effect for ethnicity and duration of diabetes suggested that risk for south Asian patients was lower in early years following diagnosis; OR for SA vs. WH at durations 0 and 1 year were 0.56 (0.37, 0.86) and 0.59 (0.39, 0.89) respectively. After 20 years’ duration, OR?=?1.40 (0.63, 3.08). Limitations - Comparability of ethnicity defined groups; statistical methods controlled for differences between groups, but residual confounding may remain. Analyses are based on a single measure of albumin:creatinine ratio. Conclusions - There were significant differences between ethnicity groups in risk factor profiles and microalbuminuria and overt proteinuria outcomes. Whilst south Asian patients had no excess risk of microalbuminuria, the risk of overt proteinuria was elevated significantly, which might be explained by faster progression of renal dysfunction in patients of south Asian ethnicity.

Mothering and intellectual disability:partnership rhetoric?

This paper is about mothering an intellectually disabled child identified with special educational needs. It specifically looks at the parent partnership rhetoric that has dominated UK government policy and directives for nearly three decades and yet research suggests parents and more often mothers have to battle to be recognised as legitimate experts. This paper engages with sociological analysis as it highlights via qualitative narratives that mothers are weighed down by the sheer number of professionals involved in their day-to-day life. Moreover, mothers whose children are not identified in the early years are often blamed in the first instance for playing a part in their child’s difficult behaviour. This research ultimately suggests that partnership work is important and necessary for practice within health, education and social work professions, not least of all because the emotional roller-coaster that mothers experience during the assessment and statementing process is disabling.

[Review of] Ivo Mijnssen, The Quest for an Ideal Youth in Putin’s Russia I. Back to Our Future! History, Modernity and Patriotism According to Nashi, 2005–2012. Soviet and Post-Soviet Politics and Society, Stuttgart: Ibidem Verlag, 2012, 202pp., e 34.90 p/b

THE YOUTH MOVEMENT NASHI (OURS) WAS FOUNDED IN THE SPRING of 2005 against the backdrop of Ukraine’s ‘Orange Revolution’. Its aim was to stabilise Russia’s political system and take back the streets from opposition demonstrators. Personally loyal to Putin and taking its ideological orientation from Surkov’s concept of ‘sovereign democracy’, Nashi has sought to turn the tide on ‘defeatism’ and develop Russian youth into a patriotic new elite that ‘believes in the future of Russia’ (p. 15). Combining a wealth of empirical detail and the application of insights from discourse theory, Ivo Mijnssen analyses the organisation’s development between 2005 and 2012. His analysis focuses on three key moments—the organisation’s foundation, the apogee of its mobilisation around the Bronze Soldier dispute with Estonia, and the 2010 Seliger youth camp—to help understand Nashi’s organisation, purpose and ideational outlook as well as the limitations and challenges it faces. As such,the book is insightful both for those with an interest in post-Soviet Russian youth culture, and for scholars seeking a rounded understanding of the Kremlin’s initiatives to return a sense of identity and purpose to Russian national life.The first chapter, ‘Background and Context’, outlines the conceptual toolkit provided by Ernesto Laclau and Chantal Mouffe to help make sense of developments on the terrain of identity politics. In their terms, since the collapse of the Soviet Union, Russia has experienced acute dislocation of its identity. With the tangible loss of great power status, Russian realities have become unfixed from a discourse enabling national life to be constructed, albeit inherently contingently, as meaningful. The lack of a Gramscian hegemonic discourse to provide a unifying national idea was securitised as an existential threat demanding special measures. Accordingly, the identification of those who are ‘notUs’ has been a recurrent theme of Nashi’s discourse and activity. With the victory in World War II held up as a foundational moment, a constitutive other is found in the notion of ‘unusual fascists’. This notion includes not just neo-Nazis, but reflects a chain of equivalence that expands to include a range of perceived enemies of Putin’s consolidation project such as oligarchs and pro-Western liberals.The empirical background is provided by the second chapter, ‘Russia’s Youth, the Orange Revolution, and Nashi’, which traces the emergence of Nashi amid the climate of political instability of 2004 and 2005. A particularly note-worthy aspect of Mijnssen’s work is the inclusion of citations from his interviews with Nashicommissars; the youth movement’s cadres. Although relatively few in number, such insider conversations provide insight into the ethos of Nashi’s organisation and the outlook of those who have pledged their involvement. Besides the discussion of Nashi’s manifesto, the reader thus gains insight into the motivations of some participants and behind-the-scenes details of Nashi’s activities in response to the perceived threat of anti-government protests. The third chapter, ‘Nashi’s Bronze Soldier’, charts Nashi’s role in elevating the removal of a World War II monument from downtown Tallinn into an international dispute over the interpretation of history. The events subsequent to this securitisation of memory are charted in detail, concluding that Nashi’s activities were ultimately unsuccessful as their demands received little official support.The fourth chapter, ‘Seliger: The Foundry of Modernisation’, presents a distinctive feature of Mijnssen’s study, namely his ethnographic account as a participant observer in the Youth International Forum at Seliger. In the early years of the camp (2005–2007), Russian participants received extensive training, including master classes in ‘methods of forestalling mass unrest’ (p. 131), and the camp served to foster a sense of group identity and purpose among activists. After 2009 the event was no longer officially run as a Nashi camp, and its role became that of a forum for the exchange of ideas about innovation, although camp spirit remained a central feature. In 2010 the camp welcomed international attendees for the first time. As one of about 700 international participants in that year the author provides a fascinating account based on fieldwork diaries.Despite the polemical nature of the topic, Mijnssen’s analysis remains even-handed, exemplified in his balanced assessment of the Seliger experience. While he details the frustrations and disappointments of the international participants with regard to the unaccustomed strict camp discipline, organisational and communication failures, and the controlled format of many discussions,he does not neglect to note the camp’s successes in generating a gratifying collective dynamic between the participants, even among the international attendees who spent only a week there.In addition to the useful bibliography, the book is back-ended by two appendices, which provide the reader with important Russian-language primary source materials. The first is Nashi’s ‘Unusual Fascism’ (Neobyknovennyi fashizm) brochure, and the second is the booklet entitled ‘Some Uncomfortable Questions to the Russian Authorities’ (Neskol’ko neudobnykh voprosov rossiiskoivlasti) which was provided to the Seliger 2010 instructors to guide them in responding to probing questions from foreign participants. Given that these are not readily publicly available even now, they constitute a useful resource from the historical perspective.

Jointly event extraction and visualization on Twitter via probabilistic modelling

Event extraction from texts aims to detect structured information such as what has happened, to whom, where and when. Event extraction and visualization are typically considered as two different tasks. In this paper, we propose a novel approach based on probabilistic modelling to jointly extract and visualize events from tweets where both tasks benefit from each other. We model each event as a joint distribution over named entities, a date, a location and event-related keywords. Moreover, both tweets and event instances are associated with coordinates in the visualization space. The manifold assumption that the intrinsic geometry of tweets is a low-rank, non-linear manifold within the high-dimensional space is incorporated into the learning framework using a regularization. Experimental results show that the proposed approach can effectively deal with both event extraction and visualization and performs remarkably better than both the state-of-the-art event extraction method and a pipeline approach for event extraction and visualization.