Factors influencing robustness and effectiveness of conditional random fields in active learning frameworks

Active learning approaches reduce the annotation cost required by traditional supervised approaches to reach the same effectiveness by actively selecting informative instances during the learning phase. However, effectiveness and robustness of the learnt models are influenced by a number of factors. In this paper we investigate the factors that affect the effectiveness, more specifically in terms of stability and robustness, of active learning models built using conditional random fields (CRFs) for information extraction applications. Stability, defined as a small variation of performance when small variation of the training data or a small variation of the parameters occur, is a major issue for machine learning models, but even more so in the active learning framework which aims to minimise the amount of training data required. The factors we investigate are a) the choice of incremental vs. standard active learning, b) the feature set used as a representation of the text (i.e., morphological features, syntactic features, or semantic features) and c) Gaussian prior variance as one of the important CRFs parameters. Our empirical findings show that incremental learning and the Gaussian prior variance lead to more stable and robust models across iterations. Our study also demonstrates that orthographical, morphological and contextual features as a group of basic features play an important role in learning effective models across all iterations.

An Australian perspective on the ALI-III global principles for cooperation in International insolvency cases

In 2012, Professor Ian Fletcher (United Kingdom) and Professor Bob Wessels (The Netherlands) presented a Report to the American Law Institute and the International Insolvency Institute entitled Transnational Insolvency: Global Principles for Cooperation in International Insolvency Cases (“Global Principles”). This followed their appointment as Joint Reporters to investigate whether the essential provisions of the American Law Institute Principles of Cooperation among the North American Free Trade Agreement Countries with their annexed Guidelines Applicable to Court-to-Court Communication in Cross-border Cases may, with certain necessary modifications, be acceptable for use by jurisdictions across the world. This article comments on the Global Principles from the perspective of a jurisdiction which has adopted the UNCITRAL Model Law on Cross-border Insolvency (“Model Law”). In 2008, Australia enacted a standalone statute, the Cross-border Insolvency Act 2008 (Cth) to which is annexed the Model Law. In that process, it made minimal changes to the Model Law text. Against the background of the 2008 Act, related procedural laws as well as Australia’s general insolvency statutes and recent cross-border insolvency jurisprudence, this article comments on the potential relevance of the Transnational Insolvency Report as a point of reference for Australian courts and insolvency administrators when addressing international insolvency cases. By comparing the Global Principles with the Model Law as closely adopted in Australia, this analysis is a resource for other Model Law jurisdictions when considering the potential relevance of the Global Principles for their own international insolvency practice.

MIMO enhanced slotted cooperation in urban vehicular networks

The requirement of isolated relays is one of the prime obstacles in utilizing sequential slotted cooperative protocols for Vehicular Ad-hoc Networks (VANET). Significant research advancement has taken place to improve the diversity multiplexing trade-off (DMT) of cooperative protocols in conventional mobile networks without much attention on vehicular ad-hoc networks. We have extended the concept of sequential slotted amplify and forward (SAF) protocols in the context of urban vehicular ad-hoc networks. Multiple Input Multiple Output (MIMO) reception is used at relaying vehicular nodes to isolate the relays effectively. The proposed approach adds a pragmatic value to the sequential slotted cooperative protocols while achieving attractive performance gains in urban VANETs. We have analysed the DMT bounds and the outage probabilities of the proposed scheme. The results suggest that the proposed scheme can achieve an optimal DMT similar to the DMT upper bound of the sequential SAF. Furthermore, the outage performance of the proposed scheme outperforms the SAF protocol by 2.5 dB at a target outage probability of 10-4.

An efficient DSE using conditional multivariate complex Gaussian distribution

This paper presents an efficient noniterative method for distribution state estimation using conditional multivariate complex Gaussian distribution (CMCGD). In the proposed method, the mean and standard deviation (SD) of the state variables is obtained in one step considering load uncertainties, measurement errors, and load correlations. In this method, first the bus voltages, branch currents, and injection currents are represented by MCGD using direct load flow and a linear transformation. Then, the mean and SD of bus voltages, or other states, are calculated using CMCGD and estimation of variance method. The mean and SD of pseudo measurements, as well as spatial correlations between pseudo measurements, are modeled based on the historical data for different levels of load duration curve. The proposed method can handle load uncertainties without using time-consuming approaches such as Monte Carlo. Simulation results of two case studies, six-bus, and a realistic 747-bus distribution network show the effectiveness of the proposed method in terms of speed, accuracy, and quality against the conventional approach.

Aspect-based opinion mining from product reviews using conditional random fields

Product reviews are the foremost source of information for customers and manufacturers to help them make appropriate purchasing and production decisions. Natural language data is typically very sparse; the most common words are those that do not carry a lot of semantic content, and occurrences of any particular content-bearing word are rare, while co-occurrences of these words are rarer. Mining product aspects, along with corresponding opinions, is essential for Aspect-Based Opinion Mining (ABOM) as a result of the e-commerce revolution. Therefore, the need for automatic mining of reviews has reached a peak. In this work, we deal with ABOM as sequence labelling problem and propose a supervised extraction method to identify product aspects and corresponding opinions. We use Conditional Random Fields (CRFs) to solve the extraction problem and propose a feature function to enhance accuracy. The proposed method is evaluated using two different datasets. We also evaluate the effectiveness of feature function and the optimisation through multiple experiments.

Patriotism’s impact on cooperation with the state: An experimental study on tax compliance

Although it seems reasonable to assume that activating patriotism might motivate citizens to cooperate with the state in reaching societal goals, the empirical evidence supporting this contention is based mostly on correlational rather than experimental studies. In addition, little is known on whether patriotism can be manipulated without simultaneously triggering nationalism and on the psychological processes which determine the patriotism-cooperation relation. This current article reports results of one survey and three experiments that manipulate patriotism by displaying either a national flag or national landscapes or by priming national achievements. The outcomes indicate that reported and manipulated patriotism indirectly increase tax compliance, although the national flag also increases nationalism. National achievements, on the other hand, seemingly increases trust in national public institutions and the voluntary motivation to cooperate, whereas national landscapes only increase the voluntary motivation to cooperate. Hence, it is possible to increase social capital in the form of trust and cooperation through patriotism without fostering nationalism as well.

Modeling the role of competition and cooperation in the evolution of katydid acoustic synchrony

The precise timing of individual signals in response to those of signaling neighbors is seen in many animal species. Synchrony is the most striking of the resultant timing patterns. One of the best examples of acoustic synchrony is in katydid choruses where males produce chirps with a high degree of temporal overlap. Cooperative hypotheses that speculate on the evolutionary origins of acousti synchrony include the preservation of the species-specific call pattern, reduced predation risks, and increased call intensity. An alternative suggestion is that synchrony evolved as an epiphenomenon of competition between males in response to a female preference for chirps that lead other chirps. Previous models investigating the evolutionary origins of synchrony focused only on intrasexual competitive interactions. We investigated both competitive and cooperative hypotheses for the evolution of synchrony in the katydid Mecopoda ``Chirper'' using physiologically and ecologically realistic simulation models incorporating the natural variation in call features, ecology, female preferences, and spacing patterns, specifically aggregation. We found that although a female preference for leading chirps enables synchronous males to have some selective advantage, it is the female preference for the increased intensity of aggregations of synchronous males that enables synchrony to evolve as an evolutionarily stable strategy.

Evolution of cooperation by reciprocation within structured demes

The iterative two-person Prisoners’ Dilemma game has been generalised to theN-person case. The evolution of cooperation is explored by matching the Tit For Tat (TFT) strategy (Axelrod and Hamilton 1981) against the selfish strategy. Extension of TFT toN-person situations yields a graded set of strategies from the softest TFT, which continues cooperation even if only one of the opponents reciprocates it, to the hardest, which would do so only when all the remaining opponents cooperate. The hardest TFT can go to fixation against the selfish strategy provided it crosses a threshold frequencypc. All the other TFT are invadable by the selfish (D) or the pure defector strategy, while none can invadeD. Yet, provided a thresholdpc is crossed, they can coexist stably withD. AsN, the size of the group increases, the threshold pc also increases, indicating that the evolution of cooperation is more difficult for larger groups. Under certain conditions, only the soft TFT can coexist stably against the selfish strategyD, while the harder ones cannot. An interesting possibility of a complete takeover of the selfish population by successive invasions by harder and harder TFT strategies is also presented.

Labor-Management Cooperation

[Excerpt] In analyzing labor-management cooperation, it is important to be clear on what it is not. It is not an absence of strikes or conflict. Cooperation is not synonymous with industrial peace. Cooperation may take place even when bargaining leads to work stoppages; conversely, the mere absence of strikes is no evidence that there is labor-management cooperation. In the current period, there is a tendency to equate concessionary bargaining with labor-management cooperation. Demand for and acceptance of "givebacks" reflect economic pressures and relative bargaining strength and ought not to be interpreted as evidence of a cooperative relationship.

Novel conditional mouse models for targeted kidney research : Emphasis on the analysis of the biological function of nephrin

Nephrin is a transmembrane protein belonging to the immunoglobulin superfamily and is expressed primarily in the podocytes, which are highly differentiated epithelial cells needed for primary urine formation in the kidney. Mutations leading to nephrin loss abrogate podocyte morphology, and result in massive protein loss into urine and consequent early death in humans carrying specific mutations in this gene. The disease phenotype is closely replicated in respective mouse models. The purpose of this thesis was to generate novel inducible mouse-lines, which allow targeted gene deletion in a time and tissue-specific manner. A proof of principle model for succesful gene therapy for this disease was generated, which allowed podocyte specific transgene replacement to rescue gene deficient mice from perinatal lethality. Furthermore, the phenotypic consequences of nephrin restoration in the kidney and nephrin deficiency in the testis, brain and pancreas in rescued mice were investigated. A novel podocyte-specific construct was achieved by using standard cloning techniques to provide an inducible tool for in vitro and in vivo gene targeting. Using modified constructs and microinjection procedures two novel transgenic mouse-lines were generated. First, a mouse-line with doxycycline inducible expression of Cre recombinase that allows podocyte-specific gene deletion was generated. Second, a mouse-line with doxycycline inducible expression of rat nephrin, which allows podocyte-specific nephrin over-expression was made. Furthermore, it was possible to rescue nephrin deficient mice from perinatal lethality by cross-breeding them with a mouse-line with inducible rat nephrin expression that restored the missing endogenous nephrin only in the kidney after doxycycline treatment. The rescued mice were smaller, infertile, showed genital malformations and developed distinct histological abnormalities in the kidney with an altered molecular composition of the podocytes. Histological changes were also found in the testis, cerebellum and pancreas. The expression of another molecule with limited tissue expression, densin, was localized to the plasma membranes of Sertoli cells in the testis by immunofluorescence staining. Densin may be an essential adherens junction protein between Sertoli cells and developing germ cells and these junctions share similar protein assembly with kidney podocytes. This single, binary conditional construct serves as a cost- and time-efficient tool to increase the understanding of podocyte-specific key proteins in health and disease. The results verified a tightly controlled inducible podocyte-specific transgene expression in vitro and in vivo as expected. These novel mouse-lines with doxycycline inducible Cre recombinase and with rat nephrin expression will be useful for conditional gene targeting of essential podocyte proteins and to study in detail their functions in the adult mice. This is important for future diagnostic and pharmacologic development platforms.

A conditional random field-based downscaling method for assessment of climate change impact on multisite daily precipitation in the Mahanadi basin

Downscaling to station-scale hydrologic variables from large-scale atmospheric variables simulated by general circulation models (GCMs) is usually necessary to assess the hydrologic impact of climate change. This work presents CRF-downscaling, a new probabilistic downscaling method that represents the daily precipitation sequence as a conditional random field (CRF). The conditional distribution of the precipitation sequence at a site, given the daily atmospheric (large-scale) variable sequence, is modeled as a linear chain CRF. CRFs do not make assumptions on independence of observations, which gives them flexibility in using high-dimensional feature vectors. Maximum likelihood parameter estimation for the model is performed using limited memory Broyden-Fletcher-Goldfarb-Shanno (L-BFGS) optimization. Maximum a posteriori estimation is used to determine the most likely precipitation sequence for a given set of atmospheric input variables using the Viterbi algorithm. Direct classification of dry/wet days as well as precipitation amount is achieved within a single modeling framework. The model is used to project the future cumulative distribution function of precipitation. Uncertainty in precipitation prediction is addressed through a modified Viterbi algorithm that predicts the n most likely sequences. The model is applied for downscaling monsoon (June-September) daily precipitation at eight sites in the Mahanadi basin in Orissa, India, using the MIROC3.2 medium-resolution GCM. The predicted distributions at all sites show an increase in the number of wet days, and also an increase in wet day precipitation amounts. A comparison of current and future predicted probability density functions for daily precipitation shows a change in shape of the density function with decreasing probability of lower precipitation and increasing probability of higher precipitation.

Cooperation and conflict in conspecific brood parasitism : an alternative reproductive tactic

Interactions among individuals give rise to both cooperation and conflict. Individuals will behave selfishly or altruistically depending on which gives the higher payoff. The reproductive strategies of many animals are flexible and several alternative tactics may be present from which the most suitable one is applied. Generally, alternative reproductive tactics may be defined as a response to competition from individuals of the same sex. These alternative reproductive tactics are means by which individuals may fine-tune their fitness to the reigning circumstances and which are shaped by the environment individuals are occupying as well as by the behaviour of other individuals sharing the environment. By employing such alternative ways of achieving reproductive output, individuals may alleviate competition from others. Conspecific brood parasitism (CBP) is an alternative reproductive strategy found in several egg laying animal groups, and it is especially common among waterfowl. Within this alternative reproductive strategy, four reproductive options can be identified. These four options represent a continuum from low reproductive effort coupled with low fitness returns, to high reproductive effort and consequently high benefits. It may not be evident how individuals should allocate reproductive effort between eggs laid in their own nest vs. in nests of others, however. Limited fecundity will constrain the number of eggs donated by a parasite, but also the tendency for hosts to accept parasitic eggs may affect the allocation decision. Furthermore, kinship, individual quality and the costs of breeding may play a role in complicating the allocation decision. In this thesis, I view the seemingly paradoxical effects of kinship on conflict resolution in the context of alternative reproductive tactics, examining the resulting features of cooperation and conflict. Conspecific brood parasitism sets the stage for investigating these questions. By using both empirical and theoretical approaches, I examine the nature of CBP in a brood parasitic duck, the Barrow's goldeneye (Bucephala islandica). The theoretical chapter of this thesis gives rise to four main conclusions. Firstly, variation in individual quality plays a central role in shaping breeding strategies. Secondly, kinship plays a central role in the evolution of CBP. Thirdly, egg recognition ability may affect the prevalence of parasitism. If egg recognition is perfect, higher relatedness between host and parasite facilitates CBP. Finally, I show that the relative costs of egg laying and post-laying care play a so far underestimated role in determining the prevalence of parasitism. The costs of breeding may outweigh possible inclusive fitness benefits accrued from receiving eggs from relatives. Several of the patterns brought out by the theoretical work are then confirmed empirically in the following chapters. Findings include confirmation of the central role of relatedness in determining the extent of parasitism as well as inducing a counterintuitive host clutch reduction. Furthermore, I demonstrate a cost of CBP inflicted on hosts, as well as results suggesting that host age reflects individual quality, affecting the ability to overcome costs inflicted by CBP. In summary, I demonstrate both theoretically and empirically the presence of cooperation and conflict in the interactions between conspecific parasites and their hosts. The field of CBP research has traditionally been divided, but the first steps have now been taken toward the acceptance of the opposite side of the divide. Especially the theoretical findings of chapter 1 offer the possibility to view seemingly contrasting results of various studies within the same framework, and may direct future research toward more general features underlying differences in the patterns of CBP between populations or species.

Cooperation of Notch and Ras/MAPK signaling pathways in human breast carcinogenesis

Background: Recent studies have implicated aberrant Notch signaling in breast cancers. Yet, relatively little is known about the pattern of expression of various components of the Notch pathway, or its mechanism of action. To better understand the role of the Notch pathway in breast cancer, we have undertaken a detailed expression analysis of various Notch receptors, their ligands, and downstream targets at different stages of breast cancer progression. Results: We report here that there is a general increase in the expression levels of Notch 1, 2, 4, Jagged1, Jagged2, and Delta-like 4 proteins in breast cancers, with simultaneous upregulation of multiple Notch receptors and ligands in a given cancer tissue. While Notch3 and Delta-like1 were undetectable in normal tissues, moderate to high expression was detected in several cancers. We detected the presence of active, cleaved Notch1, along with downstream targets of the Notch pathway, Hes1/Hes5, in similar to 75% of breast cancers, clearly indicating that in a large proportion of breast cancers Notch signaling is aberrantly activated. Furthermore, we detected cleaved Notch1 and Hes1/5 in early precursors of breast cancers - hyperplasia and ductal carcinoma in situ suggesting that aberrant Notch activation may be an early event in breast cancer progression. Mechanistically, while constitutively active Notch1 alone failed to transform immortalized breast cells, it synergized with the Ras/MAPK pathway to mediate transformation. This cooperation is reflected in vivo, as a subset of cleaved Notch positive tumors additionally expressed phopsho-Erk1/2 in the nuclei. Such cases exhibited high node positivity, suggesting that Notch-Ras cooperation may lead to poor prognosis. Conclusions: High level expression of Notch receptors and ligands, and its increased activation in several breast cancers and early precursors, places Notch signaling as a key player in breast cancer pathogenesis. Its cooperation with the Ras/MAPK pathway in transformation offers combined inhibition of the two pathways as a new modality for breast cancer treatment.

Correlation, Coding, and Cooperation in Wireless Sensor Networks

We consider a single-hop data-gathering sensor network, consisting of a set of sensor nodes that transmit data periodically to a base-station. We are interested in maximizing the lifetime of this network. With our definition of network lifetime and the assumption that the radio transmission energy consumption forms the most significant portion of the total energy consumption at a sensor node, we attempt to enhance the network lifetime by reducing the transmission energy budget of sensor nodes by exploiting three system-level opportunities. We pose the problem of maximizing lifetime as a max-min optimization problem subject to the constraint of successful data collection and limited energy supply at each node. This turns out to be an extremely difficult optimization to solve. To reduce the complexity of this problem, we allow the sensor nodes and the base-station to interactively communicate with each other and employ instantaneous decoding at the base-station. The chief contribution of the paper is to show that the computational complexity of our problem is determined by the complex interplay of various system-level opportunities and challenges.

Conditional Probability-Based Significance Tests for Sequential Patterns in Multineuronal Spike Trains

We consider the problem of detecting statistically significant sequential patterns in multineuronal spike trains. These patterns are characterized by ordered sequences of spikes from different neurons with specific delays between spikes. We have previously proposed a data-mining scheme to efficiently discover such patterns, which occur often enough in the data. Here we propose a method to determine the statistical significance of such repeating patterns. The novelty of our approach is that we use a compound null hypothesis that not only includes models of independent neurons but also models where neurons have weak dependencies. The strength of interaction among the neurons is represented in terms of certain pair-wise conditional probabilities. We specify our null hypothesis by putting an upper bound on all such conditional probabilities. We construct a probabilistic model that captures the counting process and use this to derive a test of significance for rejecting such a compound null hypothesis. The structure of our null hypothesis also allows us to rank-order different significant patterns. We illustrate the effectiveness of our approach using spike trains generated with a simulator.