Automatic Inference of Graph Models for Complex Networks with Genetic Programming

Complex networks can arise naturally and spontaneously from all things that act as a part of a larger system. From the patterns of socialization between people to the way biological systems organize themselves, complex networks are ubiquitous, but are currently poorly understood. A number of algorithms, designed by humans, have been proposed to describe the organizational behaviour of real-world networks. Consequently, breakthroughs in genetics, medicine, epidemiology, neuroscience, telecommunications and the social sciences have recently resulted. The algorithms, called graph models, represent significant human effort. Deriving accurate graph models is non-trivial, time-intensive, challenging and may only yield useful results for very specific phenomena. An automated approach can greatly reduce the human effort required and if effective, provide a valuable tool for understanding the large decentralized systems of interrelated things around us. To the best of the author's knowledge this thesis proposes the first method for the automatic inference of graph models for complex networks with varied properties, with and without community structure. Furthermore, to the best of the author's knowledge it is the first application of genetic programming for the automatic inference of graph models. The system and methodology was tested against benchmark data, and was shown to be capable of reproducing close approximations to well-known algorithms designed by humans. Furthermore, when used to infer a model for real biological data the resulting model was more representative than models currently used in the literature.

Triarylamminium radical-cation complexes: design and magnetic properties and Base-catalyzed hydrosilylation: mechanism and substrate scope

1. Triarylamminium radical-cation complexes. The detailed study of manganese, copper and nickel metal-radical complexes with triarylamminium ligands was conducted. Stable, neutral and pseudo-octahedral coordination monometallic complexes with simple monodentate 2,2`-bipyridine ligand containing a redox-active N,N`-(4,4`-dimethoxydiphenyl-amino) substituent were synthesized and fully characterized. The one-electron oxidation process and formation of persistent radical-cation complexes was observed by cyclic voltammetry and spectroelectrochemical measurements. Evans method measurements were performed with radical-cation complexes generated by chemical one-electron oxidation with NOPF6 in acetonitrile. The experimental results indicate ferromagnetic coupling between metal and triarylamminium cation in manganese (II) complex and antiferromagnetic coupling in nickel (II) complex. This data is supported by DFT calculations which also lend weight to the  spin polarization mechanism as an operative model for magnetic exchange coupling. Neutral bimetallic complexes with a new ditopic ligand were synthesized and fully characterized, including magnetic and electrochemical studies. Chemical oxidation of these precursor complexes did not generate radical-cations, but dicationic complexes, which was confirmed by UV-vis and EPR-experiments, as well as varied temperature magnetic measurements. DFT calculations for radical-cation complexes are included. A synthetic pathway for polytopic ligand with multiple redox-active triarylamine sites was developed. The structure of the ligand is presumably suitable for -spin polarization exchange model and allows for production of polymetallic complexes having high spin ground states. 2. Base-catalyzed hydrosilylation. A simple reductive base-catalyzed hydrosilation of aldehydes and ketones was adapted to the use of the cheap, safe, and non-toxic polymethylhydrosiloxane (PMHS) instead of the common PhSiH3 and (EtO)3SiH, which present significant cost and safety concerns, respectively. The conversion of silane into pentacoordinate silicate species upon addition of a base was studied in details for the cases of phenyl silane and PMHS and is believed to be essential for the hydrosilylation process. We discovered that nucleophiles (a base or fluoride-anion) induced the rearrangement of PMHS and TMDS into light silanes: MeSiH3 and Me2SiH2, respectively. The reductive properties of PMHS under basic conditions can be attributed to the formation of methyl silane and its conversion into a silicate species. A procedure for the generation of methyl silane and its use in further efficient reductions of aldehydes and ketones has been developed. The protocol was extended to the selective reduction of esters and tertiary amides into alcohols and aldimines into amines with good isolated yields and reduction of heterocyclic compounds was attempted.

Object-Oriented Genetic Programming for the Automatic Inference of Graph Models for Complex Networks

Complex networks are systems of entities that are interconnected through meaningful relationships. The result of the relations between entities forms a structure that has a statistical complexity that is not formed by random chance. In the study of complex networks, many graph models have been proposed to model the behaviours observed. However, constructing graph models manually is tedious and problematic. Many of the models proposed in the literature have been cited as having inaccuracies with respect to the complex networks they represent. However, recently, an approach that automates the inference of graph models was proposed by Bailey [10] The proposed methodology employs genetic programming (GP) to produce graph models that approximate various properties of an exemplary graph of a targeted complex network. However, there is a great deal already known about complex networks, in general, and often specific knowledge is held about the network being modelled. The knowledge, albeit incomplete, is important in constructing a graph model. However it is difficult to incorporate such knowledge using existing GP techniques. Thus, this thesis proposes a novel GP system which can incorporate incomplete expert knowledge that assists in the evolution of a graph model. Inspired by existing graph models, an abstract graph model was developed to serve as an embryo for inferring graph models of some complex networks. The GP system and abstract model were used to reproduce well-known graph models. The results indicated that the system was able to evolve models that produced networks that had structural similarities to the networks generated by the respective target models.

Mirroring Enzymes: The Role of H-Bonding In HQuin-BAM Catalyzed Asymmetric Aza-Henry Reactions: A DFT Study into the Reactivity, Mechanism, and Origins of Selectivity

The exact mechanistic understanding of various organocatalytic systems in asymmetric reactions such as Henry and aza-Henry transformations is important for developing and designing new synthetic organocatalysts. The focus of this dissertation will be on the use of density functional theory (DFT) for studying the asymmetric aza-Henry reaction. The first part of the thesis is a detailed mechanistic investigation of a poorly understood chiral bis(amidine) (BAM) Brønsted acid catalyzed aza-Henry reaction between nitromethane and N-Boc phenylaldimine. The catalyst, in addition to acting as a Brønsted base, serves to simultaneously activate both the electrophile and the nucleophile through dual H-bonding during C-C bond formation and is thus essential for both reaction rate and selectivity. Analysis of the H-bonding interactions revealed that there was a strong preference for the formation of a homonuclear positive charge-assisted H-bond, which in turn governed the relative orientation of substrate binding. Attracted by this well-defined mechanistic investigation, the other important aspect of my PhD research addressed a detailed theoretical analysis accounting for the observed selectivity in diastereoselective versions of this reaction. A detailed inspection of the stereodetermining C-C bond forming transition states for monoalkylated nitronate addition to a range of electronically different aldimines, revealed that the origins of stereoselectivity were controlled by a delicate balance of different factors such as steric, orbital interactions, and the extent of distortion in the catalyst and substrates. The structural analysis of different substituted transition states established an interesting dependency on matching the shape and size of the catalyst (host molecule) and substrates (guest molecules) upon binding, both being key factors governing selectivity, in essence, offering an analogy to positive cooperative binding effect of catalytic enzymes and substrates in Nature. In addition, both intra-molecular (intra-host) and inter-molecular (host-guest, guest-guest) stabilizing interactions play a key role to the high π-facial selectivity. The application of dispersion-corrected functionals (i.e., ωB97X-D and B3LYP-D3) was essential for accurately modeling these stabilizing interactions, indicating the importance of dispersion effects in enantioselectivity. As a brief prelude to more extensive future studies, the influence of a triflate counterion on both reactivity and selectivity in this reaction was also addressed.

Markovian Processes, Two-Sided Autoregressions and Finite-Sample Inference for Stationary and Nonstationary Autoregressive Processes.

In this paper, we develop finite-sample inference procedures for stationary and nonstationary autoregressive (AR) models. The method is based on special properties of Markov processes and a split-sample technique. The results on Markovian processes (intercalary independence and truncation) only require the existence of conditional densities. They are proved for possibly nonstationary and/or non-Gaussian multivariate Markov processes. In the context of a linear regression model with AR(1) errors, we show how these results can be used to simplify the distributional properties of the model by conditioning a subset of the data on the remaining observations. This transformation leads to a new model which has the form of a two-sided autoregression to which standard classical linear regression inference techniques can be applied. We show how to derive tests and confidence sets for the mean and/or autoregressive parameters of the model. We also develop a test on the order of an autoregression. We show that a combination of subsample-based inferences can improve the performance of the procedure. An application to U.S. domestic investment data illustrates the method.

Statistical Inference for Computable General Equilibrium Models with Application to a Model of the Moroccan Economy

We study the problem of measuring the uncertainty of CGE (or RBC)-type model simulations associated with parameter uncertainty. We describe two approaches for building confidence sets on model endogenous variables. The first one uses a standard Wald-type statistic. The second approach assumes that a confidence set (sampling or Bayesian) is available for the free parameters, from which confidence sets are derived by a projection technique. The latter has two advantages: first, confidence set validity is not affected by model nonlinearities; second, we can easily build simultaneous confidence intervals for an unlimited number of variables. We study conditions under which these confidence sets take the form of intervals and show they can be implemented using standard methods for solving CGE models. We present an application to a CGE model of the Moroccan economy to study the effects of policy-induced increases of transfers from Moroccan expatriates.

Finite-Sample Inference Methods for Simultaneous Equations and Models with Unobserved and Generated Regressors

We propose finite sample tests and confidence sets for models with unobserved and generated regressors as well as various models estimated by instrumental variables methods. The validity of the procedures is unaffected by the presence of identification problems or \"weak instruments\", so no detection of such problems is required. We study two distinct approaches for various models considered by Pagan (1984). The first one is an instrument substitution method which generalizes an approach proposed by Anderson and Rubin (1949) and Fuller (1987) for different (although related) problems, while the second one is based on splitting the sample. The instrument substitution method uses the instruments directly, instead of generated regressors, in order to test hypotheses about the \"structural parameters\" of interest and build confidence sets. The second approach relies on \"generated regressors\", which allows a gain in degrees of freedom, and a sample split technique. For inference about general possibly nonlinear transformations of model parameters, projection techniques are proposed. A distributional theory is obtained under the assumptions of Gaussian errors and strictly exogenous regressors. We show that the various tests and confidence sets proposed are (locally) \"asymptotically valid\" under much weaker assumptions. The properties of the tests proposed are examined in simulation experiments. In general, they outperform the usual asymptotic inference methods in terms of both reliability and power. Finally, the techniques suggested are applied to a model of Tobin’s q and to a model of academic performance.

Simulation-Based Finite-and Large-sample Inference Methods in Multivariate Regressions and Seemingly Unrelated Regressions

In the context of multivariate regression (MLR) and seemingly unrelated regressions (SURE) models, it is well known that commonly employed asymptotic test criteria are seriously biased towards overrejection. in this paper, we propose finite-and large-sample likelihood-based test procedures for possibly non-linear hypotheses on the coefficients of MLR and SURE systems.

Projection-Based Statistical Inference in Linear Structural Models with Possibly Weak Instruments

It is well known that standard asymptotic theory is not valid or is extremely unreliable in models with identification problems or weak instruments [Dufour (1997, Econometrica), Staiger and Stock (1997, Econometrica), Wang and Zivot (1998, Econometrica), Stock and Wright (2000, Econometrica), Dufour and Jasiak (2001, International Economic Review)]. One possible way out consists here in using a variant of the Anderson-Rubin (1949, Ann. Math. Stat.) procedure. The latter, however, allows one to build exact tests and confidence sets only for the full vector of the coefficients of the endogenous explanatory variables in a structural equation, which in general does not allow for individual coefficients. This problem may in principle be overcome by using projection techniques [Dufour (1997, Econometrica), Dufour and Jasiak (2001, International Economic Review)]. AR-types are emphasized because they are robust to both weak instruments and instrument exclusion. However, these techniques can be implemented only by using costly numerical techniques. In this paper, we provide a complete analytic solution to the problem of building projection-based confidence sets from Anderson-Rubin-type confidence sets. The latter involves the geometric properties of “quadrics” and can be viewed as an extension of usual confidence intervals and ellipsoids. Only least squares techniques are required for building the confidence intervals. We also study by simulation how “conservative” projection-based confidence sets are. Finally, we illustrate the methods proposed by applying them to three different examples: the relationship between trade and growth in a cross-section of countries, returns to education, and a study of production functions in the U.S. economy.

Identification, Weak Instruments and Statistical Inference in Econometrics

We discuss statistical inference problems associated with identification and testability in econometrics, and we emphasize the common nature of the two issues. After reviewing the relevant statistical notions, we consider in turn inference in nonparametric models and recent developments on weakly identified models (or weak instruments). We point out that many hypotheses, for which test procedures are commonly proposed, are not testable at all, while some frequently used econometric methods are fundamentally inappropriate for the models considered. Such situations lead to ill-defined statistical problems and are often associated with a misguided use of asymptotic distributional results. Concerning nonparametric hypotheses, we discuss three basic problems for which such difficulties occur: (1) testing a mean (or a moment) under (too) weak distributional assumptions; (2) inference under heteroskedasticity of unknown form; (3) inference in dynamic models with an unlimited number of parameters. Concerning weakly identified models, we stress that valid inference should be based on proper pivotal functions —a condition not satisfied by standard Wald-type methods based on standard errors — and we discuss recent developments in this field, mainly from the viewpoint of building valid tests and confidence sets. The techniques discussed include alternative proposed statistics, bounds, projection, split-sampling, conditioning, Monte Carlo tests. The possibility of deriving a finite-sample distributional theory, robustness to the presence of weak instruments, and robustness to the specification of a model for endogenous explanatory variables are stressed as important criteria assessing alternative procedures.

Short run and long run causality in time series: Inference

We propose methods for testing hypotheses of non-causality at various horizons, as defined in Dufour and Renault (1998, Econometrica). We study in detail the case of VAR models and we propose linear methods based on running vector autoregressions at different horizons. While the hypotheses considered are nonlinear, the proposed methods only require linear regression techniques as well as standard Gaussian asymptotic distributional theory. Bootstrap procedures are also considered. For the case of integrated processes, we propose extended regression methods that avoid nonstandard asymptotics. The methods are applied to a VAR model of the U.S. economy.

Monte Carlo Tests with Nuisance Parameters: A General Approach to Finite-Sample Inference and Nonstandard Asymptotics

The technique of Monte Carlo (MC) tests [Dwass (1957), Barnard (1963)] provides an attractive method of building exact tests from statistics whose finite sample distribution is intractable but can be simulated (provided it does not involve nuisance parameters). We extend this method in two ways: first, by allowing for MC tests based on exchangeable possibly discrete test statistics; second, by generalizing the method to statistics whose null distributions involve nuisance parameters (maximized MC tests, MMC). Simplified asymptotically justified versions of the MMC method are also proposed and it is shown that they provide a simple way of improving standard asymptotics and dealing with nonstandard asymptotics (e.g., unit root asymptotics). Parametric bootstrap tests may be interpreted as a simplified version of the MMC method (without the general validity properties of the latter).

Finite-Sample Simulation-Based Inference in VAR Models with Applications to Order Selection and Causality Testing

Statistical tests in vector autoregressive (VAR) models are typically based on large-sample approximations, involving the use of asymptotic distributions or bootstrap techniques. After documenting that such methods can be very misleading even with fairly large samples, especially when the number of lags or the number of equations is not small, we propose a general simulation-based technique that allows one to control completely the level of tests in parametric VAR models. In particular, we show that maximized Monte Carlo tests [Dufour (2002)] can provide provably exact tests for such models, whether they are stationary or integrated. Applications to order selection and causality testing are considered as special cases. The technique developed is applied to quarterly and monthly VAR models of the U.S. economy, comprising income, money, interest rates and prices, over the period 1965-1996.

Choosing Wisely: The Natural Multi-Bidding Mechanism

Pérez-Castrillo and Wettstein (2002) propose a multi-bidding mechanism to determine a winner from a set of possible projects. The winning project is implemented and its surplus is shared among the agents. In the multi-bidding mechanism each agent announces a vector of bids, one for each possible project, that are constrained to sum up to zero. In addition, each agent chooses a favorite a object which is used as a tie-breaker if several projects receive the same highest aggregate bid. Since more desirable projects receive larger bids, it is natural to consider the multi-bidding mechanism without the announcement of favorite projects. We show that the merits of the multi-bidding mechanism appear not to be robust to this natural simplification. Specifically, a Nash equilibrium exists if and only if there are at least two individually optimal projects and all individually optimal projects are efficient.