A Perspective on Computer Assisted Assessment Techniques for Short Free-Text Answers

Computer Assisted Assessment (CAA) has been existing for several years now. While some forms of CAA do not require sophisticated text understanding (e.g., multiple choice questions), there are also student answers that consist of free text and require analysis of text in the answer. Research towards the latter till date has concentrated on two main sub-tasks: (i) grading of essays, which is done mainly by checking the style, correctness of grammar, and coherence of the essay and (ii) assessment of short free-text answers. In this paper, we present a structured view of relevant research in automated assessment techniques for short free-text answers. We review papers spanning the last 15 years of research with emphasis on recent papers. Our main objectives are two folds. First we present the survey in a structured way by segregating information on dataset, problem formulation, techniques, and evaluation measures. Second we present a discussion on some of the potential future directions in this domain which we hope would be helpful for researchers.

Interrogating an insect society

Insect societies such as those of ants, bees, and wasps consist of 1 or a small number of fertile queens and a large number of sterile or nearly sterile workers. While the queens engage in laying eggs, workers perform all other tasks such as nest building, acquisition and processing of food, and brood care. How do such societies function in a coordinated and efficient manner? What are the rules that individuals follow? How are these rules made and enforced? These questions are of obvious interest to us as fellow social animals but how do we interrogate an insect society and seek answers to these questions? In this article I will describe my research that was designed to see answers from an insect society to a series of questions of obvious interest to us. I have chosen the Indian paper wasp Ropalidia marginata for this purpose, a species that is abundantly distributed in peninsular India and serves as an excellent model system. An important feature of this species is that queens and workers are morphologically identical and physiologically nearly so. How then does an individual become a queen? How does the queen suppress worker reproduction? How does the queen regulate the nonreproductive activities of the workers? What is the function of aggression shown by different individuals? How and when is the queen's heir decided? I will show how such questions can indeed be investigated and will emphasize the need for a whole range of different techniques of observation and experimentation.

Manifolds with nonnegative isotropic curvature

We prove that if (M-n, g), n >= 4, is a compact, orientable, locally irreducible Riemannian manifold with nonnegative isotropic curvature,then one of the following possibilities hold: (i) M admits a metric with positive isotropic curvature. (ii) (M, g) is isometric to a locally symmetric space. (iii) (M, g) is Kahler and biholomorphic to CPn/2. (iv) (M, g) is quaternionic-Kahler. This is implied by the following result: Let (M-2n, g) be a compact, locally irreducible Kahler manifold with nonnegative isotropic curvature. Then either M is biholomorphic to CPn or isometric to a compact Hermitian symmetric space. This answers a question of Micallef and Wang in the affirmative. The proof is based on the recent work of Brendle and Schoen on the Ricci flow.

Structural Ordering of Disordered Ligand-Binding Loops of Biotin Protein Ligase into Active Conformations as a Consequence of Dehydration

Mycobacterium tuberculosis (Mtb), a dreaded pathogen, has a unique cell envelope composed of high fatty acid content that plays a crucial role in its pathogenesis. Acetyl Coenzyme A Carboxylase (ACC), an important enzyme that catalyzes the first reaction of fatty acid biosynthesis, is biotinylated by biotin acetyl-CoA carboxylase ligase (BirA). The ligand-binding loops in all known apo BirAs to date are disordered and attain an ordered structure only after undergoing a conformational change upon ligand-binding. Here, we report that dehydration of Mtb-BirA crystals traps both the apo and active conformations in its asymmetric unit, and for the first time provides structural evidence of such transformation. Recombinant Mtb-BirA was crystallized at room temperature, and diffraction data was collected at 295 K as well as at 120 K. Transfer of crystals to paraffin and paratone-N oil (cryoprotectants) prior to flash-freezing induced lattice shrinkage and enhancement in the resolution of the X-ray diffraction data. Intriguingly, the crystal lattice rearrangement due to shrinkage in the dehydrated Mtb-BirA crystals ensued structural order of otherwise flexible ligand-binding loops L4 and L8 in apo BirA. In addition, crystal dehydration resulted in a shift of similar to 3.5 angstrom in the flexible loop L6, a proline-rich loop unique to Mtb complex as well as around the L11 region. The shift in loop L11 in the C-terminal domain on dehydration emulates the action responsible for the complex formation with its protein ligand biotin carboxyl carrier protein (BCCP) domain of ACCA3. This is contrary to the involvement of loop L14 observed in Pyrococcus horikoshii BirA-BCCP complex. Another interesting feature that emerges from this dehydrated structure is that the two subunits A and B, though related by a noncrystallographic twofold symmetry, assemble into an asymmetric dimer representing the ligand-bound and ligand-free states of the protein, respectively. In-depth analyses of the sequence and the structure also provide answers to the reported lower affinities of Mtb-BirA toward ATP and biotin substrates. This dehydrated crystal structure not only provides key leads to the understanding of the structure/function relationships in the protein in the absence of any ligand-bound structure, but also demonstrates the merit of dehydration of crystals as an inimitable technique to have a glance at proteins in action.

Truthful and Quality Conscious Query Incentive Networks

Query incentive networks capture the role of incentives in extracting information from decentralized information networks such as a social network. Several game theoretic tilt:Kids of query incentive networks have been proposed in the literature to study and characterize the dependence, of the monetary reward required to extract the answer for a query, on various factors such as the structure of the network, the level of difficulty of the query, and the required success probability.None of the existing models, however, captures the practical andimportant factor of quality of answers. In this paper, we develop a complete mechanism design based framework to incorporate the quality of answers, in the monetization of query incentive networks. First, we extend the model of Kleinberg and Raghavan [2] to allow the nodes to modulate the incentive on the basis of the quality of the answer they receive. For this qualify conscious model. we show are existence of a unique Nash equilibrium and study the impact of quality of answers on the growth rate of the initial reward, with respect to the branching factor of the network. Next, we present two mechanisms; the direct comparison mechanism and the peer prediction mechanism, for truthful elicitation of quality from the agents. These mechanisms are based on scoring rules and cover different; scenarios which may arise in query incentive networks. We show that the proposed quality elicitation mechanisms are incentive compatible and ex-ante budget balanced. We also derive conditions under which ex-post budget balance can beachieved by these mechanisms.

Mechanistic evaluation of mitigation of petroleum hydrocarbon contamination by soil medium

Present in situ chemical treatment technologies for mitigation of petroleum hydrocarbon contamination are in the developmental stage or being tested. To devise efficient strategies for restricting the movement of petroleum hydrocarbon (PHC) molecules in the contaminated soil, it is proposed to utilize the sorption–interaction relationships between the petroleum contaminants and the soil substrate. The basic questions addressed in this paper are as follows (i) What are the prominent chemical constituents of the various petroleum fractions that interact with the soil substrate? (ii) What are the functional groups of a soil that interact with the contaminants? (iii) What are the bonding mechanisms possible between the soil functional groups and the PHC contaminants? (iv) What are the consequent changes brought about the soil physical properties on interaction with PHC's? (v) What are the factors influencing the interactions between PHC molecules and clay particles of the soil substrate? (vi) What is the possibility of improving the soil's attenuation ability for PHC's? The development of answers to the basic questions reveal that petroleum hydrocarbons comprise a mixture of nonpolar alkanes and aromatic and polycyclic hydrocarbons, that have limited solubility in water. The bonding mechanism between the nonpolar PHC's and the clay surface is by way of van der Waals attraction. The adsorption of the nonpolar hydrocarbons by the clay surface occurs only when their (i.e., the hydrocarbon molecules) solubility in water is exceeded and the hydrocarbons exist in the micellar form. Dilute solutions of hydrocarbons in water, i.e., concentrations of hydrocarbons at or below the solubility limit, have no effect on the hydraulic conductivity of clay soils. Permeation with pure hydrocarbons invariably influences the clay hydraulic conductivity. To improve the attenuation ability of soils towards PHC's, it is proposed to coat the soil surface with "ultra" heavy organic polymers. Adsorption of organic polymers by the clay surface may change the surface properties of the soil from highly hydrophilic (having affinity for water molecules) to organophilic (having affinity for organic molecules). The organic polymers attached to the clay surface are expected to attenuate the PHC molecules by van der Waals attraction, by hydrogen bonding, and also by adsorption into interlayer space in the case of soils containing swelling clays.

Estimating national contributions of greenhouse gas emissions :The CSE-WRI controversy

Analysts have identified four related questions that need to be asked and answered before agreements to respond to global warming will be possible.1 Which countries bear responsibility for causing the problem? What quantities and mix of greenhouse gases should each country be allowed to emit? Which countries have the resources to do something about the problem? Where are the best opportunities for undertaking projects to respond to the problem? Failure to distinguish among these four questions, or willingness to accept superficial answers, promotes unnecessary controversy.

Growing pseudo-eigenmodes and positive logarithmic norms in rotating shear flows

Rotating shear flows, when angular momentum increases and angular velocity decreases as functions of radiation coordinate, are hydrodynamically stable under linear perturbation. The Keplerian flow is an example of such a system, which appears in an astrophysical context. Although decaying eigenmodes exhibit large transient energy growth of perturbation which could govern nonlinearity in the system, the feedback of inherent instability to generate turbulence seems questionable. We show that such systems exhibiting growing pseudo-eigenmodes easily reach an upper bound of growth rate in terms of the logarithmic norm of the involved non-normal operators, thus exhibiting feedback of inherent instability. This supports the existence of turbulence of hydrodynamic origin in the Keplerian accretion disc in astrophysics. Hence, this answers the question of the mismatch between the linear theory and experimental/observed data and helps in resolving the outstanding question of the origin of turbulence therein.

Seismic horizontal pullout capacity of vertical anchors in sands

The problem of finding the horizontal pullout capacity of vertical anchors embedded in sands with the inclusion of pseudostatic horizontal earthquake body forces, was tackled in this note. The analysis was carried out using an upper bound limit analysis, with the consideration of two different collapse mechanisms: bilinear and composite logarithmic spiral rupture surfaces. The results are presented in nondimensional form to find the pullout resistance with changes in earthquake acceleration for different combinations of embedment ratio of the anchor (lambda), friction angle of the soil (phi), and the anchor-soil interface wall friction angle (delta). The pullout resistance decreases quite substantially with increases in the magnitude of the earthquake acceleration. For values of delta up to about 0.25-0.5phi, the bilinear and composite logarithmic spiral rupture surfaces gave almost identical answers, whereas for higher values of delta, the choice of the logarithmic spiral provides significantly smaller pullout resistance. The results compare favorably with the existing theoretical data.

Volume Change behaviour in Calcitic Soil influenced with Sulphuric Acid using Artificial Neural Networks

This paper elucidates the methodology of applying artificial neural network model (ANNM) to predict the percent swell of calcitic soil in sulphuric acid solutions, a complex phenomenon involving many parameters. Swell data required for modelling is experimentally obtained using conventional oedometer tests under nominal surcharge. The phases in ANN include optimal design of architecture, operation and training of architecture. The designed optimal neural model (3-5-1) is a fully connected three layer feed forward network with symmetric sigmoid activation function and trained by the back propagation algorithm to minimize a quadratic error criterion.The used model requires parameters such as duration of interaction, calcite mineral content and acid concentration for prediction of swell. The observed strong correlation coefficient (R2 = 0.9979) between the values determined by the experiment and predicted using the developed model demonstrates that the network can provide answers to complex problems in geotechnical engineering.

Efficient external memory structures for range-aggregate queries

We present external memory data structures for efficiently answering range-aggregate queries. The range-aggregate problem is defined as follows: Given a set of weighted points in R-d, compute the aggregate of the weights of the points that lie inside a d-dimensional orthogonal query rectangle. The aggregates we consider in this paper include COUNT, sum, and MAX. First, we develop a structure for answering two-dimensional range-COUNT queries that uses O(N/B) disk blocks and answers a query in O(log(B) N) I/Os, where N is the number of input points and B is the disk block size. The structure can be extended to obtain a near-linear-size structure for answering range-sum queries using O(log(B) N) I/Os, and a linear-size structure for answering range-MAX queries in O(log(B)(2) N) I/Os. Our structures can be made dynamic and extended to higher dimensions. (C) 2012 Elsevier B.V. All rights reserved.

The projective plane, J-holomorphic curves and Desargues' theorem

By a theorem of Gromov, for an almost complex structure J on CP2 tamed by the standard symplectic structure, the J-holomorphic curves representing the positive generator of homology form a projective plane. We show that this satisfies the Theorem of Desargues if and only if J is isomorphic to the standard complex structure. This answers a question of Ghys. (C) 2013 Published by Elsevier Masson SAS on behalf of Academie des sciences.

A questioning based method to automatically acquire expert assembly diagnostic knowledge

In the domain of manual mechanical assembly, expert knowledge is an important means of supporting assembly planning that leads to fewer issues during actual assembly. Knowledge based systems can be used to provide assembly planners with expert knowledge as advice. However, acquisition of knowledge remains a difficult task to automate, while manual acquisition is tedious, time-consuming, and requires engagement of knowledge engineers with specialist knowledge to understand and translate expert knowledge. This paper describes the development, implementation and preliminary evaluation of a method that asks a series of questions to an expert, so as to automatically acquire necessary diagnostic and remedial knowledge as rules for use in a knowledge based system for advising assembly planners diagnose and resolve issues. The method, called a questioning procedure, organizes its questions around an assembly situation which it presents to the expert as the context, and adapts its questions based on the answers it receives from the expert. (C) 2014 Elsevier Ltd. All rights reserved.

UNO Gets Easier for a Single Player

This work is a follow up to 2, FUN 2010], which initiated a detailed analysis of the popular game of UNO (R). We consider the solitaire version of the game, which was shown to be NP-complete. In 2], the authors also demonstrate a (O)(n)(c(2)) algorithm, where c is the number of colors across all the cards, which implies, in particular that the problem is polynomial time when the number of colors is a constant. In this work, we propose a kernelization algorithm, a consequence of which is that the problem is fixed-parameter tractable when the number of colors is treated as a parameter. This removes the exponential dependence on c and answers the question stated in 2] in the affirmative. We also introduce a natural and possibly more challenging version of UNO that we call ``All Or None UNO''. For this variant, we prove that even the single-player version is NP-complete, and we show a single-exponential FPT algorithm, along with a cubic kernel.

Checking Liveness Properties of Presburger Counter Systems Using Reachability Analysis

Counter systems are a well-known and powerful modeling notation for specifying infinite-state systems. In this paper we target the problem of checking liveness properties in counter systems. We propose two semi decision techniques towards this, both of which return a formula that encodes the set of reachable states of the system that satisfy a given liveness property. A novel aspect of our techniques is that they use reachability analysis techniques, which are well studied in the literature, as black boxes, and are hence able to compute precise answers on a much wider class of systems than previous approaches for the same problem. Secondly, they compute their results by iterative expansion or contraction, and hence permit an approximate solution to be obtained at any point. We state the formal properties of our techniques, and also provide experimental results using standard benchmarks to show the usefulness of our approaches. Finally, we sketch an extension of our liveness checking approach to check general CTL properties.