Indexing narrative structure and semantics in motion pictures with a probabilistic framework

This work constitutes the first attempt to extract an important narrative structure, the 3-Act story telling paradigm, in film. This narrative structure is prevalent in the domain of film as it forms the foundation and framework in which the film can be made to function as an effective tool for story telling, and its extraction is a vital step in automatic content management for film data. A novel act boundary likelihood function for Act 1 is derived using a Bayesian formulation under guidance from film grammar, tested under many configurations and the results are reported for experiments involving 25 full length movies. The formulation is shown to be a useful tool in both the automatic and semi-interactive setting for semantic analysis of film.

The domain layer for mixed-initiative interaction in generative design

The design space exploration formalism has developed data structures and algorithms of sufficient complexity and scope to support conceptual layout, massing, and enclosure configurations. However, design remains a human enterprise. To support the user in designing with the formalism, we have developed an interaction model that addresses the interleaving of user actions with the formal operations of design space exploration. The central feature of our interaction model is the modeling of control based on mixed-initiative. Initiative is sometimes taken by the designer and sometimes by the formalism in working on a shared design task. The model comprises three layers, domain, task, and dialogue. In this paper we describe the formulation of the domain layer of our mixed-initiative interaction model for design space exploration. We present the view of the domain as understood in the formalism in terms of the three abstract concepts of state, move, and structure. In order to support mixed initiative, it is necessary to develop a shared view of the domain. The domain layer addresses this problem by mapping the designer's view onto the symbol substrate. First, we present the designer's view of the domain in terms of problems, solutions, choices, and history. Second, we show how this view is interleaved with the symbol-substrate through four domain layer constructs, problem state, solution state, choice, and exploration history. The domain layer presents a suitable foundation for integrating the role of the designer with a description formalism. It enables the designer to maintain exploration freedom in terms of formulating and reformulating problems, generating solutions, making choices, and navigating the history of exploration.

Challenges of continuous global optimization in molecular structure prediction

The molecular geometry, the three dimensional arrangement of atoms in space, is a major factor determining the properties and reactivity of molecules, biomolecules and macromolecules. Computation of stable molecular conformations can be done by locating minima on the potential energy surface (PES). This is a very challenging global optimization problem because of extremely large numbers of shallow local minima and complicated landscape of PES. This paper illustrates the mathematical and computational challenges on one important instance of the problem, computation of molecular geometry of oligopeptides, and proposes the use of the Extended Cutting Angle Method (ECAM) to solve this problem.

ECAM is a deterministic global optimization technique, which computes tight lower bounds on the values of the objective function and fathoms those part of the domain where the global minimum cannot reside. As with any domain partitioning scheme, its challenge is an extremely large partition of the domain required for accurate lower bounds. We address this challenge by providing an efficient combinatorial algorithm for calculating the lower bounds, and by combining ECAM with a local optimization method, while preserving the deterministic character of ECAM.

Managing data using neighbor replication on triangular-grid structure

Data is one of the domains in grid research that deals with the storage, replication, and management of large data sets in a distributed environment. The all-data-to-all sites replication scheme such as read-one write-all and tree grid structure (TGS) are the popular techniques being used for replication and management of data in this domain. However, these techniques have its weaknesses in terms of data storage capacity and also data access times due to some number of sites must ‘agree’ in common to execute certain transactions. In this paper, we propose the all-data-to-some-sites scheme called the neighbor replication on triangular grid (NRTG) technique by considering only neighbors have the replicated data, and thus, minimizes the storage capacity as well as high update availability. Also, the technique tolerates failures such as server failures, site failure or even network partitioning using remote procedure call (RPC).

Electrospun single-walled carbon nanotube/polyvinyl alcohol composite nanofibers : structure-property relationships

Polyvinyl alcohol (PVA) nanofibers and single-walled carbon nanotube (SWNT)/PVA composite nanofibers have been produced by electrospinning. An apparent increase in the PVA crystallinity with a concomitant change in its main crystalline phase and a reduction in the crystalline domain size were observed in the SWNT/PVA composite nanofibers, indicating the occurrence of a SWNT-induced nucleation crystallization of the PVA phase. Both the pure PVA and SWNT/PVA composite nanofibers were subjected to the following post-electrospinning treatments: (i) soaking in methanol to increase the PVA crystallinity, and (ii) cross-linking with glutaric dialdehyde to control the PVA morphology. Effects of the PVA morphology on the tensile properties of the resultant electrospun nanofibers were examined. Dynamic mechanical thermal analyses of both pure PVA and SWNT/PVA composite electrospun nanofibers indicated that SWNT–polymer interaction facilitated the formation of crystalline domains, which can be further enhanced by soaking the nanofiber in methanol and/or cross-linking the polymer with glutaric dialdehyde.

Spectral element modelling of wave propagation with boundary and structural discontinuity reflections

Spectral element method is very efficient in modelling high-frequency stress wave propagation because it works in the frequency domain. It does not need to use very fine meshes in order to capture high frequency wave energy as the time domain methods do, such as finite element method. However, the conventional spectral element method requires a throw-off element to be added to the structural boundaries to act as a conduit for energy to transmit out of the system. This makes the method difficult to model wave reflection at boundaries. To overcome this limitation, imaginary spectral elements are proposed in this study, which are combined with the real structural elements to model wave reflections at structural boundaries. The efficiency and accuracy of this proposed approach is verified by comparing the numerical simulation results with measured results of one dimensional stress wave propagation in a steel bar. The method is also applied to model wave propagation in a steel bar with not only boundary reflection, but also reflections from single and multiple cracks. The reflection and transmission coefficients, which are obtained from the discrete spring model, are adopted to quantify the discontinuities. Experimental tests of wave propagation in a steel bar with one crack of different depths are also carried out. Numerical simulations and experimental results show that the proposed method is effective and reliable in modelling wave propagation in one-dimensional waveguides with reflections from boundary and structural discontinuities. The proposed method can be applied to effectively model stress wave propagation for structural damage detection.

Spherulitic networks : from structure to rheological property

A finite element method based on ABAQUS is employed to examine the correlation between the microstructure and the elastic response of planar Cayley treelike fiber networks. It is found that the elastic modulus of the fiber network decreases drastically with the fiber length, following the power law. The power law of elastic modulus G′ vs the correlation length ξ obtained from this simulation has an exponent of −1.71, which is close to the exponent of −1.5 for a single-domain network of agar gels. On the other hand, the experimental results from multidomain networks give rise to a power law index of −0.49. The difference between −1.5 and −0.49 can be attributed to the multidomain structure, which weakens the structure of the overall system and therefore suppresses the increase in G′. In addition, when the aspect ratio of the fiber is smaller than 20, the radius of the fiber cross-section has a great impact on the network elasticity, while, when the aspect ratio is larger than 20, it has almost no effect on the elastic property of the network. The stress distribution in the network is uniform due to the symmetrical network structure. This study provides a general understanding of the correlation between microscopic structure and the macroscopic properties of soft functional materials.

Ligand-enhanced expression and in-cell assay of human peroxisome proliferator-activated receptor alpha ligand binding domain

A human peroxisome proliferator-activated receptor alpha ligand binding domain (PPARαLBD)-maltose binding protein fusion construct was expressed in Escherichia coli. A codon optimized DNA sequence encoding human PPARαLBD (aa196–468) was synthesized and ligated into the pDEST17 E. coli expression vector downstream of a MBP solubility fusion tag and an intermittent TEV protease cleavage site. Following auto-induction at 28 °C, PPARαLBD protein was purified to electrophoretic homogeneity by a nickel affinity chromatographic step, on-column TEV protease cleavage followed by Sephacryl S200 size exclusion chromatography. The recombinant protein displayed cross-reactivity with goat anti-(human PPARα) polyclonal antibody and was identified as human PPARα by trypic peptide mass finger-printing. The addition of a PPARα specific ligand (fenofibric acid, GW7647 or GW590735) to the growth media significantly stabilized the PPARαLBD structure and enhanced the expression of soluble protein. In-cell ligand binding was examined by monitoring the enhancement of PPARαLBD expression as a function of the concentration of ligand in the growth media. The efficient expression and in-cell assay of the reported PPARαLBD construct make it amenable to high through-put screening assays in drug discovery programs.

A probabilistic framework for extracting narrative act boundaries and semantics in motion pictures

This work constitutes the first attempt to extract the important narrative structure, the 3-Act storytelling paradigm in film. Widely prevalent in the domain of film, it forms the foundation and framework in which a film can be made to function as an effective tool for story telling, and its extraction is a vital step in automatic content management for film data. The identification of act boundaries allows for structuralizing film at a level far higher than existing segmentation frameworks, which include shot detection and scene identification, and provides a basis for inferences about the semantic content of dramatic events in film. A novel act boundary likelihood function for Act 1 and 2 is derived using a Bayesian formulation under guidance from film grammar, tested under many configurations and the results are reported for experiments involving 25 full-length movies. The result proves to be a useful tool in both the automatic and semi-interactive setting for semantic analysis of film, with potential application to analogues occuring in many other domains, including news, training video, sitcoms.

Incorporating domain knowledge with video and voice data analysis in news broadcasts

This paper addresses the area of video annotation, indexing and retrieval, and shows how a set of tools can be employed, along with domain knowledge, to detect narrative structure in broadcast news. The initial structure is detected using low-level audio visual processing in conjunction with domain knowledge. Higher level processing may then utilize the initial structure detected to direct processing to improve and extend the initial classification.

The structure detected breaks a news broadcast into segments, each of which contains a single topic of discussion. Further the segments are labeled as a) anchor person or reporter, b) footage with a voice over or c) sound bite. This labeling may be used to provide a summary, for example by presenting a thumbnail for each reporter present in a section of the video. The inclusion of domain knowledge in computation allows more directed application of high level processing, giving much greater efficiency of effort expended. This allows valid deductions to be made about structure and semantics of the contents of a news video stream, as demonstrated by our experiments on CNN news broadcasts.

The boundary lubrication of chemically grafted and cross-linked hyaluronic acid in phosphate buffered saline and lipid solutions measured by the surface forces apparatus

High molecular weight hyaluronic acid (HA) is present in articular joints and synovial fluid at high concentrations; yet despite numerous studies, the role of HA in joint lubrication is still not clear. Free HA in solution does not appear to be a good lubricant, being negatively charged and therefore repelled from most biological, including cartilage, surfaces. Recent enzymatic experiments suggested that mechanically or physically (rather than chemically) trapped HA could function as an “adaptive” or “emergency” boundary lubricant to eliminate wear damage in shearing cartilage surfaces. In this work, HA was chemically grafted to a layer of self-assembled amino-propyl-triethoxy-silane (APTES) on mica and then cross-linked. The boundary lubrication behavior of APTES and of chemically grafted and cross-linked HA in both electrolyte and lipid 1,2-dioleoyl-sn-glycero-3-phosphocholine (DOPC) solutions was tested with a surface forces apparatus (SFA). Despite the high coefficient of friction (COF) of μ ≈ 0.50, the chemically grafted HA gel significantly improved the lubrication behavior of HA, particularly the wear resistance, in comparison to free HA. Adding more DOPC lipid to the solution did not improve the lubrication of the chemically grafted and cross-linked HA layer. Damage of the underlying mica surface became visible at higher loads (pressure >2 MPa) after prolonged sliding times. It has generally been assumed that damage caused by or during sliding, also known as “abrasive friction”, which is the main biomedical/clinical/morphological manifestation of arthritis, is due to a high friction force and, therefore, a large COF, and that to prevent surface damage or wear (abrasion) one should therefore aim to reduce the COF, which has been the traditional focus of basic research in biolubrication, particularly in cartilage and joint lubrication. Here we combine our results with previous ones on grafted and cross-linked HA on lipid bilayers, and lubricin-mediated lubrication, and conclude that for cartilage surfaces, a high COF can be associated with good wear protection, while a low COF can have poor wear resistance. Both of these properties depend on how the lubricating molecules are attached to and organized at the surfaces, as well as the structure and mechanical, viscoelastic, elastic, and physical properties of the surfaces, but the two phenomena are not directly or simply related. We also conclude that to provide both the low COF and good wear protection of joints under physiological conditions, some or all of the four major components of joints—HA, lubricin, lipids, and the cartilage fibrils—must act synergistically in ways (physisorbed, chemisorbed, grafted and/or cross-linked) that are still to be determined.

Molecular aspects of boundary lubrication by human lubricin : effect of disulfide bonds and enzymatic digestion

Lubricin (LUB) is a glycoprotein of the synovial cavity of human articular joints, where it serves as an antiadhesive, boundary lubricant, and regulating factor for the cartilage surface. It has been proposed that these properties are related to the presence of a long, extended, heavily glycosylated and highly hydrated mucinous domain in the central part of the LUB molecule. In this work, we show that LUB has a contour length of 220 ± 30 nm and a persistence length of ≤10 nm. LUB molecules aggregate in oligomers where the protein extremities are linked by disulfide bonds. We have studied the effect of proteolytic digestion by chymotrypsin and removal of the disulfide bonds, both of which mainly affect the N− and C− terminals of the protein, on the adsorption, normal forces, friction (lubrication) forces, and wear of LUB layers adsorbed on smooth, negatively charged mica surfaces, where the protein naturally forms lubricating polymer brush-like layers. After in situ digestion, the surface coverage was drastically reduced, the normal forces were altered, and both the coefficient of friction and the wear were dramatically increased (the COF increased to μ = 1.1−1.9), indicating that the mucinous domain was removed from the surface. Removal of disulfide bonds did not change the surface coverage or the overall features of the normal forces; however, we find an increase in the friction coefficient from μ = 0.02−0.04 to μ = 0.13−1.17 in the pressure regime below 6 atm, which we attribute to a higher affinity of the protein terminals for the surface. The necessary condition for LUB to be a good lubricant is that the protein be adsorbed to the surface via its terminals, leaving the central mucin domain free to form a low-friction, surface-protecting layer. Our results suggest that this “end-anchoring” has to be strong enough to impart the layer a sufficient resistance to shear, but without excessively restricting the conformational freedom of the adsorbed proteins.

Vibration based damage identification of a scale-model steel frame structure subjected to bolt connection failures

Large-span steel frame structures prove to be an ideal choice for their speed of construction, relatively low cost, strength, durability and structural design flexibility. For this type of structure, the beam-column connections are critical for its structural integrity and overall stability. This is because a steel frame generally fails first at its connectors, due to the change in stress redistribution with adjacent members and material related failures, caused by various factors such as fire, seismic activity or material deterioration. Since particular attention is required at a steel frame’s connection points, this study explores the applicability of a comprehensive structural health monitoring (SHM) method to identify early damage and prolong the lifespan of connection points of steel frames. An impact hammer test was performed on a scale-model steel frame structure, recording its dynamic response to the hammer strike via an accelerometer. The testing procedure included an intact scenario and two damage scenarios by unfastening four bolt connections in an accumulating order. Based entirely on time-domain experimental data for its calibration, an Auto Regressive Average Exogenous (ARMAX) model is used to create a simple and accurate model for vibration simulation. The calibrated ARMAX model is then used to identify various bolt-connection related damage scenarios via R² value. The findings in this study suggest that the proposed time-domain approach is capable of identifying structural damage in a parsimonious manner and can be used as a quick or initial solution.