Adaptive Sleep-Wake Control using Reinforcement Learning in Sensor Networks

The aim in this paper is to allocate the `sleep time' of the individual sensors in an intrusion detection application so that the energy consumption from the sensors is reduced, while keeping the tracking error to a minimum. We propose two novel reinforcement learning (RL) based algorithms that attempt to minimize a certain long-run average cost objective. Both our algorithms incorporate feature-based representations to handle the curse of dimensionality associated with the underlying partially-observable Markov decision process (POMDP). Further, the feature selection scheme used in our algorithms intelligently manages the energy cost and tracking cost factors, which in turn assists the search for the optimal sleeping policy. We also extend these algorithms to a setting where the intruder's mobility model is not known by incorporating a stochastic iterative scheme for estimating the mobility model. The simulation results on a synthetic 2-d network setting are encouraging.

Pulse transit time differential measurement by fiber Bragg grating pulse recorder

The present study reports a noninvasive technique for the measurement of the pulse transit time differential (PTTD) from the pulse pressure waveforms obtained at the carotid artery and radial artery using fiber Bragg grating pulse recorders (FBGPR). PTTD is defined as the time difference between the arrivals of a pulse pressure waveform at the carotid and radial arterial sites. The PTTD is investigated as an indicator of variation in the systolic blood pressure. The results are validated against blood pressure variation obtained from a Mindray Patient Monitor. Furthermore, the pulse wave velocity computed from the obtained PTTD is compared with the pulse wave velocity obtained from the color Doppler ultrasound system and is found to be in good agreement. The major advantage of the PTTD measurement via FBGPRs is that the data acquisition system employed can simultaneously acquire pulse pressure waveforms from both FBGPRs placed at carotid and radial arterial sites with a single time scale, which eliminates time synchronization complexity. (C) 2015 Society of Photo-Optical Instrumentation Engineers (SPIE)

Study on effect of optical wavelength on photo induced strain sensitivity in carbon nanotubes using fiber Bragg grating

In this work, the role of optical wavelength on the photo induced strain in carbon nanotubes (CNT) is probed using a Fiber Bragg Grating (FBG), upon exposure to infrared (IR) (21 mu epsilon mW(-1)) and visible (9 mu epsilon mW(-1)) radiations. The strain sensitivity in CNT is monitored over a smaller range (10(-3) to 10(-9) epsilon) by exposing to a low optical power varying in the range 10(-3) to 10(-6) W. In addition, the wavelength dependent response and recovery periods of CNT under IR (tau(rise) = 150 ms, tau(fall) = 280 ms) and visible (tau(rise) = 1.07 s, tau(fall) = 1.18 s) radiations are evaluated in detail. This study can be further extended to measure the sensitivity of nano-scale photo induced strains in nano materials and opens avenues to control mechanical actuation using various optical wavelengths.

Multi-agent Reinforcement Learning for Traffic Signal Control

Optimal control of traffic lights at junctions or traffic signal control (TSC) is essential for reducing the average delay experienced by the road users amidst the rapid increase in the usage of vehicles. In this paper, we formulate the TSC problem as a discounted cost Markov decision process (MDP) and apply multi-agent reinforcement learning (MARL) algorithms to obtain dynamic TSC policies. We model each traffic signal junction as an independent agent. An agent decides the signal duration of its phases in a round-robin (RR) manner using multi-agent Q-learning with either is an element of-greedy or UCB 3] based exploration strategies. It updates its Q-factors based on the cost feedback signal received from its neighbouring agents. This feedback signal can be easily constructed and is shown to be effective in minimizing the average delay of the vehicles in the network. We show through simulations over VISSIM that our algorithms perform significantly better than both the standard fixed signal timing (FST) algorithm and the saturation balancing (SAT) algorithm 15] over two real road networks.

Fly ash cenospheres as reinforcement in different polymer composites - a comparative study of physical and mechanical properties

The work reports the preparation of fly ash cenospheres bearing polymer composites, using various polymer matrix materials namely, low density polyethylene, high density polyethylene, polystyrene and polymethylmethacrylate followed by evaluation of properties. The composites are synthesized by including about 18% by weight fly ash cenospheres, into various polymer matrices using brabender facility in the temperature range 120-160 degrees C and at a mixing pressure of 50 MPa. Subsequently, they are cast into sheets through compression moulding. The test samples, made from the sheets, are characterized for physical as well as mechanical properties such as density, hardness, compression strength, impact response, wear and friction. The investigation reveals that the addition of fly ash cenospheres to various polymer matrices results in reduction of density. Further, improvements in the slide wear resistance and decrease in the co-efficient of friction values are noticed. As for interpreting the slide wear data, recourse to examination under scanning electron microscope is made in this paper. As regards the mechanical properties, hardness increases while the compression strength and impact energy decreases with inclusion of cenospheres in all the four types of samples investigated.

Non-invasive pressure monitoring by hoop strain using Fiber Bragg Grating sensor

Non-invasive, real-time dynamic monitoring of pressure inside a column with the aid of Fiber Bragg Grating (FBG) sensor is presented in the present work. A bare FBG sensor is adhered on the circumference of a pressure column normal to its axis, which has the ability to acquire the hoop strain induced by the pressure variation inside the column. Pressure induced hoop strain response obtained using FBG sensor is validated against the pressure measurements obtained from conventional pressure gauge. Further, a protrusion setup on the outer surface of the column has been proposed over which a secondary FBG sensor is bonded normal to its axis, in order to increase the gauge length of this FBG sensor. This is carried out in order to validate the variation in sensitivity of the protrusion bonded FBG sensor compared to the bare FBG sensor bonded over the surface. A comparative study is done between the two FBG sensors and a conventional pressure gauge in order to establish the capacity of FBG sensor obtained hoop strain response for pressure monitoring inside the column.

Ag+-induced reverse vesicle to helical fiber transformation in a self-assembly by adjusting the keto-enol equilibrium of a chiral salicylideneaniline

A new chiral amphiphilic salicylideneaniline bearing a terminal pyridine was synthesized. It formed reverse vesicles in toluene. The addition of Ag+, however, reversibly transforms these reverse vesicles into left-handed nanohelices accompanied by spontaneous gel formation at room temperature.

Ultra sensitive NO2 gas detection using the reduced graphene oxide coated etched fiber Bragg gratings

We report a simple and highly sensitive methodology for the room temperature NO2 gas sensing using reduced graphene oxide (RGO) coated clad etched fiber Bragg grating (eFBG). A significant shift (>10 pm) is observed in the reflected Bragg wavelength (lambda(B)) upon exposing RGO coated on the surface of eFBG to the NO2 gas molecules of concentration 0.5 ppm. The shift in Bragg wavelength is due to the change in the refractive index of RGO by charge transfer from the adsorbing NO2 molecules. The range of NO2 concentration is tested from 0.5 ppm to 3 ppm and the estimated time taken for 50% increase in Delta lambda(B) ranges from 20 min (for 0.5 ppm) to 6 min (for 3 ppm). (C) 2015 Elsevier B.V. All rights reserved.

Fiber Bragg Grating Sensor Package for Submicron Level Displacement Measurements

In this article, the design and development of a Fiber Bragg Grating (FBG) based displacement sensor package for submicron level displacement measurements are presented. A linear shift of 12.12 nm in Bragg wavelength of the FBG sensor is obtained for a displacement of 6 mm with a calibration factor of 0.495 mu m/pm. Field trials have also been conducted by comparing the FBG displacement sensor package against a conventional dial gauge, on a five block masonry prism specimen loaded using three-point bending technique. The responses from both the sensors are in good agreement, up to the failure of the masonry prism. Furthermore, from the real-time displacement data recorded using FBG, it is possible to detect the time at which early creaks generated inside the body of the specimen which then prorogate to the surface to develop visible surface cracks; the respective load from the load cell can be obtained from the inflection (stress release point) in the displacement curve. Thus the developed FBG displacement sensor package can be used to detect failures in structures much earlier and to provide an adequate time to exercise necessary action, thereby avoiding the possible disaster.

Electromagnetic analysis of novel class of multiple core/multiple clad step index single mode optical fiber by analytical means

General propagation properties and universal curves are given for double clad single mode fibers with inner cladding index higher or lower than the outer cladding index, using the parameter: inner cladding/core radii ratio. Mode cut-off conditions are also examined for the cases. It is shown that dispersion properties largely differ from the single clad single mode fiber case, leading to large new possibilities for extension of single mode operation for large wavelength tange. Paper demonstrates that how substantially we can extend the single mode operation range by using the raised inner cladding fiber. Throughout we have applied our own computations technique to find out the eigenvalue for a given modes. Detail derivations with all trivial mathematics for eigenmode equation are derived for each case. Paper also demonstrates that there is not much use of using depressed inner cladding fiber. We have also concluded that using the large inner cladding/inner core radius we can significantly increase the single mode operation range for the large wavelength region. (C) 2015 Elsevier GmbH. All rights reserved.

Effect of particle size of sand and surface asperities of reinforcement on their interface shear behaviour

This paper investigates the effect of particle size of sand and the surface asperities of reinforcing material on their interlocking mechanism and its influence on the interfacial shear strength under direct sliding condition. Three sands of different sizes with similar morphological characteristics and four different types of reinforcing materials with different surface features were used in this study. Interface direct shear tests on these materials were performed in a specially developed symmetric loading interface direct shear test setup. Morphological characteristics of sand particles were determined from digital image analysis and the surface roughness of the reinforcing materials was measured using an analytical expression developed for this purpose. Interface direct shear tests at three different normal stresses were carried out by shearing the sand on the reinforcing material fixed to a smooth surface. Test results revealed that the peak interfacial friction and dilation angles are hugely dependent upon the interlocking between the sand particles and the asperities of reinforcing material, which in turn depends on the relative size of sand particles and asperities. Asperity ratio (AS/D-50) of interlocking materials, which is defined as the ratio of asperity spacing of the reinforcing material and the mean particle size of sand was found to govern the interfacial shear strength with highest interfacial strength measured when the asperity ratio was equal to one, which represents the closest fitting of sand particles into the asperities. It was also understood that the surface roughness of the reinforcing material influences the shear strength to an extent, the influence being more pronounced in coarser particles. Shear bands in the interface shear tests were analysed through image segmentation technique and it was observed that the ratio of shear band thickness (t) to the median particle size (D-50) was maximum when the AS/D-50 was equal to one. (C) 2015 Elsevier Ltd. All rights reserved.

Modeling and mesoscopic damage constitutive relation of brittle short-fiber-reinforced composites

Aimed at brittle composites reinforced by randomly distributed short-fibers with a relatively large aspect ratio, stiffness modulus and strength, a mesoscopic material model was proposed. Based on the statistical description, damage mechanisms, damage-induced anisotropy, damage rate effect and stress redistribution, the constitutive relation were derived. By taking glass fiber reinforced polypropylene polymers as an example, the effect of initial orientation distribution of fibers, damage-induced anisotropy, and damage-rate effect on macro-behaviors of composites were quantitatively analyzed. The theoretical predictions compared favorably with the experimental results.

Enhanced Plasticity of Zr-Based Bulk Metallic Glass Matrix Composite with Ductile Reinforcement

A composite material containing uniformly distributed micrometer-sized Nb particles in a Zr-based amorphous matrix was prepared by suction cast. The resulting material exhibits high fractured strength over 1550 MPa and enhanced plastic strain of about 29.7% before failure in uniaxial compression test at room temperature. Studies of the serrations on the stress-strain curves and the shear bands on the fractured samples reveal that the amplitude of the stress drop of each serration step corresponds to the extent of the propagation of a single shear band through the materials. The composite exhibits more serration steps and smaller amplitude of stress drop due to the pinning of shear band propagation by ductile Nb particles.

Thermocapillary flow in an annular liquid layer painted on a moving fiber

In the present paper, a theoretical model is studied on the flow in the liquid annular film, which is ejected from a vessel with relatively higher temperature and painted on the moving solid fiber. A temperature gradient, driving a thermocapillary flow, is formed on the free surface because of the heat transfer from the liquid with relatively higher temperature to the environmental gas with relatively lower temperature. The thermocapillary flow may change the radii profile of the liquid film. This process analyzed is based on the approximations of lubrication theory and perturbation theory, and the equation of the liquid layer radii and the process of thermal hydrodynamics in the liquid layer are solved for a temperature distribution on the solid fiber.

Experimental Study on Dynamic Properties of High Strength Fiber Clusters

In this paper, the dynamic behaviors of several kinds of high strength fibers, including Kevlar, UHMPE, glass fibers, carbon fibers etc., are investigated experimentally, with a Split Hopkinson Tension Bar (SHTB). The effect of strain rate on the modulus, strength, failure strain and failure characteristics of fibers, under impact loading, is analyzed with the relative stress vs. strain curves. At the same time, the mechanism about the rate dependence of mechanical behaviors of various fibers is discussed based on the understanding on the microstructures and deformation models of materials. Some comments are also presented on the decentralization of experimental results, and a new method called traveling wave method is presented to increase the experimental accuracy. Research results obtained in this paper will benefit to understand the energy absorption and to build up the constitutive law of protective materials reinforced by high strength fibers.