A unified framework for linear function approximation of value functions in stochastic control

This paper contributes with a unified formulation that merges previ- ous analysis on the prediction of the performance ( value function ) of certain sequence of actions ( policy ) when an agent operates a Markov decision process with large state-space. When the states are represented by features and the value function is linearly approxi- mated, our analysis reveals a new relationship between two common cost functions used to obtain the optimal approximation. In addition, this analysis allows us to propose an efficient adaptive algorithm that provides an unbiased linear estimate. The performance of the pro- posed algorithm is illustrated by simulation, showing competitive results when compared with the state-of-the-art solutions.

Biophotonic Sensing Cells (BICELLs) for label-free biosensing

Label free immunoassay sector is a ferment of activity, experiencing rapid growth as new technologies come forward and achieve acceptance. The landscape is changing in a “bottom up” approach, as individual companies promote individual technologies and find a market for them. Therefore, each of the companies operating in the label-free immunoassay sector offers a technology that is in some way unique and proprietary. However, no many technologies based on Label-free technology are currently in the market for PoC and High Throughput Screening (HTS), where mature labeled technologies have taken the market.

Biophotonic Sensing Cells Optimization for label-free biosensing

Los sectores de detección biológica demandan continuamente técnicas de análisis y diagnóstico más eficientes y precisas para identificar enfermedades y desarrollar nuevos medicamentos. Actualmente se considera que hay una gran necesidad de desarrollar herramientas de diagnóstico capaces de asegurar sensibilidad, rapidez, sencillez y asequibilidad para aplicaciones en sectores como la salud, la alimentación, el medioambiente o la seguridad. En el ámbito clínico se necesitan profundos avances tecnológicos capaces de ofrecer análisis rápidos, exactos, fiables y asequibles en coste y que tengan como consecuencia la mejora clínica y económica a partir de un diagnóstico eficiente. En concreto, hay un interés creciente por la descentralización del diagnóstico clínico mediante plataformas de detección cercanas al usuario final, denominadas POCs (Point Of Care devices). La utilización de POCs (referidas al diagnóstico cercano al usuario final o fuera del laboratorio de análisis clínico), mediante detección in vitro (IVD), será extremadamente útil en centros de salud, clínicas o unidades hospitalarias, entornos laborales o incluso en el hogar. Por otra parte, el desarrollo de la genómica, proteómica y otras tecnologías conocidas como “omics” (sufijo en inglés para referirse, por ejemplo, a genomics, transcriptomics, proteomics, metabolomics, lipidomics) está incrementando la demanda de nuevas tecnologías mucho más avanzadas con una clara orientación hacia la medicina personalizada y la necesidad de hacer frente a cambios en los tratamientos en el caso de enfermedades complejas. Desde hace poco tiempo se han definido las Celdas Biofónicas (BICELLs) como una metodología novedosa para la detección de agentes biológicos que ofrecen una serie de características que las hacen interesantes como son: Capacidad de multiplexación, alta sensibilidad, posibilidad de medir en gota, compatible con otras tecnologías. En este trabajo se hace un estudio y optimización sobre diferentes tipos de BICELLs y se valoran una serie de figuras de merito a tener en cuenta desde el punto de vista del lector óptico a emplear.

Label-free biosensing for dry eye by Means of BICELLS

The use of Biophotonic Sensing Cells (BICELLs) based on micro-nano pattemed photonic architectures has been recently proven as an efficient methodology for label-free biosensing by using Optical Interrogation [1]. According to this, we have studied the different optical response for a specific typology of BICELL, consisting of structures of SU -8. This material is biocompatible with different types of biomolecules and can be immobilized on its sensing surface. In particular, we have measured the optical response for a biomarker in clinic diagnostic of dry eye. Although different proteins can be enstudied such as: PRDX5, ANXA 1, ANXA 11, CST 4, PLAA Y S 1 OOA6 related with ocular surface (dry eye), for this work PLAA (phospholipase A2) is studied by means of label free biosensing based on BICELLs for analyzing the performance and specificity according with means values of concentration in ROC curves.

Biosensing comparison between different geometries based on vertical submicron-structrures made of SU-8 resist

Previous work of the research group [1-4] demonstrated the viability of using periodic lattices of micro and nanopillars, called Bio-photonic sensing Cells (BICELLs), as an optical biosensor vertically characterized by visible spectrometry. Also we have studied theoretically [5] the performance of the BICELLs by 2D and 3D simulation in orde r to optimize the biosensing response. In this work we present the fabrication and biosensing comparison of different geometrical parameters on periodic lattices of pillars in order to discuss theoretical conclusions with these results. In this way, we have explored the biosensing response of other patter ns such as crosses, stars, cylinders, concentrical cylinders (Figure 1). Also we introduced a novel method to test the BICELLs in a cost-effective way by using an ultra-thin film of SU-8 spin-coated onto the patterns to reproduce the effect of a biofilm attached to the biosensor surface. Finally we have tested the biosensing response of the different geometries by the well-known Bovine Serum Albumin (BSA) immunoassay and compared with the theoretical simulation.

Silicon nanopillar arrays with SiO2 overlayer for biosensing application

We present the fabrication of silicon dioxide (SiO2) coated silicon nanopillar array structures and demonstrate their application as sensitive optical biosensors. Colloidal lithography, plasma dry etching and deposition processes are used to fabricate SiO2 coated Si nanopillar arrays with two different diameters and periods. Proof of concept bio recognition experiments are carried out with the bovine serum albumin (BSA)/antiBSA model system using Fourier transform visible and IR spectrometry (FT-VIS-IR) in reflection mode. A limit of detection (LoD) value of 5.2 ng/ml is estimated taking in to account the wavenumber uncertainty in the measurements.

Student academic performance stochastic simulator based on the Monte Carlo method

In this paper, a computer-based tool is developed to analyze student performance along a given curriculum. The proposed software makes use of historical data to compute passing/failing probabilities and simulates future student academic performance based on stochastic programming methods (MonteCarlo) according to the specific university regulations. This allows to compute the academic performance rates for the specific subjects of the curriculum for each semester, as well as the overall rates (the set of subjects in the semester), which are the efficiency rate and the success rate. Additionally, we compute the rates for the Bachelors degree, which are the graduation rate measured as the percentage of students who finish as scheduled or taking an extra year and the efficiency rate (measured as the percentage of credits of the curriculum with respect to the credits really taken). In Spain, these metrics have been defined by the National Quality Evaluation and Accreditation Agency (ANECA). Moreover, the sensitivity of the performance metrics to some of the parameters of the simulator is analyzed using statistical tools (Design of Experiments). The simulator has been adapted to the curriculum characteristics of the Bachelor in Engineering Technologies at the Technical University of Madrid(UPM).

Quality-optimization algorithm based on stochastic dynamic programming for MPEG DASH video streaming

In contrast to traditional push-based protocols, adaptive streaming techniques like Dynamic Adaptive Streaming over HTTP (DASH) fix attention on the client, who dynamically requests different-quality portions of the content to cope with a limited and variable bandwidth but aiming at maximizing the quality perceived by the user. Since DASH adaptation logic at the client is not covered by the standard, we propose a solution based on Stochastic Dynamic Programming (SDP) techniques to find the optimal request policies that guarantee the users' Quality of Experience (QoE). Our algorithm is evaluated in a simulated streaming session and is compared with other adaptation approaches. The results show that our proposal outperforms them in terms of QoE, requesting higher qualities on average.

Optimization methods for the operating room management under uncertainty: stochastic programming vs. decomposition approach

The operating theatres are the engine of the hospitals; proper management of the operating rooms and its staff represents a great challenge for managers and its results impact directly in the budget of the hospital. This work presents a MILP model for the efficient schedule of multiple surgeries in Operating Rooms (ORs) during a working day. This model considers multiple surgeons and ORs and different types of surgeries. Stochastic strategies are also implemented for taking into account the uncertain in surgery durations (pre-incision, incision, post-incision times). In addition, a heuristic-based methods and a MILP decomposition approach is proposed for solving large-scale ORs scheduling problems in computational efficient way. All these computer-aided strategies has been implemented in AIMMS, as an advanced modeling and optimization software, developing a user friendly solution tool for the operating room management under uncertainty.

Aluminum nanoholes for optical biosensing

Sub-wavelength diameter holes in thin metal layers can exhibit remarkable optical features that make them highly suitable for (bio)sensing applications. Either as efficient light scattering centers for surface plasmon excitation or metal-clad optical waveguides, they are able to form strongly localized optical fields that can effectively interact with biomolecules and/or nanoparticles on the nanoscale. As the metal of choice, aluminum exhibits good optical and electrical properties, is easy to manufacture and process and, unlike gold and silver, its low cost makes it very promising for commercial applications. However, aluminum has been scarcely used for biosensing purposes due to corrosion and pitting issues. In this short review, we show our recent achievements on aluminum nanohole platforms for (bio)sensing. These include a method to circumvent aluminum degradation—which has been successfully applied to the demonstration of aluminum nanohole array (NHA) immunosensors based on both, glass and polycarbonate compact discs supports—the use of aluminum nanoholes operating as optical waveguides for synthesizing submicron-sized molecularly imprinted polymers by local photopolymerization, and a technique for fabricating transferable aluminum NHAs onto flexible pressure-sensitive adhesive tapes, which could facilitate the development of a wearable technology based on aluminum NHAs.