Pragmatic development of service based real-time change data capture

This thesis makes a contribution to the Change Data Capture (CDC) field by providing an empirical evaluation on the performance of CDC architectures in the context of realtime data warehousing. CDC is a mechanism for providing data warehouse architectures with fresh data from Online Transaction Processing (OLTP) databases. There are two types of CDC architectures, pull architectures and push architectures. There is exiguous data on the performance of CDC architectures in a real-time environment. Performance data is required to determine the real-time viability of the two architectures. We propose that push CDC architectures are optimal for real-time CDC. However, push CDC architectures are seldom implemented because they are highly intrusive towards existing systems and arduous to maintain. As part of our contribution, we pragmatically develop a service based push CDC solution, which addresses the issues of intrusiveness and maintainability. Our solution uses Data Access Services (DAS) to decouple CDC logic from the applications. A requirement for the DAS is to place minimal overhead on a transaction in an OLTP environment. We synthesize DAS literature and pragmatically develop DAS that eciently execute transactions in an OLTP environment. Essentially we develop effeicient RESTful DAS, which expose Transactions As A Resource (TAAR). We evaluate the TAAR solution and three pull CDC mechanisms in a real-time environment, using the industry recognised TPC-C benchmark. The optimal CDC mechanism in a real-time environment, will capture change data with minimal latency and will have a negligible affect on the database's transactional throughput. Capture latency is the time it takes a CDC mechanism to capture a data change that has been applied to an OLTP database. A standard definition for capture latency and how to measure it does not exist in the field. We create this definition and extend the TPC-C benchmark to make the capture latency measurement. The results from our evaluation show that pull CDC is capable of real-time CDC at low levels of user concurrency. However, as the level of user concurrency scales upwards, pull CDC has a significant impact on the database's transaction rate, which affirms the theory that pull CDC architectures are not viable in a real-time architecture. TAAR CDC on the other hand is capable of real-time CDC, and places a minimal overhead on the transaction rate, although this performance is at the expense of CPU resources.

Digital signal processing implementation for near real-time wavelet transformation system for binary images

Communication has become an essential function in our civilization. With the increasing demand for communication channels, it is now necessary to find ways to optimize the use of their bandwidth. One way to achieve this is by transforming the information before it is transmitted. This transformation can be performed by several techniques. One of the newest of these techniques is the use of wavelets. Wavelet transformation refers to the act of breaking down a signal into components called details and trends by using small waveforms that have a zero average in the time domain. After this transformation the data can be compressed by discarding the details, transmitting the trends. In the receiving end, the trends are used to reconstruct the image. In this work, the wavelet used for the transformation of an image will be selected from a library of available bases. The accuracy of the reconstruction, after the details are discarded, is dependent on the wavelets chosen from the wavelet basis library. The system developed in this thesis takes a 2-D image and decomposes it using a wavelet bank. A digital signal processor is used to achieve near real-time performance in this transformation task. A contribution of this thesis project is the development of DSP-based test bed for the future development of new real-time wavelet transformation algorithms.

Near real time surface ocean velocity in the Bay of Biscay - Basque Country from Mai to September 2016

The data set consists of maps of total velocity of the surface current in the Southeastern Bay of Biscay averaged over a time interval of 1 hour around the cardinal hour. Surface ocean velocities estimated by this HF Radar(4.65 MHz) are representative of the upper 2-3 meters of the ocean. The main objective of near real time processing is to produce the best product from available data at the time of processing. Total velocities are derived using least square fit that maps radial velocities measured from individual sites onto a cartesian grid. The final product is a map of the horizontal components of the ocean currents on a regular grid in the area of overlap of two or more radar stations.

Real-time surface current data in the Ibiza Channel from January to October 2016

The data set consists of maps of total velocity of surface currents in the Ibiza Channel, derived from HF radar measurements.

Real-time detection of faces in video streams

[EN]This paper describes a face detection system which goes beyond traditional approaches normally designed for still images. First the video stream context is considered to apply the detector, and therefore, the resulting system is designed taking into consideration a main feature available in a video stream, i.e. temporal coherence. The resulting system builds a feature based model for each detected face, and searches them using various model information in the next frame. The results achieved for video stream processing outperform Rowley-Kanade's and Viola-Jones' solutions providing eye and face data in a reduced time with a notable correct detection rate.

Validation of reference genes for gene expression studies in the honey bee, Apis mellifera, by quantitative real-time RT-PCR

For obtaining accurate and reliable gene expression results it is essential that quantitative real-time RT-PCR (qRT-PCR) data are normalized with appropriate reference genes. The current exponential increase in postgenomic studies on the honey bee, Apis mellifera, makes the standardization of qRT-PCR results an important task for ongoing community efforts. For this aim we selected four candidate reference genes (actin, ribosomal protein 49, elongation factor 1-alpha, tbp-association factor) and used three software-based approaches (geNorm, BestKeeper and NormFinder) to evaluate the suitability of these genes as endogenous controls. Their expression was examined during honey bee development, in different tissues, and after juvenile hormone exposure. Furthermore, the importance of choosing an appropriate reference gene was investigated for two developmentally regulated target genes. The results led us to consider all four candidate genes as suitable genes for normalization in A. mellifera. However, each condition evaluated in this study revealed a specific set of genes as the most appropriated ones.

Detection of dengue virus in saliva and urine by real time RT-PCR

Early diagnosis of dengue virus (DENV) infection is important for patient management and control of dengue outbreaks. The objective of this study was to analyze the usefulness of urine and saliva samples for early diagnosis of DENV infection by real time RT-PCR. Two febrile patients, who have been attended at the General Hospital of the School of Medicine of Ribeirao Preto, Sao Paulo University were included in the study. Serum, urine and saliva samples collected from both patients were subjected to real time RT-PCR for DENV detection and quantification. Dengue RNA was detected in serum, urine and saliva samples of both patients. Patient 1 was infected with DENV-2 and patient 2 with DENV-3. Data presented in this study suggest that urine and saliva could be used as alternative samples for early diagnosis of dengue virus infection when blood samples are difficult to obtain, e.g.,in newborns and patients with hemorrhagic syndromes.

Real-Time Voltage Regulation in Power Distribution System Using Fuzzy Control

Two different fuzzy approaches to voltage control in electric power distribution systems are introduced in this paper. The real-time controller in each case would act on power transformers equipped with under-load tap changers. Learning systems are employed to turn the voltage-control relays into adaptive devices. The scope of this study has been limited to the power distribution substation, and the voltage measurements and control actions are carried out on the secondary bus. The capacity of fuzzy systems to handle approximate data, together with their unique ability to interpret qualitative information, make it possible to design voltage-control strategies that satisfy the requirements of the Brazilian regulatory bodies and the real concerns of the electric power distribution companies. Fuzzy control systems based on these two strategies have been implemented and the test results were highly satisfactory.

Standard Values for Real-Time Transthoracic Three-Dimensional Echocardiographic Dyssynchrony Indexes in a Normal Population

Background: There is a paucity of information describing the real-time 3-dimensional echocardiography (RT3DE) and dyssynchrony indexes (DIs) of a normal population. We evaluate the RT3DE DIs in a population with normal electrocardiograms and 2- and 3-dimensional echocardiographic analyses. This information is relevant for cardiac resynchronization therapy. Methods: We evaluated 131 healthy volunteers (73 were male, aged 46 +/- 14 years) who were referred for routine echocardiography; who presented normal cardiac structure on electrocardiography, 2-dimensional echocardiography, and RT3DE; and who had no history of cardiac diseases. We analyzed 3-dimensional left ventricular ejection fraction, left ventricle end-diastolic volume, left ventricle end-systolic volume, and left ventricular systolic DI% (6-, 12-, and 16-segment models). RT3DE data were analyzed by quantifying the statistical distribution (mean, median, standard deviation [SD], relative SD, coefficient of skewness, coefficient of kurtosis, Kolmogorov-Smirnov test, D`Agostino-Pearson test, percentiles, and 95% confidence interval). Results: Left ventricular ejection fraction ranged from 50% to 80% (66.1% +/- 7.1%); left ventricle end-diastolic volume ranged from 39.8 to 145 mL (79.1 +/- 24.9 mL); left ventricle end-systolic volume ranged from 12.9 to 66 mL (27 +/- 12.1 mL); 6-segment DI% ranged from 0.20% to 3.80% (1.21% +/- 0.66%), median: 1.06, relative SD: 0.5482, coefficient of skewness: 1.2620 (P < .0001), coefficient of Kurtosis: 1.9956 (P = .0039); percentile 2.5%: 0.2900, percentile 97.5%: 2.8300; 12-segment DI% ranged from 0.22% to 4.01% (1.29% +/- 0.71%), median: 1.14, relative SD: 0.95, coefficient of skewness: 1.1089 (P < .0001), coefficient of Kurtosis: 1.6372 (P = .0100), percentile 2.5%: 0.2850, percentile 97.5%: 3.0700; and 16-segment DI% ranged from 0.29% to 4.88% (1.59 +/- 0.99), median: 1.39, relative SD: 0.56, coefficient of skewness: 1.0792 (P < .0001), coefficient of Kurtosis: 0.9248 (P = .07), percentile 2.5%: 0.3750, percentile 97.5%: 3.750. Conclusion: This study allows for the quantification of RT3DE DIs in normal subjects, providing a comparison for patients with heart failure who may be candidates for cardiac resynchronization therapy. (J Am Soc Echocardiogr 2008; 21: 1229-1235)

Real-time quantitative PCR in cerebral toxoplasmosis diagnosis of Brazilian human immunodeficiency virus-infected patients

Cerebral toxoplasmosis is the most common cerebral mass lesion in AIDS patients in Brazil, and results in high mortality and morbidity, despite free access to HAART (highly active antiretroviral treatment). Molecular diagnosis based on conventional PCR (cnPCR) or real-time quantitative PCR (qrtPCR) has been indispensable for definitive diagnosis. We report here the evaluation of qrtPCR with blood and cerebrospinal fluid (CSF) samples from AIDS patients in Brazil. This prospective study was conducted for 2 years, analysing DNA samples extracted from 149 AIDS patients (98 blood and 51 CSF samples) with confirmed clinical and radiological diagnosis The laboratory diagnosis included cnPCR (with the B22/B23 primer set) and indirect immunofluorescence (IF). For qrtPCR, two primer sets were simultaneously designed based on described genes and using a 6-carboxyfluorescein dye-labelled TaqMan MGB (minor groove binder) probe One was Bug, which amplified a sequence from the B1 gene The other was the RETg, which amplified a PCR product of the 529 bp sequence. The overall cnPCR and qrtPCR results were positive results were observed in 33.6% (50) patients The sensitivities were 98% for cnPCR (B22/B23), and 86 and 98% for qrtPCR (B1Tg and RETg, respectively). Negative reactions were observed in 66 4% patients. The specificities were 97% for cnPCR and qrtPCR (B1Tg). and 88.8% for RETg These data show that RETg PCR is highly sensitive as it amplifies a repeat region with many copies; however, its specificity is lower than the other markers However, B1Tg PCR had good specificity, but lower sensitivity Among the patients, 20 had blood and CSF collected simultaneously Thus, their results permitted us to analyse and compare molecular, serological and clinical diagnosis for a better understanding of the different scenarios of laboratorial and clinical diagnosis. For nine patients with confirmed cerebral toxoplasmosis diagnosis, four scenarios were observed: (i) and (ii) negative molecular diagnosis for CSF and positive for blood with variable IF titres for the sera and CSF (negative or positive), (iii) positive molecular diagnosis with CSF and negative with blood, and (iv) positive molecular diagnosis in both samples. In the latter two situations, normally the IF titres in sera and CSF are variable. Other opportunistic infections were shown in 11 patients Despite the IF titres in sera and CSF being variable, all of them had negative molecular diagnosis for both samples qrtPCR allows for a rapid identification of Toxoplasma gondii DNA in patient samples; in a minority of cases discrepancies occur with the cnPCR.

A SON Enhanced Algorithm for Observed Time Differences Based Geolocation in Real 3G Networks

Conferência - 16th International Symposium on Wireless Personal Multimedia Communications (WPMC)- Jun 24-27, 2013

Engineering real-time applications with WorldFIP: tools and analysis

WorldFIP is standardised as European Norm EN 50170 - General Purpose Field Communication System. Field communication systems (fieldbuses) started to be widely used as the communication support for distributed computer-controlled systems (DCCS), and are being used in all sorts of process control and manufacturing applications within different types of industries. There are several advantages in using fieldbuses as a replacement of for the traditional point-to-point links between sensors/actuators and computer-based control systems. Indeed they concern economical ones (cable savings) but, importantly, fieldbuses allow an increased decentralisation and distribution of the processing power over the field. Typically DCCS have real-time requirements that must be fulfilled. By this, we mean that process data must be transferred between network computing nodes within a maximum admissible time span. WorldFIP has very interesting mechanisms to schedule data transfers. It explicit distinguishes to types of traffic: periodic and aperiodic. In this paper we describe how WorldFIP handles these two types of traffic, and more importantly, we provide a comprehensive analysis for guaranteeing the real-time requirements of both types of traffic. A major contribution is made in the analysis of worst-case response time of aperiodic transfer requests.

Distributed computing for the factory-floor: a real-time approach using WorldFIP networks

Field communication systems (fieldbuses) are widely used as the communication support for distributed computer-controlled systems (DCCS) within all sort of process control and manufacturing applications. There are several advantages in the use of fieldbuses as a replacement for the traditional point-to-point links between sensors/actuators and computer-based control systems, within which the most relevant is the decentralisation and distribution of the processing power over the field. A widely used fieldbus is the WorldFIP, which is normalised as European standard EN 50170. Using WorldFIP to support DCCS, an important issue is “how to guarantee the timing requirements of the real-time traffic?” WorldFIP has very interesting mechanisms to schedule data transfers, since it explicitly distinguishes periodic and aperiodic traffic. In this paper, we describe how WorldFIP handles these two types of traffic, and more importantly, we provide a comprehensive analysis on how to guarantee the timing requirements of the real-time traffic.

Evaluation of a real time DGPS data server

The goal of the this paper is to show that the DGPS data Internet service we designed and developed provides campus-wide real time access to Differential GPS (DGPS) data and, thus, supports precise outdoor navigation. First we describe the developed distributed system in terms of architecture (a three tier client/server application), services provided (real time DGPS data transportation from remote DGPS sources and campus wide data dissemination) and transmission modes implemented (raw and frame mode over TCP and UDP). Then we present and discuss the results obtained and, finally, we draw some conclusions.

A framework for the development of parallel and distributed real-time embedded systems

Embedded real-time applications increasingly present high computation requirements, which need to be completed within specific deadlines, but that present highly variable patterns, depending on the set of data available in a determined instant. The current trend to provide parallel processing in the embedded domain allows providing higher processing power; however, it does not address the variability in the processing pattern. Dimensioning each device for its worst-case scenario implies lower average utilization, and increased available, but unusable, processing in the overall system. A solution for this problem is to extend the parallel execution of the applications, allowing networked nodes to distribute the workload, on peak situations, to neighbour nodes. In this context, this report proposes a framework to develop parallel and distributed real-time embedded applications, transparently using OpenMP and Message Passing Interface (MPI), within a programming model based on OpenMP. The technical report also devises an integrated timing model, which enables the structured reasoning on the timing behaviour of these hybrid architectures.