10 resultados para bigdata, data stream processing, dsp, apache storm, cyber security

em Chinese Academy of Sciences Institutional Repositories Grid Portal


Relevância:

100.00% 100.00%

Publicador:

Resumo:

skyline查询是数据挖掘一个重要的研究方向,在基于数据的决策支持等应用中有着重要的作用.由于现实应用中存在着大量的不完整数据流,但大多数现有的skyline查询算法都依赖于如下的假设:1)任意数据点的所有维度值都是已知的;2)数据集是稳定、有界的并且可以随意访问.此外,随着数据维度的增加,skyline数据点的个数会变得过多,因此引入了k-支配skyline的概念,但是不完整数据的k-支配关系并不具有传递性,现有的skyline查询算法都无法适用.基于这些问题,考虑到数据流高维、无界、顺序性的特点,并且在某些维度上可能具有缺失值的特性,提出了一种新的基于滑动窗口的不完整数据流的k-支配skyline查询算法,实验结果表明,算法不仅可以支持不完整数据流上的k-支配skyline计算,并能够保证效率和性能.

Relevância:

100.00% 100.00%

Publicador:

Resumo:

随着信息技术的发展,出现了大量的数据流应用,如传感器数据处理、网络监控、金融数据分析等。在这些应用中,数据是一种连续、时变、有序、无限的序列,查询大多数都是采用连续查询方式。这种数据和查询的连续性对管理系统的资源需求很大。当系统资源不能满足查询处理要求,即查询处理任务超过系统的最大处理能力,用户的查询将得不到及时、正确地处理。同时,如果查询处理时间超过了查询截止期需求,查询结果就没有意义,甚至会造成灾难性后果。目前,很多研究都集中于数据流系统的降载,对支持实时查询处理的实时数据流系统降载的研究比较少。 本论文主要研究支持实时查询处理的实时数据流管理系统中的降载方法,主要包括如下三个方面:随机降载方法、语义降载方法与共享滑动窗口连接操作的降载方法。最后,通过实时数据流管理系统测试平台验证了所提出算法在提高系统吞吐量与降低截止期错失率方面表现出良好的性能。 针对实时数据流应用需求,提出了一种适合实时查询的数据流处理框架结构RT-DSPA和相应的多层过载处理策略MLOHS,为降载方法的研究提供一个框架基础。RT-DSPA分为用户层、DSMS层以及数据源层多个功能模块,具有多层性、可扩展性、健壮性以及可配置性的特点。 在随机降载方面,提出了一种基于数据流流速的负载估计算法;在实时数据流处理框架与负载估计算法的基础上,提出了一种截止期敏感的随机降载算法RLS-EDA。由于系统负载经常波动较大,该算法利用截止期的特点,使用暂存所丢弃元组技术充分地利用CPU空闲资源,使降载执行后系统的吞吐量得到提高,进而尽可能地降低查询截止期错失率;最后,讨论了降载过程中的队列维护策略、含共享操作符查询网络中的降载位置以及降载操作符插入查询网络的算法。实验结果表明,在系统负载波动较大的情况下,RLS-EDA算法表现出良好的性能。 在充分了解数据流及查询特征的情况下,语义降载表现出更好的降载效果。为明确语义降载时使用到的语义,提出了元组价值、价值等级的概念,给出价值等级划分时发生冲突的解决方法。设计了适合实时数据流管理系统的价值等级–执行开销优先级表和截止期–价值密度优先级表,其在确定优先级时可考虑多维因素。基于这两种优先级表设计,提出了相对应的语义降载算法SLS-PT-VD&EC和SLS-PT-D&TVD。基于优先级表的语义降载算法能够灵活地满足用户的不同需求,同时提高系统降载时的性能。 最后,针对共享滑动窗口连接操作符的过载情况,利用查询截止期的特点,提出了一种基于暂存丢弃元组技术的共享滑动窗口连接的降载算法LS-SJRT;为减小LS-SJRT算法的降载开销,提出了一种改进的基于调节滑动窗口宽度的共享滑动窗口连接降载算法LS-SJRT-CW。实验结果显示这两种算法在共享连接操作符过载时都能够表现出较好的性能。

Relevância:

100.00% 100.00%

Publicador:

Resumo:

What geophysical inversion studied includes the common mathematics physical property of inversion and the constitution and appraisal method of solution in geophysics domain, i.e. using observed physical phenomenon from the earth surface to infer space changing and physical property structure of medium within the earth. Seismic inversion is a branch of geophysical inversion. The basic purpose of seismic inversion is to utilizing seismic wave propagating law in the medium underground to infer stratum structure and space distribution of physical property according to data acquisition, processing and interpretation, and then offer the vital foundation for exploratory development. Poststack inversion is convenient and swift, its acoustic impedance inversion product can reflect reservoir interior changing rule to a certain degree, but poststack data lack abundant amplitude and travel time information included in prestack data because of multiple superimpose and weaken the sensitiveness which reflecting reservoir property. Compared with poststack seismic inversion, prestack seismic inversion has better fidelity and more adequate information. Prestack seismic inversion, including waveform inversion, not only suitable for thin strata physical property inversion, it can also inverse reservoir oil-bearing ability. Prestack seismic inversion and prestack elastic impedance inversion maintain avo information, sufficiently applying seismic gathering data with different incident angle, partial angle stack, gradient and intercept seismic data cube. Prestack inversion and poststack inversion technology were studied in this dissertation. A joint inversion method which synthesize prestack elastic wave waveform inversion, prestack elastic impedance inversion and poststack inversion was proposed by making fully use of prestack inversion multiple information and relatively fast and steady characteristic of poststack inversion. Using the proposed method to extract rock physics attribute cube with clear physical significance and reflecting reservoir characterization, such as P-wave and S-wave impedance, P-wave and S-wave velocity, velocity ratio, density, Poisson ratio and Lame’s constant. Regarding loose sand reservoir in lower member of Minghuazhen formation, 32-6 south districts in Qinhuangdao,as the research object, be aimed at the different between shallow layer loose sand and deep layer tight sand, first of all, acquire physical property parameters suitable for this kind of heavy oil pool according to experimental study, establishing initial pressure and shear wave relational model; Afterwards, performing prestack elastic wave forward and inversion research, summarizing rules under the guidance of theoretical research and numerical simulation, performing elastic impedance inversion, calculating rock physics attributes; Finally, predicting sand body distribution according to rock physics parameters, and predicting favorable oil area combine well-logging materials and made good results.

Relevância:

100.00% 100.00%

Publicador:

Resumo:

As a complement to conventional MT, Long-period Magnetotellurics (LMT) has been developed at low frequency for soundings of deep electric structures. Eastern Himalayan Syntaxis (EHS) and surrounding area is a key place for the study of dynamics of the uplift of Tibetan plateau. Experiments in the pioneer studies for EHS3D project showed that the study area shares an unusual low resistive crust and upper mantle. Conventional MT could not provide sufficient information about the deep structures of the study area that requested long period MT measurement to be complemented. This thesis presents the LMT studies in eastern Tibet along the EHS3D-3 Profile from Xiachayu to Yushu including data acquisition, processing, inversion and interpretation. The effective period of the measured LMT signals extend from 10s up to 30000s for the duration more than one week measurement. The resulting model shows that the LMT sounding coincides with the MT data in overlapped periods. Especially the induction arrows and tippers derived from LMT data provide more information about the base of the conductors beneath the plateau with higher resolution. Anomalous induction coefficients and 2-D model suggest extensive conductive bodies beneath Lhasa block and Qiangtang terrain which would be a possible evidence for partial melt and fluids at depth.

Relevância:

100.00% 100.00%

Publicador:

Resumo:

Intense tectonic renovation has occurred in the eastern continent of china since Mesozoic, as evidenced by the high heat flow, widespread magma extrusion and volcanic activities, and development of large sedimentary basins. To explain the cause and mechanism for the tectonic process in this period, some researchers have put forward various models, such as mantle plume, subduction of the Pacific slab, Yangtze Block-North China Block collision, etc. Their seismological evidence, however, is still scarce..During the period from 2000 to 2003, large temporary seismic arrays were established in North China by the Institute of the Geology and Geophysics, Chinese Academy of Sciences. Total 129 portable seismic stations were linearly emplaced across the western and eastern boundaries of the Bohai Bay Basin, and accumulated a large amount of high-quality data. Moreover, abundant data were also collected at the capital digital seismic network established in the ninth five-year period of national economic and social development. These provide an unprecedented opportunity for us to study the deep structure and associated geodynamic mechanism of lithospheric processes in North China using seismological techniques.Seismology is a kind of observation-based science. The development of seismic observations greatly promotes the improvement of seismologic theory and methodology. At the beginning of this thesis, I review the history of seismic observation progress, and present some routine processing techniques used in the array seismology. I also introduce two popular seismic imaging methods (receiver function method and seismic tomography).Receiver function method has been widely used to study the crustal and upper mantle structures, and many relevant research results have been published. In this thesis I elaborate the theory of this method, including the basic concept of receiver functions and the methodology for data pre-processing, stacking and migration. I also address some problems often encountered in practical applications of receiver function imaging.By using the teleseismic data collected at the temporary seismic arrays in North China, in particular, the traveltime information of P-to-S conversion and multiple reverberations of the Moho discontinuity, I obtain the distributions of the crustal thickness and the poisson ratio at the northwest boundary area of the Bohai Bay Basin and discuss the geological implications of the results.Through detailed intestigations on the crustal structural feature around the middle part of the Tanlu fault, considerable disparity in poisson ratios is found in the western and eastern sides of the Tanlu fault. Moreover, an obvious Moho offset is coincidently observed at the same surface location. A reasonable density model for the Tanlu fault area is also derived by simulating the observed gravity variations. Both receiver function study and gravity anomaly modeling suggest that the crustal difference between the western and eastern sides of the Tanlu fault is mainly resulted from their different compositions.With common conversion point imaging of receiver functions, I estimate the depths of the upper and lower boundaries of the mantle transition zone, i.e., the 410 and 660 km discontinuities, beneath most part of the North China continent The thickness of the transition zone (TTZ) in the study area is calculated by subtracting the depth of .410 km discontinuity from that of the 660km discontinuity. The resultant TTZ is 10-15 km larger in the east than in the west of the study area. Phase transitions at the 410 km and the 660 km discontinuities are known to have different Clapeyron slopes. Therefore, the TTZ is sensitive to the temperature changes in the transition zone. Previous studies have shown that the TTZ would be smaller in the mantle plume areas and become larger when the remnants of subducted slabs are present The hypothesis of mantle plume cannot give a reasonable interpretation to the observed TTZ beneath North China, Instead, the receiver function imaging results favor a dynamic model that correlates the thermal structure of the mantle transition zone and associated upper mantle dynamics of North China to the Pacific plate subduction process.

Relevância:

40.00% 40.00%

Publicador:

Resumo:

Based on the data processing technologies of interferential spectrometer, a sort of real-time data processing system on chip of interferential imaging spectrometer was studied based on large capacitance and high speed field programmable gate array( FPGA) device. The system integrates both interferograrn sampling and spectrum rebuilding on a single chip of FPGA and makes them being accomplished in real-time with advantages such as small cubage, fast speed and high reliability. It establishes a good technical foundation in the applications of imaging spectrometer on target detection and recognition in real-time.

Relevância:

40.00% 40.00%

Publicador:

Resumo:

A 2.5-D and 3-D multi-fold GPR survey was carried out in the Archaeological Park of Aquileia (northern Italy). The primary objective of the study was the identification of targets of potential archaeological interest in an area designated by local archaeological authorities. The second geophysical objective was to test 2-D and 3-D multi-fold methods and to study localised targets of unknown shape and dimensions in hostile soil conditions. Several portions of the acquisition grid were processed in common offset (CO), common shot (CSG) and common mid point (CMP) geometry. An 8×8 m area was studied with orthogonal CMPs thus achieving a 3-D subsurface coverage with azimuthal range limited to two normal components. Coherent noise components were identified in the pre-stack domain and removed by means of FK filtering of CMP records. Stack velocities were obtained from conventional velocity analysis and azimuthal velocity analysis of 3-D pre-stack gathers. Two major discontinuities were identified in the area of study. The deeper one most probably coincides with the paleosol at the base of the layer associated with activities of man in the area in the last 2500 years. This interpretation is in agreement with the results obtained from nearby cores and excavations. The shallow discontinuity is observed in a part of the investigated area and it shows local interruptions with a linear distribution on the grid. Such interruptions may correspond to buried targets of archaeological interest. The prominent enhancement of the subsurface images obtained by means of multi-fold techniques, compared with the relatively poor quality of the conventional single-fold georadar sections, indicates that multi-fold methods are well suited for the application to high resolution studies in archaeology.

Relevância:

40.00% 40.00%

Publicador:

Resumo:

本文在分析几种常用的基于编码器测速方法的基础上,提出了一种高性能的自适应速度测量方法。该方法选择一个可变的时间周期和编码器脉冲数来测量单位时间内的编码器脉冲数,再通过简单的计算得到转速的测量值。数字信号处理器(DSP)芯片集成有正交脉冲编码电路,并且数据处理速度快,实时性强。本文中提出的方法在电机控制专用DSP芯片TMS320 LF2407A上进行了实现。实验研究表明,可以在提高低速时的测速准确度的同时,提高系统的响应时间。该方法已经在自主研发的全数字伺服驱动系统中得到了成功应用。

Relevância:

30.00% 30.00%

Publicador:

Resumo:

Modeling study is performed concerning the heat transfer and fluid flow for a laminar argon plasma jet impinging normally upon a flat workpiece exposed to the ambient air. The diffusion of the air into the plasma jet is handled by using the combined-diffusion-coefficient approach. The heat flux density and jet shear stress distributions at the workpiece surface obtained from the plasma jet modeling are then used to study the re-melting process of a carbon steel workpiece. Besides the heat conduction within the workpiece, the effects of the plasma-jet inlet parameters (temperature and velocity), workpiece moving speed, Marangoni convection, natural convection etc. on the re-melting process are considered. The modeling results demonstrate that the shapes and sizes of the molten pool in the workpiece are influenced appreciably by the plasma-jet inlet parameters, workpiece moving speed and Marangoni convection. The jet shear stress manifests its effect at higher plasma-jet inlet velocities, while the natural convection effect can be ignored. The modeling results of the molten pool sizes agree reasonably with available experimental data.