CN102722355A - Workflow mechanism-based concurrent ETL (Extract, Transform and Load) conversion method - Google Patents
Workflow mechanism-based concurrent ETL (Extract, Transform and Load) conversion method Download PDFInfo
- Publication number
- CN102722355A CN102722355A CN2012101817148A CN201210181714A CN102722355A CN 102722355 A CN102722355 A CN 102722355A CN 2012101817148 A CN2012101817148 A CN 2012101817148A CN 201210181714 A CN201210181714 A CN 201210181714A CN 102722355 A CN102722355 A CN 102722355A
- Authority
- CN
- China
- Prior art keywords
- workflow
- task
- etl
- management
- hairdo
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The invention discloses a workflow mechanism-based concurrent ETL (Extract, Transform and Load) conversion method. By using a workflow technology and a multi-thread concurrent technology, concurrent execution of a plurality of ETL tasks of an ETL workflow and concurrent execution of a plurality of ETL behaviors in a single task are realized. When a plurality of ETL workflows are executed simultaneously and more parallel branches are available in the ETL workflows and the ETL operation, the execution efficiency can be obviously increased. At the same time, according to the method, cluster distribution processing is constructed, and parallel ETL data extraction engines are constructed by a parallel pipeline technology, so that the extraction efficiency of data can be greatly increased, and the parallel processing problem of multiple data flows and the bottleneck problem of conversion processing are solved.
Description
Technical field
The present invention relates to conventional procedure ETL pattern is carried out innovation transformation; Especially combine workflow technology and data parallel treatment technology the ETL model of routine to be carried out the engine of reconstruct and optimization; Wherein relate to data pick-up technology, data-switching, cleaning and reconfiguration technique; Workflow technology, data parallel treatment technology, fields such as load-balancing technique.
Background technology
At present, the extraction (Extract) of data during ETL refers in making up process data warehouse data source is through being loaded into the process of data warehouse after the data-switching.ETL has integrated the flow process of data from the flow process of the collection of data source, data cleansing, data reconstruction and data load to destination database, Data Mart, data warehouse, and ETL is the key that makes up data warehouse.Yet at present; Continuous increase along with the service source data volume has reached the mass data rank, and; Real-time to data analysis under the present business environment requires also to improve constantly; Formed sharp-pointed contradiction between the two, one of them very important reasons be exactly the efficient of ETL instrument and the problem of accuracy, comprise following three aspects:
1, based on the mechanism of process processing, data pick-up that can not walk abreast and conversion, along with the increase of source data amount, data conversion efficiency reduces greatly.
2, the procedure degree is low, and standardization flow process of no use is gone control, thereby for logical process in the transfer process, the ability of abnormality processing is relatively low.
3, not forming the multiplex (MUX) and do task cooperation working mechanism, generally all is queue-type task execution mechanism, and running efficiency of system is low, and can not support unusual rollback flow process.
Summary of the invention
The efficient that the objective of the invention is to be brought to present processization, centralization, serialization ETL instrument is low, the low problem that waits some row of accuracy rate, proposition a kind of based on workflow mechanism and hairdo ETL conversion method.Utilize workflow technology and multi-thread concurrent technology, realized the concurrent execution of a plurality of ETL tasks of ETL workflow and the movable concurrent execution of a plurality of ETL in the individual task.Carry out a plurality of ETL workflows when simultaneously, and parallel branch can significantly improve execution efficient more for a long time in ETL workflow and the ETL operation.Meanwhile; This engine proposes through a kind of through making up the cluster distribution process; The parallel pipeline technique construction ETl data pick-up engine that walks abreast can improve the extraction efficiency of data itself greatly, has solved the parallel processing problem of multiple data stream and the bottleneck problem of conversion process.
Technical scheme of the present invention is:
A kind of also hairdo ETL conversion method based on workflow mechanism, this method comprises following performing step:
A, set up work-flow process, a plurality of workflow instances are distributed on the different computing nodes through network based on the data-oriented task of WFMC model (WFMC is a WFMC);
B, to set up a plurality of parallel data pick-ups conversion executive process be the ETL process, is used to carry out each workflow task;
C, set up, be used for being responsible for the paralleling abstracting task is monitored and managed the i.e. master control managing process of parallel workflow task of above-mentioned concurrent process;
D, the parallel task management dispatching process of foundation are used for workflow task is transferred to the master control managing process.
Method of the present invention is further comprising the steps of:
E, set up the judgment rule storehouse of a cover parallel work flow task conflict,, adopt the rule of this rule base that workflow task is handled when sending out between the workflow task when conflicting;
F, set up the load balancing monitoring process, be used for the performance of concurrent process is monitored.
Among the step B of the present invention; Employing is based on RMI RMI (RMI full name: RMI; From program in machine code, be packaged into method to remote interface; To be that this locality is called the same for perceptual image when calling, and the shielding network connects, and is convenient to the service of external system integrated network) the remote scheduling interface and the design of hairdo ETL engine architecture; Also hairdo ETL method is made up of the master control managing process and a plurality of executive process that are deployed on the network, and the remote scheduling interface through RMI mechanism between master control managing process and the executive process communicates.
In the judgment rule storehouse of the parallel work flow task conflict of step e of the present invention, judgment rule comprises: " being empty ", " non-NULL ", " in tabulation "; " comprise ", " equaling ", " being not equal to ", " less than "; " smaller or equal to ", " greater than ", " more than or equal to "; " regular expression ", " beginning field ", " trailer field " is at interior multiple judgment mechanism.
Parallel task management dispatching method described in the step D of the present invention may further comprise the steps for the method for scheduling task that adopts formation poll check mechanism Round Robin:
At first, set up the management and running thread pool, during original state, several management and running threads are arranged in the thread pool;
During execution work stream task, obtain the management and running thread of a free time, if do not have idle thread then wait for and being notified from the management and running thread pool; Otherwise; From the waiting list of workflow task, take out a workflow instance and put into workflow execution formation; And transfer to the aforementioned idle management and running thread that obtains and dispatch; The task management of management and running thread notice master control managing process is partly set up the workflow task instance and is put into formation to be executed the task, and repeating this process is that sky or management and running thread pool are sky up to formation to be executed the task.
Among the step B of the present invention, data pick-up conversion executive process adopts the data stream that does not change the data element structure to cut apart pattern and data are walked abreast cuts apart extraction.
Communication between the workflow task that concurrent process of the present invention promptly walks abreast is adopted and is accomplished based on the pipe communication mechanism of shared drive.
Beneficial effect of the present invention:
The present invention utilizes workflow technology and multi-thread concurrent technology, has realized the concurrent execution of a plurality of ETL tasks of ETL workflow and the movable concurrent execution of a plurality of ETL in the individual task.Carry out a plurality of ETL workflows when simultaneously, and parallel branch can significantly improve execution efficient more for a long time in ETL workflow and the ETL operation.Meanwhile; This engine proposes through a kind of through making up the cluster distribution process; The parallel pipeline technique construction ETl data pick-up engine that walks abreast can improve the extraction efficiency of data itself greatly, has solved the parallel processing problem of multiple data stream and the bottleneck problem of conversion process.
One, employing is based on the workflow engine of WFMC master pattern, and standardization level is high, and customizability is high, can fast the data-switching flow process be changed into the workflow of standard.
Two, make the task coordinate treatment mechanism through good multiplex (MUX), support and realize concurrent execution and the cooperation that many ETL execute the task.
Three, employing realizes data level other concurrent extraction and processing based on the shared pipe technology of shared drive, has improved data pick-up efficient greatly.
Description of drawings
Fig. 1 is the operational flow diagram of the work-flow process of data-oriented task in the steps A of the present invention.
Fig. 2 is ETL workflow of the present invention is promptly concerned the despatching work stream of forming by the scheduling between a plurality of tasks a directed acyclic control flow graph.
Fig. 3 is the operational flow diagram of master control managing process among the step C of the present invention.
Fig. 4 is the operational flow diagram of task management dispatching process among the step D of the present invention.
Fig. 5 is node control service procedure figure of the present invention.
Embodiment
Below in conjunction with accompanying drawing and embodiment the present invention is further described.
As shown in Figure 1, a kind of also hairdo ETL conversion method based on workflow mechanism comprises following performing step:
A, set up a cover based on the data-oriented task workflow engine of WFMC model; Workflow instance is distributed on the different computing nodes through network carries out, mechanism is come associated treatment global workflow instance through consultation simultaneously.Owing to can expand computing node at an easy rate, thereby improve the extensibility and execution efficient of system greatly, can obviously improve the performance bottleneck problem of centralized executive mode.
B, set up data pick-up conversion and carry out engine and be used for execution work stream task;
Foundation is based on the also hairdo ETL engine architecture design of RMI remote scheduling interface, and also hairdo ETL engine is made up of the master control engine and a plurality of execution engine that are deployed on the network.Remote scheduling interface through RMI mechanism between master control engine and the execution engine communicates.
Employing is based on the data-switching workflow mechanism of WFMC model.
The despatching work stream that the ETL workflow is made up of the relation of the scheduling between a plurality of tasks; Can regard a directed acyclic control flow graph G (V as; B), as shown in Figure 2, the task (wf_task) of the vertex representation ETL workflow of figure or control module (wf_control).Former piece relation (wf_p recondition) between task is represented on the limit.
C, foundation are responsible for the paralleling abstracting task is monitored and managed to the master control management engine of concurrent task;
The master control engine is made up of applications interface, metadatabase adapter, metadata parser, execution monitoring and master control engine scheduling center:
D, the parallel task management scheduling mechanism of foundation;
Adopting the data stream do not change the data element structure to cut apart pattern walks abreast to data and cuts apart extraction.
Support is accomplished the communication between the concurrent process based on the pipe communication mechanism of shared drive.
Process is writing information in pipeline, and other processes can be from pipeline sense information.Pipeline can be counted as-individual virtual file, and it is kept in the internal memory.Named pipes is identified by-individual name, can realize client and service end application program threads under the distributional environment ask communicate by letter
E, set up the judgment rule storehouse of a cover parallel task conflict.
Will " be empty ", " non-NULL ", " in tabulation ", " comprising "; " equal ", " being not equal to ", " less than ", " smaller or equal to "; " greater than ", " more than or equal to ", " regular expression "; " beginning field ", multiple rule judgment expression formulas such as " trailer fields " is built-in enters the judgment rule storehouse, to strengthen the dirigibility of workflow task
F, set up a cover load balancing monitoring module, be used for performance monitoring the parallel processing service
(load balancing is a characteristic of multi-task scheduling to the task scheduling algorithm of employing formation poll check mechanism (Round Robin) automatically; Under the huge situation of data volume; Multi-task parallel is carried out, and must consider performance issue), during execution work stream instance; Obtain the management and running thread of a free time from the management and running thread pool, if do not have idle thread then wait for and being notified; Otherwise; From the workflow waiting list, take out a workflow instance and put into workflow execution formation; And transfer to this management and running thread and dispatch; The task management of management and running notice is set up the workflow task instance and is put into the task dispatching formation, and repeating this process is that sky or management and running thread pool are sky up to waiting list.
The present invention does not relate to all identical with the prior art prior art that maybe can adopt of part and realizes.
Claims (7)
- One kind based on workflow mechanism and hairdo ETL conversion method, it is characterized in that this method comprises following performing step:A, set up work-flow process, a plurality of workflow instances are distributed on the different computing nodes through network based on the data-oriented task of WFMC model;B, to set up a plurality of parallel data pick-ups conversion executive process be the ETL process, is used to carry out each workflow task;C, set up, be used for being responsible for the paralleling abstracting task is monitored and managed the i.e. master control managing process of parallel workflow task of above-mentioned concurrent process;D, the parallel task management dispatching process of foundation are used for workflow task is transferred to the master control managing process.
- 2. the also hairdo ETL conversion method based on workflow mechanism according to claim 1 is characterized in that this method is further comprising the steps of:E, set up the judgment rule storehouse of a cover parallel work flow task conflict,, adopt the rule of this rule base that workflow task is handled when sending out between the workflow task when conflicting;F, set up the load balancing monitoring process, be used for the performance of concurrent process is monitored.
- 3. the also hairdo ETL conversion method based on workflow mechanism according to claim 1; It is characterized in that; Among the step B; Employing is based on the also hairdo ETL engine architecture design of RMI RMI remote scheduling interface, and also hairdo ETL method is made up of the master control managing process and a plurality of executive process that are deployed on the network, and the remote scheduling interface through RMI mechanism between master control managing process and the executive process communicates.
- 4. the also hairdo ETL conversion method based on workflow mechanism according to claim 2; It is characterized in that; In the judgment rule storehouse of the parallel work flow task conflict of step e, judgment rule comprises: be sky, non-NULL, in tabulation, comprise, equal, be not equal to, less than, smaller or equal to, greater than, more than or equal to, regular expression, beginning field and trailer field at interior multiple judgment mechanism.
- 5. the also hairdo ETL conversion method based on workflow mechanism according to claim 1; It is characterized in that the parallel task management dispatching method described in the step D may further comprise the steps for the method for scheduling task that adopts formation poll check mechanism Round Robin:At first, set up the management and running thread pool, during original state, several management and running threads are arranged in the thread pool;During execution work stream task, obtain the management and running thread of a free time, if do not have idle thread then wait for and being notified from the management and running thread pool; Otherwise; From the waiting list of workflow task, take out a workflow instance and put into workflow execution formation; And transfer to the aforementioned idle management and running thread that obtains and dispatch; The task management of management and running thread notice master control managing process is partly set up the workflow task instance and is put into formation to be executed the task, and repeating this process is that sky or management and running thread pool are sky up to formation to be executed the task.
- 6. according to claim 1 based on workflow mechanism and hairdo ETL conversion method, it is characterized in that among the step B that data pick-up conversion executive process adopts the data stream that does not change the data element structure to cut apart pattern and data are walked abreast cuts apart extraction.
- 7. the also hairdo ETL conversion method based on workflow mechanism according to claim 1 is characterized in that the communication between the workflow task that concurrent process promptly walks abreast is adopted and accomplished based on the pipe communication mechanism of shared drive.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2012101817148A CN102722355A (en) | 2012-06-04 | 2012-06-04 | Workflow mechanism-based concurrent ETL (Extract, Transform and Load) conversion method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2012101817148A CN102722355A (en) | 2012-06-04 | 2012-06-04 | Workflow mechanism-based concurrent ETL (Extract, Transform and Load) conversion method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN102722355A true CN102722355A (en) | 2012-10-10 |
Family
ID=46948137
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2012101817148A Pending CN102722355A (en) | 2012-06-04 | 2012-06-04 | Workflow mechanism-based concurrent ETL (Extract, Transform and Load) conversion method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102722355A (en) |
Cited By (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103902391A (en) * | 2014-04-15 | 2014-07-02 | 宇龙计算机通信科技(深圳)有限公司 | Application program management device and method |
| WO2014134757A1 (en) * | 2013-03-07 | 2014-09-12 | Xu Guoqing King | Rule engine of parallel business and implementation method therefor |
| CN104317970A (en) * | 2014-11-19 | 2015-01-28 | 亚信科技（南京）有限公司 | Data flow type processing method based on data processing center |
| CN104391929A (en) * | 2014-11-21 | 2015-03-04 | 浪潮通用软件有限公司 | Transmission method of data stream in ETL |
| CN104407847A (en) * | 2014-10-29 | 2015-03-11 | 中国建设银行股份有限公司 | Batch processing method and device |
| CN104679482A (en) * | 2013-11-27 | 2015-06-03 | 北京拓尔思信息技术股份有限公司 | OSGI (Open Service Gateway Initiative)-based ETL (Extraction-Transformation-Loading) processing device and method |
| CN104850638A (en) * | 2015-05-25 | 2015-08-19 | 广州精点计算机科技有限公司 | ETL process parallel decision method and apparatus |
| CN105095327A (en) * | 2014-05-23 | 2015-11-25 | 深圳市珍爱网信息技术有限公司 | Distributed ELT system and scheduling method |
| CN105468682A (en) * | 2015-11-16 | 2016-04-06 | 中国建设银行股份有限公司 | Event scheduling system |
| CN108665239A (en) * | 2018-05-08 | 2018-10-16 | 平安普惠企业管理有限公司 | Workflow processing method, device, computer equipment and storage medium |
| CN108694082A (en) * | 2018-05-14 | 2018-10-23 | 有时数联科技（北京）有限公司 | A kind of cross-domain operation stream scheduling method and system |
| CN109445854A (en) * | 2018-10-31 | 2019-03-08 | 中科驭数（北京）科技有限公司 | Data transmission method and device |
| CN109800226A (en) * | 2018-12-25 | 2019-05-24 | 北京明略软件系统有限公司 | A kind of data administer in task management method and device |
| CN110162531A (en) * | 2018-02-28 | 2019-08-23 | 山东衡昊信息技术有限公司 | A kind of distribution concurrent data processing assignment decisions method |
| CN110321223A (en) * | 2019-07-03 | 2019-10-11 | 湖南大学 | The data flow division methods and device of Coflow work compound stream scheduling perception |
| CN111371856A (en) * | 2020-02-25 | 2020-07-03 | 程瑞萍 | Cloud computing task scheduling method and device, cloud computing system and server |
| CN111752971A (en) * | 2017-12-20 | 2020-10-09 | 第四范式（北京）技术有限公司 | Method, device and equipment for processing data streams based on task parallel and storage medium |
| CN112860776A (en) * | 2021-01-20 | 2021-05-28 | 山东众阳健康科技集团有限公司 | Method and system for extracting and scheduling various data |
-
2012
- 2012-06-04 CN CN2012101817148A patent/CN102722355A/en active Pending
Non-Patent Citations (2)
| Title |
|---|
| 丁进，郭朝珍: "基于多Agent与工作流的分布式ETL引擎的研究", 《计算机应用》 * |
| 许力，牟晓光，马云存: "并行ETL过程的研究与实现", 《计算机工程与应用》 * |
Cited By (30)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2014134757A1 (en) * | 2013-03-07 | 2014-09-12 | Xu Guoqing King | Rule engine of parallel business and implementation method therefor |
| CN104679482A (en) * | 2013-11-27 | 2015-06-03 | 北京拓尔思信息技术股份有限公司 | OSGI (Open Service Gateway Initiative)-based ETL (Extraction-Transformation-Loading) processing device and method |
| CN103902391B (en) * | 2014-04-15 | 2018-04-10 | 宇龙计算机通信科技(深圳)有限公司 | Application program management device and application management method |
| CN103902391A (en) * | 2014-04-15 | 2014-07-02 | 宇龙计算机通信科技(深圳)有限公司 | Application program management device and method |
| CN105095327A (en) * | 2014-05-23 | 2015-11-25 | 深圳市珍爱网信息技术有限公司 | Distributed ELT system and scheduling method |
| CN104407847A (en) * | 2014-10-29 | 2015-03-11 | 中国建设银行股份有限公司 | Batch processing method and device |
| CN104407847B (en) * | 2014-10-29 | 2019-05-07 | 中国建设银行股份有限公司 | A kind of method and device of batch processing |
| CN104317970A (en) * | 2014-11-19 | 2015-01-28 | 亚信科技（南京）有限公司 | Data flow type processing method based on data processing center |
| CN104317970B (en) * | 2014-11-19 | 2018-08-28 | 亚信科技（南京）有限公司 | A kind of data stream type processing method based on data mart modeling center |
| CN104391929A (en) * | 2014-11-21 | 2015-03-04 | 浪潮通用软件有限公司 | Transmission method of data stream in ETL |
| CN104850638B (en) * | 2015-05-25 | 2018-10-19 | 广东精点数据科技股份有限公司 | ETL concurrent process decision-making technique and device |
| CN104850638A (en) * | 2015-05-25 | 2015-08-19 | 广州精点计算机科技有限公司 | ETL process parallel decision method and apparatus |
| CN105468682B (en) * | 2015-11-16 | 2018-12-14 | 中国建设银行股份有限公司 | A kind of event scheduling system |
| CN105468682A (en) * | 2015-11-16 | 2016-04-06 | 中国建设银行股份有限公司 | Event scheduling system |
| CN111752971A (en) * | 2017-12-20 | 2020-10-09 | 第四范式（北京）技术有限公司 | Method, device and equipment for processing data streams based on task parallel and storage medium |
| CN110162531A (en) * | 2018-02-28 | 2019-08-23 | 山东衡昊信息技术有限公司 | A kind of distribution concurrent data processing assignment decisions method |
| CN110162531B (en) * | 2018-02-28 | 2021-04-16 | 山东衡昊信息技术有限公司 | Distributed concurrent data processing task decision method |
| CN108665239A (en) * | 2018-05-08 | 2018-10-16 | 平安普惠企业管理有限公司 | Workflow processing method, device, computer equipment and storage medium |
| CN108665239B (en) * | 2018-05-08 | 2024-01-16 | 印嘉商用科技(深圳)有限公司 | Workflow processing method, workflow processing device, computer equipment and storage medium |
| CN108694082A (en) * | 2018-05-14 | 2018-10-23 | 有时数联科技（北京）有限公司 | A kind of cross-domain operation stream scheduling method and system |
| CN108694082B (en) * | 2018-05-14 | 2021-06-22 | 有时数联科技（北京）有限公司 | Cross-domain job flow scheduling method and system |
| CN109445854A (en) * | 2018-10-31 | 2019-03-08 | 中科驭数（北京）科技有限公司 | Data transmission method and device |
| CN109445854B (en) * | 2018-10-31 | 2019-11-05 | 中科驭数（北京）科技有限公司 | Data transmission method and device |
| CN109800226A (en) * | 2018-12-25 | 2019-05-24 | 北京明略软件系统有限公司 | A kind of data administer in task management method and device |
| CN110321223A (en) * | 2019-07-03 | 2019-10-11 | 湖南大学 | The data flow division methods and device of Coflow work compound stream scheduling perception |
| CN110321223B (en) * | 2019-07-03 | 2021-08-17 | 湖南大学 | Data flow dividing method and device for scheduling perception of Coflow collaborative job flow |
| CN111371856A (en) * | 2020-02-25 | 2020-07-03 | 程瑞萍 | Cloud computing task scheduling method and device, cloud computing system and server |
| CN111371856B (en) * | 2020-02-25 | 2021-01-05 | 南京争锋信息科技有限公司 | Cloud computing task scheduling method and device, cloud computing system and server |
| CN112860776A (en) * | 2021-01-20 | 2021-05-28 | 山东众阳健康科技集团有限公司 | Method and system for extracting and scheduling various data |
| CN112860776B (en) * | 2021-01-20 | 2022-12-06 | 众阳健康科技集团有限公司 | Method and system for extracting and scheduling various data |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102722355A (en) | Workflow mechanism-based concurrent ETL (Extract, Transform and Load) conversion method | |
| CN106126601A (en) | A kind of social security distributed preprocess method of big data and system | |
| CN105005570B (en) | Magnanimity intelligent power data digging method and device based on cloud computing | |
| CN106202346B (en) | A kind of data load cleaning engine, scheduling and storage system | |
| CN106022245A (en) | Multi-source remote sensing satellite data parallel processing system and method based on algorithm classification | |
| CN107038162A (en) | Real time data querying method and system based on database journal | |
| CN111694888A (en) | Distributed ETL data exchange system and method based on micro-service architecture | |
| CN104933160B (en) | A kind of ETL frame design method towards safety monitoring business diagnosis | |
| CN106547882A (en) | A kind of real-time processing method and system of big data of marketing in intelligent grid | |
| CN102663114A (en) | Database inquiry processing method facing concurrency OLAP (On Line Analytical Processing) | |
| CN103473642A (en) | Method for rule engine for production dispatching | |
| CN108595473A (en) | A kind of big data application platform based on cloud computing | |
| CN108009258A (en) | It is a kind of can Configuration Online data collection and analysis platform | |
| CN102394903B (en) | A kind of active reconstruction calculating system constructing system | |
| CN102508919A (en) | Data processing method and system | |
| CN110019209A (en) | A kind of big data emerging system and method based on Hydropower Enterprise ' business datum | |
| CN105677467A (en) | Yarn resource scheduler based on quantified labels | |
| CN104881730A (en) | Boiler virtual prototype collaborative design system and method based on workflow | |
| CN104156505B (en) | A kind of Hadoop cluster job scheduling method and devices based on user behavior analysis | |
| CN105608138A (en) | System for optimizing parallel data loading performance of array databases | |
| CN104346441B (en) | A kind of power distribution network information data dynamic integrity exchange method | |
| CN101551811B (en) | Memory type scheduling method used for ETL system of real-time data | |
| CN105550351A (en) | Passenger travel data ad-hoc query system and method | |
| CN104239537A (en) | Method for realizing generating and processing flow for large-data pre-processing text data | |
| CN102646057B (en) | Compound event responding method and system facing to real-time sensing environment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20121010 |