CN106250566A - A kind of distributed data base and the management method of data operation thereof - Google Patents

A kind of distributed data base and the management method of data operation thereof Download PDF

Info

Publication number
CN106250566A
CN106250566A CN201610777671.8A CN201610777671A CN106250566A CN 106250566 A CN106250566 A CN 106250566A CN 201610777671 A CN201610777671 A CN 201610777671A CN 106250566 A CN106250566 A CN 106250566A
Authority
CN
China
Prior art keywords
cluster
data
distributed
node
basic operations
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201610777671.8A
Other languages
Chinese (zh)
Inventor
崔维力
武新
张绍勇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
TIANJIN NANKAI UNIVERSITY GENERAL DATA TECHNOLOGIES Co Ltd
Original Assignee
TIANJIN NANKAI UNIVERSITY GENERAL DATA TECHNOLOGIES Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by TIANJIN NANKAI UNIVERSITY GENERAL DATA TECHNOLOGIES Co Ltd filed Critical TIANJIN NANKAI UNIVERSITY GENERAL DATA TECHNOLOGIES Co Ltd
Priority to CN201610777671.8A priority Critical patent/CN106250566A/en
Publication of CN106250566A publication Critical patent/CN106250566A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/27Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor

Landscapes

  • Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Computing Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention provides the management method of a kind of distributed data base and data operation thereof.Wherein, described distributed data base includes: management cluster, for receiving the instruction of user, and instructs described in analytical optimization, generates implement plan and scheduling;Basic operations layer cluster, is used for receiving management cluster and receives implement plan, carry out computing based on the traffic table being distributed on node;Summarized results operation layer cluster, carries out computing for receiving the data from the distribution of basic operations layer cluster.When data do not have locality, it is possible to achieve collect and interaction data, reduce the use of Internet resources between node, and distributed data base computing node resource can be made more to equalize.

Description

A kind of distributed data base and the management method of data operation thereof
Technical field
The invention belongs to distributed data base technique field, especially relate to a kind of distributed data base and data operation thereof Management method.
Background technology
Distributed data base refers to utilize information autobahn to be connected by the most scattered multiple data storage cells Get up one data base the most unified of composition.The basic thought of distributed data base is by original centralized data base Data dispersion storage on multiple data memory nodes connected by network, with obtain bigger memory capacity and higher also Send out visit capacity.In recent years, along with the rapid growth of data volume, distributed data base technique have also been obtained quickly development, tradition Relevant database start from centralized model to distributed structure/architecture develop, distributed data base based on relationship type retain Under the data model of traditional database and basic feature, move towards distributed storage from centralised storage, walk from centralized calculating To Distributed Calculation.
In distributed data base system be typically all use multiple stage machine storage data, will user data according to hash Or random distribution algorithm is distributed to data in each Work machine of data base, so reduce separate unit database work machine The data volume that device is stored, reduces storage and the calculating pressure of each machine.This distributed data base system is first data Data are distributed to collect in group operatione node, when in SQL, computing is directed to hash according to the mode of hash or random distribution During Distribution of A Sequence, because node data has local local, therefore SQL can be handed down to each computing node, computing can be respectively Individual nodal parallel performs, when the computing in SQL is non-hash Distribution of A Sequence, then computing does not the most have local local, and this SQL is just Cannot directly perform at each nodal parallel, it is necessary on all computing nodes of cluster, data are re-started and dynamically heavily divide Be distributed to after cloth on all computing nodes of cluster or be aggregated into single perform result on all computing nodes of cluster After node, data just have local local, and both the above computing mode has following defects that mode 1: all at cluster The computing on all computing nodes of cluster it is distributed to all of after data being re-started dynamic redistribution on computing node The resource of node all takies, and relates to the netted communication of point-to-point, (such as looks into 100) when nodes is more, the most often Individual node all can produce substantial amounts of connection and thread carries out transmission and the reception of data, and therefore resource consumption will be the biggest;Mode 2: On all computing nodes of cluster perform result be aggregated into the computing of individual node will relatively to the resource occupation collecting node Height, but the hardware configuration of all computing nodes in cluster is essentially identical, and also when running, resource occupation is the most essentially identical, if Collect node and have resource occupation more relative to other computing nodes, then, in the case of hardware configuration is essentially identical, this collects Node will become the bottleneck node of whole cluster.
Summary of the invention
Embodiments provide the management method of a kind of distributed data base and data operation thereof, distributed to solve Database operation node resource consumes unbalanced technical problem.
On the one hand, embodiments provide a kind of distributed data base system, including:
Management cluster, for receiving the instruction of user, and instructs described in analytical optimization, generates implement plan and scheduling;
Basic operations layer cluster, is used for receiving management cluster and receives implement plan, based on the traffic table being distributed on node Carry out computing;
Summarized results operation layer cluster, carries out computing for receiving the data from the distribution of basic operations layer cluster.
On the other hand, embodiments provide the management method of the data operation of a kind of distributed data base, including:
When instruction described user includes Hash Distribution of A Sequence, the instruction of the user received directly is sent out by management cluster Deliver to basic operations layer cluster, and receive the execution result that basic operations layer cluster returns.
Further, the management method of the data operation of a kind of distributed data base, including:
When not including Hash Distribution of A Sequence in the instruction of described user, the instruction of the user received is sent by management cluster To basic operations layer cluster, after basic operations layer cluster completes to calculate, generate intermediate result data, and intermediate result data is divided Send to summarized results operation layer cluster, summarized results operation layer group be uploaded to manage cluster.
Further, the management method of the data operation of a kind of distributed data base, including:
When not including Hash Distribution of A Sequence in the instruction of described user, need to produce intermediate object program, then the data produced It is distributed to intermediate object program or summarized results operation layer cluster carries out follow-up operation, after above middle table or summary sheet Reforwarding is calculated and will be run on this cluster, if the result of operation needs the table continued with on basic operations node layer cluster to hand over Time mutually, the result of operation will be distributed on basic operations node layer cluster continue follow-up operation, if basic operations layer collection Subsequent operation on group needs again to produce middle table, then the data produced are distributed to summarized results operation layer cluster and carry out.
The distributed data base of embodiment of the present invention offer and the management method of data operation thereof, be used for receiving by increase Data from the distribution of basic operations layer cluster carry out the summarized results operation layer cluster of computing.In data, not there is locality Time, it is possible to achieve collect and interaction data, reduce the use of Internet resources between node, and distributed data base computing can be made Node resource more equalizes.
Accompanying drawing explanation
In order to be illustrated more clearly that the technical scheme of the embodiment of the present invention, below will be in embodiment or description of the prior art The required accompanying drawing used is briefly described, it should be apparent that, the accompanying drawing in describing below is only some realities of the present invention Execute example, for those of ordinary skill in the art, on the premise of not paying creative work, it is also possible to attached according to these Figure obtains other accompanying drawing.
Fig. 1 is the structural representation of the distributed data base that the embodiment of the present invention one provides;
Fig. 2 is the flow process signal of the management method of the data operation of the distributed data base that the embodiment of the present invention two provides Figure;
Fig. 3 is the flow process signal of the management method of the data operation of the distributed data base that the embodiment of the present invention three provides Figure;
Fig. 4 is the flow process signal of the management method of the data operation of the distributed data base that the embodiment of the present invention four provides Figure.
Detailed description of the invention
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, complete Describe, it is clear that described embodiment is a part of embodiment of the present invention rather than whole embodiments wholely.Based on this Embodiment in bright, the every other enforcement that those of ordinary skill in the art are obtained under not making creative work premise Example, broadly falls into the scope of protection of the invention.
Fig. 1 is the structural representation of the distributed data base that the embodiment of the present invention one provides, and sees Fig. 1, described distributed Database Systems, including management cluster, for receiving the instruction of user, and instruct described in analytical optimization, generate implement plan and Scheduling;Basic operations layer cluster, is used for receiving management cluster and receives implement plan, carry out based on the traffic table being distributed on node Computing;Summarized results operation layer cluster, carries out computing for receiving the data from the distribution of basic operations layer cluster.
In Shared-nothing framework, whole system includes managing cluster and computing cluster.In the present embodiment, meter Calculate cluster and be divided into basic operations layer cluster and summarized results operation layer cluster, the computing of difference in functionality can be carried out, so that Originally distribute to the summarized results operation layer cluster that multiple node forms and come real by calculating operation collecting of completing of single node etc. Existing, it is possible to reduce the use of Internet resources between node, and distributed data base computing node resource can be made more to equalize.
Embodiment two
Fig. 2 is the flow process signal of the management method of the data operation of the distributed data base that the embodiment of the present invention two provides Figure, the present embodiment is applicable to computing cluster in distributed data base system and is divided into basic operations layer cluster and summarized results During operation layer cluster, the situation being managed distributed data base data operation, the method can be by a point distributed data base The managing device of data operation perform, this device can be realized by software/hardware mode, and can be integrated in distributed data base In system.
See Fig. 2, the management method of the data operation of described distributed data base, including:
S210, when the instruction described user includes Hash Distribution of A Sequence, management cluster is directly by the user's that receives Instruction sends to basic operations layer cluster.
Exemplary, the instruction of described user is sql operation.Any one node by unified management node cluster Receive the instruction of user as entrance, management node cluster is responsible for receiving the SQL of user, and responsible SQL resolves, SQL optimizes, distribution Formula implement plan generates, performs scheduling.In cluster all traffic table according to hash distribution or the mode of random distribution data Being distributed in the node of basic operations layer cluster, the node of basic operations layer cluster is responsible for receiving SQL from the node of management cluster, Computing is carried out based on the traffic table being distributed on node.
S220, receives the execution result that basic operations layer cluster returns.
When operation in sql all comprises hash Distribution of A Sequence, then data have locality, receive from management clustered node SQL can directly be handed down to basic operations layer cluster node perform, perform result be directly returned to manage cluster entrance joint Point, is then back to user.Under this scene, summarized results operation layer cluster is not involved in computing.
The management method of the data operation of the distributed data base that the present embodiment provides, when data have locality, logical Cross basic operations layer cluster and directly computing can obtain result.The use of Internet resources between node can be reduced.
Embodiment three
Fig. 3 is the flow process signal of the management method of the data operation of the distributed data base that the embodiment of the present invention three provides Figure, the present embodiment is applicable to computing cluster in distributed data base system and is divided into basic operations layer cluster and summarized results During operation layer cluster, the situation being managed distributed data base data operation, the method can be by a point distributed data base The managing device of data operation perform, this device can be realized by software/hardware mode, and can be integrated in distributed data base In system.
See Fig. 3, the management method of the data operation of described distributed data base, including:
S310, when not including Hash Distribution of A Sequence in the instruction of described user, the finger of user that management cluster will receive Order sends to basic operations layer cluster.
Exemplary, the instruction of described user is sql operation.Any one node by unified management node cluster Receive the instruction of user as entrance, management node cluster is responsible for receiving the SQL of user, and responsible SQL resolves, SQL optimizes, distribution Formula implement plan generates, performs scheduling.In cluster all traffic table according to hash distribution or the mode of random distribution data Being distributed in the node of basic operations layer cluster, the node of basic operations layer cluster is responsible for receiving SQL from the node of management cluster, Computing is carried out based on the traffic table being distributed on node.
S320, after basic operations layer cluster completes to calculate, generates intermediate result data, and is distributed to by intermediate result data Summarized results operation layer cluster.
Operation in sql not all comprises hash Distribution of A Sequence, then data do not have local local, from management clustered node After the SQL received is handed down to the node execution of basic operations layer cluster, need to produce the data of intermediate object program, then generation Data are distributed to summarized results operation layer cluster and carry out follow-up operation.
S330, summarized results operation cluster is uploaded to manage cluster.
The result of subsequent operation need not interact with the table on basic operations node layer cluster, then operation result is straight Connecing the Ingress node returning to manage cluster, management cluster Ingress node returns result to user again.
The management method of the data operation of the distributed data base that the present embodiment provides, when data do not have locality, By basic operations layer collection group operatione to, and result is sent summarized results operation layer cluster.Mutual without information again, permissible Reduce the use of Internet resources between node.
Embodiment four
Fig. 4 is the flow process signal of the management method of the data operation of the distributed data base that the embodiment of the present invention four provides Figure, the present embodiment is applicable to computing cluster in distributed data base system and is divided into basic operations layer cluster and summarized results During operation layer cluster, the situation being managed distributed data base data operation, the method can be by a point distributed data base The managing device of data operation perform, this device can be realized by software/hardware mode, and can be integrated in distributed data base In system.
See Fig. 4, the management method of the data operation of described distributed data base, including:
S410, when not including Hash Distribution of A Sequence in the instruction of described user, the finger of user that management cluster will receive Order sends to basic operations layer cluster.
Exemplary, the instruction of described user is sql operation.Any one node by unified management node cluster Receive the instruction of user as entrance, management node cluster is responsible for receiving the SQL of user, and responsible SQL resolves, SQL optimizes, distribution Formula implement plan generates, performs scheduling.In cluster all traffic table according to hash distribution or the mode of random distribution data Being distributed in the node of basic operations layer cluster, the node of basic operations layer cluster is responsible for receiving SQL from the node of management cluster, Computing is carried out based on the traffic table being distributed on node.
S420, is distributed to summarized results operation layer cluster the data produced and carries out follow-up operation, based on described generation Data subsequent arithmetic run on summarized results operation layer cluster.
It is handed down to after the node of basic operations layer cluster performs from the management SQL that receives of clustered node, in needing to produce Between the data of result, such as middle table or summary sheet, then the data produced are distributed to summarized results operation layer cluster and carry out Follow-up operation.
S430, if need to continue to interact with the table on basic operations node layer cluster, the result of operation will It is distributed on basic operations node layer cluster continue follow-up operation.
Subsequent arithmetic based on above middle table or summary sheet will run on this cluster, the result of operation the need to When continuing to interact with the table on basic operations node layer cluster, the result of operation will be distributed to basic operations node layer collection Follow-up operation is continued, it is not necessary to management cluster is to basic operations node layer cluster distributed tasks on group.
S440, if the subsequent operation on basic operations layer cluster needs again to produce data, then the data distribution produced Run to summarized results operation layer cluster.
If the subsequent operation on basic operations layer cluster needs again to produce middle table, then in the data produced being distributed to Between result or summarized results operation layer cluster carry out, after having performed all of subsequent step according to above logic, operation result or Person returns to manage the Ingress node of cluster from the node of basic operations layer cluster, or from intermediate object program or summarized results computing The node of layer cluster returns to manage the Ingress node of cluster, and then management cluster Ingress node returns result to user again.
The management method of the data operation of the distributed data base that the present embodiment provides, when data do not have locality, By basic operations layer collection group operatione to, and result is sent summarized results operation layer cluster.When information is mutual again for needs, Summarized results operation layer cluster gets final product distributed tasks, it is possible to achieve complicated logic task, it is possible to reduce network between node The use of resource.
One of ordinary skill in the art will appreciate that: all or part of step realizing above-mentioned each method embodiment can be led to The hardware crossing programmed instruction relevant completes.Aforesaid program can be stored in a computer read/write memory medium.This journey Sequence upon execution, performs to include the step of above-mentioned each method embodiment;And aforesaid storage medium includes: ROM, RAM, magnetic disc or The various media that can store program code such as person's CD.
Last it is noted that various embodiments above is only in order to illustrate technical scheme, it is not intended to limit;To the greatest extent The present invention has been described in detail by pipe with reference to foregoing embodiments, it will be understood by those within the art that: it depends on So the technical scheme described in foregoing embodiments can be modified, or the most some or all of technical characteristic is entered Row equivalent;And these amendments or replacement, do not make the essence of appropriate technical solution depart from various embodiments of the present invention technology The scope of scheme.

Claims (4)

1. a distributed data base system, it is characterised in that including:
Management cluster, for receiving the instruction of user, and instructs described in analytical optimization, generates implement plan and scheduling;
Basic operations layer cluster, is used for receiving management cluster and receives implement plan, carry out based on the traffic table being distributed on node Computing;
Summarized results operation layer cluster, carries out computing for receiving the data from the distribution of basic operations layer cluster.
2. the management method of the data operation of a distributed data base according to claim 1, it is characterised in that bag Include:
When instruction described user includes Hash Distribution of A Sequence, the instruction of the user received directly is sent extremely by management cluster Basic operations layer cluster, and receive the execution result that basic operations layer cluster returns.
3. the management method of the data operation of a distributed data base according to claim 1, it is characterised in that bag Include:
When not including Hash Distribution of A Sequence in the instruction of described user, the instruction of the user received is sent to base by management cluster Plinth operation layer cluster, after basic operations layer cluster completes to calculate, generates intermediate result data, and is distributed to by intermediate result data Summarized results operation layer cluster, is uploaded to manage cluster by summarized results operation layer group.
4. the management method of the data operation of a distributed data base according to claim 1, it is characterised in that bag Include:
When not including Hash Distribution of A Sequence in the instruction of described user, then the data produced are distributed to summarized results operation layer collection Group carries out follow-up operation, and data subsequent arithmetic based on described generation runs on summarized results operation layer cluster, operation If result needs to continue to interact with the table on basic operations node layer cluster, the result of operation will be distributed to basis Follow-up operation is continued on operation layer node cluster, if the subsequent operation on basic operations layer cluster needs again to produce data, Then the data produced are distributed to summarized results operation layer cluster run.
CN201610777671.8A 2016-08-31 2016-08-31 A kind of distributed data base and the management method of data operation thereof Pending CN106250566A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610777671.8A CN106250566A (en) 2016-08-31 2016-08-31 A kind of distributed data base and the management method of data operation thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610777671.8A CN106250566A (en) 2016-08-31 2016-08-31 A kind of distributed data base and the management method of data operation thereof

Publications (1)

Publication Number Publication Date
CN106250566A true CN106250566A (en) 2016-12-21

Family

ID=58081016

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610777671.8A Pending CN106250566A (en) 2016-08-31 2016-08-31 A kind of distributed data base and the management method of data operation thereof

Country Status (1)

Country Link
CN (1) CN106250566A (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019062156A1 (en) * 2017-09-27 2019-04-04 华为技术有限公司 Storage procedure executing method and device, and storage medium
CN111049898A (en) * 2019-12-10 2020-04-21 杭州东方通信软件技术有限公司 Method and system for realizing cross-domain architecture of computing cluster resources
CN112202859A (en) * 2020-09-22 2021-01-08 北京人大金仓信息技术股份有限公司 Data transmission method and database system
CN112307113A (en) * 2019-07-29 2021-02-02 中兴通讯股份有限公司 Service request message sending method and distributed database architecture
CN113094391A (en) * 2021-04-22 2021-07-09 山东浪潮通软信息科技有限公司 Calculation method, device and equipment for data summarization supporting cache
WO2021254047A1 (en) * 2020-06-16 2021-12-23 中兴通讯股份有限公司 Method for realizing redistribution of distributed database, database, server and medium

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101291245A (en) * 2007-04-16 2008-10-22 阿里巴巴集团控股有限公司 Distributed processing method, system and device thereof
CN103150304A (en) * 2011-12-06 2013-06-12 郑红云 Cloud database system
CN104111958A (en) * 2013-04-22 2014-10-22 中国移动通信集团山东有限公司 Data query method and device
CN104331457A (en) * 2014-10-31 2015-02-04 北京思特奇信息技术股份有限公司 Database node-based data access method and system
CN104504128A (en) * 2014-12-31 2015-04-08 天津南大通用数据技术股份有限公司 Construction method for database system asymmetric deployment based on federated clusters
CN104504154A (en) * 2015-01-14 2015-04-08 曙光信息产业(北京)有限公司 Method and device for data aggregate query
CN105045929A (en) * 2015-08-31 2015-11-11 国家电网公司 MPP architecture based distributed relational database
CN105389368A (en) * 2015-11-16 2016-03-09 天津南大通用数据技术股份有限公司 Method for managing metadata of database cluster of MPP architecture
CN105824868A (en) * 2015-12-24 2016-08-03 广东亿迅科技有限公司 Distributed type database data processing method and distributed type database system
US9576039B2 (en) * 2014-02-19 2017-02-21 Snowflake Computing Inc. Resource provisioning systems and methods

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101291245A (en) * 2007-04-16 2008-10-22 阿里巴巴集团控股有限公司 Distributed processing method, system and device thereof
CN103150304A (en) * 2011-12-06 2013-06-12 郑红云 Cloud database system
CN104111958A (en) * 2013-04-22 2014-10-22 中国移动通信集团山东有限公司 Data query method and device
US9576039B2 (en) * 2014-02-19 2017-02-21 Snowflake Computing Inc. Resource provisioning systems and methods
CN104331457A (en) * 2014-10-31 2015-02-04 北京思特奇信息技术股份有限公司 Database node-based data access method and system
CN104504128A (en) * 2014-12-31 2015-04-08 天津南大通用数据技术股份有限公司 Construction method for database system asymmetric deployment based on federated clusters
CN104504154A (en) * 2015-01-14 2015-04-08 曙光信息产业(北京)有限公司 Method and device for data aggregate query
CN105045929A (en) * 2015-08-31 2015-11-11 国家电网公司 MPP architecture based distributed relational database
CN105389368A (en) * 2015-11-16 2016-03-09 天津南大通用数据技术股份有限公司 Method for managing metadata of database cluster of MPP architecture
CN105824868A (en) * 2015-12-24 2016-08-03 广东亿迅科技有限公司 Distributed type database data processing method and distributed type database system

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
DAYS无悔: ""GreenPlum数据库"", 《百度文库》 *

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019062156A1 (en) * 2017-09-27 2019-04-04 华为技术有限公司 Storage procedure executing method and device, and storage medium
CN112307113A (en) * 2019-07-29 2021-02-02 中兴通讯股份有限公司 Service request message sending method and distributed database architecture
CN111049898A (en) * 2019-12-10 2020-04-21 杭州东方通信软件技术有限公司 Method and system for realizing cross-domain architecture of computing cluster resources
WO2021254047A1 (en) * 2020-06-16 2021-12-23 中兴通讯股份有限公司 Method for realizing redistribution of distributed database, database, server and medium
CN112202859A (en) * 2020-09-22 2021-01-08 北京人大金仓信息技术股份有限公司 Data transmission method and database system
CN112202859B (en) * 2020-09-22 2024-02-23 北京人大金仓信息技术股份有限公司 Data transmission method and database system
CN113094391A (en) * 2021-04-22 2021-07-09 山东浪潮通软信息科技有限公司 Calculation method, device and equipment for data summarization supporting cache

Similar Documents

Publication Publication Date Title
CN106250566A (en) A kind of distributed data base and the management method of data operation thereof
CN104050042B (en) The resource allocation methods and device of ETL operations
US20140358977A1 (en) Management of Intermediate Data Spills during the Shuffle Phase of a Map-Reduce Job
CN109144699A (en) Distributed task dispatching method, apparatus and system
CN102075402A (en) Virtual network mapping processing method and system
CN102930062A (en) Rapid horizontal extending method for databases
CN105824686A (en) Selecting method and selecting system of host machine of virtual machine
CN107968810A (en) A kind of resource regulating method of server cluster, device and system
CN107733696A (en) A kind of machine learning and artificial intelligence application all-in-one dispositions method
CN101256599B (en) System for gathering data of distributing simulation platform based on grid
CN105827678B (en) Communication means and node under a kind of framework based on High Availabitity
CN102394903B (en) A kind of active reconstruction calculating system constructing system
CN107402926A (en) A kind of querying method and query facility
CN101615176A (en) A kind of data monitoring system and implementation method
CN107124473A (en) The construction method and cloud platform of cloud platform
CN105930417A (en) Big data ETL (Extract-Transform-Load) interactive processing platform based on cloud computing
CN108052542A (en) A kind of analysis method of the multidimensional data of the data based on presto
CN104572298B (en) The resource regulating method and device of video cloud platform
CN115169634A (en) Task allocation optimization processing method and device
CN108830436B (en) Shared bicycle scheduling method based on fractal tree self-balancing division
CN109189343A (en) A kind of metadata rule method, apparatus, equipment and computer readable storage medium
CN107861820A (en) A kind of resources of virtual machine distribution method and system
CN113806606A (en) Three-dimensional scene-based electric power big data rapid visual analysis method and system
CN104933411A (en) Fingerprint identification processing method and system
CN103207915B (en) A kind of reverse skyline query, Apparatus and system

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20161221

RJ01 Rejection of invention patent application after publication