CN103748578A - Data distribution method, device, and system - Google Patents
Data distribution method, device, and system Download PDFInfo
- Publication number
- CN103748578A CN103748578A CN201280002465.XA CN201280002465A CN103748578A CN 103748578 A CN103748578 A CN 103748578A CN 201280002465 A CN201280002465 A CN 201280002465A CN 103748578 A CN103748578 A CN 103748578A
- Authority
- CN
- China
- Prior art keywords
- distribution
- sequence
- logical data
- data table
- control node
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000009826 distribution Methods 0.000 title claims abstract description 493
- 238000000034 method Methods 0.000 title claims abstract description 35
- 238000012545 processing Methods 0.000 claims description 19
- 230000008569 process Effects 0.000 abstract description 6
- 230000005012 migration Effects 0.000 description 21
- 238000013508 migration Methods 0.000 description 21
- 238000003860 storage Methods 0.000 description 12
- 238000010586 diagram Methods 0.000 description 5
- 238000013500 data storage Methods 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 4
- 238000004891 communication Methods 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 230000008878 coupling Effects 0.000 description 2
- 241001522296 Erithacus rubecula Species 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2458—Special types of queries, e.g. statistical queries, fuzzy queries or distributed queries
- G06F16/2471—Distributed queries
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2453—Query optimisation
- G06F16/24532—Query optimisation of parallel queries
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Computational Linguistics (AREA)
- Computing Systems (AREA)
- Software Systems (AREA)
- Probability & Statistics with Applications (AREA)
- Mathematical Physics (AREA)
- Fuzzy Systems (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The present invention relates to the technical field of information. Disclosed are a data distribution method, device, and system, so as to save querying time, and improve the querying efficiency. The method comprises: before data querying, a control node setting a distribution table establishment instruction according to an establishment rule, the distribution table establishment instruction carrying an identifier (ID) of a logic data table and a distribution column ID of a selected distribution column, the selected distribution column being a distribution column in the logic data table, and the logic data table being a logic data table established in the control node; and the control node sending the distribution table establishment instruction to a data node, so that the data node establishes a distribution table of the logic data table according to the distribution table establishment instruction. The present invention is mainly applied in a data distribution process in a parallel database system.
Description
Method, the apparatus and system technical field of data distribution
The present invention relates to areas of information technology, more particularly to a kind of method of data distribution, apparatus and system.Background technology
Parallel database system is a kind of data storage technology for being distributed data content and being stored on multiple back end, can be according to Hash（Hash), scope（Range), rotate（Round-bin) scheduling algorithm, a logical data table is distributed on each back end.Inquiry velocity is fast for the parallel database system data content that parallel query user needs on each back end, relatively non-parallel database system, and is easily managed data content.
Generally, multiple fields can be included in logical data table, parallel database system is with one of those（Or multiple) field contents as the independent variable of above-mentioned algorithm carry out distribution storage to the logical data table on back end, and the Distribution of A Sequence of the logical data table is referred to as the field of independent variable.
In the prior art, parallel database system carries out Distribution of A Sequence joint to the distribution table of multiple logical data tables（When Join) inquiring about, if the Distribution of A Sequence of multiple distribution tables with inquiry relation is differed, need to re-start distribution to multiple logical data tables according to the Distribution of A Sequence that multiple distribution tables have, so as to influence search efficiency.The content of the invention
Embodiments of the invention provide a kind of method of data distribution, apparatus and system, can save query time, improve search efficiency.
On the one hand, the embodiments of the invention provide a kind of method of data distribution, including：
Before data query, control node creates instruction according to rule setting distribution table is created, the distribution table creates the Distribution of A Sequence mark of the mark ID that logical data table is carried in instruction and selected Distribution of A Sequence, wherein described selected distribution is classified as Distribution of A Sequence in the logical data table, and the logical data table is the logical data table created in the control node；
The control node sends the distribution table to back end and creates instruction, so as to the back end
The distribution table for indicating to create the logical data table is created according to the distribution table.
On the other hand, the embodiment of the present invention additionally provides a kind of control node, including：
Processing unit, for before data query, instruction is created according to rule setting distribution table is created, the distribution table creates the Distribution of A Sequence mark of the mark ID that logical data table is carried in instruction and selected Distribution of A Sequence, wherein described selected distribution is classified as Distribution of A Sequence in the logical data table, and the logical data table is the logical data table created in the control node；
Transmitting element, for sending the distribution table establishment instruction that the processing unit is set to back end, so that the back end creates the distribution table for indicating to create the logical data table according to the distribution table.
Finally, the embodiment of the present invention additionally provides a kind of system of data distribution, including：
Control node, for before data query, instruction is created according to rule setting distribution table is created, the distribution table creates the Distribution of A Sequence mark of the mark ID that logical data table is carried in instruction and selected Distribution of A Sequence, wherein described selected distribution is classified as the Distribution of A Sequence in the logical data table, the logical data table is the logical data table created in the control node, sends the distribution table to back end and creates instruction；The back end, creates instruction for before data query, receiving the distribution table that the control node is sent, the distribution table for indicating to create the logical data table is created according to the distribution table.
The method of data distribution provided in an embodiment of the present invention, apparatus and system, can be before data query, the distribution of multiple logical data tables is stored on each back end according to identical Distribution of A Sequence according to rule is created, the distribution table set up after distribution storage on each back end is used for follow-up data query.It can avoid during Distribution of A Sequence conjunctive query, when the Distribution of A Sequence of multiple distribution tables with inquiry relation is differed, the problem of needing multiple logical data tables redistribution being stored on each back end, the inquiry time delay that mass data migration is brought during Distribution of A Sequence conjunctive query can be avoided, it is possible to increase search efficiency.
Brief description of the drawings
In order to illustrate more clearly about the embodiment of the present invention or technical scheme of the prior art, the required accompanying drawing used in embodiment or description of the prior art will be briefly described below, apparently, drawings in the following description are only some embodiments of the present invention, for those of ordinary skill in the art
On the premise of not paying creative work, other accompanying drawings can also be obtained according to these accompanying drawings.
Fig. 1 is the schematic diagram of the framework of parallel database system；
Fig. 2 is the schematic diagram of logical data table in parallel database system；
Fig. 3 is the schematic diagram that back end creates distribution table；
Fig. 4 is the schematic diagram that another back end creates distribution table；
Fig. 5 is the flow chart of the method for data distribution in the embodiment of the present invention；
Fig. 6 is the flow chart of the method for another data distribution in the embodiment of the present invention；
Fig. 7 is the schematic diagram of application scenarios in the embodiment of the present invention；
Fig. 8 is the structural representation of control node in the embodiment of the present invention；
Fig. 9 is the system schematic of data distribution in the embodiment of the present invention.Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is clearly and completely described, it is clear that described embodiment is only a part of embodiment of the invention, rather than whole embodiments.Based on the embodiment in the present invention, the every other embodiment that those of ordinary skill in the art are obtained under the premise of creative work is not made belongs to the scope of protection of the invention.
Fig. 1 is a kind of framework of parallel database system, and control node is connected to three back end, and control node and each back end have independent central processing unit（Centra l Proces s ing Uni t, abbreviation CPU), memory（Internal memory, hard disk）, between node and node pass through express network（Such as Ethernet, optical fiber switching network）Realize data communication.Wherein, control node is mainly used in：1st, according to the field and preset algorithm of logical data table by distributed data storage to be managed to each back end, the logical data table is the tables of data with properties of data structures being stored in control node, and the logical data table is the logic basis that back end creates distribution table；2nd, query interface, such as SQL are provided for client（Structured Query Language, abbreviation SQL), Java databases connection（Java Data Base Connect ivi ty, f JDBC), Open Database Connection (Open Database Connect ivi ty, ODBC) etc.；3rd, the Query Result of each back end feedback is handled according to the inquiry request of client.Back end is mainly used in：Controlled node control sets up the distribution table of logical data table according to Distribution of A Sequence, carries out Data Migration with other back end, realizes distribution as self contained data base node
The storage and inquiry of table.
Exemplified by storing teaching data information：There are three logical data tables in Fig. 2, the data of logical data Table A (being subsequently referred to as Table A) storage student number and name, the data of the data of logical data table B (follow-up referred to as table B) storage student number, course identification and achievement, logical data table C (follow-up referred to as table C) storage course identifications and course name.Wherein, any one row in logical data table（Or be field or attribute）Three fields that student number, course identification and the achievement that can be distributed as the logical data table in the Distribution of A Sequence of storage, such as table B are table B.Control node using student number field as Distribution of A Sequence, by the algorithm of Hash (Hash) mould 3 by the distributed data storage of Table A to three back end.As shown in figure 3, student number 1 removes more than 31, then student number 1 and the corresponding name of student number 1（The first row data i.e. in Table A）Store on back end 1, student number 2 removes more than 32, then on the second row data Cun Chudao back end 2 in Table A, student number 3 removes more than 30, then on the third line data Cun Chudao back end 0 in Table A, the divisor 3 wherein in the algorithm of Hash mould 3 is the number of back end in parallel database system.Similarly, control node is respectively using student number field and course identification field as Distribution of A Sequence, by table B and table C distributed data storage to three back end.Wherein, control node using student number field as table B Distribution of A Sequence（J) table B is distributed by the algorithm of Hash mould 3, using course identification field as table C Distribution of A Sequence（K) table C is distributed by the algorithm of Hash mould 3.After the distribution of logical data table, the tables of data set up on each back end is referred to as the distribution table of the logical data table, the title of distribution table can be represented by logical data table mark+back end mark+Distribution of A Sequence mark, such as B+mdtl+j in back end 1, represents that back end 1 creates table B distribution table using student number field (j) as Distribution of A Sequence.As client executing query statement select stu.name, course. id from A, B where A: stu_id=B:During stu.id, the query statement represents the Distribution of A Sequence conjunctive query by Table A and table B（From A, B), the data of query name, course identification and achievement, and the corresponding relation between three（Select stu.name, course-id), wherein Table A and table B are stored on each back end using student number field as distribution column distribution（ A: stu_id=B: stu_id).Query Result is that back end 1 inquires 1 corresponding three course identification of student number and corresponding three achievements, back end 2 inquires 2 corresponding three course identifications of student number and corresponding three achievements, and back end 0 inquires 3 corresponding three course identifications of student number and corresponding three achievements.Query Result is reported control node by three back end respectively, control
Node by the Query Result summarizing and reporting of reception to client so that complete inquiry.
As client executing query statement Selec t s tu_ id, course_name from B, C where B: cour se_ id=C:During course_ id, because table B distribution is classified as student number field, and table C distribution is classified as course identification field, the Distribution of A Sequence of two tables is different, so back end 1 can only inquire the course name of the corresponding course identification 1 of student number 1, the course name of the corresponding course identification 2 and 3 of student number 1 can not then be inquired about, and the course name of the corresponding course identification 2 and 3 of student number 1 can not be also inquired about on back end 2 and back end 0, it is similar, back end 2 and back end 0 there is also it is identical the problem of.Now control node needs to re-start table B using course identification field as Distribution of A Sequence distribution (because table C does not have student number field, to make table B and table C are distributed according to identical Distribution of A Sequence, need to re-start distribution according to the algorithm of Hash mould 3 to table B using course identification field as Distribution of A Sequence, re-create table B distribution table）.It is distribution table that table B is re-created on three back end as shown in figure 4, the k wherein in distribution table name is to represent course identification field to identify as the Distribution of A Sequence of Distribution of A Sequence.
After completion table B distribution table is re-created, control node controls three back end to carry out Data Migration, so that back end obtains the data increased newly in the distribution table of itself reconstruction corresponding to list item at other back end.For example, in distribution table B+mdt l+k in back end 1, student number 2 is increased newly and student number 3 distinguishes the row list item of 1 achievement of corresponding course 1 and course two, and back end 1 is not related to this two rows list item when creating distribution table B+mdt l+j, so back end 1 does not obtain the data of this two rows list item when creating distribution table B+mdt l+j.Back end 1 obtains the data of the corresponding course 1 of student number 2 and the achievement of course 1 at back end 2（That is the corresponding data of the first row list item in B+mdt2+j）, data (the i.e. corresponding data of the first row list item in B+mdt O+j of the corresponding course 1 of student number 3 and the achievement of course 1 are obtained at back end 0）.Back end 2 and back end 0 are rebuild after table B distribution table, and corresponding steps are performed also according to itself table characteristic, herein without --- Redundant is stated.
Back end is got after the data of reconstruction table B distribution tables needs, is added the data in the table B distribution tables of reconstruction in corresponding list item, so as to complete reconstruction table B distribution table.Now, control node can just inquire the course name of corresponding three subject of each student number with control data node according to the distribution table of table B after table C distribution table and reconstruction.
The distribution table of same logical data table is corresponded on each back end plus and can completely reflect this
The content of logical data table.
The embodiments of the invention provide a kind of method of data distribution, as shown in Fig. 5, methods described comprises the following steps：
501st, before data query, control node creates instruction according to rule setting distribution table is created.
The distribution table creates the mark that logical data table is carried in instruction（Ident i ty, abbreviation ID) and selected Distribution of A Sequence Distribution of A Sequence mark, wherein the selected distribution is classified as Distribution of A Sequence in the logical data table, the logical data table is the logical data table created in the control node.
The ID of the logical data table is used for unique mark logical data table, and the Distribution of A Sequence identifies the Distribution of A Sequence selected for unique mark.The distribution table, which is created, can carry one or more logical data table ids and one or more Distribution of A Sequence mark in instruction, when carrying multiple Distribution of A Sequence marks, the multiple Distribution of A Sequence mark can be multiple Distribution of A Sequence mark in a logical data table or multiple Distribution of A Sequence mark in multiple logical data tables.
By taking the distribution table B+mdt l+j on back end in Fig. 41 as an example, B is table B ID, and j is the Distribution of A Sequence mark using student number field as Distribution of A Sequence, and mdt l are the mark of back end.
502nd, control node sends distribution table to back end and creates instruction.
The logical data table id and Distribution of A Sequence mark that back end is created according to the distribution table in indicating create the distribution table of the logical data table, and complete the Data Migration between back end.
In the prior art, after client input inquiry sentence（After starting a query at）If the multiple distribution tables for participating in Distribution of A Sequence conjunctive query are not by same distribution column distribution storage, then need to be arranged according to same distribution on each back end and distribution is re-started to corresponding logical data table, and Data Migration is carried out between back end, Data Migration in query process can take substantial amounts of query time, reduce search efficiency.The method of data distribution provided in an embodiment of the present invention, can be in phase data memory, and according to the selected Distribution of A Sequence of rule is created, back end is used for follow-up Distribution of A Sequence conjunctive query based on the distribution table that selected Distribution of A Sequence is created.When client input inquiry sentence, multiple distribution tables that back end is directly created according to being arranged according to predetermined distribution carry out Distribution of A Sequence conjunctive query, can save query time, improve search efficiency.
Further, further expanded as to Fig. 5 illustrated embodiments, the embodiment of the present invention additionally provides a kind of method of data distribution, as shown in fig. 6, methods described comprises the following steps：
601st, before data query, control node creates the establishment instruction of rule setting distribution table according to the statistical result to logical data table in predetermined period.
Control node according to the statistical results of the data to logical data table using at least one field of logical data table as selected Distribution of A Sequence, the ID of the Distribution of A Sequence mark of selected Distribution of A Sequence and logical data table is added to during the distribution table creates and indicate.
The objects of statistics of control node is Table A, table B and table C in all logical data tables created in parallel database system, i.e. Fig. 2.The statistical result includes：In a predetermined period, the list item data that number of times that logical data table is queried, logical data table are queried account for the number of times that Distribution of A Sequence is queried in the ratio and logical data table of the logical data table summary table item data.Wherein, the called number of times of logical data table is the number of times that the logical data table participates in Distribution of A Sequence conjunctive query in a predetermined period；The ratio that the called list item data of logical data table account for the logical data table summary table item data is in a predetermined period, the accumulative accessed amount of any a line entry number evidence accounts for the ratio of the logical data table summary table item data in logical data table, for example, certain logical data table one has three row list item data, and Second Threshold is 120%.The first row list item data have been queried 4 times in the logical data table in 5 minutes, then the queries of the row list item data is 4 rows（Aggregate-value）, the queries of the row list item data accounts for 133% (4/ 3=1. 33) of the logical data table summary table item data, the Second Threshold more than 120%.Wherein, any a line entry number evidence, which is queried, is not limited to by Distribution of A Sequence conjunctive query.The number of times that Distribution of A Sequence is queried in logical data table is that the number of times that any one field is inquired about as Distribution of A Sequence in logical data table, the inquiry is not limited to Distribution of A Sequence conjunctive query in a predetermined period.
Specifically：
A) in a predetermined period, when the number of times that logical data table is queried exceedes first threshold, control node is by all fields in the ID of logical data table and the logical data table（It is used as Distribution of A Sequence）Distribution of A Sequence mark be added to distribution table create indicate in.
B) in a predetermined period, when the ratio that the list item data being queried in logical data table account for the logical data table summary table item data exceedes Second Threshold, control node is by all fields in the ID of the logical data table and the logical data table（It is used as Distribution of A Sequence）Distribution of A Sequence mark be added to distribution table create indicate in.
C) in a predetermined period, when the number of times that Distribution of A Sequence is queried in logical data table is more than three threshold values, control node will be queried the Distribution of A Sequence of Distribution of A Sequence of the number of times more than the 3rd threshold value mark and be added in distribution table establishment instruction in the ID of the logical data table and the logical data table.
In embodiments of the present invention, any one statistical result that control node can be in above three statistical result sets distribution table to create and indicated, for example：
When the ratio that the list item data that number of times and logical data table that logical data table is queried are queried account for the logical data table summary table item data is not up to respective threshold value, the ID of logical data table is not added to distribution table and created in instruction by control node.When any one reaches its respective threshold during the list item data that number of times or logical data table that logical data table is queried are queried account for the ratio of the logical data table summary table item data the two conditions, control node (regard field all in the ID of logical data table and the logical data table as Distribution of A Sequence）Distribution of A Sequence mark be added to distribution table create indicate in.When the number of times that Distribution of A Sequence is queried in logical data table reaches three threshold values, control node reaches inquiry times the Distribution of A Sequence mark of the Distribution of A Sequence of the 3rd threshold value and the ID of the logical data table are added to distribution table and created in instruction.
Optionally, above-mentioned three kinds of statistical results can also be combined by control node, be used as addition logical data table id and the foundation of Distribution of A Sequence mark.For example, in the predetermined period of 5 minutes, if certain logical data table meets It volumes of expression formula (Join Times>6) and (Pacces sed Lines Percent >180%) and (CFrenqence>8), then the ID of the logical data table and corresponding Distribution of A Sequence mark are added into distribution table to create in instruction.Wherein,（Join Times>6) represent that the number of times that the logical data table is queried is more than 6 times,（Pacces sed Lines Percent ＞ 180%) represent a certain list item data in the logical data table queries account for the logical data table summary table item data ratio be more than 180%, (CFrenqence>8) represent that a certain Distribution of A Sequence is queried in the logical data table number of times is more than 8 times, and represent be between three judgment conditions with relation, i.e., while meeting above three judgment condition.Or, It volumes of expression formulas of certain logical data table can also be (Pacces sed L ines Percent>5/ Join Times>50% ) and ( CFrenqence>6), wherein, "/" represents or relation that two judgment conditions select one.
Control node control data node create distribution table sentence be：
CREATE [TEMP] TABLE table.name (create—def ini t ion . )
[Distribution on KEY column..name [, column_name ,]-be used for defining Distribution of A Sequence
[INHERITS (table-name)]
[TABLESPACE tablespace] al lowMult ipleDistr ibution-point out to allow to be distributed the definition for wherein aggravating font to increase newly in Current standards sql like language, are interpreted as follows:
Control node control data node create distribution table sentence be：[Distribution on KEY column-name [, column_name ,] ... a llowMult ipleDistr ibution, wherein, column-name is bad to be distributed1J is identified, and column-name [, column-name ...] is represented can be using multiple Distribution of A Sequence as the independent variable of Distribution Algorithm, and allowMultipleDistribution represents to allow to create distribution table.
In addition, control node can also indicate that the Distribution of A Sequence mark of the ID of logical data table and the selected Distribution of A Sequence of logical data table is added into distribution table creates in instruction according to the establishment of client.Logical data table id and the Distribution of A Sequence mark of at least one Distribution of A Sequence in the logical data table that the establishment that such as control node is received is selected in indicating comprising inquiry or DBA.The Distribution of A Sequence mark of the logical data table id created in indicating and selected Distribution of A Sequence is added to distribution table and created in instruction by control node.
Further, it is the memory space of saving back end, control node can also periodically delete the distribution table for not being queried or being seldom queried in back end.Specifically, the number of times that each distribution table is queried in control node statistics node, the distribution table that number of times is less than the 4th threshold value is queried if existed in a predetermined period, then the back end belonging to control node to the distribution table sends distribution table and deletes instruction, the distribution table, which is deleted to indicate to carry, is queried Distribution of A Sequence mark of the number of times less than the distribution table correspondence Distribution of A Sequence of the 4th threshold value, and the logical data table belonging to the Distribution of A Sequence ID.Back end receives the distribution table and deleted after instruction, and corresponding distribution table is deleted according to logical data Table I D and the Distribution of A Sequence mark wherein carried.
Further, distribution table is created to avoid back end from repeating, control node is setting distribution table
When creating instruction, it can also judge whether back end identifies the distribution table for creating the logical data table according to the Distribution of A Sequence of the ID of the logical data table and selected Distribution of A Sequence, the ID of the logical data table is that control node is added to the ID that distribution table creates the logical data table in indicating, the Distribution of A Sequence of the selected Distribution of A Sequence is designated the Distribution of A Sequence mark that control node is added to during distribution table establishment is indicated.If back end creates the distribution table of the logical data table according to the Distribution of A Sequence mark of the logical data table id and selected Distribution of A Sequence, the Distribution of A Sequence mark of the ID of the logical data table and selected Distribution of A Sequence is not added to distribution table and created in instruction by control node.
602nd, control node sends distribution table to back end and creates instruction.
Control node sends distribution table to back end and creates instruction, is logical data table establishment distribution table so that back end creates the ID of logical data table in instruction, Distribution of A Sequence mark and default Distribution Algorithm according to distribution table.
Specifically, for table B create distribution table as shown in B+mdt l+k, B+mdt 2+k in Fig. 4 and B+mdt O+k forms.Back end can create a distribution table using a field of logical data table as Distribution of A Sequence（As shown in Figure 3）, a distribution table can also be created using two or more fields of logical data table as Distribution of A Sequence.For example student number field and achievement field are added and the independent variable of the algorithm of mould 3 is used as.When a field of the back end according to logical data table（Such as student number field）When creating a distribution table, the maximum quantity that back end can create distribution table is the field quantity of the logical data table.When creating a distribution table according to two or more fields of logical data table, the maximum quantity that back end can create distribution table is the permutation and combination of the field of logical data table at least two, and the distribution table quantity that can be created is more than the quantity of field in the logical data table.
In embodiments of the present invention, back end is distributed or created the Distribution Algorithm used during distribution table and includes but is not limited to be hash algorithm, range algorithm and round robin algorithm.
Back end is created according to distribution table to be indicated to have created after distribution table, in addition it is also necessary to data that are that newly-built distribution table includes but not stored in notebook data node are obtained at other back end, the Data Migration between back end is thus completed.
For example, in Fig. 4, back end 1 obtains all list item data in the B+mdt 2+j tables and B+mdt O+j tables that back end 2 and back end 0 are sent after distribution table B+mdt l+k have been created.
Further, be reduce Data Migration amount, back end 1 can also only obtain back end 2 send B+mdt2+j in the first row list item data, and back end 0 send B+mdt O+j in the first row list item data.
After back end has created distribution table and carries out Data Migration, when client initiates inquiry request, control node sends inquiry to back end and indicated, so that back end carries out Distribution of A Sequence conjunctive query.
When carrying out Distribution of A Sequence conjunctive query, the less distribution table of Query Cost can be selected to be inquired about, the Query Cost includes but are not limited to Data Migration amount.For example, as client executing query statement Select s tu- id, course_name f rom B, C where B: cour se. id=C:Course. during id, the tables of data that Distribution of A Sequence conjunctive query is participated on back end 1 is B+mdt l+k and C+mdt l+k, and two tables are arranged according to same distribution（Course identification k) is distributed.Back end 1 can be searched and the achievement of the corresponding course 1 of three student numbers is reported to control node.Same back end 2 can be searched with back end 0 and the achievement of the corresponding course 2 of three student numbers and course 3 is reported to control node.Control node, which collects the Query Result that three back end are reported, feeds back to client, completes inquiry.
The embodiment of the present invention is illustrated so that two tables of data participate in Distribution of A Sequence conjunctive query as an example, and the tables of data that Distribution of A Sequence conjunctive query is participated in practical application can also be more than three.
In the prior art, after client input inquiry sentence（After starting a query at）Just start to set up distribution table according to querying condition and carry out the Data Migration in Data Migration, query process that substantial amounts of query time can be taken, reduce search efficiency.The method of data distribution provided in an embodiment of the present invention, can be in phase data memory, Distribution of A Sequence is selected in instruction according to statistical result or client to preset data, and back end is used for follow-up Distribution of A Sequence conjunctive query based on the distribution table that selected Distribution of A Sequence is created.When client input inquiry sentence, multiple distribution tables that back end is directly created according to being arranged according to predetermined distribution carry out Distribution of A Sequence conjunctive query, can save query time, improve search efficiency.
In an application scenarios of the embodiment of the present invention, as shown in Fig. 7, control node can be indicated according to client or statistical result indicates that back end creates table B distribution table again.Specifically, 701, client sends distribution table to control node creates instruction, indicate to create distribution table in parallel database system for table B.702nd, control node sends distribution table to three back end and creates instruction respectively, and the distribution table creates the ID and Distribution of A Sequence that table B is carried in instruction（Course identification field）Mark.703rd, three
Individual back end creates the distribution table for indicating to create table B according to distribution table.704th, control node sends Data Migration to three back end respectively and indicated.705th, back end indicates to carry out Data Migration according to Data Migration.706th, back end sends to control node and creates success message.707th, control node is received after the establishment success message of back end transmission, is sent to client and is created success message.
Application scenarios shown in Fig. 7, can create on each back end the Data Migration between distribution table and complete back end before client query.Because distribution table is created before client query, keyword that can not be in query statement determines to create the Distribution of A Sequence of distribution table, so the logical data table id and Distribution of A Sequence that are set in advance according to the statistical result or client of inquiring about user data in the application scenarios shown in Fig. 7 create distribution table, the distribution table of establishment is used for follow-up Distribution of A Sequence conjunctive query.Carried out being transferred to the step of creating distribution table and Data Migration before client query, thereby saving and the time delay that distribution table and Data Migration are caused to inquiry is created in query process, search efficiency can be improved.
In the application scenarios shown in the embodiment of the present invention and Fig. 7, the Data Migration is specifically, source data node replicates the data of itself storage, by the data transfer of duplication into purpose back end.The data stored in Data Migration opisthogenesis back end are still present, in practical application, and the Data Migration is the known technology means of those skilled in the art, and the embodiment of the present invention does not do excessive introduction to this.
The realization of embodiment of the method with reference to shown in Fig. 6, the embodiment of the present invention additionally provides a kind of control node, for realizing the embodiment of the method shown in Fig. 6.As shown in figure 8, the control node includes：Processing unit 81, transmitting element 82 and receiving unit 83, wherein,
The processing unit 81, for before data query, instruction is created according to rule setting distribution table is created, the distribution table creates the Distribution of A Sequence mark of the ID that logical data table is carried in instruction and selected Distribution of A Sequence, wherein described selected distribution is classified as Distribution of A Sequence in the logical data table, and the logical data table is the logical data table created in the control node；
The transmitting element 82, for sending the distribution table establishment instruction that the processing unit 81 is set to back end, so that the back end creates the distribution table for indicating to create the logical data table according to the distribution table.
Further, the processing unit 81 specifically for：The data of the logical data table in predetermined period are counted, statistical result is drawn, according to the statistical result by the ID of the logical data table and institute
The Distribution of A Sequence mark for stating selected Distribution of A Sequence is added in the distribution table establishment instruction.
Further, the receiving unit 83, the establishment for receiving client indicates that the establishment carries the ID of the logical data table and the Distribution of A Sequence mark of the selected Distribution of A Sequence in indicating；
The processing unit 81 also particularly useful for：
The ID for the logical data table that the establishment that the receiving unit 83 is received is carried in indicating and the Distribution of A Sequence mark of the selected Distribution of A Sequence are added to the distribution table and created in instruction.
Further, the processing unit 81 further specifically for：In a predetermined period, at least one in following data is counted：The list item data being queried in number of times that the logical data table is queried, the logical data table account for the number of times that Distribution of A Sequence is queried in the ratio and the logical data table of the logical data table summary table item data；
When the number of times that the logical data table is queried exceedes first threshold, the Distribution of A Sequence mark of all Distribution of A Sequence in the I D of the logical data table and the logical data table is added to the distribution table and created in instruction；
When the ratio that the list item data being queried in the logical data table account for the logical data table summary table item data exceedes Second Threshold, the Distribution of A Sequence mark of all Distribution of A Sequence in the ID of the logical data table and the logical data table is added to the distribution table and created in instruction；
When the number of times that Distribution of A Sequence is queried in the logical data table is more than three threshold values, number of times will be queried in the ID of the logical data table and the logical data table and will be added to more than the Distribution of A Sequence mark of the Distribution of A Sequence of the 3rd threshold value in the distribution table establishment instruction.
Further, the transmitting element 82 is additionally operable to：When the processing unit 81, which counts the number of times that the corresponding distribution table of Distribution of A Sequence is queried in the logical data table, is less than four threshold values, distribution table, which is sent, to the back end deletes instruction, the distribution table, which is deleted to indicate to carry, is queried Distribution of A Sequence mark and the ID of the logical data table of the number of times less than the corresponding Distribution of A Sequence of distribution table of the 4th threshold value, and the distribution table, which is deleted, to be indicated to be used to indicate that the back end is queried the distribution table that number of times is less than the 4th threshold value described in deleting.
Further, the processing unit 81 is additionally operable to：Before the Distribution of A Sequence mark of the I D of the logical data table and the selected Distribution of A Sequence is added to during the distribution table establishment is indicated by the control node,
Judge whether the back end identifies the distribution table for creating the logical data table according to the Distribution of A Sequence of the ID of the logical data table and the selected Distribution of A Sequence；
When the back end creates the distribution table of the logical data table not according to the ID of the logical data table and the Distribution of A Sequence mark of the selected Distribution of A Sequence, the Distribution of A Sequence mark of the ID of the logical data table and the selected Distribution of A Sequence is added to the distribution table and created in instruction；
When the back end identifies the distribution table for creating the logical data table according to the Distribution of A Sequence of the ID of the logical data table and the selected Distribution of A Sequence, the Distribution of A Sequence mark of the ID of the logical data table and the selected Distribution of A Sequence is not added to the distribution table and created in instruction.
Control node provided in an embodiment of the present invention, can select Distribution of A Sequence, back end is used for follow-up Distribution of A Sequence conjunctive query based on the distribution table that selected Distribution of A Sequence is created in phase data memory according to the instruction of statistical result or client to preset data.When client input inquiry sentence, multiple distribution tables that back end is directly created according to being arranged according to predetermined distribution carry out Distribution of A Sequence conjunctive query, can save query time, improve search efficiency.
Further, the embodiment of the present invention additionally provides a kind of system of data distribution, as shown in Fig. 9, and the system includes control node 91 and to three back end 92, wherein,
The control node 91, for before data query, instruction is created according to rule setting distribution table is created, the distribution table creates the Distribution of A Sequence mark of the mark ID that logical data table is carried in instruction and selected Distribution of A Sequence, wherein described selected distribution is classified as the Distribution of A Sequence in the logical data table, the logical data table is the logical data table created in the control node, sends the distribution table to the back end 92 and creates instruction.
The back end 92, creates instruction for before data query, receiving the distribution table that the control node 91 is sent, the distribution table for indicating to create the logical data table is created according to the distribution table.
The system of data distribution provided in an embodiment of the present invention is illustrated exemplified by comprising three back end 92, and the quantity of back end 92 is not limited in practical application.
The system of data distribution provided in an embodiment of the present invention, can be in phase data memory, control node selectes Distribution of A Sequence according to the instruction of statistical result or client to preset data, and back end is used for follow-up Distribution of A Sequence conjunctive query based on the distribution table that selected Distribution of A Sequence is created.When client input inquiry sentence,
Multiple distribution tables that back end is directly created according to being arranged according to predetermined distribution carry out Distribution of A Sequence conjunctive query, can save query time, improve search efficiency.
It is apparent to those skilled in the art that, for convenience and simplicity of description, only it is illustrated with the division of above-mentioned each functional module, in practical application, it can as needed and by above-mentioned functions distribute and be completed by different functional modules, the internal structure of device is divided into different functional modules, to complete all or part of function described above.The specific work process of the system, apparatus, and unit of foregoing description, may be referred to the corresponding process in preceding method embodiment, no longer Redundant is stated herein.
In several embodiments provided herein, it should be understood that disclosed system, apparatus and method can be realized by another way.For example, device embodiment described above is only schematical, for example, the division of the module or unit, it is only a kind of division of logic function, there can be other dividing mode when actually realizing, such as multiple units or component can combine or be desirably integrated into another system, or some features can be ignored, or do not perform.Another, it, by some interfaces, the INDIRECT COUPLING or communication connection of device or unit, can be electrical, machinery or other forms that shown or discussed coupling or direct-coupling or communication connection each other, which can be,.
The unit illustrated as separating component can be or may not be physically separate, and the part shown as unit can be or may not be physical location, you can with positioned at a place, or can also be distributed on multiple NEs.Some or all of unit therein can be selected to realize the purpose of this embodiment scheme according to the actual needs.
In addition, each functional unit in each of the invention embodiment can be integrated in a processing unit or unit is individually physically present, can also two or more units it is integrated in a unit.Above-mentioned integrated unit can both be realized in the form of hardware, it would however also be possible to employ the form of SFU software functional unit is realized.
If the integrated unit is realized using in the form of SFU software functional unit and as independent production marketing or in use, can be stored in a computer read/write memory medium.Understood based on such, the part or all or part of the technical scheme that technical scheme substantially contributes to prior art in other words can be embodied in the form of software product, the computer software product is stored in a storage medium, including some instructions are to cause a computer equipment（Can be personal computer,
Server, or the network equipment etc.）Or processor（Proces sor) perform all or part of step of each of the invention embodiment methods described.And foregoing storage medium includes：USB flash disk, mobile hard disk, read-only storage（ROM, Read-Only Memory), random access memory（RAM, Random Acces s Memory), magnetic disc or CD etc. are various can be with the medium of store program codes.
It is described above; only embodiment of the invention, but protection scope of the present invention is not limited thereto, any one skilled in the art the invention discloses technical scope in; change or replacement can be readily occurred in, should be all included within the scope of the present invention.Therefore, protection scope of the present invention should be based on the protection scope of the described claims.
Claims (11)
- Claims1st, a kind of method of data distribution, it is characterised in that including：Before data query, control node creates instruction according to rule setting distribution table is created, the distribution table creates the Distribution of A Sequence mark of the mark ID that logical data table is carried in instruction and selected Distribution of A Sequence, wherein described selected distribution is classified as Distribution of A Sequence in the logical data table, and the logical data table is the logical data table created in the control node；The control node sends the distribution table to back end and creates instruction, so that the back end creates the distribution table for indicating to create the logical data table according to the distribution table.2nd, according to the method described in claim 1, it is characterised in that the control node creates instruction according to rule setting distribution table is created, and specifically includes：The data of control node statistics logical data table in predetermined period, draw statistical result, and the Distribution of A Sequence mark of the ID of the logical data table and the selected Distribution of A Sequence is added into the distribution table according to the statistical result creates in instruction；Or,The establishment that the control node receives client is indicated, the ID and the selected Distribution of A Sequence that carry the logical data table in the establishment instruction Distribution of A Sequence are identified, and the control node, which identifies the ID of the logical data table for creating and being carried in instruction and the selected Distribution of A Sequence Distribution of A Sequence, to be added in the distribution table establishment instruction.3rd, method according to claim 2, it is characterised in that the data of control node statistics logical data table in predetermined period, is specifically included：In a predetermined period, the control node counts at least one in following data：The list item data being queried in number of times that the logical data table is queried, the logical data table account for the number of times that Distribution of A Sequence is queried in the ratio and the logical data table of the logical data table summary table item data；It is described that the Distribution of A Sequence mark of the I D of the logical data table and the selected Distribution of A Sequence is added in the distribution table establishment instruction according to the statistical result, specifically include：When the number of times that the logical data table is queried exceedes first threshold, the Distribution of A Sequence mark of all Distribution of A Sequence in the I D of the logical data table and the logical data table is added to the distribution table and created in instruction by the control node；And/or, When the ratio that the list item data being queried in the logical data table account for the logical data table summary table item data exceedes Second Threshold, the Distribution of A Sequence mark of all Distribution of A Sequence in the ID of the logical data table and the logical data table is added to the distribution table and created in instruction by the control node；And/or,When the number of times that Distribution of A Sequence is queried in the logical data table is more than three threshold values, the control node will be queried number of times and be added to more than the Distribution of A Sequence mark of the Distribution of A Sequence of the 3rd threshold value in the distribution table establishment instruction in the ID of the logical data table and the logical data table.4th, method according to claim 3, it is characterised in that when the number of times that the corresponding distribution table of Distribution of A Sequence is queried in the logical data table is less than four threshold values, methods described further comprises：The control node sends distribution table to the back end and deletes instruction, the distribution table, which is deleted to indicate to carry, is queried Distribution of A Sequence mark and the I D of the logical data table of the number of times less than the corresponding Distribution of A Sequence of distribution table of the 4th threshold value, and the distribution table, which is deleted, to be indicated to be used to indicate that the back end is queried the distribution table that number of times is less than the 4th threshold value described in deleting.5th, method as claimed in any of claims 2 to 4, it is characterized in that, before the Distribution of A Sequence mark of the ID of the logical data table and the selected Distribution of A Sequence is added to during the distribution table establishment is indicated by the control node, methods described further comprises：The control node judges whether the back end identifies the distribution table for creating the logical data table according to the Distribution of A Sequence of the ID of the logical data table and the selected Distribution of A Sequence；When the back end creates the distribution table of the logical data table not according to the I D of the logical data table and the Distribution of A Sequence mark of the selected Distribution of A Sequence, the Distribution of A Sequence mark of the I D of the logical data table and the selected Distribution of A Sequence is added to the distribution table and created in instruction by the control node；When the back end identifies the distribution table for creating the logical data table according to the Distribution of A Sequence of the I D of the logical data table and the selected Distribution of A Sequence, the Distribution of A Sequence mark of the I D of the logical data table and the selected Distribution of A Sequence is not added to the distribution table and created in instruction by the control node.6th, a kind of control node, it is characterised in that including：Processing unit, for before data query, instruction is created according to rule setting distribution table is created, the distribution table creates the Distribution of A Sequence mark of the mark ID that logical data table is carried in instruction and selected Distribution of A Sequence, wherein described selected distribution is classified as the Distribution of A Sequence in the logical data table, and the logical data table is the control The logical data table created in node；Transmitting element, for sending the distribution table establishment instruction that the processing unit is set to back end, so that the back end creates the distribution table for indicating to create the logical data table according to the distribution table.7th, control node according to claim 6, it is characterised in that the processing unit specifically for：The data of the logical data table in predetermined period are counted, statistical result is drawn, the Distribution of A Sequence mark of the ID of the logical data table and the selected Distribution of A Sequence is added into the distribution table according to the statistical result creates in instruction.8th, control node according to claim 6, it is characterized in that, the control node also includes receiving unit, the receiving unit, establishment for receiving client indicates that the establishment carries the I D of the logical data table and the Distribution of A Sequence mark of the selected Distribution of A Sequence in indicating；The processing unit also particularly useful for：The I D for the logical data table that the establishment that the receiving unit is received is carried in indicating and the Distribution of A Sequence mark of the selected Distribution of A Sequence are added to the distribution table and created in instruction.9th, control node according to claim 7, it is characterised in that the processing unit further specifically for：In a predetermined period, at least one in following data is counted：The list item data being queried in number of times that the logical data table is queried, the logical data table account for the number of times that Distribution of A Sequence is queried in the ratio and the logical data table of the logical data table summary table item data；When the number of times that the logical data table is queried exceedes first threshold, the Distribution of A Sequence mark of all Distribution of A Sequence in the I D of the logical data table and the logical data table is added to the distribution table and created in instruction；When the ratio that the list item data being queried in the logical data table account for the logical data table summary table item data exceedes Second Threshold, the Distribution of A Sequence mark of all Distribution of A Sequence in the I D of the logical data table and the logical data table is added to the distribution table and created in instruction；When the number of times that Distribution of A Sequence is queried in the logical data table is more than three threshold values, number of times will be queried in the ID of the logical data table and the logical data table and will be added to more than the Distribution of A Sequence mark of the Distribution of A Sequence of the 3rd threshold value in the distribution table establishment instruction. 10th, control node according to claim 9, it is characterised in that the transmitting element is additionally operable to：When the processing unit, which counts the number of times that the corresponding distribution table of Distribution of A Sequence is queried in the logical data table, is less than four threshold values, distribution table, which is sent, to the back end deletes instruction, the distribution table, which is deleted to indicate to carry, is queried Distribution of A Sequence mark and the ID of the logical data table of the number of times less than the corresponding Distribution of A Sequence of distribution table of the 4th threshold value, and the distribution table, which is deleted, to be indicated to be used to indicate that the back end is queried the distribution table that number of times is less than the 4th threshold value described in deleting.11st, the control node according to any one in claim 7 to 10, it is characterised in that the processing unit is additionally operable to：Before the Distribution of A Sequence of the ID of the logical data table and selected Distribution of A Sequence mark is added to during the distribution table establishment is indicated, judge whether the back end identifies the distribution table for creating the logical data table according to the Distribution of A Sequence of the ID of the logical data table and the selected Distribution of A Sequence；When the back end creates the distribution table of the logical data table not according to the I D of the logical data table and the Distribution of A Sequence mark of the selected Distribution of A Sequence, the Distribution of A Sequence mark of the ID of the logical data table and the selected Distribution of A Sequence is added to the distribution table and created in instruction；When the back end identifies the distribution table for creating the logical data table according to the Distribution of A Sequence of the I D of the logical data table and the selected Distribution of A Sequence, the Distribution of A Sequence mark of the ID of the logical data table and the selected Distribution of A Sequence is not added to the distribution table and created in instruction.12nd, a kind of system of data distribution, the system includes control node and back end, it is characterised in that including：The control node, for before data query, instruction is created according to rule setting distribution table is created, the distribution table creates the Distribution of A Sequence mark of the mark ID that logical data table is carried in instruction and selected Distribution of A Sequence, wherein described selected distribution is classified as the Distribution of A Sequence in the logical data table, the logical data table is the logical data table created in the control node, sends the distribution table to the back end and creates instruction；The back end, creates instruction for before data query, receiving the distribution table that the control node is sent, the distribution table for indicating to create the logical data table is created according to the distribution table.
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/CN2012/079173 WO2014015492A1 (en) | 2012-07-26 | 2012-07-26 | Data distribution method, device, and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103748578A true CN103748578A (en) | 2014-04-23 |
| CN103748578B CN103748578B (en) | 2017-10-10 |
Family
ID=49996501
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201280002465.XA Active CN103748578B (en) | 2012-07-26 | 2012-07-26 | The method of data distribution, apparatus and system |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN103748578B (en) |
| WO (1) | WO2014015492A1 (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2022240906A1 (en) * | 2021-05-11 | 2022-11-17 | Strong Force Vcn Portfolio 2019, Llc | Systems, methods, kits, and apparatuses for edge-distributed storage and querying in value chain networks |
| US20220261389A1 (en) * | 2021-02-18 | 2022-08-18 | International Business Machines Corporation | Distributing rows of a table in a distributed database system |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101120340A (en) * | 2004-02-21 | 2008-02-06 | 数据迅捷股份有限公司 | Ultra-shared-nothing parallel database |
| US20080263001A1 (en) * | 2002-12-19 | 2008-10-23 | International Business Machines Corporation | System and method for automating data partitioning in a parallel database |
| CN101916261A (en) * | 2010-07-28 | 2010-12-15 | 北京播思软件技术有限公司 | Data partitioning method for distributed parallel database system |
| CN102323946A (en) * | 2011-09-05 | 2012-01-18 | 天津神舟通用数据技术有限公司 | Implementation method for operator reuse in parallel database |
| CN102375853A (en) * | 2010-08-24 | 2012-03-14 | 中国移动通信集团公司 | Distributed database system, method for building index therein and query method |
| US20120117065A1 (en) * | 2010-11-05 | 2012-05-10 | Microsoft Corporation | Automated partitioning in parallel database systems |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102033889B (en) * | 2009-09-29 | 2012-08-22 | 熊凡凡 | Distributed database parallel processing system |
| CN102122306A (en) * | 2011-03-28 | 2011-07-13 | 中国人民解放军国防科学技术大学 | Data processing method and distributed file system applying same |
-
2012
- 2012-07-26 WO PCT/CN2012/079173 patent/WO2014015492A1/en active Application Filing
- 2012-07-26 CN CN201280002465.XA patent/CN103748578B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080263001A1 (en) * | 2002-12-19 | 2008-10-23 | International Business Machines Corporation | System and method for automating data partitioning in a parallel database |
| CN101120340A (en) * | 2004-02-21 | 2008-02-06 | 数据迅捷股份有限公司 | Ultra-shared-nothing parallel database |
| CN101916261A (en) * | 2010-07-28 | 2010-12-15 | 北京播思软件技术有限公司 | Data partitioning method for distributed parallel database system |
| CN102375853A (en) * | 2010-08-24 | 2012-03-14 | 中国移动通信集团公司 | Distributed database system, method for building index therein and query method |
| US20120117065A1 (en) * | 2010-11-05 | 2012-05-10 | Microsoft Corporation | Automated partitioning in parallel database systems |
| CN102323946A (en) * | 2011-09-05 | 2012-01-18 | 天津神舟通用数据技术有限公司 | Implementation method for operator reuse in parallel database |
Non-Patent Citations (1)
| Title |
|---|
| 文明波，丁治明: "适用于云计算的面向查询数据库数据分布策略", 《计算机科学》 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103748578B (en) | 2017-10-10 |
| WO2014015492A1 (en) | 2014-01-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP6338817B2 (en) | Data management system and method using database middleware | |
| CN104737157B (en) | Federated database system | |
| CN100586112C (en) | Method for establishing contact list and managing contact information in instant communication | |
| CN110555012B (en) | Data migration method and device | |
| CN101640613B (en) | Method and device for network resource relating management | |
| CN102375837B (en) | Data acquiring system and method | |
| CN107491510A (en) | One kind mixing heterogeneous data source unified query system and distributed enquiring method | |
| CN109299157B (en) | Data export method and device for distributed big single table | |
| CN102201010A (en) | Distributed database system without sharing structure and realizing method thereof | |
| CN102270225A (en) | Data change log monitoring method and device | |
| CN103823846A (en) | Method for storing and querying big data on basis of graph theories | |
| CN109656688B (en) | Method, system and server for realizing distributed business rules | |
| CN104268295A (en) | Data query method and device | |
| CN111258978A (en) | Data storage method | |
| CN106471501A (en) | The method of data query, the storage method data system of data object | |
| CN104268298A (en) | Method for creating database index and inquiring data | |
| CN102750368B (en) | High-speed importing method of cluster data in data base | |
| CN105550332A (en) | Dual-layer index structure based origin graph query method | |
| CN101916281B (en) | Concurrent computational system and non-repetition counting method | |
| CN103856462A (en) | Method and system for managing sessions | |
| CN102737061B (en) | Distributed ticket query management system and method | |
| CN115905628A (en) | Dynamic resource directory construction method, device, equipment and storage medium | |
| CN103377236B (en) | A kind of Connection inquiring method and system for distributed data base | |
| CN102724301B (en) | Cloud database system and method and equipment for reading and writing cloud data | |
| WO2017000592A1 (en) | Data processing method, apparatus and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20220216 Address after: 550025 Huawei cloud data center, jiaoxinggong Road, Qianzhong Avenue, Gui'an New District, Guiyang City, Guizhou Province Patentee after: Huawei Cloud Computing Technology Co.,Ltd. Address before: 518129 Bantian HUAWEI headquarters office building, Longgang District, Guangdong, Shenzhen Patentee before: HUAWEI TECHNOLOGIES Co.,Ltd. |