CN110413606A - A kind of horizontal method for splitting of tables of data and device - Google Patents

A kind of horizontal method for splitting of tables of data and device Download PDF

Info

Publication number
CN110413606A
CN110413606A CN201810391193.6A CN201810391193A CN110413606A CN 110413606 A CN110413606 A CN 110413606A CN 201810391193 A CN201810391193 A CN 201810391193A CN 110413606 A CN110413606 A CN 110413606A
Authority
CN
China
Prior art keywords
data
tables
split
fractionation
horizontal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201810391193.6A
Other languages
Chinese (zh)
Inventor
李文博
张炎泼
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guizhou Baishan Cloud Polytron Technologies Inc
Guizhou Baishancloud Technology Co Ltd
Original Assignee
Guizhou Baishan Cloud Polytron Technologies Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guizhou Baishan Cloud Polytron Technologies Inc filed Critical Guizhou Baishan Cloud Polytron Technologies Inc
Priority to CN201810391193.6A priority Critical patent/CN110413606A/en
Publication of CN110413606A publication Critical patent/CN110413606A/en
Pending legal-status Critical Current

Links

Landscapes

  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention discloses a kind of horizontal method for splitting of tables of data and devices.Disclosed method include: to the various field combinations in tables of data the distribution situations of all records in corresponding tables of data be compared;It chooses so that all records in tables of data are evenly distributed in or are approximately uniformly distributed in the field combination in N number of set as fractionation field combination;Tables of data automatic horizontal is split as N number of split table based on field combination is split, wherein N >=2 and be much smaller than the total number of records.Above-mentioned technical proposal according to the present invention can be realized the automatic fractionation of tables of data.

Description

A kind of horizontal method for splitting of tables of data and device
Technical field
The present invention relates to database field more particularly to a kind of horizontal method for splitting of tables of data and device.
Background technique
Database is used to save the related data record of user or equipment, and the data record of same type is generally held in number According in a tables of data in library.With the continuous growth of data volume, the form of Dan Kudan table will cause the IO bottle of data base read-write Neck just needs to split the individual data table in database at this time.Existing point of table (that is, tables of data fractionation) technology, it is main There is the shortcomings that 3 aspects:
1. structure and its split mode multiplicity of tables of data, ununified specification, to cause tables of data and data The fractionation in library is complicated, and the time cost of fractionation is higher.
2. nonstandard split mode, which can split again tables of data for the later period, increases additional cost.
3. the problems such as the problems such as split process is cumbersome and lack of standardization also be easy to cause mistake fractionation, data record to lose.
To solve the above-mentioned problems, it needs to propose new technical solution.
Summary of the invention
The horizontal method for splitting of tables of data according to the present invention, comprising:
To the various field combinations in tables of data the distribution situations of all records in corresponding tables of data carry out Compare;
It chooses so that the word that all records in tables of data are evenly distributed in or are approximately uniformly distributed in N number of set Duan Zuhe is as fractionation field combination;
Tables of data automatic horizontal is split as N number of split table based on field combination is split,
Wherein, N >=2 and be much smaller than the total number of records.
The horizontal method for splitting of tables of data according to the present invention is being split tables of data automatic horizontal based on fractionation field combination Before the step of for N number of split table, further includes:
It is that tables of data establishes index based on field combination is split.
The horizontal method for splitting of tables of data according to the present invention, when in tables of data include ID critical field, ID critical field ID value be all be randomly generated when, directly selection ID critical field as split field combination.
The horizontal method for splitting of tables of data according to the present invention is being split tables of data automatic horizontal based on fractionation field combination After the step of for N number of split table, further includes:
N number of split table is automatically stored in one or more databases.
The horizontal method for splitting of tables of data according to the present invention, the database where tables of data are not to be carrying out and master data The backup database of data simultaneously operating between library, is automatically stored in one or more databases by N number of split table After step, further includes:
The incremental data of tables of data is synchronized in N number of split table according to the Binlog information of primary database and is split accordingly Table.
The horizontal method for splitting of tables of data according to the present invention, further includes:
The data interaction operation between application layer and N number of split table is managed using database broker program.
The horizontal detachment device of tables of data according to the present invention, comprising:
Comparison module, for the various field combinations in tables of data all records in corresponding tables of data Distribution situation is compared;
Selecting module, for choosing so that all records in tables of data are evenly distributed in or are approximately uniformly distributed in Field combination in N number of set is as fractionation field combination;
Module is split, for tables of data automatic horizontal to be split as N number of split table based on fractionation field combination,
Wherein, N >=2 and be much smaller than the total number of records.
The horizontal detachment device of tables of data according to the present invention, further includes:
Index module, for split module execute based on split field combination tables of data automatic horizontal is split as it is N number of It is that tables of data establishes index based on field combination is split before the step of split table.
The horizontal detachment device of tables of data according to the present invention, further includes:
Memory module, for split module execute based on split field combination tables of data automatic horizontal is split as it is N number of After the step of split table, N number of split table is automatically stored in one or more databases.
The horizontal detachment device of tables of data according to the present invention, further includes:
Synchronization module, for the incremental data of tables of data to be synchronized to N number of fractionation according to the Binlog information of primary database Corresponding split table in table.
Above-mentioned technical proposal according to the present invention can be realized the automatic fractionation of tables of data.
Detailed description of the invention
It is incorporated into specification and the attached drawing for constituting part of specification shows the embodiment of the present invention, and with Relevant verbal description principle for explaining the present invention together.In the drawings, similar appended drawing reference is for indicating class As element.Drawings in the following description are some embodiments of the invention, rather than whole embodiments.It is common for this field For technical staff, without creative efforts, other drawings may be obtained according to these drawings without any creative labor.
Fig. 1 schematically illustrates the schematic flow diagram of the horizontal method for splitting of tables of data according to the present invention.
Fig. 2 schematically illustrates the schematic block diagram of the horizontal detachment device of tables of data according to the present invention.
Fig. 3 schematically illustrates an exemplary schematic diagram of horizontal method for splitting according to the present invention.
Specific embodiment
In order to make the object, technical scheme and advantages of the embodiment of the invention clearer, below in conjunction with the embodiment of the present invention In attached drawing, technical scheme in the embodiment of the invention is clearly and completely described, it is clear that described embodiment is A part of the embodiments of the present invention, instead of all the embodiments.Based on the embodiments of the present invention, ordinary skill people Member's every other embodiment obtained without making creative work, shall fall within the protection scope of the present invention.It needs It is noted that in the absence of conflict, the features in the embodiments and the embodiments of the present application can mutual any combination.
Fig. 1 schematically illustrates the schematic flow diagram of the horizontal method for splitting of tables of data according to the present invention.
As shown in the solid box of Fig. 1, the horizontal method for splitting of tables of data according to the present invention includes:
Step S102: to the various field combinations in tables of data all records in corresponding tables of data distribution Situation is compared;
Step S104: it chooses so that all records in tables of data are evenly distributed in or are approximately uniformly distributed in N number of Field combination in set is as fractionation field combination;
Step S106: being split as N number of split table for tables of data automatic horizontal based on field combination is split,
Wherein, N >=2 and be much smaller than the total number of records.Optionally, as shown in the dotted line frame of Fig. 1, tables of data according to the present invention Horizontal method for splitting, before step S106, further includes:
Step S108: being that tables of data establishes index based on field combination is split.
When stating method in realization, for example, can be by " approaches uniformity " is defined as: the record number phase that each split table includes The error of average record number after being rounded for the ratio between the record sum and N by former tables of data is less than or equal to 1%.Example Such as, it for former tables of data of the record sum more than 300,000, " can will be much smaller than " is defined as: the total N of split table at least wants small In the 1/100000th of the record sum for being equal to former tables of data.
Optionally, when in tables of data include ID critical field, the ID value of ID critical field be all be randomly generated when, directly ID critical field is chosen as fractionation field combination.
That is, above-mentioned fractionation field combination can only split key comprising ID critical field, by phase when fractionation Record corresponding to adjacent ID value is split in same split table.Moreover, being required to the tables of data split automatically, increasing When new record, ID value corresponding to every new record is all (that is, ID value is not incremented by successively) being randomly generated.Thus can It is enough to guarantee to be directed to each tables of data, identical method for splitting can be used, to complete automatic split.
At this point it is possible to avoid the step of will carrying out field combination selection to the tables of data of different structure (that is, on being omitted State step S102 and step S104), without the ashing technique for targetedly redesigning field.To simplify processing step Suddenly.
Optionally, as shown in the dotted line frame of Fig. 1, the horizontal method for splitting of tables of data according to the present invention, step S106 it Afterwards, further includes:
Step S110: N number of split table is automatically stored in one or more databases.
Optionally, as shown in the dotted line frame of Fig. 1, the horizontal method for splitting of tables of data according to the present invention, above-mentioned tables of data institute Database be the data simultaneously operating not being carrying out between primary database backup database, step S106 it Afterwards, further includes:
Step S112: the incremental data of tables of data is synchronized in N number of split table according to the Binlog information of primary database Corresponding split table.
That is, according to the note of the Binlog file in the source database of (that is, stop synchronous after) after carrying out point table handling It records, the incremental data affairs that database occurs during the entire process of available point of table.
For example, Binlog, which is synchronized, may include following steps:
1, each affairs is read, each action type (including newly-increased, modification, deletion) of the affairs is judged, by it It is put into write-in queue, while having x queue to use.Needing to guarantee to index identical operation, to be put into the same queue suitable to guarantee Sequence, to guarantee the consistency for the final result successively repeatedly modified same data record.
2, the operation for reading a write-in queue initiates write data requests to database broker program according to action type, Then the corresponding output queue of write-in queue is write the result into.
3, above-mentioned steps 2 execute (the one write-in queue of distribution of each thread and an output team using multithreading Column).
4, collection procedure collect each output queue as a result, summarized (be written successfully how much, each type is each more It is few etc..).
Optionally, as shown in the dotted line frame of Fig. 1, the horizontal method for splitting of tables of data according to the present invention, further includes:
Step S114: the data interaction operation between application layer and N number of split table is managed using database broker program.
The connection of database broker program divides each new database after table, establishes and is reflected according to the value that one group of data splits key Penetrate the index of a database table.For example, the database broker program has the feature that
1, with the connection of database using long connection, do not have to write-in database every time and all establish primary connection.
2, it when being connected to the request of write-in database, first searches index and finds the database table for needing to operate, protected with this It demonstrate,proves in data synchronization process, the region belonging to it is added according to dividing table rule in newly-increased data.
Fig. 2 schematically illustrates the schematic block diagram of the horizontal detachment device 200 of tables of data according to the present invention.
As shown in the solid box of Fig. 2, the horizontal detachment device 200 of tables of data according to the present invention includes:
Comparison module 201, for the various field combinations in tables of data all notes in corresponding tables of data The distribution situation of record is compared;
Selecting module 203, for choosing so that all records in tables of data are evenly distributed in or approximately uniformly divide Field combination of the cloth in N number of set is as fractionation field combination;
Module 205 is split, for tables of data automatic horizontal to be split as N number of split table based on fractionation field combination,
Wherein, N >=2 and be much smaller than the total number of records.
Optionally, as shown in the dotted line frame of Fig. 2, the horizontal detachment device 200 of tables of data further include:
Index module 207 is split tables of data automatic horizontal based on fractionation field combination for executing in fractionation module 205 It is that tables of data establishes index based on field combination is split before the step of for N number of split table.
Optionally, as shown in the dotted line frame of Fig. 2, the horizontal detachment device 200 of tables of data further include:
Memory module 209 is split tables of data automatic horizontal based on fractionation field combination for executing in fractionation module 205 After the step of for N number of split table, N number of split table is automatically stored in one or more databases.
Optionally, as shown in the dotted line frame of Fig. 2, the horizontal detachment device 200 of tables of data further include:
Synchronization module 211, for the incremental data of tables of data to be synchronized to N number of tear open according to the Binlog information of primary database Divide corresponding split table in table.
Optionally, as shown in the dotted line frame of Fig. 2, the horizontal detachment device 200 of tables of data further include:
Data interaction module 213, for managing the number between application layer and N number of split table using database broker program According to interactive operation.
In order to make those skilled in the art more clearly understand above-mentioned technical proposal according to the present invention, below in conjunction with one A specific example is illustrated.
Fig. 3 schematically illustrates an exemplary schematic diagram of horizontal method for splitting according to the present invention.
As shown in figure 3, the example may comprise steps of:
1, it is operated corresponding to " configuration " in Fig. 3:
According to (for example, user is customized or system developer define it is various) specification, write-in needs the database of point table Connection, table information, divide table index information, the connection of newly-increased database, new table distributed number in the database and name rule Then.
For example, configuration file can be used to realize in above-mentioned " configuration " operation, the information of the configuration file include divide table it The capacity of each sublist, the link information of new old database, new database can accommodate the quantity of sublist, split key, first group afterwards Split the value or value range (that is, as value or value range of initial query condition) of key.
2, stop the use of database (that is, " database " in Fig. 3) to be copied, stop the data with master library (not shown) It is synchronous that (" database where above-mentioned tables of data is not to be carrying out and master to the precondition executed corresponding to above-mentioned steps S112 The backup database of data simultaneously operating between database ").
3, the operation corresponding to " dividing list procedure " progress " reading ", " by Range-partition replicate data " in Fig. 3:
1) database is connected, data (corresponding to above-mentioned steps S108) is read according to index, (is corresponded to according to index range Above-mentioned steps S104 and S108) different regions is divided data into (corresponding to " the N number of collection referred in above-mentioned steps S104 Close ").
It obtains splitting key and its value for example, configuration file can be read;To split key as one group of initial query condition (that is, a group field and its value or value range).When the data inquired are greater than 0, restore all inquiry fields and with The last item data are all inquiry fields assignment again;Otherwise an inquiry field and its assignment are subtracted;When inquiry field Terminate when number is less than 1;It is more than circulation.Every a line of database is accessed with this.Also, the sublist provided according to configuration file Capacity, is sequentially arranged into sublist for every data line, thus obtains the beginning of a subregion and next subregion.It is recycled to data Library terminates.Having finally obtained the start-stop position of different subregion and each subregion, (these positions are to split one group of key to take Value).
2) SQL query statement (corresponding to above-mentioned steps S106) of data in each region is generated.
For example, can use above-mentioned steps 3-1) obtained in different subregion and each subregion start-stop position, splicing Generate SQL query (sentence) condition of replicate data: the x of 0 < x of position < position 1 is member's (record) of subregion 1.That is, each The start-stop position of subregion is exactly the value range of a group polling condition of this subregion, can use the start-stop position of each subregion Generate query statement.
3) data in each region are individually replicated and (corresponds to above-mentioned steps S106), and named.
For example, the SQL query condition according to obtained in above-mentioned steps 3-2), the data of database can be copied and, Duplication obtains a SQL file (example using the querying condition and MySQLdump tool of 0 < x of similar position < position 1 every time Such as, it can be named with above-mentioned " table name ").The data of each subregion independently separate at this time.Replicate data refers to replicating All the elements of one data, and step 3-2) in subregion work only have read data fractionation key that group content, There is no carry out actual copy.
4, the operation corresponding to " dividing list procedure " progress " write-in new database " in Fig. 3:
According to distribution of the new table in new database (that is, " new database " in Fig. 3), new table is created and by each region Data write-in (correspond to above-mentioned steps S110).
For example, son can be accommodated according to new database in the above-mentioned steps 3-3) partition data replicated and configuration file The quantity of table, the SQL file in new database using each subregion establishes new table, and (optionally, SQL file designation can also make The one group of fractionation key value originated with subregion.That is, will in step 3-3) from former table copy intermediate duplication data copy (that is, Import) into new database.
5, restore synchronous (precondition " the above-mentioned tables of data executed corresponding to above-mentioned steps S112 of data of original database The database at place is the backup database for the data simultaneously operating not being carrying out between primary database ").
6, start broker program (that is, " agency " in Fig. 3), number newly is increased original database according to database Binlog information According to being synchronized in corresponding new table (correspond to above-mentioned steps S112).
7, it is managed between application layer and database layer to divide table to establish database broker (that is, and " agency " in Fig. 3) Interaction (correspond to above-mentioned steps S114).
The example has the advantage that the automatic fractionation that SQL database may be implemented;The fractionation each time of table and split it The fractionation next time that can be potentially encountered afterwards will not have an impact mutually, i.e., it is independent for splitting each time all, will not shadow after fractionation Ring read-write and subsequent fractionation;The exemplary method for splitting is suitable for the horizontal of universal SQL database table and splits, that is, should Exemplary method for splitting has universal applicability;Whether table has carried out splitting Bright, moreover, broker program can ensure that in the fractionation for not stopping database use in the case where carry out table and divide table automatically Possibility.
Illustratively illustrate above-mentioned technology according to the present invention below in conjunction with sample data to be split table shown in table 1 How scheme selects the fractionation field combination finally used.
Table 1 includes the sample data table to be split of multiple fields
Student_id Teacher_id Class_id Class_type Score
10032020 101 001 Major 100
11033021 102 001 elective 60
10032020 103 003 elective 70
11033021 104 004 major 80
In this tables of data, it is to major in or take as an elective course that some student, which can select some course,.Each subject has different It majors in teacher and takes as an elective course teacher.Each teacher only teaches a subject.Index can be (Student_id, Class_id), (Student_id,Class_type).Because the curricula-variable of each student is uncertain, and there are two types of curriculum characters, so It can show that with (Student_id, Class_id), effect is better to split key by comparing.Then it can split into more A sublist: the distribution of each word table is (illustrate only initial value corresponding to each field in bracket): (10000000, 001), (10001000,010) ....
Here Student_id individual character section can be used also to split key, if it is considered that the big student of student number be it is newborn, Curricula-variable is few;Student number it is small be higher grade pupil, curricula-variable is more;In this case, then dividing table effect is not as good as multi-field Combinatorial resolution Key.
Above-mentioned technical proposal according to the present invention can be realized the automatic fractionation of tables of data.Reduce (including in database ) tables of data split time cost;Avoid the fault being likely to occur during multiple fractured operation and therefore increased volume Outer cost.
In addition, above-mentioned technical proposal according to the present invention, additionally it is possible to which the process for avoiding traditional data table from splitting is cumbersome and not The problems such as specification, so as to avoid generate mistake split, data record lose the problems such as the case where.
Descriptions above can combine implementation individually or in various ways, and these variants all exist Within protection scope of the present invention.
It will appreciated by the skilled person that whole or certain steps, system, dress in method disclosed hereinabove Functional module/unit in setting may be implemented as software, firmware, hardware and its combination appropriate.In hardware embodiment, Division between the functional module/unit referred in the above description not necessarily corresponds to the division of physical assemblies;For example, one Physical assemblies can have multiple functions or a function or step and can be executed by several physical assemblies cooperations.Certain groups Part or all components may be implemented as by processor, such as the software that digital signal processor or microprocessor execute, or by It is embodied as hardware, or is implemented as integrated circuit, such as specific integrated circuit.Such software can be distributed in computer-readable On medium, computer-readable medium may include computer storage medium (or non-transitory medium) and communication media (or temporarily Property medium).As known to a person of ordinary skill in the art, term computer storage medium is included in for storing information (such as Computer readable instructions, data structure, program module or other data) any method or technique in the volatibility implemented and non- Volatibility, removable and nonremovable medium.Computer storage medium include but is not limited to RAM, ROM, EEPROM, flash memory or its His memory technology, CD-ROM, digital versatile disc (DVD) or other optical disc storages, magnetic holder, tape, disk storage or other Magnetic memory apparatus or any other medium that can be used for storing desired information and can be accessed by a computer.This Outside, known to a person of ordinary skill in the art to be, communication media generally comprises computer readable instructions, data structure, program mould Other data in the modulated data signal of block or such as carrier wave or other transmission mechanisms etc, and may include any information Delivery media.
Finally, it should be noted that the above embodiments are merely illustrative of the technical solutions of the present invention, rather than its limitations.Although Present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that: it still may be used To modify the technical solutions described in the foregoing embodiments or equivalent replacement of some of the technical features; And these are modified or replaceed, the spirit of the technical solution for various embodiments of the present invention that it does not separate the essence of the corresponding technical solution And range.

Claims (10)

1. a kind of horizontal method for splitting of tables of data characterized by comprising
To the various field combinations in the tables of data all records in the corresponding tables of data distribution situation It is compared;
It chooses so that the word that all records in the tables of data are evenly distributed in or are approximately uniformly distributed in N number of set Duan Zuhe is as fractionation field combination;
The tables of data automatic horizontal is split as N number of split table based on the fractionation field combination,
Wherein, N >=2 and be much smaller than the total number of records.
2. the horizontal method for splitting of tables of data as described in claim 1, which is characterized in that be based on the fractionation field groups described Before the step of tables of data automatic horizontal is split as N number of split table by conjunction, further includes:
It is that the tables of data establishes index based on the fractionation field combination.
3. the horizontal method for splitting of tables of data as claimed in claim 1 or 2, which is characterized in that when in the tables of data include ID Critical field, the ID value of the ID critical field be all be randomly generated when, directly choose described in the ID critical field is used as Split field combination.
4. the horizontal method for splitting of tables of data as claimed in claim 1 or 2, which is characterized in that be based on the fractionation word described After the step of tables of data automatic horizontal is split as N number of split table by Duan Zuhe, further includes:
N number of split table is automatically stored in one or more databases.
5. the horizontal method for splitting of tables of data as claimed in claim 1 or 2, which is characterized in that the data where the tables of data Library is the backup database for the data simultaneously operating not being carrying out between primary database, described by N number of split table It is automatically stored to after the step in one or more databases, further includes:
The incremental data of the tables of data is synchronized to phase in N number of split table according to the Binlog information of the primary database The split table answered.
6. the horizontal method for splitting of tables of data as claimed in claim 1 or 2, which is characterized in that further include:
The data interaction operation between application layer and N number of split table is managed using database broker program.
7. a kind of horizontal detachment device of tables of data characterized by comprising
Comparison module, for the various field combinations in the tables of data all notes in the corresponding tables of data The distribution situation of record is compared;
Selecting module, for choosing so that all records in the tables of data are evenly distributed in or are approximately uniformly distributed in Field combination in N number of set is as fractionation field combination;
Module is split, for the tables of data automatic horizontal to be split as N number of split table based on the fractionation field combination,
Wherein, N >=2 and be much smaller than the total number of records.
8. the horizontal detachment device of tables of data as claimed in claim 7, which is characterized in that further include:
Index module is used to be based on the fractionation field combination for the tables of data automatic water described in fractionation module execution It is that the tables of data establishes index based on the fractionation field combination before flat the step of being split as N number of split table.
9. the horizontal detachment device of tables of data as claimed in claim 7 or 8, which is characterized in that further include:
Memory module is used to be based on the fractionation field combination for the tables of data automatic water described in fractionation module execution After flat the step of being split as N number of split table, N number of split table is automatically stored in one or more databases.
10. the horizontal detachment device of tables of data as claimed in claim 7 or 8, which is characterized in that further include:
Synchronization module, it is described for being synchronized to the incremental data of the tables of data according to the Binlog information of the primary database Corresponding split table in N number of split table.
CN201810391193.6A 2018-04-27 2018-04-27 A kind of horizontal method for splitting of tables of data and device Pending CN110413606A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810391193.6A CN110413606A (en) 2018-04-27 2018-04-27 A kind of horizontal method for splitting of tables of data and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810391193.6A CN110413606A (en) 2018-04-27 2018-04-27 A kind of horizontal method for splitting of tables of data and device

Publications (1)

Publication Number Publication Date
CN110413606A true CN110413606A (en) 2019-11-05

Family

ID=68345873

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810391193.6A Pending CN110413606A (en) 2018-04-27 2018-04-27 A kind of horizontal method for splitting of tables of data and device

Country Status (1)

Country Link
CN (1) CN110413606A (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2001025962A1 (en) * 1999-10-05 2001-04-12 S.C. Medicarom Group S.R.L. Database organization for increasing performance by splitting tables
JP2002109448A (en) * 2000-09-28 2002-04-12 Toshiba Corp Business form processing device, business form processing method and storage medium
CN102395962A (en) * 2009-03-11 2012-03-28 甲骨文国际公司 Composite hash and list partitioning of database tables
CN102999526A (en) * 2011-09-16 2013-03-27 阿里巴巴集团控股有限公司 Splitting and inquiring method and system of database relational table
CN105512200A (en) * 2015-11-26 2016-04-20 华为技术有限公司 Distributed database processing method and device

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2001025962A1 (en) * 1999-10-05 2001-04-12 S.C. Medicarom Group S.R.L. Database organization for increasing performance by splitting tables
JP2002109448A (en) * 2000-09-28 2002-04-12 Toshiba Corp Business form processing device, business form processing method and storage medium
CN102395962A (en) * 2009-03-11 2012-03-28 甲骨文国际公司 Composite hash and list partitioning of database tables
CN102999526A (en) * 2011-09-16 2013-03-27 阿里巴巴集团控股有限公司 Splitting and inquiring method and system of database relational table
CN105512200A (en) * 2015-11-26 2016-04-20 华为技术有限公司 Distributed database processing method and device

Similar Documents

Publication Publication Date Title
CA3121919C (en) System and method for augmenting database applications with blockchain technology
US7930271B2 (en) Method and apparatus for data processing
US9372882B2 (en) Partitioning online databases
US8572022B2 (en) Automatic synchronization conflict resolution
US8756196B2 (en) Propagating tables while preserving cyclic foreign key relationships
US9418094B2 (en) Method and apparatus for performing multi-stage table updates
CN109891402A (en) The conversion of revocable and on-line mode
US20070162506A1 (en) Method and system for performing a redistribute transparently in a multi-node system
US20090157762A1 (en) Dynamic Data Reorganization to Accommodate Growth Across Replicated Databases
CN101268439A (en) Database fragment cloning and management
CN103577546B (en) A kind of method of data backup, equipment and distributed cluster file system
US20140059026A1 (en) Test data generation and scale up for database testing using unique common factor sequencing
JP2009522677A (en) Method, system, and device for file system dump / restore by node numbering
US20240061712A1 (en) Method, apparatus, and system for creating training task on ai training platform, and medium
CN103905512B (en) A kind of data processing method and equipment
US11151157B2 (en) Database management method
US20130006920A1 (en) Record operation mode setting
JP2004318288A (en) Method and device for processing data and its processing program
CN113760902A (en) Data splitting method, device, equipment, medium and program product
JP2011522337A (en) Method of synchronizing software modules of computer system distributed to server cluster, application to synchronization system and data storage
US7318168B2 (en) Bit map write logging with write order preservation in support asynchronous update of secondary storage
CN110413606A (en) A kind of horizontal method for splitting of tables of data and device
CN111061759A (en) Data query method and device
US20190065327A1 (en) Efficient versioned object management
CN114153857A (en) Data synchronization method, data synchronization apparatus, and computer-readable storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20191105