CN117971966A - Data partitioning method, system, equipment and medium of Doris - Google Patents
Data partitioning method, system, equipment and medium of Doris Download PDFInfo
- Publication number
- CN117971966A CN117971966A CN202311853305.2A CN202311853305A CN117971966A CN 117971966 A CN117971966 A CN 117971966A CN 202311853305 A CN202311853305 A CN 202311853305A CN 117971966 A CN117971966 A CN 117971966A
- Authority
- CN
- China
- Prior art keywords
- partition
- condition
- time
- data
- doris
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000638 solvent extraction Methods 0.000 title claims abstract description 48
- 238000000034 method Methods 0.000 title claims abstract description 47
- 238000005192 partition Methods 0.000 claims abstract description 342
- 230000001960 triggered effect Effects 0.000 claims abstract description 10
- 238000004590 computer program Methods 0.000 claims description 19
- 230000002123 temporal effect Effects 0.000 claims description 18
- 230000008569 process Effects 0.000 abstract description 4
- 238000012423 maintenance Methods 0.000 description 11
- 238000010586 diagram Methods 0.000 description 7
- 230000007547 defect Effects 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 238000012545 processing Methods 0.000 description 4
- 238000013459 approach Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
Landscapes
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The invention discloses a data partitioning method, a system, equipment and a medium of Doris, wherein the method is applied to a system architecture formed by a partition management automation system and a Doris database; comprising the following steps: the partition management automation system creates a first data table, wherein the first data table is based on non-time partition conditions; filling enumerated values for the first data table; configuring a combined partition key formed by a time partition condition and a non-time partition condition as a combined partition condition, and creating a partition timing task; based on the partition timing task, associating the combined partition condition and the partition target table, and automatically forming a partition template relation; obtaining a partition creation rule according to the partition template relationship; the time condition is triggered regularly, and a partition creation instruction is generated; the partition management automation system sends a partition creation instruction to the Doris database for execution. The present invention automates the data partition creation process of a combined partition key based on time units and non-time units.
Description
Technical Field
The invention relates to a data partition management technology in the field of computers- > big data- > data warehouse- > Apache Doris, in particular to a data partition method, system, equipment and medium of Doris.
Background
Doris is a high-performance real-time analytical database in which the data level of each data table is divided into multiple data slices (tables) in a storage engine, each data slice contains multiple rows of data records, and the data slices are stored physically independently without data intersections. All tables of a data table are logically assigned to different partitions (partitions), one to each Partition, and one to each Partition having multiple tables. Because the tablelet is physically stored, partition can also be considered physically independent.
There are two ways of data partitioning built in Doris: the first is a manual partition mode, wherein the manual partition mode is to manually create partitions in advance according to a certain partition rule, and the partition mode may cause data writing failure due to forgetting to create the partitions in advance, so that the manual maintenance cost is high. The second is a dynamic partitioning method, in some scenarios, a time unit (such as hours, days, weeks, months, etc.) is used as a unique partitioning condition of the data table partition, when a dynamic partitioning rule can be specified when the table is created, and Doris starts a thread in the background to create the partition in advance or delete the partition according to the rule specified by the user. Dynamic partitioning can only be used in a scenario where time units are the only conditions for partitioning, if time units and other conditions are the partitioning conditions, then a manual partitioning approach is still used.
Thus, (1) manual partitioning method: before data is written into a data table, a partition is manually established in advance; the defects are as follows: the partition needs to be created in advance, otherwise, the data writing failure may be caused by forgetting to create the partition, and the manual maintenance cost is high. (2) dynamic partitioning method: before the data is written into the data table, the background thread has created a partition in advance; the defects are as follows: the suitable partition condition is only a scene of time unit, if the partition condition is a combination of the time unit and other partition conditions, the partition still needs to be manually created in advance, and the manual maintenance cost is still high.
Disclosure of Invention
The technical problem to be solved by the invention is that the manual partition method needs to be created in advance, otherwise, the data writing failure can be caused by forgetting to create the partition, and the manual maintenance cost is high. While the proper partitioning condition of the dynamic partitioning method is only a scene of time units, if the partitioning condition is a combination of the time units and other partitioning conditions, the partitioning still needs to be manually created in advance, and the manual maintenance cost is still high.
The invention aims to provide a data partitioning method, a system, equipment and a medium of Doris, which can only adopt a manual partitioning mode in certain scenes when a time condition and other non-time condition are required to be combined to partition. In order to avoid the situation that the data writing into the data table fails due to forgetting to create the partition in advance, the invention improves the manual creating mode of the partition taking time and non-time conditions as combined partition conditions into an automatic creating mode, maintains the partition creating rule into an external system, and requests the Doris database to create the partition in an internal mode, thereby eliminating the manual maintenance cost of the manual partition.
The invention is realized by the following technical scheme:
In a first aspect, the present invention provides a method for partitioning data of Doris, the method comprising:
The method is applied to a system architecture formed by a partition management automation system and a Doris database; the method comprises the following steps:
the partition management automation system creates a first data table, wherein the first data table is based on non-time partition conditions; filling enumerated values for the first data table;
the partition management automation system configures a combined partition key formed by a time partition condition and a non-time partition condition as a combined partition condition, and creates a partition timing task; based on the partition timing task, associating the combined partition condition with a partition target table (i.e. a user access record table), and automatically forming a partition template relation;
the partition management automation system obtains partition creation rules according to the partition template relationship; the time condition is triggered regularly, and a partition creation instruction is generated; the partition management automation system sends a partition creation instruction to the Doris database;
the Doris database creates data partitions in temporal and non-temporal conditions according to partition creation instructions.
Further, non-temporal partition conditions refer to a non-temporal set that can be enumerated and is limited;
time zone conditions refer to time zone conditions formed in time units including seconds, minutes, hours, days, months, weeks, and/or years.
Further, the first data table is represented as a first table name (first number, first name, enumerated value).
Further, configuring a combined partition key formed by a time partition condition and a non-time partition condition as a combined partition condition, and creating a partition timing task; based on the partition timing tasks, associating a combined partition condition with a partition target table (i.e., a user access record table), automatically forming a partition template relationship, including:
configuring a combined partition key formed by a time partition condition and a non-time partition condition as a combined partition condition, and storing the combined partition condition and corresponding data into a second data table; the representation of the second data table is a second table name (second number, time partition condition, first name);
Creating a partition timing task, and storing the partition timing task and corresponding data record into a partition timing task table; the partition timing task table is expressed as a third table name (third number, third name, partition timing rule), and the partition timing rule table refers to the time executed under the partition condition;
According to the combined partition conditions and the partition timing tasks, automatically forming partition template relations among the combined partition conditions, the partition timing tasks and the user access record table; storing the partition template relationship and corresponding data into a partition template relationship table; the partition template relationship table is expressed as a fourth table name (fourth number, third number, second number, execution table name), and the execution table name refers to a table name of a specific execution partition creation instruction, that is, a user access record table.
Further, the partition management automation system obtains partition creation rules according to the partition template relationship; the time condition is triggered regularly, and a partition creation instruction is generated; the partition management automation system sends a partition creation instruction to the Doris database, including:
all records in the partition template relation table are loaded into a memory, and partition creation rules are formed in the memory;
forming a partition creation instruction according to the trigger time of the loaded data record and when the trigger time condition is met, replacing a non-time partition condition in the partition creation instruction with a different value, and generating a partition creation instruction based on the next time condition of the user access record table;
The partition management automation system sends a partition creation instruction to the Doris database.
Further, the partition creation rule refers to that the user performs the partition creation command based on the time condition and the non-time condition under the expression of a certain partition timing task on the access record table.
In a second aspect, the present invention further provides a Doris data partitioning system, where the system uses a Doris data partitioning method as described above; the system comprises:
A partition management automation system for creating a first data table, the first data table being a data table based on non-time partition conditions; filling enumerated values for the first data table; and configuring a combined partition key formed by the time partition condition and the non-time partition condition as a combined partition condition, and creating a partition timing task; based on the partition timing task, associating the combined partition condition with a partition target table (i.e. a user access record table), and automatically forming a partition template relation; obtaining a partition creation rule according to the partition template relationship; the time condition is triggered regularly, and a partition creation instruction is generated; the partition management automation system sends a partition creation instruction to the Doris database;
and the Doris database is used for creating the data partition under the time condition and the non-time condition according to the partition creation instruction.
Further, non-temporal partition conditions refer to a non-temporal set that can be enumerated and is limited;
time zone conditions refer to time zone conditions formed in time units including seconds, minutes, hours, days, months, weeks, and/or years.
In a third aspect, the present invention further provides a computer device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, where the processor implements a data partitioning method of Doris as described above when the computer program is executed.
In a fourth aspect, the present invention further provides a computer readable storage medium, where a computer program is stored, where the computer program when executed by a processor implements a data partitioning method of Doris as described above.
Compared with the prior art, the invention has the following advantages and beneficial effects:
The invention relates to a data partitioning method, a system, equipment and a medium of Doris, which improves a partition taking time and non-time conditions as combined partition conditions into an automatic creating mode from a manual creating mode, maintains a partition creating rule into an external system, and requests a Doris database to create the partition in an internal mode, thereby avoiding errors that data cannot be written due to forgetting to create the partition in advance in a scene of manually creating the partition, and further eliminating the manual maintenance cost of the manual partition.
Drawings
The accompanying drawings, which are included to provide a further understanding of embodiments of the application and are incorporated in and constitute a part of this specification, illustrate embodiments of the application and together with the description serve to explain the principles of the application. In the drawings:
FIG. 1 is a flow chart of a method for partitioning data in Doris according to the present invention;
FIG. 2 is a block diagram illustrating a data partitioning system in accordance with the present invention.
Detailed Description
For the purpose of making apparent the objects, technical solutions and advantages of the present invention, the present invention will be further described in detail with reference to the following examples and the accompanying drawings, wherein the exemplary embodiments of the present invention and the descriptions thereof are for illustrating the present invention only and are not to be construed as limiting the present invention.
There are two ways of data partitioning built in Doris: (1) manual partitioning method: before data is written into a data table, a partition is manually established in advance; the defects are as follows: the partition needs to be created in advance, otherwise, the data writing failure may be caused by forgetting to create the partition, and the manual maintenance cost is high. (2) dynamic partitioning method: before the data is written into the data table, the background thread has created a partition in advance; the defects are as follows: the suitable partition condition is only a scene of time unit, if the partition condition is a combination of the time unit and other partition conditions, the partition still needs to be manually created in advance, and the manual maintenance cost is still high.
Based on the above problems, the invention designs a data partitioning method and system of Doris, and the difference between the invention and the prior art is that: the invention improves the manual creating mode of the partition taking the time and non-time conditions as the combined partition conditions into the automatic creating mode, maintains the partition creating rule into an external system, and requests the Doris database to create the partition in the internal system, thereby eliminating the manual maintenance cost of the manual partition.
Example 1
As shown in fig. 1, the present embodiment assumes that a user access record table uv (user_id, visist _date, city, …) is provided, and it is desired to store data written in the data table in sections by "day" and "city". The invention relates to a data partitioning method of Doris, which comprises the following steps:
The method is applied to a system architecture formed by a partition management automation system and a Doris database; the method comprises the following steps:
step 1, a partition management automation system creates a user access record table and a first data table, wherein the user access record table is used for storing user access records, and the first data table is based on non-time partition conditions; filling enumerated values for the first data table; the representation of the first data table is a first table name (first number, first name, enumerated value).
In particular, non-temporal partition conditions refer to a non-temporal set that can be enumerated and is limited; time zone conditions refer to time zone conditions formed in time units including seconds, minutes, hours, days, months, weeks, and/or years.
In this embodiment, the user access record table is a uv table, the first data table is a unit (id, name, value), and a plurality of enumeration values are added to the unit table. For example, (1 unit, "city", "beijing"), (2, "city", "shanghai") (3,
“city”,“guangzhou”)。
Step2, the partition management automation system configures a combined partition key formed by a time partition condition and a non-time partition condition as a combined partition condition, and creates a partition timing task; based on the partition timing task, associating the combined partition condition with a partition target table (i.e. a user access record table), and automatically forming a partition template relation;
the step 2 specifically comprises the following steps:
Step 21, configuring a combined partition key formed by the time partition condition and the non-time partition condition as a combined partition condition, and storing the combined partition condition and corresponding data into a second data table; the representation of the second data table is a second table name (second number, time partition condition, first name); in this embodiment, the second data table is a key (id, timeUnit, unit). For example, a combined partition key based on time unit "day" and city "is configured: (1 key, "day", "city").
Step 22, creating a partition timing task, and storing the partition timing task and corresponding data record into a partition timing task table; the partition timing task table is expressed as a third table name (third number, third name, partition timing rule), and the partition timing rule table refers to the time executed under the partition condition;
In this embodiment, for example, a partition timing task table is created as rule (id, ruleName, cron), and a record (1 rule, "test", "0.20.0.
Specifically, "0 20 0? * "corresponds to [ seconds ] [ minutes ] [ time ] [ day ] [ month ] [ week ] [ year ], wherein" × "represents any value,"? "means no specified value.
Step 23, according to the combined partition condition and the partition timing task, automatically forming a partition template relation among the combined partition condition, the partition timing task and the user access record table; storing the partition template relationship and corresponding data into a partition template relationship table; the partition template relationship table is expressed as a fourth table name (fourth number, third number, second number, execution table name), and the execution table name refers to a table name of a specific execution partition creation instruction, that is, a user access record table.
In this embodiment, a partition template relationship table is created, and the relationships of partition keys, user access record tables, and partition rules are recorded in the partition template relationship table. For example, the partition template relationship table is template (id, ruleId, keyId, tableName), and a record (1 template,1rule, "day", "city", "uv") is inserted into the partition template relationship table.
Step 3, the partition management automation system obtains a partition creation rule according to the partition template relationship; the time condition is triggered regularly, and a partition creation instruction is generated; the partition management automation system sends a partition creation instruction to the Doris database;
the step 3 specifically comprises the following steps:
Step 31, loading all records in the partition template relation table into a memory, and forming a partition creation rule in the memory; partition creation rules refer to the execution of partition creation commands based on temporal and non-temporal conditions under the expression of a certain partition timing task on a user access record table.
In this embodiment, the partition management automation system loads all records in the data table of step 23. For example, (1 template,1rule, "day", "city", "uv") is loaded into memory in the form of (1 template, "0 20 0?
*”,”day”,“city”,”uv”)；
Step 32, forming a partition creation instruction according to the trigger time of the loaded data record, and when the trigger time condition is met, replacing the non-time partition condition in the partition creation instruction with different values to generate a partition creation instruction based on the next time condition of the user access record table;
In this embodiment, the partition management automation system triggers the partition creation instruction according to the trigger time of the loaded data record, and the non-time unit condition in the instruction is replaced by a different value. For example, (1 template, "0.0 x.," day "," city "," uv ") triggered at 2023-01-01:20, then a partition creation instruction based on the next natural day of the uv table is generated:
“ALTER TABLE uv ADD PARTITION dc_20230101_beijing VALUES IN((“2023-01-02”，“beijing”))”,
“ALTER TABLE uv ADD PARTITION dc_20230101_shanghai VALUES IN((“2023-01-02”，“shanghai”))”,
“ALTER TABLE uv ADD PARTITION dc_20230101_guangzhou VALUES IN
((“2023-01-02”，“guangzhou”))”
Etc., wherein the "city" field is replaced with its full value, respectively.
At step 33, the partition management automation system sends a partition creation instruction to the Doris database.
And 4, the doris database creates the data partition under the time condition and the non-time condition according to the partition creation instruction.
According to the method, the data partition creation process based on the combined partition key of the time unit and the non-time unit is automated, so that the automatic partition creation is realized under the scene of taking the time unit and the non-time unit as the combined partition key, the partition is created according to the timing request Doris database in the external system, the error that the data cannot be written due to forgetting to create the partition in advance under the scene of manually creating the partition is avoided, and the manual maintenance cost of the manual partition is eliminated.
Example 2
As shown in fig. 2, the present embodiment is different from embodiment 1 in that the present embodiment provides a data partitioning system of Doris, which uses a data partitioning method of Doris of embodiment 1; the system comprises:
The partition management automation system is used for creating a user access record table and a first data table, wherein the user access record table is used for storing user access records, and the first data table is based on non-time partition conditions; filling enumerated values for the first data table; and configuring a combined partition key formed by the time partition condition and the non-time partition condition as a combined partition condition, and creating a partition timing task; based on the partition timing task, associating the combined partition condition with a partition target table (i.e. a user access record table), and automatically forming a partition template relation; obtaining a partition creation rule according to the partition template relationship; the time condition is triggered regularly, and a partition creation instruction is generated; the partition management automation system sends a partition creation instruction to the Doris database;
and the Doris database is used for creating the data partition under the time condition and the non-time condition according to the partition creation instruction.
In particular, non-temporal partition conditions refer to a non-temporal set that can be enumerated and is limited;
time zone conditions refer to time zone conditions formed in time units including seconds, minutes, hours, days, months, weeks, and/or years.
The execution process of each unit is performed according to the steps of the data partitioning method of Doris in embodiment 1, which is not described in detail.
The invention also provides a computer device, which comprises a memory, a processor and a computer program stored in the memory and capable of running on the processor, wherein the processor realizes the data partitioning method of the Doris when executing the computer program.
Meanwhile, the invention also provides a computer readable storage medium, wherein the computer readable storage medium stores a computer program, and the computer program is executed by a processor to realize the data partitioning method of Doris.
It will be appreciated by those skilled in the art that embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
The foregoing description of the embodiments has been provided for the purpose of illustrating the general principles of the invention, and is not meant to limit the scope of the invention, but to limit the invention to the particular embodiments, and any modifications, equivalents, improvements, etc. that fall within the spirit and principles of the invention are intended to be included within the scope of the invention.
Claims (10)
1. A data partitioning method of Doris, which is characterized in that the method is applied to a system architecture formed by a partition management automation system and a Doris database; the method comprises the following steps:
the partition management automation system creates a first data table, wherein the first data table is a data table based on non-time partition conditions; filling enumerated values for the first data table;
Configuring a combined partition key formed by a time partition condition and a non-time partition condition as a combined partition condition, and creating a partition timing task; based on the partition timing task, associating a combined partition condition and a partition target table, and automatically forming a partition template relation;
obtaining a partition creation rule according to the partition template relationship; the time condition is triggered regularly, and a partition creation instruction is generated; the partition management automation system sends the partition creation instruction to a Doris database;
The Doris database creates a data partition in a temporal condition and a non-temporal condition according to the partition creation instruction.
2. A method of partitioning data in Doris according to claim 1, wherein said non-temporal partitioning condition refers to a non-temporal set that is enumerated and limited;
The time division condition refers to a time division condition formed in time units including seconds, minutes, hours, days, months, weeks, and/or years.
3. The method of claim 1, wherein the first data table is represented by a first table name (first number, first name, enumerated value).
4. A data partitioning method according to claim 3, wherein a combined partition key formed with a time partition condition and a non-time partition condition is configured as a combined partition condition, and a partition timing task is created; based on the partition timing task, associating a combined partition condition with a partition target table, automatically forming a partition template relationship, comprising:
Configuring a combined partition key formed by a time partition condition and a non-time partition condition as a combined partition condition, and storing the combined partition condition and corresponding data into a second data table; the representation of the second data table is a second table name (second number, time partition condition, first name);
Creating a partition timing task, and storing the partition timing task and a corresponding data record into a partition timing task table; the partition timing task table is expressed as a third table name (third number, third name, partition timing rule), and the partition timing rule table refers to the execution time under the partition condition;
According to the combined partition conditions and the partition timing tasks, automatically forming partition template relations among the combined partition conditions, the partition timing tasks and a user access record table; storing the partition template relationship and corresponding data into a partition template relationship table; the partition template relation table is expressed as a fourth table name (fourth number, third number, second number, execution table name), and the execution table name refers to a table name of a specific execution partition creation instruction, namely, a user access record table.
5. The method for partitioning data in Doris according to claim 4, wherein partition creation rules are obtained according to the partition template relationship; the time condition is triggered regularly, and a partition creation instruction is generated; the partition management automation system sends the partition creation instruction to the Doris database, including:
loading all records in the partition template relation table into a memory, and forming a partition creation rule in the memory;
Forming a partition creating instruction according to the trigger time of the loaded data record and when the trigger time condition is met, replacing a non-time partition condition in the partition creating instruction with a different value, and generating a partition creating instruction based on the next time condition of a user access record table;
The partition management automation system sends the partition creation instruction to the Doris database.
6. The method of claim 5, wherein the partition creation rule refers to a user accessing an expression of a task on a record table at a certain partition timing, and executing the partition creation command based on a time condition and a non-time condition.
7. A Doris's data partitioning system, comprising:
A partition management automation system for creating a first data table, the first data table being a data table based on non-time partition conditions; filling enumerated values for the first data table; and configuring a combined partition key formed by the time partition condition and the non-time partition condition as a combined partition condition, and creating a partition timing task; based on the partition timing task association combination partition conditions and a partition target table, automatically forming a partition template relationship; obtaining a partition creation rule according to the partition template relationship; the time condition is triggered regularly, and a partition creation instruction is generated; the partition management automation system sends the partition creation instruction to a Doris database;
And the Doris database is used for creating the data partition under the time condition and the non-time condition according to the partition creation instruction.
8. The Doris's data partitioning system of claim 7, wherein said non-temporal partitioning condition refers to a non-temporal set that is enumerated and limited;
The time division condition refers to a time division condition formed in time units including seconds, minutes, hours, days, months, weeks, and/or years.
9. A computer device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, characterized in that the processor implements a Doris data partitioning method according to any one of claims 1 to 6 when executing the computer program.
10. A computer readable storage medium storing a computer program, wherein the computer program when executed by a processor implements a Doris's data partitioning method according to any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311853305.2A CN117971966A (en) | 2023-12-28 | 2023-12-28 | Data partitioning method, system, equipment and medium of Doris |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311853305.2A CN117971966A (en) | 2023-12-28 | 2023-12-28 | Data partitioning method, system, equipment and medium of Doris |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN117971966A true CN117971966A (en) | 2024-05-03 |
Family
ID=90845089
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311853305.2A Pending CN117971966A (en) | 2023-12-28 | 2023-12-28 | Data partitioning method, system, equipment and medium of Doris |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117971966A (en) |
-
2023
- 2023-12-28 CN CN202311853305.2A patent/CN117971966A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11314701B2 (en) | Resharding method and system for a distributed storage system | |
| CN110532247B (en) | Data migration method and data migration system | |
| US10585876B2 (en) | Providing snapshot isolation to a database management system | |
| US7818297B2 (en) | System and method for refreshing a table using epochs | |
| CN104462169B (en) | Import data to the method and system in database table | |
| US20130318129A1 (en) | Systems and methods for asynchronous schema changes | |
| US8768973B2 (en) | Apparatus and method for expanding a shared-nothing system | |
| US20130254240A1 (en) | Method of processing database, database processing apparatus, computer program product | |
| US20140258221A1 (en) | Increasing distributed database capacity | |
| CN107665219B (en) | Log management method and device | |
| US6951013B1 (en) | Method for facilitating development and testing of relational database application software | |
| CN110489092B (en) | Method for solving read data delay problem under database read-write separation architecture | |
| CN107016016A (en) | A kind of method and device of data processing | |
| CN105426373A (en) | Database synchronization method and device | |
| CN104881418A (en) | Method and device for quickly reclaiming rollback space in MySQL | |
| CN109241193B (en) | Distributed database processing method and device, and server cluster | |
| CN106780157B (en) | Ceph-based power grid multi-temporal model storage and management system and method | |
| US7269589B2 (en) | Database managing method and system having data backup function and associated programs | |
| CN111352936A (en) | Method and storage medium for ES index reconstruction | |
| US8452730B2 (en) | Archiving method and system | |
| CN115858252B (en) | Data recovery method, device and storage medium | |
| CN107122254B (en) | Computer repair control method and system and repair method and system | |
| CN117971966A (en) | Data partitioning method, system, equipment and medium of Doris | |
| KR20120082176A (en) | Data processing method of database management system and system thereof | |
| US20100049714A1 (en) | Fast search replication synchronization processes |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |