CN111813772B - Data processing method and device - Google Patents
Data processing method and device Download PDFInfo
- Publication number
- CN111813772B CN111813772B CN201910294334.7A CN201910294334A CN111813772B CN 111813772 B CN111813772 B CN 111813772B CN 201910294334 A CN201910294334 A CN 201910294334A CN 111813772 B CN111813772 B CN 111813772B
- Authority
- CN
- China
- Prior art keywords
- index information
- processed
- new
- routing
- service data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 39
- 238000000034 method Methods 0.000 claims abstract description 19
- 238000012545 processing Methods 0.000 claims description 68
- 238000010276 construction Methods 0.000 claims description 3
- 238000010586 diagram Methods 0.000 description 7
- 230000008569 process Effects 0.000 description 6
- 230000005012 migration Effects 0.000 description 3
- 238000013508 migration Methods 0.000 description 3
- 238000004891 communication Methods 0.000 description 2
- 238000004590 computer program Methods 0.000 description 2
- 230000001413 cellular effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 239000004984 smart glass Substances 0.000 description 1
- 238000011144 upstream manufacturing Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2228—Indexing structures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/23—Updating
- G06F16/2308—Concurrency control
- G06F16/2315—Optimistic concurrency control
- G06F16/2322—Optimistic concurrency control using timestamps
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/28—Databases characterised by their database models, e.g. relational or object models
- G06F16/284—Relational databases
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Software Systems (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The present specification provides a data processing method and apparatus, wherein the data processing method stores a routing table in advance, the routing table including a routing rule pointing to a preset database, and index information corresponding to the routing rule, the method comprising: acquiring service data to be processed; determining index information corresponding to the service data to be processed, wherein the index information is generated in advance or generated in real time; determining a corresponding routing rule in the routing table based on the index information; and writing the service data to be processed into a corresponding preset database according to the routing rule.
Description
Technical Field
The present disclosure relates to the field of computer technologies, and in particular, to a data processing method. The present description is directed at a data processing apparatus, a computing device, and a computer-readable storage medium.
Background
In the prior art, the horizontal expansion of the database refers to splitting an original single database according to a certain rule, and dispersing data to a plurality of physical machines for distributed storage, so that the limitation of a single machine is broken through, and the system can cope with the continuously-rising mass data in a mode of increasing machines. The distributed database must involve the routing problem of data due to the decentralized storage of data, so that the mapping relationship of data also changes due to the change of the number of machines when the distributed database horizontally expands, so that part or all of the data needs to be redeployed, and the migration of the data can affect the service of an upper layer, or the realization of the expansion of the database becomes complex under the condition that the service of the upper layer is not perceived.
Disclosure of Invention
In view of the foregoing, the embodiments of the present disclosure provide a data processing method, and also relate to a data processing apparatus, a computing device, and a computer readable storage medium, so as to solve the technical drawbacks of the prior art.
According to a first aspect of embodiments of the present specification, there is provided a data processing method in which a routing table including routing rules pointing to a preset database and index information corresponding to the routing rules is stored in advance, the method comprising:
Acquiring service data to be processed;
Determining index information corresponding to the service data to be processed, wherein the index information is generated in advance or generated in real time;
Determining a corresponding routing rule in the routing table based on the index information;
And writing the service data to be processed into a corresponding preset database according to the routing rule.
Optionally, the acquiring service data to be processed includes:
and acquiring the service data to be processed at the preset data processing time.
Optionally, the index information is generated in advance, and determining index information corresponding to the service data to be processed includes:
And determining index information corresponding to the preset data processing time based on the preset data processing time, wherein the index information is generated according to a set index information generation rule according to time information corresponding to the preset data processing time.
Optionally, the index information is generated in real time, and determining index information corresponding to the service data to be processed includes:
And generating index information of the current service data to be processed based on the preset data processing time and the set index information generation rule.
Optionally, the set index information generation rule is as follows:
Determining the index information generation time, the data statistics reference value and the data statistics unit;
and determining the difference value of the index information generation time and the data statistics reference value, and calculating the ratio of the difference value of the index information generation time and the data statistics unit as the index information.
Optionally, the routing rules pointing to the preset database included in the pre-stored routing table are determined by the following steps:
Determining a preset database for storing the service data to be processed according to the storage space occupied by the service data to be processed, and determining index information of the service data to be processed;
and constructing an association relation between the index information and the preset database as a routing rule which is included in the routing table and points to the preset database.
Optionally, after the step of writing the service data to be processed into the corresponding preset database according to the routing rule is performed, the method further includes:
acquiring available storage space of a preset database corresponding to each routing rule in the routing table, and predicting occupied storage space of service data to be processed in a set time period;
and under the condition that the occupied storage space of the service data to be processed in the set time period is larger than the available storage space of the preset database, acquiring a new database, and generating a new routing rule corresponding to the new database and new index information corresponding to the new routing rule.
Optionally, after the step of writing the service data to be processed into the corresponding preset database according to the routing rule is performed, the method further includes:
acquiring available storage space of a preset database corresponding to each routing rule in the routing table, and comparing the available storage space of the preset database with a preset space threshold;
And under the condition that the available storage space of the preset database is smaller than the preset space threshold value, acquiring a new database, and generating a new routing rule corresponding to the new database and new index information corresponding to the new routing rule.
Optionally, the data processing method further includes:
Updating the routing rule to the new routing rule, updating the index information to the new index information, and updating the routing table to a new routing table;
correspondingly, the updating content of the new routing table comprises the following steps:
a new routing rule pointing to a new database, and new index information corresponding to the new routing rule.
Optionally, the routing table includes the routing rule pointing to the preset database, and further includes:
And adding an effective time stamp for the routing rule, wherein the effective time stamp is used for marking the effective time of the routing rule.
According to a second aspect of embodiments of the present specification, there is provided a data processing apparatus in which a routing table including routing rules pointing to a preset database and index information corresponding to the routing rules is stored in advance, the apparatus comprising:
The acquisition module is configured to acquire service data to be processed;
The index information determining module is configured to determine index information corresponding to the service data to be processed, wherein the index information is generated in advance or generated in real time;
a routing rule determining module configured to determine a corresponding routing rule in the routing table based on the index information;
and the writing module is configured to write the service data to be processed into a corresponding preset database according to the routing rule.
Optionally, the acquisition module is further configured to:
and acquiring the service data to be processed at the preset data processing time.
Optionally, the index information is generated in advance, and determining index information corresponding to the service data to be processed includes:
And determining index information corresponding to the preset data processing time based on the preset data processing time, wherein the index information is generated according to a set index information generation rule according to time information corresponding to the preset data processing time.
Optionally, the index information is generated in real time, and determining index information corresponding to the service data to be processed includes:
And generating index information of the current service data to be processed based on the preset data processing time and the set index information generation rule.
Optionally, the set index information generation rule is as follows:
a first determination unit configured to determine the index information generation timing, the data statistics reference value, and the data statistics unit;
And a calculating unit configured to determine a difference between the index information generation time and the data statistics reference value, and calculate a ratio of the difference to the data statistics unit as the index information.
Optionally, the routing rules pointing to the preset database included in the pre-stored routing table are determined by the following steps:
The second determining unit is configured to determine a preset database for storing the service data to be processed according to the storage space occupied by the service data to be processed, and determine index information of the service data to be processed;
And the construction unit is configured to construct the association relation between the index information and the preset database as a routing rule which is included in the routing table and points to the preset database.
Optionally, the writing module includes:
The first acquisition unit is configured to acquire the available storage space of a preset database corresponding to each routing rule in the routing table and predict the occupied storage space of the service data to be processed in a set time period;
the first generation unit is configured to acquire a new database and generate a new routing rule corresponding to the new database and new index information corresponding to the new routing rule under the condition that the occupied storage space of service data to be processed is larger than the available storage space of the preset database in a set time period.
Optionally, the writing module includes:
the second acquisition unit is configured to acquire the available storage space of a preset database corresponding to each routing rule in the routing table, and compare the available storage space of the preset database with a preset space threshold;
And the second generation unit is configured to acquire a new database and generate a new routing rule corresponding to the new database and new index information corresponding to the new routing rule under the condition that the available storage space of the preset database is smaller than the preset space threshold.
Optionally, the data processing apparatus further includes:
An updating module configured to update the routing rule to the new routing rule, the index information to the new index information, and the routing table to a new routing table;
correspondingly, the updating content of the new routing table comprises the following steps:
a new routing rule pointing to a new database, and new index information corresponding to the new routing rule.
Optionally, the routing table includes the routing rule pointing to the preset database, and further includes:
And adding an effective time stamp for the routing rule, wherein the effective time stamp is used for marking the effective time of the routing rule.
According to a third aspect of embodiments of the present specification, there is provided an electronic device comprising:
A memory and a processor;
the memory is for storing computer-executable instructions, and the processor is for executing the computer-executable instructions:
Acquiring service data to be processed;
Determining index information corresponding to the service data to be processed, wherein the index information is generated in advance or generated in real time;
Determining a corresponding routing rule in the routing table based on the index information;
And writing the service data to be processed into a corresponding preset database according to the routing rule.
According to a fourth aspect of embodiments of the present specification, there is provided a computer readable storage medium storing computer executable instructions which, when executed by a processor, implement the steps of any one of the data processing methods.
Compared with the prior art, the specification has the following advantages:
The present specification provides a data processing method, including: acquiring service data to be processed; determining index information corresponding to the service data to be processed, wherein the index information is generated in advance or generated in real time; determining a corresponding routing rule in the routing table based on the index information; and writing the service data to be processed into a corresponding preset database according to the routing rule.
According to the data processing method provided by the specification, the routing table is stored in advance, the routing rule pointing to the preset database and the index information corresponding to the routing rule are stored in the routing table, when the service data to be processed is obtained, the index information of the service data to be processed can be determined according to the index information recorded in the routing table, so that one index information can correspond to all data of the service to be processed, the space of the routing table occupied by each index information corresponding to one service data in the routing table is reduced, after the index information is determined according to the corresponding relation between the index information and the routing rule recorded in the routing table, the preset database can be written according to the corresponding routing rule, and the service data to be processed is stored under the condition that other systems carrying the service data to be processed are not affected, so that the solution of horizontally expanding the database without data migration is realized.
Drawings
FIG. 1 is a flow chart of a data processing method according to an embodiment of the present disclosure;
FIG. 2 is a flow chart illustrating a process of a data processing method according to an embodiment of the present disclosure;
FIG. 3 is a schematic diagram illustrating a data processing method according to an embodiment of the present disclosure;
FIG. 4 is a schematic diagram of a data processing apparatus according to an embodiment of the present disclosure;
fig. 5 is a block diagram of an electronic device according to an embodiment of the present disclosure.
Detailed Description
In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present description. This description may be embodied in many other forms than described herein and similarly generalized by those skilled in the art to whom this disclosure pertains without departing from the spirit of the disclosure and, therefore, this disclosure is not limited by the specific implementations disclosed below.
The terminology used in the one or more embodiments of the specification is for the purpose of describing particular embodiments only and is not intended to be limiting of the one or more embodiments of the specification. As used in this specification, one or more embodiments and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and/or" as used in one or more embodiments of the present specification refers to and encompasses any or all possible combinations of one or more of the associated listed items.
It should be understood that, although the terms first, second, etc. may be used in one or more embodiments of this specification to describe various information, these information should not be limited by these terms. These terms are only used to distinguish one type of information from another. For example, a first may also be referred to as a second, and similarly, a second may also be referred to as a first, without departing from the scope of one or more embodiments of the present description. The word "if" as used herein may be interpreted as "at … …" or "at … …" or "in response to a determination" depending on the context.
In the present application, a data processing method is provided, and a data processing apparatus, a computing device, and a computer-readable storage medium are described in detail one by one in the following embodiments.
Fig. 1 shows a flowchart of a data processing method according to an embodiment of the present specification, in which a routing table including routing rules pointing to a preset database and index information corresponding to the routing rules is stored in advance, the method including steps 102 to 108.
Step 102: and acquiring service data to be processed.
Specifically, after obtaining the service data to be processed, the service data to be processed needs to be stored in a preset database, so as to improve the efficiency of storing the service data to be processed and ensure that the service data to be processed cannot be influenced by the difference of an upstream system and a downstream system generating the service data to be processed in the process of writing the service data to be processed into the database.
And acquiring the service data to be processed at the preset data processing time.
Specifically, the preset data processing time may be set according to an actual application, and the specification is not limited in any way, where the service data to be processed may include all data in the service to be processed.
Step 104: and determining index information corresponding to the service data to be processed, wherein the index information is generated in advance or in real time.
Specifically, according to the obtained service data to be processed, determining index information corresponding to the service data to be processed through a prestored routing table, wherein the index information comprises index information generated in advance and index information generated in real time.
Further, in one or more implementations of this embodiment, the determining, based on the index information being generated in advance, the index information corresponding to the service data to be processed includes:
And determining index information corresponding to the preset data processing time based on the preset data processing time, wherein the index information is generated according to a set index information generation rule according to time information corresponding to the preset data processing time.
Specifically, in order to determine a preset database capable of storing the service data to be processed when the service data to be processed is acquired, index information corresponding to the service data to be processed may be determined at a preset data processing time.
On the basis that the index information is generated in real time, further, in one or more implementations of the embodiment, determining the index information corresponding to the service data to be processed includes:
And generating index information of the current service data to be processed based on the preset data processing time and the set index information generation rule.
Specifically, when the real-time acquired service data to be processed is inconsistent with the predicted service data to be processed, the index information of the real-time acquired service data to be processed may be generated according to the acquiring time of the real-time acquired service data to be processed and the index information generating rule.
On the basis of determining the index information of the service data to be processed, further, in one or more implementations of this embodiment, the set index information generation rule is as follows:
Determining the index information generation time, the data statistics reference value and the data statistics unit;
and determining the difference value of the index information generation time and the data statistics reference value, and calculating the ratio of the difference value of the index information generation time and the data statistics unit as the index information.
Specifically, the preset data processing time may be a time when the service data is written into the database, the data statistics reference value may be a preset start time of use of the database, and the setting of the data statistics unit may be set according to an actual situation, which may be one hour, one day, one week, or the like, and the specification is not limited in any way.
Based on this, the set index information generation rule may be implemented according to formula (1), formula (1) being as follows:
(CURRENT_TIME-START_TIME)/DATE＝ID (1)
Wherein current_time represents a preset data processing TIME, start_time represents a data statistics reference value, DATE represents a data statistics unit, and ID represents index information.
In practical application, the description is made on determining index information corresponding to the service data to be processed by taking a day as a unit of a data statistics unit, wherein a data statistics reference value is 20181001, a preset data processing time is 20181002, a data statistics unit is 1, and the index information corresponding to the service data to be processed is determined to be 1 according to a formula (1).
Alternatively, the index information may be generated by a primary key ID generator, and the index information generation rule may be a rule set in the primary key ID generator.
By determining index information for the service data to be processed with the same attribute, all data of one index information corresponding to the preset data processing time can be realized, and the occupied space of each index information corresponding to one service data is reduced.
Step 106: and determining a corresponding routing rule in the routing table based on the index information.
Specifically, according to the index information of the service data to be processed, a routing rule corresponding to the index information is determined by querying a routing table, the routing rule records a preset database corresponding to the service data to be processed, and the routing rule can be generated by a routing information generator.
In practical application, taking the example that the storage space of the preset database does not reach the upper storage limit, describing the corresponding routing rule in the routing table determined based on the index information, wherein the data statistics unit takes a day as a unit, and acquiring the index information corresponding to the service data to be processed for three days in the future includes: the first index information is 1, the second index information is 2, the third index information is 3, and the pre-generated routing rule comprises: a first routing rule route1, a second routing rule route2, and a third routing rule route3; the query routing table determines that index information 1 corresponds to a first routing rule route1, index information 2 corresponds to a second routing rule route2, and index information 3 corresponds to a third routing rule route3.
The routing table records the corresponding relation between the index information and the routing rule, and the routing table is shown in table 1:
TABLE 1
| Index information | route |
| 1 | Route1 (first routing rule) |
| 2 | Route2 (second routing rule) |
| 3 | Route3 (third routing rule) |
The first routing rule route1, the second routing rule route2 and the third routing rule route3 record association relations between the index information and a preset database storing the service data to be processed.
After the service data to be processed is obtained, the index information of the service data to be processed is determined according to the corresponding relation between the index information recorded in the table 1 and the routing rules, and the service data to be processed is written into a preset database according to the routing rules corresponding to the index information.
Further, in one or more implementations of the present embodiment, the routing rules pointing to the preset database are included in the pre-stored routing table, and specific implementation manners of the routing rules are as follows:
Determining a preset database for storing the service data to be processed according to the storage space occupied by the service data to be processed, and determining index information of the service data to be processed;
and constructing an association relation between the index information and the preset database as a routing rule which is included in the routing table and points to the preset database.
Specifically, the storage space occupied by the service data to be processed is estimated, a preset database capable of storing the service data to be processed is determined, index information of the service data to be processed is generated according to the index information generation rule, the association relation between the index information and the preset database is constructed, the association relation between the index information and the preset database is determined as a routing rule, and the routing rule is written into a routing table.
In addition, under the condition that the estimated service data to be processed cannot be stored in the original preset database in a set time period, according to the storage space occupied by the service data to be processed estimated recently, an information database is determined to store the service data to be processed, new index information is determined, the association relation between the new index information and the new database is constructed, the association relation between the new index information and the new database is determined to be a routing rule of the service data to be processed, and a prestored routing table is updated.
In practical application, taking pre-generated routing rules as an example, describing a routing rule generation process, wherein the storage space occupied by the service data to be processed is 8G, the available storage available space of a preset database is 10G, index information corresponding to the received service data to be processed is ID1, the service data to be processed can be stored in the preset database, the association relation between the ID1 and the preset database is established, the ID1 corresponding to the preset database is determined, the association relation between the ID1 and the preset database is determined as the routing rule of the service data to be processed, the routing rule is route, and when the service data to be processed is obtained, the service data to be processed is written into the corresponding preset database according to route.
In one or more implementations of this embodiment, the routing table includes the routing rule pointing to the preset database, and further includes:
And adding an effective time stamp for the routing rule, wherein the effective time stamp is used for marking the effective time of the routing rule.
The effective time stamp is used for marking the effective time of the routing rule, in practical application, according to the index information of the service data to be processed and the database for storing the service data to be processed, the association relation between the database and the index information is constructed to determine the routing rule corresponding to the service data to be processed, the specific effective time is not defined by the routing rule, the effective time is determined for the routing rule through the effective time stamp, the preset routing rule can be effectively ensured to be effective at the set time, and the subsequent writing operation is carried out on the service data to be processed. The specific effective time may be effective at the time of completing the database arrangement, or effective at the time of acquiring the service data to be processed, and the specific time may be set according to the service requirement in practical application, which is not limited in this specification.
By adding the effective time stamp to the preset routing rule and the routing rule, the preset database capable of storing the service data to be processed can be determined when the service data to be processed is acquired, and the service data to be processed can be stored quickly.
Step 108: and writing the service data to be processed into a corresponding preset database according to the routing rule.
Specifically, according to the above-mentioned index information of the service data to be processed, and the routing rule of the service data to be processed is determined by querying the routing table through the index information, the service data to be processed can be written into the preset database according to the routing rule.
Further, in one or more implementations of the present embodiment, after the service data to be processed is written into the database, it is estimated whether the future service data to be processed can be stored into the preset database, where the implementation manner is as follows:
acquiring available storage space of a preset database corresponding to each routing rule in the routing table, and predicting occupied storage space of service data to be processed in a set time period;
and under the condition that the occupied storage space of the service data to be processed in the set time period is larger than the available storage space of the preset database, acquiring a new database, and generating a new routing rule corresponding to the new database and new index information corresponding to the new routing rule.
Specifically, the available storage space of a preset database corresponding to each routing rule in the routing table is obtained, the occupied storage space of the service data to be processed in a time period is predicted, whether the available storage space of the preset data can accommodate the service data to be processed or not is judged, when the available storage space of the preset database stores the service data to be processed, a new database is added, a new routing rule corresponding to the new database and new index information corresponding to the new routing rule are generated, when the moment of obtaining the service data to be processed is reached, the new index information of the service data to be processed and the new routing rule corresponding to the new index information are determined, and the service data to be processed is written into the new database.
In addition, after the service data to be processed is written into the database, another implementation manner of estimating whether the future service data to be processed can be stored into the preset database is estimated, and further, in one or more implementations of this embodiment, another implementation manner is as follows:
acquiring available storage space of a preset database corresponding to each routing rule in the routing table, and comparing the available storage space of the preset database with a preset space threshold;
And under the condition that the available storage space of the preset database is smaller than the preset space threshold value, acquiring a new database, and generating a new routing rule corresponding to the new database and new index information corresponding to the new routing rule.
Specifically, the available storage space of the preset database corresponding to each routing rule in the routing table is obtained, the available storage space of the preset database is compared with a preset space threshold, under the condition that the available storage space of the preset database is smaller than the preset space threshold, even if the previously obtained service data to be processed can be stored in the preset database, the occupied storage space of the subsequently obtained service data to be processed can be larger than the available storage space of the preset database, in order to avoid the situation, the preset space storage threshold is set for the preset database, normal operation of other systems is not affected when the service data to be processed is written into the database, and under the condition that the available storage space of the preset database is smaller than the preset space threshold, a new database is obtained, a new routing rule corresponding to the new database and new index information corresponding to the new routing rule are generated, and the service data to be processed is written into the new database.
Further, in one or more implementations of this embodiment, update contents are as follows, on the basis of acquiring a new database, generating new index information, and a new routing rule:
Updating the routing rule to the new routing rule, updating the index information to the new index information, and updating the routing table to a new routing table;
correspondingly, the updating content of the new routing table comprises the following steps:
a new routing rule pointing to a new database, and new index information corresponding to the new routing rule.
Specifically, when a new database is acquired, new index information and a new routing rule are generated, the routing table needs to be updated, the index information and the routing rule which are unchanged in the routing table are kept unchanged, the changed index information is updated to be the new index information, and the routing rule is updated to be the new routing rule.
Based on this, the updated content in the routing table is a new routing rule pointing to a new database, and new index information corresponding to the new routing rule.
Still taking the above routing table (table 1) as an example, describing the update of the routing table, referring to table 1, it can be seen that the index information includes a first index information of 1, a second index information of 2, and a third index information of 3, and the routing rule generated in advance includes: a first routing rule route1, a second routing rule route2, and a third routing rule route3; the query routing table determines that index information 1 corresponds to a first routing rule route1, index information 2 corresponds to a second routing rule route2, and index information 3 corresponds to a third routing rule route3.
Under the condition that the occupied storage space of the service data to be processed corresponding to the index information 3 is larger than the preset database in the set time period, updating the index information 3 and the routing rule corresponding to the index information 3, wherein the updated routing table is shown in the table 2:
TABLE 2
| Index information | route |
| 1 | Route1 (first routing rule) |
| 2 | Route2 (second routing rule) |
| 3+ | Route3+ (third+ routing rule) |
The service data to be processed corresponds to index information 3+, and the index information 3+ is used for inquiring the table 2, so that the corresponding routing rule is route3+, and the routing rule route3+ points to the new preset database.
According to the data processing method provided by the specification, the routing table is stored in advance, the routing rule pointing to the preset database and the index information corresponding to the routing rule are stored in the routing table, when the service data to be processed is acquired, the index information of the service data to be processed can be determined according to the index information recorded in the routing table, so that one index information can correspond to all data of the service data to be processed, the space of the routing table occupied by each index information corresponding to one service data in the routing table is reduced, after the index information is determined according to the corresponding relation between the index information and the routing rule recorded in the routing table, the acquired service data to be processed can be written into the preset database according to the corresponding routing rule, and meanwhile, the effective time stamp can be set for the routing rule.
The application of the data processing method provided in the present specification to storing online purchase order data is taken as an example, and the data processing method is further described below with reference to fig. 2 and fig. 3. Fig. 2 is a flowchart of a data processing method provided in the present specification, and fig. 3 is a schematic structural diagram of the data processing method in the present specification. The specific steps of the flowchart of the data processing method include steps 202 to 216.
Step 202: and acquiring five pieces of online purchase order service data at preset data processing time.
Specifically, the online shopping order service data generated in the online shopping platform is received at a preset data processing time 20190410.
Step 204: and determining index information ID5 of the five pieces of online purchase order service data.
Specifically, before the online purchase order service data is acquired, corresponding index information and a routing rule pointing to a preset database are generated in advance by predicting the occupied storage space of the online purchase order service data.
Referring to fig. 3, before five pieces of online shopping order service data are acquired, index information ID4 is generated for the predicted five pieces of online shopping order service data by a primary key ID generator, and written into a routing table, a database storing the online shopping order service data is created, and an association relationship between the index information ID4 and the database is constructed as a routing rule route5 of the online shopping order service data. The specific steps are as follows:
step 302: index information ID4 is generated for the online purchase order service data by the primary key ID generator.
Step 304: and generating a routing rule route5 for the online purchase order service data through a routing information generator.
Step 306: index information ID4 and routing rule route5 are written into the routing table.
Step 308: and when the online purchase order service data is acquired, the routing table is inquired through the routing analyzer.
Step 310: and determining a routing rule corresponding to the index information ID4 in the routing table as a routing rule route5.
Step 312: and writing the online shopping order business data into a database according to the routing rule route 5.
Specifically, the writing process of the service data can be referred to as steps 302 to 312.
Step 206: and inquiring a routing table through index information ID5 corresponding to the five online purchase order service data to determine a corresponding routing rule route5.
Specifically, the corresponding relation between the index information ID5 and the routing rule route5 is recorded in the routing table.
Step 208: and writing the five online shopping order business data into a preset database according to the routing rule route5.
Step 210: the online purchase order service data after predicting the five online purchase order service data occupies a storage space.
Step 212: judging whether the storage space occupied by the online purchase order service data is larger than the available storage space of preset data or not; if not, go to step 214; if yes, go to step 216.
Step 214: and writing the online purchase order service data into a preset database according to the routing rule in the routing table.
Step 216: a new database is acquired, and a new routing rule route6 corresponding to the new database and new index information ID6 corresponding to the new routing rule are generated.
According to the data processing method provided by the specification, the online purchase order service data are recorded in the preset database according to the preset routing rule, the storage process of the online purchase order service data can be completed only through one writing operation, when the available storage space of the preset database is insufficient when other online purchase order service data after five online purchase order service data are obtained, a new database is obtained, and a new routing rule and new index information corresponding to the new database are generated, so that smooth expansion of the database is realized under the condition that online service is not perceived.
Corresponding to the above method embodiments, the present disclosure further provides an embodiment of a data processing apparatus, and fig. 4 shows a schematic structural diagram of the data processing apparatus according to an embodiment of the present disclosure. As shown in fig. 4, the apparatus includes:
an acquisition module 402 configured to acquire service data to be processed;
A determining index information module 404 configured to determine index information corresponding to the service data to be processed, the index information being generated in advance or generated in real time;
A determine routing rule module 406 configured to determine a corresponding routing rule in the routing table based on the index information;
the writing module 408 is configured to write the service data to be processed into a corresponding preset database according to the routing rule.
In an alternative embodiment, the acquisition module 402 is further configured to:
and acquiring the service data to be processed at the preset data processing time.
In an optional embodiment, the determining, for the index information generated in advance, index information corresponding to the service data to be processed includes:
And determining index information corresponding to the preset data processing time based on the preset data processing time, wherein the index information is generated according to a set index information generation rule according to time information corresponding to the preset data processing time.
In an optional embodiment, the index information is generated in real time, and determining index information corresponding to the service data to be processed includes:
And generating index information of the current service data to be processed based on the preset data processing time and the set index information generation rule.
In an alternative embodiment, the set index information generation rule is as follows:
a first determination unit configured to determine the index information generation timing, the data statistics reference value, and the data statistics unit;
And a calculating unit configured to determine a difference between the index information generation time and the data statistics reference value, and calculate a ratio of the difference to the data statistics unit as the index information.
In an alternative embodiment, the routing rules included in the pre-stored routing table and pointing to the preset database are determined by the following steps:
The second determining unit is configured to determine a preset database for storing the service data to be processed according to the storage space occupied by the service data to be processed, and determine index information of the service data to be processed;
And the construction unit is configured to construct the association relation between the index information and the preset database as a routing rule which is included in the routing table and points to the preset database.
In an alternative embodiment, the writing module 408 includes:
The first acquisition unit is configured to acquire the available storage space of a preset database corresponding to each routing rule in the routing table and predict the occupied storage space of the service data to be processed in a set time period;
the first generation unit is configured to acquire a new database and generate a new routing rule corresponding to the new database and new index information corresponding to the new routing rule under the condition that the occupied storage space of service data to be processed is larger than the available storage space of the preset database in a set time period.
In an alternative embodiment, the writing module 408 includes:
the second acquisition unit is configured to acquire the available storage space of a preset database corresponding to each routing rule in the routing table, and compare the available storage space of the preset database with a preset space threshold;
And the second generation unit is configured to acquire a new database and generate a new routing rule corresponding to the new database and new index information corresponding to the new routing rule under the condition that the available storage space of the preset database is smaller than the preset space threshold.
In an alternative embodiment, the data processing apparatus includes:
An updating module configured to update the routing rule to the new routing rule, the index information to the new index information, and the routing table to a new routing table;
correspondingly, the updating content of the new routing table comprises the following steps:
a new routing rule pointing to a new database, and new index information corresponding to the new routing rule.
In an alternative embodiment, the routing table includes the routing rule pointing to the preset database, and further includes:
And adding an effective time stamp for the routing rule, wherein the effective time stamp is used for marking the effective time of the routing rule.
According to the data processing device provided by the specification, the routing table is stored in advance, the routing rule pointing to the preset database and the index information corresponding to the routing rule are stored in the routing table, when the service data to be processed is obtained, the index information of the service data to be processed can be determined according to the index information recorded in the routing table, so that one index information can correspond to all data of the service to be processed, the space of the routing table occupied by each index information corresponding to one service data in the routing table is reduced, after the index information is determined according to the corresponding relation between the index information and the routing rule recorded in the routing table, the obtained service data to be processed can be written into the preset database according to the corresponding routing rule, and the service data to be processed is stored under the condition that other systems carrying the service data to be processed are not affected to normally run, and the solution that the data base can be horizontally expanded without data migration is realized.
The above is a schematic solution of a data processing apparatus of the present embodiment. It should be noted that, the technical solution of the data processing apparatus and the technical solution of the data processing method belong to the same conception, and details of the technical solution of the data processing apparatus, which are not described in detail, can be referred to the description of the technical solution of the data processing method.
Fig. 5 shows a block diagram of an electronic device 500 according to an embodiment of the present description. The components of the electronic device 500 include, but are not limited to, a memory 510 and a processor 520. Processor 520 is coupled to memory 510 via bus 530 and database 550 is used to hold data.
The electronic device 500 also includes an access device 540, the access device 540 enabling the electronic device 500 to communicate via one or more networks 560. Examples of such networks include the Public Switched Telephone Network (PSTN), a Local Area Network (LAN), a Wide Area Network (WAN), a Personal Area Network (PAN), or a combination of communication networks such as the internet. The access device 540 may include one or more of any type of network interface, wired or wireless (e.g., a Network Interface Card (NIC)), such as an IEEE802.11 Wireless Local Area Network (WLAN) wireless interface, a worldwide interoperability for microwave access (Wi-MAX) interface, an ethernet interface, a Universal Serial Bus (USB) interface, a cellular network interface, a bluetooth interface, a Near Field Communication (NFC) interface, and so forth.
In one embodiment of the present description, the above-described and other components of the electronic device 500 not shown in fig. 5 may also be connected to each other, for example, by a bus. It should be understood that the block diagram of the electronic device shown in fig. 5 is for exemplary purposes only and is not intended to limit the scope of the present description. Those skilled in the art may add or replace other components as desired.
Electronic device 500 may be any type of stationary or mobile electronic device including a mobile computer or mobile electronic device (e.g., tablet, personal digital assistant, laptop, notebook, netbook, etc.), mobile telephone (e.g., smart phone), wearable electronic device (e.g., smart watch, smart glasses, etc.), or other type of mobile device, or a stationary electronic device such as a desktop computer or PC. The electronic device 500 may also be a mobile or stationary server.
Wherein the processor 520 is configured to execute the following computer-executable instructions:
Acquiring service data to be processed;
Determining index information corresponding to the service data to be processed, wherein the index information is generated in advance or generated in real time;
Determining a corresponding routing rule in the routing table based on the index information;
And writing the service data to be processed into a corresponding preset database according to the routing rule.
Optionally, the acquiring service data to be processed includes:
and acquiring the service data to be processed at the preset data processing time.
Optionally, the index information is generated in advance, and determining index information corresponding to the service data to be processed includes:
And determining index information corresponding to the preset data processing time based on the preset data processing time, wherein the index information is generated according to a set index information generation rule according to time information corresponding to the preset data processing time.
Optionally, the index information is generated in real time, and determining index information corresponding to the service data to be processed includes:
And generating index information of the current service data to be processed based on the preset data processing time and the set index information generation rule.
Optionally, the set index information generation rule is as follows:
Determining the index information generation time, the data statistics reference value and the data statistics unit;
and determining the difference value of the index information generation time and the data statistics reference value, and calculating the ratio of the difference value of the index information generation time and the data statistics unit as the index information.
Optionally, the routing rules pointing to the preset database included in the pre-stored routing table are determined by the following steps:
Determining a preset database for storing the service data to be processed according to the storage space occupied by the service data to be processed, and determining index information of the service data to be processed;
and constructing an association relation between the index information and the preset database as a routing rule which is included in the routing table and points to the preset database.
Optionally, after the step of writing the service data to be processed into the corresponding preset database according to the routing rule is performed, the method further includes:
acquiring available storage space of a preset database corresponding to each routing rule in the routing table, and predicting occupied storage space of service data to be processed in a set time period;
and under the condition that the occupied storage space of the service data to be processed in the set time period is larger than the available storage space of the preset database, acquiring a new database, and generating a new routing rule corresponding to the new database and new index information corresponding to the new routing rule.
Optionally, after the step of writing the service data to be processed into the corresponding preset database according to the routing rule is performed, the method further includes:
acquiring available storage space of a preset database corresponding to each routing rule in the routing table, and comparing the available storage space of the preset database with a preset space threshold;
And under the condition that the available storage space of the preset database is smaller than the preset space threshold value, acquiring a new database, and generating a new routing rule corresponding to the new database and new index information corresponding to the new routing rule.
Optionally, the data processing method further includes:
Updating the routing rule to the new routing rule, updating the index information to the new index information, and updating the routing table to a new routing table;
correspondingly, the updating content of the new routing table comprises the following steps:
a new routing rule pointing to a new database, and new index information corresponding to the new routing rule.
Optionally, the routing table includes the routing rule pointing to the preset database, and further includes:
And adding an effective time stamp for the routing rule, wherein the effective time stamp is used for marking the effective time of the routing rule.
The above is a schematic solution of an electronic device of the present embodiment. It should be noted that, the technical solution of the electronic device and the technical solution of the data processing method belong to the same concept, and details of the technical solution of the electronic device, which are not described in detail, can be referred to the description of the technical solution of the data processing method.
An embodiment of the present specification also provides a computer-readable storage medium storing computer instructions that, when executed by a processor, implement the steps of a data processing method as described above.
The above is an exemplary version of a computer-readable storage medium of the present embodiment. It should be noted that, the technical solution of the storage medium and the technical solution of the data processing method belong to the same concept, and details of the technical solution of the storage medium which are not described in detail can be referred to the description of the technical solution of the data processing method.
The foregoing describes specific embodiments of the present disclosure. Other embodiments are within the scope of the following claims. In some cases, the actions or steps recited in the claims can be performed in a different order than in the embodiments and still achieve desirable results. In addition, the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.
The computer instructions include computer program code that may be in source code form, object code form, executable file or some intermediate form, etc. The computer readable medium may include: any entity or device capable of carrying the computer program code, a recording medium, a U disk, a removable hard disk, a magnetic disk, an optical disk, a computer Memory, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), an electrical carrier signal, a telecommunications signal, a software distribution medium, and so forth. It should be noted that the computer readable medium contains content that can be appropriately scaled according to the requirements of jurisdictions in which such content is subject to legislation and patent practice, such as in certain jurisdictions in which such content is subject to legislation and patent practice, the computer readable medium does not include electrical carrier signals and telecommunication signals.
It should be noted that, for the sake of simplicity of description, the foregoing method embodiments are all expressed as a series of combinations of actions, but it should be understood by those skilled in the art that the present description is not limited by the order of actions described, as some steps may be performed in other order or simultaneously in accordance with the present description. Further, those skilled in the art will appreciate that the embodiments described in the specification are all preferred embodiments, and that the acts and modules referred to are not necessarily all necessary in the specification.
In the foregoing embodiments, the descriptions of the embodiments are emphasized, and for parts of one embodiment that are not described in detail, reference may be made to the related descriptions of other embodiments.
The preferred embodiments of the present specification disclosed above are merely used to help clarify the present specification. Alternative embodiments are not intended to be exhaustive or to limit the invention to the precise form disclosed. Obviously, many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles of the disclosure and the practical application, to thereby enable others skilled in the art to best understand and utilize the disclosure. This specification is to be limited only by the claims and the full scope and equivalents thereof.
Claims (16)
1. A data processing method characterized in that a routing table including a routing rule directed to a preset database and index information corresponding to the routing rule is stored in advance, the method comprising:
acquiring service data to be processed at a preset data processing moment;
Determining index information corresponding to the service data to be processed, wherein the index information is generated in advance or generated in real time;
Determining a corresponding routing rule in the routing table based on the index information;
Writing the service data to be processed into a corresponding preset database according to the routing rule;
And determining index information corresponding to the service data to be processed under the condition that the index information is pre-generated, wherein the method comprises the following steps: determining index information corresponding to the preset data processing time based on the preset data processing time, wherein the index information is generated according to a set index information generation rule according to time information corresponding to the preset data processing time;
Wherein the set index information generation rule includes: determining index information generation time, a data statistics reference value and a data statistics unit; and determining a difference value between the index information generation time and the data statistics reference value, and calculating the ratio of the difference value between the index information generation time and the data statistics reference value to the data statistics unit as the index information, wherein the data statistics reference value is the starting time of the use of a preset database, and the data statistics unit is a time unit.
2. The data processing method according to claim 1, wherein the index information is generated in real time, and determining the index information corresponding to the service data to be processed includes:
And generating index information of the current service data to be processed based on the preset data processing time and the set index information generation rule.
3. The data processing method according to claim 1, wherein the routing rules included in the pre-stored routing table and directed to a pre-set database are determined by:
Determining a preset database for storing the service data to be processed according to the storage space occupied by the service data to be processed, and determining index information of the service data to be processed;
and constructing an association relation between the index information and the preset database as a routing rule which is included in the routing table and points to the preset database.
4. The data processing method according to claim 1, wherein after the step of writing the service data to be processed into the corresponding preset database according to the routing rule is performed, further comprising:
acquiring available storage space of a preset database corresponding to each routing rule in the routing table, and predicting occupied storage space of service data to be processed in a set time period;
and under the condition that the occupied storage space of the service data to be processed in the set time period is larger than the available storage space of the preset database, acquiring a new database, and generating a new routing rule corresponding to the new database and new index information corresponding to the new routing rule.
5. The data processing method according to claim 1, wherein after the step of writing the service data to be processed into the corresponding preset database according to the routing rule is performed, further comprising:
acquiring available storage space of a preset database corresponding to each routing rule in the routing table, and comparing the available storage space of the preset database with a preset space threshold;
And under the condition that the available storage space of the preset database is smaller than the preset space threshold value, acquiring a new database, and generating a new routing rule corresponding to the new database and new index information corresponding to the new routing rule.
6. The data processing method according to claim 4 or 5, characterized by further comprising:
Updating the routing rule to the new routing rule, updating the index information to the new index information, and updating the routing table to a new routing table;
correspondingly, the updating content of the new routing table comprises the following steps:
a new routing rule pointing to a new database, and new index information corresponding to the new routing rule.
7. The data processing method according to claim 1, wherein the routing table includes the routing rule pointing to the preset database, further comprising:
And adding an effective time stamp for the routing rule, wherein the effective time stamp is used for marking the effective time of the routing rule.
8. A data processing apparatus in which a routing table including routing rules directed to a preset database and index information corresponding to the routing rules is stored in advance, the apparatus comprising:
The acquisition module is configured to acquire service data to be processed at a preset data processing time;
The index information determining module is configured to determine index information corresponding to the service data to be processed, wherein the index information is generated in advance or generated in real time;
a routing rule determining module configured to determine a corresponding routing rule in the routing table based on the index information;
The writing module is configured to write the service data to be processed into a corresponding preset database according to the routing rule;
And determining index information corresponding to the service data to be processed under the condition that the index information is pre-generated, wherein the method comprises the following steps: determining index information corresponding to the preset data processing time based on the preset data processing time, wherein the index information is generated according to a set index information generation rule according to time information corresponding to the preset data processing time;
Wherein the set index information generation rule includes: determining index information generation time, a data statistics reference value and a data statistics unit; and determining a difference value between the index information generation time and the data statistics reference value, and calculating the ratio of the difference value between the index information generation time and the data statistics reference value to the data statistics unit as the index information, wherein the data statistics reference value is the starting time of the use of a preset database, and the data statistics unit is a time unit.
9. The data processing apparatus according to claim 8, wherein the index information is generated in real time, and determining the index information corresponding to the service data to be processed includes:
And generating index information of the current service data to be processed based on the preset data processing time and the set index information generation rule.
10. The data processing apparatus according to claim 8, wherein the routing rules included in the pre-stored routing table and directed to a pre-set database are determined by:
The second determining unit is configured to determine a preset database for storing the service data to be processed according to the storage space occupied by the service data to be processed, and determine index information of the service data to be processed;
And the construction unit is configured to construct the association relation between the index information and the preset database as a routing rule which is included in the routing table and points to the preset database.
11. The data processing apparatus of claim 8, wherein the write module comprises:
The first acquisition unit is configured to acquire the available storage space of a preset database corresponding to each routing rule in the routing table and predict the occupied storage space of the service data to be processed in a set time period;
the first generation unit is configured to acquire a new database and generate a new routing rule corresponding to the new database and new index information corresponding to the new routing rule under the condition that the occupied storage space of service data to be processed is larger than the available storage space of the preset database in a set time period.
12. The data processing apparatus of claim 8, wherein the write module comprises:
the second acquisition unit is configured to acquire the available storage space of a preset database corresponding to each routing rule in the routing table, and compare the available storage space of the preset database with a preset space threshold;
And the second generation unit is configured to acquire a new database and generate a new routing rule corresponding to the new database and new index information corresponding to the new routing rule under the condition that the available storage space of the preset database is smaller than the preset space threshold.
13. The data processing apparatus according to claim 11 or 12, further comprising:
An updating module configured to update the routing rule to the new routing rule, the index information to the new index information, and the routing table to a new routing table;
correspondingly, the updating content of the new routing table comprises the following steps:
a new routing rule pointing to a new database, and new index information corresponding to the new routing rule.
14. The data processing apparatus according to claim 8, wherein the routing table includes the routing rule pointing to the preset database, further comprising:
And adding an effective time stamp for the routing rule, wherein the effective time stamp is used for marking the effective time of the routing rule.
15. An electronic device, comprising:
A memory and a processor;
the memory is used for storing computer executable instructions, the memory is pre-stored with a routing table, the routing table comprises routing rules pointing to a preset database and index information corresponding to the routing rules, and the processor is used for executing the computer executable instructions:
acquiring service data to be processed at a preset data processing moment;
Determining index information corresponding to the service data to be processed, wherein the index information is generated in advance or generated in real time;
Determining a corresponding routing rule in the routing table based on the index information;
Writing the service data to be processed into a corresponding preset database according to the routing rule;
And determining index information corresponding to the service data to be processed under the condition that the index information is pre-generated, wherein the method comprises the following steps: determining index information corresponding to the preset data processing time based on the preset data processing time, wherein the index information is generated according to a set index information generation rule according to time information corresponding to the preset data processing time;
Wherein the set index information generation rule includes: determining index information generation time, a data statistics reference value and a data statistics unit; and determining a difference value between the index information generation time and the data statistics reference value, and calculating the ratio of the difference value between the index information generation time and the data statistics reference value to the data statistics unit as the index information, wherein the data statistics reference value is the starting time of the use of a preset database, and the data statistics unit is a time unit.
16. A computer-readable storage medium storing computer instructions which, when executed by a processor, implement the steps of the data processing method of any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910294334.7A CN111813772B (en) | 2019-04-12 | 2019-04-12 | Data processing method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910294334.7A CN111813772B (en) | 2019-04-12 | 2019-04-12 | Data processing method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111813772A CN111813772A (en) | 2020-10-23 |
| CN111813772B true CN111813772B (en) | 2024-05-07 |
Family
ID=72843909
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910294334.7A Active CN111813772B (en) | 2019-04-12 | 2019-04-12 | Data processing method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111813772B (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102930062A (en) * | 2012-11-30 | 2013-02-13 | 南京富士通南大软件技术有限公司 | Rapid horizontal extending method for databases |
| CN103714097A (en) * | 2012-10-09 | 2014-04-09 | 阿里巴巴集团控股有限公司 | Method and device for accessing database |
| CN104380667A (en) * | 2013-06-14 | 2015-02-25 | 华为技术有限公司 | Method and device for routing data message |
| CN106294421A (en) * | 2015-05-25 | 2017-01-04 | 阿里巴巴集团控股有限公司 | A kind of data write, read method and device |
| CN107016025A (en) * | 2016-11-17 | 2017-08-04 | 阿里巴巴集团控股有限公司 | A kind of method for building up and device of non-relational database index |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9679262B2 (en) * | 2013-11-11 | 2017-06-13 | Bank Of America Corporation | Image index routing |
| US20170053276A1 (en) * | 2015-08-21 | 2017-02-23 | Green Dot Corporation | Systems and Methods for Transaction Routing |
| CN105512200A (en) * | 2015-11-26 | 2016-04-20 | 华为技术有限公司 | Distributed database processing method and device |
-
2019
- 2019-04-12 CN CN201910294334.7A patent/CN111813772B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103714097A (en) * | 2012-10-09 | 2014-04-09 | 阿里巴巴集团控股有限公司 | Method and device for accessing database |
| CN102930062A (en) * | 2012-11-30 | 2013-02-13 | 南京富士通南大软件技术有限公司 | Rapid horizontal extending method for databases |
| CN104380667A (en) * | 2013-06-14 | 2015-02-25 | 华为技术有限公司 | Method and device for routing data message |
| CN106294421A (en) * | 2015-05-25 | 2017-01-04 | 阿里巴巴集团控股有限公司 | A kind of data write, read method and device |
| CN107016025A (en) * | 2016-11-17 | 2017-08-04 | 阿里巴巴集团控股有限公司 | A kind of method for building up and device of non-relational database index |
Non-Patent Citations (1)
| Title |
|---|
| 关联规则数据结构分布重排的数据库索引算法;陈康;王丹丹;;科技通报;20151031(10);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111813772A (en) | 2020-10-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108234666A (en) | A kind of micro services calling system, method and computer storage media | |
| CN111949324A (en) | Distributed serial number generation method and device | |
| CN111158613A (en) | Data block storage method and device based on access heat and storage equipment | |
| CN105721629A (en) | User identifier matching method and device | |
| CN111914175A (en) | Recommendation process optimization method, device, equipment and medium | |
| CN109949108A (en) | Invoice creation method and device, electronic equipment based on block chain | |
| CN110244967A (en) | Method for updating edition and device | |
| CN111767047A (en) | Micro-service component management method and device | |
| JP6097774B2 (en) | Anonymization processing method, anonymization processing program, and anonymization processing device | |
| CN114416485A (en) | Data processing method and device | |
| CN111813772B (en) | Data processing method and device | |
| CN113297229B (en) | Method for routing read request and feedback message, respective device and database | |
| CN109241249B (en) | Method and device for determining burst problem | |
| CN108122123B (en) | Method and device for expanding potential users | |
| CN115660591A (en) | Process configuration method, system, electronic device and medium for business approval | |
| CN113596061B (en) | Network security vulnerability response method based on block chain technology | |
| JP2020035219A (en) | Device, method, and program for processing information | |
| CN110446167B (en) | Position estimation method and device | |
| CN112905457B (en) | Software testing method and device | |
| CN116955709A (en) | User data fusion processing method and system | |
| CN114385705A (en) | Data importance identification method, device, equipment and medium | |
| CN112862693A (en) | Picture processing method and device | |
| JPWO2010046972A1 (en) | Change impact research support program, change impact research support device, and change impact research support method | |
| CN111522616A (en) | Page change method and device | |
| Karunathilake et al. | Simulation speedup in OMNeT++ using contact traces |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |