CN111813772A - Data processing method and device - Google Patents
Data processing method and device Download PDFInfo
- Publication number
- CN111813772A CN111813772A CN201910294334.7A CN201910294334A CN111813772A CN 111813772 A CN111813772 A CN 111813772A CN 201910294334 A CN201910294334 A CN 201910294334A CN 111813772 A CN111813772 A CN 111813772A
- Authority
- CN
- China
- Prior art keywords
- index information
- routing rule
- new
- processed
- service data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 43
- 238000000034 method Methods 0.000 claims abstract description 26
- 238000012545 processing Methods 0.000 claims description 68
- 238000004364 calculation method Methods 0.000 claims description 3
- 230000008569 process Effects 0.000 description 9
- 238000010586 diagram Methods 0.000 description 7
- 230000005012 migration Effects 0.000 description 4
- 238000013508 migration Methods 0.000 description 4
- 238000004891 communication Methods 0.000 description 2
- 238000004590 computer program Methods 0.000 description 2
- 230000001413 cellular effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000000630 rising effect Effects 0.000 description 1
- 239000004984 smart glass Substances 0.000 description 1
- 238000011144 upstream manufacturing Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2228—Indexing structures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/23—Updating
- G06F16/2308—Concurrency control
- G06F16/2315—Optimistic concurrency control
- G06F16/2322—Optimistic concurrency control using timestamps
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/28—Databases characterised by their database models, e.g. relational or object models
- G06F16/284—Relational databases
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Software Systems (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The present specification provides a data processing method and an apparatus, where the data processing method stores a routing table in advance, the routing table includes a routing rule pointing to a preset database and index information corresponding to the routing rule, and the method includes: acquiring service data to be processed; determining index information corresponding to the to-be-processed business data, wherein the index information is generated in advance or generated in real time; determining a corresponding routing rule in the routing table based on the index information; and writing the service data to be processed into a corresponding preset database according to the routing rule.
Description
Technical Field
The present disclosure relates to the field of computer technologies, and in particular, to a data processing method. The present specification also relates to a data processing apparatus, a computing device, and a computer-readable storage medium.
Background
In the prior art, the horizontal expansion of the database refers to that an original single database is divided according to a certain rule, and data is dispersed to a plurality of physical machines for distributed storage, so that the single-machine limitation is broken through, and a system can cope with continuously rising mass data in a manner of increasing machines. Due to the distributed storage of the data, the distributed database is bound to involve the routing problem of the data, so that when the distributed database is horizontally expanded, due to the change of the number of machines, the mapping relationship of the data is also changed, thereby causing that part or all of the data needs to be redeployed, and the migration of the data affects the service of an upper layer, or the realization of the capacity expansion of the database is complicated under the condition that the service of the upper layer is not perceived.
Disclosure of Invention
In view of the above, embodiments of the present disclosure provide a data processing method, and relate to a data processing apparatus, a computing device, and a computer-readable storage medium, to solve technical defects in the prior art.
According to a first aspect of embodiments of the present specification, there is provided a data processing method in which a routing table is stored in advance, the routing table including a routing rule pointing to a preset database and index information corresponding to the routing rule, the method including:
acquiring service data to be processed;
determining index information corresponding to the to-be-processed business data, wherein the index information is generated in advance or generated in real time;
determining a corresponding routing rule in the routing table based on the index information;
and writing the service data to be processed into a corresponding preset database according to the routing rule.
Optionally, the acquiring the service data to be processed includes:
and acquiring the to-be-processed service data at a preset data processing moment.
Optionally, the index information is generated in advance, and the determining of the index information corresponding to the to-be-processed service data includes:
and determining index information corresponding to the preset data processing time based on the preset data processing time, wherein the index information is generated according to the time information corresponding to the preset data processing time and a set index information generation rule.
Optionally, the index information is generated in real time, and the determining of the index information corresponding to the to-be-processed service data includes:
and generating the index information of the current to-be-processed service data based on the preset data processing time and a set index information generation rule.
Optionally, the set index information generation rule is as follows:
determining the index information generation time, the data statistics reference value and the data statistics unit;
and determining the difference between the index information generation time and the data statistics reference value, and calculating the ratio of the difference between the index information generation time and the data statistics reference value to the data statistics unit as the index information.
Optionally, the routing rule pointing to the preset database included in the pre-stored routing table is determined by the following steps:
determining a preset database for storing the service data to be processed according to the storage space occupied by the service data to be processed, and determining index information of the service data to be processed;
and constructing an incidence relation between the index information and the preset database to serve as a routing rule pointing to the preset database in the routing table.
Optionally, after the step of writing the to-be-processed service data into the corresponding preset database according to the routing rule is executed, the method further includes:
acquiring available storage space of a preset database corresponding to each routing rule in the routing table, and predicting the storage space occupied by the service data to be processed in a set time period;
and under the condition that the occupied storage space of the service data to be processed in a set time period is larger than the available storage space of the preset database, acquiring a new database, and generating a new routing rule corresponding to the new database and new index information corresponding to the new routing rule.
Optionally, after the step of writing the to-be-processed service data into the corresponding preset database according to the routing rule is executed, the method further includes:
acquiring available storage space of a preset database corresponding to each routing rule in the routing table, and comparing the available storage space of the preset database with a preset space threshold value;
and under the condition that the available storage space of the preset database is smaller than the preset space threshold, acquiring a new database, and generating a new routing rule corresponding to the new database and new index information corresponding to the new routing rule.
Optionally, the data processing method further includes:
updating the routing rule to the new routing rule, the index information to the new index information, and the routing table to a new routing table;
correspondingly, the updating content of the new routing table comprises the following steps:
a new routing rule pointing to a new database, and new index information corresponding to the new routing rule.
Optionally, the routing table includes the routing rule pointing to the preset database, and further includes:
adding an effective time stamp to the routing rule, wherein the effective time stamp is used for marking the effective time of the routing rule.
According to a second aspect of embodiments of the present specification, there is provided a data processing apparatus in which a routing table including a routing rule pointing to a preset database and index information corresponding to the routing rule is stored in advance, the apparatus including:
the acquisition module is configured to acquire service data to be processed;
an index information determining module configured to determine index information corresponding to the to-be-processed service data, where the index information is generated in advance or generated in real time;
a determine routing rule module configured to determine a corresponding routing rule in the routing table based on the index information;
and the writing module is configured to write the to-be-processed service data into a corresponding preset database according to the routing rule.
Optionally, the obtaining module is further configured to:
and acquiring the to-be-processed service data at a preset data processing moment.
Optionally, the index information is generated in advance, and the determining of the index information corresponding to the to-be-processed service data includes:
and determining index information corresponding to the preset data processing time based on the preset data processing time, wherein the index information is generated according to the time information corresponding to the preset data processing time and a set index information generation rule.
Optionally, the index information is generated in real time, and the determining of the index information corresponding to the to-be-processed service data includes:
and generating the index information of the current to-be-processed service data based on the preset data processing time and a set index information generation rule.
Optionally, the set index information generation rule is as follows:
a first determination unit configured to determine the index information generation time, the data statistics reference value, and the data statistics unit;
and the calculation unit is configured to determine a difference value of the index information generation time and the data statistics reference value, and calculate a ratio of the difference value of the index information generation time and the data statistics reference value to the data statistics unit as the index information.
Optionally, the routing rule pointing to the preset database included in the pre-stored routing table is determined by the following steps:
the second determining unit is configured to determine a preset database for storing the to-be-processed service data according to the storage space occupied by the to-be-processed service data, and determine index information of the to-be-processed service data;
and the constructing unit is configured to construct an incidence relation between the index information and the preset database as a routing rule pointing to the preset database and included in the routing table.
Optionally, the writing module includes:
the first obtaining unit is configured to obtain an available storage space of a preset database corresponding to each routing rule in the routing table, and predict an occupied storage space of the to-be-processed service data in a set time period;
the first generating unit is configured to acquire a new database and generate a new routing rule corresponding to the new database and new index information corresponding to the new routing rule under the condition that the occupied storage space of the to-be-processed service data in a set time period is larger than the available storage space of the preset database.
Optionally, the writing module includes:
a second obtaining unit, configured to obtain an available storage space of a preset database corresponding to each routing rule in the routing table, and compare the available storage space of the preset database with a preset space threshold;
a second generating unit configured to acquire a new database and generate a new routing rule corresponding to the new database and new index information corresponding to the new routing rule in a case where an available storage space of the preset database is smaller than the preset space threshold.
Optionally, the data processing apparatus further includes:
an update module configured to update the routing rule to the new routing rule, the index information to the new index information, and the routing table to a new routing table;
correspondingly, the updating content of the new routing table comprises the following steps:
a new routing rule pointing to a new database, and new index information corresponding to the new routing rule.
Optionally, the routing table includes the routing rule pointing to the preset database, and further includes:
adding an effective time stamp to the routing rule, wherein the effective time stamp is used for marking the effective time of the routing rule.
According to a third aspect of embodiments herein, there is provided an electronic apparatus including:
a memory and a processor;
the memory is to store computer-executable instructions, and the processor is to execute the computer-executable instructions to:
acquiring service data to be processed;
determining index information corresponding to the to-be-processed business data, wherein the index information is generated in advance or generated in real time;
determining a corresponding routing rule in the routing table based on the index information;
and writing the service data to be processed into a corresponding preset database according to the routing rule.
According to a fourth aspect of embodiments herein, there is provided a computer-readable storage medium storing computer-executable instructions that, when executed by a processor, implement the steps of any one of the data processing methods.
Compared with the prior art, the specification has the following advantages:
the present specification provides a data processing method including: acquiring service data to be processed; determining index information corresponding to the to-be-processed business data, wherein the index information is generated in advance or generated in real time; determining a corresponding routing rule in the routing table based on the index information; and writing the service data to be processed into a corresponding preset database according to the routing rule.
The data processing method provided by the specification stores a routing table in advance, and the routing table stores routing rules pointing to a preset database and index information corresponding to the routing rules, when the service data to be processed is obtained, the index information of the service data to be processed can be determined according to the index information recorded in the routing table, so that one index information can correspond to all data of the service to be processed, the routing table space occupied by each index information corresponding to one service data in the routing table is reduced, after the index information is determined according to the service data to be processed, the index information can be written into the preset database according to the corresponding routing rules, and the service data to be processed is stored under the condition that the normal operation of other systems bearing the service data to be processed is not influenced, the solution that the database can be horizontally expanded without data migration is realized.
Drawings
FIG. 1 is a flow chart of a data processing method provided in an embodiment of the present description;
FIG. 2 is a flow chart of a data processing method process provided by an embodiment of the present specification;
FIG. 3 is a schematic diagram of a data processing method provided in an embodiment of the present specification;
fig. 4 is a schematic structural diagram of a data processing apparatus according to an embodiment of the present disclosure;
fig. 5 is a block diagram of an electronic device according to an embodiment of the present disclosure.
Detailed Description
In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present description. This description may be embodied in many different forms and should not be construed as limited to the embodiments set forth herein, as those skilled in the art will be able to make and use the present disclosure without departing from the spirit and scope of the present disclosure.
The terminology used in the description of the one or more embodiments is for the purpose of describing the particular embodiments only and is not intended to be limiting of the description of the one or more embodiments. As used in one or more embodiments of the present specification and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and/or" as used in one or more embodiments of the present specification refers to and encompasses any and all possible combinations of one or more of the associated listed items.
It will be understood that, although the terms first, second, etc. may be used herein in one or more embodiments to describe various information, these information should not be limited by these terms. These terms are only used to distinguish one type of information from another. For example, a first can also be referred to as a second and, similarly, a second can also be referred to as a first without departing from the scope of one or more embodiments of the present description. The word "if" as used herein may be interpreted as "at … …" or "when … …" or "in response to a determination", depending on the context.
In the present application, a data processing method is provided, and a data processing apparatus, a computing device, and a computer-readable storage medium are provided, which are described in detail in the following embodiments one by one.
Fig. 1 is a flowchart illustrating a data processing method according to an embodiment of the present specification, in which a routing table is stored in advance, the routing table including a routing rule pointing to a preset database and index information corresponding to the routing rule, and the method includes steps 102 to 108.
Step 102: and acquiring service data to be processed.
Specifically, after obtaining service data to be processed, the service data to be processed needs to be stored in a preset database, and in order to improve efficiency of storing the service data to be processed and ensure that, in a process of writing the service data to be processed into the database, there is no difference influence on an upstream system and a downstream system that generate the service data to be processed, this specification implements and provides a data processing method, where obtaining the service data to be processed may be obtained at a preset data processing time, and based on this, in one or more implementation manners of this embodiment, obtaining the service data to be processed includes:
and acquiring the to-be-processed service data at a preset data processing moment.
Specifically, the preset data processing time may be set according to an actual application, and this specification is not limited herein, where the to-be-processed service data may include all data in the to-be-processed service.
Step 104: and determining index information corresponding to the to-be-processed service data, wherein the index information is generated in advance or in real time.
Specifically, according to the acquired to-be-processed service data, index information corresponding to the to-be-processed service data is determined through a pre-stored routing table, where the index information includes pre-generated index information and real-time generated index information.
On the basis that the index information is generated in advance, further, in one or more implementations of this embodiment, the determining the index information corresponding to the to-be-processed service data, where the determining the index information is generated in advance, includes:
and determining index information corresponding to the preset data processing time based on the preset data processing time, wherein the index information is generated according to the time information corresponding to the preset data processing time and a set index information generation rule.
Specifically, in order to determine a preset database capable of storing the to-be-processed service data when the to-be-processed service data is acquired, the index information corresponding to the to-be-processed service data may be determined at a preset data processing time.
On the basis that the index information is generated in real time, further, in one or more embodiments of this embodiment, determining the index information corresponding to the to-be-processed service data includes:
and generating the index information of the current to-be-processed service data based on the preset data processing time and a set index information generation rule.
Specifically, under the condition that the to-be-processed service data acquired in real time is inconsistent with the predicted to-be-processed service data, the index information of the to-be-processed service data acquired in real time can be generated according to the acquisition time of the to-be-processed service data acquired in real time and the index information generation rule.
On the basis of determining the index information of the to-be-processed service data, further, in one or more implementations of this embodiment, the set index information generation rule is as follows:
determining the index information generation time, the data statistics reference value and the data statistics unit;
and determining the difference between the index information generation time and the data statistics reference value, and calculating the ratio of the difference between the index information generation time and the data statistics reference value to the data statistics unit as the index information.
Specifically, the preset data processing time may be a time when the service data is written into the database, the data statistics reference value may be a starting time of use of the preset database, and the setting of the data statistics unit may be set according to an actual situation, and may be one hour, one day, one week, or the like, which is not limited herein.
Based on this, the set index information generation rule can be implemented according to formula (1), where formula (1) is as follows:
(CURRENT_TIME-START_TIME)/DATE＝ID (1)
the CURRENT _ TIME represents a preset data processing TIME, the START _ TIME represents a data statistics reference value, the DATE represents a data statistics unit, and the ID represents index information.
In practical application, determining index information corresponding to the to-be-processed service data in units of days is described, wherein a data statistics reference value is 20181001, a preset data processing time is 20181002, a data statistics unit is 1, and the index information corresponding to the to-be-processed service data is determined to be 1 according to a formula (1).
Alternatively, the index information may be generated by a primary key ID generator, and the index information generation rule may be a rule set in the primary key ID generator.
By determining the index information for the to-be-processed service data with the same attribute, the method can realize that one index information corresponds to all data at the preset data processing time, and reduce the occupied space of each index information corresponding to one service data.
Step 106: and determining a corresponding routing rule in the routing table based on the index information.
Specifically, according to the determined index information of the to-be-processed service data, a routing rule corresponding to the index information is determined by querying a routing table, the routing rule records a preset database corresponding to the to-be-processed service data, and the routing rule can be generated by a routing information generator.
In practical application, taking the example that the storage space of the preset database does not reach the upper storage limit, the method for determining the corresponding routing rule in the routing table based on the index information is described, wherein a data statistics unit takes a day as a unit, and acquiring the index information corresponding to the to-be-processed service data of three days in the future comprises the following steps: the first index information is 1, the second index information is 2, the third index information is 3, and the pre-generated routing rule includes: a first routing rule route1, a second routing rule route2, a third routing rule route 3; and querying the routing table to determine that the index information 1 corresponds to the first routing rule route1, the index information 2 corresponds to the second routing rule route2, and the index information 3 corresponds to the third routing rule route 3.
The routing table records the corresponding relationship between the index information and the routing rule, and is shown in table 1:
TABLE 1
| Index information | route |
| 1 | route1 (first routing rule) |
| 2 | route2 (second routing rule) |
| 3 | route3 (third routing rule) |
The first routing rule 1, the second routing rule 2, and the third routing rule 3 all record the association relationship between the index information and a preset database storing the service data to be processed.
After the service data to be processed is obtained, the index information of the service data to be processed is determined according to the corresponding relation between the index information and the routing rule recorded in the table 1, and the index information is written into a preset database according to the routing rule corresponding to the index information.
On the basis that the routing rule is prestored in the routing table, further, in one or more embodiments of this embodiment, the specific implementation manner of the routing rule pointing to the preset database included in the prestored routing table is as follows:
determining a preset database for storing the service data to be processed according to the storage space occupied by the service data to be processed, and determining index information of the service data to be processed;
and constructing an incidence relation between the index information and the preset database to serve as a routing rule pointing to the preset database in the routing table.
Specifically, a storage space occupied by the to-be-processed service data is estimated, a preset database capable of storing the to-be-processed service data is determined, a rule is generated according to the index information, index information of the to-be-processed service data is generated, an association relationship between the index information and the preset database is established, the association relationship between the index information and the preset database is determined as a routing rule, and the routing rule is written into a routing table.
In addition, under the condition that the estimated to-be-processed service data cannot be stored in the original preset database is detected in a set time period, according to the storage space occupied by the newly estimated to-be-processed service data, an information database is determined to store the to-be-processed service data, new index information is determined, the incidence relation between the new index information and the new database is established, the incidence relation between the new index information and the new database is determined as the routing rule of the to-be-processed service data, and a pre-stored routing table is updated.
In practical application, for example, a pre-generated routing rule is taken as an example, a routing rule generation process is described, where a storage space occupied by to-be-processed service data is 8G, an available storage space of a preset database is 10G, index information corresponding to the received to-be-processed service data is ID1, the to-be-processed service data is determined to be storable in the preset database, an association relationship between ID1 and the preset database is established, ID1 corresponds to the preset database, the association relationship between ID1 and the preset database is determined as a routing rule of the to-be-processed service data, the routing rule is route, and when the to-be-processed service data is acquired, the to-be-processed service data is written into the corresponding preset database according to route.
In one or more implementations of this embodiment, the routing table includes the routing rule pointing to the preset database, and further includes:
adding an effective time stamp to the routing rule, wherein the effective time stamp is used for marking the effective time of the routing rule.
The effective time stamp is used for marking the effective time of the routing rule, in practical application, according to the index information of the service data to be processed which is determined in advance and the database for storing the service data to be processed, the association relation between the database and the index information is established and determined as the routing rule corresponding to the service data to be processed, the specific effective time is not defined by the routing rule, the effective time is determined for the routing rule through the effective time stamp, the preset routing rule can be effectively ensured to be effective at the set time, and the subsequent writing operation is carried out on the service data to be processed. The specific effective time may be effective at the time of completing database arrangement, or effective at the time of acquiring the service data to be processed, and the specific time may be set according to the service requirement in the practical application, which is not limited herein.
By presetting the routing rule and adding the effective timestamp to the routing rule, the preset database capable of storing the to-be-processed service data can be determined when the to-be-processed service data is acquired, and the to-be-processed service data can be rapidly stored.
Step 108: and writing the service data to be processed into a corresponding preset database according to the routing rule.
Specifically, the index information of the service data to be processed is determined according to the above, the routing rule of the service data to be processed is determined by querying the routing table through the index information, and the service data to be processed can be written into the preset database according to the routing rule.
On the basis of writing the to-be-processed service data into a preset database, further, in one or more embodiments of this embodiment, after writing the to-be-processed service data into the database, it is estimated whether future to-be-processed service data can be stored into the preset database, and a specific implementation manner is as follows:
acquiring available storage space of a preset database corresponding to each routing rule in the routing table, and predicting the storage space occupied by the service data to be processed in a set time period;
and under the condition that the occupied storage space of the service data to be processed in a set time period is larger than the available storage space of the preset database, acquiring a new database, and generating a new routing rule corresponding to the new database and new index information corresponding to the new routing rule.
Specifically, the method includes the steps of obtaining an available storage space of a preset database corresponding to each routing rule in the routing table, predicting a storage space occupied by service data to be processed in a time period, judging whether the available storage space of the preset data can accommodate the service data to be processed, adding a new database when the available storage space of the preset database does not store the service data to be processed, generating a new routing rule corresponding to the new database and new index information corresponding to the new routing rule, determining new index information of the service data to be processed and the new routing rule corresponding to the new index information when the time of obtaining the service data to be processed is reached, and writing the service data to be processed into the new database.
In addition, after the to-be-processed service data is written into the database, another implementation manner of predicting whether future to-be-processed service data can be stored in the preset database is estimated, and further, in one or more implementation manners of this embodiment, another implementation manner is as follows:
acquiring available storage space of a preset database corresponding to each routing rule in the routing table, and comparing the available storage space of the preset database with a preset space threshold value;
and under the condition that the available storage space of the preset database is smaller than the preset space threshold, acquiring a new database, and generating a new routing rule corresponding to the new database and new index information corresponding to the new routing rule.
Specifically, the available storage space of the preset database corresponding to each routing rule in the routing table is obtained, the available storage space of the preset database is compared with a preset space threshold, and when the available storage space of the preset database is smaller than the preset space threshold, it is indicated that even if the service data to be processed obtained first can be stored in the preset database, the storage space occupied by the subsequently obtained service data to be processed may be larger than the available storage space of the preset database, in order to avoid this, by setting the preset space storage threshold for the preset database, it is further ensured that the normal operation of other systems is not affected when the service data to be processed is written into the database, by obtaining a new database and generating a new routing rule corresponding to the new database when the available storage space of the preset database is smaller than the preset space threshold, and new index information corresponding to the new routing rule, and writing the to-be-processed service data into a new database.
On the basis of acquiring a new database, generating new index information and a new routing rule, further, in one or more embodiments of this embodiment, the update content is as follows:
updating the routing rule to the new routing rule, the index information to the new index information, and the routing table to a new routing table;
correspondingly, the updating content of the new routing table comprises the following steps:
a new routing rule pointing to a new database, and new index information corresponding to the new routing rule.
Specifically, under the conditions of acquiring a new database, generating new index information and a new routing rule, the routing table needs to be updated, the unchanged index information and routing rule in the routing table remain unchanged, the changed index information is updated to new index information, and the routing rule is updated to the new routing rule.
Based on the above, the updated contents in the routing table are a new routing rule pointing to a new database and new index information corresponding to the new routing rule.
Still taking the above-mentioned routing table (table 1) as an example, the routing table update is described, where referring to table 1, it can be seen that the index information includes that the first index information is 1, the second index information is 2, and the third index information is 3, and the pre-generated routing rule includes: a first routing rule route1, a second routing rule route2, a third routing rule route 3; and querying the routing table to determine that the index information 1 corresponds to the first routing rule route1, the index information 2 corresponds to the second routing rule route2, and the index information 3 corresponds to the third routing rule route 3.
Under the condition that the storage space occupied by the to-be-processed service data corresponding to the index information 3 is determined to be larger than that of a preset database within a set time period, the index information 3 and the routing rule corresponding to the index information 3 are updated, and the updated routing table is shown in table 2:
TABLE 2
| Index information | route |
| 1 | route1 (first routing rule) |
| 2 | route2 (second routing rule) |
| 3+ | route3+ (third + routing rule) |
The index information 3+ corresponding to the service data to be processed is found through the index information 3+ lookup table 2, the corresponding routing rule is route3+, and the routing rule route3+ points to the new preset database.
The data processing method provided by the specification stores a routing table in advance, and the routing table stores routing rules pointing to a preset database and index information corresponding to the routing rules, when the service data to be processed is obtained, the index information of the service data to be processed can be determined according to the index information recorded in the routing table, so that one index information can correspond to all data of the service to be processed, the routing table space occupied by each index information corresponding to one service data in the routing table is reduced, after the index information is determined according to the service data to be processed, the index information can be written into the preset database according to the corresponding routing rule, and meanwhile, an effective timestamp is added to the routing rule, and the effective time of the routing rule can be set, the method and the device avoid the situation that the obtained routing rule is not stored to the database according to the set routing rule and the to-be-processed service data is stored under the condition that the normal operation of other systems bearing the to-be-processed service data is not influenced, and realize the solution that the database can be horizontally expanded without data migration.
The following will further describe the data processing method by taking an application of the data processing method provided in this specification in storing online shopping order data as an example with reference to fig. 2 and fig. 3. Fig. 2 is a flowchart of a data processing method process provided in this specification, and fig. 3 is a schematic structural diagram of the data processing method process in this specification. The specific steps of the flow chart of the data processing method process include steps 202 to 216.
Step 202: and acquiring five pieces of online shopping order business data at the preset data processing time.
Specifically, the online shopping order service data generated in the online shopping platform is received at the preset data processing time 20190410.
Step 204: and determining the index information ID5 of the service data of the five online shopping orders.
Specifically, before the online shopping order business data are acquired, the corresponding index information and the routing rule pointing to the preset database are generated in advance by predicting the occupied storage space of the online shopping order business data.
Referring to fig. 3, before five pieces of online shopping order service data are acquired, index information ID4 is generated for the predicted five pieces of online shopping order service data through a primary key ID generator and is written into a routing table, a database storing the online shopping order service data is created, and an association relationship between the index information ID4 and the database is constructed as a routing rule route5 of the online shopping order service data. The method comprises the following specific steps:
step 302: and generating index information ID4 for the online shopping order business data through a primary key ID generator.
Step 304: and generating a routing rule 5 for the online shopping order business data through the routing information generator.
Step 306: the index information ID4 and the routing rule route5 are written to the routing table.
Step 308: and when the online shopping order business data is acquired, inquiring a routing table through a routing analyzer.
Step 310: and determining that the routing rule corresponding to the index information ID4 in the routing table is routing 5.
Step 312: and writing the online shopping order business data into the database according to the routing rule route 5.
Specifically, the steps 302 to 312 may be referred to during the process of writing the service data.
Step 206: and inquiring a routing table through index information ID5 corresponding to the five online shopping order business data to determine a corresponding routing rule route 5.
Specifically, the routing table records the correspondence between the index information ID5 and the routing rule route 5.
Step 208: and writing the five online shopping order business data into a preset database according to the routing rule route 5.
Step 210: and predicting that the network purchase order business data after the five network purchase order business data occupy the storage space.
Step 212: judging whether the storage space occupied by the business data of the online shopping order is larger than the available storage space of the preset data; if not, go to step 214; if yes, go to step 216.
Step 214: and writing the online shopping order business data into a preset database according to the routing rule in the routing table.
Step 216: acquires a new database, and generates a new routing rule 6 corresponding to the new database, and a new index information ID6 corresponding to the new routing rule.
According to the data processing method provided by the specification, the online shopping order business data are recorded in the preset database according to the preset routing rule, the storage process of the online shopping order business data can be completed through one-time writing operation, when other online shopping order business data after five pieces of online shopping order business data are obtained and the available storage space of the preset database is insufficient, the new database is obtained, the new routing rule and the new index information corresponding to the new database are generated, and smooth capacity expansion of the database under the condition that online business is not sensed is achieved.
Corresponding to the above method embodiments, the present specification further provides data processing apparatus embodiments, and fig. 4 shows a schematic structural diagram of the data processing apparatus according to an embodiment of the present specification. As shown in fig. 4, the apparatus includes:
an obtaining module 402 configured to obtain to-be-processed service data;
an index information determining module 404 configured to determine index information corresponding to the to-be-processed service data, where the index information is generated in advance or generated in real time;
a determine routing rule module 406 configured to determine a corresponding routing rule in the routing table based on the index information;
the writing module 408 is configured to write the to-be-processed service data into a corresponding preset database according to the routing rule.
In an optional embodiment, the obtaining module 402 is further configured to:
and acquiring the to-be-processed service data at a preset data processing moment.
In an optional embodiment, the index information is generated in advance, and determining the index information corresponding to the to-be-processed service data includes:
and determining index information corresponding to the preset data processing time based on the preset data processing time, wherein the index information is generated according to the time information corresponding to the preset data processing time and a set index information generation rule.
In an optional embodiment, the generating the index information in real time and determining the index information corresponding to the to-be-processed service data includes:
and generating the index information of the current to-be-processed service data based on the preset data processing time and a set index information generation rule.
In an optional embodiment, the set index information generation rule is as follows:
a first determination unit configured to determine the index information generation time, the data statistics reference value, and the data statistics unit;
and the calculation unit is configured to determine a difference value of the index information generation time and the data statistics reference value, and calculate a ratio of the difference value of the index information generation time and the data statistics reference value to the data statistics unit as the index information.
In an optional embodiment, the routing rule pointing to the preset database included in the pre-stored routing table is determined by the following steps:
the second determining unit is configured to determine a preset database for storing the to-be-processed service data according to the storage space occupied by the to-be-processed service data, and determine index information of the to-be-processed service data;
and the constructing unit is configured to construct an incidence relation between the index information and the preset database as a routing rule pointing to the preset database and included in the routing table.
In an alternative embodiment, the writing module 408 includes:
the first obtaining unit is configured to obtain an available storage space of a preset database corresponding to each routing rule in the routing table, and predict an occupied storage space of the to-be-processed service data in a set time period;
the first generating unit is configured to acquire a new database and generate a new routing rule corresponding to the new database and new index information corresponding to the new routing rule under the condition that the occupied storage space of the to-be-processed service data in a set time period is larger than the available storage space of the preset database.
In an alternative embodiment, the writing module 408 includes:
a second obtaining unit, configured to obtain an available storage space of a preset database corresponding to each routing rule in the routing table, and compare the available storage space of the preset database with a preset space threshold;
a second generating unit configured to acquire a new database and generate a new routing rule corresponding to the new database and new index information corresponding to the new routing rule in a case where an available storage space of the preset database is smaller than the preset space threshold.
In an optional embodiment, the data processing apparatus includes:
an update module configured to update the routing rule to the new routing rule, the index information to the new index information, and the routing table to a new routing table;
correspondingly, the updating content of the new routing table comprises the following steps:
a new routing rule pointing to a new database, and new index information corresponding to the new routing rule.
In an optional embodiment, the routing table includes the routing rule pointing to the preset database, and further includes:
adding an effective time stamp to the routing rule, wherein the effective time stamp is used for marking the effective time of the routing rule.
The data processing device provided by the present specification stores a routing table in advance, and the routing table stores a routing rule pointing to a preset database and index information corresponding to the routing rule, when the service data to be processed is obtained, the index information of the service data to be processed can be determined according to the index information recorded in the routing table, so that one index information can correspond to all data of the service to be processed, a routing table space occupied by each index information corresponding to one service data in the routing table is reduced, after the index information is determined according to the service data to be processed, the index information can be written into the preset database according to the corresponding routing rule, under the condition that the normal operation of other systems bearing the service data to be processed is not influenced, and storing the service data to be processed, thereby realizing a solution that the database can be horizontally expanded without data migration.
The above is a schematic configuration of a data processing apparatus of the present embodiment. It should be noted that the technical solution of the data processing apparatus and the technical solution of the data processing method belong to the same concept, and details that are not described in detail in the technical solution of the data processing apparatus can be referred to the description of the technical solution of the data processing method.
Fig. 5 shows a block diagram of an electronic device 500 according to an embodiment of the present description. The components of the electronic device 500 include, but are not limited to, a memory 510 and a processor 520. Processor 520 is coupled to memory 510 via bus 530, and database 550 is used to store data.
The electronic device 500 also includes an access device 540, the access device 540 enabling the electronic device 500 to communicate via one or more networks 560. Examples of such networks include the Public Switched Telephone Network (PSTN), a Local Area Network (LAN), a Wide Area Network (WAN), a Personal Area Network (PAN), or a combination of communication networks such as the internet. The access device 540 may include one or more of any type of network interface, e.g., a Network Interface Card (NIC), wired or wireless, such as an IEEE802.11 Wireless Local Area Network (WLAN) wireless interface, a worldwide interoperability for microwave access (Wi-MAX) interface, an ethernet interface, a Universal Serial Bus (USB) interface, a cellular network interface, a bluetooth interface, a Near Field Communication (NFC) interface, and so forth.
In one embodiment of the present description, the other components of the electronic device 500 described above and not shown in fig. 5 may also be connected to each other, for example, by a bus. It should be understood that the block diagram of the electronic device shown in fig. 5 is for exemplary purposes only and is not intended to limit the scope of the present disclosure. Those skilled in the art may add or replace other components as desired.
The electronic device 500 may be any type of stationary or mobile electronic device, including a mobile computer or mobile electronic device (e.g., tablet, personal digital assistant, laptop, notebook, netbook, etc.), a mobile phone (e.g., smartphone), a wearable electronic device (e.g., smartwatch, smartglasses, etc.), or other type of mobile device, or a stationary electronic device such as a desktop computer or PC. The electronic device 500 may also be a mobile or stationary server.
Wherein processor 520 is configured to execute the following computer-executable instructions:
acquiring service data to be processed;
determining index information corresponding to the to-be-processed business data, wherein the index information is generated in advance or generated in real time;
determining a corresponding routing rule in the routing table based on the index information;
and writing the service data to be processed into a corresponding preset database according to the routing rule.
Optionally, the acquiring the service data to be processed includes:
and acquiring the to-be-processed service data at a preset data processing moment.
Optionally, the index information is generated in advance, and the determining of the index information corresponding to the to-be-processed service data includes:
and determining index information corresponding to the preset data processing time based on the preset data processing time, wherein the index information is generated according to the time information corresponding to the preset data processing time and a set index information generation rule.
Optionally, the index information is generated in real time, and the determining of the index information corresponding to the to-be-processed service data includes:
and generating the index information of the current to-be-processed service data based on the preset data processing time and a set index information generation rule.
Optionally, the set index information generation rule is as follows:
determining the index information generation time, the data statistics reference value and the data statistics unit;
and determining the difference between the index information generation time and the data statistics reference value, and calculating the ratio of the difference between the index information generation time and the data statistics reference value to the data statistics unit as the index information.
Optionally, the routing rule pointing to the preset database included in the pre-stored routing table is determined by the following steps:
determining a preset database for storing the service data to be processed according to the storage space occupied by the service data to be processed, and determining index information of the service data to be processed;
and constructing an incidence relation between the index information and the preset database to serve as a routing rule pointing to the preset database in the routing table.
Optionally, after the step of writing the to-be-processed service data into the corresponding preset database according to the routing rule is executed, the method further includes:
acquiring available storage space of a preset database corresponding to each routing rule in the routing table, and predicting the storage space occupied by the service data to be processed in a set time period;
and under the condition that the occupied storage space of the service data to be processed in a set time period is larger than the available storage space of the preset database, acquiring a new database, and generating a new routing rule corresponding to the new database and new index information corresponding to the new routing rule.
Optionally, after the step of writing the to-be-processed service data into the corresponding preset database according to the routing rule is executed, the method further includes:
acquiring available storage space of a preset database corresponding to each routing rule in the routing table, and comparing the available storage space of the preset database with a preset space threshold value;
and under the condition that the available storage space of the preset database is smaller than the preset space threshold, acquiring a new database, and generating a new routing rule corresponding to the new database and new index information corresponding to the new routing rule.
Optionally, the data processing method further includes:
updating the routing rule to the new routing rule, the index information to the new index information, and the routing table to a new routing table;
correspondingly, the updating content of the new routing table comprises the following steps:
a new routing rule pointing to a new database, and new index information corresponding to the new routing rule.
Optionally, the routing table includes the routing rule pointing to the preset database, and further includes:
adding an effective time stamp to the routing rule, wherein the effective time stamp is used for marking the effective time of the routing rule.
The above is a schematic scheme of an electronic device of the present embodiment. It should be noted that the technical solution of the electronic device and the technical solution of the data processing method belong to the same concept, and details that are not described in detail in the technical solution of the electronic device can be referred to the description of the technical solution of the data processing method.
An embodiment of the present specification further provides a computer readable storage medium storing computer instructions, which when executed by a processor implement the steps of the data processing method as described above.
The above is an illustrative scheme of a computer-readable storage medium of the present embodiment. It should be noted that the technical solution of the storage medium belongs to the same concept as the technical solution of the data processing method, and details that are not described in detail in the technical solution of the storage medium can be referred to the description of the technical solution of the data processing method.
The foregoing description has been directed to specific embodiments of this disclosure. Other embodiments are within the scope of the following claims. In some cases, the actions or steps recited in the claims may be performed in a different order than in the embodiments and still achieve desirable results. In addition, the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. In some embodiments, multitasking and parallel processing may also be possible or may be advantageous.
The computer instructions comprise computer program code which may be in the form of source code, object code, an executable file or some intermediate form, or the like. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording medium, usb disk, removable hard disk, magnetic disk, optical disk, computer Memory, Read-Only Memory (ROM), Random Access Memory (RAM), electrical carrier wave signals, telecommunications signals, software distribution medium, and the like. It should be noted that the computer readable medium may contain content that is subject to appropriate increase or decrease as required by legislation and patent practice in jurisdictions, for example, in some jurisdictions, computer readable media does not include electrical carrier signals and telecommunications signals as is required by legislation and patent practice.
It should be noted that, for the sake of simplicity, the foregoing method embodiments are described as a series of acts or combinations, but those skilled in the art should understand that the present disclosure is not limited by the described order of acts, as some steps may be performed in other orders or simultaneously according to the present disclosure. Further, those skilled in the art should also appreciate that the embodiments described in this specification are preferred embodiments and that acts and modules referred to are not necessarily required for this description.
In the above embodiments, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.
The preferred embodiments of the present specification disclosed above are intended only to aid in the description of the specification. Alternative embodiments are not exhaustive and do not limit the invention to the precise embodiments described. Obviously, many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles of the specification and its practical application, to thereby enable others skilled in the art to best understand the specification and its practical application. The specification is limited only by the claims and their full scope and equivalents.
Claims (22)
1. A data processing method is characterized in that a routing table is stored in advance, the routing table comprises a routing rule pointing to a preset database and index information corresponding to the routing rule, and the method comprises the following steps:
acquiring service data to be processed;
determining index information corresponding to the to-be-processed business data, wherein the index information is generated in advance or generated in real time;
determining a corresponding routing rule in the routing table based on the index information;
and writing the service data to be processed into a corresponding preset database according to the routing rule.
2. The data processing method according to claim 1, wherein the acquiring the service data to be processed comprises:
and acquiring the to-be-processed service data at a preset data processing moment.
3. The data processing method according to claim 2, wherein the index information is pre-generated, and determining the index information corresponding to the to-be-processed service data includes:
and determining index information corresponding to the preset data processing time based on the preset data processing time, wherein the index information is generated according to the time information corresponding to the preset data processing time and a set index information generation rule.
4. The data processing method according to claim 2, wherein the index information is generated in real time, and determining the index information corresponding to the to-be-processed service data includes:
and generating the index information of the current to-be-processed service data based on the preset data processing time and a set index information generation rule.
5. The data processing method according to claim 3 or 4, wherein the set index information generation rule is as follows:
determining the index information generation time, the data statistics reference value and the data statistics unit;
and determining the difference between the index information generation time and the data statistics reference value, and calculating the ratio of the difference between the index information generation time and the data statistics reference value to the data statistics unit as the index information.
6. The data processing method according to claim 1, wherein the routing rule pointing to the predetermined database included in the pre-stored routing table is determined by:
determining a preset database for storing the service data to be processed according to the storage space occupied by the service data to be processed, and determining index information of the service data to be processed;
and constructing an incidence relation between the index information and the preset database to serve as a routing rule pointing to the preset database in the routing table.
7. The data processing method according to claim 1, wherein after the step of writing the to-be-processed service data into the corresponding preset database according to the routing rule is executed, the method further comprises:
acquiring available storage space of a preset database corresponding to each routing rule in the routing table, and predicting the storage space occupied by the service data to be processed in a set time period;
and under the condition that the occupied storage space of the service data to be processed in a set time period is larger than the available storage space of the preset database, acquiring a new database, and generating a new routing rule corresponding to the new database and new index information corresponding to the new routing rule.
8. The data processing method according to claim 1, wherein after the step of writing the to-be-processed service data into the corresponding preset database according to the routing rule is executed, the method further comprises:
acquiring available storage space of a preset database corresponding to each routing rule in the routing table, and comparing the available storage space of the preset database with a preset space threshold value;
and under the condition that the available storage space of the preset database is smaller than the preset space threshold, acquiring a new database, and generating a new routing rule corresponding to the new database and new index information corresponding to the new routing rule.
9. The data processing method according to claim 7 or 8, further comprising:
updating the routing rule to the new routing rule, the index information to the new index information, and the routing table to a new routing table;
correspondingly, the updating content of the new routing table comprises the following steps:
a new routing rule pointing to a new database, and new index information corresponding to the new routing rule.
10. The data processing method according to claim 1, wherein the routing table includes the routing rule pointing to the preset database, and further comprising:
adding an effective time stamp to the routing rule, wherein the effective time stamp is used for marking the effective time of the routing rule.
11. A data processing apparatus characterized in that a routing table including a routing rule pointing to a preset database and index information corresponding to the routing rule is stored in advance, the apparatus comprising:
the acquisition module is configured to acquire service data to be processed;
an index information determining module configured to determine index information corresponding to the to-be-processed service data, where the index information is generated in advance or generated in real time;
a determine routing rule module configured to determine a corresponding routing rule in the routing table based on the index information;
and the writing module is configured to write the to-be-processed service data into a corresponding preset database according to the routing rule.
12. The data processing apparatus of claim 11, wherein the acquisition module is further configured to:
and acquiring the to-be-processed service data at a preset data processing moment.
13. The data processing apparatus according to claim 12, wherein the index information is pre-generated, and determining the index information corresponding to the to-be-processed service data includes:
and determining index information corresponding to the preset data processing time based on the preset data processing time, wherein the index information is generated according to the time information corresponding to the preset data processing time and a set index information generation rule.
14. The data processing apparatus according to claim 12, wherein the index information is generated in real time, and determining the index information corresponding to the to-be-processed service data includes:
and generating the index information of the current to-be-processed service data based on the preset data processing time and a set index information generation rule.
15. The data processing apparatus according to claim 13 or 14, wherein the set index information generation rule is as follows:
a first determination unit configured to determine the index information generation time, the data statistics reference value, and the data statistics unit;
and the calculation unit is configured to determine a difference value of the index information generation time and the data statistics reference value, and calculate a ratio of the difference value of the index information generation time and the data statistics reference value to the data statistics unit as the index information.
16. The data processing apparatus according to claim 11, wherein the routing rule included in the pre-stored routing table and pointing to the preset database is determined by:
the second determining unit is configured to determine a preset database for storing the to-be-processed service data according to the storage space occupied by the to-be-processed service data, and determine index information of the to-be-processed service data;
and the constructing unit is configured to construct an incidence relation between the index information and the preset database as a routing rule pointing to the preset database and included in the routing table.
17. The data processing apparatus of claim 11, wherein the write module comprises:
the first obtaining unit is configured to obtain an available storage space of a preset database corresponding to each routing rule in the routing table, and predict an occupied storage space of the to-be-processed service data in a set time period;
the first generating unit is configured to acquire a new database and generate a new routing rule corresponding to the new database and new index information corresponding to the new routing rule under the condition that the occupied storage space of the to-be-processed service data in a set time period is larger than the available storage space of the preset database.
18. The data processing apparatus of claim 11, wherein the write module comprises:
a second obtaining unit, configured to obtain an available storage space of a preset database corresponding to each routing rule in the routing table, and compare the available storage space of the preset database with a preset space threshold;
a second generating unit configured to acquire a new database and generate a new routing rule corresponding to the new database and new index information corresponding to the new routing rule in a case where an available storage space of the preset database is smaller than the preset space threshold.
19. The data processing apparatus according to claim 17 or 18, further comprising:
an update module configured to update the routing rule to the new routing rule, the index information to the new index information, and the routing table to a new routing table;
correspondingly, the updating content of the new routing table comprises the following steps:
a new routing rule pointing to a new database, and new index information corresponding to the new routing rule.
20. The data processing apparatus according to claim 11, wherein the routing table includes the routing rule pointing to the preset database, further comprising:
adding an effective time stamp to the routing rule, wherein the effective time stamp is used for marking the effective time of the routing rule.
21. An electronic device, comprising:
a memory and a processor;
the memory is to store computer-executable instructions, and the processor is to execute the computer-executable instructions to:
acquiring service data to be processed;
determining index information corresponding to the to-be-processed business data, wherein the index information is generated in advance or generated in real time;
determining a corresponding routing rule in the routing table based on the index information;
and writing the service data to be processed into a corresponding preset database according to the routing rule.
22. A computer-readable storage medium storing computer instructions, which when executed by a processor implement the steps of the data processing method of any one of claims 1 to 10.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910294334.7A CN111813772B (en) | 2019-04-12 | 2019-04-12 | Data processing method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910294334.7A CN111813772B (en) | 2019-04-12 | 2019-04-12 | Data processing method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111813772A true CN111813772A (en) | 2020-10-23 |
| CN111813772B CN111813772B (en) | 2024-05-07 |
Family
ID=72843909
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910294334.7A Active CN111813772B (en) | 2019-04-12 | 2019-04-12 | Data processing method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111813772B (en) |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102930062A (en) * | 2012-11-30 | 2013-02-13 | 南京富士通南大软件技术有限公司 | Rapid horizontal extending method for databases |
| CN103714097A (en) * | 2012-10-09 | 2014-04-09 | 阿里巴巴集团控股有限公司 | Method and device for accessing database |
| CN104380667A (en) * | 2013-06-14 | 2015-02-25 | 华为技术有限公司 | Method and device for routing data message |
| US20150134562A1 (en) * | 2013-11-11 | 2015-05-14 | Bank Of America Corporation | Image index routing |
| CN105512200A (en) * | 2015-11-26 | 2016-04-20 | 华为技术有限公司 | Distributed database processing method and device |
| CN106294421A (en) * | 2015-05-25 | 2017-01-04 | 阿里巴巴集团控股有限公司 | A kind of data write, read method and device |
| US20170053276A1 (en) * | 2015-08-21 | 2017-02-23 | Green Dot Corporation | Systems and Methods for Transaction Routing |
| CN107016025A (en) * | 2016-11-17 | 2017-08-04 | 阿里巴巴集团控股有限公司 | A kind of method for building up and device of non-relational database index |
-
2019
- 2019-04-12 CN CN201910294334.7A patent/CN111813772B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103714097A (en) * | 2012-10-09 | 2014-04-09 | 阿里巴巴集团控股有限公司 | Method and device for accessing database |
| CN102930062A (en) * | 2012-11-30 | 2013-02-13 | 南京富士通南大软件技术有限公司 | Rapid horizontal extending method for databases |
| CN104380667A (en) * | 2013-06-14 | 2015-02-25 | 华为技术有限公司 | Method and device for routing data message |
| US20150134562A1 (en) * | 2013-11-11 | 2015-05-14 | Bank Of America Corporation | Image index routing |
| CN106294421A (en) * | 2015-05-25 | 2017-01-04 | 阿里巴巴集团控股有限公司 | A kind of data write, read method and device |
| US20170053276A1 (en) * | 2015-08-21 | 2017-02-23 | Green Dot Corporation | Systems and Methods for Transaction Routing |
| CN105512200A (en) * | 2015-11-26 | 2016-04-20 | 华为技术有限公司 | Distributed database processing method and device |
| CN107016025A (en) * | 2016-11-17 | 2017-08-04 | 阿里巴巴集团控股有限公司 | A kind of method for building up and device of non-relational database index |
Non-Patent Citations (1)
| Title |
|---|
| 陈康;王丹丹;: "关联规则数据结构分布重排的数据库索引算法", 科技通报, no. 10, 31 October 2015 (2015-10-31) * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111813772B (en) | 2024-05-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109495318B (en) | Mobile communication network flow prediction method, device and readable storage medium | |
| AU2017101862A4 (en) | Collaborative filtering method, apparatus, server and storage medium in combination with time factor | |
| CN105721629A (en) | User identifier matching method and device | |
| CN111767047A (en) | Micro-service component management method and device | |
| CN111966335A (en) | Platform creation method and device | |
| CN108875035B (en) | Data storage method of distributed file system and related equipment | |
| CN113297269A (en) | Data query method and device | |
| CN115660591A (en) | Process configuration method, system, electronic device and medium for business approval | |
| CN112766825A (en) | Enterprise financial service risk prediction method and device | |
| JP2021101382A (en) | Marketing support device, marketing support method and computer program | |
| CN111813772A (en) | Data processing method and device | |
| CN113343038A (en) | Data visualization display method and device | |
| JP6680663B2 (en) | Information processing apparatus, information processing method, prediction model generation apparatus, prediction model generation method, and program | |
| CN109241249B (en) | Method and device for determining burst problem | |
| CN111475492A (en) | Data processing method and device | |
| CN113297229A (en) | Method for routing read request and feedback message, respective device and database | |
| CN114385596A (en) | Data processing method and device | |
| CN112583667B (en) | Content delivery network link evaluation method and device | |
| CN115757639A (en) | Data source synchronization method and device, electronic equipment and storage medium | |
| CN110446167B (en) | Position estimation method and device | |
| CN114595245A (en) | Data processing method and device | |
| CN111522616A (en) | Page change method and device | |
| CN112579246B (en) | Virtual machine migration processing method and device | |
| CN111988401A (en) | Data uploading method and device | |
| CN112559872A (en) | Method, system, computer device and storage medium for identifying user between devices |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |