CN107085603B - Data processing method and device - Google Patents
Data processing method and device Download PDFInfo
- Publication number
- CN107085603B CN107085603B CN201710210430.XA CN201710210430A CN107085603B CN 107085603 B CN107085603 B CN 107085603B CN 201710210430 A CN201710210430 A CN 201710210430A CN 107085603 B CN107085603 B CN 107085603B
- Authority
- CN
- China
- Prior art keywords
- data
- version number
- database
- target data
- updated
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/23—Updating
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/219—Managing data history or versioning
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The embodiment of the invention provides a data processing method and a device, wherein the method comprises the following steps: processing target data in a database; after the target data are processed, comparing whether the version number of the processed target data is consistent with the version number of the target data stored in the current database or not, wherein the version number of each data stored in the database is correspondingly updated when each data is updated; and when the version number of the processed target data is inconsistent with the version number of the target data stored in the current database, processing the target data again. The embodiment of the invention can avoid data errors, ensure the consistency of the data and improve the accuracy of the data stored in the database.
Description
Technical Field
The present invention relates to the field of computer technologies, and in particular, to a data processing method and apparatus.
Background
With the rapid development of computer technology and internet technology, a great deal of various data is generated and updated every day on a network. For example, the amount of index data for video search on a video website has currently reached 5 hundred million mass data.
At present, a large amount of data is generally stored through various databases. And, the stored data can be processed correspondingly according to the requirement, and the processed data can be stored. For example, for a large amount of data stored in a database, batch processing may be performed on the data in the database periodically. The data processing may have various forms according to different business needs, for example, normalization processing may be performed on all data in the database, and the processed data may be stored. Meanwhile, according to specific service requirements, individual data can be subjected to real-time data processing, and the processed data can be stored.
In the prior art, when a data processing program process reads data from a database and is performing data processing, the data in the database may be updated. This will cause the data being processed to be out of date, so that after the data processing program completes the data processing, the stored processed data will not correspond to the updated data in the database, and further cause the data to be in error.
Disclosure of Invention
The embodiment of the invention aims to provide a data processing method and a data processing device so as to improve the accuracy of data stored in a database and avoid data errors. The specific technical scheme is as follows:
the embodiment of the invention discloses a data processing method, which comprises the following steps:
processing target data in a database;
after the target data are processed, comparing whether the version number of the processed target data is consistent with the version number of the target data stored in the database at present, wherein the version number of each data stored in the database is updated correspondingly when each data is updated;
and when the version number of the processed target data is inconsistent with the version number of the target data stored in the database, processing the target data again.
Optionally, the step of comparing whether the version number of the processed target data is consistent with the version number of the target data stored in the database after the target data is processed includes:
when a plurality of processes simultaneously process the target data, after each process finishes processing the target data, comparing whether the version number of the processed target data is consistent with the version number of the target data stored in the database at present.
Optionally, the method further includes:
monitoring whether the data stored in the database is updated or not;
and when the data is updated, synchronously updating the version number of the data.
Optionally, the database is an Hbase database, and the step of monitoring whether the data stored in the database is updated includes:
monitoring whether the data in the Hbase database is updated in real time through a coprocessor mechanism of the Hbase database;
when the data is updated, the step of synchronously updating the version number of the data comprises the following steps:
and when the data is updated, synchronously updating the version number of the data through the coprocessor mechanism.
Optionally, the step of synchronously updating the version number of the data includes:
acquiring a next version number of the current version number according to the current version number of the data and a preset version number sorting rule;
and determining the obtained version number as the version number of the data.
The embodiment of the invention also discloses a data processing device, which comprises:
the first processing module is used for processing target data in the database;
the comparison module is used for comparing whether the version number of the processed target data is consistent with the version number of the target data stored in the database or not after the target data is processed, wherein the version number of each data stored in the database is correspondingly updated when each data is updated;
and the second processing module is used for processing the target data again when the version number of the processed target data is inconsistent with the version number of the target data stored in the database at present.
Optionally, the comparing module is specifically configured to, when multiple processes simultaneously process the target data, after each process completes processing of the target data, compare whether the version number of the processed target data is consistent with the version number of the target data stored in the database at present.
Optionally, the apparatus further comprises:
the monitoring module is used for monitoring whether the data stored in the database is updated or not;
and the updating module is used for synchronously updating the version number of the data when the data is updated.
Optionally, the database is an Hbase database, and the monitoring module is specifically configured to monitor whether data in the Hbase database is updated in real time through a coprocessor mechanism of the Hbase database;
the updating module is specifically configured to update the version number of the data synchronously through the coprocessor mechanism when the data is updated.
Optionally, the update module is specifically configured to obtain a next version number of the current version number according to the current version number of the data and a preset version number sorting rule; and determining the obtained version number as the version number of the data.
In the data processing method and device provided by the embodiment of the invention, after data processing is completed, whether the data is updated or not can be judged according to the version number of the data, and when the version number of the data after the data processing is not consistent with the version number of the data in the database at the moment, the data is updated in the data processing process. Of course, not all of the advantages described above need to be achieved at the same time in the practice of any one product or method of the invention.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
FIG. 1 is a flow chart of a data processing method provided by an embodiment of the present invention;
fig. 2 is a schematic structural diagram of a data processing apparatus according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1, fig. 1 is a flowchart of a data processing method according to an embodiment of the present invention, including:
The method provided by the embodiment of the invention can be applied to electronic equipment. The electronic device may be a desktop computer, a portable computer, an intelligent mobile terminal, and the like.
A database refers to a collection of data that is stored together in a manner that can be shared by multiple users, has as little redundancy as possible, and is independent of the application. The database in the embodiment of the present invention may be one of various databases currently existing, such as Hbase database, DB2 database, SQL Server database, Sybase database, and the like.
The target data refers to a part or all of data stored in the database and required to be processed. The data processing refers to a process of processing data stored in a database according to different business requirements and corresponding rules, for example, the data can be normalized, dimensions contained in the data are removed, and the data are converted into pure values; or screening the data to remove the sinking data, and the like.
According to different specific needs, data can be processed in multiple ways, and a specific method for processing data belongs to the prior art and is not described herein again.
In the embodiment of the present invention, the electronic device may process data through various data processing programs or a data processing program of the database itself, and when processing the data, target data to be processed may be read from the database. For example, when the target data is stored in the database in the form of a table, the data processing program may first read the target data from the table of the database, and then perform the processing of the target data. After the processing is completed, the processed data can be stored in other databases, or stored in another table of the original database, or stored in a table of the original data in the original database and covers the original data in the original database.
And 102, after the target data are processed, comparing whether the version number of the processed target data is consistent with the version number of the target data stored in the current database or not. The version number of each data stored in the database is updated correspondingly when each data is updated.
In the embodiment of the present invention, the electronic device may correspondingly store the version number of the data in the database. The version number of the data can be used for corresponding to each update of the data, and whether the data is updated or not can be reflected through different version numbers.
For different types of databases, different forms of version numbers may be added to the data. For example, in the Hbase database, data is usually stored in a table form, so that a new column of version numbers can be added to an existing data storage table. Referring to table 1, table 1 is a data storage table in the Hbase database.
TABLE 1
| RowKey | Column a | b column | c column (a) | Version number |
| RowKey1 | A12 | B20 | C500 | 1 |
| RowKey2 | A15 | B21 | C600 | 3 |
RowKey in Table 1 indicates the row primary key in Hbase database for data query. Each row in the table represents a set of data. After each row, a version number may be added, which may be represented numerically, and which is updated each time one or more columns of data in a row are updated, in synchronization. For example, the numbers in the version number may be incremented by a preset value, thereby implementing the update of the version number.
After the electronic device has finished processing the extracted target data, it may determine whether or not the original target data stored in the database has been updated during the target data processing. When the electronic device reads the target data, the version number of the target data is read at the same time, so that after the target data is processed, the version number of the target data currently stored in the database can be read from the database, and whether the version number of the processed target data is consistent with the version number of the target data stored in the database is compared.
And 103, when the version number of the processed target data is inconsistent with the version number of the target data stored in the current database, processing the target data again.
Through comparison, if the version number of the processed target data is inconsistent with the version number of the target data stored in the current database, the version number is inconsistent because the target data stored in the database is updated during the processing of the target data by the data processing program.
At this time, since the target data is updated, the processed target data is expired, and there is no application meaning. The electronic device can discard the processed target data, read the updated target data from the database again, and perform data processing again. Of course, after the target data is processed again, the comparison of the version numbers can be performed again to ensure the accuracy of the processed data.
And when the version number of the processed target data is consistent with the version number of the target data stored in the current database, indicating that the target data stored in the database is not updated in the data processing process. In this case, the electronic device may store the processed target data.
The electronic device may store the target data to be processed in a next container. The container is used for storing data in computer technology, and in the embodiment of the present invention, the container may be other storage locations of the database storing the target data, or may be other databases besides the database storing the target data.
In the embodiment of the invention, the version number is added to the data in the database, the processed target data is compared with the version number of the target data stored in the database at the current moment when the target data is processed, whether the processed target data is updated or not can be timely found, the processed target data is overdue can be caused, when the version numbers are inconsistent, the processed target data is overdue, the target data in the database can be reprocessed, so that data errors are avoided, the consistency of the data is ensured, the accuracy of the data stored in the database is improved, and the updating operation of individual data can be simultaneously carried out during the processing of large batches of data without causing data errors.
Optionally, in the data processing method provided in the embodiment of the present invention, after the target data is processed, the step of comparing whether the version number of the processed target data is consistent with the version number of the target data stored in the current database may include:
when a plurality of processes process the target data at the same time, after each process finishes processing the target data, comparing whether the version number of the processed target data is consistent with the version number of the target data stored in the current database or not.
When processing target data in a database, a plurality of processes of a plurality of data processing programs often process the target data at the same time. For example, in a general application, a batch data processing operation is performed on all target data in the database periodically every day, and a real-time data processing operation can be performed on individual target data in the database at any time. When all target data are processed in batch and the individual target data are processed in real time, the same target data are processed.
In this case, each process can read the target data from the database and perform independent processing. After the post-processing is finished, each process can compare whether the version number of the processed target data is consistent with the version number of the target data stored in the current database, and if not, the process of the data is carried out again.
In practical applications, the target data may be processed in the same way by multiple processes, for example, in the above example, batch data processing operations performed periodically every day and real-time processing operations performed on individual target data may be performed on the same data, and the finally processed data may be stored in the same storage location. In this case, when the target data is updated while being processed, a problem of data overwriting each other also occurs.
For example, when the batch processing process has read the target data and starts processing the target data, the target data stored in the database is updated; the real-time processing process reads the updated target data, starts to process the data, and stores the processed target data in a preset position in a database after the processing is finished; and at the moment, the batch processing process also completes the processing of the target data, the processed target data is also stored in the preset position in the database, and the processed target data stored in the real-time processing process is covered.
The processed target data saved by the batch processing process at this time is a result obtained from the target data before update, is erroneous data, and also covers the correct processing result saved by the real-time processing process.
After each process finishes the processing of the target data, whether the target data is updated or not is judged according to the version number, and the situation can be avoided.
For example, when the batch processing process has read the target data and starts processing the target data, the target data stored in the database is updated, and the version number of the target data is updated synchronously; the real-time processing process reads the updated target data and starts to process the data, and after the processing is finished, the version number of the processed target data is found to be consistent with the version number of the target data in the current database through judgment, so that the processed target data is stored at a preset position in the database after the processing is finished; the batch processing process also completes the processing of the target data, and the version number of the processed target data is found to be inconsistent with the version number of the target data in the current database through judgment, so that the processed target data is abandoned, the processing of the target data is carried out again, or the operation of the data processing can be abandoned. Thereby avoiding saving erroneous data.
When multiple processes process the target data at the same time, after each process finishes the processing of the target data, whether the target data is updated is judged according to the version number of the target data, so that the coverage of error data on correct data is avoided, and data errors are further avoided.
Optionally, in the data processing method provided in the embodiment of the present invention, the method further includes:
the first step is to monitor whether the data stored in the database is updated.
In the embodiment of the invention, the electronic equipment can monitor the data in the database in real time and monitor whether the data is updated or not. Specifically, there are different ways for monitoring data in different databases, for example, the database may be monitored in real time through an additional program, or whether the data in the database is updated is monitored through a plug-in or a subroutine of the database itself.
The data updating and the various data processing on the data are not necessarily connected and are independent processes, and the data updating can be carried out at any time, so that the monitoring on the data updating is carried out in real time.
And step two, when the data is updated, synchronously updating the version number of the data.
When the data in the database is monitored to be updated, the version number can be updated synchronously. The version number may be updated by a preset update program, and a specific update program may be developed by a person skilled in the art through various programming languages for different database types, which belongs to the prior art and is not described herein again.
In the embodiment of the invention, the data in the database is monitored in real time, when the data is updated, the version number of the data can be updated in time, the monitoring of the data updating and the synchronous updating of the version number can be realized through additional programs, the monitoring and the synchronous updating of the version number are not coupled with the data processing process, the management of the data in the database and the processing of the data are facilitated, and the efficiency of processing the data is improved.
Optionally, in the data processing method provided in the embodiment of the present invention, when the database is the Hbase database, the step of monitoring whether the data stored in the database is updated may include:
and monitoring whether the data in the Hbase database is updated in real time through a coprocessor mechanism of the Hbase database.
The Hbase database is a distributed storage system which is high in reliability, high in performance, column-oriented and telescopic, and a large-scale structured storage cluster can be built on a cheap server by utilizing the HBase technology. The Hbase database has been widely used.
The coprocessor mechanism of the Hbase database can enable a developer to execute a self-defined code at a server side to complete certain functions.
The updating operation of the data in the Hbase database can be monitored in real time through a coprocessor mechanism of the Hbase database, and the updated data can be synchronously detected when the data is updated every time.
When the data is updated, the step of synchronizing the version number of the updated data may include:
when the data is updated, the version number of the data is synchronously updated through the coprocessor mechanism.
When a coprocessor mechanism of the Hbase database monitors that data is updated, the version number of the data can be synchronously updated. For example, the coprocessor mechanism of the Hbase database can synchronously modify the version number corresponding to the data in the data table when the data in the data table of the Hbase database is updated.
In the embodiment of the invention, when the Hbase database is used, the data updating in the database is monitored through a coprocessor mechanism of the Hbase database, and the version number of the data is synchronously updated when the data is updated. By a coprocessor mechanism of the Hbase database, coupling between a data processing program and the database can be reduced, and a uniform standard is formed conveniently. Moreover, the problem is solved by the characteristic of Hbase, and the development cost is reduced.
Optionally, in the data processing method provided in the embodiment of the present invention, the step of synchronously updating the version number of the data may include:
the first step, according to the current version number of the data and the preset version number sorting rule, the next version number of the current version number is obtained.
The version number may be expressed in various ways, for example, the version number may be a number or a letter.
When the version number is a number, the preset version number sorting rule may be that the current version number is accumulated by a preset value, so as to obtain a next version number of the current version number. For example, immediately after data is written into a database, the initial version number may be 0 since data does not exist before, the version number may be incremented by 1 every time the data is updated, and the next version number of the current version number is 1 when the data is updated for the first time.
When the version number is a letter, the preset version number sorting rule can be that sorting is performed according to the arrangement sequence of the English letters, and 26 English letters are recycled, so that the next version number of the current version number is obtained. For example, the initial version number may be a when data is just written to the database, and the next version number to the current version number when the data is first updated may be B.
And secondly, determining the acquired version number as the version number of the data.
And updating the version number corresponding to the data into the obtained next version number after obtaining the next version number according to the current version number through a preset version number sequencing rule, thereby finishing updating the data version number.
In the embodiment of the invention, the next version number of the current version number is obtained according to the current version number through the preset version number sorting rule, so that the version number can be updated more orderly, the data updating times can be known through the version number, and the management and the application of data in a database are facilitated.
Referring to fig. 2, fig. 2 is a block diagram of a data processing apparatus according to an embodiment of the present invention, including:
a first processing module 201, configured to process target data in a database;
the comparing module 202 is configured to compare whether the version number of the processed target data is consistent with the version number of the target data stored in the current database after the target data is processed. The version number of each data stored in the database is updated correspondingly when each data is updated;
and the second processing module 203 is configured to, when the version number of the target data is inconsistent with the version number of the target data stored in the current database, re-process the target data.
In the embodiment of the invention, the version number is added to the data in the database, the processed target data is compared with the version number of the target data stored in the database at the current moment when the target data is processed, whether the processed target data is updated or not can be timely found, the processed target data is overdue can be caused, when the version numbers are inconsistent, the processed target data is overdue, the target data in the database can be reprocessed, so that data errors are avoided, the consistency of the data is ensured, the accuracy of the data stored in the database is improved, and the updating operation of individual data can be simultaneously carried out during the processing of large batches of data without causing data errors.
The device of the embodiment of the invention is a device applying the data processing method, so that all the embodiments of the data processing method are suitable for the device and can achieve the same or similar beneficial effects.
Optionally, in the data processing apparatus provided in the embodiment of the present invention, the comparison module 202 is specifically configured to, when a plurality of processes are simultaneously performing processing on the target data, compare whether the version number of the processed target data is consistent with the version number of the target data stored in the current database after each process completes the processing on the target data.
Optionally, in the data processing apparatus provided in the embodiment of the present invention, the apparatus further includes:
a monitoring module (not shown in the figure) for monitoring whether the data stored in the database is updated;
and an updating module (not shown in the figure) for synchronizing the version number of the updated data when the data is updated.
Optionally, in the data processing apparatus provided in the embodiment of the present invention, when the database is the Hbase database, the monitoring module is specifically configured to monitor whether data in the Hbase database is updated in real time through a coprocessor mechanism of the Hbase database;
and the updating module is specifically used for synchronously updating the version number of the data through a coprocessor mechanism when the data is updated.
Optionally, in the data processing apparatus provided in the embodiment of the present invention, the update module is specifically configured to obtain a next version number of the current version number according to the current version number of the data and a preset version number sorting rule. And determining the acquired version number as the version number of the data.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
All the embodiments in the present specification are described in a related manner, and the same and similar parts among the embodiments may be referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, for the system embodiment, since it is substantially similar to the method embodiment, the description is simple, and for the relevant points, reference may be made to the partial description of the method embodiment.
The above description is only for the preferred embodiment of the present invention, and is not intended to limit the scope of the present invention. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention shall fall within the protection scope of the present invention.
Claims (10)
1. A data processing method, comprising:
processing target data in a database;
after the target data are processed, comparing whether the version number of the processed target data is consistent with the version number of the target data stored in the database at present, wherein the version number of each data stored in the database is updated correspondingly when each data is updated;
when the version number of the processed target data is inconsistent with the version number of the target data stored in the database, the target data is processed again;
the processing of the target data in the database includes: and performing data processing of corresponding rules on the target data in the database according to different service requirements.
2. The method of claim 1, wherein comparing whether the version number of the processed target data is consistent with the version number of the target data currently stored in the database after the processing of the target data is completed comprises:
when a plurality of processes simultaneously process the target data, after each process finishes processing the target data, comparing whether the version number of the processed target data is consistent with the version number of the target data stored in the database at present.
3. The method of claim 1, further comprising:
monitoring whether the data stored in the database is updated or not;
and when the data is updated, synchronously updating the version number of the data.
4. The method of claim 3, wherein the database is an Hbase database, and wherein the step of monitoring whether the data stored in the database is updated comprises:
monitoring whether the data in the Hbase database is updated in real time through a coprocessor mechanism of the Hbase database;
when the data is updated, the step of synchronously updating the version number of the data comprises the following steps:
and when the data is updated, synchronously updating the version number of the data through the coprocessor mechanism.
5. The method of claim 3, wherein the step of synchronously updating the version number of the data comprises:
acquiring a next version number of the current version number according to the current version number of the data and a preset version number sorting rule;
and determining the obtained version number as the version number of the data.
6. A data processing apparatus, comprising:
the first processing module is used for processing target data in the database;
the comparison module is used for comparing whether the version number of the processed target data is consistent with the version number of the target data stored in the database or not after the target data is processed, wherein the version number of each data stored in the database is correspondingly updated when each data is updated;
the second processing module is used for processing the target data again when the version number of the processed target data is inconsistent with the version number of the target data stored in the database at present;
the first processing module is specifically configured to perform data processing according to corresponding rules on target data in the database according to different service requirements.
7. The apparatus according to claim 6, wherein the comparing module is specifically configured to, when a plurality of processes are simultaneously performing processing on the target data, compare whether a version number of the processed target data is consistent with a version number of the target data currently stored in the database after each process completes the processing on the target data.
8. The apparatus of claim 6, further comprising:
the monitoring module is used for monitoring whether the data stored in the database is updated or not;
and the updating module is used for synchronously updating the version number of the data when the data is updated.
9. The apparatus according to claim 8, wherein the database is an Hbase database, and the monitoring module is specifically configured to monitor whether the data in the Hbase database is updated in real time through a coprocessor mechanism of the Hbase database;
the updating module is specifically configured to update the version number of the data synchronously through the coprocessor mechanism when the data is updated.
10. The apparatus according to claim 8, wherein the updating module is specifically configured to obtain a next version number of the current version number according to a current version number of the data and a preset version number sorting rule; and determining the obtained version number as the version number of the data.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710210430.XA CN107085603B (en) | 2017-03-31 | 2017-03-31 | Data processing method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710210430.XA CN107085603B (en) | 2017-03-31 | 2017-03-31 | Data processing method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107085603A CN107085603A (en) | 2017-08-22 |
| CN107085603B true CN107085603B (en) | 2020-04-03 |
Family
ID=59615293
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710210430.XA Active CN107085603B (en) | 2017-03-31 | 2017-03-31 | Data processing method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107085603B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108388438B (en) * | 2018-02-07 | 2021-04-23 | 平安普惠企业管理有限公司 | System base table updating method and device, computer equipment and storage medium |
| CN109299194A (en) * | 2018-09-25 | 2019-02-01 | 平安科技（深圳）有限公司 | Multi-edition data memory management method and device, electronic equipment, storage medium |
| CN110134670A (en) * | 2019-05-16 | 2019-08-16 | 拉扎斯网络科技（上海）有限公司 | Date storage method, device, electronic equipment and computer readable storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1522409A (en) * | 2001-06-09 | 2004-08-18 | 存储交易株式会社 | Cache-conscious concurrency control scheme for database systems |
| CN103744936A (en) * | 2013-12-31 | 2014-04-23 | 华为技术有限公司 | Multi-version concurrency control method in database and database system |
| CN104469474A (en) * | 2014-10-28 | 2015-03-25 | 深圳国微技术有限公司 | Channel list updating method and device, and terminal device |
| CN105095313A (en) * | 2014-05-22 | 2015-11-25 | 阿里巴巴集团控股有限公司 | Data access method and equipment |
| CN105843895A (en) * | 2016-03-22 | 2016-08-10 | 北京建飞无限科技有限公司 | EhCache-based data querying and synchronizing method, device and system |
| CN106294607A (en) * | 2016-07-29 | 2017-01-04 | 北京奇虎科技有限公司 | Data cached update method and updating device |
-
2017
- 2017-03-31 CN CN201710210430.XA patent/CN107085603B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1522409A (en) * | 2001-06-09 | 2004-08-18 | 存储交易株式会社 | Cache-conscious concurrency control scheme for database systems |
| CN103744936A (en) * | 2013-12-31 | 2014-04-23 | 华为技术有限公司 | Multi-version concurrency control method in database and database system |
| CN105095313A (en) * | 2014-05-22 | 2015-11-25 | 阿里巴巴集团控股有限公司 | Data access method and equipment |
| CN104469474A (en) * | 2014-10-28 | 2015-03-25 | 深圳国微技术有限公司 | Channel list updating method and device, and terminal device |
| CN105843895A (en) * | 2016-03-22 | 2016-08-10 | 北京建飞无限科技有限公司 | EhCache-based data querying and synchronizing method, device and system |
| CN106294607A (en) * | 2016-07-29 | 2017-01-04 | 北京奇虎科技有限公司 | Data cached update method and updating device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107085603A (en) | 2017-08-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110292775B (en) | Method and device for acquiring difference data | |
| CN107085603B (en) | Data processing method and device | |
| JP2013504118A (en) | Information retrieval based on query semantic patterns | |
| CN106407360B (en) | Data processing method and device | |
| CN110837520A (en) | Data processing method, platform and system | |
| US9454561B2 (en) | Method and a consistency checker for finding data inconsistencies in a data repository | |
| CN110134738B (en) | Distributed storage system resource estimation method and device | |
| CN108846117A (en) | The duplicate removal screening technique and device of business news flash | |
| CN110659282A (en) | Data route construction method and device, computer equipment and storage medium | |
| KR100491250B1 (en) | Method and System for registering goods information | |
| CN106844320B (en) | Financial statement integration method and equipment | |
| CN114461644A (en) | Data acquisition method and device, electronic equipment and storage medium | |
| CN105095436A (en) | Automatic modeling method for data of data sources | |
| CN112364014A (en) | Data query method, device, server and storage medium | |
| CN111984673B (en) | Fuzzy retrieval method and device for tree structure of power grid electric energy metering system | |
| CN116261779A (en) | Data processing method, system and computer readable storage medium | |
| CN111475464B (en) | Method for automatically finding and mining fingerprints of Web component | |
| CN115544215B (en) | Associated object acquisition method, medium and equipment | |
| CN111858581A (en) | Page query method and device, storage medium and electronic equipment | |
| CN110688995A (en) | Map query processing method, computer-readable storage medium and mobile terminal | |
| CN107679908B (en) | Salesperson topic auxiliary query method, electronic device and storage medium | |
| CN107368464B (en) | Method and device for acquiring bidding product information | |
| CN106682107B (en) | Method and device for determining incidence relation of database table | |
| CN109785099B (en) | Method and system for automatically processing service data information | |
| CN113032368A (en) | Data migration method and device, storage medium and platform |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |