CN104156420A - Method and device for managing transaction journal - Google Patents
Method and device for managing transaction journal Download PDFInfo
- Publication number
- CN104156420A CN104156420A CN201410383979.5A CN201410383979A CN104156420A CN 104156420 A CN104156420 A CN 104156420A CN 201410383979 A CN201410383979 A CN 201410383979A CN 104156420 A CN104156420 A CN 104156420A
- Authority
- CN
- China
- Prior art keywords
- transaction
- duplicate removal
- transaction operation
- operational zone
- journal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/1805—Append-only file systems, e.g. using logs or journals to store data
- G06F16/1815—Journaling file systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/17—Details of further file system functions
- G06F16/174—Redundancy elimination performed by the file system
- G06F16/1748—De-duplication implemented within the file system, e.g. based on file segments
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a method and device for managing a transaction journal. The method for managing the transaction journal comprises the steps of determining all transaction operations corresponding to the transaction journal, conducting duplication eliminating on the determined transaction operations, and generating a new transaction journal according to the transaction operations after duplication eliminating. The device for managing the transaction journal comprises a determining module, a duplication eliminating module and a generating module. The determining module is used for determining all transaction operations corresponding to the transaction journal. The duplication eliminating module is used for conducting duplication eliminating on the determined transaction operations. The generating module is used for generating the new transaction journal according to the transaction operations after duplication eliminating. According to the method and device for managing the transaction journal, the data size of journal equipment is reduced, so that after breakdown happens to a duplicate of metadata, the scale of the journal data reserved by other duplicates is lowered, thus the time for tolerating duplicate breakdown time of a file system is prolonged, and the time for repairing breakdown metadata is shortened.
Description
Technical field
The present invention relates to computer realm, specifically, relate to a kind of management method and device of transaction journal.
Background technology
In file system, daily record technology refers to before amendment metadata, metadata is revised pre-recorded to daily record equipment, so that after file system is collapsed, can file system recovery be arrived to consistent state by the mode of application daily record, really be applied to after physical disk in metadata amendment, this part log space of daily record equipment will be recovered to again utilize.
Daily record technology can be converted into a daily record data synchronous operation by multiple metadata synchronization operations, and, in the time that metadata is modified, file system also has journalizing on the basis of original operation, because up-to-date metadata amendment is to be recorded on daily record equipment with the form of daily record data, therefore after system crash, as long as metadata amendment is recorded on daily record equipment, after system is recovered normally, system still can not lose this part metadata amendment by reusing this part daily record data so.Wherein, metadata amendment is to be recorded on daily record equipment with the form of affairs, and, in these affairs, recording all information of revising metadata, therefore, system can be reappeared all metadata amendments that a metadata amendment request relates to by transaction journal, thereby realizes the consistance of metadata.
But, in the file system based on the many copies of metadata, after a copy breaks down, in order to ensure the consistance of metadata, other copies need for fault copy retains daily record data, so that fault copy returns to behind trouble spot, the daily record data that is its reservation according to other copies again, return to the state consistent with other metadata copies, that is, and the last state of metadata copy.But, along with the growth of fault-time of fault copy, other copies are that the daily record data scale of its reservation is also in continuous increase, and the storage size of daily record equipment defines the copy fault-time that system can be tolerated, cause the copy that whole file system can be tolerated to shorten fault-time; In addition,, because the failure recovery time of copy and the daily record data scale of record are directly proportional, therefore, along with the growth of time of copy fault, the time that copy fault restoration needs is also longer.
As can be seen here, in the time that the copy of metadata breaks down, existing daily record technology is long problem short and fault copy repair time copy fault-time of having that file system can tolerate.
The copy fault-time that can tolerate for file system in correlation technique, short and fault copy long problem repair time, not yet proposed effective solution at present.
Summary of the invention
The copy fault-time that can tolerate for file system in correlation technique short and fault copy long problem repair time, the present invention proposes a kind of management method and device of transaction journal, can be recorded to by minimizing the mode of the data volume of daily record equipment, the copy that file system can be tolerated is elongated fault-time, and makes fault copy obtain minimizing repair time.
Technical scheme of the present invention is achieved in that
A kind of management method of transaction journal is provided according to an aspect of the present invention.
The management method of this transaction journal comprises:
Determine the corresponding all transaction operations of transaction journal;
Definite transaction operation is carried out to duplicate removal;
According to the transaction operation after duplicate removal, generate new transaction journal.
Wherein, the management method of this transaction journal also can comprise: before the transaction operation to definite carries out duplicate removal, according to the corresponding Action Target of transaction operation, transaction operation is divided into groups, generate multiple transaction operation groups;
Correspondingly, in the time that the transaction operation to definite carries out duplicate removal, be that the transaction operation in each transaction operation group is carried out to duplicate removal.
In such scheme, in the time that the transaction operation to definite carries out duplicate removal, can determine between the operational zone of each transaction operation, and to analyzing between operational zone to determine between operational zone, whether having repetitive operation interval; And in the situation that there is repetitive operation interval between definite operational zone, the transaction operation that has repetitive operation interval is carried out to duplicate removal.
In addition, in the time that the transaction operation to definite carries out duplicate removal, before also can analyzing between to operational zone, according to predetermined sortord to sorting between operational zone.
Wherein, this predetermined sortord comprises according to the beginning skew between the operational zone of transaction operation and sorts or sort according to the end skew between the operational zone of transaction operation.
A kind of management devices of transaction journal is provided according to a further aspect in the invention.
The management devices of this transaction journal comprises:
Determination module, for determining the corresponding all transaction operations of transaction journal;
Duplicate removal module, carries out duplicate removal for the transaction operation to definite;
Generation module, for according to the transaction operation after duplicate removal, generates new transaction journal.
In addition, the management devices of this transaction journal also comprises: grouping module, before carrying out duplicate removal for the affairs to definite, according to the corresponding Action Target of transaction operation, transaction operation is divided into groups, and generate multiple transaction operation groups;
Correspondingly, duplicate removal module is for carrying out duplicate removal to the transaction operation of each transaction operation group.
In such scheme, duplicate removal module can comprise definite submodule, analyze submodule and duplicate removal submodule; Wherein, determine submodule, for determining between the operational zone of each transaction operation; Analyze submodule, for to analyzing between operational zone, determine between operational zone, whether there is repetitive operation interval; Duplicate removal submodule, in the situation that there is repetitive operation interval between definite operational zone, carries out duplicate removal to the transaction operation that has repetitive operation interval.
In addition, duplicate removal module also comprises order module, before analyzing between to operational zone, according to predetermined sortord to sorting between operational zone.
Wherein, predetermined sortord comprises according to the beginning skew between the operational zone of transaction operation and sorts or sort according to the end skew between the operational zone of transaction operation.
The present invention is by the duplicate removal to transaction operation in transaction journal, the data volume that has realized daily record equipment reduces, thereby make after the copy of metadata breaks down, the scale of the daily record data that to have reduced other copies be its reservation, and then extended the copy fault-time that file system can be tolerated, and reduce the time that fault metadata need to be repaired.
Brief description of the drawings
In order to be illustrated more clearly in the embodiment of the present invention or technical scheme of the prior art, to the accompanying drawing of required use in embodiment be briefly described below, apparently, accompanying drawing in the following describes is only some embodiments of the present invention, for those of ordinary skill in the art, do not paying under the prerequisite of creative work, can also obtain according to these accompanying drawings other accompanying drawing.
Fig. 1 is according to the process flow diagram of the management method of the transaction journal of the embodiment of the present invention;
Fig. 2 is according to the daily record data polymerization process figure of the single affairs inside of the embodiment of the present invention;
Fig. 3 is the organizational form schematic diagram in internal memory according to the transaction journal after the polymerization of the embodiment of the present invention;
Fig. 4 is according to the structural drawing of the management devices of the transaction journal of the embodiment of the present invention.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is clearly and completely described, obviously, described embodiment is only the present invention's part embodiment, instead of whole embodiment.Based on the embodiment in the present invention, the every other embodiment that those of ordinary skill in the art obtain, belongs to the scope of protection of the invention.
According to embodiments of the invention, provide a kind of management method of transaction journal.
As shown in Figure 1, comprise according to the management method of the transaction journal of the embodiment of the present invention:
Step S101, determines the corresponding all transaction operations of transaction journal;
Step S103, carries out duplicate removal to definite transaction operation;
Step S105, according to the transaction operation after duplicate removal, generates new transaction journal.
By means of above-mentioned steps of the present invention, by the duplicate removal to transaction operation in transaction journal, the data volume that has realized daily record equipment reduces, thereby make after the copy of metadata breaks down, the scale of the daily record data that to have reduced other copies be its reservation, and then extended the copy fault-time that file system can be tolerated, and reduce the time that fault metadata need to be repaired.
In addition, in one embodiment, in order to improve the efficiency of transaction operation duplicate removal, reduce the difficulty of transaction operation duplicate removal, the management method of this transaction journal also can comprise: before the transaction operation to definite carries out duplicate removal, according to the corresponding Action Target of transaction operation, transaction operation is divided into groups, and generate multiple transaction operation groups.
And in the time of practical application, this Action Target can be the corresponding meta data file of each transaction operation, divide into groups according to its corresponding different meta data files by all transaction operations in transaction journal, generate with the corresponding transaction operation group of different meta data files.
In addition, in another embodiment, in order further to improve the efficiency of transaction operation duplicate removal, reduce the difficulty of transaction operation duplicate removal, can also be to the transaction operation in each transaction operation group, storage area size according to meta data file is carried out refinement grouping, for example, in the time that the storage area size of meta data file is 30M, the storage area size of this meta data file can be carried out to decile, separate the storage area of 3 10M sizes, now corresponding the storage area of each 10M all transaction operations are assigned as to one group, so can carry out 3 groups of parallel duplicate removal processing to all transaction operations of meta data file, thereby effectively improve the efficiency of transaction operation duplicate removal, reduce the difficulty of transaction operation duplicate removal.
In addition it should be noted in the discussion above that in the present invention,, technical scheme of the present invention does not limit the big or small partitioning scheme in above-mentioned metadata store region, that is to say, in the time of practical application, technique scheme of the present invention can also adopt other similar predetermined segmentation strategy.
In addition, in the above-described embodiments, because all transaction operations to meta data file divide into groups, generate multiple transaction operation groups, therefore, in the time of practical application, in the time that the transaction operation to definite carries out duplicate removal, be that the transaction operation in each transaction operation group is carried out to duplicate removal.
In addition, in one embodiment, in the time that the transaction operation to definite carries out duplicate removal, can first determine between the operational zone of each transaction operation, and to analyzing between operational zone, determine between operational zone, whether there is repetitive operation interval, and determining there is repetitive operation interval between operational zone in the situation that, the transaction operation that has repetitive operation interval is carried out to duplicate removal.
In addition, In yet another embodiment, before analyzing between to operational zone, in order better and easily to determine between operational zone whether have repetitive operation interval, can also be according to predetermined sortord to sorting between operational zone.
In the time of practical application, above-mentioned predetermined sortord can be to sort according to the skew that starts between the operational zone of transaction operation, can be also to sort according to the end skew between the operational zone of transaction operation.In addition, should be noted that, in the present invention, be the easy-to-look-up transaction operation with same operation interval for the object sorting between operational zone, thereby improve existing the transaction operation in repetitive operation interval to carry out the efficiency of duplicate removal, therefore, in the present invention, do not limit for the sortord between the operational zone of transaction operation, its can be also do not enumerate other can improve the sortord between the operational zone that transaction operation to there is repetitive operation interval carries out deduplicated efficiency.
In such scheme, what between operational zone, refer to is the corresponding Update Table of transaction operation corresponding physical storage address interval in storage system, starting skew, what refer to is the start address in this physical storage address interval, and what finish that skew refers to is the end address in this physical storage address interval.
Can find out according to such scheme of the present invention, the copy problem short and fault copy length repair time fault-time that the present invention can tolerate for file system has provided solution, in actual applications, can be that the mode that the daily record data of single affairs inside is carried out to polymerization reduces the daily record data amount in daily record equipment, can be also that the mode that the continuous affairs of a collection of transaction number are carried out to data aggregate reduces the daily record data amount in daily record equipment.
For convenient understanding technique scheme of the present invention, be polymerized to example with the daily record data of single affairs inside below, technique scheme of the present invention is elaborated.
Fig. 2 is the process flow diagram of the daily record data polymerization of single affairs inside, as can be seen from Figure 2, these single affairs relate to 3 meta data files (in the time of practical application, the quantity of the meta data file relating to for office is restriction not, just schematically illustrate as an example of 3 meta data files example herein), idiographic flow is as follows:
First, the operation of recording in affairs is classified by related file in operation, generate three groups of three groups of operations that relate separately to file f ile1, file f ile2 and file f ile3;
Secondly, to the operation (operation of each file) in every group, according to starting skew (operation skew) operation is reordered (initial order of operation is time sequencing) between operational zone;
Again, for the operation completing for every group of internal sort, for the operation having between coincidence operational zone, upgrade between its operational zone and form between new operational zone, to reach the object of duplicate removal operation; And to every group of operation after duplicate removal, according to the time sequencing of operation, upgrade the data between the new operational zone producing;
Finally, every group of operation (for the operation of different files) is integrated into new affairs, forms the affairs based on meta data file, and replace the original affairs based on operation
Can find out from above-mentioned idiographic flow, by means of above-mentioned daily record data polymerization process of the present invention, can be to the affairs based on operation, by the operation in affairs is pressed to document classification, and by the mode reordering, operation is carried out to polymerization (duplicate removal), thereby reduce the data volume in daily record equipment, and by the daily record data after polymerization, be integrated into the new affairs taking meta data file as unit, metadata amendment record is organized, and the atomicity of new affairs is the same with the operation atomicity that old affairs ensure.
Organizational form for the affairs after polymerization (based on the affairs of meta data file) in internal memory as shown in Figure 3, the organizational form schematic diagram of transaction journal after Fig. 3 polymerization in internal memory, as can be seen from Figure 3, should the affairs based on meta data file there be four class data to combine, specific as follows:
1, atomicity information: the linked list head of the meta data file that the unique identification that comprises affairs and transaction operation relate to, wherein meta data file is organized by the mode of chained list;
2, operand information: the gauge outfit of the information that comprises meta data file and the operation chained list to this file, wherein, to the operation of this file according to starting to be offset orderly being added on this chained list;
3, operation information: type and the operation skew of recording each operation, wherein, the type of operation is divided into deletion (unlink), create (), upgrade (offeset, length), wherein offset is offset for starting, the address size that length is Update Table;
4, metadata: record actual content metadata.
In the time of practical application, for the flow process of the daily record data polymerization between the continuous affairs of multiple transaction numbers, than the above-mentioned data aggregate flow process of single affairs inside, its difference is only, after completing the operation of each affairs divided into groups, also need the operational group of the identical file relating between multiple affairs to be integrated into again a large file operation group, then this large file operation group is carried out to data aggregate.Therefore,, for the flow process of the daily record data polymerization between the continuous affairs of multiple transaction numbers, just do not set forth one by one at this.
Identical with the daily record data polymerization of single affairs is, after daily record data polymerization between the continuous affairs of multiple transaction numbers completes, the new affairs of formation also have atomicity, and, these affairs are the uniquely identifieds using transaction number interval as affairs, this identification method can identify uniqueness and the ordinal relation of affairs after polymerization, can also embody the corresponding relation of polymerization front and back affairs, and the atomicity with the affairs in transaction number interval has also ensured the corresponding atomicity taking the transaction number in this interval as a collection of affairs of mark.
In addition,, according to embodiments of the invention, also provide a kind of management devices of transaction journal.
As shown in Figure 4, comprise according to the management devices of the transaction journal of the embodiment of the present invention:
Determination module 41, for determining the corresponding all transaction operations of transaction journal;
Duplicate removal module 42, carries out duplicate removal for the transaction operation to definite;
Generation module 43, for according to the transaction operation after duplicate removal, generates new transaction journal.
In one embodiment, in order to improve the efficiency of transaction operation duplicate removal, reduce the difficulty of transaction operation duplicate removal, the management devices of this transaction journal also comprises: grouping module (not shown), for before the affairs to definite are carried out duplicate removal, according to the corresponding Action Target of transaction operation, transaction operation is divided into groups, generate multiple transaction operation groups; And correspondingly, 42 of duplicate removal modules are for carrying out duplicate removal to the transaction operation of each transaction operation group.
In addition, in another embodiment, duplicate removal module 42 can comprise determines submodule (not shown), analysis submodule (not shown) and duplicate removal submodule (not shown); Wherein, determine submodule, for determining between the operational zone of each transaction operation; Analyze submodule, for to analyzing between operational zone, determine between operational zone, whether there is repetitive operation interval; Duplicate removal submodule, in the situation that there is repetitive operation interval between definite operational zone, carries out duplicate removal to the transaction operation that has repetitive operation interval.
In addition, in one embodiment, duplicate removal module 42 can also comprise order module (not shown), before analyzing between to operational zone, according to predetermined sortord to sorting between operational zone.
Wherein, this predetermined sortord can be to sort according to the skew that starts between the operational zone of transaction operation, can be also to sort according to the end skew between the operational zone of transaction operation; In addition, should be noted that, in the present invention, be the easy-to-look-up transaction operation with same operation interval for the object sorting between operational zone, thereby improve existing the transaction operation in repetitive operation interval to carry out the efficiency of duplicate removal, therefore, in the present invention, do not limit for the sortord between the operational zone of transaction operation, its can be also do not enumerate other can improve the sortord between the operational zone that transaction operation to there is repetitive operation interval carries out deduplicated efficiency.
In sum, by means of technique scheme of the present invention, carry out duplicate removal by the repetitive operation interval to operating in affairs, realize the polymerization to redundant data in transaction journal, thereby the data volume of daily record equipment records is reduced, make in the time that a copy of metadata breaks down, the copy that whole file system can be tolerated is elongated fault-time; And, because the fault correction time of metadata is directly proportional to scale of Web logs, make under same application scenarios and identical metadata copy fault-time the time decreased that metadata reparation needs.
The foregoing is only preferred embodiment of the present invention, in order to limit the present invention, within the spirit and principles in the present invention not all, any amendment of doing, be equal to replacement, improvement etc., within all should being included in protection scope of the present invention.
Claims (10)
1. a management method for transaction journal, is characterized in that, comprising:
Determine the corresponding all transaction operations of described transaction journal;
The described transaction operation of determining is carried out to duplicate removal;
According to the transaction operation after duplicate removal, generate new transaction journal.
2. management method according to claim 1, is characterized in that, further comprises:
Before the described transaction operation of determining is carried out to duplicate removal, according to the corresponding Action Target of described transaction operation, described transaction operation is divided into groups, generate multiple transaction operation groups;
And, the described transaction operation of determining is carried out to duplicate removal and comprises:
Transaction operation in described each transaction operation group is carried out to duplicate removal.
3. management method according to claim 1 and 2, is characterized in that, the described transaction operation of determining is carried out to duplicate removal and comprise:
Determine between the operational zone of each transaction operation;
To analyzing between described operational zone, determine between described operational zone, whether there is repetitive operation interval;
In the situation that there is repetitive operation interval between definite described operational zone, the transaction operation that has repetitive operation interval is carried out to duplicate removal.
4. management method according to claim 3, is characterized in that, the described transaction operation of determining is carried out to duplicate removal and also comprise:
Before analyzing between to described operational zone, according to predetermined sortord to sorting between described operational zone.
5. management method according to claim 4, is characterized in that, described predetermined sortord comprises:
Sort or be offset and sort according to the end between the operational zone of described transaction operation according to the skew that starts between the operational zone of described transaction operation.
6. a management devices for transaction journal, is characterized in that, comprising:
Determination module, for determining the corresponding all transaction operations of described transaction journal;
Duplicate removal module, for carrying out duplicate removal to the described transaction operation of determining;
Generation module, for according to the transaction operation after duplicate removal, generates new transaction journal.
7. management devices according to claim 6, is characterized in that, further comprises:
Grouping module, for before the described affairs of determining are carried out to duplicate removal, according to the corresponding Action Target of described transaction operation, divides into groups to described transaction operation, generates multiple transaction operation groups;
And described duplicate removal module is also for carrying out duplicate removal to the transaction operation of described each transaction operation group.
8. according to the management devices described in claim 6 or 7, it is characterized in that, described duplicate removal module further comprises definite submodule, analyzes submodule and duplicate removal submodule; Wherein,
Determine submodule, for determining between the operational zone of each transaction operation;
Analyze submodule, for to analyzing between described operational zone, determine between described operational zone, whether there is repetitive operation interval;
Duplicate removal submodule, in the situation that there is repetitive operation interval between definite described operational zone, carries out duplicate removal to the transaction operation that has repetitive operation interval.
9. management devices according to claim 8, is characterized in that, described duplicate removal module also comprises order module, before analyzing between to described operational zone, according to predetermined sortord to sorting between described operational zone.
10. management devices according to claim 9, is characterized in that, described predetermined sortord comprises:
Sort or be offset and sort according to the end between the operational zone of described transaction operation according to the skew that starts between the operational zone of described transaction operation.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410383979.5A CN104156420B (en) | 2014-08-06 | 2014-08-06 | The management method and device of transaction journal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410383979.5A CN104156420B (en) | 2014-08-06 | 2014-08-06 | The management method and device of transaction journal |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104156420A true CN104156420A (en) | 2014-11-19 |
| CN104156420B CN104156420B (en) | 2017-10-03 |
Family
ID=51881919
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410383979.5A Active CN104156420B (en) | 2014-08-06 | 2014-08-06 | The management method and device of transaction journal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104156420B (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106250478A (en) * | 2016-07-29 | 2016-12-21 | 珠海格力电器股份有限公司 | Curve data recording method, device, display terminal and the air-conditioning of display terminal |
| CN106777049A (en) * | 2016-12-09 | 2017-05-31 | 武汉斗鱼网络科技有限公司 | A kind of processing method and system for avoiding repeating daily record output |
| CN107656834A (en) * | 2016-07-26 | 2018-02-02 | 慧与发展有限责任合伙企业 | Recover main frame based on transaction journal to access |
| CN108984566A (en) * | 2017-06-02 | 2018-12-11 | 伊姆西Ip控股有限责任公司 | Method and apparatus for file system journal |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110040728A1 (en) * | 2009-08-11 | 2011-02-17 | International Business Machines Corporation | Replication of deduplicated data |
| CN102323958A (en) * | 2011-10-27 | 2012-01-18 | 上海文广互动电视有限公司 | Data de-duplication method |
| CN102385624A (en) * | 2011-10-25 | 2012-03-21 | 曙光信息产业(北京)有限公司 | DFS (distributed file system)-oriented log data organization method |
| US20130282670A1 (en) * | 2012-04-23 | 2013-10-24 | International Business Machines Corporation | Preserving redundancy in data deduplication systems by designation of virtual address |
| CN103399944A (en) * | 2013-08-14 | 2013-11-20 | 曙光信息产业(北京)有限公司 | Implementation method and implementation device for data duplication elimination query |
| CN103886082A (en) * | 2014-03-26 | 2014-06-25 | 百度在线网络技术（北京）有限公司 | Method and device for verifying position information of interest points |
-
2014
- 2014-08-06 CN CN201410383979.5A patent/CN104156420B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110040728A1 (en) * | 2009-08-11 | 2011-02-17 | International Business Machines Corporation | Replication of deduplicated data |
| CN102385624A (en) * | 2011-10-25 | 2012-03-21 | 曙光信息产业(北京)有限公司 | DFS (distributed file system)-oriented log data organization method |
| CN102323958A (en) * | 2011-10-27 | 2012-01-18 | 上海文广互动电视有限公司 | Data de-duplication method |
| US20130282670A1 (en) * | 2012-04-23 | 2013-10-24 | International Business Machines Corporation | Preserving redundancy in data deduplication systems by designation of virtual address |
| CN103399944A (en) * | 2013-08-14 | 2013-11-20 | 曙光信息产业(北京)有限公司 | Implementation method and implementation device for data duplication elimination query |
| CN103886082A (en) * | 2014-03-26 | 2014-06-25 | 百度在线网络技术（北京）有限公司 | Method and device for verifying position information of interest points |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107656834A (en) * | 2016-07-26 | 2018-02-02 | 慧与发展有限责任合伙企业 | Recover main frame based on transaction journal to access |
| CN107656834B (en) * | 2016-07-26 | 2021-04-09 | 慧与发展有限责任合伙企业 | System and method for recovering host access based on transaction log and storage medium |
| CN106250478A (en) * | 2016-07-29 | 2016-12-21 | 珠海格力电器股份有限公司 | Curve data recording method, device, display terminal and the air-conditioning of display terminal |
| CN106777049A (en) * | 2016-12-09 | 2017-05-31 | 武汉斗鱼网络科技有限公司 | A kind of processing method and system for avoiding repeating daily record output |
| CN108984566A (en) * | 2017-06-02 | 2018-12-11 | 伊姆西Ip控股有限责任公司 | Method and apparatus for file system journal |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104156420B (en) | 2017-10-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105224546B (en) | Data storage and query method and equipment | |
| CN105069048A (en) | Small file storage method, query method and device | |
| CN102436408B (en) | Data storage cloud and cloud backup method based on Map/Dedup | |
| US20070162513A1 (en) | Methods and apparatus for point in time data access and recovery | |
| US20110153570A1 (en) | Data replication and recovery method in asymmetric clustered distributed file system | |
| CN106663047A (en) | Systems and methods for oprtimized signature comparisons and data replication | |
| CN104301360A (en) | Method, log server and system for recording log data | |
| CN103631940A (en) | Data writing method and data writing system applied to HBASE database | |
| CN103744906A (en) | System, method and device for data synchronization | |
| CN107992492B (en) | Data block storage method, data block reading method, data block storage device, data block reading device and block chain | |
| CN104156420A (en) | Method and device for managing transaction journal | |
| US11403021B2 (en) | File merging method and controller | |
| CN111061752B (en) | Data processing method and device and electronic equipment | |
| US20160170873A1 (en) | Information processing device | |
| CN105243027A (en) | Method for storing data in storage device and memory controller | |
| CN105787037A (en) | Repeated data deleting method and device | |
| CN103473076A (en) | Issuing method and issuing system for code version | |
| CN104239443A (en) | Serialization data operation log storage method | |
| CN103593449A (en) | Method and system for recycling database resources | |
| CN102467525A (en) | Document associating method and system | |
| CN101673374A (en) | Bill processing method and device | |
| CN108932271A (en) | A kind of file management method and device | |
| CN110263076B (en) | Method for automatically generating data analysis report | |
| CN104050057A (en) | Historical sensed data duplicate removal fragment eliminating method and system | |
| CN105224663A (en) | A kind of data-accessing tasks management method based on multiple data source and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20220125 Address after: 300450 3 / F, No. 15, Haitai Huake street, Huayuan Industrial Zone (outer ring), Tianjin Binhai New Area, Tianjin Patentee after: Tianjin Zhongke Shuguang Storage Technology Co.,Ltd. Address before: 100193 No. 36 Building, No. 8 Hospital, Wangxi Road, Haidian District, Beijing Patentee before: Dawning Information Industry (Beijing) Co.,Ltd. |
|
| TR01 | Transfer of patent right |