CN107888675A - A kind of distributed memory system data recovery implementation method - Google Patents
A kind of distributed memory system data recovery implementation method Download PDFInfo
- Publication number
- CN107888675A CN107888675A CN201711087452.8A CN201711087452A CN107888675A CN 107888675 A CN107888675 A CN 107888675A CN 201711087452 A CN201711087452 A CN 201711087452A CN 107888675 A CN107888675 A CN 107888675A
- Authority
- CN
- China
- Prior art keywords
- memory system
- distributed memory
- time point
- node
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1402—Saving, restoring, recovering or retrying
- G06F11/1446—Point-in-time backing up or restoration of persistent data
- G06F11/1458—Management of the backup or restore process
- G06F11/1464—Management of the backup or restore process for networked environments
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
Patent of the present invention is related to a kind of distributed memory system data recovery implementation method, when the book that this method externally provides in distributed memory system needs to carry out data recovery, it is divided into first time point by data recovery management time point, second time point etc., multiple time point T were recovered, T is the positive integer more than or equal to 3, when distributed memory system present node needs to recover the data of first time point, present node can ask the second time point data message of all other node of distributed storage, first time point and the data difference at the second time point are reverted to by the first time point asked than completing present node.
Description
Technical field
Patent of the present invention is related to computer field of storage, particularly distributed memory system field.
Background technology
Distributed memory system, it is to disperse to be stored in more independent equipment by data.Traditional network store system
All data are deposited using the storage server of concentration, storage server turns into the bottleneck of systematic function, and reliability and peace
The focus of full property, it is impossible to meet the needs of Mass storage application.Distributed network storage system uses expansible system knot
Structure, storage load is shared using more storage servers, position storage information using location server, it not only increases system
Reliability, availability and access efficiency, be also easy to extend.
Under big data environment, the increase of data scale and complexity is often very fast, will to the scalability of system
Ask higher.Realize that the enhanced scalability of storage system first has to the major issue for solving two aspects, the distribution comprising metadata
With the transparent migration of data.The distribution of metadata mainly realizes that the latter then stresses Data Migration by static subtree partitioning technology
The optimization of algorithm.In addition, big data storage system node fails rate in large scale is high, therefore also need to complete necessarily adaptive
Answer management function.System is allowed for according to the node number required for data volume and the workload calculated estimation, and dynamically
Data are migrated between node.To realize load balancing；Simultaneously during node fails, data must can pass through the mechanism such as copy
Recovered, it is impossible to which upper layer application is had an impact.
Conventional data storage model needs to support application as much as possible, it is therefore desirable to possesses preferable versatility.Big number
It is generally not that can most improve application according to the characteristic such as extensive, high dynamic and quick processing, general Data Storage Models
The model of performance and concern of the big data storage system to upper layer application performance are considerably beyond the pursuit to versatility.For answering
Stored with load to optimize, be exactly to couple data storage with application.Simplify or extend the function of distributed file system, root
According to application-specific, certain loads, file system is customized specific computation model and depth optimization, makes using reaching optimal
Performance.
Increase with the data scale of big data, carrying out full dose recovery when recovering to data every time will be to distribution
Formula storage system produces huge load.
Patent of invention content
Patent of the present invention is related to a kind of distributed memory system data recovery implementation method, and this method is in distributed memory system
When the book externally provided needs to carry out data recovery, when being divided into first time point, second by data recovery management time point
Between multiple time point T such as point recovered, T is positive integer more than or equal to 3, when distributed memory system present node need it is extensive
During the data of multiple first time point, present node can ask the second time point data of all other node of distributed storage to be believed
Breath, first time point and the data difference at the second time point are reverted to by the first time point asked than completing present node.
Brief description of the drawings
Fig. 1 is a kind of distributed memory system data recovery implementation method structural representation of patent of the present invention.
Embodiment
In order that the object, technical solution and advantage of patent of the present invention are more clearly understood, below in conjunction with accompanying drawing and implementation
Example, patent of the present invention is further elaborated.It should be appreciated that specific embodiment described herein is only explaining
Patent of the present invention, is not intended to limit the present invention patent.
Referring to Fig. 1, Fig. 1 is a kind of distributed memory system data recovery implementation method structural representation of patent of the present invention
Figure.
A kind of distributed memory system data recovery implementation method, it is characterised in that methods described includes distributed storage
System（10）, distributed memory system node a（11a）, distributed memory system node b（11b）, distributed memory system node
c（11c）, time point（12）, book（13）, service communication network（14）With business main frame（15）, this method distributed storage
System（10）By distributed memory system node a（11a）, distributed memory system node b（11b）With distributed memory system section
Point c（11c）Composition, another distributed memory system（10）Pass through service communication network（14）To business main frame（15）Book is provided
（13）Service, while distributed memory system（10）Passage time point（12）To carry out the management of data recovery.
A kind of distributed memory system data recovery implementation method, it is characterised in that this method time point（12）It is divided into
One time point, the second time point and X time point, X are the positive integer more than or equal to 3.
A kind of distributed memory system data recovery implementation method, it is characterised in that this method distributed memory system
（10）Distributed memory system node a（11a）Ask recovery time point（12）Book（13）During first time point, distribution
Formula storage nodes a（11a）Can requesting query distributed memory system node b（11b）With distributed memory system node c
（11c）Book（13）Second time point information, recover two time point data differences i.e. completion book by contrasting（13）
To very first time point data.
A kind of distributed memory system data recovery implementation method, it is characterised in that this method distributed memory system
（10）Middle distributed memory system node a（11a）, distributed memory system node b（11b）With distributed memory system node c
（11c）Can be that request data is rolled up（13）Time point（12）Recover, but the same time can only be entered by the node asked at first
OK.
A kind of distributed memory system data recovery implementation method, it is characterised in that this method distributed memory system
（10）Middle distributed memory system node a（11a）, distributed memory system node b（11b）With distributed memory system node c
（11c）Can be that request data is rolled up（13）Time point（12）Recover, but the time point recovered（12）Can only be progressively toward laggard
OK.
The preferred embodiment of patent of the present invention is the foregoing is only, is not intended to limit the invention patent, it is all at this
All any modification, equivalent and improvement made within the spirit and principle of patent of invention etc., should be included in patent of the present invention
Protection domain within.
Claims (5)
1. a kind of distributed memory system data recovery implementation method, it is characterised in that methods described includes distributed storage system
System（10）, distributed memory system node a（11a）, distributed memory system node b（11b）, distributed memory system node c
（11c）, time point（12）, book（13）, service communication network（14）With business main frame（15）, this method distributed storage system
System（10）By distributed memory system node a（11a）, distributed memory system node b（11b）With distributed memory system node
c（11c）Composition, another distributed memory system（10）Pass through service communication network（14）To business main frame（15）Book is provided
（13）Service, while distributed memory system（10）Passage time point（12）To carry out the management of data recovery.
A kind of 2. distributed memory system data recovery implementation method according to claim 1, it is characterised in that this method
Time point（12）It is divided into first time point, the second time point and X time point, X is the positive integer more than or equal to 3.
A kind of 3. distributed memory system data recovery implementation method according to claim 1, it is characterised in that this method
Distributed memory system（10）Distributed memory system node a（11a）Ask recovery time point（12）Book（13）The
During one time point, distributed memory system node a（11a）Can requesting query distributed memory system node b（11b）And distribution
Storage nodes c（11c）Book（13）Second time point information, it has been by contrasting two time point data differences of recovery
Into book（13）To very first time point data.
A kind of 4. distributed memory system data recovery implementation method according to claim 1, it is characterised in that this method
Distributed memory system（10）Middle distributed memory system node a（11a）, distributed memory system node b（11b）And distribution
Storage nodes c（11c）Can be that request data is rolled up（13）Time point（12）Recover, but the same time can only be by first
The node of request is carried out.
A kind of 5. distributed memory system data recovery implementation method according to claim 1, it is characterised in that this method
Distributed memory system（10）Middle distributed memory system node a（11a）, distributed memory system node b（11b）And distribution
Storage nodes c（11c）Can be that request data is rolled up（13）Time point（12）Recover, but the time point recovered（12）Only
Progressively it can carry out backward.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711087452.8A CN107888675A (en) | 2017-11-08 | 2017-11-08 | A kind of distributed memory system data recovery implementation method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711087452.8A CN107888675A (en) | 2017-11-08 | 2017-11-08 | A kind of distributed memory system data recovery implementation method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107888675A true CN107888675A (en) | 2018-04-06 |
Family
ID=61779233
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711087452.8A Pending CN107888675A (en) | 2017-11-08 | 2017-11-08 | A kind of distributed memory system data recovery implementation method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107888675A (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105843704A (en) * | 2016-03-15 | 2016-08-10 | 上海爱数信息技术股份有限公司 | Data protection method and system capable of combining with snapshot function based on distributed block storage |
| CN106126370A (en) * | 2016-06-15 | 2016-11-16 | 上海爱数信息技术股份有限公司 | Based on the Server free backup method and the system that store increment bitmap between snapshot |
| CN106354582A (en) * | 2016-08-18 | 2017-01-25 | 无锡华云数据技术服务有限公司 | Continuous data protection method |
| CN107291391A (en) * | 2017-06-21 | 2017-10-24 | 郑州云海信息技术有限公司 | A kind of data processing method and system for distributed memory system |
-
2017
- 2017-11-08 CN CN201711087452.8A patent/CN107888675A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105843704A (en) * | 2016-03-15 | 2016-08-10 | 上海爱数信息技术股份有限公司 | Data protection method and system capable of combining with snapshot function based on distributed block storage |
| CN106126370A (en) * | 2016-06-15 | 2016-11-16 | 上海爱数信息技术股份有限公司 | Based on the Server free backup method and the system that store increment bitmap between snapshot |
| CN106354582A (en) * | 2016-08-18 | 2017-01-25 | 无锡华云数据技术服务有限公司 | Continuous data protection method |
| CN107291391A (en) * | 2017-06-21 | 2017-10-24 | 郑州云海信息技术有限公司 | A kind of data processing method and system for distributed memory system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CA2892889C (en) | Scaling computing clusters | |
| CN109074377B (en) | Managed function execution for real-time processing of data streams | |
| CN104735098B (en) | The control method and control system of session information | |
| JP6716727B2 (en) | Streaming data distributed processing method and apparatus | |
| SE1751212A1 (en) | Distributed data set storage and retrieval | |
| US20160034205A1 (en) | Systems and/or methods for leveraging in-memory storage in connection with the shuffle phase of mapreduce | |
| CN103810061B (en) | A kind of High Availabitity cloud storage method | |
| Zaki | NoSQL databases: new millennium database for big data, big users, cloud computing and its security challenges | |
| CN104881466B (en) | The processing of data fragmentation and the delet method of garbage files and device | |
| CN103118073B (en) | Virtual machine data persistence storage system and method in cloud environment | |
| Kushwah et al. | A survey on various fault tolerant approaches for cloud environment during load balancing | |
| US20140059094A1 (en) | Making use of a file path to determine file locality for applications | |
| US11321283B2 (en) | Table and index communications channels | |
| Kaseb et al. | An improved technique for increasing availability in Big Data replication | |
| CN105045762A (en) | Management method and apparatus for configuration file | |
| US11178197B2 (en) | Idempotent processing of data streams | |
| JP6383110B2 (en) | Data search method, apparatus and terminal | |
| US9684668B1 (en) | Systems and methods for performing lookups on distributed deduplicated data systems | |
| Ikhlaq et al. | Computation of Big Data in Hadoop and Cloud Environment | |
| US10102228B1 (en) | Table and index communications channels | |
| CN107888675A (en) | A kind of distributed memory system data recovery implementation method | |
| CN110221778A (en) | Processing method, system, storage medium and the electronic equipment of hotel's data | |
| CN108363642A (en) | A kind of distributed memory system data recovery implementation method | |
| CN105025042A (en) | Method of determining data information, system and proxy servers | |
| US10511656B1 (en) | Log information transmission integrity |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20180406 |