CN107590285A - A kind of method of heterogeneous system data consistency - Google Patents
A kind of method of heterogeneous system data consistency Download PDFInfo
- Publication number
- CN107590285A CN107590285A CN201710915790.XA CN201710915790A CN107590285A CN 107590285 A CN107590285 A CN 107590285A CN 201710915790 A CN201710915790 A CN 201710915790A CN 107590285 A CN107590285 A CN 107590285A
- Authority
- CN
- China
- Prior art keywords
- data
- data consistency
- renewal
- consistency policy
- compared
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Abstract
The present invention provides a kind of method of heterogeneous system data consistency, belongs to big data processing technology field, and the invention mainly comprises two aspects：1）Compared with small data consistency policy, 2）Larger data consistency policy；Compared with small data consistency policy, different more new strategies is used for different media；Larger data consistency policy, if the most data of system are required for renewal, then the valid data in the data block that will directly update copy out, and are disposably updated operation.Reduce space expense, it is excessively slow to avoid data renewal speed.
Description
Technical field
The present invention relates to big data treatment technology, more particularly to a kind of method of heterogeneous system data consistency.
Background technology
With the fast development of internet, data volume increases severely, and big data processing is to memory speed, capacity, energy consumption and reliable
Property aspect propose very high demand.Traditional DRAM media faces enormous challenge in terms of big data is handled.With non-easy
The appearance of the property lost memory, the new isomery mixing memory system for extending calculator memory are got the attention.It is new non-easy
The property lost memory has non-volatile, low-power consumption, relative to the fireballing feature of disk read-write, locates in isomery mixing memory system
Reason big data can improve efficiency.But data load or need to ensure the consistent of data when writing in isomery mixing memory system
Property.
Traditional data consistency method mainly has ahead daily record and Copy on write technology.Ahead day aims in reality
First renewal operation note in daily record before updating the data, such write operation carries out twice.Using Copy on write technology,
Renewal operation all replicates legacy data and writes update to new position every time, this approach reduces the expense for writing daily record, but
It is due to that data in file system are indexed using tree, if carrying out realistic copy to a data block,
Renewal operation can be caused successively to diffuse up until tree root.Renewal speed is excessively slow.
The content of the invention
In order to solve the above technical problems, the present invention proposes a kind of method of heterogeneous system data consistency.
The technical scheme is that：
A kind of method of heterogeneous system data consistency, mainly includes：Compared with small data consistency policy, larger data uniformity plan
Slightly.
Wherein,
Compared with small data consistency policy, different more new strategies is used for different media；
Larger data consistency policy, if the most data of system are required for renewal, then the data that will directly update
Valid data in block copy out, and are disposably updated operation.
In compared with small data consistency policy,
If initial data affiliated area be PCM if directly carry out original place renewal, therefore can directly carry out Copy on write without
Want additional space expense；
If Flash, then using strange land more new strategy, new memory space is opened up again in Copy on write technology to carry out,
Without covering legacy data；When all data write, using file size as root pointer changes and the principle of change, renewal is literary
The size of part so that the data of foregoing renewal are changed into effective.
In the event of fortuitous event, then ignore the foregoing validity for writing data.
The invention provides a kind of method of heterogeneous system data consistency, this method is according to different media using different
More new strategy, reduce space expense, it is excessively slow to avoid data renewal speed.
Brief description of the drawings
Fig. 1 is unified memory addressing schematic diagram；
Fig. 2 is the schematic flow sheet of the present invention.
Embodiment
More detailed elaboration is carried out to present disclosure below：
In the case that different medium coexists in isomery mixing memory system, ensure that the uniformity of data is asked
Topic.New nonvolatile memory Large Copacity, low-power consumption, non-volatile advantage can have been given play in isomery mixing memory system,
Merged simultaneously with existing memory dram, highly reliable, Large Copacity system can be constructed.Isomery mixing memory system is based primarily upon
Tri- kinds of medium fusions of DRAM, Flash and PCM form., can be tri- kinds by DRAM, Flash and PCM in isomery mixing memory system
Medium carries out unified memory addressing, unified management.Isomery mixing memory system unified memory addressing schematic diagram is as shown in Figure 1.It is different
Structure mixing memory system uses Caches of the DRAM as non-volatile memory medium, non-volatile due to non-volatile memory medium,
Data in the data and non-volatile memory medium that are stored in DRAM Cache there may be the problem of inconsistent.A kind of isomery system
The design structure of the method for data consistency of uniting includes：Compared with small data consistency policy, larger data consistency policy.
A kind of method flow diagram of heterogeneous system data consistency is as shown in Figure 2.
Compared with small data consistency policy module, different more new strategies is used for different media.
Directly carry out original place renewal if initial data affiliated area is PCM, thus can directly carry out Copy on write and
Additional space expense is not needed.
If Flash, then using strange land more new strategy, new memory space is opened up again in Copy on write technology to enter
OK, without covering legacy data；When all data write, the principle that is changed using file size as root pointer changes, more
The size of new file so that the data of foregoing renewal are changed into effective.
In the event of fortuitous events such as power down, then ignore the foregoing validity for writing data.
Larger data consistency policy module, then directly will be more if the most data of system are required for renewal
Valid data in new data block copy out, and are disposably updated operation, to reduce the expense for updating operation.
Claims (3)
- A kind of 1. method of heterogeneous system data consistency, it is characterised in thatIt is main to include two aspects：1）Compared with small data consistency policy, 2）Larger data consistency policy；Wherein,Compared with small data consistency policy, different more new strategies is used for different media；Larger data consistency policy, if the most data of system are required for renewal, then the data that will directly update Valid data in block copy out, and are disposably updated operation.
- 2. according to the method for claim 1, it is characterised in thatIn compared with small data consistency policy,If initial data affiliated area be PCM if directly carry out original place renewal, therefore can directly carry out Copy on write without Want additional space expense；If Flash, then using strange land more new strategy, new memory space is opened up again in Copy on write technology to carry out, Without covering legacy data；When all data write, using file size as root pointer changes and the principle of change, renewal is literary The size of part so that the data of foregoing renewal are changed into effective.
- 3. according to the method for claim 2, it is characterised in thatIn the event of fortuitous event, then ignore the foregoing validity for writing data.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710915790.XA CN107590285A (en) | 2017-09-30 | 2017-09-30 | A kind of method of heterogeneous system data consistency |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710915790.XA CN107590285A (en) | 2017-09-30 | 2017-09-30 | A kind of method of heterogeneous system data consistency |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107590285A true CN107590285A (en) | 2018-01-16 |
Family
ID=61052494
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710915790.XA Pending CN107590285A (en) | 2017-09-30 | 2017-09-30 | A kind of method of heterogeneous system data consistency |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107590285A (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100037023A1 (en) * | 2008-08-07 | 2010-02-11 | Aszmann Lawrence E | System and method for transferring data between different raid data storage types for current data and replay data |
| CN103838853A (en) * | 2014-03-17 | 2014-06-04 | 华中科技大学 | Mixed file system based on different storage media |
| CN103838676A (en) * | 2012-11-22 | 2014-06-04 | 华为技术有限公司 | Data storage system, data storage method and PCM bridge |
| CN103902669A (en) * | 2014-03-17 | 2014-07-02 | 华中科技大学 | Separating type file system based on different storage media |
| CN104007939A (en) * | 2014-06-23 | 2014-08-27 | 深圳供电局有限公司 | Embedded type FAT file system and method for frequent write-in of small files |
-
2017
- 2017-09-30 CN CN201710915790.XA patent/CN107590285A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100037023A1 (en) * | 2008-08-07 | 2010-02-11 | Aszmann Lawrence E | System and method for transferring data between different raid data storage types for current data and replay data |
| CN103838676A (en) * | 2012-11-22 | 2014-06-04 | 华为技术有限公司 | Data storage system, data storage method and PCM bridge |
| CN103838853A (en) * | 2014-03-17 | 2014-06-04 | 华中科技大学 | Mixed file system based on different storage media |
| CN103902669A (en) * | 2014-03-17 | 2014-07-02 | 华中科技大学 | Separating type file system based on different storage media |
| CN104007939A (en) * | 2014-06-23 | 2014-08-27 | 深圳供电局有限公司 | Embedded type FAT file system and method for frequent write-in of small files |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Jacob et al. | Memory systems: cache, DRAM, disk | |
| CN103810112B (en) | A kind of Nonvolatile memory system and management method thereof | |
| CN107391027A (en) | Redundant Array of Inexpensive Disc storage device and its management method | |
| TW200941487A (en) | Method and controller for promoting management efficiency of non-volatile memory storage device | |
| CN100583293C (en) | Memory device and its reading and writing method | |
| CN101582092B (en) | Method and device for realizing the store of date in memory | |
| ATE458229T1 (en) | ARRANGEMENT WITH A TACHOGRAPH | |
| CN102890620A (en) | Non-volatile temporary data handling | |
| CN104360963A (en) | Heterogeneous hybrid memory method and device oriented to memory computing | |
| TW200634848A (en) | Method for generating latch clock and memory subsystem | |
| CN100377086C (en) | Method for realizing operating procedure directly from file system in embedded system | |
| CN105393228A (en) | Method, device and user equipment for reading/writing data in nand flash | |
| CN102999441A (en) | Fine granularity memory access method | |
| CN103559145B (en) | A kind of digital independent, wiring method and electronic equipment | |
| CN103500075A (en) | Externally-connected computer accelerating device based on new materials | |
| CN104991776A (en) | Excel reading and writing method based on configuration | |
| CN102486751A (en) | Method for realizing virtual big page through small page NANDFLASH on micro memory system | |
| CN105786721A (en) | Memory address mapping management method and processor | |
| CN104123952A (en) | Cache-free disc burning method and device | |
| CN103246615A (en) | Method and device for data management in flash memory device | |
| CN104142943A (en) | Database expansion method and database | |
| CN107590285A (en) | A kind of method of heterogeneous system data consistency | |
| CN103164344B (en) | The method of data management in a kind of flash memory device and device | |
| CN108182236A (en) | A kind of web page drop-down list implementation method of unified disposition data source | |
| CN101807212B (en) | Caching method for embedded file system and embedded file system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180116 |