CN106877877A - A kind of online data compresses integrated approach and system in storage - Google Patents
A kind of online data compresses integrated approach and system in storage Download PDFInfo
- Publication number
- CN106877877A CN106877877A CN201710112767.7A CN201710112767A CN106877877A CN 106877877 A CN106877877 A CN 106877877A CN 201710112767 A CN201710112767 A CN 201710112767A CN 106877877 A CN106877877 A CN 106877877A
- Authority
- CN
- China
- Prior art keywords
- data
- compression
- module
- upper strata
- data block
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000007906 compression Methods 0.000 claims abstract description 190
- 230000006835 compression Effects 0.000 claims abstract description 189
- 241001269238 Data Species 0.000 claims abstract description 8
- 238000004321 preservation Methods 0.000 claims abstract description 6
- 238000000034 method Methods 0.000 claims description 6
- 230000005540 biological transmission Effects 0.000 claims description 3
- 230000015572 biosynthetic process Effects 0.000 claims description 2
- 238000013144 data compression Methods 0.000 description 9
- 230000001934 delay Effects 0.000 description 2
- 238000013500 data storage Methods 0.000 description 1
- 230000006837 decompression Effects 0.000 description 1
- 230000007423 decrease Effects 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 230000003111 delayed effect Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H03—ELECTRONIC CIRCUITRY
- H03M—CODING; DECODING; CODE CONVERSION IN GENERAL
- H03M7/00—Conversion of a code where information is represented by a given sequence or number of digits to a code where the same, similar or subset of information is represented by a different sequence or number of digits
- H03M7/30—Compression; Expansion; Suppression of unnecessary data, e.g. redundancy reduction
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0608—Saving storage space on storage systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0655—Vertical data movement, i.e. input-output transfer; data movement between one or more hosts and one or more storage devices
- G06F3/0656—Data buffering arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/0671—In-line storage system
- G06F3/0673—Single storage device
- G06F3/0674—Disk device
Abstract
A kind of online data of present invention offer compresses integrated approach and system in storage, by the caching of I/O data write-in upper strata；Multiple I/O datas are combined compression during compression module caches upper strata according to default decrement, form combination compression I/O data block；Compression module is in the position in disk for each I/O data correspondence one metadata of generation in combination compression I/O data block, each I/O data that metadata is used for before and after recording compressed；Compression module will combine compression I/O data block and the metadata corresponding with combination compression I/O data block inside I/O data is handed down to lower floor and caches；Lower floor's caching preserves combination compression I/O data block and metadata；I/O data block and meta-data preservation to rear end disk are compressed in the combination that lower floor's caching will be preserved.Data can just be issued to rear end disk after overcompression, so store larger data using less disk space, improve the space availability ratio of disk and the performance of whole storage system.
Description
Technical field
Compress integrated approach in storage and be the present invention relates to field of data storage, more particularly to a kind of online data
System.
Background technology
Today's society data volume explodes, and this structure to whole IT causes serious impact, especially disk size
Demand it is increasing, this undoubtedly increased the cost of enterprise.In order to reduce the amount of storage of data, generally use data compression
After stored, and traditional compression is usually non real-time compression, and conventional compression is to store data into rear end disk first, so
Afterwards when storage system is idle, from rear end, out be compressed digital independent by disk, the IO that compression will be compressed after finishing
Store disk, such data compression cannot the compression ratio of estimated data be compressed, it is necessary to be read out from disk again, press
Contracting data are non real-time coming into force.
The content of the invention
In order to overcome above-mentioned deficiency of the prior art, the present invention provides a kind of online data compression in storage integrated
Method, method includes：
By in the caching of I/O data write-in upper strata；
Multiple I/O datas are combined compression during compression module caches upper strata according to default decrement, form combination compression IO
Data block；
Compression module is used to record for each I/O data correspondence one metadata of generation in combination compression I/O data block, metadata
Each I/O data before and after compression is in the position in disk；
Compression module will combine compression I/O data block and the first number corresponding with combination compression I/O data block inside I/O data
Cached according to lower floor is handed down to；
Lower floor's caching preserves combination compression I/O data block and metadata；
I/O data block and meta-data preservation to rear end disk are compressed in the combination that lower floor's caching will be preserved.
Preferably, host interface layer is received and reads I/O data request, and reads I/O data in upper strata caches；
If reading the I/O data in upper strata caches, I/O data is returned into host interface layer.
Preferably, if not reading the I/O data in upper strata caches, I/O data read request is sent to compression mould
Block, reads I/O data in compression module；
If reading the I/O data in compression module, I/O data is returned into upper strata caching, be then back to main frame and connect
Mouth layer.
Preferably, if not reading the I/O data in compression module, I/O data read request is sent to lower floor and is delayed
Deposit, the metadata of the I/O data is read in lower floor's caching, corresponding combination compression I/O data is found according to metadata information
I/O data in block；
If reading the I/O data in lower floor caches, the combination compression I/O data block where I/O data is back to compression
Module, compression module is decompressed to the combination compression I/O data block, recovers I/O data；
I/O data is returned into upper strata caching, host interface layer is then back to.
Preferably, if not reading the I/O data in lower floor caches, in rear end, disk reads the I/O data
Metadata, the I/O data in corresponding combination compression I/O data block is found according to metadata information；
If reading the I/O data in the disk of rear end, the combination compression I/O data block where I/O data is back to compression
Module, compression module is decompressed to the combination compression I/O data block, recovers I/O data；
I/O data is returned into upper strata caching, host interface layer is then back to.
Preferably, the acquisition modes of default decrement include：
On upper strata, caching randomly selects N number of I/O data block, and N is the natural number of non-zero, and the I/O data block to extracting is combined pressure
Contracting, calculates the average MD5 values of N number of I/O data block, using the value as default decrement after combination compression.
A kind of online data compression integrated system in storage, including：Upper strata cache module, compression module, lower floor delays
Storing module, rear end disk；
Upper strata cache module is used for for I/O data write-in；
Compression module is used to that multiple I/O datas in the cache module of upper strata to be combined into compression, formation group according to default decrement
Combined pressure contracting I/O data block；Compression module is for each I/O data correspondence one metadata of generation in combination compression I/O data block, unit
Each I/O data that data are used for before and after recording compressed is in the position in disk；Compression module will combine compression I/O data block with
And the metadata corresponding with combination compression I/O data block inside I/O data is handed down to lower floor's cache module；
Lower floor's cache module be used for preserve combination compression I/O data block and metadata, and will preserve combination compression I/O data block and
Meta-data preservation is to rear end disk.
Preferably, also include：Upper strata caches I/O data processing module, compression module I/O data processing module, lower floor's caching
I/O data processing module；
Upper strata caching I/O data processing module is used to be received according to host interface layer reads I/O data request, at the caching I/O data of upper strata
Reason module reads I/O data in the cache module of upper strata, if reading the I/O data in upper strata caches, I/O data is returned
Back to host interface layer；
If compression module I/O data processing module is used to not read the I/O data in the cache module of upper strata, upper strata caches IO
Data processing module sends to compression module I/O data read request, and compression module I/O data processing module is read in compression module
Take I/O data；If reading the I/O data in compression module, I/O data is returned into upper strata caching, be then back to master
Machine interface layer；
If lower floor's caching I/O data processing module is used to not read the I/O data in compression module, I/O data is read please
Transmission to lower floor's cache module is asked, lower floor caches first number that I/O data processing module reads the I/O data in lower floor's cache module
According to, according to metadata information find it is corresponding combination compression I/O data block in I/O data；
If reading the I/O data in lower floor's cache module, the combination compression I/O data block where I/O data is back to
Compression module, compression module is decompressed to the combination compression I/O data block, recovers I/O data；I/O data is returned into upper strata
Cache module, is then back to host interface layer.
Preferably, also include：Rear end data in magnetic disk processing module；
If rear end data in magnetic disk processing module is used to not read the I/O data in lower floor's cache module, in rear end disk
The metadata of the I/O data is read, the I/O data in corresponding combination compression I/O data block is found according to metadata information；
If reading the I/O data in the disk of rear end, the combination compression I/O data block where I/O data is back to compression mould
Block, compression module is decompressed to the combination compression I/O data block, recovers I/O data；I/O data is returned into upper strata caching mould
Block, is then back to host interface layer.
Preferably, also include：Default decrement setup module；
Default decrement setup module is used to randomly select N number of I/O data block in upper strata cache module, and N is the nature of non-zero
Number, the I/O data block to extracting is combined compression, the average MD5 values of N number of I/O data block is calculated after combination compression, by the value
As default decrement.
As can be seen from the above technical solutions, the present invention has advantages below：
Online data compression integrated approach in storage relate to compression module, and storage is pressed from front end receiver I/O data
Contracting, is issued to caching, then by cache flash to rear end disk after compression.Compared with traditional compression, online data compression can
With the compression ratio of estimated data, because I/O data had completed compression before disk is issued；Line compression also a saving disk
Space, it is not necessary to read out from disk be compressed again；Compressed data is to come into force in real time, and to the performance of I/O data
Influence is not produced.
Brief description of the drawings
In order to illustrate more clearly of technical scheme, will make simple to the accompanying drawing to be used needed for description below
Introduce on ground, it should be apparent that, drawings in the following description are only some embodiments of the present invention, for ordinary skill
For personnel, on the premise of not paying creative work, other accompanying drawings can also be obtained according to these accompanying drawings.
Fig. 1 is the overall flow figure that online data compresses integrated approach in storage；
Fig. 2 is the reading manner flow chart of I/O data；
Fig. 3 is another reading manner flow chart of I/O data；
Fig. 4 is another reading manner flow chart of I/O data；
Fig. 5 is online data compression integrated system overall schematic in storage.
Specific embodiment
To enable that goal of the invention of the invention, feature, advantage are more obvious and understandable, below will be with specific
Embodiment and accompanying drawing, the technical scheme to present invention protection are clearly and completely described, it is clear that implementation disclosed below
Example is only a part of embodiment of the invention, and not all embodiment.Based on the embodiment in this patent, the common skill in this area
All other embodiment that art personnel are obtained under the premise of creative work is not made, belongs to the model of this patent protection
Enclose.
The present embodiment provides a kind of online data compression integrated approach in storage, as shown in figure 1, method includes：
S1：By in the caching of I/O data write-in upper strata；
S2：Multiple I/O datas are combined compression during compression module caches upper strata according to default decrement, form combination pressure
Contracting I/O data block；
S3：Compression module is used for for each I/O data correspondence one metadata of generation in combination compression I/O data block, metadata
Each I/O data before and after recording compressed is in the position in disk；
S4：Compression module will combine compression I/O data block and the unit corresponding with combination compression I/O data block inside I/O data
Data distributing is cached to lower floor；
S5：Lower floor's caching preserves combination compression I/O data block and metadata；
S6：I/O data block and meta-data preservation to rear end disk are compressed in the combination that lower floor's caching will be preserved.
Data can just be issued to rear end disk after overcompression, so store larger number using less disk space
According to, the space availability ratio of disk and the performance of whole storage system are improved, compression function is integrated into conventional store.This implementation
Real-time compression method is used in example, data had been completed the compression to data before storage to rear end disk, and online
Real Time Compression does not interfere with the performance of I/O data.
Although compression has consumed a part of resource and increased delay in itself in compression process, in IO write magnetic disks
Saved during process the time, overall measured result shows that compression performance does not decline.
Wherein, the acquisition modes of default decrement include：On upper strata, caching randomly selects N number of I/O data block, and N is non-zero
Natural number, the I/O data block to extracting is combined compression, and combination calculates the average MD5 values of N number of I/O data block after compressing,
Using the value as default decrement.
For example：On upper strata, caching is randomly selected three I/O data blocks and is compressed, and 4K is after the compression of each I/O data block,
Compression calculates the average MD5 values of these three I/O data blocks after finishing, using the value as default decrement.
Compression module during according to default decrement, upper strata is cached multiple I/O datas be combined compression, when compressed value with
When default decrement is equal, this size is the size of combination compression I/O data block.
In the present embodiment, as shown in Fig. 2 the reading manner of I/O data is：
S11：Host interface layer is received reads I/O data request, and reads I/O data in upper strata caches；
S12：If reading the I/O data in upper strata caches, I/O data is returned into host interface layer.
In the present embodiment, as shown in figure 3, the reading manner of I/O data is：
S21：Host interface layer is received reads I/O data request, and reads I/O data in upper strata caches；
S22：If not reading the I/O data in upper strata caches, I/O data read request is sent to compression module, in pressure
I/O data is read in contracting module；
S23：If reading the I/O data in compression module, I/O data is returned into upper strata caching, be then back to master
Machine interface layer.
In the present embodiment, as shown in figure 4, the reading manner of I/O data is：
S31：Host interface layer is received reads I/O data request, and reads I/O data in upper strata caches；
S32：If not reading the I/O data in upper strata caches, I/O data read request is sent to compression module, in pressure
I/O data is read in contracting module；
S33：If not reading the I/O data in compression module, I/O data read request is sent to lower floor's caching, under
Layer caching reads the metadata of the I/O data, and the IO in corresponding combination compression I/O data block is found according to metadata information
Data；
S34：If reading the I/O data in lower floor caches, the combination compression I/O data block where I/O data is back to
Compression module, compression module is decompressed to the combination compression I/O data block, recovers I/O data；
S35：I/O data is returned into upper strata caching, host interface layer is then back to.
Further, if not reading the I/O data in lower floor caches, in rear end, disk reads the I/O data
Metadata, according to metadata information find it is corresponding combination compression I/O data block in I/O data；
If reading the I/O data in the disk of rear end, the combination compression I/O data block where I/O data is back to compression
Module, compression module is decompressed to the combination compression I/O data block, recovers I/O data；
I/O data is returned into upper strata caching, host interface layer is then back to.
The present invention also provides a kind of online data compression integrated system in storage, as shown in figure 5, including：Delay on upper strata
Storing module 1, compression module 2, lower floor's cache module 3, rear end disk 4；
Upper strata cache module 1 is used for for I/O data write-in；
Compression module 2 is used to that multiple I/O datas in upper strata cache module 1 to be combined into compression according to default decrement, is formed
Combination compression I/O data block；Compression module 2 generates a metadata for each I/O data correspondence in combination compression I/O data block,
Each I/O data that metadata is used for before and after recording compressed is in the position in disk；Compression module 2 will combine compression I/O data
Block and the metadata corresponding with combination compression I/O data block inside I/O data are handed down to lower floor's cache module 3；Lower floor delays
Storing module 3 is for preserving combination compression I/O data block and metadata, and I/O data block is compressed in the combination that will be preserved and metadata is protected
It is stored to rear end disk 4.
In the present embodiment, also include：Upper strata caches I/O data processing module, compression module I/O data processing module, lower floor
Caching I/O data processing module；
Upper strata caching I/O data processing module is used to be received according to host interface layer reads I/O data request, at the caching I/O data of upper strata
Reason module reads I/O data in the cache module of upper strata, if reading the I/O data in upper strata caches, I/O data is returned
Back to host interface layer；
If compression module I/O data processing module is used to not read the I/O data in the cache module of upper strata, upper strata caches IO
Data processing module sends to compression module I/O data read request, and compression module I/O data processing module is read in compression module
Take I/O data；If reading the I/O data in compression module, I/O data is returned into upper strata caching, be then back to master
Machine interface layer；
If lower floor's caching I/O data processing module is used to not read the I/O data in compression module, I/O data is read please
Transmission to lower floor's cache module is asked, lower floor caches first number that I/O data processing module reads the I/O data in lower floor's cache module
According to, according to metadata information find it is corresponding combination compression I/O data block in I/O data；
If reading the I/O data in lower floor's cache module, the combination compression I/O data block where I/O data is back to
Compression module, compression module is decompressed to the combination compression I/O data block, recovers I/O data；I/O data is returned into upper strata
Cache module, is then back to host interface layer.
Integrated system also includes：Rear end data in magnetic disk processing module；If rear end data in magnetic disk processing module is used in lower floor
The I/O data is not read in cache module, then the metadata of the I/O data is read in rear end disk, believed according to metadata
Breath finds the I/O data in corresponding combination compression I/O data block；If reading the I/O data in the disk of rear end, will
Combination compression I/O data block where I/O data is back to compression module, and compression module is carried out to the combination compression I/O data block
Decompression, recovers I/O data；I/O data is returned into upper strata cache module, host interface layer is then back to.
Integrated system also includes：Default decrement setup module；Default decrement setup module is used for slow on upper strata
Storing module randomly selects N number of I/O data block, and N is the natural number of non-zero, and the I/O data block to extracting is combined compression, combination pressure
The average MD5 values of N number of I/O data block are calculated after contracting, using the value as default decrement.
Each embodiment is described by the way of progressive in this specification, and what each embodiment was stressed is and other
The difference of embodiment, identical similar portion reference mutually between each embodiment.
The foregoing description of the disclosed embodiments, enables professional and technical personnel in the field to realize or uses the present invention.
Various modifications to these embodiments will be apparent for those skilled in the art, as defined herein
General Principle can be realized in other embodiments without departing from the spirit or scope of the present invention.Therefore, the present invention
The embodiments shown herein is not intended to be limited to, and is to fit to and principles disclosed herein and features of novelty phase one
The scope most wide for causing.
Claims (10)
1. a kind of online data compresses integrated approach in storage, it is characterised in that method includes：
By in the caching of I/O data write-in upper strata；
Multiple I/O datas are combined compression during compression module caches upper strata according to default decrement, form combination compression IO
Data block；
Compression module is used to record for each I/O data correspondence one metadata of generation in combination compression I/O data block, metadata
Each I/O data before and after compression is in the position in disk；
Compression module will combine compression I/O data block and the first number corresponding with combination compression I/O data block inside I/O data
Cached according to lower floor is handed down to；
Lower floor's caching preserves combination compression I/O data block and metadata；
I/O data block and meta-data preservation to rear end disk are compressed in the combination that lower floor's caching will be preserved.
2. online data according to claim 1 compresses integrated approach in storage, it is characterised in that
Host interface layer is received reads I/O data request, and reads I/O data in upper strata caches；
If reading the I/O data in upper strata caches, I/O data is returned into host interface layer.
3. online data according to claim 2 compresses integrated approach in storage, it is characterised in that
If not reading the I/O data in upper strata caches, I/O data read request is sent to compression module, in compression mould
I/O data is read in block；
If reading the I/O data in compression module, I/O data is returned into upper strata caching, be then back to main frame and connect
Mouth layer.
4. online data according to claim 3 compresses integrated approach in storage, it is characterised in that
If not reading the I/O data in compression module, I/O data read request is sent to lower floor's caching, it is slow in lower floor
The metadata for reading the I/O data is deposited, the IO numbers in corresponding combination compression I/O data block are found according to metadata information
According to；
If reading the I/O data in lower floor caches, the combination compression I/O data block where I/O data is back to compression
Module, compression module is decompressed to the combination compression I/O data block, recovers I/O data；
I/O data is returned into upper strata caching, host interface layer is then back to.
5. online data according to claim 4 compresses integrated approach in storage, it is characterised in that
If not reading the I/O data in lower floor caches, in rear end, disk reads the metadata of the I/O data, according to
Metadata information finds the I/O data in corresponding combination compression I/O data block；
If reading the I/O data in the disk of rear end, the combination compression I/O data block where I/O data is back to compression
Module, compression module is decompressed to the combination compression I/O data block, recovers I/O data；
I/O data is returned into upper strata caching, host interface layer is then back to.
6. online data according to claim 1 compresses integrated approach in storage, it is characterised in that
The acquisition modes of default decrement include：
On upper strata, caching randomly selects N number of I/O data block, and N is the natural number of non-zero, and the I/O data block to extracting is combined pressure
Contracting, calculates the average MD5 values of N number of I/O data block, using the value as default decrement after combination compression.
7. a kind of online data compresses integrated system in storage, it is characterised in that including：Upper strata cache module, compresses mould
Block, lower floor's cache module, rear end disk；
Upper strata cache module is used for for I/O data write-in；
Compression module is used to that multiple I/O datas in the cache module of upper strata to be combined into compression, formation group according to default decrement
Combined pressure contracting I/O data block；Compression module is for each I/O data correspondence one metadata of generation in combination compression I/O data block, unit
Each I/O data that data are used for before and after recording compressed is in the position in disk；Compression module will combine compression I/O data block with
And the metadata corresponding with combination compression I/O data block inside I/O data is handed down to lower floor's cache module；
Lower floor's cache module be used for preserve combination compression I/O data block and metadata, and will preserve combination compression I/O data block and
Meta-data preservation is to rear end disk.
8. online data according to claim 7 compresses integrated system in storage, it is characterised in that
Also include：Upper strata caches I/O data processing module, compression module I/O data processing module, lower floor's caching I/O data treatment mould
Block；
Upper strata caching I/O data processing module is used to be received according to host interface layer reads I/O data request, at the caching I/O data of upper strata
Reason module reads I/O data in the cache module of upper strata, if reading the I/O data in upper strata caches, I/O data is returned
Back to host interface layer；
If compression module I/O data processing module is used to not read the I/O data in the cache module of upper strata, upper strata caches IO
Data processing module sends to compression module I/O data read request, and compression module I/O data processing module is read in compression module
Take I/O data；If reading the I/O data in compression module, I/O data is returned into upper strata caching, be then back to master
Machine interface layer；
If lower floor's caching I/O data processing module is used to not read the I/O data in compression module, I/O data is read please
Transmission to lower floor's cache module is asked, lower floor caches first number that I/O data processing module reads the I/O data in lower floor's cache module
According to, according to metadata information find it is corresponding combination compression I/O data block in I/O data；
If reading the I/O data in lower floor's cache module, the combination compression I/O data block where I/O data is back to
Compression module, compression module is decompressed to the combination compression I/O data block, recovers I/O data；I/O data is returned into upper strata
Cache module, is then back to host interface layer.
9. online data according to claim 7 compresses integrated system in storage, it is characterised in that
Also include：Rear end data in magnetic disk processing module；
If rear end data in magnetic disk processing module is used to not read the I/O data in lower floor's cache module, in rear end disk
The metadata of the I/O data is read, the I/O data in corresponding combination compression I/O data block is found according to metadata information；
If reading the I/O data in the disk of rear end, the combination compression I/O data block where I/O data is back to compression mould
Block, compression module is decompressed to the combination compression I/O data block, recovers I/O data；I/O data is returned into upper strata caching mould
Block, is then back to host interface layer.
10. online data according to claim 7 compresses integrated system in storage, it is characterised in that
Also include：Default decrement setup module；
Default decrement setup module is used to randomly select N number of I/O data block in upper strata cache module, and N is the nature of non-zero
Number, the I/O data block to extracting is combined compression, the average MD5 values of N number of I/O data block is calculated after combination compression, by the value
As default decrement.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710112767.7A CN106877877B (en) | 2017-02-28 | 2017-02-28 | Integration method and system for online data compression in storage |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710112767.7A CN106877877B (en) | 2017-02-28 | 2017-02-28 | Integration method and system for online data compression in storage |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106877877A true CN106877877A (en) | 2017-06-20 |
| CN106877877B CN106877877B (en) | 2020-11-27 |
Family
ID=59168105
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710112767.7A Active CN106877877B (en) | 2017-02-28 | 2017-02-28 | Integration method and system for online data compression in storage |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106877877B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107910046A (en) * | 2017-11-24 | 2018-04-13 | 郑州云海信息技术有限公司 | A kind of medical image real-time compression system and method |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1612252A (en) * | 2003-10-31 | 2005-05-04 | 浙江中控技术股份有限公司 | Real-time data on-line compression and decompression method |
| US20130145059A1 (en) * | 2009-07-23 | 2013-06-06 | Stec, Inc. | Data storage system with primary and secondary compression engines |
| CN103685589A (en) * | 2012-09-07 | 2014-03-26 | 中国科学院计算机网络信息中心 | Binary coding-based domain name system (DNS) data compression and decompression methods and systems |
| CN103744627A (en) * | 2014-01-26 | 2014-04-23 | 武汉英泰斯特电子技术有限公司 | Method and system for compressing and storing data collected in real time |
| US20160371037A1 (en) * | 2013-03-15 | 2016-12-22 | Western Digital Technologies, Inc. | Compression and formatting of data for data storage systems |
| CN106406766A (en) * | 2016-09-23 | 2017-02-15 | 郑州云海信息技术有限公司 | A data storage method and device |
-
2017
- 2017-02-28 CN CN201710112767.7A patent/CN106877877B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1612252A (en) * | 2003-10-31 | 2005-05-04 | 浙江中控技术股份有限公司 | Real-time data on-line compression and decompression method |
| US20130145059A1 (en) * | 2009-07-23 | 2013-06-06 | Stec, Inc. | Data storage system with primary and secondary compression engines |
| CN103685589A (en) * | 2012-09-07 | 2014-03-26 | 中国科学院计算机网络信息中心 | Binary coding-based domain name system (DNS) data compression and decompression methods and systems |
| US20160371037A1 (en) * | 2013-03-15 | 2016-12-22 | Western Digital Technologies, Inc. | Compression and formatting of data for data storage systems |
| CN103744627A (en) * | 2014-01-26 | 2014-04-23 | 武汉英泰斯特电子技术有限公司 | Method and system for compressing and storing data collected in real time |
| CN106406766A (en) * | 2016-09-23 | 2017-02-15 | 郑州云海信息技术有限公司 | A data storage method and device |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107910046A (en) * | 2017-11-24 | 2018-04-13 | 郑州云海信息技术有限公司 | A kind of medical image real-time compression system and method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106877877B (en) | 2020-11-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20120166400A1 (en) | Techniques for processing operations on column partitions in a database | |
| CN101430657B (en) | Continuous data protection method | |
| CN105573682B (en) | A kind of SAN storage system and its data read-write method | |
| CN102147768B (en) | Memory, solid caching system and caching data processing method | |
| CN108540556B (en) | A kind of fining Session cluster shared system and method based on cache | |
| WO2007049109A3 (en) | Method and system for compression of logical data objects for storage | |
| CN101277211A (en) | Method and apparatus for buffering data | |
| CN107526550A (en) | A kind of two benches merging method based on log-structured merging tree | |
| CN106569750A (en) | Data compression method and device | |
| CN106649891A (en) | Distributed data storage method and system | |
| CN110908608A (en) | Storage space saving method and system | |
| CN106681659A (en) | Data compression method and device | |
| CN107168651A (en) | A kind of small documents polymerize storage processing method | |
| CN108089825A (en) | A kind of storage system based on distributed type assemblies | |
| CN109614045A (en) | A kind of metadata rule method, apparatus and relevant device | |
| CN105393228A (en) | Method, device and user equipment for reading/writing data in nand flash | |
| CN106897440B (en) | File read-write processing method for distributed file system | |
| CN106877877A (en) | A kind of online data compresses integrated approach and system in storage | |
| CN109739696A (en) | Double-control storage array solid state disk cache acceleration method | |
| CN104281517B (en) | Log mode based memory space management method and device | |
| CN106776361A (en) | A kind of caching method and system towards extensive non-volatile memory medium | |
| CN106227901A (en) | A kind of based on heavily deleting and compressing parallel space method for saving | |
| CN107562829A (en) | Data access method and equipment | |
| CN115202588B (en) | Data storage method and device and data recovery method and device | |
| CN109597587A (en) | A kind of method for writing data, medium and Nonvolatile memory |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20201105 Address after: 215100 No. 1 Guanpu Road, Guoxiang Street, Wuzhong Economic Development Zone, Suzhou City, Jiangsu Province Applicant after: SUZHOU LANGCHAO INTELLIGENT TECHNOLOGY Co.,Ltd. Address before: 450000 Henan province Zheng Dong New District of Zhengzhou City Xinyi Road No. 278 16 floor room 1601 Applicant before: ZHENGZHOU YUNHAI INFORMATION TECHNOLOGY Co.,Ltd. |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |