CN109062502A - A kind of data compression method, device, equipment and computer readable storage medium - Google Patents
A kind of data compression method, device, equipment and computer readable storage medium Download PDFInfo
- Publication number
- CN109062502A CN109062502A CN201810751787.3A CN201810751787A CN109062502A CN 109062502 A CN109062502 A CN 109062502A CN 201810751787 A CN201810751787 A CN 201810751787A CN 109062502 A CN109062502 A CN 109062502A
- Authority
- CN
- China
- Prior art keywords
- data
- compression
- stored
- compressed data
- compressed
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0608—Saving storage space on storage systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0638—Organizing or formatting or addressing of data
- G06F3/0644—Management of space entities, e.g. partitions, extents, pools
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/0671—In-line storage system
- G06F3/0673—Single storage device
- G06F3/0679—Non-volatile semiconductor memory device, e.g. flash memory, one time programmable memory [OTP]
-
- H—ELECTRICITY
- H03—ELECTRONIC CIRCUITRY
- H03M—CODING; DECODING; CODE CONVERSION IN GENERAL
- H03M7/00—Conversion of a code where information is represented by a given sequence or number of digits to a code where the same, similar or subset of information is represented by a different sequence or number of digits
- H03M7/30—Compression; Expansion; Suppression of unnecessary data, e.g. redundancy reduction
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Transfer Between Computers (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a kind of data compression method, device, equipment and computer readable storage mediums, wherein this method comprises: receiving the data to be stored that upper-layer service issues；Data to be stored is compressed using specified core cpu, obtains corresponding compressed data；Wherein, specifying core cpu is compress the corresponding core cpu for compressing affairs and being bound with to data in advance；Compressed data is stored into disk.In technical solution disclosed in the present application, specified core cpu is bound for compression affairs in advance, as a result, when receiving the data to be stored that upper-layer service issues, the compression of data to be stored is realized using specified core cpu, and then the compressed data that compression obtains is stored into disk.As it can be seen that the application, which passes through, binds specified core cpu for compression affairs, the influence of the compression performance of other business compressing datas is avoided, data compression is realized by specified core cpu, greatly reduces cost needed for realizing data compression.
Description
Technical field
The present invention relates to memory system technologies fields, more specifically to a kind of data compression method, device, equipment
And computer readable storage medium.
Background technique
Along with the development of information industry, data information amount is doubled and redoubled, and the demand to memory capacity is increasing, storage
Cost is continuously increased, while higher and higher to the performance requirement of storage system.With the full development for dodging array, due to SSD (solid-state
Hard disk) write-in restricted lifetime, by compressed data reduce SSD be written data volume method demand it is stronger.The prior art
In the compressions of data to write-in SSD, but compressing card higher cost are realized usually using compressing card, and then cause to realize number
According to higher cost needed for compression.
In conclusion there is higher cost for realizing the technical solution of data compression in the prior art.
Summary of the invention
The object of the present invention is to provide a kind of data compression method, device, equipment and computer readable storage mediums, can
Solve the problems, such as higher cost existing for the technical solution for realizing data compression in the prior art.
To achieve the goals above, the invention provides the following technical scheme:
A kind of data compression method, comprising:
Receive the data to be stored that upper-layer service issues；
The data to be stored is compressed using specified core cpu, obtains corresponding compressed data；Wherein, described
Specified core cpu be in advance with data are carried out to compress the corresponding core cpu for compressing affairs and being bound；
The compressed data is stored into disk.
Preferably, before the compressed data being stored into disk, further includes:
The compressed data is merged according to default principle.
Preferably, the compressed data is merged according to default principle, comprising:
The preset quantity compressed data is merged, or the compressed data is incorporated into occupied space and is reached
Preset value.
Preferably, after the compressed data being merged according to default principle, further includes:
Update the corresponding metadata of the compressed data；
It is corresponding, the method also includes:
The data read request that the upper-layer service issues is received, metadata corresponding with the data read request is obtained
For target metadata, reading compressed data corresponding with the target metadata is destination packed data, to the targeted compression
Data are decompressed, and the data that decompression obtains are returned to the upper-layer service.
A kind of data compression device, comprising:
Receiving module is used for: receiving the data to be stored that upper-layer service issues；
Compression module is used for: being compressed using specified core cpu to the data to be stored, is obtained corresponding compression
Data；Wherein, the specified core cpu is compress the corresponding core cpu for compressing affairs and being bound with to data in advance；
Memory module is used for: the compressed data is stored into disk.
Preferably, further includes:
Merging module is used for: before the compressed data is stored into disk, by the compressed data according to default original
Then merge.
Preferably, the merging module includes:
Combining unit is used for: the preset quantity compressed data being merged, or the compressed data is merged
Reach preset value to occupied space.
Preferably, further includes:
Metadata updates module, is used for: after the compressed data is merged according to default principle, updating the pressure
The corresponding metadata of contracting data；
Decompression module is used for: being received the data read request that the upper-layer service issues, is obtained and the reading data
Requesting corresponding metadata is target metadata, and reading compressed data corresponding with the target metadata is targeted compression number
According to being decompressed to the destination packed data, and the obtained data of decompression are returned to the upper-layer service.
A kind of data compression device, comprising:
Memory, for storing computer program；
Processor, when for executing the computer program the step of realization any one as above data compression method.
A kind of computer readable storage medium is stored with computer program on the computer readable storage medium, described
The step of as above any one data compression method is realized when computer program is executed by processor.
The present invention provides a kind of data compression method, device, equipment and computer readable storage medium, wherein this method
It include: the data to be stored for receiving upper-layer service and issuing；The data to be stored is compressed using specified core cpu, is obtained
To corresponding compressed data；Wherein, the specified core cpu is to tie up in advance with carrying out compressing corresponding compression affairs to data
Fixed core cpu；The compressed data is stored into disk.It is in advance compression affairs in technical solution disclosed in the present application
Bind specified core cpu, as a result, when receiving the data to be stored that upper-layer service issues, using specified core cpu realize to
The compression of storing data, and then the compressed data that compression obtains is stored into disk.As it can be seen that the application passes through as compression affairs
Bind specified core cpu, avoid the influence of the compression performance of other business compressing datas, further, by with compression thing
The specified core cpu of business binding realizes data compression, without in addition increasing such as compressing card hardware, greatly reduces realization data
Cost needed for compression.
Detailed description of the invention
In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show below
There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this
The embodiment of invention for those of ordinary skill in the art without creative efforts, can also basis
The attached drawing of offer obtains other attached drawings.
Fig. 1 is a kind of flow chart of data compression method provided in an embodiment of the present invention；
Fig. 2 is a kind of structural schematic diagram of data compression device provided in an embodiment of the present invention.
Specific embodiment
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete
Site preparation description, it is clear that described embodiments are only a part of the embodiments of the present invention, instead of all the embodiments.It is based on
Embodiment in the present invention, it is obtained by those of ordinary skill in the art without making creative efforts every other
Embodiment shall fall within the protection scope of the present invention.
Referring to Fig. 1, can wrap it illustrates a kind of flow chart of data compression method provided in an embodiment of the present invention
It includes:
S11: the data to be stored that upper-layer service issues is received.
It should be noted that a kind of execution subject of data compression method provided in an embodiment of the present invention can be corresponding
Data compression device, and the device can be set in storage system, therefore, a kind of data compression provided in an embodiment of the present invention
The execution subject of method can be storage system.Wherein, upper-layer service, which can refer to, any needs to store data to storage system
Business, and data to be stored is that the needs that issue of upper-layer service are stored to the data of storage system.
S12: compressing data to be stored using specified core cpu, obtains corresponding compressed data；Wherein, it specifies
Core cpu is compress the corresponding core cpu for compressing affairs and being bound with to data in advance.
Compression affairs are bound with one or more core cpu in advance, which can be with
Referred to as specified core cpu, particular number can be set according to actual needs；After realizing above-mentioned binding, core cpu is specified
It can be only used for realizing compression affairs, i.e., the operation compressed data, to avoid other stored service logic shadows
Ring the performance of data compression.That is, dedicated core cpu is distributed in the application for compression affairs, to treat storage in realization
When the compression of data, realized using the dedicated core cpu of distribution, and then obtain corresponding compressed data.It additionally needs
Bright, carrying out data compression using specified core cpu can be using the realization of compression function library, and compression function library is
Staff is preset include compression function function library, compression function can by staff according to actual needs into
Row setting, as long as it can be realized data compression function, is not specifically limited herein.
It should be noted that realizing that the binding of compression affairs and core cpu can specifically include in the application:
Step 1: creating the compression affairs of multithreading, wherein per thread is used to realize data compression function；
Step 2: the per thread for including for compression affairs binds core cpu, is also that compression affairs bind core cpu；
Step 3: upper-layer service being waited to issue data to be stored.
S13: compressed data is stored into disk.
Compressed data is stored into the disk of storage system, as realization data rule.
In technical solution disclosed in the present application, specified core cpu is bound for compression affairs in advance, as a result, on receiving
When the data to be stored that layer service issues, the compression of data to be stored is realized using specified core cpu, and then compression is obtained
Compressed data is stored into disk.As it can be seen that the application, which passes through, binds specified core cpu for compression affairs, other business are avoided
The influence of the compression performance of compressing data, further, by realizing data pressure with the specified core cpu of compression affairs binding
Contracting greatly reduces cost needed for realizing data compression without in addition increasing such as compressing card hardware.
A kind of data compression method provided in an embodiment of the present invention can be with before storing compressed data into disk
Include:
Compressed data is merged according to default principle.
It should be noted that within the storage system, data are issued according to the form of block, common data block it is big
Data can be split into the data block of K rank size as number to be stored by small such as 16K, 4K, 8K, namely usually upper-layer service
According to；And data to be stored is compressed into smaller data block as compressed data, due to being each data point in disk by the application
What the space size matched was usually fixed, such as distribute to each data space be 4K, and if each compressed data much
Less than 4K, if that directly then each compressed data will occupy the memory space of 4K by compressed data write-in disk, lead to magnetic
The space utilization rate of disk is lower, therefore, in the application can first judge whether the occupied space of single compressed data is less than disk
In be the distribution of each data space, if it is, compressed data is merged according to default principle, the compression number after merging
Disk directly then otherwise is written into compressed data according to write-in disk, so that the merging by compressed data improves compression factor,
Improve disk space usage.
And above-mentioned default principle can be set according to actual needs, such as multiple compressed datas can be merged into occupancy
It is the identical data block in the space of each data distribution in space and disk, it can also be in order to avoid merging obtained data block
Include that compressed data excessively leads to the case where being unfavorable for inquiry, the compressed data of the preset quantity set according to actual needs is closed
And at data block, and stored obtained data block is merged, that is, a kind of data compression side provided in an embodiment of the present invention
Compressed data is merged according to default principle, may include: by method
Preset quantity compressed data is merged, or compressed data is incorporated into occupied space and reaches preset value.
Wherein, preset quantity can be set according to actual needs by staff, in general, preset quantity pressure
Contracting data merge to obtain the space that the occupied space of data block is less than or distributes equal to disk for each data；And preset value is then
It specifically can generally can be set to preset for the value less than or equal to the space in disk being each data distribution
Value of the value equal to the space in disk being each data distribution.For example, data to be stored is 4K alignment, data to be stored warp
Crossing the compressed data obtained after data compression is byte-aligned, and the space that disk is each data distribution is 4K, then will compression
Disk is written after reconsolidating the data block for 4K alignment in data again.
To sum up, by being merged to compressed data, compression factor is improved, invalid data occupation rate is reduced, is improved
Disk space occupancy.
Compressed data is merged it according to default principle by a kind of data compression method provided in an embodiment of the present invention
Afterwards, can also include:
Update the corresponding metadata of compressed data；
It is corresponding, method further include:
The data read request that upper-layer service issues is received, obtaining metadata corresponding with data read request is target element
Data, reading compressed data corresponding with target metadata is destination packed data, is decompressed to destination packed data, and will
It decompresses obtained data and returns to upper-layer service.
Update the corresponding metadata of compressed data, i.e., the address information distributed compressed data in disk and other correlations
Information is written into corresponding metadata, thus in the reading for needing to realize compressed data, can be navigated to by metadata
Compressed data, and then upper layer application is returned to after decompressing, improve the speed of reading data and return.
The embodiment of the invention also provides a kind of data compression devices, as shown in Fig. 2, may include:
Receiving module 11, is used for: receiving the data to be stored that upper-layer service issues；
Compression module 12, is used for: being compressed using specified core cpu to data to be stored, obtains corresponding compression number
According to；Wherein, specifying core cpu is compress the corresponding core cpu for compressing affairs and being bound with to data in advance；
Memory module 13, is used for: compressed data is stored into disk.
A kind of data compression device provided in an embodiment of the present invention can also include:
Merging module is used for: before compressed data is stored into disk, compressed data being closed according to default principle
And.
A kind of data compression device provided in an embodiment of the present invention, merging module may include:
Combining unit is used for: preset quantity compressed data being merged, or compressed data is incorporated into occupancy sky
Between reach preset value.
A kind of data compression device provided in an embodiment of the present invention can also include:
Metadata updates module, is used for: after compressed data is merged according to default principle, updating compressed data pair
The metadata answered；
Decompression module is used for: being received the data read request that upper-layer service issues, is obtained corresponding with data read request
Metadata be target metadata, reading corresponding with target metadata compressed data is destination packed data, to targeted compression
Data are decompressed, and the data that decompression obtains are returned to upper-layer service.
The embodiment of the invention also provides a kind of data compression devices, may include:
Memory, for storing computer program；
Processor, when for executing computer program realize as above any one of data compression method the step of.
A kind of computer readable storage medium is stored with computer program, computer journey on computer readable storage medium
The step of as above any one data compression method is realized when sequence is executed by processor.
It should be noted that a kind of data compression device provided in an embodiment of the present invention, equipment and computer-readable storage
The explanation of relevant portion refers to the detailed of corresponding part in a kind of data compression method provided in an embodiment of the present invention in medium
Illustrate, details are not described herein.In addition in above-mentioned technical proposal provided in an embodiment of the present invention with correspond to technical side in the prior art
The consistent part of case realization principle is simultaneously unspecified, in order to avoid excessively repeat.
The foregoing description of the disclosed embodiments can be realized those skilled in the art or using the present invention.To this
A variety of modifications of a little embodiments will be apparent for a person skilled in the art, and the general principles defined herein can
Without departing from the spirit or scope of the present invention, to realize in other embodiments.Therefore, the present invention will not be limited
It is formed on the embodiments shown herein, and is to fit to consistent with the principles and novel features disclosed in this article widest
Range.
Claims (10)
1. a kind of data compression method characterized by comprising
Receive the data to be stored that upper-layer service issues；
The data to be stored is compressed using specified core cpu, obtains corresponding compressed data；Wherein, described specified
Core cpu is compress the corresponding core cpu for compressing affairs and being bound with to data in advance；
The compressed data is stored into disk.
2. the method according to claim 1, wherein also being wrapped before the compressed data is stored into disk
It includes:
The compressed data is merged according to default principle.
3. according to the method described in claim 2, it is characterized in that, the compressed data is merged according to default principle,
Include:
The preset quantity compressed data is merged, or the compressed data is incorporated into occupied space and reaches default
Value.
4. according to the method described in claim 3, it is characterized in that, the compressed data is merged it according to default principle
Afterwards, further includes:
Update the corresponding metadata of the compressed data；
It is corresponding, the method also includes:
The data read request that the upper-layer service issues is received, obtaining metadata corresponding with the data read request is mesh
Metadata is marked, reading compressed data corresponding with the target metadata is destination packed data, to the destination packed data
It is decompressed, and the data that decompression obtains is returned into the upper-layer service.
5. a kind of data compression device characterized by comprising
Receiving module is used for: receiving the data to be stored that upper-layer service issues；
Compression module is used for: being compressed using specified core cpu to the data to be stored, is obtained corresponding compressed data；
Wherein, the specified core cpu is compress the corresponding core cpu for compressing affairs and being bound with to data in advance；
Memory module is used for: the compressed data is stored into disk.
6. device according to claim 5, which is characterized in that further include:
Merging module is used for: before the compressed data is stored into disk, by the compressed data according to default principle into
Row merges.
7. device according to claim 6, which is characterized in that the merging module includes:
Combining unit is used for: the preset quantity compressed data being merged, or the compressed data is incorporated into and is accounted for
Reach preset value with space.
8. device according to claim 7, which is characterized in that further include:
Metadata updates module, is used for: after the compressed data is merged according to default principle, updating the compression number
According to corresponding metadata；
Decompression module is used for: being received the data read request that the upper-layer service issues, is obtained and the data read request
Corresponding metadata is target metadata, and reading compressed data corresponding with the target metadata is destination packed data, right
The destination packed data is decompressed, and the data that decompression obtains are returned to the upper-layer service.
9. a kind of data compression device characterized by comprising
Memory, for storing computer program；
Processor, realizing the data compression method as described in any one of Claims 1-4 when for executing the computer program
Step.
10. a kind of computer readable storage medium, which is characterized in that be stored with computer on the computer readable storage medium
Program realizes the step of the data compression method as described in any one of Claims 1-4 when the computer program is executed by processor
Suddenly.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810751787.3A CN109062502A (en) | 2018-07-10 | 2018-07-10 | A kind of data compression method, device, equipment and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810751787.3A CN109062502A (en) | 2018-07-10 | 2018-07-10 | A kind of data compression method, device, equipment and computer readable storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109062502A true CN109062502A (en) | 2018-12-21 |
Family
ID=64819448
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810751787.3A Pending CN109062502A (en) | 2018-07-10 | 2018-07-10 | A kind of data compression method, device, equipment and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109062502A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109886858A (en) * | 2019-01-25 | 2019-06-14 | 上海赜睿信息科技有限公司 | A kind of method and device of data processing |
| CN110018792A (en) * | 2019-04-10 | 2019-07-16 | 苏州浪潮智能科技有限公司 | One kind is to rule data processing method, device, electronic equipment and storage medium |
| CN111309269A (en) * | 2020-02-28 | 2020-06-19 | 苏州浪潮智能科技有限公司 | Method, system and equipment for dropping compressed data and readable storage medium |
| CN111880743A (en) * | 2020-07-29 | 2020-11-03 | 北京浪潮数据技术有限公司 | Data storage method, device, equipment and storage medium |
| CN112015346A (en) * | 2020-08-28 | 2020-12-01 | 北京浪潮数据技术有限公司 | Storage controller, data storage method and device thereof and storage medium |
| CN113726341A (en) * | 2021-08-25 | 2021-11-30 | 杭州海康威视数字技术股份有限公司 | Data processing method and device, electronic equipment and storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101526923A (en) * | 2009-04-02 | 2009-09-09 | 成都市华为赛门铁克科技有限公司 | Data processing method, device thereof and flash-memory storage system |
| CN101606392A (en) * | 2007-02-09 | 2009-12-16 | 高通股份有限公司 | Decompression and compression to the data channel information based on programmable pattern |
| CN103326730A (en) * | 2013-06-06 | 2013-09-25 | 清华大学 | Data parallelism compression method |
| CN103559020A (en) * | 2013-11-07 | 2014-02-05 | 中国科学院软件研究所 | Method for realizing parallel compression and parallel decompression on FASTQ file containing DNA (deoxyribonucleic acid) sequence read data |
| CN104181510A (en) * | 2014-09-05 | 2014-12-03 | 电子科技大学 | Parallel radar pulse compression method |
| CN108134609A (en) * | 2017-12-21 | 2018-06-08 | 深圳大学 | Multithreading compression and decompressing method and the device of a kind of conventional data gz forms |
-
2018
- 2018-07-10 CN CN201810751787.3A patent/CN109062502A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101606392A (en) * | 2007-02-09 | 2009-12-16 | 高通股份有限公司 | Decompression and compression to the data channel information based on programmable pattern |
| CN101526923A (en) * | 2009-04-02 | 2009-09-09 | 成都市华为赛门铁克科技有限公司 | Data processing method, device thereof and flash-memory storage system |
| CN103326730A (en) * | 2013-06-06 | 2013-09-25 | 清华大学 | Data parallelism compression method |
| CN103559020A (en) * | 2013-11-07 | 2014-02-05 | 中国科学院软件研究所 | Method for realizing parallel compression and parallel decompression on FASTQ file containing DNA (deoxyribonucleic acid) sequence read data |
| CN104181510A (en) * | 2014-09-05 | 2014-12-03 | 电子科技大学 | Parallel radar pulse compression method |
| CN108134609A (en) * | 2017-12-21 | 2018-06-08 | 深圳大学 | Multithreading compression and decompressing method and the device of a kind of conventional data gz forms |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109886858A (en) * | 2019-01-25 | 2019-06-14 | 上海赜睿信息科技有限公司 | A kind of method and device of data processing |
| CN109886858B (en) * | 2019-01-25 | 2023-04-11 | 上海赜睿信息科技有限公司 | Data processing method and device |
| CN110018792A (en) * | 2019-04-10 | 2019-07-16 | 苏州浪潮智能科技有限公司 | One kind is to rule data processing method, device, electronic equipment and storage medium |
| CN111309269A (en) * | 2020-02-28 | 2020-06-19 | 苏州浪潮智能科技有限公司 | Method, system and equipment for dropping compressed data and readable storage medium |
| WO2021169388A1 (en) * | 2020-02-28 | 2021-09-02 | 苏州浪潮智能科技有限公司 | Method, system and device for writing compressed data to disk, and readable storage medium |
| CN111880743A (en) * | 2020-07-29 | 2020-11-03 | 北京浪潮数据技术有限公司 | Data storage method, device, equipment and storage medium |
| CN112015346A (en) * | 2020-08-28 | 2020-12-01 | 北京浪潮数据技术有限公司 | Storage controller, data storage method and device thereof and storage medium |
| CN112015346B (en) * | 2020-08-28 | 2022-06-17 | 北京浪潮数据技术有限公司 | Storage controller, data storage method and device thereof and storage medium |
| CN113726341A (en) * | 2021-08-25 | 2021-11-30 | 杭州海康威视数字技术股份有限公司 | Data processing method and device, electronic equipment and storage medium |
| CN113726341B (en) * | 2021-08-25 | 2023-09-01 | 杭州海康威视数字技术股份有限公司 | Data processing method and device, electronic equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109062502A (en) | A kind of data compression method, device, equipment and computer readable storage medium | |
| US8838894B2 (en) | Storing row-major data with an affinity for columns | |
| US10972125B2 (en) | Storage access interface to an encoded storage system | |
| CN105027122B (en) | Compression and data de-duplication Layered driver | |
| CN103392207B (en) | Itself log recording and level uniformity of non-volatile memories | |
| US20160147778A1 (en) | Applying a database transaction log record directly to a database table container | |
| CN107704194B (en) | Lock-free IO processing method and device | |
| CN104424314A (en) | Database operation for columnar table database | |
| CN103384877A (en) | Storage system comprising flash memory, and storage control method | |
| US9449020B2 (en) | Method for smart card to process CAP file | |
| CN104937564B (en) | The data flushing of group form | |
| CN109313609A (en) | The system and method to interweave for odd mode storage channel | |
| CN107111461A (en) | Bandwidth of memory is provided using back-to-back read operation in the system based on CPU (CPU) by compressed Memory Controller (CMC) to compress | |
| CN110187832B (en) | Data operation method, device and system | |
| CN109448777A (en) | A kind of test method and device of NVME solid state hard disk | |
| CN111857572A (en) | Data writing method, device and equipment of TLC solid state disk and storage medium | |
| CN110147345A (en) | A kind of key assignments storage system and its working method based on RDMA | |
| CN115470156A (en) | RDMA-based memory use method, system, electronic device and storage medium | |
| US11119703B2 (en) | Utilizing a set of virtual storage units distributed across physical storage units | |
| CN101207705A (en) | Graphic file management method | |
| US10776052B2 (en) | Information processing apparatus, data compressing method, and computer-readable recording medium | |
| WO2019008715A1 (en) | Data loading program, data loading method, and data loading device | |
| CN109189345B (en) | Online data sorting method, device, equipment and storage medium | |
| CN106844228B (en) | Method and device for realizing partition management of lightweight SD card | |
| CN111435331A (en) | Data writing method and device for storage volume, electronic equipment and machine-readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20181221 |