CN109491595B - Hierarchical storage system and method - Google Patents
Hierarchical storage system and method Download PDFInfo
- Publication number
- CN109491595B CN109491595B CN201811140606.XA CN201811140606A CN109491595B CN 109491595 B CN109491595 B CN 109491595B CN 201811140606 A CN201811140606 A CN 201811140606A CN 109491595 B CN109491595 B CN 109491595B
- Authority
- CN
- China
- Prior art keywords
- storage
- storage unit
- data
- data file
- hierarchical
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/061—Improving I/O performance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0629—Configuration or reconfiguration of storage systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/0671—In-line storage system
- G06F3/0673—Single storage device
- G06F3/0674—Disk device
Abstract
The invention discloses a hierarchical storage system and a hierarchical storage method, and belongs to the technical field of solid state disks. The system comprises a first storage unit and a second storage unit; the first storage unit comprises a storage space and a storage controller; the storage controller includes: the data acquisition module is used for acquiring a data file input by a user; the encryption module is used for encrypting the data file, and the encrypted data file is cached in the storage space; the hierarchical storage module is used for dividing storage types of the data files cached in the storage space, reserving the data files with the first storage type in the storage space and storing the data files with the second storage type in a second storage unit; the first storage unit is a PCIe solid state disk. The beneficial effects of the above technical scheme are: the use cost of the solid state disk is reduced, and the read-write performance of the hard disk is improved, so that the user experience is improved.
Description
Technical Field
The invention relates to the technical field of solid state disks, in particular to a hierarchical storage system and a hierarchical storage method.
Background
Solid State Drives (SSD), as a new storage medium, have faster read/write speed, lower shock resistance, lower power consumption, lower working noise, larger working temperature range, and lighter and thinner appearance than conventional mechanical hard disks. Therefore, with the development of storage technology, more and more storage solutions are implemented by using solid state disks.
In the prior art, only one hard disk is usually used for storing data, for example, a solid state disk is used for storing data, but the types of the data are different, the read frequency is also different, and the unified use of the solid state disk for storing data is not favorable for the read-write efficiency of the data, and is not in accordance with the read-write habit of a user.
In addition, the traditional hard disk encryption mode is realized by adopting an encryption gateway or an encryption machine, data is firstly sent to the encryption gateway or the encryption machine, encryption is realized through special encryption hardware, and then the encrypted data is forwarded to a storage system for storage. The use flow of the encryption mode is complex, and the performance and the cache capacity are limited.
Disclosure of Invention
According to the problems in the prior art, a technical scheme of a hierarchical storage system and a hierarchical storage method is provided, which aims to reduce the use cost of a solid state disk and improve the read-write performance of the hard disk, so that the user experience is improved.
The technical scheme specifically comprises the following steps:
a hierarchical storage system comprises a first storage unit and a second storage unit, wherein the first storage unit is connected with the second storage unit;
the first storage unit comprises a storage space for storing data files and a storage controller of the first storage unit, and the storage controller is connected with the storage space;
the storage controller includes:
the data acquisition module is used for acquiring the data file input by the user through an encrypted writing interface provided by the first storage unit;
the encryption module is connected with the data acquisition module and used for encrypting the acquired data file, and the encrypted data file is cached in the storage space;
the hierarchical storage module is used for dividing the storage types of the data files cached in the storage space, reserving the data files with a first storage type in the storage space and storing the data files with a second storage type in the second storage unit;
the first storage unit is a PCIe solid state disk.
Preferably, the hierarchical storage module divides the storage types of the data files cached in the storage space according to a preset hierarchical storage algorithm.
Preferably, the hierarchical storage system, wherein the first storage type is a hot data type.
Preferably, the hierarchical storage system, wherein the second storage type is a cold data type;
the second storage unit is realized by adopting a blue light storage technology.
Preferably, in the hierarchical storage system, the hierarchical storage module controls the second storage unit to read and store the data file with the second storage type through a common read interface provided by the first storage unit.
Preferably, the hierarchical storage system, wherein the storage controller further comprises:
the request acquisition module is connected with the hierarchical storage module and used for acquiring an access request which is input by a user and used for accessing the stored data file through an encryption reading interface provided by the first storage unit;
the hierarchical storage module is further used for judging and outputting the storage type of the data file associated with the access request, and outputting a judgment result;
the data reading module is connected with the hierarchical storage module and used for reading the data file related to the access request in the storage space or the second storage unit according to the judgment result;
and the decryption module is connected with the data reading module and used for decrypting the read data file, and the decrypted data file is cached in the storage space for a user to view.
A hierarchical storage method is provided, wherein a first storage unit and a second storage unit are arranged, and the first storage unit is connected with the second storage unit;
the hierarchical storage method comprises a data writing process, and specifically comprises the following steps:
step A1, inputting data files by a user through an encrypted writing interface provided by the first storage unit;
step A2, encrypting the acquired data file by the first storage unit, and caching the encrypted data file in a storage space in the first storage unit;
step A3, the first storage unit divides the storage type of the data file cached in the storage space, the hierarchical storage module reserves the data file with the first storage type in the storage space, and saves the data file with the second storage type in the second storage unit;
the first storage unit is a PCIe solid state disk.
Preferably, the first storage unit divides the storage types of the data files cached in the storage space according to a preset hierarchical storage algorithm.
Preferably, in the hierarchical storage method, the first data type is a hot data type.
Preferably, the hierarchical storage method, wherein the second data type is a cold data type;
the second storage unit is realized by adopting a blue light storage technology.
Preferably, in the hierarchical storage method, the first storage unit controls the second storage unit to read and store the data file with the second storage type through a normal read interface provided by the first storage unit.
Preferably, the hierarchical storage method further includes a data reading process, and specifically includes:
step B1, the user inputs the access request for accessing the saved data file through the encrypted reading interface provided by the first storage unit;
a step B2 of the first storage unit judging and outputting the storage type of the data file associated with the access request, and outputting a judgment result;
step B3, the first storage unit reads the data file associated with the access request in the storage space or the second storage unit according to the determination result;
and step B4, the first storage unit decrypts the read data file, and the decrypted data file is cached in the storage space for a user to view.
The beneficial effects of the above technical scheme are:
1) the hierarchical storage system is provided, so that the use cost of the solid state disk can be reduced, the read-write performance of the hard disk is improved, and the user experience is improved;
2) a hierarchical storage method is provided, which can support the operation of a hierarchical storage system.
Drawings
FIG. 1 is a schematic diagram of a hierarchical memory system according to a preferred embodiment of the present invention;
FIG. 2 is a flow chart illustrating a data writing process in a hierarchical storage method according to a preferred embodiment of the present invention;
FIG. 3 is a flow chart illustrating a data reading process in a hierarchical storage method according to a preferred embodiment of the present invention.
Detailed Description
The invention is further described with reference to the following drawings and specific examples, which are not intended to be limiting.
In light of the above problems in the prior art, there is now provided a hierarchical storage system, as shown in fig. 1, including a first storage unit 1 and a second storage unit 2, the first storage unit 1 being connected to the second storage unit 2;
the first storage unit 1 comprises a storage space 11 for storing data files and a storage controller 12 of the first storage unit 1, and the storage controller 12 is connected with the storage space 11;
the storage controller 12 includes:
a data obtaining module 121, configured to obtain a data file input by a user through an encrypted writing interface (not shown in the figure) provided by the first storage unit 1;
the encryption module 122 is connected to the data acquisition module 121 and is configured to encrypt the acquired data file, where the encrypted data file is cached in the storage space 11;
the hierarchical storage module 123 is configured to divide storage types of the data files cached in the storage space 11, and the hierarchical storage module retains the data files with the first storage type in the storage space 1 and retains the data files with the second storage type in the second storage unit 2;
the first storage unit 1 is a PCIe solid state disk.
Specifically, in this embodiment, the first data type is a hot data type, and the second data type is a cold data type. Furthermore, the hot data type may be a data file with a high reading and writing frequency by a user at ordinary times; the cold data type may be a data file that is read and written by a user at low frequency at ordinary times. The cold and hot data are stored in a first storage unit (a solid state disk) and backed up to a second storage unit (e.g. a blue light storage unit), so that the cold and hot data of the data file are separated.
In this embodiment, the cold-hot separation process of the data file is implemented by the storage controller of the first storage unit.
In this embodiment, since the first storage unit 1 is a PCIe solid state disk, the encryption and decryption processing of the data file is implemented by the storage controller 12 of the solid state disk, and an encryption gateway or an encryption machine is not required to be additionally added, so that the encryption and decryption processing is relatively simple, and the use cost is saved. Specifically, after the data file is sent to the first storage unit 1, the encryption module 122 encrypts the data file to form a corresponding ciphertext and stores the ciphertext in the storage space 11 of the first storage unit 1. The second storage unit 2 backs up and saves the ciphertext corresponding to the data file with the second data type.
In summary, the above description is the data file writing function of the storage controller 12 in the first storage unit 1.
In a preferred embodiment of the present invention, the second memory cell 2 is implemented by using a blue-ray memory technology, that is, the second memory cell 2 is a blue-ray memory cell.
In a preferred embodiment of the present invention, the hierarchical storage module 123 controls the second storage unit 2 to read and store the data file with the second storage type through a normal reading interface (not shown in the figure) provided by the first storage unit 1.
Specifically, when the hierarchical storage module 123 determines that the data file currently cached in the storage space 11 of the first storage unit 1 is of the second data type, the hierarchical storage module 123 sends a read instruction to the second storage unit 2 to instruct the second storage unit 2 to read the corresponding data file cached in the first storage unit 1 and perform backup storage. The second storage unit 2 obtains and stores the ciphertext cached in the first storage unit 1 through a common read interface provided by the first storage unit 1.
In a preferred embodiment of the present invention, as also shown in fig. 1, the storage controller 12 further comprises:
a request obtaining module 124, connected to the hierarchical storage module 123, for obtaining an access request for accessing the saved data file, which is input by a user, through an encrypted reading interface (not shown in the figure) provided by the first storage unit 1;
the hierarchical storage module 123 is further configured to determine and output a storage type of the data file associated with the access request, and output a determination result;
the data reading module 125 is connected to the hierarchical storage module 123, and is configured to read the data file associated with the access request in the storage space 11 or the second storage unit 2 according to the determination result;
the decryption module 126 is connected to the data reading module 125, and is configured to decrypt the read data file, and cache the decrypted data file in the storage space for the user to view.
In this embodiment, the storage controller 12 in the hierarchical storage system may implement a function of decrypting and reading the data file in addition to the function of encrypting and writing the data file. Specifically, the user can send an access request for a data file through the encrypted read interface provided by the first storage unit 1, and access data from the encrypted read interface. After the access request is obtained, the hierarchical storage module 123 determines the type of the data file (i.e., the data file that the user wishes to access) to which the access request is directed, and further determines the location where the data file is stored according to the type. If the data file to be accessed is of the first data type (hot data), the data reading module 125 only needs to be obtained from the first storage unit 1 (storage space of the solid state disk); if the data file to be accessed is of the second data type (cold data), the data reading module 125 needs to retrieve the data file from the second storage unit 2 (blu-ray storage unit).
In this embodiment, since the data files stored in the first storage unit 1 and the second storage unit 2 are both ciphertexts, after the data file is obtained, the data reading module 125 needs to send the data file into the decryption module 126 for decryption, so that the decrypted data file can be fed back to the user for access.
In a preferred embodiment of the present invention, a hierarchical storage method is now provided based on the hierarchical storage system described above. In the method, a first storage unit and a second storage unit are arranged, and the first storage unit is connected with the second storage unit. The arrangement of the first storage unit and the second storage unit and the connection relationship therebetween are implemented with reference to the hierarchical management system described above.
The hierarchical storage method includes a data writing process, as shown in fig. 2, which includes:
step A1, inputting a data file by a user through an encrypted writing interface provided by a first storage unit;
step A2, encrypting the acquired data file by the first storage unit, and caching the encrypted data file in a storage space in the first storage unit;
step A3, the first storage unit divides the storage type of the data file cached in the storage space, the hierarchical storage module reserves the data file with the first storage type in the storage space, and saves the data file with the second storage type in the second storage unit;
the first storage unit is a PCIe solid state disk.
In a preferred embodiment of the present invention, the first data type is a thermal data type.
In a preferred embodiment of the present invention, the second data type is a cold data type;
the second memory cell is implemented using the blu-ray memory technology.
In a preferred embodiment of the present invention, the first storage unit controls the second storage unit to read and store the data file with the second storage type through a common read interface provided by the first storage unit.
In a preferred embodiment of the present invention, the hierarchical storage method further includes a data reading process, as shown in fig. 3, including:
step B1, the user inputs the access request for accessing the saved data file through the encrypted reading interface provided by the first storage unit;
step B2, the first storage unit judges and outputs the storage type of the data file associated with the access request, and outputs the judgment result;
step B3, the first storage unit reads the data file related to the access request in the storage space or the second storage unit according to the judgment result;
and step B4, the first storage unit decrypts the read data file, and the decrypted data file is cached in the storage space for the user to view.
While the invention has been described with reference to a preferred embodiment, it will be understood by those skilled in the art that various changes in form and detail may be made therein without departing from the spirit and scope of the invention.
Claims (8)
1. A hierarchical storage system is characterized by comprising a first storage unit and a second storage unit, wherein the first storage unit is connected with the second storage unit;
the first storage unit comprises a storage space for storing data files and a storage controller of the first storage unit, and the storage controller is connected with the storage space;
the storage controller includes:
the data acquisition module is used for acquiring the data file input by the user through an encrypted writing interface provided by the first storage unit;
the encryption module is connected with the data acquisition module and used for encrypting the acquired data file, and the encrypted data file is cached in the storage space;
the hierarchical storage module is used for dividing the data files cached in the storage space into storage types, reserving the data files with a first storage type in the storage space and storing the data files with a second storage type in the second storage unit;
the request acquisition module is connected with the hierarchical storage module and used for acquiring an access request which is input by a user and used for accessing the stored data file through an encryption reading interface provided by the first storage unit;
the hierarchical storage module is further used for judging and outputting the storage type of the data file associated with the access request, and outputting a judgment result;
the data reading module is connected with the hierarchical storage module and used for reading the data file related to the access request in the storage space or the second storage unit according to the judgment result;
the decryption module is connected with the data reading module and used for decrypting the read data file, and the decrypted data file is cached in the storage space for a user to check;
the first storage unit is a PCIe solid state disk.
2. The hierarchical storage system according to claim 1, wherein the first storage type is a hot data type.
3. The tiered storage system of claim 1 wherein said second storage type is a cold data type;
the second storage unit is realized by adopting a blue light storage technology.
4. The hierarchical storage system according to claim 1, wherein the hierarchical storage module controls the second storage unit to read and save the data file having the second storage type through a normal read interface provided by the first storage unit.
5. A hierarchical storage method is characterized in that a first storage unit and a second storage unit are arranged, and the first storage unit is connected with the second storage unit;
the hierarchical storage method comprises a data writing process, and specifically comprises the following steps:
step A1, inputting data files by a user through an encrypted writing interface provided by the first storage unit;
step A2, encrypting the acquired data file by the first storage unit, and caching the encrypted data file in a storage space in the first storage unit;
step A3, the data files cached in the storage space of the first storage unit are divided into storage types, the hierarchical storage module reserves the data files with the first storage type in the storage space, and saves the data files with the second storage type in the second storage unit;
the first storage unit is a PCIe solid state disk;
the hierarchical storage method further comprises a data reading process, and the hierarchical storage method specifically comprises the following steps:
step B1, the user inputs the access request for accessing the saved data file through the encrypted reading interface provided by the first storage unit;
a step B2 of the first storage unit judging and outputting the storage type of the data file associated with the access request, and outputting a judgment result;
step B3, the first storage unit reads the data file associated with the access request in the storage space or the second storage unit according to the determination result;
and step B4, the first storage unit decrypts the read data file, and the decrypted data file is cached in the storage space for a user to view.
6. The hierarchical storage method according to claim 5, wherein the first storage type is a hot data type.
7. The hierarchical storage method according to claim 5, wherein the second storage type is a cold data type;
the second storage unit is realized by adopting a blue light storage technology.
8. The hierarchical storage method according to claim 5, wherein the first storage unit controls the second storage unit to read and save the data file having the second storage type through a normal read interface provided by the first storage unit.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811140606.XA CN109491595B (en) | 2018-09-28 | 2018-09-28 | Hierarchical storage system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811140606.XA CN109491595B (en) | 2018-09-28 | 2018-09-28 | Hierarchical storage system and method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109491595A CN109491595A (en) | 2019-03-19 |
| CN109491595B true CN109491595B (en) | 2020-11-17 |
Family
ID=65690016
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811140606.XA Active CN109491595B (en) | 2018-09-28 | 2018-09-28 | Hierarchical storage system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109491595B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112463745A (en) * | 2020-12-04 | 2021-03-09 | 宁夏新航信息科技有限公司 | Data storage method and data storage device |
| CN114780023A (en) * | 2022-03-29 | 2022-07-22 | 北京柏睿数据技术股份有限公司 | Method and device for quickly accessing data file |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101788959A (en) * | 2010-02-03 | 2010-07-28 | 武汉固捷联讯科技有限公司 | Solid state hard disk secure encryption system |
| CN103186350B (en) * | 2011-12-31 | 2016-03-30 | 北京快网科技有限公司 | The moving method of mixing storage system and hot spot data block |
| CN203102263U (en) * | 2012-09-14 | 2013-07-31 | 天津捷同科技有限公司 | Solid state disk encrypting system |
| CN103605615B (en) * | 2013-11-21 | 2017-02-15 | 郑州云海信息技术有限公司 | Block-level-data-based directional allocation method for hierarchical storage |
-
2018
- 2018-09-28 CN CN201811140606.XA patent/CN109491595B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN109491595A (en) | 2019-03-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR101155697B1 (en) | Data whitening for writing and reading data to and from a non-volatile memory | |
| JP4648687B2 (en) | Method and apparatus for encryption conversion in data storage system | |
| JP7222971B2 (en) | Apparatus and method for encryption and decryption of stored data | |
| US20090119517A1 (en) | Apparatus and Method for Securing Data on a Portable Storage Device | |
| US9324361B2 (en) | Protecting stored data from traffic analysis | |
| US20090271638A1 (en) | Storage system with an encryption function | |
| US20060182281A1 (en) | Storage system, data migration method and management computer | |
| CN109491595B (en) | Hierarchical storage system and method | |
| US20140040637A1 (en) | Encrypting data on primary storage device and on cache storage device | |
| CN112084138A (en) | SoC (system on chip) security disk control chip architecture design method for trusted storage | |
| CN113420308A (en) | Data access control method and control system for encryption memory | |
| JP4764455B2 (en) | External storage device | |
| WO2019041272A1 (en) | Method and device for encrypting and decrypting computer memory data | |
| US8132025B2 (en) | Management method for archive system security | |
| JP2006293583A (en) | File management method | |
| US20100138670A1 (en) | Storage apparatus and data writing method | |
| CN103136122A (en) | Encryption method of removable disc | |
| JPWO2008090928A1 (en) | Data conversion method, apparatus and program on storage medium | |
| CN116680715A (en) | Database encryption configuration method and device, electronic equipment and storage medium | |
| JP6277797B2 (en) | Storage medium control apparatus, storage medium control method, and program | |
| JP2009187646A (en) | Encrypting/decrypting apparatus for hard disk drive, and hard disk drive apparatus | |
| JP2004326260A (en) | Data writing method and data reading method and data recording device using them | |
| US20220123932A1 (en) | Data storage device encryption | |
| US9058295B2 (en) | Encrypt data of storage device | |
| CN110929303A (en) | Data processing method, device and system and solid state disk |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20201022 Address after: No.288, Baichuan Road, Hai'an high tech Zone, Nantong City, Jiangsu Province, 226600 Applicant after: Fangyixin Electronic Technology (Jiangsu) Co., Ltd Address before: 200433 room 323, No. 1101-162, National Road, Shanghai, Yangpu District Applicant before: FANGYI INFORMATION TECHNOLOGY (SHANGHAI) Co.,Ltd. |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |