CN110703997A - Cloud storage system, data storage method, device, equipment and computer medium - Google Patents
Cloud storage system, data storage method, device, equipment and computer medium Download PDFInfo
- Publication number
- CN110703997A CN110703997A CN201910931450.5A CN201910931450A CN110703997A CN 110703997 A CN110703997 A CN 110703997A CN 201910931450 A CN201910931450 A CN 201910931450A CN 110703997 A CN110703997 A CN 110703997A
- Authority
- CN
- China
- Prior art keywords
- storage device
- storage
- target
- data
- group
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000013500 data storage Methods 0.000 title claims abstract description 37
- 238000000034 method Methods 0.000 title claims abstract description 27
- 238000004590 computer program Methods 0.000 claims description 16
- 238000012546 transfer Methods 0.000 claims description 8
- 230000000875 corresponding effect Effects 0.000 description 23
- 238000004891 communication Methods 0.000 description 7
- 238000010586 diagram Methods 0.000 description 7
- 238000005516 engineering process Methods 0.000 description 6
- 206010063385 Intellectualisation Diseases 0.000 description 2
- 238000007726 management method Methods 0.000 description 2
- 239000002699 waste material Substances 0.000 description 2
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0604—Improving or facilitating administration, e.g. storage management
- G06F3/0607—Improving or facilitating administration, e.g. storage management by facilitating the process of upgrading existing storage systems, e.g. for improving compatibility between host and storage device
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0646—Horizontal data movement in storage systems, i.e. moving data in between storage devices or systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The application discloses a cloud storage system, a data storage method, a data storage device, equipment and a computer medium, wherein the system comprises a server and a storage device group connected with the server; the server is used for receiving the data to be stored, storing the data to be stored to the uppermost storage device in the storage device group, and transferring the data with the access frequency smaller than the first frequency threshold value in the target storage devices to the lower storage device of the target storage devices for each target storage device in the storage device group; the storage equipment group comprises a preset number of storage equipment; the storage equipment with the optimal storage performance in the storage equipment group is the storage equipment with the optimal storage performance in the uppermost storage equipment, and the storage equipment with the storage performance second to that of the target storage equipment in the storage equipment group is the lower storage equipment; the first frequency threshold is an access frequency threshold corresponding to the target storage device. The storage system provided by the application realizes the balance of cost and performance of the cloud storage system.
Description
Technical Field
The present application relates to the field of storage technologies, and in particular, to a cloud storage system, a data storage method, an apparatus, a device, and a computer medium.
Background
Cloud storage is a mode of online storage on the internet, i.e., data is stored on a plurality of virtual servers, which are usually hosted by third parties, rather than on dedicated servers. The cloud storage can be used for realizing automation and intellectualization of storage management, the utilization rate of a storage space can be improved, and resource waste is avoided.
At present, the storage capacity of cloud storage is based on the storage device in the cloud storage, and when the performance of the storage device is strong, the storage capacity of the cloud storage is strong, however, the cost of the storage device with strong performance is also higher, so that the cost of the cloud storage is higher.
In summary, how to balance the storage performance and cost of cloud storage is a problem to be solved urgently by those skilled in the art.
Disclosure of Invention
The application aims to provide a cloud storage system which can solve the technical problem of balancing the storage performance and cost of cloud storage to a certain extent. The application also provides a data storage method, a device, equipment and a computer readable storage medium.
In order to achieve the above purpose, the present application provides the following technical solutions:
a cloud storage system comprises a server and a storage device group connected with the server;
the server is used for receiving data to be stored and storing the data to be stored to the uppermost storage device in the storage device group; for each target storage device in the storage device group, transferring data with access frequency smaller than a first frequency threshold value in the target storage device to a lower storage device of the target storage device;
the storage device group comprises a preset number of storage devices; the storage device at the uppermost layer is a storage device with the optimal storage performance in the storage device group, and the storage device at the lower layer is a storage device with the storage performance second to that of the target storage device in the storage device group; the first frequency threshold is an access frequency threshold corresponding to the target storage device.
Preferably, the preset number is 3.
Preferably, the storage device group comprises an SSD, a first rotational speed HDD, and a second rotational speed HDD;
wherein the rotation speed of the first rotation speed HDD is higher than the rotation speed of the second rotation speed HDD.
Preferably, the server is further configured to:
for each target storage device in the storage device group, transferring data with access frequency greater than a second frequency threshold value in the target storage device to an upper storage device of the target storage device;
wherein the upper storage device is a storage device in the storage device group, the storage performance of which is only higher than that of the target storage device; the second frequency threshold is an access frequency threshold corresponding to the target storage device.
Preferably, the second frequency threshold is larger than the first frequency threshold by a preset value, and the preset value corresponds to a performance difference between the target storage device and the upper storage device.
A data storage method is applied to a server in a cloud storage system and comprises the following steps:
receiving data to be stored;
storing the data to be stored to the uppermost storage device in the storage device group;
for each target storage device in the storage device group, transferring data with access frequency smaller than a first frequency threshold value in the target storage device to a lower storage device of the target storage device;
the storage equipment group comprises a preset number of storage equipment connected with the server; the storage device at the uppermost layer is a storage device with the optimal storage performance in the storage device group, and the storage device at the lower layer is a storage device with the storage performance second to that of the target storage device in the storage device group; the first frequency threshold is an access frequency threshold corresponding to the target storage device.
Preferably, the method further comprises the following steps:
for each target storage device in the storage device group, transferring data with access frequency greater than a second frequency threshold value in the target storage device to an upper storage device of the target storage device;
wherein the upper storage device is a storage device in the storage device group, the storage performance of which is only higher than that of the target storage device; the second frequency threshold is an access frequency threshold corresponding to the target storage device.
A data storage device is applied to a server in a cloud storage system and comprises:
the first receiving module is used for receiving data to be stored;
the first storage module is used for storing the data to be stored to the uppermost storage device in the storage device group;
a first transfer module, configured to, for each target storage device in the storage device group, transfer data in the target storage device whose access frequency is smaller than a first frequency threshold to a lower storage device of the target storage device;
the storage equipment group comprises a preset number of storage equipment connected with the server; the storage device at the uppermost layer is a storage device with the optimal storage performance in the storage device group, and the storage device at the lower layer is a storage device with the storage performance second to that of the target storage device in the storage device group; the first frequency threshold is an access frequency threshold corresponding to the target storage device.
A data storage device is applied to a server in a cloud storage system and comprises:
a memory for storing a computer program;
a processor for implementing the steps of the data storage method as described in any one of the above when executing the computer program.
A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the steps of the data storage method as set forth in any one of the preceding claims.
The cloud storage system comprises a server and a storage equipment group connected with the server; the server is used for receiving the data to be stored, storing the data to be stored to the uppermost storage device in the storage device group, and transferring the data with the access frequency smaller than the first frequency threshold value in the target storage devices to the lower storage device of the target storage devices for each target storage device in the storage device group; the storage equipment group comprises a preset number of storage equipment; the storage equipment with the optimal storage performance in the storage equipment group is the storage equipment with the optimal storage performance in the uppermost storage equipment, and the storage equipment with the storage performance second to that of the target storage equipment in the storage equipment group is the lower storage equipment; the first frequency threshold is an access frequency threshold corresponding to the target storage device. The storage system comprises a server and a storage device group, the storage device group comprises a preset number of storage devices, and the storage performance of each storage device is different, so that the server can manage data stored in each storage device based on access frequency, specifically, data with access frequency smaller than a first frequency threshold corresponding to a target storage device are transferred to a lower storage device of the target storage device, and therefore data with high access frequency are stored in the storage devices with excellent storage performance, the storage performance of the cloud storage system is guaranteed, the cost of the cloud storage system is reduced, and balance between the cost and the performance of the cloud storage system is achieved. The data storage method, the data storage device, the data storage equipment and the computer readable storage medium solve the corresponding technical problems.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below, it is obvious that the drawings in the following description are only embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.
Fig. 1 is a schematic structural diagram of a cloud storage system according to an embodiment of the present application;
fig. 2 is a flowchart of a data storage method according to an embodiment of the present application;
fig. 3 is a schematic structural diagram of a data storage device according to an embodiment of the present application;
fig. 4 is a schematic structural diagram of a data storage device according to an embodiment of the present application;
fig. 5 is another schematic structural diagram of a data storage device according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
Cloud storage is a mode of online storage on the internet, i.e., data is stored on a plurality of virtual servers, which are usually hosted by third parties, rather than on dedicated servers. The cloud storage can be used for realizing automation and intellectualization of storage management, the utilization rate of a storage space can be improved, and resource waste is avoided. At present, the storage capacity of cloud storage is based on the storage device in the cloud storage, and when the performance of the storage device is strong, the storage capacity of the cloud storage is strong, however, the cost of the storage device with strong performance is also higher, so that the cost of the cloud storage is higher. The cloud storage system provided by the application can balance the storage performance and cost of cloud storage.
Referring to fig. 1, fig. 1 is a schematic structural diagram of a cloud storage system according to an embodiment of the present disclosure.
The cloud storage system provided by the embodiment of the application comprises a server 11 and a storage device group 12 connected with the server 11;
the server 11 is configured to receive data to be stored, and store the data to be stored to the uppermost storage device in the storage device group; for each target storage device in the storage device group, transferring the data with the access frequency smaller than a first frequency threshold value in the target storage device to the lower storage device of the target storage device;
the storage equipment group comprises a preset number of storage equipment; the storage equipment with the optimal storage performance in the storage equipment group is the storage equipment with the optimal storage performance in the uppermost storage equipment, and the storage equipment with the storage performance second to that of the target storage equipment in the storage equipment group is the lower storage equipment; the first frequency threshold is an access frequency threshold corresponding to the target storage device.
In practical application, the number of storage devices in the storage device group in the cloud storage system provided by the embodiment of the present application may be determined according to actual needs, for example, the storage device group may include five storage devices, and as can be known from descriptions of the uppermost storage device, the lower storage device, and the optimal storage performance in the present application, differences exist between storage performances of the storage devices in the storage device group in the present application; therefore, when the server stores data, the data to be stored can be preferentially stored in the uppermost storage device in the storage device group, then, for each target storage device in the storage device group, the data with the access frequency smaller than the first frequency threshold value in the target storage device is transferred to the lower storage device of the target storage device, that is, the server stores the data with the high access frequency in the storage device with good storage performance, and stores the data with the low access frequency in the storage device with poor storage performance.
The cloud storage system comprises a server and a storage equipment group connected with the server; the server is used for receiving the data to be stored, storing the data to be stored to the uppermost storage device in the storage device group, and transferring the data with the access frequency smaller than the first frequency threshold value in the target storage devices to the lower storage device of the target storage devices for each target storage device in the storage device group; the storage equipment group comprises a preset number of storage equipment; the storage equipment with the optimal storage performance in the storage equipment group is the storage equipment with the optimal storage performance in the uppermost storage equipment, and the storage equipment with the storage performance second to that of the target storage equipment in the storage equipment group is the lower storage equipment; the first frequency threshold is an access frequency threshold corresponding to the target storage device. The storage system comprises a server and a storage device group, the storage device group comprises a preset number of storage devices, and the storage performance of each storage device is different, so that the server can manage data stored in each storage device based on access frequency, specifically, data with access frequency smaller than a first frequency threshold corresponding to a target storage device are transferred to a lower storage device of the target storage device, and therefore data with high access frequency are stored in the storage devices with excellent storage performance, the storage performance of the cloud storage system is guaranteed, the cost of the cloud storage system is reduced, and balance between the cost and the performance of the cloud storage system is achieved.
In practical applications, in the cloud storage system provided in the embodiment of the present application, in order to avoid that the volume of the cloud storage system is too large due to an excessive number of storage devices in the storage device group, the preset number of storage devices in the storage device group may be set to 3.
In a specific application scenario, the storage device group can be realized by an SSD, a first rotating speed HDD and a second rotating speed HDD; wherein the rotation speed of the first rotation speed HDD is higher than the rotation speed of the second rotation speed HDD.
In practical applications, in the cloud storage system provided in the embodiment of the present application, since the access frequency of the data constantly changes with time, in order to ensure effective utilization of the storage performance of the cloud storage system, the storage location of the data needs to be adjusted at any time, and in the present application, the server is further configured to:
for each target storage device in the storage device group, transferring the data with the access frequency larger than the second frequency threshold value in the target storage device to an upper storage device of the target storage device;
the upper-layer storage equipment is storage equipment of which the storage performance is only higher than that of target storage equipment in the storage equipment group; the second frequency threshold is an access frequency threshold corresponding to the target storage device.
In a specific application scenario, whether data should be stored in a storage device with good storage performance or a storage device with poor storage performance may be determined according to actual needs, in the present application, a second frequency threshold may be set to be larger than a first frequency threshold by a preset value, and the preset value corresponds to a performance difference between a target storage device and an upper storage device, so that the server may transfer the data from the target storage device to the upper storage device when an access frequency of the data corresponds to the storage performance of the upper storage device.
Referring to fig. 2, fig. 2 is a flowchart of a data storage method according to an embodiment of the present disclosure.
The data storage method provided by the embodiment of the application is applied to a server in a cloud storage system, and can comprise the following steps:
step S101: data to be stored is received.
Step S102: and storing the data to be stored to the uppermost storage device in the storage device group.
Step S103: for each target storage device in the storage device group, transferring the data with the access frequency smaller than a first frequency threshold value in the target storage device to the lower storage device of the target storage device; the storage equipment group comprises a preset number of storage equipment connected with the server; the storage equipment with the optimal storage performance in the storage equipment group is the storage equipment with the optimal storage performance in the uppermost storage equipment, and the storage equipment with the storage performance second to that of the target storage equipment in the storage equipment group is the lower storage equipment; the first frequency threshold is an access frequency threshold corresponding to the target storage device.
In the data storage method provided in the embodiment of the present application, the server may be further configured to execute the following steps:
for each target storage device in the storage device group, transferring the data with the access frequency larger than the second frequency threshold value in the target storage device to an upper storage device of the target storage device;
the upper-layer storage equipment is storage equipment of which the storage performance is only higher than that of target storage equipment in the storage equipment group; the second frequency threshold is an access frequency threshold corresponding to the target storage device.
Referring to fig. 3, fig. 3 is a schematic structural diagram of a data storage device according to an embodiment of the present disclosure.
The data storage device provided by the embodiment of the application is applied to a server in a cloud storage system, and may include:
a first receiving module 101, configured to receive data to be stored;
the first storage module 102 is configured to store data to be stored to an uppermost storage device in the storage device group;
a first transfer module 103, configured to, for each target storage device in the storage device group, transfer data in the target storage device whose access frequency is smaller than a first frequency threshold to a lower storage device of the target storage device;
the storage equipment group comprises a preset number of storage equipment connected with the server; the storage equipment with the optimal storage performance in the storage equipment group is the storage equipment with the optimal storage performance in the uppermost storage equipment, and the storage equipment with the storage performance second to that of the target storage equipment in the storage equipment group is the lower storage equipment; the first frequency threshold is an access frequency threshold corresponding to the target storage device.
The data storage device provided by the embodiment of the application is applied to a server in a cloud storage system, and may further include:
the second transfer module is used for transferring the data with the access frequency larger than the second frequency threshold value in the target storage equipment to the upper storage equipment of the target storage equipment for each target storage equipment in the storage equipment group;
the upper-layer storage equipment is storage equipment of which the storage performance is only higher than that of target storage equipment in the storage equipment group; the second frequency threshold is an access frequency threshold corresponding to the target storage device.
The application also provides a data storage device and a computer readable storage medium, which have corresponding effects of the data storage method provided by the embodiment of the application. Referring to fig. 4, fig. 4 is a schematic structural diagram of a data storage device according to an embodiment of the present disclosure.
The data storage device provided by the embodiment of the application comprises a memory 201 and a processor 202, wherein a computer program is stored in the memory 201, and the processor 202 implements the following steps when executing the computer program:
receiving data to be stored;
storing data to be stored to the uppermost storage device in the storage device group;
for each target storage device in the storage device group, transferring the data with the access frequency smaller than a first frequency threshold value in the target storage device to the lower storage device of the target storage device;
the storage equipment group comprises a preset number of storage equipment connected with the server; the storage equipment with the optimal storage performance in the storage equipment group is the storage equipment with the optimal storage performance in the uppermost storage equipment, and the storage equipment with the storage performance second to that of the target storage equipment in the storage equipment group is the lower storage equipment; the first frequency threshold is an access frequency threshold corresponding to the target storage device.
The data storage device provided by the embodiment of the application comprises a memory 201 and a processor 202, wherein a computer program is stored in the memory 201, and the processor 202 implements the following steps when executing the computer program: for each target storage device in the storage device group, transferring the data with the access frequency larger than the second frequency threshold value in the target storage device to an upper storage device of the target storage device; the upper-layer storage equipment is storage equipment of which the storage performance is only higher than that of target storage equipment in the storage equipment group; the second frequency threshold is an access frequency threshold corresponding to the target storage device.
Referring to fig. 5, another data storage device provided in the embodiment of the present application may further include: an input port 203 connected to the processor 202, for transmitting externally input commands to the processor 202; a display unit 204 connected to the processor 202, for displaying the processing result of the processor 202 to the outside; and the communication module 205 is connected with the processor 202 and is used for realizing the communication between the data storage device and the outside. The display unit 204 may be a display panel, a laser scanning display, or the like; the communication method adopted by the communication module 205 includes, but is not limited to, mobile high definition link technology (HML), Universal Serial Bus (USB), High Definition Multimedia Interface (HDMI), and wireless connection: wireless fidelity technology (WiFi), bluetooth communication technology, bluetooth low energy communication technology, ieee802.11s based communication technology.
A computer-readable storage medium is provided in an embodiment of the present application, in which a computer program is stored, and when the computer program is executed by a processor, the computer program implements the following steps:
receiving data to be stored;
storing data to be stored to the uppermost storage device in the storage device group;
for each target storage device in the storage device group, transferring the data with the access frequency smaller than a first frequency threshold value in the target storage device to the lower storage device of the target storage device;
the storage equipment group comprises a preset number of storage equipment connected with the server; the storage equipment with the optimal storage performance in the storage equipment group is the storage equipment with the optimal storage performance in the uppermost storage equipment, and the storage equipment with the storage performance second to that of the target storage equipment in the storage equipment group is the lower storage equipment; the first frequency threshold is an access frequency threshold corresponding to the target storage device.
A computer-readable storage medium is provided in an embodiment of the present application, in which a computer program is stored, and when the computer program is executed by a processor, the computer program implements the following steps: for each target storage device in the storage device group, transferring the data with the access frequency larger than the second frequency threshold value in the target storage device to an upper storage device of the target storage device; the upper-layer storage equipment is storage equipment of which the storage performance is only higher than that of target storage equipment in the storage equipment group; the second frequency threshold is an access frequency threshold corresponding to the target storage device.
The computer-readable storage media to which this application relates include Random Access Memory (RAM), memory, Read Only Memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage media known in the art.
For a description of a relevant part in a data storage method, an apparatus, a device, and a computer-readable storage medium provided in the embodiments of the present application, reference is made to detailed descriptions of a corresponding part in a cloud storage system provided in the embodiments of the present application, and details are not repeated here. In addition, parts of the above technical solutions provided in the embodiments of the present application, which are consistent with the implementation principles of corresponding technical solutions in the prior art, are not described in detail so as to avoid redundant description.
It is further noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the application. Thus, the present application is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims (10)
1. The cloud storage system is characterized by comprising a server and a storage equipment group connected with the server;
the server is used for receiving data to be stored and storing the data to be stored to the uppermost storage device in the storage device group; for each target storage device in the storage device group, transferring data with access frequency smaller than a first frequency threshold value in the target storage device to a lower storage device of the target storage device;
the storage device group comprises a preset number of storage devices; the storage device at the uppermost layer is a storage device with the optimal storage performance in the storage device group, and the storage device at the lower layer is a storage device with the storage performance second to that of the target storage device in the storage device group; the first frequency threshold is an access frequency threshold corresponding to the target storage device.
2. The system of claim 1, wherein the predetermined number is 3.
3. The system of claim 2, wherein the storage device group comprises an SSD, a first rotational speed HDD, a second rotational speed HDD;
wherein the rotation speed of the first rotation speed HDD is higher than the rotation speed of the second rotation speed HDD.
4. The system of any of claims 1 to 3, wherein the server is further configured to:
for each target storage device in the storage device group, transferring data with access frequency greater than a second frequency threshold value in the target storage device to an upper storage device of the target storage device;
wherein the upper storage device is a storage device in the storage device group, the storage performance of which is only higher than that of the target storage device; the second frequency threshold is an access frequency threshold corresponding to the target storage device.
5. The system of claim 4, wherein the second frequency threshold is greater than the first frequency threshold by a predetermined amount, the predetermined amount corresponding to a performance difference between the target storage device and the upper storage device.
6. A data storage method is applied to a server in a cloud storage system, and comprises the following steps:
receiving data to be stored;
storing the data to be stored to the uppermost storage device in the storage device group;
for each target storage device in the storage device group, transferring data with access frequency smaller than a first frequency threshold value in the target storage device to a lower storage device of the target storage device;
the storage equipment group comprises a preset number of storage equipment connected with the server; the storage device at the uppermost layer is a storage device with the optimal storage performance in the storage device group, and the storage device at the lower layer is a storage device with the storage performance second to that of the target storage device in the storage device group; the first frequency threshold is an access frequency threshold corresponding to the target storage device.
7. The method of claim 6, further comprising:
for each target storage device in the storage device group, transferring data with access frequency greater than a second frequency threshold value in the target storage device to an upper storage device of the target storage device;
wherein the upper storage device is a storage device in the storage device group, the storage performance of which is only higher than that of the target storage device; the second frequency threshold is an access frequency threshold corresponding to the target storage device.
8. A data storage device is applied to a server in a cloud storage system, and comprises:
the first receiving module is used for receiving data to be stored;
the first storage module is used for storing the data to be stored to the uppermost storage device in the storage device group;
a first transfer module, configured to, for each target storage device in the storage device group, transfer data in the target storage device whose access frequency is smaller than a first frequency threshold to a lower storage device of the target storage device;
the storage equipment group comprises a preset number of storage equipment connected with the server; the storage device at the uppermost layer is a storage device with the optimal storage performance in the storage device group, and the storage device at the lower layer is a storage device with the storage performance second to that of the target storage device in the storage device group; the first frequency threshold is an access frequency threshold corresponding to the target storage device.
9. The data storage device is applied to a server in a cloud storage system, and comprises:
a memory for storing a computer program;
a processor for implementing the steps of the data storage method as claimed in claim 6 or 7 when executing said computer program.
10. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the steps of the data storage method according to claim 6 or 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910931450.5A CN110703997A (en) | 2019-09-29 | 2019-09-29 | Cloud storage system, data storage method, device, equipment and computer medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910931450.5A CN110703997A (en) | 2019-09-29 | 2019-09-29 | Cloud storage system, data storage method, device, equipment and computer medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110703997A true CN110703997A (en) | 2020-01-17 |
Family
ID=69197531
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910931450.5A Pending CN110703997A (en) | 2019-09-29 | 2019-09-29 | Cloud storage system, data storage method, device, equipment and computer medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110703997A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114647386A (en) * | 2022-04-02 | 2022-06-21 | 南京大昌智能科技有限公司 | Big data distributed storage method based on artificial intelligence |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102411542A (en) * | 2011-10-26 | 2012-04-11 | 上海文广互动电视有限公司 | Dynamic hierarchical storage system and method |
| CN102831088A (en) * | 2012-07-27 | 2012-12-19 | 国家超级计算深圳中心(深圳云计算中心) | Data migration method and device based on mixing memory |
| CN103795756A (en) * | 2012-10-31 | 2014-05-14 | 中国电信股份有限公司 | Hierarchical storage method, hierarchical storage system and object access controller |
-
2019
- 2019-09-29 CN CN201910931450.5A patent/CN110703997A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102411542A (en) * | 2011-10-26 | 2012-04-11 | 上海文广互动电视有限公司 | Dynamic hierarchical storage system and method |
| CN102831088A (en) * | 2012-07-27 | 2012-12-19 | 国家超级计算深圳中心(深圳云计算中心) | Data migration method and device based on mixing memory |
| CN103795756A (en) * | 2012-10-31 | 2014-05-14 | 中国电信股份有限公司 | Hierarchical storage method, hierarchical storage system and object access controller |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114647386A (en) * | 2022-04-02 | 2022-06-21 | 南京大昌智能科技有限公司 | Big data distributed storage method based on artificial intelligence |
| CN114647386B (en) * | 2022-04-02 | 2023-12-26 | 水发科技信息(山东)有限公司 | Big data distributed storage method based on artificial intelligence |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10235047B2 (en) | Memory management method, apparatus, and system | |
| US20140245394A1 (en) | Trust-based computing resource authorization in a networked computing environment | |
| US10331470B2 (en) | Virtual machine creation according to a redundancy policy | |
| CN102316043B (en) | Port virtualization method, switch and communication system | |
| CN110719345B (en) | Virtual machine MAC address generation method, system, equipment and computer medium | |
| US11237761B2 (en) | Management of multiple physical function nonvolatile memory devices | |
| CN107423301B (en) | Data processing method, related equipment and storage system | |
| CN103516547A (en) | Network parameter distribution method and device | |
| EP3432132A1 (en) | Data storage method and device | |
| CN105302536A (en) | Configuration method and apparatus for related parameters of MapReduce application | |
| US20150348177A1 (en) | Managing lease transactions in distributed systems | |
| CN103617024B (en) | A kind of concurrent data disposal route, device and system | |
| CN108234551A (en) | A kind of data processing method and device | |
| CN110365783B (en) | File deployment method and device, network node and storage medium | |
| CN102970349B (en) | A kind of memory load equalization methods of DHT network | |
| CN110703997A (en) | Cloud storage system, data storage method, device, equipment and computer medium | |
| US10789008B2 (en) | Reducing write collisions in data copy | |
| CN106933646B (en) | Method and device for creating virtual machine | |
| CN108833570B (en) | Cluster storage and balanced transmission system based on cloud storage | |
| CN107797758A (en) | Date storage method, data access method and device | |
| CN113986134B (en) | Method for storing data, method and device for reading data | |
| CN105765542A (en) | Method for accessing files, distributed storage system and storage node | |
| CN111858129B (en) | Erasure code read request processing method, system, equipment and computer medium | |
| CN113254160A (en) | IO resource request method and device | |
| WO2022043792A1 (en) | Input/output queue hinting for resource utilization |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200117 |