CN111475117B - Aggregated cloud storage QoS control method and system - Google Patents
Aggregated cloud storage QoS control method and system Download PDFInfo
- Publication number
- CN111475117B CN111475117B CN202010272635.2A CN202010272635A CN111475117B CN 111475117 B CN111475117 B CN 111475117B CN 202010272635 A CN202010272635 A CN 202010272635A CN 111475117 B CN111475117 B CN 111475117B
- Authority
- CN
- China
- Prior art keywords
- cloud storage
- storage
- qos
- user data
- cloud
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000003860 storage Methods 0.000 title claims abstract description 274
- 238000000034 method Methods 0.000 title claims abstract description 23
- 230000004044 response Effects 0.000 claims abstract description 41
- 238000013500 data storage Methods 0.000 claims abstract description 22
- 238000002372 labelling Methods 0.000 claims abstract description 10
- 238000012216 screening Methods 0.000 claims abstract description 7
- 238000004364 calculation method Methods 0.000 claims description 13
- 238000012217 deletion Methods 0.000 claims description 3
- 230000037430 deletion Effects 0.000 claims description 3
- 230000014759 maintenance of location Effects 0.000 claims description 3
- 238000004590 computer program Methods 0.000 description 7
- 238000010586 diagram Methods 0.000 description 7
- 239000008186 active pharmaceutical agent Substances 0.000 description 5
- 230000006870 function Effects 0.000 description 4
- 238000012545 processing Methods 0.000 description 4
- 238000013475 authorization Methods 0.000 description 2
- 238000007726 management method Methods 0.000 description 2
- 230000002776 aggregation Effects 0.000 description 1
- 238000004220 aggregation Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000007429 general method Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0614—Improving the reliability of storage systems
- G06F3/0619—Improving the reliability of storage systems in relation to data integrity, e.g. data losses, bit errors
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1402—Saving, restoring, recovering or retrying
- G06F11/1446—Point-in-time backing up or restoration of persistent data
- G06F11/1448—Management of the data involved in backup or backup restore
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1402—Saving, restoring, recovering or retrying
- G06F11/1446—Point-in-time backing up or restoration of persistent data
- G06F11/1458—Management of the backup or restore process
- G06F11/1464—Management of the backup or restore process for networked environments
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0629—Configuration or reconfiguration of storage systems
- G06F3/0631—Configuration or reconfiguration of storage systems by allocating resources to storage systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0646—Horizontal data movement in storage systems, i.e. moving data in between storage devices or systems
- G06F3/065—Replication mechanisms
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0646—Horizontal data movement in storage systems, i.e. moving data in between storage devices or systems
- G06F3/0652—Erasing, e.g. deleting, data cleaning, moving of data to a wastebasket
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0653—Monitoring storage devices or systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
Abstract
The invention discloses an aggregate cloud storage QoS control method, which comprises the steps of obtaining response time, network bandwidth and storage space of each cloud storage, and calculating QoS performance of each cloud storage; according to QoS performance of each cloud storage, calculating QoS grade of each cloud storage; screening cloud storage with highest QoS (quality of service) level, and marking the cloud storage as a current storage unit; creating a copy of the user data in response to storing the user data to the current storage unit; responding to failure of user data storage, reducing cloud storage grade serving as a front storage unit according to a preset rule, re-labeling a current storage unit, and storing a user data copy to the current storage unit; in response to successful storage of the user data, the user data copy is deleted. Corresponding systems are also disclosed. The invention stores the user data according to the QoS grade, creates the user data copy during storage, and deletes the user data copy only after successful storage, thereby avoiding the loss to the user caused by data uploading failure.
Description
Technical Field
The invention relates to an aggregation cloud storage QoS control method and system, and belongs to the field of computer technology information management.
Background
In the cloud storage system, the data storage servers are all common computers, so that the data uploading is not guaranteed to be successful in a hundred percent. When user data is uploaded to cloud storage, the situation that the cloud storage cannot respond timely or normal storage service cannot be provided may occur, and the user data is lost due to failure in uploading.
Disclosure of Invention
The invention provides an aggregate cloud storage QoS control method and system, which solve the problem that user data is lost due to uploading failure.
In order to solve the technical problems, the invention adopts the following technical scheme:
an aggregate cloud storage QoS control method comprises,
acquiring response time, network bandwidth and storage space of each cloud storage, and calculating QoS performance of each cloud storage;
according to QoS performance of each cloud storage, calculating QoS grade of each cloud storage;
screening cloud storage with highest QoS (quality of service) level, and marking the cloud storage as a current storage unit;
creating a copy of the user data in response to storing the user data to the current storage unit;
responding to failure of user data storage, reducing cloud storage grade serving as a current storage unit according to a preset rule, re-labeling the current storage unit, and storing a user data copy to the current storage unit;
in response to successful storage of the user data, the user data copy is deleted.
And acquiring response time, network bandwidth and storage space of each cloud storage, and calculating QoS performance of each cloud storage with response time smaller than a threshold value.
The cloud stores the QoS performance calculation formula as,
wherein q is cloud storage QoS performance, t, w and s are response time, network bandwidth and storage space respectively, and gamma, alpha and beta are weights of t, w and s respectively.
The cloud stores the QoS class calculation formula as,
where l is the cloud storage QoS class, q is the cloud storage QoS performance, and η is the maximum QoS class that the cloud storage can possess.
In response to the current storage unit response time storing user data being less than the threshold, the user data storage is successful.
And if a plurality of cloud storages with highest QoS (quality of service) grades exist, marking the cloud storage with the nearest address as the current storage unit.
Responding to failure of user data storage and cloud storage of a non-level cloud storage of a cloud storage A serving as a current storage unit, selecting a lower level of cloud storage as the current storage unit, and reducing the QoS level of the cloud storage A by one level;
responding to failure of user data storage and cloud storage A with the same level as the cloud storage A of the current storage unit, selecting the cloud storage with the same level and nearest address as the current storage unit, and reducing the QoS level of the cloud storage A by one level;
and responding to failure of user data storage, cloud storage A which is the current storage unit has no level of cloud storage, and cloud storage A with the highest QoS level is the lowest level, and selecting the closest cloud storage with the highest QoS level as the current storage unit.
An aggregated cloud storage QoS control system, comprising,
QoS performance calculation module: acquiring response time, network bandwidth and storage space of each cloud storage, and calculating QoS performance of each cloud storage;
QoS grade calculation module: according to QoS performance of each cloud storage, calculating QoS grade of each cloud storage;
and the marking module is used for: screening cloud storage with highest QoS (quality of service) level, and marking the cloud storage as a current storage unit;
and a copy creation module: creating a copy of the user data in response to storing the user data to the current storage unit;
and (5) a re-labeling module: responding to failure of user data storage, reducing cloud storage grade serving as a front storage unit according to a preset rule, re-labeling a current storage unit, and storing a user data copy to the current storage unit;
and a duplicate deletion module: in response to successful storage of the user data, the user data copy is deleted.
A computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by a computing device, cause the computing device to perform an aggregated cloud storage QoS control method.
A computing device comprising one or more processors, memory, and one or more programs, wherein one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs comprising instructions for performing an aggregated cloud storage QoS control method.
The invention has the beneficial effects that: according to the invention, cloud storage is divided into different QoS grades according to QoS performance, user data is stored according to QoS grades, and user data copies are created when the user data copies are stored, and the user data copies are deleted only after the user data copies are successfully stored, so that the reliability of cloud storage is improved, and the loss caused by data uploading failure to users is avoided.
Drawings
FIG. 1 is a flow chart of the method of the present invention;
FIG. 2 is a cloud storage and QoS level map;
fig. 3 is a schematic structural diagram of an aggregated cloud storage device.
Detailed Description
The invention is further described below with reference to the accompanying drawings. The following examples are only for more clearly illustrating the technical aspects of the present invention, and are not intended to limit the scope of the present invention.
As shown in fig. 1, an aggregated cloud storage QoS control method includes the following steps:
step 1, acquiring response time, network bandwidth and storage space of each cloud storage, and calculating QoS performance of each cloud storage with response time smaller than a threshold value.
A plurality of cloud storage QoS grades can exist in the aggregated cloud storage, the metrics of different QoS dimensions are different, the QoS grade of any cloud storage can be determined by a plurality of elements, and the scheme provides a general method for dividing the QoS grade based on factors such as hardware implementation, network quality, transmission cost and the like.
And when the initialization or each request period starts, sending a test data packet to each cloud storage, and acquiring response time, network bandwidth and storage space of each cloud storage.
If the response time is greater than or equal to the threshold value, indicating that the corresponding cloud storage is unavailable and cannot be used as a storage unit for storing user data, and setting the QoS performance of the cloud storage to 0; the rest cloud storage is available cloud storage, namely QoS performance calculation is carried out on the cloud storage with response time smaller than the threshold value.
The QoS performance element is determined to include response time, network bandwidth and memory space, and the specific formula is as follows:
wherein q is cloud storage QoS performance, t, w and s are response time, network bandwidth and storage space respectively, and gamma, alpha and beta are weights of t, w and s respectively, and the weights are set according to the requirement of a user on QoS.
And step 2, calculating the QoS grade of each cloud storage according to the QoS performance of each cloud storage.
The cloud storage QoS class calculation formula is:
where l is the cloud storage QoS level, η is the maximum QoS level that the cloud can possess.
As shown in fig. 2, there is a "one-to-one" or "many-to-one" mapping relationship between cloud storage and QoS class.
Step 3, screening cloud storage with highest QoS (quality of service) level, and marking the cloud storage as a current storage unit; specifically, a pointer is set, cloud storage pointed by the pointer is used as a current storage unit, and user data is directly uploaded to the current storage unit pointed by the pointer when data storage is carried out subsequently. And if a plurality of cloud storages with highest QoS (quality of service) grades exist, marking the cloud storage with the nearest address as the current storage unit.
And 4, in response to storing the user data in the current storage unit, copying the user data and creating a user data copy.
Step 5, in response to failure in storing the user data, namely that the corresponding time is greater than or equal to a threshold value, reducing cloud storage grade serving as a current storage unit according to a preset rule, re-labeling the current storage unit, and storing the user data copy to the current storage unit; and deleting the user data copy in response to successful storage of the user data, i.e. the corresponding time is less than or equal to the threshold value.
The preset rules are as follows:
A. if the user data storage fails and the cloud storage A serving as the current storage unit is not in the same level, selecting the cloud storage at a lower level as the current storage unit, and reducing the QoS level of the cloud storage A by one level;
B. if the user data storage fails, the cloud storage A serving as the current storage unit has the same-level cloud storage, selecting the cloud storage with the same level and the nearest address as the current storage unit, and reducing the QoS level of the cloud storage A by one level;
C. and responding to failure of user data storage, cloud storage A which is the current storage unit has no level of cloud storage, and cloud storage A with the highest QoS level is the lowest level, and selecting the closest cloud storage with the highest QoS level as the current storage unit.
According to the method, cloud storage is divided into different QoS grades according to QoS performance, user data is stored according to the QoS grades, user data copies are created during storage, the user data copies are deleted only after the storage is successful, reliability of cloud storage is improved, and loss caused by data uploading failure to users is avoided.
An aggregated cloud storage QoS control system, comprising,
QoS performance calculation module: acquiring response time, network bandwidth and storage space of each cloud storage, and calculating QoS performance of each cloud storage;
QoS grade calculation module: according to QoS performance of each cloud storage, calculating QoS grade of each cloud storage;
and the marking module is used for: screening cloud storage with highest QoS (quality of service) level, and marking the cloud storage as a current storage unit;
and a copy creation module: creating a copy of the user data in response to storing the user data to the current storage unit;
and (5) a re-labeling module: responding to failure of user data storage, reducing cloud storage grade serving as a front storage unit according to a preset rule, re-labeling a current storage unit, and storing a user data copy to the current storage unit;
and a duplicate deletion module: in response to successful storage of the user data, the user data copy is deleted.
As shown in fig. 3, an aggregate cloud storage device includes a client and a server; the client side is used for completing user registration and login, obtaining files uploaded by the user and obtaining various requirements of the user on cloud storage. The server side is loaded with an aggregate cloud storage QoS control system, so that QoS level service division, user data copy dynamic copy/delete service and the like are realized.
When the device is started, cloud storage QoS (quality of service) grades are generated, and cloud storage corresponding to each QoS grade is recorded. The device not only provides a world wide web interface to acquire the uploading files of users and QoS requirements for cloud storage, but also provides a Restful API for third-party application programs to collect QoS services provided by the device and the access device. Authentication through role-based access control is required before access to the Restful APIs (some APIs allow only administrator users to access, and some APIs are only accessible to normal users).
The ordinary user accesses a foreground (client) website through a browser, registers a user name and a password, and logs in. And verifying the user login request by managing the Session, and recording and maintaining the Session information in a database.
And after the login is successful, the website user side invokes a Restful API of the back end to upload the file (namely user data), and provides grading service for the aggregated cloud storage. The uploaded file is transmitted to the server through the client website. After uploading files and storing the files to a local server, creating a copy for each file at the server side, and then constructing and distributing tasks according to the generated cloud storage QoS level and pushing the tasks to a message queue. And acquiring the provider and related authorization information from the cloud storage provider authorization service, finishing file uploading, and sending back feedback information. If the uploading is successful, deleting the file copy of the server side; if the uploading fails, the grade of the cloud storage is reduced, and then the file is uploaded to other cloud storage again. Through the interaction of the QoS classification strategy and the data copy strategy, the device realizes continuous optimization management of QoS according to the user requirement and cloud storage capacity.
A computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by a computing device, cause the computing device to perform an aggregated cloud storage QoS control method.
A computing device comprising one or more processors, memory, and one or more programs, wherein one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs comprising instructions for performing an aggregated cloud storage QoS control method.
It will be appreciated by those skilled in the art that embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
The foregoing is illustrative of the present invention and is not to be construed as limiting thereof, but rather as providing for the use of additional embodiments and advantages of all such modifications, equivalents, improvements and similar to the present invention are intended to be included within the scope of the present invention as defined by the appended claims.
Claims (8)
1. An aggregate cloud storage QoS control method is characterized in that: comprising the steps of (a) a step of,
acquiring response time, network bandwidth and storage space of each cloud storage, and calculating QoS performance of each cloud storage; wherein, the calculation formula of the cloud storage QoS performance is as follows,
wherein q is cloud storage QoS performance, t, w and s are response time, network bandwidth and storage space respectively, and gamma, alpha and beta are weights of t, w and s respectively;
according to QoS performance of each cloud storage, calculating QoS grade of each cloud storage;
screening cloud storage with highest QoS (quality of service) level, and marking the cloud storage as a current storage unit;
creating a copy of the user data in response to storing the user data to the current storage unit;
responding to failure of user data storage, reducing cloud storage grade serving as a current storage unit according to a preset rule, re-labeling the current storage unit, and storing a user data copy to the current storage unit; the preset rules are as follows: responding to failure of user data storage and cloud storage of a non-level cloud storage of a cloud storage A serving as a current storage unit, selecting a lower level of cloud storage as the current storage unit, and reducing the QoS level of the cloud storage A by one level; responding to failure of user data storage and cloud storage A with the same level as the cloud storage A of the current storage unit, selecting the cloud storage with the same level and nearest address as the current storage unit, and reducing the QoS level of the cloud storage A by one level; responding to failure of user data storage, cloud storage of a cloud storage A without a level as a current storage unit, and cloud storage A with a QoS level of the lowest level, and selecting the cloud storage with the highest QoS level and the nearest address as the current storage unit; the response time of the current storage unit for storing the user data is greater than or equal to a threshold value, and the user data is failed to be stored;
in response to successful storage of the user data, the user data copy is deleted.
2. The aggregated cloud storage QoS control method according to claim 1, wherein: and acquiring response time, network bandwidth and storage space of each cloud storage, and calculating QoS performance of each cloud storage with response time smaller than a threshold value.
3. The aggregated cloud storage QoS control method according to claim 1, wherein: the cloud stores the QoS class calculation formula as,
where l is the cloud storage QoS level, η is the maximum QoS level that the cloud can possess.
4. The aggregated cloud storage QoS control method according to claim 1, wherein: in response to the current storage unit response time storing user data being less than the threshold, the user data storage is successful.
5. The aggregated cloud storage QoS control method according to claim 1, wherein: and if a plurality of cloud storages with highest QoS (quality of service) grades exist, marking the cloud storage with the nearest address as the current storage unit.
6. An aggregate cloud storage QoS control system, characterized by: comprising the steps of (a) a step of,
QoS performance calculation module: acquiring response time, network bandwidth and storage space of each cloud storage, and calculating QoS performance of each cloud storage;
QoS grade calculation module: according to QoS performance of each cloud storage, calculating QoS grade of each cloud storage; wherein, the calculation formula of the cloud storage QoS performance is as follows,
wherein q is cloud storage QoS performance, t, w and s are response time, network bandwidth and storage space respectively, and gamma, alpha and beta are weights of t, w and s respectively;
and the marking module is used for: screening cloud storage with highest QoS (quality of service) level, and marking the cloud storage as a current storage unit;
and a copy creation module: creating a copy of the user data in response to storing the user data to the current storage unit;
and (5) a re-labeling module: responding to failure of user data storage, reducing cloud storage grade serving as a current storage unit according to a preset rule, re-labeling the current storage unit, and storing a user data copy to the current storage unit; the preset rules are as follows: responding to failure of user data storage and cloud storage of a non-level cloud storage of a cloud storage A serving as a current storage unit, selecting a lower level of cloud storage as the current storage unit, and reducing the QoS level of the cloud storage A by one level; responding to failure of user data storage and cloud storage A with the same level as the cloud storage A of the current storage unit, selecting the cloud storage with the same level and nearest address as the current storage unit, and reducing the QoS level of the cloud storage A by one level; responding to failure of user data storage, cloud storage of a cloud storage A without a level as a current storage unit, and cloud storage A with a QoS level of the lowest level, and selecting the cloud storage with the highest QoS level and the nearest address as the current storage unit; the response time of the current storage unit for storing the user data is greater than or equal to a threshold value, and the user data is failed to be stored;
and a duplicate deletion module: in response to successful storage of the user data, the user data copy is deleted.
7. A computer readable storage medium storing one or more programs, characterized by: the one or more programs include instructions, which when executed by a computing device, cause the computing device to perform any of the methods of claims 1-5.
8. A computing device, characterized by: comprising the steps of (a) a step of,
one or more processors, memory, and one or more programs, wherein one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs comprising instructions for performing any of the methods of claims 1-5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010272635.2A CN111475117B (en) | 2020-04-09 | 2020-04-09 | Aggregated cloud storage QoS control method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010272635.2A CN111475117B (en) | 2020-04-09 | 2020-04-09 | Aggregated cloud storage QoS control method and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111475117A CN111475117A (en) | 2020-07-31 |
| CN111475117B true CN111475117B (en) | 2024-01-23 |
Family
ID=71751440
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010272635.2A Active CN111475117B (en) | 2020-04-09 | 2020-04-09 | Aggregated cloud storage QoS control method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111475117B (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102170396A (en) * | 2011-05-06 | 2011-08-31 | 浙江大学 | QoS control method of cloud storage system based on differentiated service |
| CN104754001A (en) * | 2013-12-30 | 2015-07-01 | 方正宽带网络服务股份有限公司 | Cloud storage system and data storage method |
| CN106534304A (en) * | 2016-11-11 | 2017-03-22 | 北京邮电大学 | Cloud storage method and device based on retrievable probability |
| CN108200169A (en) * | 2017-12-30 | 2018-06-22 | 广东技术师范学院 | A kind of first Placement Strategy control method of the copy of cloud storage system |
| CN108462736A (en) * | 2018-01-21 | 2018-08-28 | 肖芳 | A kind of cloud storage data copy storage method towards QoS |
| WO2019127234A1 (en) * | 2017-12-28 | 2019-07-04 | 华为技术有限公司 | Object migration method, device, and system |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9563463B2 (en) * | 2013-12-13 | 2017-02-07 | Hitachi, Ltd. | Computer system and control method therefor |
| US10838828B2 (en) * | 2017-07-25 | 2020-11-17 | Hubstor Inc. | Methods and systems relating to network based storage |
| US10372371B2 (en) * | 2017-09-14 | 2019-08-06 | International Business Machines Corporation | Dynamic data relocation using cloud based ranks |
| US10581969B2 (en) * | 2017-09-14 | 2020-03-03 | International Business Machines Corporation | Storage system using cloud based ranks as replica storage |
-
2020
- 2020-04-09 CN CN202010272635.2A patent/CN111475117B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102170396A (en) * | 2011-05-06 | 2011-08-31 | 浙江大学 | QoS control method of cloud storage system based on differentiated service |
| CN104754001A (en) * | 2013-12-30 | 2015-07-01 | 方正宽带网络服务股份有限公司 | Cloud storage system and data storage method |
| CN106534304A (en) * | 2016-11-11 | 2017-03-22 | 北京邮电大学 | Cloud storage method and device based on retrievable probability |
| WO2019127234A1 (en) * | 2017-12-28 | 2019-07-04 | 华为技术有限公司 | Object migration method, device, and system |
| CN108200169A (en) * | 2017-12-30 | 2018-06-22 | 广东技术师范学院 | A kind of first Placement Strategy control method of the copy of cloud storage system |
| CN108462736A (en) * | 2018-01-21 | 2018-08-28 | 肖芳 | A kind of cloud storage data copy storage method towards QoS |
Non-Patent Citations (1)
| Title |
|---|
| 许丽婷 等.基于Docker技术的分层式数据安全性防护系统.信息化研究.2017,第43卷(第1期),51-55. * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111475117A (en) | 2020-07-31 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10896102B2 (en) | Implementing secure communication in a distributed computing system | |
| CN107832153B (en) | Hadoop cluster resource self-adaptive allocation method | |
| US11216414B2 (en) | Computer-implemented object management via tags | |
| WO2021126295A1 (en) | Request throttling in distributed storage systems | |
| WO2018059222A1 (en) | File slice uploading method and apparatus, and cloud storage system | |
| US10922303B1 (en) | Early detection of corrupt data partition exports | |
| CA2533744C (en) | Hierarchical management of the dynamic allocation of resources in a multi-node system | |
| US9860317B1 (en) | Throughput throttling for distributed file storage services with varying connection characteristics | |
| US9596189B1 (en) | Virtual machine management | |
| JP2017509053A (en) | Content delivery network architecture with edge proxies | |
| US11856054B2 (en) | Quality of service (QOS) setting recommendations for volumes across a cluster | |
| US10620871B1 (en) | Storage scheme for a distributed storage system | |
| US20200050479A1 (en) | Blockchain network and task scheduling method therefor | |
| CN110677274A (en) | Event-based cloud network service scheduling method and device | |
| WO2020134364A1 (en) | Virtual machine migration method, cloud computing management platform, and storage medium | |
| US20230308511A1 (en) | Multichannel virtual internet protocol address affinity | |
| CN107566470B (en) | Method and device for managing virtual machine in cloud data system | |
| US20190317665A1 (en) | Resource fairness control in distributed storage systems using congestion data | |
| US11301306B2 (en) | Apparatus, systems, and methods for remote system batch processing | |
| CN111475117B (en) | Aggregated cloud storage QoS control method and system | |
| EP3349416B1 (en) | Relationship chain processing method and system, and storage medium | |
| CN108200151A (en) | ISCSI Target load-balancing methods and device in a kind of distributed memory system | |
| WO2023093194A1 (en) | Cloud monitoring method and cloud management platform | |
| CN107357631A (en) | A kind of method and apparatus and computer-readable recording medium for managing virtual machine key | |
| CN114020218A (en) | Mixed repeating data deleting and scheduling method and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |