CN114338722A - Cloud-edge storage resource management system and method, storage medium and electronic device - Google Patents
Cloud-edge storage resource management system and method, storage medium and electronic device Download PDFInfo
- Publication number
- CN114338722A CN114338722A CN202111653031.3A CN202111653031A CN114338722A CN 114338722 A CN114338722 A CN 114338722A CN 202111653031 A CN202111653031 A CN 202111653031A CN 114338722 A CN114338722 A CN 114338722A
- Authority
- CN
- China
- Prior art keywords
- storage
- cloud
- module
- edge
- resource management
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 29
- 238000007726 management method Methods 0.000 claims abstract description 154
- 238000012545 processing Methods 0.000 claims abstract description 46
- 239000011232 storage material Substances 0.000 claims abstract description 24
- 230000007175 bidirectional communication Effects 0.000 claims abstract description 10
- 230000004044 response Effects 0.000 claims description 34
- 230000009471 action Effects 0.000 claims description 6
- 238000004590 computer program Methods 0.000 claims description 3
- 230000001360 synchronised effect Effects 0.000 claims description 3
- 238000010586 diagram Methods 0.000 description 9
- 230000008569 process Effects 0.000 description 8
- 239000003795 chemical substances by application Substances 0.000 description 6
- 230000006870 function Effects 0.000 description 5
- 230000006854 communication Effects 0.000 description 4
- 238000004891 communication Methods 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 239000013307 optical fiber Substances 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 230000006978 adaptation Effects 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 238000012217 deletion Methods 0.000 description 1
- 230000037430 deletion Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000000638 solvent extraction Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Abstract
The disclosure relates to the technical field of cloud computing, and relates to a cloud-side storage resource management system and method, a storage medium and an electronic device. The system comprises a cloud end side and an edge side; the cloud end side comprises a cloud storage control module, an edge storage agent module and a Cloudhub module which is provided with a Socket Server submodule; the edge side at least comprises an Edgehub module which carries out bidirectional communication with the Socket Server submodule through the cloud edge tunnel and an edge proxy module which is deployed with a resource processing unit. According to the cloud storage resource management method and the cloud storage resource management system, the edge storage agent module deployed on the cloud side, the Socket Server submodule deployed in the Cloudhub module and the cloud side tunnel are used for establishing a calling link for cloud side storage resource management, and the resource processing unit capable of realizing resource storage management scheduling logic is deployed in the edge agent module, so that unified management of cloud side storage resources is realized.
Description
Technical Field
The present disclosure relates to the field of cloud computing technologies, and in particular, to a cloud-side storage resource management system, a cloud-side storage resource management method, a computer storage medium, and an electronic device.
Background
The edge computing is a distributed processing and storage system structure, is closer to the source of data, for example, cameras, wearable medical equipment and the like with a visual processing function utilize cloud-edge computing, and as the demand of business scenes on the edge computing is gradually increased, more and more edge resource pools are established outside a central cloud resource pool.
In the related art, the management and control node on the cloud side has implemented cloud computing node resource scheduling, storage resource management, and cloud side edge node computing resource scheduling, but the cloud side cannot schedule the edge side storage resource, and the edge side computing node also lacks execution logic related to resource storage, that is, container arrangement scheduling in the related art does not have cooperative scheduling capability of the cloud edge storage resource.
It is to be noted that the information invented in the background section above is only for enhancement of understanding of the background of the present disclosure, and thus may include information that does not constitute prior art known to those of ordinary skill in the art.
Disclosure of Invention
The present disclosure aims to provide a cloud-side storage resource management system and method, a computer storage medium, and an electronic device, thereby achieving a cooperative deployment capability of cloud-side storage resources.
Additional features and advantages of the disclosure will be set forth in the detailed description which follows, or in part will be obvious from the description, or may be learned by practice of the disclosure.
According to one aspect of the disclosure, a cloud side storage resource management system is provided, which includes a cloud side and an edge side, and is characterized in that the cloud side at least includes a cloud storage control module, an edge storage agent module and a CloudHub module with a Socket Server sub-module; the edge side at least comprises an Edgehub module which carries out bidirectional communication with the Socket Server submodule through a cloud edge tunnel and an edge proxy module which is deployed with a resource processing unit; the edge storage agent module is used for receiving a storage resource management instruction sent by the cloud storage control module and forwarding the storage resource management instruction to the Socket Server submodule; the Socket Server submodule is used for sending the storage resource management instruction to the EdgeHub module through the cloud side tunnel; the resource processing unit is configured to receive the storage resource management instruction sent by the EdgeHub module, and execute the storage resource management instruction to obtain result response information of the storage resource management instruction.
In an exemplary embodiment of the present disclosure, the Socket Server sub-module is further configured to receive result response information that the edge side completes processing the resource management instruction; and the result response information is sent to the EdgeHub module through the edge proxy module and is sent to the Socket Server submodule through the EdgeHub module.
In an exemplary embodiment of the present disclosure, the edge side further includes an edge storage driver module, configured to execute a resource management action corresponding to the storage resource management instruction of the edge side according to the call operation of the resource processing unit; the cloud end side further comprises a cloud storage driving module which is configured to execute resource management actions corresponding to the storage resource management instructions of the cloud end side according to the calling operation of the cloud storage control module.
In an exemplary embodiment of the disclosure, the edge storage driver module is configured to create a resource storage volume corresponding to the storage resource management instruction according to a call operation of the resource processing unit.
In an exemplary embodiment of the present disclosure, the cloud end side further includes an edge control module deployed with a storage management unit, and is configured to monitor that the edge side completes creation of the resource storage volume, and generate mount information corresponding to the resource storage volume; the edge control module with the storage management unit is also used for sending a container mounting request carrying the mounting information to the Socket Server submodule.
In an exemplary embodiment of the present disclosure, the Socket Server sub-module is further configured to synchronize the container mount request to the EdgeHub module through the cloud-edge tunnel; the resource processing unit is further configured to receive the container mount request sent by the EdgeHub module, and call the edge storage driver module to perform a container mount operation, so as to obtain result response information of the container mount request.
In an exemplary embodiment of the disclosure, the result response information is synchronized to the CloudHub module via the EdgeHub module, the cloud edge tunnel, and the Socket Server submodule, so that the result response information is fed back to the edge control module through the CloudHub module to update the metadata corresponding to the resource storage volume.
In an exemplary embodiment of the disclosure, the system further includes a resource management description information creating module, configured to generate resource management description information according to the description information creating operation, so as to generate a storage resource management instruction and send the storage resource management instruction to the cloud storage control module.
According to one aspect of the disclosure, a cloud-side storage resource management method is provided, which is applied to an edge storage agent module on a cloud-side of a cloud-side storage resource management system, wherein the cloud-side at least comprises a cloud-side storage control module and a CloudHub module with a Socket Server sub-module, and the cloud-side storage resource management system further comprises an edge side, wherein the edge side at least comprises an EdgeHub module which performs bidirectional communication with the Socket Server sub-module through a cloud-side tunnel and an edge agent module with a resource processing unit; the method comprises the following steps: the edge storage agent module receives a storage resource management instruction sent by the cloud storage control module, and forwards the storage resource management instruction to the Socket Server submodule, so that the Socket Server submodule sends the storage resource management instruction to the EdgeHub module through the cloud edge tunnel, and the resource processing unit receives and executes the storage resource management instruction sent by the EdgeHub module to obtain result response information of the storage resource management instruction.
According to an aspect of the present disclosure, there is provided a computer storage medium having a computer program stored thereon, the computer program, when executed by a processor, implementing the cloud-edge storage resource management method of any one of the above.
According to an aspect of the present disclosure, there is provided an electronic device including: a processor; and a memory for storing executable instructions of the processor; wherein the processor is configured to perform any of the above cloud-edge storage resource management via execution of the executable instructions.
In the cloud side storage resource management system and method in the exemplary embodiment of the disclosure, the cloud side at least comprises a cloud storage control module, an edge storage agent module and a CloudHub module with a Socket Server submodule deployed; the edge side at least comprises an Edgehub module which carries out bidirectional communication with the Socket Server submodule through the cloud edge tunnel and an edge proxy module which is deployed with a resource processing unit. The edge storage agent module, the Socket Server submodule deployed in the Cloudhub module and the cloud side tunnel are used for establishing a calling link for carrying out cloud side storage resource management, the edge side can feed back resource storage related information to the cloud side through the Edgehub module and the cloud side tunnel, meanwhile, the cloud side can also realize management of resource storage of the edge side based on the established calling link, so that unified management of cloud side storage resources is realized, a resource processing unit capable of realizing resource storage management scheduling logic is deployed in the edge agent module, the edge side is expanded, and meanwhile, the edge side has computing capacity, also has execution logic related to resource storage, and cooperative scheduling management of computing and storage resources is realized. In addition, a Socket Server submodule is created in the cloud hub module on the cloud side, a cloud-side message transmission tunnel can be reused, the message transmission rate on the cloud side is improved, and resource consumption is low.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Drawings
The above and other objects, features and advantages of exemplary embodiments of the present disclosure will become readily apparent from the following detailed description read in conjunction with the accompanying drawings. Several embodiments of the present disclosure are illustrated by way of example, and not by way of limitation, in the figures of the accompanying drawings and in which:
FIG. 1 is a diagram illustrating a cloud-edge collaboration architecture in the related art;
fig. 2 illustrates a schematic structural diagram of a cloud-edge storage resource management system according to an exemplary embodiment of the present disclosure;
fig. 3 shows a schematic structural diagram of a cloud-edge storage resource management system according to an exemplary embodiment of the present disclosure;
fig. 4 is a flowchart illustrating a process of creating a storage volume on a edge side by a cloud side and mounting the storage volume on a container according to an exemplary embodiment of the disclosure;
FIG. 5 illustrates a process flow diagram of a cloud-edge storage resource management method according to an exemplary embodiment of the present disclosure;
FIG. 6 shows a schematic diagram of a storage medium according to an exemplary embodiment of the present disclosure;
fig. 7 shows a block diagram of an electronic device according to an exemplary embodiment of the present disclosure.
In the drawings, the same or corresponding reference numerals indicate the same or corresponding parts.
Detailed Description
Exemplary embodiments will now be described more fully with reference to the accompanying drawings. The exemplary embodiments, however, may be embodied in many different forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of exemplary embodiments to those skilled in the art. The same reference numerals in the drawings denote the same or similar structures, and thus their detailed description will be omitted.
Furthermore, the described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided to give a thorough understanding of embodiments of the disclosure. One skilled in the relevant art will recognize, however, that the subject matter of the present disclosure can be practiced without one or more of the specific details, or with other methods, components, devices, steps, and so forth. In other instances, well-known structures, methods, devices, implementations, or operations are not shown or described in detail to avoid obscuring aspects of the disclosure.
The block diagrams shown in the figures are functional entities only and do not necessarily correspond to physically separate entities. That is, these functional entities may be implemented in the form of software, or in one or more software-hardened modules, or in different networks and/or processor devices and/or microcontroller devices.
In the related art, more and more edge resource pools are established outside a central cloud resource pool, including a computing resource pool, a storage resource pool, and the like. The cloud native technology architecture side with the container and container arrangement engine kubernets (k8s) as the core evolves from the central cloud architecture to the cloud edge coordination architecture as shown in fig. 1. As shown in fig. 1, in the related art, a cloud side k8s management and control node may implement resource scheduling for a computing node on an edge side, interact with a central side storage system management and control node (e.g., ceph/nfs/oss), implement storage scheduling on the cloud side, and implement computing resource scheduling for an edge node through a "message tunnel" by a k8s management and control node. However, in a cloud-edge scenario, the control surface of the orchestration scheduling system is deployed on the cloud side, and the storage systems are separately and independently deployed on the cloud side and the edge side, which is limited by cloud-edge network communication, the control surface of the orchestration scheduling system on the cloud side cannot directly interact with the control surface of the storage system on the edge side, that is, the k8s management and control node cannot schedule the storage system on the edge side, and cannot realize cloud-edge cooperative scheduling of resource storage.
Based on this, in the exemplary embodiment of the present disclosure, a cloud-edge storage resource management system is first provided. Referring to fig. 2, the cloud-side storage resource management system includes a cloud-side 100 and an edge-side 200, where the cloud-side 100 at least includes a cloud-side storage control module 101, an edge-side storage agent module 102, and a CloudHub module 104 deployed with a Socket Server sub-module 103; the edge side 200 at least includes an EdgeHub module 201 which performs bidirectional communication with the Socket Server sub-module 103 through the cloud edge tunnel 300, and an edge proxy module 203 in which the resource processing unit 202 is deployed. Specifically, the method comprises the following steps:
the edge storage agent module 102 is configured to receive a storage resource management instruction sent by the cloud storage control module 101, and forward the storage resource management instruction to the Socket Server sub-module 103;
the Socket Server sub-module 103 is configured to send the storage resource management instruction to the EdgeHub module 201 through the cloud-edge tunnel 300;
the resource processing unit 202 is configured to receive the storage resource management instruction sent by the EdgeHub module 201, and execute the storage resource management instruction to obtain result response information of the storage resource management instruction.
In the cloud edge storage resource management system according to the exemplary embodiment of the present disclosure, a call link for performing cloud edge storage resource management is established through the edge storage agent module 102, the Socket Server sub-module 103, and the cloud edge tunnel 300, the edge side 200 may feed back resource storage related information to the cloud side 100 through the EdgeHub module 201 and the cloud edge tunnel 300, and meanwhile, the cloud side 100 may further implement management of resource storage of the edge side 200 based on the established call link, thereby implementing unified management of cloud edge storage resources, and by deploying the resource processing unit 202 capable of implementing resource storage management scheduling logic in the edge agent module 203, the edge side 200 is expanded to have computing capability and also have execution logic related to resource storage, thereby implementing collaborative scheduling management of computing and storage resources.
In the exemplary embodiment of the present disclosure, the Socket Server submodule 103 is a Server end of cloud-side communication, and the Socket Server submodule 103 is deployed in the CloudHub module 104, so that multiplexing of a cloud-side tunnel can be realized. The Socket Server sub-module 103 includes various resource storage processing interfaces, and thus has a function of resource storage management. The cloud side tunnel is used for acting on a request of the cloud side for accessing the edge side, so that the cloud side can directly access the edge side.
In an exemplary embodiment, the Socket Server submodule 103 is further configured to receive result response information of the edge side 200 completing processing of the resource management instruction, that is, based on the Socket Server submodule 103 and the cloud edge tunnel deployed in the CloudHub module 104, bidirectional communication of the cloud edge may be implemented, the edge side 200 may actively send the relevant response information of the resource storage to the cloud side 100, and the cloud side 100 may also actively initiate scheduling management of the resource storage of the edge side 200, such as deleting a container, creating a container, adjusting container parameters, and the like.
The result response information is sent to the EdgeHub module 201 through the edge proxy module 203, and is sent to the Socket Server submodule 103 through the EdgeHub module 201.
Through the present exemplary embodiment, the cloud end side 100 may manage and schedule resource storage in the edge side 200, implement edge cooperative scheduling management, and improve management efficiency.
As shown in fig. 3, which is a schematic structural diagram of a cloud-edge storage resource management system according to an exemplary embodiment of the present disclosure, as shown in fig. 3, the edge side 200 may further include an edge storage driver module 204 configured to execute a resource management action corresponding to a storage resource management instruction of the edge side 200 according to a call operation of the resource processing unit 202. For example, the edge storage driver module 204 will be configured to create a resource storage volume corresponding to the storage resource management instruction, delete the corresponding resource storage volume, adjust the parameters of the corresponding resource storage volume, and so on, according to the calling operation of the resource processing unit 202. Specifically, after the resource processing unit 202 receives the storage resource management instruction sent by the EdgeHub module 201, the storage resource management instruction may be executed by calling the edge storage driver module 204 to obtain result response information corresponding to the storage resource management instruction. The edge storage driver module 204 is compatible with various third-party storage resources. For example, the edge storage driver module 204 may be compatible with various storage resources of the edge storage provider, such as storage ceph, nfs and aws, and the disclosure does not make any special limitation on the edge storage provider and the storage resources provided thereby.
Correspondingly, as shown in fig. 3, the cloud side 100 may further include a cloud storage driver module 105 configured to execute a resource management action corresponding to the storage resource management instruction on the cloud side according to the call operation of the cloud storage control module 101. The cloud storage driver module 105 is compatible with various third-party cloud storage resources. For example, the cloud storage driver module 105 may be compatible with storage resources of various cloud storage providers, such as ceph, nfs, aws, and the like.
Through the present exemplary embodiment, the cloud storage driver module 105 is sunk as the edge storage driver module 204, so that the communication link between the cloud storage controller module 101 and the edge storage driver module 204 in the edge side 200 is opened via the cloud storage controller module 101, the edge storage agent module 102, the CloudHub module 104 with the Socket Server submodule 103 deployed, the EdgeHub module 201 in the edge side 200, and the edge agent module 203 with the resource processing unit 202 deployed, thereby implementing the scheduling of the edge resource storage.
In an exemplary embodiment, with continued reference to fig. 3, the cloud end side 100 may further include an edge control module 107 disposed with the storage management unit 106, and configured to monitor that the edge side 200 completes creation of the resource storage volume and generates mount information corresponding to the resource storage volume. The mount information includes, but is not limited to, a location, a type, a model, a name, an operation mode, port information, and the like of the resource storage volume.
Specifically, when the edge control module 107 monitors that the edge storage driver module 204 of the edge side 200 completes creating the resource storage volume, mount information corresponding to the resource storage volume is generated.
According to the exemplary embodiment, the storage management unit 106 is deployed in the edge control module 107, and the extended edge control module 107 has a resource storage management function, so that the cloud-side storage resource management system can form a logical closed loop of resource management, and the cloud-side resource storage can be uniformly managed.
In an exemplary embodiment, the edge control module 107 deployed with the storage management unit 106 is further configured to send a container mount request carrying mount information to the Socket Server sub-module 103. That is to say, after the edge control module 107 generates the container mount request, the container mount request carrying the mount information may be sent to the Socket Server sub-module 103, so as to issue the container mount request to the edge side 200 through the Socket Server sub-module 103 and the cloud edge tunnel 300, so as to mount the created resource storage volume on the edge side 200 according to the container mount request, thereby implementing container mount management on the edge side 200.
In an exemplary embodiment, the Socket Server submodule 103 is further configured to synchronize the container mount request to the EdgeHub module 201 through the cloud edge tunnel 300. After receiving the container mount request sent by the edge control module 107, the Socket Server sub-module 103 synchronizes the container mount request to the EdgeHub module 201 through the cloud-side tunnel 300. Based on this, the resource processing unit 202 is further configured to receive the container mount request sent by the EdgeHub module 201, and invoke the edge storage driver module 204 to perform a container mount operation, so as to obtain result response information of the container mount request. Based on this, container mounting management on the edge side 200 can be realized by the cloud side 100,
in an exemplary embodiment of the present disclosure, the edge storage driver module 204 is invoked to perform a container mount operation, obtain result response information of the container mount request, and may be synchronized to the CloudHub module 104 via the EdgeHub module 201, the cloud-side tunnel 300, and the Socket Server submodule 103, so that the CloudHub module 104 feeds back the result response information to the edge control module 107, so as to update the metadata corresponding to the resource storage volume. That is, after the mount operation of the resource storage volume is completed, the completed response information is returned step by step according to the container mount request path corresponding to the resource storage volume until the result response information is returned to the edge control module 107.
In an exemplary embodiment of the present disclosure, the cloud-side storage resource management system further includes a resource management description information creating module, configured to generate resource management description information according to the description information creating operation, so as to generate a storage resource management instruction and send the storage resource management instruction to the cloud storage control module 101.
In an exemplary embodiment, the cloud storage control module 101 is further configured to register the edge storage.
In an exemplary embodiment, after receiving a storage resource management instruction forwarded by the edge storage agent module 102 or receiving a container mount request sent by the edge control module 107, the Socket Server sub-module 103 encapsulates a corresponding instruction message or request message, and sends the encapsulated message to the EdgeHub module 201 of the edge side 200 through the cloud edge tunnel 300. After receiving the encapsulated message, the EdgeHub module 201 decapsulates the message and converts the decapsulated message into an HTTP (Hyper Text Transfer Protocol) call, so as to satisfy the requirement that the requests at the edge side are HTTP requests, and certainly, it is not necessary to convert the decapsulated message into an HTTP call, and the decapsulated message may be selectively adjusted according to the specific request processing requirement of the edge side 200, which is not particularly limited by the present disclosure.
It should be noted that, except that in the above exemplary embodiment, before the cloud side performs storage volume creation and storage management on the edge side, the cloud side may perform other resource storage related management on the edge side by using the same method, such as container deletion, container parameter adjustment, storage volume creation and mounting, and the like, and all that an edge storage agent module 101 deployed on the basis of the cloud side 100, a Socket Server sub-module 103 deployed in a CloudHub module 104, and a cloud-side tunnel 300 form a call link for cloud-side storage resource management to perform uniform management of cloud-side resource storage belongs to the protection scope of the present solution.
Fig. 4 is a flowchart illustrating a process of creating a storage volume on a cloud side and mounting the storage volume on a container on a edge side according to an exemplary embodiment of the disclosure, and a workflow of the cloud-side storage resource management system of the disclosure is described below with reference to fig. 4.
Step 1) according to the description information creating operation, the resource management description module generates resource management description information, and if the creation statement of the storage volume, a storage resource management instruction is generated according to the resource management description information. Wherein the resource management description information can be created by calling k8s API Server (k8s application program interface service).
Step 2) the cloud storage control module 101 monitors a storage resource management instruction for creating a storage volume, and sends the storage resource management instruction for creating the storage volume to the edge storage agent module 102.
Step 3) the edge storage agent module 102 forwards a storage resource management instruction for creating a storage volume to the Socket Server sub-module 103.
And step 4), the Socket Server submodule 103 sends the storage resource management instruction to the EdgeHub module 201 through the cloud edge tunnel 300.
Step 5) the EdgeHub module 201 forwards the storage resource management instruction to the message manager metamanager to send the resource management instruction to the edge proxy module 203 deployed with the resource processing unit 202.
Step 6) the resource handling unit 202 in the edge proxy module 203 creates a storage volume by calling the edge storage driver module 204 to call third party provided storage (external storage).
And 7) step-by-step feeding back result response information provided by a third party and used for creating the storage volume to the cloud storage control module 101 so as to update the corresponding metadata of the created storage volume according to the result response information. Since the result response information also passes through the modules in steps 1) to 6) in steps 7) to 12), the details are not repeated herein.
The following describes the process of mounting a storage volume in a container after the creation of the storage volume is completed:
step 1) an edge control module 107 of the cloud side 100, which is deployed with a storage management unit 106, listens whether the edge side 200 has completed creation of a storage volume.
Step 2) the edge control module 107 of the cloud side 100, which is deployed with the storage management unit 106, monitors that the edge side 200 has completed creating the storage volume, generates mounting information corresponding to the resource storage container, and sends a container mounting request carrying the mounting information to the Socket Server sub-module 103.
Step 3), the Socket Server submodule 103 synchronizes the container mount request to the EdgeHub module 201 through the cloud edge tunnel 300.
Step 4) the EdgeHub module 201 sends a container mount request to the resource handling unit 202 deployed at the edge proxy module 203 via the MetaManager.
Step 5), the resource processing unit 202 calls the edge storage driver module 204 to execute the container mount operation, and the result response information of the container mount request is obtained.
And 6) step 6) to 10) step by step feeding back the result response information of the mounted storage volume to the edge control module 107 so as to update the relevant metadata corresponding to the mounted storage volume according to the result response information. Since the result response information also passes through the modules in steps 1) to 5) in steps 6) to 10), the details are not repeated herein.
It should be noted that although several modules or units of the cloud-side storage resource management system are mentioned in the above detailed description, such partitioning is not mandatory. Indeed, the features and functionality of two or more modules or units described above may be embodied in one module or unit, according to embodiments of the present disclosure. Conversely, the features and functions of one module or unit described above may be further divided into embodiments by a plurality of modules or units.
In an exemplary embodiment of the disclosure, a cloud-side storage resource management method is further provided, which is applied to an edge storage agent module on a cloud-side of a cloud-side storage resource management system, where the cloud-side at least includes a cloud-side storage control module and a CloudHub module with a Socket Server sub-module deployed, and the cloud-side storage resource management system further includes an edge side, and the edge side at least includes an EdgeHub module performing bidirectional communication with the Socket Server sub-module through a cloud-side tunnel and an edge agent module with a resource processing unit deployed. Specifically, the method comprises the following steps:
the edge storage agent module receives a storage resource management instruction sent by the cloud storage control module and forwards the storage resource management instruction to the Socket Server submodule, so that the Socket Server submodule sends the storage resource management instruction to the EdgeHub module through the cloud edge tunnel, and the resource processing unit receives and executes the storage resource management instruction sent by the EdgeHub module to obtain result response information of the storage resource management instruction.
Fig. 5 is a processing flow diagram of a cloud-edge storage resource management method according to an exemplary embodiment of the disclosure, and as shown in fig. 5, the cloud storage control module may register edge storage by calling a k8s API Server. And a call link for managing the cloud-side storage resources is formed through the edge storage agent module, the Socket Server sub-module deployed in the CloudHub module, and the cloud-side tunnel, so that bidirectional communication can be performed between cloud sides (such as creating messages and mounting messages shown in fig. 5).
With reference to fig. 5, the cloud storage control module 101 sends a storage volume creation instruction to the Socket Server sub-module via the edge storage agent, so that the CloudHub module obtains the storage volume creation instruction, and then sends the storage volume creation instruction to the EdgeHub module on the edge side through the cloud edge tunnel, so as to execute the storage volume creation instruction via the resource processing unit disposed in the edge agent module on the edge side.
Correspondingly, after the creation of the storage volume is completed, the edge control module monitors response information of the created storage volume, generates container mount information and sends a container mount request carrying the container mount information to a Socket Server sub-module in the CloudHub module, so that the CloudHub module obtains the container mount request and sends the container mount request to the edge side via a cloud tunnel, and the resource processing unit located in the edge proxy module at the edge side calls the edge storage drive module to execute the container mount operation, and after the creation of the container volume and the container mount are completed, the result response information can be returned to the cloud storage control module or the edge control module through the established call link.
Since the invention embodiment of the cloud-side storage resource management method according to the exemplary embodiment of the present disclosure is the same as each functional module of the cloud-side storage resource management system, details are not repeated here.
In addition, in the exemplary embodiments of the present disclosure, a computer storage medium capable of implementing the above method is also provided. On which a program product capable of implementing the above-described method of the present specification is stored. In some possible embodiments, aspects of the present disclosure may also be implemented in the form of a program product comprising program code for causing a terminal device to perform the steps according to various exemplary embodiments of the present disclosure described in the "exemplary methods" section above of this specification, when the program product is run on the terminal device.
Referring to fig. 6, a program product 600 for implementing the above method according to an exemplary embodiment of the present disclosure is described, which may employ a portable compact disc read only memory (CD-ROM) and include program code, and may be run on a terminal device, such as a personal computer. However, the program product of the present disclosure is not limited thereto, and in this document, a readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
The program product may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium include: an electrical connection having one or more wires, a portable disk, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
A computer readable signal medium may include a propagated data signal with readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A readable signal medium may also be any readable medium that is not a readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Program code for carrying out operations of the present disclosure may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computing device, partly on the user's device, as a stand-alone software package, partly on the user's computing device and partly on a remote computing device, or entirely on the remote computing device or server. In the case of a remote computing device, the remote computing device may be connected to the user computing device through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computing device (e.g., through the internet using an internet service provider).
In addition, in an exemplary embodiment of the present disclosure, an electronic device capable of implementing the above method is also provided. As will be appreciated by one skilled in the art, aspects of the present disclosure may be embodied as a system, method or program product. Accordingly, various aspects of the present disclosure may be embodied in the form of: an entirely hardware embodiment, an entirely software embodiment (including firmware, microcode, etc.) or an embodiment combining hardware and software aspects that may all generally be referred to herein as a "circuit," module "or" system.
An electronic device 700 according to such an embodiment of the present disclosure is described below with reference to fig. 7. The electronic device 700 shown in fig. 7 is only an example and should not bring any limitation to the functions and the scope of use of the embodiments of the present disclosure.
As shown in fig. 7, electronic device 700 is embodied in the form of a general purpose computing device. The components of the electronic device 700 may include, but are not limited to: the at least one processing unit 710, the at least one memory unit 720, a bus 730 connecting different system components (including the memory unit 720 and the processing unit 710), and a display unit 740.
Wherein the storage unit stores program code that is executable by the processing unit 710 to cause the processing unit 710 to perform steps according to various exemplary embodiments of the present disclosure as described in the above section "exemplary methods" of this specification.
The storage unit 720 may include readable media in the form of volatile memory units, such as a random access memory unit (RAM)721 and/or a cache memory unit 722, and may further include a read only memory unit (ROM) 723.
The memory unit 720 may also include programs/utilities 724 having a set (at least one) of program modules 725, such program modules 725 including, but not limited to: an operating system, one or more application programs, other program modules, and program data, each of which, or some combination thereof, may comprise an implementation of a network environment.
The electronic device 700 may also communicate with one or more external devices 800 (e.g., keyboard, pointing device, bluetooth device, etc.), with one or more devices that enable a user to interact with the electronic device 700, and/or with any devices (e.g., router, modem, etc.) that enable the electronic device 700 to communicate with one or more other computing devices. Such communication may occur via an input/output (I/O) interface 750. Also, the electronic device 700 may communicate with one or more networks (e.g., a Local Area Network (LAN), a Wide Area Network (WAN) and/or a public network such as the Internet) via the network adapter 770. As shown, the network adapter 770 communicates with the other modules of the electronic device 700 over the bus 730. It should be appreciated that although not shown in the figures, other hardware and/or software modules may be used in conjunction with the electronic device 700, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, among others.
Through the above description of the embodiments, those skilled in the art will readily understand that the exemplary embodiments described herein may be implemented by software, or by software in combination with necessary hardware. Therefore, the technical solution according to the embodiments of the present disclosure may be embodied in the form of a software product, which may be stored in a non-volatile storage medium (which may be a CD-ROM, a usb disk, a removable hard disk, etc.) or on a network, and includes several instructions to enable a computing device (which may be a personal computer, a server, a terminal device, or a network device, etc.) to execute the method according to the embodiments of the present disclosure.
Furthermore, the above-described figures are merely schematic illustrations of processes included in methods according to exemplary embodiments of the present disclosure, and are not intended to be limiting. It will be readily understood that the processes shown in the above figures are not intended to indicate or limit the chronological order of the processes. In addition, it is also readily understood that these processes may be performed synchronously or asynchronously, e.g., in multiple modules.
Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This disclosure is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is to be limited only by the terms of the appended claims.
Claims (10)
1. A cloud side storage resource management system comprises a cloud side and an edge side, and is characterized in that the cloud side at least comprises a cloud storage control module, an edge storage agent module and a Cloudhub module with a Socket Server submodule deployed; the edge side at least comprises an Edgehub module which carries out bidirectional communication with the Socket Server submodule through a cloud edge tunnel and an edge proxy module which is deployed with a resource processing unit;
the edge storage agent module is used for receiving a storage resource management instruction sent by the cloud storage control module and forwarding the storage resource management instruction to the Socket Server submodule;
the Socket Server submodule is used for sending the storage resource management instruction to the EdgeHub module through the cloud side tunnel;
the resource processing unit is configured to receive the storage resource management instruction sent by the EdgeHub module, and execute the storage resource management instruction to obtain result response information of the storage resource management instruction.
2. The system of claim 1, wherein the Socket Server sub-module is further configured to receive result response information that the edge side completes processing the storage resource management instruction;
and the result response information is sent to the EdgeHub module through the edge proxy module and is sent to the Socket Server submodule through the EdgeHub module.
3. The system according to claim 1, wherein the edge side further includes an edge storage driver module configured to execute a resource management action corresponding to the storage resource management instruction of the edge side according to the call operation of the resource processing unit;
the cloud end side further comprises a cloud storage driving module which is configured to execute resource management actions corresponding to the storage resource management instructions of the cloud end side according to the calling operation of the cloud storage control module.
4. The system of claim 3, wherein the edge storage driver module is configured to create the resource storage volume corresponding to the storage resource management instruction according to a call operation of the resource processing unit.
5. The system according to claim 4, wherein the cloud end side further includes an edge control module deployed with a storage management unit, and configured to monitor that the edge side completes creation of the resource storage volume, and generate mount information corresponding to the resource storage volume;
the edge control module with the storage management unit is also used for sending a container mounting request carrying the mounting information to the Socket Server submodule.
6. The system of claim 5, wherein the Socket Server sub-module is further configured to synchronize the container mount request to the EdgeHub module through the cloud edge tunnel;
the resource processing unit is further configured to receive the container mount request sent by the EdgeHub module, and call the edge storage driver module to perform a container mount operation, so as to obtain result response information of the container mount request.
7. The system of claim 5 or 6, wherein the result response information is synchronized to the CloudHub module via the EdgeHub module, the cloud edge tunnel, and the Socket Server submodule, so that the result response information is fed back to the edge control module through the CloudHub module to update the metadata corresponding to the resource storage volume.
8. The system of claim 1, further comprising a resource management description information creation module, configured to generate resource management description information according to the description information creation operation, so as to generate a storage resource management instruction and send the storage resource management instruction to the cloud storage control module.
9. A cloud storage resource management method is applied to an edge storage agent module at the cloud end side of a cloud edge storage resource management system, the cloud end side at least comprises a cloud end storage control module and a Cloudhub module with a Socket Server submodule, the cloud edge storage resource management system also comprises an edge side, and the edge side at least comprises an Edgehub module which carries out bidirectional communication with the Socket Server submodule through a cloud edge tunnel and an edge agent module with a resource processing unit; the method comprises the following steps:
the edge storage agent module receives a storage resource management instruction sent by the cloud storage control module, and forwards the storage resource management instruction to the Socket Server submodule, so that the Socket Server submodule sends the storage resource management instruction to the EdgeHub module through the cloud edge tunnel, and the resource processing unit receives and executes the storage resource management instruction sent by the EdgeHub module to obtain result response information of the storage resource management instruction.
10. A storage medium having stored thereon a computer program which, when executed by a processor, implements the cloud edge storage resource management method of claim 9.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111653031.3A CN114338722A (en) | 2021-12-30 | 2021-12-30 | Cloud-edge storage resource management system and method, storage medium and electronic device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111653031.3A CN114338722A (en) | 2021-12-30 | 2021-12-30 | Cloud-edge storage resource management system and method, storage medium and electronic device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114338722A true CN114338722A (en) | 2022-04-12 |
Family
ID=81018967
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111653031.3A Pending CN114338722A (en) | 2021-12-30 | 2021-12-30 | Cloud-edge storage resource management system and method, storage medium and electronic device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114338722A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114691050A (en) * | 2022-05-26 | 2022-07-01 | 深圳前海环融联易信息科技服务有限公司 | Cloud native storage method, device, equipment and medium based on kubernets |
| CN115658218A (en) * | 2022-09-09 | 2023-01-31 | 北京百度网讯科技有限公司 | Method, device, equipment and storage medium for edge equipment to access cloud |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103503376A (en) * | 2011-12-29 | 2014-01-08 | 华为技术有限公司 | Cloud computing system and method for managing storage resources therein |
| CN112162828A (en) * | 2020-10-29 | 2021-01-01 | 杭州谐云科技有限公司 | Container network cooperation system and method based on cloud side scene |
| CN112559133A (en) * | 2020-12-22 | 2021-03-26 | 北京滴普科技有限公司 | Cloud-edge coordination system and cloud-edge coordination method based on native container technology |
| CN112925647A (en) * | 2021-03-24 | 2021-06-08 | 北京金山云网络技术有限公司 | Cloud edge coordination system, and control method and device of cluster resources |
-
2021
- 2021-12-30 CN CN202111653031.3A patent/CN114338722A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103503376A (en) * | 2011-12-29 | 2014-01-08 | 华为技术有限公司 | Cloud computing system and method for managing storage resources therein |
| CN112162828A (en) * | 2020-10-29 | 2021-01-01 | 杭州谐云科技有限公司 | Container network cooperation system and method based on cloud side scene |
| CN112559133A (en) * | 2020-12-22 | 2021-03-26 | 北京滴普科技有限公司 | Cloud-edge coordination system and cloud-edge coordination method based on native container technology |
| CN112925647A (en) * | 2021-03-24 | 2021-06-08 | 北京金山云网络技术有限公司 | Cloud edge coordination system, and control method and device of cluster resources |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114691050A (en) * | 2022-05-26 | 2022-07-01 | 深圳前海环融联易信息科技服务有限公司 | Cloud native storage method, device, equipment and medium based on kubernets |
| CN114691050B (en) * | 2022-05-26 | 2022-09-06 | 深圳前海环融联易信息科技服务有限公司 | Cloud native storage method, device, equipment and medium based on kubernets |
| CN115658218A (en) * | 2022-09-09 | 2023-01-31 | 北京百度网讯科技有限公司 | Method, device, equipment and storage medium for edge equipment to access cloud |
| CN115658218B (en) * | 2022-09-09 | 2024-03-12 | 北京百度网讯科技有限公司 | Method, device, equipment and storage medium for accessing edge equipment to cloud |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108961033B (en) | Multi-service system interaction method and device, storage medium and electronic terminal | |
| CN109548178B (en) | Communication method and network equipment | |
| CN114338722A (en) | Cloud-edge storage resource management system and method, storage medium and electronic device | |
| CN110336871A (en) | A kind of document handling method, device, storage medium and electronic equipment | |
| WO2021088641A1 (en) | Data transmission method, data processing method, data reception method and device, and storage medium | |
| US11095717B2 (en) | Minimizing data loss in a computer storage environment with non-guaranteed continuous network connectivity | |
| CN111371898B (en) | Message monitoring method, device, equipment and storage medium | |
| US20230216895A1 (en) | Network-based media processing (nbmp) workflow management through 5g framework for live uplink streaming (flus) control | |
| CN112835524A (en) | Storage resource allocation method, storage resource controller and scheduling system | |
| KR20220151585A (en) | Business data processing method, apparatus, electronic apparatus, storage media and computer program | |
| CN114205230A (en) | Method, system, medium and electronic device for configuring cloud native network element | |
| CN110399236A (en) | Adaptation method, device, medium and the electronic equipment of message queue | |
| WO2019085780A1 (en) | Cloud storage system and method for achieving user-defined data processing in cloud storage system | |
| CN113760264A (en) | Method and device for multiplexing components among multiple applications | |
| CN103914286A (en) | Management method and manager for tab page in user interface | |
| CN109445966B (en) | Event processing method, device, medium and computing equipment | |
| WO2019223179A1 (en) | Remote log real-time viewing method, system, computer device, and storage medium | |
| CN112165529A (en) | Method, device, equipment and medium for low-cost cross-network data exchange | |
| WO2023050410A1 (en) | Workflow operation method and apparatus | |
| US11778548B2 (en) | Deploying containers on a 5G slice network | |
| US11948016B2 (en) | Application programming interface management | |
| CN114461228B (en) | Object generation method, device, equipment, system and readable storage medium | |
| CN114911421B (en) | Data storage method, system, device and storage medium based on CSI plug-in | |
| CN117806517A (en) | Multi-virtual machine key mouse control method and device, storage medium and electronic equipment | |
| US20110078233A1 (en) | Apparatus, system, and method for improved performance of real time applications in intermittent connection environments |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |