WO2023109934A1 - 一种对象存储桶的数据访问方法以及云管理平台 - Google Patents

一种对象存储桶的数据访问方法以及云管理平台 Download PDF

Info

Publication number
WO2023109934A1
WO2023109934A1 PCT/CN2022/139470 CN2022139470W WO2023109934A1 WO 2023109934 A1 WO2023109934 A1 WO 2023109934A1 CN 2022139470 W CN2022139470 W CN 2022139470W WO 2023109934 A1 WO2023109934 A1 WO 2023109934A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
management platform
cloud management
object storage
storage bucket
Prior art date
Application number
PCT/CN2022/139470
Other languages
English (en)
French (fr)
Inventor
白平昌
陈智殷
Original Assignee
华为云计算技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为云计算技术有限公司 filed Critical 华为云计算技术有限公司
Publication of WO2023109934A1 publication Critical patent/WO2023109934A1/zh

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L63/00Network architectures or network communication protocols for network security
    • H04L63/08Network architectures or network communication protocols for network security for authentication of entities
    • H04L63/083Network architectures or network communication protocols for network security for authentication of entities using passwords
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1095Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1097Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L9/00Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols
    • H04L9/40Network security protocols

Definitions

  • the embodiment of the present application relates to the field of cloud technology, and in particular to a data access method of an object storage bucket based on a cloud management platform and the cloud management platform.
  • Cloud storage is a concept extended and developed on the concept of cloud computing (cloud computing), which can achieve scale effect, improve storage efficiency, and reduce operation and maintenance costs.
  • cloud storage technology With the development and promotion of cloud storage technology, more and more enterprises and individual users choose to store data in cloud storage systems, and the performance of cloud storage systems has become the focus of attention when users choose cloud storage systems.
  • a cloud storage system may include multiple sites deployed in different geographical areas, and tenant data may be stored in a site located in a certain geographical area (the area currently accessed by the tenant). After the tenant moves to another geographical area, if the tenant needs to use the stored data, the geographical area where the data is located needs to be managed, and a migration request needs to be manually initiated to migrate the data from the site located in the geographical area that the user previously accessed To the site located in the geographical area where the user is currently connected, so as to realize the management and subsequent acquisition of data.
  • the embodiment of the present application provides a data access method of an object storage bucket and a cloud management platform.
  • the cloud management platform can replace tenants to realize automatic data management, thereby reducing tenants' operations and improving user experience.
  • the first aspect of the embodiments of the present application provides a method for accessing data in an object storage bucket based on a cloud management platform, the method comprising:
  • the cloud management platform can provide an upload interface to the first client device used by the tenant, so the tenant can upload the first data through the first client.
  • the interface sends the first data, so that the cloud management platform receives the first data uploaded by the first client through the upload interface.
  • the cloud management platform may determine that the first client used by the tenant is located in the first geographical area, so the first data may be stored in the first object storage bucket of the site in the first geographical area, and be The first data sets the first access domain name. It should be noted that the first access domain name may be used to access the first object storage bucket to acquire the first data in the first object storage bucket.
  • the tenant When the tenant is located in the second geographical area, if it finds that it needs to access the first data, the tenant can input a data access request for the first access domain name through the data acquisition interface provided by the second client to the cloud management platform, so that The cloud management platform receives the data access request sent by the second client through the data acquisition interface. Then, based on the data access request, the cloud management platform can determine that the second client needs to access the first data in the first object storage bucket, so the cloud management platform can store data from the first object storage bucket located in the first geographical area. bucket, pull the first data into the second object storage bucket of the site located in the second geographical region, then the tenant can subsequently access the first data in the second object storage bucket through the second client.
  • the cloud management platform can store the first data in the first data of the site located in the first geographical area An object storage bucket, and set the first access domain name for the first data.
  • the cloud management platform receives the data access request for the first access domain name sent by the second client located in the second geographical area, the cloud management platform will pull the first data stored in the first object storage bucket to the In the second object storage bucket of the site of the geographic region for access by the second client.
  • the cloud management platform can store the first data in the first object storage bucket in the site in the first geographical area , and configure the first access domain name for the first data.
  • the tenant located in the second geographic region needs to access the first data, it only needs to send a data access request for the first access domain name to the cloud management platform, and the cloud management platform can pull the first data from the first object storage bucket to the second object storage bucket in the site in the second geographic region, so that the tenant can access it through the second client.
  • the cloud management platform can automatically initiate a migration task to implement data migration between sites in different geographical regions for tenants to access. Since the process of migrating data by the cloud management platform is imperceptible to tenants (clients), the cloud management platform can replace tenants to realize automatic data management, thereby reducing the workload of tenants and improving user experience.
  • the upload interface is also used to receive the second data uploaded by the first client, and the first tag of the first data and the second tag of the second data input by the first client, where the first The first label is the same as the second label
  • the method further includes: the cloud management platform stores the second data in a third object storage bucket, and sets a second access domain name for the second data, wherein the third object storage bucket is set at the In a site in a geographical area; the cloud management platform pulls the second data corresponding to the second tag identical to the first tag from the third object storage bucket to the fourth object storage bucket, wherein the fourth object storage bucket is set to In a site located in a second geographic region.
  • the tenant located in the first geographical area not only needs to store the first data, but also needs to store the second data
  • the tenant can use the upload interface provided by the cloud management platform through the first client Input the second data and the second label of the second data, wherein the first label of the first data and the second label of the second data are the same, indicating that the first data and the second data are the same type of data.
  • the cloud management platform stores the second data in the third object storage of the site in the first geographical area, and sets a second access domain name for the second data. It should be noted that the second access domain name can be used to access the third object storage to obtain the second data in the third object storage.
  • the cloud management platform After the cloud management platform enables the second client to access the first data in the second object storage bucket of the site in the second geographical area, since the first data and the second data are of the same type, the cloud management platform can also The second data is pulled from the third object storage bucket of the site in the first geographical area to the fourth object storage bucket of the site in the second geographical area. In this way, the synchronization of the same type of data between the site in the first geographical area and the site in the second geographical area can be completed, so that the second data uploaded by the tenant is stored in the site in the second geographical area in advance, If the tenant still needs to access the second data when in the second geographical area, the requirement of the tenant can be met.
  • the method further includes: the cloud management platform pulls the first data stored in the first object storage bucket in the site in the first geographical area to a fifth object storage bucket, where the fifth The object storage bucket is set in a site located in a third geographical area; the cloud management platform deletes the first data stored in the first object storage bucket and the first data stored in the second object storage bucket, wherein the site located in the third geographical area
  • the site is a central site, and the sites located in the first geographical area and the sites located in the second geographical area are edge sites.
  • the cloud management platform after the cloud management platform enables the second client to access the first data in the second object storage bucket of the site in the second geographical area, since the site located in the first geographical area and the site located in the second geographical area is an edge site, and the nature of its stored data is to be deleted when it is used up, then, since the first data has been used, the cloud management platform can store the first data from the first object storage bucket in the site in the first geographical area Pull to the fifth object storage bucket of the site located in the third geographical area, the site located in the third geographical area is the central site, and the nature of the stored data is persistent storage. Thereafter, the cloud management platform deletes the first data stored in the first object storage bucket of the site in the first geographical area and the first data stored in the second object storage bucket of the site in the second geographical area.
  • the method further includes: if the tenant located in the first geographical area still has scheduling requirements for the first data, the tenant can provide the scheduling policy provided by the cloud management platform through the first client The configuration interface inputs the scheduling strategy for the first data, so that the cloud management platform receives the scheduling strategy through the scheduling strategy configuration interface.
  • the scheduling strategy includes a tag association strategy, and the tag association strategy records the first tag of the first data
  • the method further includes: the cloud management platform sets the The data stored in the object storage buckets of the sites in other geographic regions of the user with the same label as the first label is pulled to the object storage buckets of the sites in the first geographic area.
  • the scheduling policy input by the tenant may include a label association policy, and the label association policy records the first label of the first data. Therefore, after parsing the received scheduling policy, the cloud management platform can obtain the first tag, so as to determine that the remaining data of the same type as the first data need to be associated.
  • the cloud management platform may determine in regions other than the first geographical region that the data stored in the object storage buckets of the sites in which geographical regions have the same label as the first label, and pull these data to Store in other object storage buckets other than the first object storage bucket in the site in the first geographic region, and set an access domain name for the data.
  • the scheduling policy further includes a time policy, and the time policy records the scheduling time
  • the method further includes: the cloud management platform, according to the time policy, in other geographical areas where the scheduling time will be different from that of the site in the first geographical area
  • the data stored in the object storage bucket of the site of the site with the same label as the first label is pulled to the object storage bucket of the site of the first geographic region.
  • the scheduling policy input by the tenant further includes a time policy, and the time policy records the scheduling time.
  • the cloud management platform can determine in other areas except the first geographical area, which geographical areas have the data stored in the object storage bucket of the site with the same label as the first label, and transfer these data at the scheduled time
  • the data is pulled to be stored in other object storage buckets other than the first object storage bucket in the site in the first geographic region, and an access domain name is set for the data.
  • the scheduling policy is also used to specify the target site of the first data
  • the method further includes: if the tenant inputs the specified target site to the scheduling policy configuration interface through the first client, the cloud management platform
  • the first data will be stored in the object storage bucket of the target site, so as to meet the directional data storage requirements of the tenant itself.
  • the target site here may be a site located in the first geographic area, or a site located in other geographic areas.
  • the first tag is used to indicate one or any combination of the file type, creation time, prefix, suffix, and size of the first data.
  • the first client and the second client respectively use the same account to log in to the cloud management platform, and the first client and the second client use respectively associated accounts to log in to the cloud management platform, where the same account or related accounts are registered in the cloud management platform.
  • the second aspect of the embodiments of the present application provides a cloud management platform, which includes: a first providing module, configured to provide an upload interface, and the upload interface is used to receive the first data uploaded by the first client, wherein the first A client is located in a first geographic area; a first storage module is configured to store first data in a first object storage bucket, and set a first access domain name for the first data, wherein the first object storage bucket is set in the first object storage bucket In a site in a geographic area; a receiving module, configured to receive a data access request for a first access domain name sent by a second client, wherein the second client is located in a second geographic area; a first pull module, configured to store The first data in the first object storage bucket is pulled into a second object storage bucket for access by a second client, wherein the second object storage bucket is set in a site located in a second geographic region.
  • the cloud management platform can store the first data in the site located in the first geographical area In the first object storage bucket, set the first access domain name for the first data.
  • the cloud management platform receives the data access request for the first access domain name sent by the second client located in the second geographical area, the cloud management platform will pull the first data stored in the first object storage bucket to the In the second object storage bucket of the site of the geographic region for access by the second client.
  • the cloud management platform can store the first data in the first object storage bucket in the site in the first geographical area , and configure the first access domain name for the first data.
  • the tenant located in the second geographic region needs to access the first data, it only needs to send a data access request for the first access domain name to the cloud management platform, and the cloud management platform can pull the first data from the first object storage bucket to the second object storage bucket in the site in the second geographic region, so that the tenant can access it through the second client.
  • the cloud management platform can automatically initiate a migration task to implement data migration between sites in different geographical regions for tenants to access. Since the process of migrating data by the cloud management platform is imperceptible to tenants (clients), the cloud management platform can replace tenants to realize automatic data management, thereby reducing the workload of tenants and improving user experience.
  • the upload interface is also used to receive the second data uploaded by the first client, and the first tag of the first data and the second tag of the second data input by the first client, where the first The first tag is the same as the second tag
  • the cloud management platform further includes: a second storage module, configured to store the second data in the third object storage bucket, and set a second access domain name for the second data, wherein the third object storage bucket The bucket is set in the site located in the first geographical area; the second pulling module is used to pull the second data corresponding to the second tag identical to the first tag from the third object storage bucket to the fourth object storage bucket, where the fourth object storage bucket is set in the site located in the second geographic region.
  • the cloud management platform further includes: a third pulling module, configured to pull the first data stored in the first object storage bucket in the site in the first geographical area to the fifth object storage In the bucket, wherein the fifth object storage bucket is set in the site located in the third geographic area; the deletion module is configured to delete the first data stored in the first object storage bucket and the first data stored in the second object storage bucket,
  • the site located in the third geographical area is a central site, and the sites located in the first geographical area and the sites located in the second geographical area are edge sites.
  • the cloud management platform further includes: a second providing module, configured to provide a scheduling policy configuration interface, and the scheduling policy configuration interface is configured to obtain the scheduling policy for the first data sent by the first client.
  • the scheduling strategy includes a tag association strategy
  • the tag association strategy records the first tag of the first data
  • the cloud management platform further includes: a fourth pulling module, configured to associate the tag with the first tag according to the tag association strategy.
  • the data stored in the object storage buckets of the sites in a geographical area different from the site in another geographical area and set with the same label as the first label is pulled into the object storage bucket of the site in the first geographical area.
  • the first tag is used to indicate one or any combination of the file type, creation time, prefix, suffix, and size of the first data.
  • the scheduling strategy further includes a time strategy, and the time strategy records the scheduling time
  • the cloud management platform further includes: a fifth pulling module, configured to combine the scheduling time with the first geographical area according to the time strategy The data stored in the object storage buckets of sites in other geographic regions where the site is different and set with the same label as the first label is pulled into the object storage bucket of the site in the first geographic area.
  • the scheduling policy is further used to specify a target site of the first data
  • the cloud management platform further includes: a third storage module, configured to store the first data in an object storage bucket of the target site.
  • the first client and the second client respectively use the same account to log in to the cloud management platform, and the first client and the second client use respectively associated accounts to log in to the cloud management platform, where the same account or related accounts are registered in the cloud management platform.
  • the third aspect of the embodiment of the present application provides a cloud management platform.
  • the cloud management platform includes a memory and a processor; the memory stores codes, and the processor is configured to execute the codes. When the codes are executed, the cloud management platform performs as described in the first paragraph. The method described in one aspect or any possible implementation manner of the first aspect.
  • the fourth aspect of the embodiments of the present application provides a computer storage medium, the computer storage medium stores a computer program, and when the program is executed by a computer, the computer implements any possible implementation of the first aspect or the first aspect the method described.
  • a fifth aspect of the embodiments of the present application provides a computer program product.
  • the computer program product stores instructions.
  • the instructions When executed by a computer, the computer implements the computer program described in the first aspect or any possible implementation manner of the first aspect. described method.
  • the cloud management platform can store the first data in the first data of the site located in the first geographical area. Object storage bucket, and set the first access domain name for the first data.
  • the cloud management platform receives the data access request for the first access domain name sent by the second client located in the second geographical area, the cloud management platform will pull the first data stored in the first object storage bucket to the In the second object storage bucket of the site of the geographic region for access by the second client.
  • the cloud management platform can store the first data in the first object storage bucket in the site in the first geographical area , and configure the first access domain name for the first data.
  • the tenant located in the second geographic region needs to access the first data, it only needs to send a data access request for the first access domain name to the cloud management platform, and the cloud management platform can pull the first data from the first object storage bucket to the second object storage bucket in the site in the second geographic region, so that the tenant can access it through the second client.
  • the cloud management platform can automatically initiate a migration task to implement data migration between sites in different geographical regions for tenants to access. Since the process of migrating data by the cloud management platform is imperceptible to tenants (clients), the cloud management platform can replace tenants to realize automatic data management, thereby reducing the workload of tenants and improving user experience.
  • FIG. 1 is a schematic structural diagram of a cloud storage system provided by an embodiment of the present application
  • Fig. 2 is a schematic diagram of the cloud management platform provided by the embodiment of the present application.
  • FIG. 3 is a schematic flowchart of a data access method based on an object storage bucket of a cloud management platform provided by an embodiment of the present application;
  • FIG. 4 is another schematic structural diagram of a cloud storage system provided by an embodiment of the present application.
  • FIG. 5 is another schematic structural diagram of a cloud storage system provided by an embodiment of the present application.
  • FIG. 6 is another schematic structural diagram of a cloud storage system provided by an embodiment of the present application.
  • FIG. 7 is another schematic structural diagram of a cloud storage system provided by an embodiment of the present application.
  • FIG. 8 is a schematic structural diagram of a cloud management platform provided by an embodiment of the present application.
  • FIG. 9 is another schematic structural diagram of the cloud management platform provided by the embodiment of the present application.
  • the embodiment of the present application provides a data access method of an object storage bucket and a cloud management platform.
  • the cloud management platform can replace tenants to realize automatic data management, thereby reducing tenants' operations and improving user experience.
  • Cloud storage is a concept extended and developed from the concept of cloud computing, which can achieve economies of scale, improve storage efficiency, and reduce operation and maintenance costs.
  • cloud storage technology With the development and promotion of cloud storage technology, more and more enterprises and individual users choose to store data in cloud storage systems, and the performance of cloud storage systems has become the focus of attention when users choose cloud storage systems.
  • the cloud storage system can include multiple sites deployed in different geographical regions (for example, a site in South China, a site in Central China, etc.), tenants (for example, an enterprise providing a certain application and using a certain The data of users of an application, etc.) can be stored in a site located in a certain geographical area (the area the tenant is currently accessing), therefore, the cloud storage system can provide cloud storage services for tenants in various geographical areas.
  • tenants for example, an enterprise providing a certain application and using a certain The data of users of an application, etc.
  • a site located in a certain geographical area the area the tenant is currently accessing
  • the geographical area where the data is located needs to be managed, and a migration request needs to be manually initiated to migrate the data from the site located in the geographical area that the user previously accessed To the site located in the geographical area where the user is currently connected, so as to realize the management and subsequent acquisition of data.
  • the data of a certain tenant can only be stored in a site located in a specific area. Once the tenant or other tenants need to use this part of the data, it is often necessary to implement data migration within the cloud storage system, resulting in slow data acquisition and processing. The duration is too long.
  • the embodiment of the present application provides a cloud storage system, as shown in Figure 1 ( Figure 1 is a schematic structural diagram of the cloud storage system provided by the embodiment of the application), the cloud storage system includes a ) multiple sites in different geographic regions and the cloud management platform that manages these multiple sites.
  • the sites mentioned here can be understood as regions and availability zones in the field of cloud technology , AZ) or data center (data center, DC) and other concepts.
  • the cloud storage system includes a site located in South China, a site located in Central China, a site located in Beijing, and a cloud management platform for managing these three sites.
  • the site is usually a physical server cluster, based on virtualization technology, which can be used to deploy object storage service (object storage service, OBS) buckets that provide data storage services (it should be noted that the following
  • OBS object storage service
  • the involved OBS bucket can also be understood as the aforementioned object storage bucket).
  • the cloud management platform is usually far away from multiple sites (that is, there is a certain distance between the two), and the cloud management platform can perform unified management of the OBS buckets on each site, that is, the cloud management platform can uniformly manage all sites in the entire cloud storage system OBS bucket, then, when a tenant's client accesses the cloud management platform, the cloud management platform can call a site that is geographically closer to the tenant's client to provide OBS services for the tenant's client.
  • the cloud management platform can provide a variety of application programming interfaces (application programming interface, API), for example, login interface, upload interface, Data acquisition interface, scheduling policy configuration interface, etc., wherein, the cloud management platform can receive the tenant account number and tenant password (account and password registered on the cloud management platform) sent by the client client through the login interface, and process these information Perform identity verification. After the verification is passed, the client can be allowed to log in to the cloud management platform.
  • the cloud management platform can also receive the data access request of the tenant's client through the data acquisition interface, obtain the data indicated by the request based on the request, and return the data to the tenant's client through the data acquisition interface.
  • the cloud management platform can also receive the data uploaded by the tenant's client through the data upload interface, and store this part of the data.
  • the cloud management platform can also receive the scheduling policy sent by the client of the tenant through the scheduling policy configuration interface, so as to complete the management of data in multiple sites based on the scheduling policy.
  • the cloud management platform can also include a routing module, a scheduling module and a network management module, wherein the routing module can be used to automatically route (track) to the location of the data based on the data access request (for example, the data is located in a certain OBS bucket of a certain site etc).
  • the scheduling module can be used to generate a scheduling policy by itself to manage data based on the scheduling policy. In this way, the process of managing data runs silently in the background without being perceived by tenants.
  • the network management module can be used to implement network management and bandwidth utilization control among multiple geographic regions, among other things.
  • the cloud management platform can also manage each site, for example, create an OBS bucket in a site to store the data uploaded by the client of the tenant, or pull data from the OBS bucket of a site located in a certain geographical area ( Migrate) to the OBS bucket of a site located in another geographical area, or take data from an OBS bucket of a certain site and send it to the client of the tenant, and so on.
  • create an OBS bucket in a site to store the data uploaded by the client of the tenant, or pull data from the OBS bucket of a site located in a certain geographical area ( Migrate) to the OBS bucket of a site located in another geographical area, or take data from an OBS bucket of a certain site and send it to the client of the tenant, and so on.
  • Migrate the OBS bucket of a site located in a certain geographical area
  • FIG. 3 is a schematic flowchart of a data access method for an object storage bucket based on a cloud management platform provided by an embodiment of the present application. As shown in FIG. 3 , the method includes:
  • the cloud management platform provides an upload interface, and the upload interface is used to receive the first data uploaded by the first client, where the first client is located in the first geographical area.
  • the cloud management platform stores the first data in a first object storage bucket, and sets a first access domain name for the first data, where the first object storage bucket is set in a site located in a first geographical area.
  • the cloud management platform can provide the first client device used by the tenant with an upload interface (for example, a data input interface of the user interface) column, etc.), so the tenant can send the first data to the upload interface through the first client, so that the cloud management platform can receive the first data uploaded by the first client through the upload interface.
  • the cloud management platform can determine that the first client used by the tenant is located in the first geographical area, so the first data can be stored in the first OBS bucket of the site in the first geographical area (that is, the aforementioned first OBS bucket). an object storage bucket), and set the first access domain name for the first data. It should be noted that the first access domain name may be used to access the first OBS bucket to obtain the first data in the first OBS bucket.
  • the cloud management platform can also provide a scheduling policy configuration interface (for example, the scheduling policy input column of the user interface), if the tenant does not input the specified target to the scheduling policy configuration interface through the first client
  • a scheduling policy configuration interface for example, the scheduling policy input column of the user interface
  • the cloud management platform can automatically allocate the site for storing the first data to the first data, that is, the site in the first geographical area where the first client is located.
  • Figure 4 is another schematic structural diagram of the cloud storage system provided by the embodiment of the present application
  • data 1 is generated (for example, user 1 uses Office software writes a document).
  • User 1 needs to upload data 1 to the cloud storage system for storage, then the cloud management platform can provide a user interface for user 1's client 1 (for example, the browser used by user 1), which includes a data input field , user 1 can input data 1 in the input field through client 1, so as to upload data 1 to the cloud management platform.
  • client 1 for example, the browser used by user 1
  • the user interface When uploading data, the user interface also includes a scheduling policy input column, but user 1 does not need to input a site specified by user 1 into the input column through client 1, that is, user 1 does not need to specify a site located in a certain geographical area
  • the cloud management platform can automatically assign user 1 a site located in geographical area 1, and store data 1 in OBS bucket 1 of the site.
  • the cloud management platform can configure an access domain name for Data 1, that is, www.bucketname.obs11.com, and "OBS11" in the access domain name corresponds to OBS bucket 1 of the site in geographical area 1.
  • the cloud management platform will store the first data in the object storage bucket of the target site, so as to meet the tenant's own directional data storage requirements.
  • the target site here may be a site located in the first geographical area or a site located in other geographical areas, which is not specifically limited.
  • the tenant can also input the first tag of the first data to the upload interface through the first client, and the first tag of the first data includes at least one of the following items: the first data
  • the creation time of the first data for example, the time when the software to which the first data belongs produces the first data
  • the file type of the first data for example, the first data is a picture, video or text, etc.
  • the application type to which the first data belongs That is, the prefix and suffix of the first data, etc., for example, the application to which the first data belongs is an Android application, an IOS application, or a Google application, etc.
  • the size of the first data and the like.
  • the identification of the data 1 may include: the time when the office software generated the data 1, the data 1 belongs to the document type, the office software is an application belonging to the Android system, the size of the user 1 is 5M, and so on.
  • the cloud management platform receives a data access request for the first access domain name sent by the second client, where the second client is located in the second geographical area.
  • the cloud management platform pulls the first data stored in the first object storage bucket into a second object storage bucket for access by the second client, where the second object storage bucket is set at a site located in a second geographical area middle.
  • the tenant When the tenant is located in the second geographical area, if it finds that it needs to access the first data, the tenant can use the data acquisition interface provided by the second client to the cloud management platform (for example, the domain name input column of the user interface, etc.), input A data access request for the first access domain name (that is, the data access request includes the first access domain name, or the data access request is generated based on the first access domain name), so that the cloud management platform receives the data sent by the second client through the data acquisition interface access request.
  • the cloud management platform for example, the domain name input column of the user interface, etc.
  • the cloud management platform can determine that the second client needs to access the first data in the first OBS bucket, so the cloud management platform can access the first data in the first OBS bucket of the site located in the first geographical area , pull the first data into the second OBS bucket of the site located in the second geographical area (that is, the aforementioned second object storage bucket), then the tenant can access the second OBS bucket through the second client
  • the first data for example, if the data access request indicates that the operation to be implemented by the second client is a data read operation, the cloud management platform may provide the first data stored in the second OBS bucket to the second client for the For user use, as another example, if the data access request indicates that the operation to be implemented by the second client is a data write operation, the cloud management platform may open permissions or interfaces to the second client, so that the tenant can use the second client to access the second client.
  • the first data stored in the second OBS bucket is modified, etc.).
  • Figure 5 is another schematic structural diagram of the cloud storage system provided by the embodiment of the present application, and Figure 5 is drawn on the basis of Figure 4
  • client 2 for example, the cloud storage software used by user 1
  • the cloud management platform can pull data 1 from OBS bucket 1 of the site in geographic area 1 to OBS bucket 2 of the site in geographic area 2 for storage. Since the data access request indicates that the operation implemented by the client 2 is a data read operation, the cloud management platform can provide the data 1 in the OBS bucket 2 to the client 2 for use by the user 1 .
  • first client and the second client are different clients used by the same tenant (for example, a certain individual user or multiple users located in different geographical locations in a certain enterprise), then the tenants are When using the first client and the second client to log in to the cloud management platform, they use the same account or interrelated accounts (for example, master account and sub-account, etc.), and these accounts have been implemented in the cloud management platform Registration is an available account.
  • account or interrelated accounts for example, master account and sub-account, etc.
  • the cloud management platform can implement data management according to its own scheduling strategy, and can also implement data management according to the scheduling strategy of tenants.
  • the following will introduce them respectively:
  • the cloud management platform implements data management according to its own scheduling strategy:
  • the tenant can input the second data and the upload interface provided by the cloud management platform through the first client terminal.
  • the second label of the second data wherein the first label of the first data is the same as the second label of the second data, it means that the first data and the second data are of the same type.
  • the tenant uploading the second data and the second label of the second data through the first client please refer to the above-mentioned relevant description of the tenant uploading the first data and the first label of the first data through the first client, I won't repeat them here. It should be understood that uploading the first data and the first label by the tenant, and uploading the second data and the second label may also be performed simultaneously.
  • the cloud management platform receives the second data sent by the first client, it stores the second data in the third OBS bucket (that is, the aforementioned third object storage bucket) of the site in the first geographical area, and stores the second data in the The second data sets the second access domain name.
  • the second access domain name may be used to access the third OBS bucket to obtain the second data in the third OBS bucket.
  • the cloud management platform can also pull the second data from the third OBS bucket of the site in the first geographical area to the second In the fourth OBS bucket of the site in the geographic region (that is, the aforementioned fourth object storage bucket).
  • the cloud management platform can also pull the second data from the third OBS bucket of the site in the first geographical area to the second In the fourth OBS bucket of the site in the geographic region (that is, the aforementioned fourth object storage bucket).
  • the synchronization of the same type of data between the site in the first geographical area and the site in the second geographical area can be completed, so that the second data uploaded by the tenant is stored in the site in the second geographical area in advance, If the tenant still needs to access the second data when in the second geographical area, the requirement of the tenant can be met.
  • the cloud management platform will be located in the geographical area 2
  • the cloud management platform can pull data 2 from OBS bucket 3 of the site located in geographical area 1 to OBS bucket 4 of the site located in geographical area 2 for storage. If user 1 still needs to use data 2, the cloud management platform can quickly provide data 2 in OBS bucket 4 directly to client 2 for use by user 1.
  • the cloud management platform can pull the first data from the first OBS bucket in the site in the first geographic area to the fifth OBS bucket in the site in the third geographic area (that is, the aforementioned fifth object storage bucket) , the site located in the third geographic region is the central site, and the nature of its data storage is persistent storage. Thereafter, the cloud management platform deletes the first data stored in the first OBS bucket of the site in the first geographic area and the first data stored in the second OBS bucket of the site in the second geographic area.
  • the site in geographical area 1 be the site in Shenzhen
  • the site in geographical area 2 be the site in Guangzhou, all of which are edge sites
  • the site in geographical area 3 be the site in South China, which is the central site .
  • the cloud management platform can pull the data 1 to be stored in the OBS bucket 5 of the site located in the geographical area 3, and Delete Data 1 in OBS bucket 1 of the site in geographic area 1 and Data 1 in OBS bucket 2 of the site in geographic area 2.
  • the cloud management platform implements data management according to the tenant's scheduling strategy:
  • the tenant can input the first data scheduling requirements to the scheduling policy configuration interface provided by the cloud management platform through the first client. scheduling strategy, so that the cloud management platform receives the scheduling strategy through the scheduling strategy configuration interface. It should be understood that the tenant's input of the scheduling policy may also occur simultaneously with the tenant's upload of the first data and the first label.
  • the scheduling policy may include a label association policy, and the label association policy records the first label of the first data. Therefore, after parsing the received scheduling policy, the cloud management platform can obtain the first tag, so as to determine that the remaining data of the same type as the first data need to be associated. Then, the cloud management platform can determine in other regions except the first geographical region that the data stored in the OBS buckets of the sites in which geographical regions have the same label as the first label, and pull these data to the first Sites in a geographical area store in other OBS buckets other than the first OBS bucket, and set access domain names for these data.
  • Figure 7 is another schematic structural diagram of the cloud storage system provided by the embodiment of the present application, and Figure 7 is drawn on the basis of Figure 4
  • the cloud management platform determines that the cloud storage system from the client 1
  • the scheduling policy includes the label of data 1
  • the cloud management platform first determines the data 3 in the OBS bucket 6 of the site located in geographical area 4 and the data 4 in OBS bucket 7 of the site located in geographical area 5.
  • the tag is the same as that of data 1, so the cloud management platform can pull data 3 from OBS bucket 6 of the site in geographic area 4 to OBS bucket 8 of the site in geographic area 1 for storage, and store it from From the OBS bucket 7 of the site in geographic area 5, the data 4 is pulled to the OBS bucket 9 of the site in geographic area 1 for storage.
  • the scheduling policy also includes a time policy, and the time policy records the scheduling time. Therefore, the cloud management platform can determine in other regions except the first geographic region that the tags of the data stored in the OBS buckets of the sites in which geographic regions are the same as the first tag, and save these data at the scheduled time Pull and store the data in other OBS buckets other than the first OBS bucket in the site in the first geographical area, and set the access domain name for the data.
  • the cloud management platform can store the first data in the first data of the site located in the first geographical area. Object storage bucket, and set the first access domain name for the first data.
  • the cloud management platform receives the data access request for the first access domain name sent by the second client located in the second geographical area, the cloud management platform will pull the first data stored in the first object storage bucket to the In the second object storage bucket of the site of the geographic region for access by the second client.
  • the cloud management platform can store the first data in the first object storage bucket in the site in the first geographical area , and configure the first access domain name for the first data.
  • the tenant located in the second geographic region needs to access the first data, it only needs to send a data access request for the first access domain name to the cloud management platform, and the cloud management platform can pull the first data from the first object storage bucket to the second object storage bucket in the site in the second geographic region, so that the tenant can access it through the second client.
  • the cloud management platform can automatically initiate a migration task to implement data migration between sites in different geographical regions for tenants to access. Since the process of migrating data by the cloud management platform is imperceptible to tenants (clients), the cloud management platform can replace tenants to realize automatic data management, thereby reducing the workload of tenants and improving user experience.
  • the cloud management platform can implement data management based on its own scheduling strategy or tenant scheduling strategy, increasing the flexibility of data deployment and improving user experience.
  • Fig. 8 is a schematic structural diagram of the cloud management platform provided by the embodiment of the present application. As shown in Fig. 8, the cloud management platform includes:
  • the first providing module 801 is configured to provide an upload interface, and the upload interface is configured to receive the first data uploaded by the first client, wherein the first client is located in the first geographical area; for example, the first providing module 801 can be used to realize the implementation of FIG. 3 Step 301 in the illustrated embodiment.
  • the first storage module 802 is configured to store the first data in a first object storage bucket, and set a first access domain name for the first data, wherein the first object storage bucket is set in a site located in a first geographical area; the second A storage module 802 may be used to implement step 302 in the embodiment shown in FIG. 3 .
  • the receiving module 803 is configured to receive the data access request for the first access domain name sent by the second client, wherein the second client is located in the second geographical area; the receiving module 803 can be used to implement the steps in the embodiment shown in FIG. 3 303.
  • the first pulling module 804 is configured to pull the first data stored in the first object storage bucket into the second object storage bucket for access by the second client, wherein the second object storage bucket is set in the second Geographical area of the site.
  • the first pulling module 804 may be used to implement step 304 in the embodiment shown in FIG. 3 .
  • the cloud management platform can store the first data in the first data of the site located in the first geographical area. Object storage bucket, and set the first access domain name for the first data.
  • the cloud management platform receives the data access request for the first access domain name sent by the second client located in the second geographical area, the cloud management platform will pull the first data stored in the first object storage bucket to the In the second object storage bucket of the site of the geographic region for access by the second client.
  • the cloud management platform can store the first data in the first object storage bucket in the site in the first geographical area , and configure the first access domain name for the first data.
  • the tenant located in the second geographic region needs to access the first data, it only needs to send a data access request for the first access domain name to the cloud management platform, and the cloud management platform can pull the first data from the first object storage bucket to the second object storage bucket in the site in the second geographic region, so that the tenant can access it through the second client.
  • the cloud management platform can automatically initiate a migration task to implement data migration between sites in different geographical regions for tenants to access. Since the process of migrating data by the cloud management platform is imperceptible to tenants (clients), the cloud management platform can replace tenants to realize automatic data management, thereby reducing the workload of tenants and improving user experience.
  • the upload interface is also used to receive the second data uploaded by the first client, and the first tag of the first data and the second tag of the second data input by the first client, where the first The first tag is the same as the second tag
  • the cloud management platform further includes: a second storage module, configured to store the second data in the third object storage bucket, and set a second access domain name for the second data, wherein the third object storage bucket The bucket is set in the site located in the first geographical area; the second pulling module is used to pull the second data corresponding to the second tag identical to the first tag from the third object storage bucket to the fourth object storage bucket, where the fourth object storage bucket is set in the site located in the second geographic region.
  • the cloud management platform further includes: a third pulling module, configured to pull the first data stored in the first object storage bucket in the site in the first geographical area to the fifth object storage In the bucket, wherein the fifth object storage bucket is set in the site located in the third geographic area; the deletion module is configured to delete the first data stored in the first object storage bucket and the first data stored in the second object storage bucket,
  • the site located in the third geographical area is a central site, and the sites located in the first geographical area and the sites located in the second geographical area are edge sites.
  • the cloud management platform further includes: a second providing module, configured to provide a scheduling policy configuration interface, and the scheduling policy configuration interface is configured to obtain the scheduling policy for the first data sent by the first client.
  • the scheduling strategy includes a tag association strategy
  • the tag association strategy records the first tag of the first data
  • the cloud management platform further includes: a fourth pulling module, configured to associate the tag with the first tag according to the tag association strategy.
  • the data stored in the object storage buckets of the sites in a geographical area different from the site in another geographical area and set with the same label as the first label is pulled into the object storage bucket of the site in the first geographical area.
  • the first tag is used to indicate one or any combination of the file type, creation time, prefix, suffix, and size of the first data.
  • the scheduling strategy further includes a time strategy, and the time strategy records the scheduling time
  • the cloud management platform further includes: a fifth pulling module, configured to combine the scheduling time with the first geographical area according to the time strategy The data stored in the object storage buckets of sites in other geographic regions where the site is different and set with the same label as the first label is pulled into the object storage bucket of the site in the first geographic area.
  • the scheduling policy is further used to specify a target site of the first data
  • the cloud management platform further includes: a third storage module, configured to store the first data in an object storage bucket of the target site.
  • the first client and the second client respectively use the same account to log in to the cloud management platform, and the first client and the second client use respectively associated accounts to log in to the cloud management platform, where the same account or related accounts are registered in the cloud management platform.
  • FIG. 9 is another schematic structural diagram of the cloud management platform provided by the embodiment of the present application.
  • an embodiment of the cloud management platform may include one or more central processing units 901 , memory 902 , input/output interface 903 , wired or wireless network interface 904 , and power supply 905 .
  • Memory 902 may be transient or persistent storage. Furthermore, the central processing unit 901 may be configured to communicate with the memory 902, and execute a series of instruction operations in the memory 902 on the cloud management platform.
  • the central processing unit 901 may execute the method steps in the foregoing embodiment shown in FIG. 3 , and details are not described here again.
  • the division of specific functional modules in the central processing unit 901 can be compared with the first providing module, the second providing module, the first storage module, the second storage module, the third storage module, the receiving module and the receiving module described in FIG. Modules, the first pull module, the second pull module, the third pull module, the fourth pull module, the fifth pull module, and the deletion module are divided in similar ways, and will not be repeated here.
  • the embodiment of the present application also relates to a computer storage medium, including computer-readable instructions.
  • a computer storage medium including computer-readable instructions.
  • the method steps of the embodiment shown in FIG. 3 are realized.
  • the embodiment of the present application also relates to a computer program product containing instructions, which when run on a computer, causes the computer to execute the method steps of the embodiment shown in FIG. 3 .
  • the disclosed system, device and method can be implemented in other ways.
  • the device embodiments described above are only illustrative.
  • the division of the units is only a logical function division. In actual implementation, there may be other division methods.
  • multiple units or components can be combined or May be integrated into another system, or some features may be ignored, or not implemented.
  • the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces, and the indirect coupling or communication connection of devices or units may be in electrical, mechanical or other forms.
  • the units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place, or may be distributed to multiple network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.
  • each functional unit in each embodiment of the present application may be integrated into one processing unit, each unit may exist separately physically, or two or more units may be integrated into one unit.
  • the above-mentioned integrated units can be implemented in the form of hardware or in the form of software functional units.
  • the integrated unit is realized in the form of a software function unit and sold or used as an independent product, it can be stored in a computer-readable storage medium.
  • the technical solution of the present application is essentially or part of the contribution to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium , including several instructions to make a computer device (which may be a personal computer, a server, or a network device, etc.) execute all or part of the steps of the methods described in the various embodiments of the present application.
  • the aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (read-only memory, ROM), random access memory (random access memory, RAM), magnetic disk or optical disc and other media that can store program codes. .

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Computer Security & Cryptography (AREA)
  • Computer Hardware Design (AREA)
  • Computing Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

本申请公开了一种对象存储桶的数据访问方法以及云管理平台,云管理平台可代替租户实现数据的自动管理,从而减少租户的操作量,提高用户体验。本申请的方法包括:云管理平台通过上传接口接收位于第一地理区域的第一客户端上传的第一数据后,云管理平台可将第一数据存储在位于第一地理区域的站点的第一对象存储桶中,并为第一数据设置第一访问域名。当云管理平台接收位于第二地理区域的第二客户端发送的针对第一访问域名的数据访问请求时,云管理平台将存储在第一对象存储桶中的第一数据拉取到位于第二地理区域的站点的第二对象存储桶中以供第二客户端访问。

Description

一种对象存储桶的数据访问方法以及云管理平台
本申请要求于2021年12月16日提交中国专利局、申请号为202111540737.9、申请名称为“基于对象存储服务OBS的全域云存储系统”的中国专利申请的优先权,和要求于2022年03月31日提交中国专利局、申请号为202210334998.3、申请名称为“一种对象存储桶的数据访问方法以及云管理平台”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
技术领域
本申请实施例涉及云技术领域,尤其涉及一种基于云管理平台的对象存储桶的数据访问方法以及云管理平台。
背景技术
云存储(cloud storage)是在云计算(cloud computing)概念上延伸和发展出来的概念,可以实现规模效应,提高存储效率,降低运维成本。随着云存储技术的发展和推广,越来越多的企业与个人用户选择将数据存储于云存储系统,云存储系统性能成为用户选择云存储系统时关注的焦点。
目前,云存储系统可包含部署于不同地理区域的多个站点,租户的数据可存储于位于某个地理区域(租户当前接入的区域)的站点中。在租户移动至另一地理区域后,若租户需要使用已存储的数据,则需要管理数据所在的地理区域,则需要手动发起迁移请求,以将数据从位于用户之前接入的地理区域的站点迁移至位于用户当前接入的地理区域的站点,从而实现数据的管理和后续获取。
可见,当租户要管理数据所在的地理区域时,需要租户自身发起迁移任务来实现数据的迁移,在这个过程中,租户需要付出较多的操作,导致用户体验不佳。
发明内容
本申请实施例提供了一种对象存储桶的数据访问方法以及云管理平台,云管理平台可代替租户实现数据的自动管理,从而减少租户的操作量,提高用户体验。
本申请实施例的第一方面提供了一种基于云管理平台的对象存储桶的数据访问方法,该方法包括:
当位于第一地理区域的某个租户需要在云端存储第一数据时,云管理平台可向该租户所使用的第一客户端设备提供上传接口,故该租户可通过第一客户端可向上传接口发送第一数据,以使得云管理平台通过上传接口接收第一客户端上传的第一数据。接收第一数据后,云管理平台可确定该租户所使用的第一客户端位于第一地理区域,故可将第一数据存储在第一地理区域的站点的第一对象存储桶中,并为第一数据设置第一访问域名。需要说明的是,第一访问域名可用于访问第一对象存储桶,以获取第一对象存储桶中的第一数据。
当该租户位于第二地理区域时,若发现自身需要访问第一数据,该租户可通过第二客户端向云管理平台提供的数据获取接口,输入针对第一访问域名的数据访问请求,以使得云管理平台通过数据获取接口接收第二客户端发送的数据访问请求。那么,云管理平台可基于该 数据访问请求,可确定第二客户端需要访问作第一对象存储桶中的第一数据,故云管理平台可从位于第一地理区域的站点的第一对象存储桶中,将第一数据拉取到位于第二地理区域的站点的第二对象存储桶中,那么,该租户后续可通过第二客户端访问第二对象存储桶中的第一数据。
从上述方法可以看出:云管理平台通过上传接口接收位于第一地理区域的第一客户端上传的第一数据后,云管理平台可将第一数据存储在位于第一地理区域的站点的第一对象存储桶中,并为第一数据设置第一访问域名。当云管理平台接收位于第二地理区域的第二客户端发送的针对第一访问域名的数据访问请求时,云管理平台将存储在第一对象存储桶中的第一数据拉取到位于第二地理区域的站点的第二对象存储桶中以供第二客户端访问。前述过程中,位于第一地理区域的租户通过第一客户端向云管理平台上传第一数据后,云管理平台可将第一数据存储于第一地理区域的站点中的第一对象存储桶中,并为第一数据配置第一访问域名。当位于第二地理区域的该租户需要访问第一数据时,仅需向云管理平台发送针对第一访问域名的数据访问请求,云管理平台即可将第一数据,从第一对象存储桶拉取到第二地理区域的站点中的第二对象存储桶中,以供该租户通过第二客户端来实现访问。可见,在接收到租户(通过客户端发送)的数据获取请求后,云管理平台可自动发起迁移任务,实现数据在不同地理区域的站点之间的迁移,以供租户访问。由于云管理平台迁移数据的过程对于租户(的客户端)而言是无感知的,故云管理平台可代替租户实现数据的自动管理,从而减少租户的操作量,提高用户体验。
在一种可能的实现方式中,上传接口还用于接收第一客户端上传的第二数据,以及第一客户端输入的第一数据的第一标签和第二数据的第二标签,其中第一标签和第二标签相同,该方法还包括:云管理平台将第二数据存储在第三对象存储桶中,并为第二数据设置第二访问域名,其中第三对象存储桶设置在位于第一地理区域的站点中;云管理平台将与第一标签相同的第二标签对应的第二数据从第三对象存储桶中的拉取到第四对象存储桶中,其中第四对象存储桶设置在位于第二地理区域的站点中。前述实现方式中,设位于第一地理区域的该租户不仅有存储第一数据的需求,还有存储第二数据的需求,则该租户可通过第一客户端,向云管理平台提供的上传接口输入第二数据和第二数据的第二标签,其中,第一数据的第一标签和第二数据第二标签相同,说明第一数据和第二数据是同种类型的数据。那么,云管理平台接收到第一客户端发送的第二数据后,将第二数据存储在第一地理区域的站点的第三对象存储中,并为第二数据设置第二访问域名。需要说明的是,第二访问域名可用于访问第三对象存储,以获取第三对象存储中的第二数据。在云管理平台令第二客户端访问第二地理区域的站点的第二对象存储桶中的第一数据后,由于第一数据和第二数据是同种类型的数据,云管理平台还可将第二数据从第一地理区域的站点的第三对象存储桶中,拉取到第二地理区域的站点的第四对象存储桶中。如此一来,可完成第一地理区域的站点和第二地理区域的站点之间有关于同种类型的数据的同步,使得第二地理区域的站点中提前存储有该租户上传的第二数据,若该租户在第二地理区域时,还需要访问第二数据,则可以满足该租户的需求。
在一种可能的实现方式中,该方法还包括:云管理平台将第一地理区域的站点中的第一对象存储桶中存储的第一数据拉取到第五对象存储桶中,其中第五对象存储桶设置在位于第三地理区域的站点中;云管理平台删除第一对象存储桶中存储的第一数据和第二对象存储桶 中存储的第一数据,其中,位于第三地理区域的站点为中心站点,位于第一地理区域的站点和位于第二地理区域的站点为边缘站点。前述实现方式中,在云管理平台令第二客户端访问第二地理区域的站点的第二对象存储桶中的第一数据后,由于位于第一地理区域的站点和位于第二地理区域的站点为边缘站点,其存储数据的性质为用完即删,那么,由于第一数据已被使用,故云管理平台可从第一地理区域的站点中的第一对象存储桶中,将第一数据拉取到位于第三地理区域的站点的第五对象存储桶,位于第三地理区域的站点为中心站点,其存储数据的性质为持续性存储。此后,云管理平台再删除第一地理区域的站点的第一对象存储桶中存储的第一数据和位于第二地理区域的站点的第二对象存储桶中存储的第一数据。
在一种可能的实现方式中,该方法还包括:若位于第一地理区域的该租户还有针对第一数据的调度需求,该租户可通过第一客户端,向云管理平台提供的调度策略配置接口输入针对第一数据的调度策略,以使得云管理平台通过调度策略配置接口接收该调度策略。
在一种可能的实现方式中,调度策略包括标签关联策略,标签关联策略记录有第一数据的第一标签,该方法还包括:云管理平台根据标签关联策略将与第一地理区域的站点不同的其他地理区域的站点的对象存储桶中存储的设置有与第一标签相同的标签的数据拉取到第一地理区域的站点的对象存储桶中。前述实现方式中,该租户输入的调度策略可包含标签关联策略,标签关联策略记录有第一数据的第一标签。因此,云管理平台在解析接收到的该调度策略后,可获取第一标签,从而确定需要将与第一数据为相同类型的其余数据关联起来。那么,云管理平台可在除第一地理区域之外的其他区域中,确定有哪些地理区域的站点的对象存储桶中所存储的数据的标签与第一标签相同,并将这些数据拉取到第一地理区域的站点中处第一对象存储桶之外的其余对象存储桶中进行存储,并为这些数据设置访问域名。
在一种可能的实现方式中,调度策略还包括时间策略,时间策略记录有调度时间,该方法还包括:云管理平台根据时间策略在调度时间将与第一地理区域的站点不同的其他地理区域的站点的对象存储桶中存储的设置有与第一标签相同的标签的数据拉取到第一地理区域的站点的对象存储桶中。前述实现方式中,该租户输入的调度策略还包括时间策略,时间策略记录有调度时间。因此,云管理平台可在除第一地理区域之外的其他区域中,确定有哪些地理区域的站点的对象存储桶中所存储的数据的标签与第一标签相同,并在该调度时间将这些数据拉取到第一地理区域的站点中处第一对象存储桶之外的其余对象存储桶中进行存储,并为这些数据设置访问域名。
在一种可能的实现方式中,调度策略还用于指定第一数据的目标站点,该方法还包括:若该租户通过第一客户端向调度策略配置接口输入其指定的目标站点,云管理平台则会将第一数据存储在目标站点的对象存储桶中,从而满足租户自身指向性的数据存储需求。可以理解的是,此处的目标站点既可以是位于第一地理区域的站点,也可以是位于其余地理区域的站点。
在一种可能的实现方式中,第一标签用于指示第一数据的文件类型、创建时间、前缀、后缀、大小中的一者或任意组合。
在一种可能的实现方式中,第一客户端和第二客户端分别使用相同的账号登录云管理平台,第一客户端和第二客户端分别使用相互关联的账号登录云管理平台,其中相同的账号或相互关联的账号在云管理平台中注册。
本申请实施例的第二方面提供了一种云管理平台,该云管理平台包括:第一提供模块,用于提供上传接口,上传接口用于接收第一客户端上传的第一数据,其中第一客户端位于第一地理区域;第一存储模块,用于将第一数据存储在第一对象存储桶中,并为第一数据设置第一访问域名,其中第一对象存储桶设置在位于第一地理区域的站点中;接收模块,用于接收第二客户端发送的针对第一访问域名的数据访问请求,其中第二客户端位于第二地理区域;第一拉取模块,用于将存储在第一对象存储桶中的第一数据拉取到第二对象存储桶中以供第二客户端访问,其中第二对象存储桶设置在位于第二地理区域的站点中。
从上述云管理平台可以看出:云管理平台通过上传接口接收位于第一地理区域的第一客户端上传的第一数据后,云管理平台可将第一数据存储在位于第一地理区域的站点的第一对象存储桶中,并为第一数据设置第一访问域名。当云管理平台接收位于第二地理区域的第二客户端发送的针对第一访问域名的数据访问请求时,云管理平台将存储在第一对象存储桶中的第一数据拉取到位于第二地理区域的站点的第二对象存储桶中以供第二客户端访问。前述过程中,位于第一地理区域的租户通过第一客户端向云管理平台上传第一数据后,云管理平台可将第一数据存储于第一地理区域的站点中的第一对象存储桶中,并为第一数据配置第一访问域名。当位于第二地理区域的该租户需要访问第一数据时,仅需向云管理平台发送针对第一访问域名的数据访问请求,云管理平台即可将第一数据,从第一对象存储桶拉取到第二地理区域的站点中的第二对象存储桶中,以供该租户通过第二客户端来实现访问。可见,在接收到租户(通过客户端发送)的数据获取请求后,云管理平台可自动发起迁移任务,实现数据在不同地理区域的站点之间的迁移,以供租户访问。由于云管理平台迁移数据的过程对于租户(的客户端)而言是无感知的,故云管理平台可代替租户实现数据的自动管理,从而减少租户的操作量,提高用户体验。
在一种可能的实现方式中,上传接口还用于接收第一客户端上传的第二数据,以及第一客户端输入的第一数据的第一标签和第二数据的第二标签,其中第一标签和第二标签相同,云管理平台还包括:第二存储模块,用于将第二数据存储在第三对象存储桶中,并为第二数据设置第二访问域名,其中第三对象存储桶设置在位于第一地理区域的站点中;第二拉取模块,用于将与第一标签相同的第二标签对应的第二数据从第三对象存储桶中的拉取到第四对象存储桶中,其中第四对象存储桶设置在位于第二地理区域的站点中。
在一种可能的实现方式中,云管理平台还包括:第三拉取模块,用于将第一地理区域的站点中的第一对象存储桶中存储的第一数据拉取到第五对象存储桶中,其中第五对象存储桶设置在位于第三地理区域的站点中;删除模块,用于删除第一对象存储桶中存储的第一数据和第二对象存储桶中存储的第一数据,其中,位于第三地理区域的站点为中心站点,位于第一地理区域的站点和位于第二地理区域的站点为边缘站点。
在一种可能的实现方式中,云管理平台还包括:第二提供模块,用于提供调度策略配置接口,调度策略配置接口用于获取第一客户端发送的针对第一数据的调度策略。
在一种可能的实现方式中,调度策略包括标签关联策略,标签关联策略记录有第一数据的第一标签,云管理平台还包括:第四拉取模块,用于根据标签关联策略将与第一地理区域的站点不同的其他地理区域的站点的对象存储桶中存储的设置有与第一标签相同的标签的数据拉取到第一地理区域的站点的对象存储桶中。
在一种可能的实现方式中,第一标签用于指示第一数据的文件类型、创建时间、前缀、后缀、大小中的一者或任意组合。
在一种可能的实现方式中,调度策略还包括时间策略,时间策略记录有调度时间,云管理平台还包括:第五拉取模块,用于根据时间策略在调度时间将与第一地理区域的站点不同的其他地理区域的站点的对象存储桶中存储的设置有与第一标签相同的标签的数据拉取到第一地理区域的站点的对象存储桶中。
在一种可能的实现方式中,调度策略还用于指定第一数据的目标站点,云管理平台还包括:第三存储模块,用于将第一数据存储到所目标站点的对象存储桶中。
在一种可能的实现方式中,第一客户端和第二客户端分别使用相同的账号登录云管理平台,第一客户端和第二客户端分别使用相互关联的账号登录云管理平台,其中相同的账号或相互关联的账号在云管理平台中注册。
本申请实施例的第三方面提供了一种云管理平台,云管理平台包括存储器和处理器;存储器存储有代码,处理器被配置为执行代码,当代码被执行时,云管理平台执行如第一方面或第一方面中任意一种可能的实现方式所述的方法。
本申请实施例的第四方面提供了一种计算机存储介质,计算机存储介质存储有计算机程序,该程序由计算机执行时,使得计算机实施如第一方面或第一方面中任意一种可能的实现方式所述的方法。
本申请实施例的第五方面提供了一种计算机程序产品,计算机程序产品存储有指令,指令在由计算机执行时,使得计算机实施如第一方面或第一方面中任意一种可能的实现方式所述的方法。
本申请实施例中,云管理平台通过上传接口接收位于第一地理区域的第一客户端上传的第一数据后,云管理平台可将第一数据存储在位于第一地理区域的站点的第一对象存储桶中,并为第一数据设置第一访问域名。当云管理平台接收位于第二地理区域的第二客户端发送的针对第一访问域名的数据访问请求时,云管理平台将存储在第一对象存储桶中的第一数据拉取到位于第二地理区域的站点的第二对象存储桶中以供第二客户端访问。前述过程中,位于第一地理区域的租户通过第一客户端向云管理平台上传第一数据后,云管理平台可将第一数据存储于第一地理区域的站点中的第一对象存储桶中,并为第一数据配置第一访问域名。当位于第二地理区域的该租户需要访问第一数据时,仅需向云管理平台发送针对第一访问域名的数据访问请求,云管理平台即可将第一数据,从第一对象存储桶拉取到第二地理区域的站点中的第二对象存储桶中,以供该租户通过第二客户端来实现访问。可见,在接收到租户(通过客户端发送)的数据获取请求后,云管理平台可自动发起迁移任务,实现数据在不同地理区域的站点之间的迁移,以供租户访问。由于云管理平台迁移数据的过程对于租户(的客户端)而言是无感知的,故云管理平台可代替租户实现数据的自动管理,从而减少租户的操作量,提高用户体验。
附图说明
图1为本申请实施例提供的云存储系统的一个结构示意图;
图2为本申请实施例提供的云管理平台的一个示意图;
图3为本申请实施例提供的基于云管理平台的对象存储桶的数据访问方法的一个流程示意图;
图4为本申请实施例提供的云存储系统的另一结构示意图;
图5为本申请实施例提供的云存储系统的另一结构示意图;
图6为本申请实施例提供的云存储系统的另一结构示意图;
图7为本申请实施例提供的云存储系统的另一结构示意图;
图8为本申请实施例提供的云管理平台的一个结构示意图;
图9为本申请实施例提供的云管理平台的另一结构示意图。
具体实施方式
本申请实施例提供了一种对象存储桶的数据访问方法以及云管理平台,云管理平台可代替租户实现数据的自动管理,从而减少租户的操作量,提高用户体验。
本申请的说明书和权利要求书及上述附图中的术语“第一”、“第二”等是用于区别类似的对象,而不必用于描述特定的顺序或先后次序。应该理解这样使用的术语在适当情况下可以互换,这仅仅是描述本申请的实施例中对相同属性的对象在描述时所采用的区分方式。此外,术语“包括”和“具有”以及他们的任何变形,意图在于覆盖不排他的包含,以便包含一系列单元的过程、方法、系统、产品或设备不必限于那些单元,而是可包括没有清楚地列出的或对于这些过程、方法、产品或设备固有的其它单元。
本申请的说明书和权利要求书及上述附图中的术语“第一”、“第二”等是用于区别类似的对象,而不必用于描述特定的顺序或先后次序。应该理解这样使用的术语在适当情况下可以互换,这仅仅是描述本申请的实施例中对相同属性的对象在描述时所采用的区分方式。此外,术语“包括”和“具有”并他们的任何变形,意图在于覆盖不排他的包含,以便包含一系列单元的过程、方法、系统、产品或设备不必限于那些单元,而是可包括没有清楚地列出的或对于这些过程、方法、产品或设备固有的其它单元。
云存储是在云计算概念上延伸和发展出来的概念,可以实现规模效应,提高存储效率,降低运维成本。随着云存储技术的发展和推广,越来越多的企业与个人用户选择将数据存储于云存储系统,云存储系统性能成为用户选择云存储系统时关注的焦点。
目前,云存储系统可包含部署于不同地理区域(region)的多个站点(例如,位于华南地区的站点,位于华中地区的站点等等),租户(例如,提供某个应用的企业和使用某个应用的用户等等)的数据可存储于位于某个地理区域(租户当前接入的区域)的站点中,因此,云存储系统可为各个地理区域的租户提供云存储服务。在租户移动至另一地理区域后,若租户需要使用已存储的数据,则需要管理数据所在的地理区域,则需要手动发起迁移请求,以将数据从位于用户之前接入的地理区域的站点迁移至位于用户当前接入的地理区域的站点,从而实现数据的管理和后续获取。
可见,当租户要管理数据所在的地理区域时,需要租户自身发起迁移任务来实现数据的迁移,在这个过程中,租户需要付出较多的操作(例如,租户需手动配置地理区域的信息以及站点的信息等等),导致用户体验不佳。
进一步地,某个租户的数据往往只能存储在位于特定区域的站点,一旦租户或其他租户 需要使用这部分数据时,往往需要在云存储系统内部实现数据迁移,导致数据获取的速度低下,处理时长过大。
为了解决上述问题,本申请实施例提供了一种云存储系统,如图1所示(图1为本申请实施例提供的云存储系统的一个结构示意图),该云存储系统包括位于(部署于)不同地理区域的多个站点以及管理这多个站点的云管理平台,需要说明的是,此处所提及的站点,可以理解为云技术领域中的区域(region)、可用区(availability zone,AZ)或数据中心(data center,DC)等概念。例如,该云存储系统包括位于华南地区的站点,位于华中地区的站点、位于北京地区的站点以及管理这三个站点的云管理平台等等。
对于任意一个地理区域的站点而言,该站点通常为一个物理服务器集群,基于虚拟化技术,可用于部署提供数据存储服务的对象存储服务(object storage service,OBS)桶(需要说明的是,下文所涉及的OBS桶也可以理解为前述的对象存储桶)。云管理平台通常远离于多个站点(即二者之间存在一定的距离),云管理平台可对各个站点上的OBS桶进行统一管理,即云管理平台可统一管理整个云存储系统内所有站点的OBS桶,那么,当租户的客户端接入云管理平台时,云管理平台可调用地理位置离该租户的客户端较近的站点,为该租户的客户端提供OBS服务。
如图2所示(图2为本申请实施例提供的云管理平台的一个示意图),云管理平台可对外提供多种应用程序接口(application programming interface,API),例如,登录接口、上传接口、数据获取接口、调度策略配置接口等等,其中,云管理平台可通过登录接口接收租户的客户端发送的租户账号和租户密码(已在云管理平台上注册的账户和密码),并对这些信息进行身份验证,验证通过后可允许客户端登录云管理平台。云管理平台还可通过数据获取接口接收租户的客户端的数据访问请求,并基于该请求获取该请求所指示的数据,并通过数据获取接口将数据返回至租户的客户端。云管理平台还可通过数据上传接口接收租户的客户端上传的数据,并存储这部分数据。云管理平台还可通过调度策略配置接口接收租户的客户端发送的调度策略,以基于该调度策略完成数据在多个站点中的管理。
云管理平台还可包含路由模块、调度模块和网络管理模块,其中,路由模块可用于基于数据访问请求,自动路由(追踪)到数据所在的位置(例如,数据位于某个站点的某个OBS桶等等)。调度模块可用于自行生成调度策略,以基于该调度策略管理数据,如此一来,管理数据的过程在后台静默运行,不会被租户感知。网络管理模块可用于实现多个地理区域之间的网络管理和带宽利用率控制等等。
云管理平台还可管理各个站点,例如,在某个站点中创建OBS桶,用于存储租户的客户端上传的数据,又如,将数据从位于某个地理区域的站点的OBS桶拉取(迁移)至位于另一地理区域的站点的OBS桶中,再如,从某个站点的OBS桶中取出数据,并发送给租户的客户端等等。
为了进一步了解上述云存储系统的工作流程,下文将从两个方面对该工作流程进行介绍,第一方面为数据获取的过程,第二方面为数据上传和数据调度的过程。下文先对第一方面进行介绍,图3为本申请实施例提供的基于云管理平台的对象存储桶的数据访问方法的一个流程示意图,如图3所示,该方法包括:
301、云管理平台提供上传接口,上传接口用于接收第一客户端上传的第一数据,其中第 一客户端位于第一地理区域。
302、云管理平台将第一数据存储在第一对象存储桶中,并为第一数据设置第一访问域名,其中,第一对象存储桶设置在位于第一地理区域的站点中。
本实施例中,当位于第一地理区域的某个租户需要在云端存储第一数据时,云管理平台可向该租户所使用的第一客户端设备提供上传接口(例如,用户界面的数据输入栏等等),故该租户可通过第一客户端可向上传接口发送第一数据,以使得云管理平台通过上传接口接收第一客户端上传的第一数据。接收第一数据后,云管理平台可确定该租户所使用的第一客户端位于第一地理区域,故可将第一数据存储在第一地理区域的站点的第一OBS桶(即前述的第一对象存储桶)中,并为第一数据设置第一访问域名。需要说明的是,第一访问域名可用于访问第一OBS桶,以获取第一OBS桶中的第一数据。
进一步地,租户在上传第一数据时,云管理平台还可提供调度策略配置接口(例如,用户界面的调度策略输入栏),若租户未通过第一客户端向调度策略配置接口输入指定的目标站点,云管理平台可自动为第一数据分配存储第一数据的站点,即第一客户端所在的第一地理区域的站点。
例如,如图4所示(图4为本申请实施例提供的云存储系统的另一结构示意图),位于地理区域1的用户1使用某个应用时,产生了数据1(例如,用户1使用办公软件撰写了一个文档)。用户1需要将数据1上传至云存储系统进行保存,那么,云管理平台可面向用户1的客户端1(例如,用户1所使用的浏览器)提供用户界面,该用户界面中包含数据输入栏,用户1可通过客户端1在该输入栏处输入数据1,从而将数据1上传到云管理平台。在上传数据的时候,该用户界面还包含调度策略输入栏,但用户1可不通过客户端1向该输入栏输入用户1所指定的某个站点,即用户1不需要指定位于某一个地理区域的数据中心,云管理平台可自动为用户1分配位于地理区域1的站点,并将数据1存储于该站点的OBS桶1中。此外,云管理平台还可为数据1配置一个访问域名,即www.bucketname.obs11.com,该访问域名中的“OBS11”与地理区域1的站点的OBS桶1相对应。
若租户通过第一客户端向调度策略配置接口输入其指定的目标站点,云管理平台则会将第一数据存储在目标站点的对象存储桶中,从而满足租户自身指向性的数据存储需求。可以理解的是,此处的目标站点既可以是位于第一地理区域的站点,也可以是位于其余地理区域的站点,具体不做限制。
更进一步的,租户在上传的第一数据时,租户还可通过第一客户端,向上传接口输入第一数据的第一标签,第一数据的第一标签包含以下至少一项:第一数据的创建时间(例如,第一数据所属的软件产生第一数据的时间)、第一数据的文件类型(例如,第一数据为图片、视频或文本等等)、第一数据所属的应用类型(即第一数据的前缀和后缀等等,例如,第一数据所属的应用为安卓应用、IOS应用或谷歌应用等等)、第一数据的大小等等。依旧如上述例子,设数据1为用户1使用办公软件所制作的文档。那么,数据1的标识可包括:办公软件生成数据1的时间、数据1属于文档类型、办公软件为属于安卓系统的应用、用户1的大小为5M等等。
303、云管理平台接收第二客户端发送的针对第一访问域名的数据访问请求,其中第二客户端位于第二地理区域。
304、云管理平台将存储在第一对象存储桶中的第一数据拉取到第二对象存储桶中以供第二客户端访问,其中第二对象存储桶设置在位于第二地理区域的站点中。
当该租户位于第二地理区域时,若发现自身需要访问第一数据,该租户可通过第二客户端向云管理平台提供的数据获取接口(例如,用户界面的域名输入栏等等),输入针对第一访问域名的数据访问请求(即数据访问请求包含第一访问域名,或,数据访问请求基于第一访问域名生成),以使得云管理平台通过数据获取接口接收第二客户端发送的数据访问请求。那么,云管理平台可基于该数据访问请求,可确定第二客户端需要访问作第一OBS桶中的第一数据,故云管理平台可从位于第一地理区域的站点的第一OBS桶中,将第一数据拉取到位于第二地理区域的站点的第二OBS桶中(即前述的第二对象存储桶),那么,该租户后续可通过第二客户端访问第二OBS桶中的第一数据(例如,若数据访问请求指示第二客户端需实现的操作为数据读取操作,云管理平台可将第二OBS桶中存储的第一数据提供给第二客户端,以供该用户使用,又如,若数据访问请求指示第二客户端需实现的操作为数据写入操作,云管理平台可向第二客户端开放权限或接口,以使得该租户通过第二客户端对第二OBS桶中存储的第一数据进行修改等等)。
例如,如图5所示(图5为本申请实施例提供的云存储系统的另一结构示意图,图5是在图4的基础上进行绘制得到的),当位于地理区域2的用户1需要访问数据1时,可通过客户端2(例如,用户1所使用的云存储软件)向云管理平台发送数据访问请求,该请求包含www.bucketname.obs11.com这一访问域名。那么,云管理平台可从位于地理区域1的站点的OBS桶1中,将数据1拉取到位于地理区域2的站点的OBS桶2中进行存储。由于数据访问请求指示客户端2所实现的操作为数据读取操作,故云管理平台可将OBS桶2中的数据1提供给客户端2,以供用户1使用。
值得注意的,第一客户端和第二客户端是同一租户(例如,某一个人用户或某一企业中位于不同地理位置的多个用户)所使用的不同客户端,那么,该租户在分别使用第一客户端和第二客户端登录云管理平台时,使用的是相同的帐号或者相互关联的帐号(例如,母帐号和子帐号等等),且这些帐号均已在云管理平台中实现了注册,是可用的帐号。
此外,在图3的基础上,云管理平台既可以按照自身的调度策略来实现数据管理,也可以按照租户的调度策略来实现数据管理,下文将分别进行介绍:
第一种情况,云管理平台按照自身的调度策略来实现对数据的管理:
(1)在完成前述步骤302后,设位于第一地理区域的该租户还有存储第二数据的需求,该租户可通过第一客户端,向云管理平台提供的上传接口输入第二数据和第二数据的第二标签,其中,第一数据的第一标签和第二数据第二标签相同,说明第一数据和第二数据是同种类型的数据。关于该租户通过第一客户端上传第二数据和第二数据的第二标签的介绍,可参考前述该租户通过第一客户端上传第一数据和第一数据的第一标签的相关说明部分,此处不再赘述。应理解,该租户上传第一数据和第一标签,以及上传第二数据和第二标签也可以是同时进行的。
那么,云管理平台接收到第一客户端发送的第二数据后,将第二数据存储在第一地理区域的站点的第三OBS桶(即前述的第三对象存储桶)中,并为第二数据设置第二访问域名。需要说明的是,第二访问域名可用于访问第三OBS桶,以获取第三OBS桶中的第二数据。
在完成前述步骤304后,由于第一数据和第二数据是同种类型的数据,云管理平台还可将第二数据从第一地理区域的站点的第三OBS桶中,拉取到第二地理区域的站点的第四OBS桶中(即前述的第四对象存储桶)。如此一来,可完成第一地理区域的站点和第二地理区域的站点之间有关于同种类型的数据的同步,使得第二地理区域的站点中提前存储有该租户上传的第二数据,若该租户在第二地理区域时,还需要访问第二数据,则可以满足该租户的需求。
例如,如图6所示(图6为本申请实施例提供的云存储系统的另一结构示意图,图6是在图5的基础上进行绘制得到的),云管理平台将位于地理区域2的站点的OBS桶2中的数据1提供给客户端2后,由于位于地理区域1的站点的OBS桶3已存储有用户1上传的数据2,且数据1和数据2的标签是相同(即数据1和数据2是相同类型的数据),那么,云管理平台可从位于地理区域1的站点的OBS桶3中,将数据2拉取到位于地理区域2的站点的OBS桶4中进行存储,若用户1还有使用数据2的需求,云管理平台可快速地将OBS桶4中的数据2直接提供给客户端2,以供用户1使用。
(2)在完成前述步骤304后,由于位于第一地理区域的站点和位于第二地理区域的站点为边缘站点,其存储数据的性质为用完即删,那么,由于第一数据已被使用,故云管理平台可从第一地理区域的站点中的第一OBS桶中,将第一数据拉取到位于第三地理区域的站点的第五OBS桶(即前述的第五对象存储桶),位于第三地理区域的站点为中心站点,其存储数据的性质为持续性存储。此后,云管理平台再删除第一地理区域的站点的第一OBS桶中存储的第一数据和位于第二地理区域的站点的第二OBS桶中存储的第一数据。
依旧如图5所示的例子,设地理区域1的站点为深圳的站点,地理区域2的站点为广州的站点,均为边缘站点,而地理区域3的站点为华南地区的站点,为中心站点。云管理平台将位于地理区域2的站点的OBS桶2中的数据1提供给客户端2后,云管理平台可将数据1拉取待位于地理区域3的站点的OBS桶5中进行存储,并将位于地理区域1的站点的OBS桶1中的数据1和位于地理区域2的站点的OBS桶2中的数据1删除。
第二种情况,云管理平台按照租户的调度策略来实现对数据的管理:
在完成前述步骤302后,设位于第一地理区域的该租户还有针对第一数据的调度需求,该租户可通过第一客户端,向云管理平台提供的调度策略配置接口输入针对第一数据的调度策略,以使得云管理平台通过调度策略配置接口接收该调度策略。应理解,该租户输入调度策略,也可以与该租户上传第一数据和第一标签同时发生。
进一步地,该调度策略可包含标签关联策略,标签关联策略记录有第一数据的第一标签。因此,云管理平台在解析接收到的该调度策略后,可获取第一标签,从而确定需要将与第一数据为相同类型的其余数据关联起来。那么,云管理平台可在除第一地理区域之外的其他区域中,确定有哪些地理区域的站点的OBS桶中所存储的数据的标签与第一标签相同,并将这些数据拉取到第一地理区域的站点中处第一OBS桶之外的其余OBS桶中进行存储,并为这些数据设置访问域名。
例如,如图7所示(图7为本申请实施例提供的云存储系统的另一结构示意图,图7是在图4的基础上进行绘制得到的),当云管理平台确定来自客户端1的调度策略包含数据1的标签时,云管理平台先确定位于地理区域4的站点的OBS桶6中的数据3和位于地理区域5的站点的OBS桶7中的数据4,这两个数据的标签与数据1的标签相同,故云管理平台可将 从位于地理区域4的站点的OBS桶6中,将数据3拉取到位于地理区域1的站点的OBS桶8中进行存储,并从位于地理区域5的站点的OBS桶7中,将数据4拉取到位于地理区域1的站点的OBS桶9中进行存储。
更进一步地,该调度策略还包括时间策略,时间策略记录有调度时间。因此,云管理平台可在除第一地理区域之外的其他区域中,确定有哪些地理区域的站点的OBS桶中所存储的数据的标签与第一标签相同,并在该调度时间将这些数据拉取到第一地理区域的站点中处第一OBS桶之外的其余OBS桶中进行存储,并为这些数据设置访问域名。
本申请实施例中,云管理平台通过上传接口接收位于第一地理区域的第一客户端上传的第一数据后,云管理平台可将第一数据存储在位于第一地理区域的站点的第一对象存储桶中,并为第一数据设置第一访问域名。当云管理平台接收位于第二地理区域的第二客户端发送的针对第一访问域名的数据访问请求时,云管理平台将存储在第一对象存储桶中的第一数据拉取到位于第二地理区域的站点的第二对象存储桶中以供第二客户端访问。前述过程中,位于第一地理区域的租户通过第一客户端向云管理平台上传第一数据后,云管理平台可将第一数据存储于第一地理区域的站点中的第一对象存储桶中,并为第一数据配置第一访问域名。当位于第二地理区域的该租户需要访问第一数据时,仅需向云管理平台发送针对第一访问域名的数据访问请求,云管理平台即可将第一数据,从第一对象存储桶拉取到第二地理区域的站点中的第二对象存储桶中,以供该租户通过第二客户端来实现访问。可见,在接收到租户(通过客户端发送)的数据获取请求后,云管理平台可自动发起迁移任务,实现数据在不同地理区域的站点之间的迁移,以供租户访问。由于云管理平台迁移数据的过程对于租户(的客户端)而言是无感知的,故云管理平台可代替租户实现数据的自动管理,从而减少租户的操作量,提高用户体验。
进一步地,云管理平台可基于自身的调度策略或租户的调度策略,来实现数据的管理,增加数据部署的灵活性,有利于改善用户体验。
以上是对本申请实施例提供的基于云管理平台的对象存储桶的数据访问方法所进行的详细介绍,以下将对本申请实施例提供的云管理平台进行介绍。图8为本申请实施例提供的云管理平台的一个结构示意图,如图8所示,云管理平台包括:
第一提供模块801,用于提供上传接口,上传接口用于接收第一客户端上传的第一数据,其中第一客户端位于第一地理区域;例如第一提供模块801,可用于实现图3所示实施例中的步骤301。
第一存储模块802,用于将第一数据存储在第一对象存储桶中,并为第一数据设置第一访问域名,其中第一对象存储桶设置在位于第一地理区域的站点中;第一存储模块802,可用于实现图3所示实施例中的步骤302。
接收模块803,用于接收第二客户端发送的针对第一访问域名的数据访问请求,其中第二客户端位于第二地理区域;接收模块803,可用于实现图3所示实施例中的步骤303。
第一拉取模块804,用于将存储在第一对象存储桶中的第一数据拉取到第二对象存储桶中以供第二客户端访问,其中第二对象存储桶设置在位于第二地理区域的站点中。第一拉取模块804,可用于实现图3所示实施例中的步骤304。
本申请实施例中,云管理平台通过上传接口接收位于第一地理区域的第一客户端上传的 第一数据后,云管理平台可将第一数据存储在位于第一地理区域的站点的第一对象存储桶中,并为第一数据设置第一访问域名。当云管理平台接收位于第二地理区域的第二客户端发送的针对第一访问域名的数据访问请求时,云管理平台将存储在第一对象存储桶中的第一数据拉取到位于第二地理区域的站点的第二对象存储桶中以供第二客户端访问。前述过程中,位于第一地理区域的租户通过第一客户端向云管理平台上传第一数据后,云管理平台可将第一数据存储于第一地理区域的站点中的第一对象存储桶中,并为第一数据配置第一访问域名。当位于第二地理区域的该租户需要访问第一数据时,仅需向云管理平台发送针对第一访问域名的数据访问请求,云管理平台即可将第一数据,从第一对象存储桶拉取到第二地理区域的站点中的第二对象存储桶中,以供该租户通过第二客户端来实现访问。可见,在接收到租户(通过客户端发送)的数据获取请求后,云管理平台可自动发起迁移任务,实现数据在不同地理区域的站点之间的迁移,以供租户访问。由于云管理平台迁移数据的过程对于租户(的客户端)而言是无感知的,故云管理平台可代替租户实现数据的自动管理,从而减少租户的操作量,提高用户体验。
在一种可能的实现方式中,上传接口还用于接收第一客户端上传的第二数据,以及第一客户端输入的第一数据的第一标签和第二数据的第二标签,其中第一标签和第二标签相同,云管理平台还包括:第二存储模块,用于将第二数据存储在第三对象存储桶中,并为第二数据设置第二访问域名,其中第三对象存储桶设置在位于第一地理区域的站点中;第二拉取模块,用于将与第一标签相同的第二标签对应的第二数据从第三对象存储桶中的拉取到第四对象存储桶中,其中第四对象存储桶设置在位于第二地理区域的站点中。
在一种可能的实现方式中,云管理平台还包括:第三拉取模块,用于将第一地理区域的站点中的第一对象存储桶中存储的第一数据拉取到第五对象存储桶中,其中第五对象存储桶设置在位于第三地理区域的站点中;删除模块,用于删除第一对象存储桶中存储的第一数据和第二对象存储桶中存储的第一数据,其中,位于第三地理区域的站点为中心站点,位于第一地理区域的站点和位于第二地理区域的站点为边缘站点。
在一种可能的实现方式中,云管理平台还包括:第二提供模块,用于提供调度策略配置接口,调度策略配置接口用于获取第一客户端发送的针对第一数据的调度策略。
在一种可能的实现方式中,调度策略包括标签关联策略,标签关联策略记录有第一数据的第一标签,云管理平台还包括:第四拉取模块,用于根据标签关联策略将与第一地理区域的站点不同的其他地理区域的站点的对象存储桶中存储的设置有与第一标签相同的标签的数据拉取到第一地理区域的站点的对象存储桶中。
在一种可能的实现方式中,第一标签用于指示第一数据的文件类型、创建时间、前缀、后缀、大小中的一者或任意组合。
在一种可能的实现方式中,调度策略还包括时间策略,时间策略记录有调度时间,云管理平台还包括:第五拉取模块,用于根据时间策略在调度时间将与第一地理区域的站点不同的其他地理区域的站点的对象存储桶中存储的设置有与第一标签相同的标签的数据拉取到第一地理区域的站点的对象存储桶中。
在一种可能的实现方式中,调度策略还用于指定第一数据的目标站点,云管理平台还包括:第三存储模块,用于将第一数据存储到所目标站点的对象存储桶中。
在一种可能的实现方式中,第一客户端和第二客户端分别使用相同的账号登录云管理平台,第一客户端和第二客户端分别使用相互关联的账号登录云管理平台,其中相同的账号或相互关联的账号在云管理平台中注册。
需要说明的是,上述装置各模块/单元之间的信息交互、实现过程等内容,由于与本申请方法实施例基于同一构思,其带来的技术效果与本申请方法实施例相同,具体内容可参考本申请实施例前述所示的方法实施例中的叙述,此处不再赘述。
图9为本申请实施例提供的云管理平台的另一结构示意图。如图9所示,云管理平台的一个实施例可以包括一个或一个以上中央处理器901,存储器902,输入输出接口903,有线或无线网络接口904,电源905。
存储器902可以是短暂存储或持久存储。更进一步地,中央处理器901可以配置为与存储器902通信,在云管理平台上执行存储器902中的一系列指令操作。
本实施例中,中央处理器901可以执行前述图3所示实施例的方法步骤,具体此处不再赘述。
本实施例中,中央处理器901中的具体功能模块划分可以与前述图8中所描述的第一提供模块、第二提供模块、第一存储模块、第二存储模块、第三存储模块、接收模块、第一拉取模块、第二拉取模块、第三拉取模块、第四拉取模块、第五拉取模块以及删除模块等模块的划分方式类似,此处不再赘述。
本申请实施例还涉及一种计算机存储介质,包括计算机可读指令,当所述计算机可读指令被执行时,实现如图3所示实施例的方法步骤。
本申请实施例还涉及一种包含指令的计算机程序产品,当其在计算机上运行时,使得计算机执行如图3所示实施例的方法步骤。
所属领域的技术人员可以清楚地了解到,为描述的方便和简洁,上述描述的系统,装置和单元的具体工作过程,可以参考前述方法实施例中的对应过程,在此不再赘述。
在本申请所提供的几个实施例中,应该理解到,所揭露的系统,装置和方法,可以通过其它的方式实现。例如,以上所描述的装置实施例仅仅是示意性的,例如,所述单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个系统,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口,装置或单元的间接耦合或通信连接,可以是电性,机械或其它的形式。
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。
另外,在本申请各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现,也可以采用软件功能单元的形式实现。
所述集成的单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时,可以存储在一个计算机可读取存储介质中。基于这样的理解,本申请的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的全部或部分可以以软件产品的形式体现出来,该 计算机软件产品存储在一个存储介质中,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)执行本申请各个实施例所述方法的全部或部分步骤。而前述的存储介质包括:U盘、移动硬盘、只读存储器(read-only memory,ROM)、随机存取存储器(random access memory,RAM)、磁碟或者光盘等各种可以存储程序代码的介质。

Claims (21)

  1. 一种基于云管理平台的对象存储桶的数据访问方法,其特征在于,所述方法包括:
    所述云管理平台提供上传接口,所述上传接口用于接收第一客户端上传的第一数据,其中所述第一客户端位于第一地理区域;
    所述云管理平台将所述第一数据存储在第一对象存储桶中,并为所述第一数据设置第一访问域名,其中所述第一对象存储桶设置在位于所述第一地理区域的站点中;
    所述云管理平台接收第二客户端发送的针对所述第一访问域名的数据访问请求,其中所述第二客户端位于第二地理区域;
    所述云管理平台将存储在第一对象存储桶中的所述第一数据拉取到第二对象存储桶中以供所述第二客户端访问,其中所述第二对象存储桶设置在位于所述第二地理区域的站点中。
  2. 根据权利要求1所述的方法,其特征在于,所述上传接口还用于接收第一客户端上传的第二数据,以及所述第一客户端输入的所述第一数据的第一标签和所述第二数据的第二标签,其中所述第一标签和所述第二标签相同,所述方法还包括:
    所述云管理平台将所述第二数据存储在第三对象存储桶中,并为所述第二数据设置第二访问域名,其中所述第三对象存储桶设置在位于所述第一地理区域的站点中;
    所述云管理平台将与所述第一标签相同的第二标签对应的所述第二数据从所述第三对象存储桶中的拉取到第四对象存储桶中,其中所述第四对象存储桶设置在位于所述第二地理区域的站点中。
  3. 根据权利要求1或2所述的方法,其特征在于,所述方法还包括:
    所述云管理平台将所述第一地理区域的站点中的所述第一对象存储桶中存储的所述第一数据拉取到第五对象存储桶中,其中所述第五对象存储桶设置在位于所述第三地理区域的站点中;
    所述云管理平台删除第一对象存储桶中存储的所述第一数据和所述第二对象存储桶中存储的所述第一数据,其中,位于所述第三地理区域的站点为中心站点,位于所述第一地理区域的站点和位于所述第二地理区域的站点为边缘站点。
  4. 根据权利要求1所述的方法,其特征在于,所述方法还包括:
    所述云管理平台提供调度策略配置接口,所述调度策略配置接口用于获取所述第一客户端发送的针对所述第一数据的调度策略。
  5. 根据权利要求4所述的方法,其特征在于,所述调度策略包括标签关联策略,所述标签关联策略记录有所述第一数据的第一标签,所述方法还包括:
    所述云管理平台根据所述标签关联策略将与所述第一地理区域的站点不同的其他地理区域的站点的对象存储桶中存储的设置有与所述第一标签相同的标签的数据拉取到所述第一地理区域的站点的对象存储桶中。
  6. 根据权利要求5所述的方法,其特征在于,所述第一标签用于指示所述第一数据的文件类型、创建时间、前缀、后缀、大小中的一者或任意组合。
  7. 根据权利要求5或6所述的方法,其特征在于,所述调度策略还包括时间策略,所述时间策略记录有调度时间,所述方法还包括:
    所述云管理平台根据所述时间策略在所述调度时间将与所述第一地理区域的站点不同的 其他地理区域的站点的对象存储桶中存储的设置有与所述第一标签相同的标签的数据拉取到所述第一地理区域的站点的对象存储桶中。
  8. 根据权利要求4至7任一项所述的方法,其特征在于,所述调度策略还用于指定所述第一数据的目标站点,所述方法还包括:
    所述云管理平台将所述第一数据存储到所目标站点的对象存储桶中。
  9. 根据权利要求1至8任一项所述的方法,其特征在于,所述第一客户端和所述第二客户端分别使用相同的账号登录所述云管理平台,所述第一客户端和所述第二客户端分别使用相互关联的账号登录所述云管理平台,其中所述相同的账号或相互关联的账号在所述云管理平台中注册。
  10. 一种云管理平台,其特征在于,所述云管理平台包括:
    第一提供模块,用于提供上传接口,所述上传接口用于接收第一客户端上传的第一数据,其中所述第一客户端位于第一地理区域;
    第一存储模块,用于将所述第一数据存储在第一对象存储桶中,并为所述第一数据设置第一访问域名,其中所述第一对象存储桶设置在位于所述第一地理区域的站点中;
    接收模块,用于接收第二客户端发送的针对所述第一访问域名的数据访问请求,其中所述第二客户端位于第二地理区域;
    第一拉取模块,用于将存储在第一对象存储桶中的所述第一数据拉取到第二对象存储桶中以供所述第二客户端访问,其中所述第二对象存储桶设置在位于所述第二地理区域的站点中。
  11. 根据权利要求10所述的云管理平台,其特征在于,所述上传接口还用于接收第一客户端上传的第二数据,以及所述第一客户端输入的所述第一数据的第一标签和所述第二数据的第二标签,其中所述第一标签和所述第二标签相同,所述云管理平台还包括:
    第二存储模块,用于将所述第二数据存储在第三对象存储桶中,并为所述第二数据设置第二访问域名,其中所述第三对象存储桶设置在位于所述第一地理区域的站点中;
    第二拉取模块,用于将与所述第一标签相同的第二标签对应的所述第二数据从所述第三对象存储桶中的拉取到第四对象存储桶中,其中所述第四对象存储桶设置在位于所述第二地理区域的站点中。
  12. 根据权利要求10或11所述的云管理平台,其特征在于,所述云管理平台还包括:
    第三拉取模块,用于将所述第一地理区域的站点中的所述第一对象存储桶中存储的所述第一数据拉取到第五对象存储桶中,其中所述第五对象存储桶设置在位于所述第三地理区域的站点中;
    删除模块,用于删除第一对象存储桶中存储的所述第一数据和所述第二对象存储桶中存储的所述第一数据,其中,位于所述第三地理区域的站点为中心站点,位于所述第一地理区域的站点和位于所述第二地理区域的站点为边缘站点。
  13. 根据权利要求10所述的云管理平台,其特征在于,所述云管理平台还包括:
    第二提供模块,用于提供调度策略配置接口,所述调度策略配置接口用于获取所述第一客户端发送的针对所述第一数据的调度策略。
  14. 根据权利要求13所述的云管理平台,其特征在于,所述调度策略包括标签关联策略, 所述标签关联策略记录有所述第一数据的第一标签,所述云管理平台还包括:
    第四拉取模块,用于根据所述标签关联策略将与所述第一地理区域的站点不同的其他地理区域的站点的对象存储桶中存储的设置有与所述第一标签相同的标签的数据拉取到所述第一地理区域的站点的对象存储桶中。
  15. 根据权利要求14所述的云管理平台,其特征在于,所述第一标签用于指示所述第一数据的文件类型、创建时间、前缀、后缀、大小中的一者或任意组合。
  16. 根据权利要求14或15所述的云管理平台,其特征在于,所述调度策略还包括时间策略,所述时间策略记录有调度时间,所述云管理平台还包括:
    第五拉取模块,用于根据所述时间策略在所述调度时间将与所述第一地理区域的站点不同的其他地理区域的站点的对象存储桶中存储的设置有与所述第一标签相同的标签的数据拉取到所述第一地理区域的站点的对象存储桶中。
  17. 根据权利要求13至16任一项所述的云管理平台,其特征在于,所述调度策略还用于指定所述第一数据的目标站点,所述云管理平台还包括:
    第三存储模块,用于将所述第一数据存储到所目标站点的对象存储桶中。
  18. 根据权利要求10至17任一项所述的云管理平台,其特征在于,所述第一客户端和所述第二客户端分别使用相同的账号登录所述云管理平台,所述第一客户端和所述第二客户端分别使用相互关联的账号登录所述云管理平台,其中所述相同的账号或相互关联的账号在所述云管理平台中注册。
  19. 一种云管理平台,其特征在于,所述云管理平台包括存储器和处理器;
    所述存储器存储有代码,所述处理器被配置为执行所述代码,当所述代码被执行时,所述云管理平台执行如权利要求1至9任一项所述的方法。
  20. 一种计算机存储介质,其特征在于,所述计算机存储介质存储有计算机程序,该程序由计算机执行时,使得所述计算机实施权利要求1至9任一项所述的方法。
  21. 一种计算机程序产品,其特征在于,所述计算机程序产品存储有指令,所述指令在由计算机执行时,使得所述计算机实施权利要求1至9任一项所述的方法。
PCT/CN2022/139470 2021-12-16 2022-12-16 一种对象存储桶的数据访问方法以及云管理平台 WO2023109934A1 (zh)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
CN202111540737.9 2021-12-16
CN202111540737 2021-12-16
CN202210334998.3A CN116266839A (zh) 2021-12-16 2022-03-31 一种对象存储桶的数据访问方法以及云管理平台
CN202210334998.3 2022-03-31

Publications (1)

Publication Number Publication Date
WO2023109934A1 true WO2023109934A1 (zh) 2023-06-22

Family

ID=86744088

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/139470 WO2023109934A1 (zh) 2021-12-16 2022-12-16 一种对象存储桶的数据访问方法以及云管理平台

Country Status (2)

Country Link
CN (1) CN116266839A (zh)
WO (1) WO2023109934A1 (zh)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116627680B (zh) * 2023-07-20 2023-10-03 河北神玥软件科技股份有限公司 一种基于多源数据融合的云管理平台及方法

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017166481A1 (zh) * 2016-03-28 2017-10-05 乐视控股(北京)有限公司 进行跨区域的文件分享的方法及系统
CN109117650A (zh) * 2018-07-25 2019-01-01 华为技术有限公司 一种企业云的创建方法和管理平台
CN109189324A (zh) * 2018-07-09 2019-01-11 华为技术有限公司 一种数据迁移方法及装置
US20200326876A1 (en) * 2017-12-28 2020-10-15 Huawei Technologies Co., Ltd. Object Migration Method, Device, and System
CN111953811A (zh) * 2020-08-07 2020-11-17 腾讯科技(深圳)有限公司 站点访问方法、站点注册方法、装置、设备及存储介质
CN113626522A (zh) * 2021-08-02 2021-11-09 Oppo广东移动通信有限公司 数据同步方法、装置、介质及设备

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017166481A1 (zh) * 2016-03-28 2017-10-05 乐视控股(北京)有限公司 进行跨区域的文件分享的方法及系统
US20200326876A1 (en) * 2017-12-28 2020-10-15 Huawei Technologies Co., Ltd. Object Migration Method, Device, and System
CN109189324A (zh) * 2018-07-09 2019-01-11 华为技术有限公司 一种数据迁移方法及装置
CN109117650A (zh) * 2018-07-25 2019-01-01 华为技术有限公司 一种企业云的创建方法和管理平台
CN111953811A (zh) * 2020-08-07 2020-11-17 腾讯科技(深圳)有限公司 站点访问方法、站点注册方法、装置、设备及存储介质
CN113626522A (zh) * 2021-08-02 2021-11-09 Oppo广东移动通信有限公司 数据同步方法、装置、介质及设备

Also Published As

Publication number Publication date
CN116266839A (zh) 2023-06-20

Similar Documents

Publication Publication Date Title
US20220283992A1 (en) Prioritizing content item synchronization based on sharing
JP6186015B2 (ja) コンテンツアイテムの共有
KR101634409B1 (ko) 데이터 센터들에 걸친 리소스 위치 확인 및 마이그레이션 기법
US20210216210A1 (en) Optimized migration of data between file systems of a storage array
US20170302737A1 (en) Migrating shared content items between accounts
CN103020223B (zh) 文件共享处理方法、装置和系统
WO2018119601A1 (zh) 数据转换方法及备份服务器
JP2016518653A (ja) 同期したオンラインコンテンツ管理システムのためのローカルサーバ
CN111698675B (zh) 数据处理方法、装置及计算机可读存储介质
WO2023109934A1 (zh) 一种对象存储桶的数据访问方法以及云管理平台
KR101563292B1 (ko) 가상 세션 관리자를 이용한 클라우드 가상화 시스템 및 방법
CN106790027B (zh) Hdfs文件系统的多租户网盘权限管理方法及系统
CN110347656B (zh) 文件存储系统中请求的管理方法和装置
US11809381B2 (en) Accessing network based content items by a mobile device while offline
CN114979114B (zh) 云应用处理方法和系统
WO2021232860A1 (zh) 通信方法、装置及系统
KR102202645B1 (ko) 관계형 엣지 서버들 간 데이터 공조 방법
CN115706727A (zh) 云桌面数据的迁移方法、节点和服务器
US10713121B1 (en) Dynamic migration of a cloud based distributed file system metadata server
RU2656739C1 (ru) Способ и система хранения данных
US20200019646A1 (en) Cloud storage aggregator system and method
CN109347896A (zh) 一种信息处理方法、设备和计算机可读存储介质
WO2023246442A1 (zh) 基于个性化漫游数据的池化桌面启动方法和云桌面系统
WO2023041047A1 (zh) 一种基于云技术的文件服务提供方法及相关设备
WO2023040504A1 (zh) 数据处理系统、数据处理方法及相关装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22906679

Country of ref document: EP

Kind code of ref document: A1