CN111858497A - A storage type conversion method, device and device - Google Patents

Abstract

Embodiments of the present invention provide a storage type conversion method, apparatus, and device. The method includes: determining each candidate object to be processed in the target server; from each candidate object, determining a target object that satisfies a predetermined conversion condition; the conversion condition is a condition on which to determine whether any object can be converted into a storage type, And the conversion condition includes at least that the number of visits in the specified period meets the predetermined number of times; by calling the conversion interface, according to the conversion type corresponding to the conversion condition, the storage type of the target object in the target server is converted; the conversion type satisfies the conversion condition The storage type to which the object needs to be converted, and the conversion interface is the interface used to convert the storage type of the object stored in the target server. Through this solution, the object storage type in the object storage used by the enterprise user can be quickly and effectively converted according to the data hot and cold standard set by the enterprise user.

Description

A storage type conversion method, device and device

technical field

The present invention relates to the technical field of object storage, and in particular, to a storage type conversion method, device and device.

Background technique

IaaS infrastructure and services are a service model provided by cloud computing service providers, which mainly include CPU, memory, storage, network, virtualization software, distributed systems, etc., so that enterprise users do not need to worry about the supply of basic resources and only focus on deployment You can use your own business application software. Among them, object storage is a common storage method under the IaaS service model. Specifically, different storage methods can be used for data with different degrees of cold and heat. For example, hot data corresponds to standard storage, warm data corresponds to low-frequency storage, and cold data corresponds to archive storage.

In specific applications, enterprise users have the need to convert the object storage type according to the data hot and cold standards set by themselves.

It can be seen that it is an urgent problem to provide a storage type conversion solution to quickly and effectively convert the object storage type in the object storage used by the enterprise user according to the data hot and cold standard set by the enterprise user.

SUMMARY OF THE INVENTION

The purpose of the embodiments of the present invention is to provide a storage type conversion method, device and equipment, so as to realize the purpose of quickly and effectively converting the object storage type in the object storage used by the enterprise user according to the data hot and cold standard set by the enterprise user . The specific technical solutions are as follows:

In a first aspect, an embodiment of the present invention provides a storage type conversion method, including:

Determine each candidate object to be processed in the target server; the target server is a cloud server for storing objects;

From each candidate object, determine a target object that satisfies a predetermined conversion condition; wherein, the conversion condition is a condition on which to determine whether any object can be converted into a storage type, and the conversion condition at least includes The number of visits meets the predetermined number of conditions;

Convert the storage type of the target object in the target server according to the conversion type corresponding to the conversion condition by invoking the conversion interface;

The conversion type is the storage type to which the object satisfying the conversion condition needs to be converted, and the conversion interface is an interface for performing storage type conversion on the object stored in the target server.

Optionally, the determining each candidate object to be processed in the target server includes:

From the objects stored in the target server, determine the objects that meet the predetermined pre-screening conditions, and obtain each candidate object to be processed;

The pre-screening condition includes: the parameter value of the target parameter of the object conforms to the specified parameter condition;

Wherein, the target parameter includes at least one parameter among the object name, the last modification time, the size of the data amount, the operation type of the access operation that occurs, and the storage type.

Optionally, after determining a target object that satisfies a predetermined conversion condition from each candidate object, the conversion interface is called, according to the conversion type corresponding to the conversion condition, to all the target servers in the target server. Before converting the storage type of the target object, it also includes:

judging whether the target object satisfies a predetermined type locking condition;

When the judgment result is no, the step of converting the storage type of the target object in the target server according to the conversion type corresponding to the conversion condition by invoking the conversion interface is performed.

Optionally, the number of the conversion conditions is at least one; each conversion condition is set with a priority;

The converting the storage type of the target object in the target server according to the conversion type corresponding to the conversion condition by calling the conversion interface, including:

If the target object satisfies at least two conversion conditions, convert the storage type of the target object in the target server according to the conversion type corresponding to the target conversion condition by calling the conversion interface; the target conversion condition is the target The corresponding conversion condition satisfied by the object;

If the target object only satisfies one conversion condition, by calling the conversion interface, the storage type of the target object in the target server is converted according to the conversion type corresponding to the conversion condition satisfied by the target object.

Optionally, the target conversion condition is the highest priority conversion condition satisfied by the target object;

The converting the storage type of the target object in the target server according to the conversion type corresponding to the target conversion condition by calling the conversion interface, including:

If the number of target conversion conditions is multiple, the preset priority relationship about each storage type is used to determine the target conversion type with the highest corresponding priority from the conversion types corresponding to each target conversion condition, and the target server The storage type of the target object in is converted to the target conversion type;

If the number of target conversion conditions is one, by invoking the conversion interface, the storage type of the target object in the target server is converted by using the conversion type corresponding to the target conversion condition.

Optionally, the priority relationship of each storage type includes: the priority of low-frequency storage is lower than that of standard storage, and the priority of low-frequency storage is greater than the priority of archive storage.

In a second aspect, an embodiment of the present invention provides a storage type conversion device, including:

an object determination module for determining each candidate object to be processed in the target server; the target server is a cloud server for storing objects;

A screening module, configured to determine a target object that satisfies a predetermined conversion condition from each candidate object; wherein, the conversion condition is a condition on which to determine whether any object can be converted into a storage type, and the conversion condition at least includes The number of visits within the specified period meets the predetermined number of conditions;

a conversion module, configured to convert the storage type of the target object in the target server according to the conversion type corresponding to the conversion condition by invoking the conversion interface;

The conversion type is the storage type to which the object satisfying the conversion condition needs to be converted, and the conversion interface is an interface for performing storage type conversion on the object stored in the target server.

In a third aspect, an embodiment of the present invention provides a storage type conversion system, including:

A rule management device for managing a predetermined conversion condition for object storage type conversion and a conversion type corresponding to the conversion condition; wherein, the conversion condition is a condition on which to determine whether any object can be converted into a storage type, and The conversion condition at least includes that the number of visits within the specified period meets the predetermined number of times condition; the conversion type is the storage type to which the object satisfying the conversion condition needs to be converted;

An intelligent computing device is used to determine each candidate object to be processed in the target server; from each candidate object, determine the target object that satisfies the conversion condition managed by the rule management device; the target server is a user Cloud servers for storing objects;

an operation execution device, configured to convert the storage type of the target object in the target server according to the conversion type managed by the rule management device and corresponding to the conversion condition by invoking a conversion interface; The conversion interface is an interface for performing storage type conversion on objects stored in the target server.

In a fourth aspect, an embodiment of the present invention provides an electronic device, including a processor, a communication interface, a memory, and a communication bus, wherein the processor, the communication interface, and the memory communicate with each other through the communication bus;

memory for storing computer programs;

The processor is configured to implement the steps of the storage type conversion method provided by the embodiment of the present invention when executing the program stored in the memory.

In a fifth aspect, an embodiment of the present invention provides a computer-readable storage medium, where a computer program is stored in the computer-readable storage medium, and when the computer program is executed by a processor, the storage type provided by the embodiment of the present invention is implemented The steps to convert the method.

Beneficial effects of the embodiment of the present invention:

In the solution provided by the embodiment of the present invention, the conversion condition related to the data hot and cold standard set by the enterprise user is used to determine the target object of the type to be converted from the candidate objects, and by calling the object used by the enterprise user The storage-related conversion interface, that is, the conversion interface corresponding to the target server, performs storage type conversion on the target object according to the conversion type corresponding to the conversion condition. It can be seen that through this solution, the object storage type in the object storage used by the enterprise user can be quickly and effectively converted according to the data hot and cold standard set by the enterprise user.

Of course, it is not necessary for any product or method of the present invention to achieve all of the advantages described above at the same time.

Description of drawings

In order to explain the embodiments of the present invention or the technical solutions in the prior art more clearly, the following briefly introduces the accompanying drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only These are some embodiments of the present invention. For those of ordinary skill in the art, other drawings can also be obtained according to these drawings without creative efforts.

1 is a flowchart of a storage type conversion method provided by an embodiment of the present invention;

2 is another flowchart of a storage type conversion method provided by an embodiment of the present invention;

3 is another flowchart of a storage type conversion method provided by an embodiment of the present invention;

4 is a schematic diagram of the interaction between a storage type conversion device and a log storage system and a target server;

5 is a schematic structural diagram of a storage type conversion device provided by an embodiment of the present invention;

6 is a schematic structural diagram of a storage type conversion system provided by an embodiment of the present invention;

7 is a working principle diagram of a storage type conversion system provided by an embodiment of the present invention;

FIG. 8 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.

Detailed ways

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, but not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

In order to realize the purpose of quickly and effectively converting the object storage type in the object storage used by the enterprise user according to the data hot and cold standard set by the enterprise user, the embodiments of the present invention provide a storage type conversion method, device and device.

First, an embodiment of the present invention provides a storage type conversion method for introduction below.

Wherein, a storage type conversion method provided by an embodiment of the present invention is applied to an electronic device. Specifically, the execution body of the storage type conversion method may be a storage type conversion apparatus running in an electronic device. In a specific application, the storage type conversion device can run in any device other than the target server that establishes a communication connection with the target server, wherein the target server is a storage server of the storage type to be converted and storing objects; Of course, the storage type conversion device can also run in the target server. Exemplarily, in the scenario where the user client accesses the target server through the application server, the storage type conversion device may run in the application server; or, in the scenario where the user client directly accesses the target server, the storage type conversion device It can run in a client device, which is a terminal device running a user client, and so on.

It should be noted that the target server is a cloud server for storing objects. Moreover, the target server can be an object storage server provided by any third-party cloud vendor. That is to say, after the enterprise user uses the object storage server provided by any third-party cloud vendor for object storage, the storage type conversion device provided by the embodiment of the present invention can be applied to realize the storage type conversion.

And, in order to perform storage type conversion on the object in the target server by the storage type conversion device, the storage type conversion device can be pre-configured with a conversion interface, and the conversion interface is used for the storage type conversion of the object stored in the target server. That is, the conversion interface is a conversion interface related to the object storage used by the enterprise user. It can be understood that, for different target servers, the conversion interface may be different. In a specific application, various interfaces including the conversion interface may exist in the SDK (simple develop key) provided by the cloud vendor to which the target server belongs. Therefore, it can be set in the storage type conversion device. The SDK, so as to achieve the purpose of pre-configuring the conversion interface, is of course not limited to this. It can be understood that, by setting the SDK, the storage type conversion apparatus can implement modification and download of objects in the target server.

In addition, the objects involved in the embodiments of the present invention are usually unstructured data, such as pictures, videos, or documents. An object has metadata and an object id. Specifically, the metadata of the object can also be called the parameters of the object, which refers to the relevant description of the object, such as: the size of the picture, the owner of the document, etc.; the object id is a global The unique identifier used to distinguish objects. It can be understood by those in the art that object storage may include multiple storage types, for example: standard storage, that is, three-copy storage, as well as low-frequency storage and archive storage. Correspondingly, the conversion type mentioned in this embodiment of the present invention may be any of the various storage types. Among them, three-copy storage specifically refers to storing three copies of one data in a storage device; for low-frequency storage, the storage method used may be erasure code storage; and for archive storage, the adopted storage method The storage method is the method of data storage in the offline storage server.

As shown in FIG. 1, a storage type conversion method provided by an embodiment of the present invention may include the following steps:

S101, determine each candidate object to be processed in the target server;

When the storage type conversion is performed for the objects in the target server, each candidate object to be processed in the target server may be determined first, and then each candidate object can be analyzed whether the storage type can be converted. In addition, the storage type conversion device may use all or part of the objects stored in the target server as each candidate object to be processed, thereby implementing type conversion analysis for all objects or parts in the target server.

It can be understood by those skilled in the art that the storage type conversion apparatus can learn each object stored in the target server by downloading the object list information from the target server. The object list information may record description information such as the id of the object, the name of the object, the format, the size of the data, and the owner.

In order to achieve access to the target server, the relevant information of the target server can be configured through the human-computer interaction interface. The relevant information can include: the access domain name of the target server, the secret key information used to generate the signature required for identity authentication, the object Information about the storage space where it is located, and whether to use encrypted access to ssl (security socketlayer, secure socket), etc. Further, the storage type conversion device can realize the access to the target server based on the relevant information of the preconfigured target server, and perform the storage type conversion according to the preconfigured conversion interface, or download the object list information according to the information access interface. .

S102, from each candidate object, determine a target object that satisfies a predetermined conversion condition; wherein, the conversion condition is a condition on which to determine whether any object can be converted into a storage type, and the conversion condition at least includes the number of visits in a specified period meet the predetermined number of conditions;

The conversion condition and the conversion type corresponding to the conversion condition mentioned later may be configured by the configuration personnel of the enterprise user through the human-computer interaction interface. Moreover, since the data hot and cold standard is related to the number of visits, the conversion condition includes at least that the number of visits within a specified period meets the condition of the predetermined number of times. The conversion type is the storage type to which the object satisfying the conversion condition needs to be converted.

In specific applications, objects belonging to hot data can be stored in standard storage, objects belonging to warm data can be stored at low frequency, and objects belonging to cold data can be stored using archives. Then, the configurator can set the conversion condition and the conversion type corresponding to the conversion condition according to the data hot and cold standard set by the enterprise user, so as to match the hot and cold degree of the object with the storage type of the object. That is to say, the conversion condition is a condition that needs to be satisfied when it is determined that the object belongs to the target heat data, and the target heat data is: hot data, warm data or cold data; the conversion type corresponding to the conversion condition is the same as the target heat data. matching storage type. Among them, if the conversion condition is the condition that needs to be satisfied when the object belongs to hot data, the conversion type corresponding to the conversion condition is standard storage; if the conversion condition is the condition that needs to be satisfied when the object belongs to warm data, the conversion type The conversion type corresponding to the condition is low-frequency storage; if the conversion condition is a condition that needs to be satisfied when it is determined that the object belongs to cold data, the conversion type corresponding to the conversion condition is archive storage.

Among them, the hot data is the current hot data, whether it is the data that the user or the system needs to visit with a high number of times, such as the newly launched applications in the application store; Little data, such as a game installation package file that has died down; cold data is data that is rarely accessed but needs to be stored and retained, such as bank transaction records from a few years ago. For example: Assuming that in the data hot and cold standard set by enterprise users, any object is accessed more than 10 times in a week, the object is considered to be hot data, then the conversion condition can be set as: within a week If the number of visits in the data exceeds 10 times, the conversion type corresponding to the conversion condition is standard storage; if the number of visits of any object in a week exceeds 1 and less than 10 times, the object is considered to be warm data, then, you can set The given conversion condition is: if the number of visits within a week exceeds 1 and does not reach 10, the conversion type corresponding to this conversion condition is low-frequency storage; and any object is visited less than once within a week, it is considered that the object If the data is cold data, then the conversion condition can be set as follows: the number of visits within a week does not exceed 1, and the conversion type corresponding to this conversion condition is archive storage.

It should be emphasized that since the parameter values of other parameters can also be considered under the premise of considering the hot and cold standards, the storage type conversion can only be carried out when all are met. Therefore, the conversion conditions can include: access within a specified period The number of times meets the predetermined number of times conditions, and the specified parameter meets the preset conditions. The specified parameters may include: data size, last modification time, and so on.

For example: if the conversion condition only includes that the number of visits within a specified period meets the predetermined number of times, the conversion condition may include: the number of visits in the last thirty days exceeds 100, and correspondingly, the conversion type corresponding to the conversion condition It can be: standard storage; or, the conversion condition can include: the number of visits in the last 180 days is not more than 10 times, correspondingly, the conversion type corresponding to the conversion condition can be low-frequency storage; or, the conversion condition can include: in the last 360 days The number of accesses is not more than 1, and correspondingly, the conversion type corresponding to the conversion condition can be archive storage.

For example, if the conversion condition includes that the number of visits in a specified period meets the predetermined number of times and the amount of data meets the preset condition, the conversion condition may include: the number of visits in the last thirty days exceeds 100 and the amount of data is not less than 100 10M, correspondingly, the conversion type corresponding to the conversion condition may be: standard storage; or, the conversion condition may include: the number of visits in the last 180 days is not more than 10 times, and the data volume is greater than 20M, correspondingly, the conversion corresponding to the conversion condition The type may be low-frequency storage; or, the conversion condition may include: the number of accesses in the last 360 days is not greater than 1, and the data volume is greater than 30M. Correspondingly, the conversion type corresponding to the conversion condition may be archive storage.

In addition, the storage type conversion device can obtain the access times of any object within a specified period through log information about the target server. In order to obtain the access log, the access information of the log storage system that stores the log information may be pre-configured, and then the log storage system may be accessed based on the access information of the log storage system. In order to facilitate understanding of the solution, FIG. 4 shows a schematic diagram of the interaction between the storage type conversion device, the log storage system and the target server.

S103, by calling the conversion interface, according to the conversion type corresponding to the conversion condition, convert the storage type of the target object in the target server;

The conversion type is the storage type to which the object satisfying the conversion condition needs to be converted, and the conversion interface is a pre-configured interface for performing storage type conversion on the object stored in the target server.

After the target object is determined, the preconfigured conversion interface can be called to convert the storage type of the target object in the target server according to the conversion type corresponding to the conversion condition, that is, the target object is converted to be stored according to the conversion type. The number of target objects may be one or more, and for each target object, the storage type of the target object in the target server may be converted to the conversion type by calling the conversion interface.

In addition, by calling the conversion interface, according to the conversion type corresponding to the conversion condition, the conversion of the storage type of the target object in the target server can be specifically: through the conversion interface, the object id of the target object and the conversion type are passed as parameters. To the target server, so that the target server can complete the conversion of the storage type of the target object according to the object id and conversion type of the target object.

In the solution provided by the embodiment of the present invention, the conversion condition related to the data hot and cold standard set by the enterprise user is used to determine the target object of the type to be converted from the candidate objects, and by calling the object used by the enterprise user The storage-related conversion interface, that is, the conversion interface corresponding to the target server, performs storage type conversion on the target object according to the conversion type corresponding to the conversion condition. It can be seen that through this solution, the object storage type in the object storage used by the enterprise user can be quickly and effectively converted according to the data hot and cold standard set by the enterprise user.

Optionally, the configuration personnel may configure at least one conversion condition, and in this case, the number of conversion conditions acquired during the storage type conversion process may be at least one. The at least one transition condition may correspond to the same or different transition types. And, considering that an object may satisfy at least two conversion conditions at the same time, and the conversion type should be unique, therefore, a priority can be set for the at least one conversion condition, and each conversion condition is set with a priority, so that the subsequent pass through the priority level can select a unique conversion type. Wherein, the priority of each transition condition can be specified by the configuration personnel, but of course it is not limited to this.

For the clarity of the scheme, the following describes the storage type conversion method for object storage provided by the embodiment of the present invention for a situation where there are multiple conversion conditions.

As shown in FIG. 2, the storage type conversion method provided by the embodiment of the present invention may include the following steps:

S201, determine each candidate object to be processed in the target server;

In this embodiment, S201 is the same as the above-mentioned S101, and details are not described here.

S202, from each candidate object, determine a target object that satisfies at least one conversion condition;

Exemplarily, in an implementation manner, after each candidate object is determined, it can be determined whether the candidate object satisfies at least one conversion condition for each candidate object, and if so, it is determined that the candidate object satisfies at least one conversion condition. The target object of at least one transition condition.

Exemplarily, in another implementation manner, after each candidate object is determined, for each conversion condition, a target object that satisfies the conversion condition may be determined from each candidate object. Any target object can meet only one transition condition or at least two transition conditions.

For the relevant content of the conversion condition, reference may be made to the corresponding content in the foregoing embodiment, which will not be repeated here.

S203, if the target object satisfies at least two conversion conditions, by calling the conversion interface, according to the storage type corresponding to the target conversion condition, convert the storage type of the target object in the target server;

The target conversion condition is the corresponding conversion condition satisfied by the target object, that is, the conversion condition satisfied by the target object. In order to further meet the conversion requirements of enterprise users, the target conversion condition may be the conversion condition with the highest priority that is satisfied by the target object.

In addition, converting the storage type of the target object according to the conversion type corresponding to the target conversion condition is to convert the storage type of the target object in the target server according to the conversion type corresponding to the target conversion condition.

S204, if the target object only satisfies one conversion condition, by invoking the conversion interface, convert the storage type of the target object in the target server according to the conversion type corresponding to the conversion condition satisfied by the target object.

The number of target objects determined through S202 may be one or more. When the number of target objects is multiple, for each target object, specific storage type conversion may be performed according to S203-S204.

For any target object, if the target object meets at least two conversion conditions, since a unique conversion type needs to be determined, and the conversion type corresponding to the conversion condition with the highest priority can be considered as the type that best meets the needs of enterprise users, so , during type conversion, the storage type of the target object in the target server can be converted according to the conversion type corresponding to the conversion condition with the highest priority.

For any target object, if the target object meets only one conversion condition, the storage type of the target object in the target server can be converted according to the conversion type corresponding to the conversion condition satisfied by the target object.

And, by invoking the conversion interface, converting the storage type of the target object in the target server to any conversion type may specifically be: passing the object id of the target object and any conversion type as parameters to the target server through the conversion interface , so that the target server can complete the conversion of the storage type of the target object according to the object id of the target object and any conversion type.

For a target object that satisfies at least two transition conditions, there may be multiple target transition conditions, that is, there may be multiple transition conditions corresponding to the highest priority. In order to ensure the uniqueness of the conversion types, the priority relationship of each storage type can be preset. In this way, when the number of target conversion conditions is multiple, the highest priority can be selected from the conversion types corresponding to the multiple target conversion conditions. The conversion type of , as the type to be converted. Based on this processing idea, the target conversion condition is the conversion condition with the highest priority satisfied by the target object; by calling the conversion interface, according to the conversion type corresponding to the target conversion condition, the storage type of the target object in the target server is converted, which can include :

If the number of target conversion conditions is multiple, use the preset priority relationship about each storage type to determine the target conversion type with the highest priority from the conversion types corresponding to each target conversion condition, and put the target conversion type in the target server. The storage type of the target object is converted to the target conversion type;

If the number of target conversion conditions is one, the storage type of the target object in the target server is converted by calling the conversion interface and using the conversion type corresponding to the target conversion condition.

Exemplarily, the priority relationship of each storage type may be set according to the principle of ensuring the availability of object data. Exemplarily, the priority relationship of each storage type includes: the priority of low-frequency storage is lower than that of standard storage, and the priority of low-frequency storage is greater than that of archive storage.

In the solution provided by the embodiment of the present invention, the conversion condition related to the data hot and cold standard set by the enterprise user is used to determine the target object of the type to be converted from the candidate objects, and by calling the object used by the enterprise user The storage-related conversion interface, that is, the conversion interface corresponding to the target server, performs storage type conversion on the target object according to the conversion type corresponding to the conversion condition. It can be seen that through this solution, the object storage type in the object storage used by the enterprise user can be quickly and effectively converted according to the data hot and cold standard set by the enterprise user. Moreover, the number of conversion conditions can be at least one, and each conversion condition has a priority, so that the conversion of storage types is more flexible and fast.

Considering that in some scenarios, it is not necessary to analyze whether the storage type is converted for all objects in the target server, but to analyze the storage type conversion for objects in a specific processing range. Based on this requirement, pre-filter conditions for filtering objects located in a specific processing scope can be set. Correspondingly, in the above-mentioned embodiments shown in FIG. 1 and FIG. 2 , determining each candidate object to be processed in the target server may include:

From the objects stored in the target server, determine the objects that satisfy the predetermined pre-screening conditions, and obtain each candidate object to be processed.

Exemplarily, the pre-screening condition may include: the parameter value of the target parameter of the object conforms to the specified parameter condition. In a specific application, the target parameter includes at least one parameter among the object name, the last modification time, the size of the data amount, the operation type of the access operation that occurs, and the storage type, wherein the operation type of the access operation that occurs may include read operation, write operation operations and delete operations.

Moreover, when the target parameter is one parameter, the specified parameter condition is the parameter condition corresponding to the one parameter; and when the target parameter is multiple parameters, the specified parameter condition is composed of the parameter conditions corresponding to the multiple parameters. . The parameter conditions corresponding to different specified parameters may be different. For example, the parameter conditions corresponding to the object name may include specified characters in the object name, or the prefix of the object name matches the specified characters; the parameter conditions corresponding to the last modification time It can be that the last modification time is not earlier than or not later than the specified time point, or, the last modification time is equal to the specified time point; the parameter conditions corresponding to the data size can be that the data size is greater than, less than or equal to the specified data size; the occurrence of The parameter condition corresponding to the operation type of the access operation can be that a read operation, write operation and/or delete operation has occurred; the parameter condition corresponding to the storage type can be that the storage type is a specified type.

For example: when the target parameter is one, the pre-screening conditions can include: the storage type is the specified type; or, the data volume is less than the specified data volume;

When there are multiple target parameters, the pre-filter conditions may include: the prefix of the object name matches test*, the last modification time is earlier than January 10, 2020, and an over-read operation has occurred; or, the pre-filter conditions may include: the object name Including "important" and the data size is not more than 100M.

In addition, it should be noted that the parameter value of the target parameter of the object in the target server can be determined through the target information record of the target server. The target information record may include: object list information of objects stored by the target server and/or access logs about the objects stored by the target server. The object list information may be information obtained by calling an information access interface, and the information access interface is a preconfigured interface for accessing the object list information about the target server. The information access interfaces corresponding to different target servers may be different, which is not limited in this embodiment of the present invention. In addition, in a specific application, the information access interface may be provided by the aforementioned SDK.

In addition, in a specific application, there is a need to lock the storage type of a specific object, that is, no matter whether the specific object satisfies the conversion condition, the original storage type needs to be maintained. Based on this requirement, the configurator can configure the type locking condition, so as to further judge whether to perform the storage type conversion according to the type locking condition. Then, in any of the above-mentioned embodiments shown in FIG. 1 and FIG. 2 , after the target object that satisfies the predetermined conversion condition is determined from each candidate object, the conversion interface is called by calling the conversion interface according to the conversion condition. The corresponding conversion type, before converting the storage type of the target object in the target server, may also include:

Determine whether the target object satisfies the predetermined type locking condition;

When the judgment result is no, execute the step of converting the storage type of the target object in the target server according to the conversion type corresponding to the conversion condition by invoking the conversion interface.

The setting of this type of locking condition may refer to the setting of the above-mentioned pre-screening condition. That is, the type locking condition may include: the parameter value of the specified parameter of the object satisfies the preset parameter condition. The specified parameters may include at least one parameter among the object name, the last modification time, the size of the data amount, the operation type of the access operation that occurs, and the storage type. Moreover, when the specified parameter is one parameter, the preset parameter condition is the parameter condition corresponding to the one parameter; and when the specified parameter is multiple parameters, the preset parameter condition is the parameter condition corresponding to the multiple parameters constitute together.

For example: when the specified parameter is one, the type locking condition can include: the storage type is the specified type; or, the data volume is less than the specified data volume;

When there are multiple specified parameters, the type lock condition can include: the prefix of the object name matches test*, the last modification time is earlier than January 10, 2020, and a read operation has occurred; or, the pre-filter condition can include: the object name Including "important" and the data size is not more than 100M.

The following describes the storage type conversion method for object storage provided by the embodiment of the present invention with reference to a specific embodiment.

As shown in FIG. 3, the storage type conversion method provided by the embodiment of the present invention may include the following steps:

S301, from the objects stored in the target server, determine the objects that meet the predetermined pre-screening conditions, and obtain each candidate object to be processed;

S302, for each candidate object, determine whether the candidate object satisfies each conversion condition, and if the candidate object satisfies at least one conversion condition, determine that the candidate object is the target object.

S303, for each target object, determine whether the target object satisfies the predetermined type locking condition, if so, end the processing of the target object; if not, execute S304 or S305;

S304, if the target object satisfies at least two conversion conditions, and if the number of target conversion conditions is multiple, use the preset priority relationship about each storage type to determine the corresponding conversion type from the conversion types corresponding to each target conversion condition The target conversion type with the highest priority, convert the storage type of the target object in the target server to the target conversion type; if the number of target conversion conditions is one, by calling the conversion interface, use the conversion type corresponding to the target conversion condition , convert the storage type of the target object in the target server;

S305, if the target object only satisfies one conversion condition, by invoking the conversion interface, convert the storage type of the target object in the target server according to the conversion type corresponding to the conversion condition satisfied by the target object.

It can be seen that through this solution, the object storage type in the object storage used by the enterprise user can be quickly and effectively converted according to the data hot and cold standard set by the enterprise user. In addition, the number of conversion conditions can be multiple, and different conversion conditions correspond to different priorities, which makes the conversion of storage types more flexible and fast. At the same time, by setting the type locking condition, the requirement for locking the storage type of a specific object can be realized.

Corresponding to the above method embodiments, the embodiments of the present invention provide a storage type conversion device. As shown in Figure 5, the device is applied to electronic equipment and may include:

The object determination module 510 is used to determine each candidate object to be processed in the target server; the target server is a cloud server for storing objects;

The screening module 520 is configured to, from each candidate object, determine a target object that satisfies a predetermined conversion condition; wherein, the conversion condition is a condition on which to determine whether any object can be converted into a storage type, and the conversion condition is at least The number of visits included in the specified period meets the predetermined number of conditions;

A conversion module 530, configured to convert the storage type of the target object in the target server according to the conversion type corresponding to the conversion condition by invoking the conversion interface;

The conversion type is the storage type to which the object satisfying the conversion condition needs to be converted, and the conversion interface is an interface for performing storage type conversion on the object stored in the target server.

In the solution provided by the embodiment of the present invention, the conversion condition related to the data hot and cold standard set by the enterprise user is used to determine the target object of the type to be converted from the candidate objects, and by calling the object used by the enterprise user The storage-related conversion interface, that is, the conversion interface corresponding to the target server, performs storage type conversion on the target object according to the conversion type corresponding to the conversion condition. It can be seen that through this solution, the object storage type in the object storage used by the enterprise user can be quickly and effectively converted according to the data hot and cold standard set by the enterprise user.

Optionally, the object determination module 510 is specifically configured to:

From the objects stored in the target server, determine the objects that meet the predetermined pre-screening conditions, and obtain each candidate object to be processed;

The pre-screening condition includes: the parameter value of the target parameter of the object conforms to the specified parameter condition;

Wherein, the target parameter includes at least one parameter among the object name, the last modification time, the size of the data amount, the operation type of the access operation that occurs, and the storage type.

Optionally, the device may also include:

The locking analysis module is used for, after the screening module 520 determines the target object that satisfies the predetermined conversion condition from each candidate object, the conversion module calls the conversion interface, according to the conversion type corresponding to the conversion condition, Before converting the storage type of the target object in the target server, determine whether the target object satisfies a predetermined type locking condition;

When the judgment result is no, the step of converting the storage type of the target object in the target server according to the conversion type corresponding to the conversion condition by invoking the conversion interface is performed.

Optionally, the number of the conversion conditions is at least one; each conversion condition is set with a priority;

The conversion module 530 is specifically used for:

If the target object satisfies at least two conversion conditions, convert the storage type of the target object in the target server according to the conversion type corresponding to the target conversion condition by calling the conversion interface; the target conversion condition is the target The corresponding conversion condition satisfied by the object;

If the target object only satisfies one conversion condition, by calling the conversion interface, the storage type of the target object in the target server is converted according to the conversion type corresponding to the conversion condition satisfied by the target object.

Optionally, the target conversion condition is the highest priority conversion condition satisfied by the target object;

The conversion module converts the storage type of the target object in the target server according to the conversion type corresponding to the target conversion condition by calling the conversion interface, including:

If the number of target conversion conditions is multiple, the preset priority relationship about each storage type is used to determine the target conversion type with the highest corresponding priority from the conversion types corresponding to each target conversion condition, and the target server The storage type of the target object in is converted to the target conversion type;

If the number of target conversion conditions is one, by invoking the conversion interface, the storage type of the target object in the target server is converted by using the conversion type corresponding to the target conversion condition.

Optionally, the priority relationship of each storage type includes: the priority of low-frequency storage is lower than that of standard storage, and the priority of low-frequency storage is greater than the priority of archive storage.

In addition, based on the foregoing method embodiments, the embodiments of the present invention further provide a storage type conversion system. As shown in FIG. 6 , the storage type conversion system provided by the embodiment of the present invention may include:

The rule management device 610 is used for the rule management device to manage a predetermined conversion condition for object storage type conversion and a conversion type corresponding to the conversion condition; wherein, the conversion condition is to determine whether any object can be converted into storage The condition on which the type is based, and the conversion condition includes at least that the number of accesses in the specified period meets the predetermined number of times condition; the conversion type is the storage type to which the object satisfying the conversion condition needs to be converted;

The intelligent computing device 620 is used to determine each candidate object to be processed in the target server; from each candidate object, determine the target object that satisfies the conversion condition managed by the rule management device; the target server is Cloud servers for storing objects;

The operation execution device 630 is configured to convert the storage type of the target object in the target server according to the conversion type managed by the rule management device and corresponding to the conversion condition by invoking the conversion interface; wherein, The conversion interface is an interface for performing storage type conversion on objects stored in the target server.

The rule management device 610 may instruct the configuration personnel to configure the conversion conditions for object storage type conversion and the conversion types corresponding to the conversion conditions, for example, output an interface for object storage type conversion for configuration personnel to configure conversion Condition and conversion type: After the configuration is completed, the conversion condition and the conversion type corresponding to the conversion condition are saved, so as to realize the management of the rules for storing type conversion.

In the type conversion process, as shown in FIG. 7 , the intelligent computing device may read the conversion condition and the conversion type corresponding to the conversion condition from the rule management device, and determine the target object to be type-converted based on the acquired conversion condition, and Output the information of the target object to be converted to a predetermined storage area, wherein the information of the target object to be converted may include the id of the target object and the conversion type to which the target object is to be converted; The information of the target object to be type-converted is read in the area, and the storage type conversion is performed on the target object in the target server by using the conversion interface and the acquired information of the target object.

In the solution provided by the embodiment of the present invention, through the cooperation of the rule management device, the intelligent computing device and the operation execution device, the conversion conditions related to the data cooling and heating standards set by the enterprise user can be used to determine the pending object from the candidate objects. Convert the target object of the conversion type, and perform storage type conversion on the target object according to the conversion type corresponding to the conversion condition by calling the conversion interface related to the object storage used by the enterprise user, that is, the conversion interface corresponding to the target server. It can be seen that through this solution, the object storage type in the object storage used by the enterprise user can be quickly and effectively converted according to the data hot and cold standard set by the enterprise user.

An embodiment of the present invention further provides an electronic device, as shown in FIG. 8 , including a processor 801 , a communication interface 802 , a memory 803 and a communication bus 804 , wherein the processor 801 , the communication interface 802 , and the memory 803 pass through the communication bus 804 complete communication with each other,

a memory 803 for storing computer programs;

The processor 801 is configured to implement the steps of the storage type conversion method provided by the embodiment of the present invention when executing the program stored in the memory 803 .

The communication bus mentioned in the above electronic device may be a peripheral component interconnect standard (Peripheral Component Interconnect, PCI) bus or an Extended Industry Standard Architecture (Extended Industry Standard Architecture, EISA) bus or the like. The communication bus can be divided into an address bus, a data bus, a control bus, and the like. For ease of presentation, only one thick line is used in the figure, but it does not mean that there is only one bus or one type of bus.

The communication interface is used for communication between the above electronic device and other devices.

The memory may include random access memory (Random Access Memory, RAM), and may also include non-volatile memory (Non-Volatile Memory, NVM), such as at least one disk memory. Optionally, the memory may also be at least one storage device located away from the aforementioned processor.

The above-mentioned processor may be a general-purpose processor, including a central processing unit (Central Processing Unit, CPU), a network processor (Network Processor, NP), etc.; may also be a digital signal processor (Digital Signal Processing, DSP), an application-specific integrated circuit (Application Specific Integrated Circuit, ASIC), Field-Programmable Gate Array (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components.

In another embodiment provided by the present invention, a computer-readable storage medium is also provided, where a computer program is stored in the computer-readable storage medium, and when the computer program is executed by a processor, the implementation provided by the embodiment of the present invention is provided. The steps of the storage type conversion method.

In another embodiment provided by the present invention, a computer program product including instructions is also provided, when it runs on a computer, the computer executes the steps of the storage type conversion method provided by the embodiment of the present invention.

In the above-mentioned embodiments, it may be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented in software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of the present invention are generated. The computer may be a general purpose computer, special purpose computer, computer network, or other programmable device. The computer instructions may be stored in or transmitted from one computer readable storage medium to another computer readable storage medium, for example, the computer instructions may be downloaded from a website site, computer, server or data center Transmission to another website site, computer, server, or data center is by wire (eg, coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (eg, infrared, wireless, microwave, etc.). The computer-readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. that includes an integration of one or more available media. The usable media may be magnetic media (eg, floppy disks, hard disks, magnetic tapes), optical media (eg, DVD), or semiconductor media (eg, Solid State Disk (SSD)), among others.

It should be noted that, in this document, relational terms such as first and second are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any relationship between these entities or operations. any such actual relationship or sequence exists. Moreover, the terms "comprising", "comprising" or any other variation thereof are intended to encompass a non-exclusive inclusion such that a process, method, article or device that includes a list of elements includes not only those elements, but also includes not explicitly listed or other elements inherent to such a process, method, article or apparatus. Without further limitation, an element qualified by the phrase "comprising a..." does not preclude the presence of additional identical elements in a process, method, article or apparatus that includes the element.

Each embodiment in this specification is described in a related manner, and the same and similar parts between the various embodiments may be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for embodiments such as apparatuses, electronic devices, etc., since they are basically similar to the method embodiments, the description is relatively simple, and reference may be made to some descriptions of the method embodiments for related parts.

The above descriptions are only preferred embodiments of the present invention, and are not intended to limit the protection scope of the present invention. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention are included in the protection scope of the present invention.

Claims (10)

1. a storage type conversion method, is characterized in that, comprises: Determine each candidate object to be processed in the target server; the target server is a cloud server for storing objects; From each candidate object, determine a target object that satisfies a predetermined conversion condition; wherein, the conversion condition is a condition on which to determine whether any object can be converted into a storage type, and the conversion condition at least includes The number of visits meets the predetermined number of conditions; Convert the storage type of the target object in the target server according to the conversion type corresponding to the conversion condition by invoking the conversion interface; The conversion type is the storage type to which the object satisfying the conversion condition needs to be converted, and the conversion interface is an interface for performing storage type conversion on the object stored in the target server. 2. The method according to claim 1, wherein the determining each candidate object to be processed in the target server comprises: From the objects stored in the target server, determine the objects that meet the predetermined pre-screening conditions, and obtain each candidate object to be processed; The pre-screening condition includes: the parameter value of the target parameter of the object conforms to the specified parameter condition; Wherein, the target parameter includes at least one parameter among the object name, the last modification time, the size of the data amount, the operation type of the access operation that occurs, and the storage type. 3. The method according to claim 1 or 2, characterized in that, after determining a target object that satisfies a predetermined conversion condition from each candidate object, the conversion interface is called by calling the conversion interface according to the conversion condition. The corresponding conversion type, before converting the storage type of the target object in the target server, further includes: judging whether the target object satisfies a predetermined type locking condition; When the judgment result is no, the step of converting the storage type of the target object in the target server according to the conversion type corresponding to the conversion condition by invoking the conversion interface is performed. 4. method according to claim 1, is characterized in that, the quantity of described conversion condition is at least one; Each conversion condition is all provided with priority; The converting the storage type of the target object in the target server according to the conversion type corresponding to the conversion condition by calling the conversion interface, including: If the target object satisfies at least two conversion conditions, convert the storage type of the target object in the target server according to the conversion type corresponding to the target conversion condition by calling the conversion interface; the target conversion condition is the target The corresponding conversion condition satisfied by the object; If the target object only satisfies one conversion condition, by calling the conversion interface, the storage type of the target object in the target server is converted according to the conversion type corresponding to the conversion condition satisfied by the target object. 5. The method according to claim 4, wherein the target conversion condition is the highest priority conversion condition satisfied by the target object; The converting the storage type of the target object in the target server according to the conversion type corresponding to the target conversion condition by calling the conversion interface, including: If the number of target conversion conditions is multiple, the preset priority relationship about each storage type is used to determine the target conversion type with the highest corresponding priority from the conversion types corresponding to each target conversion condition, and the target server The storage type of the target object in is converted to the target conversion type; If the number of target conversion conditions is one, by invoking the conversion interface, the storage type of the target object in the target server is converted by using the conversion type corresponding to the target conversion condition. 6. The method according to claim 5, wherein the priority relationship of each storage type comprises: the priority of low-frequency storage is lower than the priority of standard storage, and the priority of low-frequency storage is greater than the priority of archive storage . 7. A storage type conversion device, characterized in that, comprising: an object determination module for determining each candidate object to be processed in the target server; the target server is a cloud server for storing objects; A screening module, configured to determine a target object that satisfies a predetermined conversion condition from each candidate object; wherein, the conversion condition is a condition on which to determine whether any object can be converted into a storage type, and the conversion condition at least includes The number of visits within the specified period meets the predetermined number of conditions; a conversion module, configured to convert the storage type of the target object in the target server according to the conversion type corresponding to the conversion condition by invoking the conversion interface; The conversion type is the storage type to which the object satisfying the conversion condition needs to be converted, and the conversion interface is an interface for performing storage type conversion on the object stored in the target server. 8. A storage type conversion system, characterized in that, comprising: A rule management device for managing a predetermined conversion condition for object storage type conversion and a conversion type corresponding to the conversion condition; wherein, the conversion condition is a condition on which to determine whether any object can be converted into a storage type, and The conversion condition at least includes that the number of visits within the specified period meets the predetermined number of times condition; the conversion type is the storage type to which the object satisfying the conversion condition needs to be converted; An intelligent computing device is used to determine each candidate object to be processed in the target server; from each candidate object, determine the target object that satisfies the conversion condition managed by the rule management device; the target server is a user Cloud servers for storing objects; an operation execution device, configured to convert the storage type of the target object in the target server according to the conversion type managed by the rule management device and corresponding to the conversion condition by invoking a conversion interface; The conversion interface is an interface for performing storage type conversion on objects stored in the target server. 9. An electronic device, characterized in that it comprises a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface, and the memory complete mutual communication through the communication bus; memory for storing computer programs; The processor is configured to implement the method steps described in any one of claims 1-6 when executing the program stored in the memory. 10. A computer-readable storage medium, wherein a computer program is stored in the computer-readable storage medium, and when the computer program is executed by a processor, the method steps of any one of claims 1-6 are implemented.

Images