CN112181277B - A data storage space management method, device, storage medium and electronic device - Google Patents

Abstract

The embodiment of the application discloses a data storage space management method and device, a storage medium and electronic equipment. The method comprises the following steps: if the trigger condition of the update capacity of the target data storage interval is detected, determining whether the trigger condition simultaneously comprises a first trigger condition and a second trigger condition; the first trigger condition comprises a trigger condition generated based on a capacity space, and the second trigger condition comprises a trigger condition generated based on a preset time rule; and if the data to be deleted simultaneously comprises the first trigger condition and the second trigger condition, determining data to be deleted from all data in the target data storage interval based on a preset rule, and deleting the data to be deleted. By executing the technical scheme, the storage data can be effectively managed according to the requirement, and the storage capacity of the storage equipment for the newly-coming data is not influenced while the storage time of the data is prolonged.

Description

A data storage space management method, device, storage medium and electronic device

technical field

The embodiments of the present application relate to the technical field of data processing, and in particular, to a data storage space management method, apparatus, storage medium, and electronic device.

Background technique

With the rapid development of science and technology, the ability to store data is increasing day by day, and storage devices can be used to store a large amount of data for a long time to achieve the purpose of retrieving data during use.

Data plays a crucial role in the retention of video surveillance data. Judging from the current trend, the retention time of video surveillance data and the number of connected cameras will continue to grow, and storage will also face the need for access to more types of metadata and larger storage capacity. However, the storage capacity cannot be expanded indefinitely, so the orderly update and deletion of a large amount of data in a certain amount of storage space is particularly important, which requires that the storage management of metadata must be more rigorous and scientific. Therefore, how to use the characteristics of video surveillance data itself, combined with the storage management technology, make the video surveillance data updated and cleaned up in a stable and orderly manner, and improve the resistance of data storage space management to known and unknown risks, is a problem that needs to be solved at present.

SUMMARY OF THE INVENTION

The embodiments of the present application provide a data storage space management method, device, storage medium and electronic device, which can effectively manage stored data according to requirements, increase the storage time of data without affecting the storage capability of the storage device for newly incoming data Effect.

In a first aspect, an embodiment of the present application provides a data storage space management method, which includes:

If a trigger condition for updating the capacity of the target data storage interval is detected, it is determined whether the trigger condition includes both a first trigger condition and a second trigger condition; wherein, the first trigger condition includes a trigger condition generated based on the capacity space, The second trigger condition includes a trigger condition generated based on a preset time rule;

If both the first trigger condition and the second trigger condition are included, the data to be deleted is determined from each data in the target data storage interval based on the preset rule, and the deletion operation is performed on the data to be deleted.

Further, the method for obtaining the first trigger condition includes:

Determine whether the first preset condition is met according to the size relationship between the remaining capacity space of the target data storage interval and the capacity requirement of the data to be stored;

If so, a first trigger condition is generated.

Further, the method for obtaining the second trigger condition includes:

Determine the capacity timer of the target data storage section according to the remaining capacity space of the target data storage section and according to the data storage rate of the target data storage section;

When the timing of the capacity timer meets the second preset condition, a second trigger condition is generated.

Further, after detecting the triggering condition of the update capacity of the target data storage interval, the method further includes:

If it is determined that the trigger condition includes the first trigger condition, and the target data storage interval reaches the first trigger condition for the first time, the data storage space capacity is updated based on the storage time of each data in the target data storage interval, and activated The time trigger mechanism works to generate a second trigger condition based on a preset time rule after activation.

Further, before detecting the triggering condition of the update capacity of the target data storage interval, the method further includes:

storing the data to be stored in the target data storage interval; wherein, the data to be stored includes a marker field, and the marker field is used to store a marker value;

Correspondingly, the data to be deleted is determined from each data in the target data storage interval based on the preset rules, including:

The data to be deleted is determined based on the tag value of the tag field of each data.

Further, before determining the data to be deleted based on the marked value of the marked field of each data, the method further includes:

Generate mark value record table;

Correspondingly, the data to be deleted is determined based on the marked value of the marked field of each data, including:

The data to be deleted is determined based on the marked value in the record table, and the record table is updated after the data is deleted.

Further, after generating the marked value record table, the method further includes: determining whether the first trigger condition is valid according to the number of marked values in the record table; wherein, if the number exceeds the quota number threshold, determining The first trigger condition is valid, and if the quantity does not exceed the quota quantity threshold, it is determined that the first trigger condition is invalid.

In a second aspect, an embodiment of the present application provides a data storage space management device, the device comprising:

The trigger condition judgment module is configured to determine whether the trigger condition includes a first trigger condition and a second trigger condition at the same time if the trigger condition of the update capacity of the target data storage interval is detected; wherein, the first trigger condition includes based on a trigger condition generated by the capacity space, and the second trigger condition includes a trigger condition generated based on a preset time rule;

A data deletion module, configured to determine the data to be deleted from each data in the target data storage interval based on a preset rule if the trigger condition judgment module determines that both the first trigger condition and the second trigger condition are included, and perform a Delete the data to be deleted.

Further, the method for obtaining the first trigger condition includes:

Determine whether the first preset condition is met according to the size relationship between the remaining capacity space of the target data storage interval and the capacity requirement of the data to be stored;

If so, a first trigger condition is generated.

Further, the method for obtaining the second trigger condition includes:

Determine the capacity timer of the target data storage section according to the remaining capacity space of the target data storage section and according to the data storage rate of the target data storage section;

When the timing of the capacity timer meets the second preset condition, a second trigger condition is generated.

Further, the device also includes:

The second trigger condition activation module is configured to: if it is determined that the trigger condition includes the first trigger condition, and the target data storage interval reaches the first trigger condition for the first time, then based on the storage time of each data in the target data storage interval The storage space capacity is updated, and the activation time trigger mechanism works, so as to generate a second trigger condition based on a preset time rule after activation.

Further, the device also includes:

a data labeling module, used for storing the data to be stored in the target data storage interval; wherein, the data to be stored includes a label field, and the label field is used to store the label value;

Correspondingly, the data deletion module is specifically used for:

The data to be deleted is determined based on the tag value of the tag field of each data.

Further, the device also includes:

The record table generation module is used to generate the mark value record table;

Correspondingly, the data deletion module is specifically used for:

The data to be deleted is determined based on the marked value in the record table, and the record table is updated after the data is deleted.

Further, after generating the marked value record table, the method further includes:

Whether the first trigger condition is valid is determined according to the number of marked values in the record table; wherein, if the quantity exceeds the quota quantity threshold, it is determined that the first trigger condition is valid, and if the quantity does not exceed the quota quantity threshold , it is determined that the first trigger condition is invalid.

In a third aspect, an embodiment of the present application provides a computer-readable storage medium on which a computer program is stored, and when the program is executed by a processor, implements the data storage space management method described in the embodiment of the present application.

In a fourth aspect, an embodiment of the present application provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executed by the processor, and the processor executes the computer program to achieve the implementation of the present application The data storage space management method described in the example.

In the technical solutions provided by the embodiments of the present application, if a trigger condition for the update capacity of the target data storage interval is detected, it is determined whether the trigger condition includes both a first trigger condition and a second trigger condition; wherein, the first trigger condition The condition includes a trigger condition generated based on the capacity space, and the second trigger condition includes a trigger condition generated based on a preset time rule; if the first trigger condition and the second trigger condition are included at the same time, based on the preset rule, from the target data storage interval. The data to be deleted is determined in each data, and the deletion operation is performed on the to-be-deleted data. By adopting the technical solution provided by the present application, the effect of effectively managing the stored data according to the requirements, increasing the storage time of the data and not affecting the storage capability of the storage device for the newly incoming data is achieved.

Description of drawings

FIG. 1 is a schematic diagram of data storage space management provided by an embodiment of the present application. ;

2 is a flowchart of a data storage space management method provided in Embodiment 1 of the present application;

3 is a schematic diagram of data management provided in Embodiment 2 of the present application;

4 is a schematic diagram of a generation record table provided by Embodiment 2 of the present application;

5 is a schematic diagram of a data storage space management method provided in Embodiment 2 of the present application;

6 is a schematic structural diagram of a data storage space management device provided in Embodiment 3 of the present application;

FIG. 7 is a schematic structural diagram of an electronic device according to Embodiment 5 of the present application.

Detailed ways

The present application will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application, but not to limit the present application. In addition, it should be noted that, for the convenience of description, the drawings only show some but not all the structures related to the present application.

Before discussing the exemplary embodiments in greater detail, it should be mentioned that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although the flowchart depicts the steps as a sequential process, many of the steps may be performed in parallel, concurrently, or concurrently. Furthermore, the order of the steps can be rearranged. The process may be terminated when its operation is complete, but may also have additional steps not included in the figures. The processes may correspond to methods, functions, procedures, subroutines, subroutines, and the like.

FIG. 1 is a schematic diagram of data storage space management provided by an embodiment of the present application. As shown in Figure 1, the recording data of IPC is evenly stored on each CDV in CLU1, and each CDV is only responsible for managing the recording data on its own server. Take CDV1 as an example: the metadata management of CDV takes the POL pool as the unit , check every 20 minutes, when it is detected that the total remaining capacity of the POL pool cannot meet the storage of any USR, it will report the insufficient capacity request to the DN, trigger the deletion mechanism, and start to check the remaining capacity of each USR under the POL pool one by one. When it is detected that the capacity of the USR is insufficient, DN deletes the oldest file in the order of the creation time of the stored video data in the current USR (delete the metadata of Time1 as shown in the figure, but the premise is to obtain all the data under the USR and sort, and then delete the oldest file. old time data), and update the capacity.

Among them, the nouns are indicated as follows:

CDM: Metadata management server, which provides metadata cluster management services.

CDV: Storage Node Management Server.

CLU: Storage cluster management unit, including multiple CDVs, responsible for the balanced storage of data.

VM: Monitoring business management server, responsible for various monitoring business management services.

DN: Data Node. Manages resources and is responsible for read and write control of data.

POL: Policy pool, which provides a virtualized resource pool for data storage. Its main function is to virtualize the resources provided by the underlying disk array, which can be scheduled and managed by upper-layer services.

IPC: IP Camera network camera. It is the development trend of IP video surveillance and high-definition video surveillance. The function of IPC is to integrate the camera and the encoder, digitize and compress the analog video and audio signals, form IP data packets, and transmit them to the specified destination address using the network.

USR: The virtual write address of the IPC, bound to the POL pool, and a virtual block of memory and path on the POL, responsible for the storage of the data written by the IPC.

From this, it can be seen that the current approach has the following problems:

1. With the access of diversified data storage, the storage capacity of USR depends on the acquisition of capacity and the calculation of upper-layer software. When the calculation is wrong or the acquired capacity is unreliable, the DN may delete the video when the actual capacity of the USR is sufficient. data, resulting in the shortening of the actual retention period of the corresponding camera;

2. When the DN cleans up the USR, the DN will obtain and sort all the data under the USR in advance. If there is a large amount of data, the DN will occupy a lot of memory, and the sorting process will take a long time, which will have a great impact on the server performance. ;

3. The DN is sorted based on the creation time of the video data (the data creation time is recorded with the server time as the timestamp during storage). When the server time jumps, the DN will first delete the video with the time jump, and the sorting method is different. Reasonable, affecting the continuity of video data.

In view of the above solutions and the existing technical problems, the present application provides the following technical solutions.

Example 1

FIG. 2 is a flowchart of a data storage space management method provided in Embodiment 1 of the present application. This embodiment is applicable to the monitoring and management of data storage space. The method can be implemented by the data storage space management device provided by the embodiment of the present application For execution, the apparatus can be implemented by software and/or hardware, and can be integrated into electronic devices such as smart terminals.

As shown in Figure 2, the data storage space management method includes:

S210. If a trigger condition for updating the capacity of the target data storage interval is detected, determine whether the trigger condition includes both a first trigger condition and a second trigger condition; wherein the first trigger condition includes a trigger generated based on the capacity space condition, and the second trigger condition includes a trigger condition generated based on a preset time rule.

The target data storage area may be a hardware device used for data storage or a specific part of the storage area of the hardware device, such as a hard disk, a mobile disk, a network disk, or a storage area of a server. Since the target data storage area is limited, in the storage process of data similar to video surveillance, the data will be continuously transmitted and saved, which will bring storage pressure to the fixed storage area. In order to save the data normally, after the stored data occupies a certain proportion of the storage area, it is necessary to delete the previously stored data. Since the remaining capacity of the storage section will be updated after deletion, the triggering condition for updating the capacity may be that the storage section meets the condition that the previously stored data needs to be deleted.

Taking the storage of surveillance camera data as an example, if the data is stored as one piece of video recorded every ten minutes, six pieces of data will be generated every hour. In the process of continuous recording, the storage area receives a piece of data every ten minutes for storage, and you can determine when the capacity needs to be updated according to the data size of the video recorded every ten minutes. Exemplarily, the data can be updated when the storage capacity reaches 90%, or after video data is received, it is determined that the current remaining capacity in the storage section is not enough to store the video data, and then the update needs to be performed.

In this embodiment, the first trigger condition is a trigger condition generated based on the capacity space. For example, in the above two examples, both are trigger conditions generated based on the capacity space. Besides, the trigger condition may further include a second trigger condition. The second trigger condition is a trigger condition generated based on a preset time rule, and exemplarily, the storage interval capacity may be updated every preset time.

S220. If both the first trigger condition and the second trigger condition are included, determine the data to be deleted from each data in the target data storage interval based on a preset rule, and perform a deletion operation on the to-be-deleted data.

Wherein, when the trigger condition includes both the first trigger condition and the second trigger condition, the capacity update operation on the data storage interval can be performed. Specifically, it can include determining the data to be deleted from the data in the target data storage interval, and A deletion operation is performed on the to-be-deleted data.

Wherein, based on the preset rule, it may be based on the duration of the data in the storage interval, or based on the sequence of time stamps when the data is stored. Exemplarily, when both the first trigger condition and the second trigger condition are satisfied, the earliest stored data may be deleted, thereby expanding the remaining capacity to store the received data. The advantage of this setting in this embodiment is that when determining whether to update the capacity based on space, there will be errors in reading the current capacity or the inability to read the data, which cannot guarantee the normal storage of the newly transmitted data, or if it is not necessary to delete it When the data is stored in the past, the data stored in the past will be deleted, the storage time of the data will be shortened, and the playback of the data content will be affected.

In the technical solutions provided by the embodiments of the present application, if a trigger condition for the update capacity of the target data storage interval is detected, it is determined whether the trigger condition includes both a first trigger condition and a second trigger condition; wherein, the first trigger condition The condition includes a trigger condition generated based on the capacity space, and the second trigger condition includes a trigger condition generated based on a preset time rule; if the first trigger condition and the second trigger condition are included at the same time, based on the preset rule, from the target data storage interval. The data to be deleted is determined in each data, and the deletion operation is performed on the to-be-deleted data. By adopting the technical solution provided by the present application, the effect of effectively managing the stored data according to the requirements, increasing the storage time of the data and not affecting the storage capability of the storage device for the newly incoming data is achieved.

On the basis of the above technical solution, optionally, the method for obtaining the first trigger condition includes: determining whether the first preset condition is met according to the size relationship between the remaining capacity space of the target data storage interval and the capacity requirement of the data to be stored ; if so, generate the first trigger condition. Determine the size relationship between the remaining capacity space of the target data storage interval and the capacity requirement of the data to be stored. If the remaining capacity space is already smaller than the capacity requirement of the data to be stored, the first trigger condition is generated, and if it is greater, the first trigger condition is not generated. The advantage of this technical solution is that the target data storage interval can be fully utilized, so as to increase the time length of data storage.

On the basis of the above technical solutions, optionally, the method for obtaining the second trigger condition includes: determining the A capacity timer of the target data storage interval; when the timing of the capacity timer meets the second preset condition, a second trigger condition is generated. Among them, the data storage rate of the target data storage interval can be obtained according to the statistics of historical storage data. For example, for the target data storage interval, it may store video information recorded by five cameras, and each camera stores it every 30 minutes. In this way, the data storage rate of the target storage section can be determined according to the size of the video data stored each time. Furthermore, according to the size of the remaining capacity space, it is determined how long it will take to cause the remaining capacity space to be insufficient to store new data. In this case, a second trigger condition can be generated. In this embodiment, it can be determined in the form of a capacity timer that when a certain specific value of the timer is reached, the second trigger condition is generated. The advantage of this technical solution is that it can avoid the problem of inaccurate capacity calculation data due to only determining whether to trigger the operation of updating the capacity based on the space, thereby improving the management effect of the data storage space.

On the basis of the above technical solutions, optionally, after detecting a triggering condition for the update capacity of the target data storage interval, the method further includes: if it is determined that the triggering condition includes a first triggering condition, and the target When the data storage interval reaches the first trigger condition for the first time, the data storage space capacity is updated based on the storage time of each data in the target data storage interval, and the time trigger mechanism is activated to generate the first trigger based on the preset time rule after activation. Two trigger conditions. In this solution, there may be a situation that when the data content of the target storage interval is not full, there is no need to control the storage efficiency. Therefore, it can be determined whether the first trigger condition is the first time, and if so, the capacity update operation can be directly performed, and the time trigger mechanism can be activated to generate the second trigger condition when the preset time rule is satisfied after activation. The preset time rule may be that after activation, it is determined that the preset time rule is satisfied when the timer reaches 1 hour. If the first trigger condition is not the first time, it means that the first trigger condition has been generated, and the data capacity of the target storage interval can be updated only when the first trigger condition and the second trigger condition are simultaneously received. The advantage of this technical solution is that the space management for data storage is ensured effectively, and the capacity update operation performed is accurate.

On the basis of the above technical solutions, optionally, before detecting the triggering condition for the update capacity of the target data storage interval, the method further includes: storing the data to be stored in the target data storage interval; wherein, the The data to be stored includes a mark field, and the mark field is used to store the mark value; correspondingly, the data to be deleted is determined from each data in the target data storage interval based on a preset rule, including: a mark based on the mark field of each data The value determines the data to be deleted. Among them, it can be a marked field when the data is generated, or a marked field is set for the data when the data is stored, which is used to mark the value. For example, if it is the first stored data, it can be marked as 0000, and the next one is 0001, and so on. Then, when the data is deleted, it can be determined according to the marked value which data is the earliest stored data, and then determined as the data to be deleted. In this technical solution, optionally, the date of the system can also be recorded, and when data needs to be deleted, the earliest stored batch of data can be first determined according to the date, and then the data to be deleted can be determined according to the marked value. In this way, the data to be deleted can be determined more quickly. At the same time, it can avoid the storage time jumping or recalling the system time due to system time or device reasons, so that the later stored data is preferentially deleted, which affects the playback of data content.

On the basis of the above technical solution, optionally, before determining the data to be deleted based on the marked value of the marked field of each data, the method further includes: generating a marked value record table; correspondingly, based on the marked value of each data's marked field Determining the data to be deleted by the marked value includes: determining the data to be deleted based on the marked value in the record table, and updating the record table after the data is deleted. Wherein, the record table may be stored separately, and when the data to be deleted needs to be determined, the record table may be read to determine the mark value of the data to be deleted, and then the data to be deleted may be determined. The content recorded in the record table may include the marked value. After deleting the data, the number in the data table can be updated. For example, after deleting the data with the number 0000, the number 0000 can be deleted from the record table, and the number value of the earliest stored data after deletion is 0001. In this embodiment, the record table may be a general table, or may be divided according to date, that is, a record table is generated every day, and other methods may also be used to flexibly set. The advantage of this setting is that the data to be deleted can be determined only according to the marked value in the record table, which is simple and quick.

On the basis of the above technical solutions, optionally, after generating the marked value record table, the method further includes: determining whether the first trigger condition is valid according to the number of marked values in the record table; wherein, if If the quantity exceeds the quota quantity threshold, it is determined that the first trigger condition is valid, and if the quantity does not exceed the quota quantity threshold, it is determined that the first trigger condition is invalid. Wherein, for example, the quota quantity threshold is 100, after receiving the first trigger condition, whether the first trigger condition is valid can be determined according to the number of marked values recorded in the record table. Exemplarily, if it exceeds 100, then is valid, if it does not exceed 100, it is invalid. The advantage of this setting is that the amount of data stored in the target storage interval can be reflected from the side based on the number of marked values in the record table, avoiding the situation where the data has not yet reached the need to delete data due to errors in reading the storage capacity. However, the first trigger condition is received, and the data deletion operation is performed, thereby affecting the storage time of the data.

Embodiment 2

In order to enable those skilled in the art to more accurately understand the technical solutions provided by the present application, the present application also provides a preferred embodiment.

FIG. 3 is a schematic diagram of data management provided by Embodiment 2 of the present application. As shown in Figure 3, the nouns are indicated as follows:

CDM: Metadata management server, which provides metadata cluster management services.

CDV: Storage Node Management Server.

CLU: Storage cluster management unit, including multiple CDVs, responsible for the balanced storage of data.

VM: Monitoring business management server, responsible for various monitoring business management services.

DN: Data Node. Manages resources and is responsible for read and write control of data.

POL: Policy Pool. Provides virtualized pools of different policies. The main function is to virtualize the underlying LV resources

IPC: IP Camera network camera. It is the development trend of IP video surveillance and high-definition video surveillance. The function of IPC is to integrate the camera and the encoder, digitize and compress the analog video and audio signals, form IP data packets, and transmit them to the specified destination address using the network.

USR: The virtual write address of the IPC, bound to the POL pool, and a virtual block of memory and path on the POL, responsible for the storage of the data written by the IPC.

The present invention improves and optimizes based on the original metadata basic management mode, adds and modifies the following three parts:

(1) Modify the file format of metadata storage, add a number field to the original file format, and number the files in the order in which they were created. At the same time, a record table is added to record the start and end numbers of each day's files in units of days;

(2) Modify the deletion mechanism, delete the oldest file without sorting, but directly access the record table generated during storage, find the oldest file according to the starting code, save sorting time, and eliminate the dependence of sorting on the creation time of video data sex;

(3) Modify the deletion trigger mechanism in the normal storage process of metadata. On the basis of the original judgment based on insufficient capacity, increase the capacity demand timer to ensure the rationality of deletion requirements in terms of deletion frequency and prevent capacity calculation. Unreasonable delete requests triggered by errors.

FIG. 4 is a schematic diagram of a generation record table provided by Embodiment 2 of the present application. As shown in Figure 4, when the DN deletes the oldest file of the USR, it directly searches the first record (the first inserted record) of the USR in the record table, and directly finds and uses the USR, date (Day) and StartNum information. Delete the corresponding recording data, and then update StartNum. If the recording data of the day has been deleted, delete the record of the day in the data table.

FIG. 5 is a schematic diagram of a data storage space management method provided by Embodiment 2 of the present application. As shown in Figure 5, when an alarm is issued when the USR capacity is insufficient, it is first necessary to determine whether the insufficient capacity alarm is valid. If it is determined to be valid, it will be sent to the DN. The basis for determination is to calculate how many files have been written to the current USR according to the record table generated by the storage, and determine whether the quota capacity threshold has been reached according to the number of files. If the quota capacity threshold is exceeded, the insufficient capacity alarm is determined to be valid, otherwise it is determined to be invalid , do not send to DN.

At the beginning, the capacity requirement timer is in the off state. When the DN receives the first valid capacity shortage alarm from the USR, it judges that if the current timer is in the off state, it directly performs the capacity processing operation, deletes the oldest file, and updates the USR. capacity, activate the timer at the same time, and set the initial time for the timer.

After the timer is activated, when the USR reports that the DN capacity is insufficient again, the DN will determine whether the timer also issues an alarm. If the timer has already alarmed, the capacity processing operation will be performed, the oldest file will be deleted, the USR capacity will be updated, and the timer will be initialized. The set value of ; if the timer does not alarm at this time, it will be ignored and not processed.

According to the time span of the current latest file storage, combined with the optimization formula of laboratory test data, a reasonable value is calculated as the set value of the timer.

The technical solution provided by this application starts from the two aspects of "validity of insufficient capacity request" and "frequency of capacity demand", and manages the life cycle of video metadata based on satisfying the two conditions of time and space at the same time. When the USR sends a capacity shortage request, according to the validity of the capacity request, combined with the correctness of the demand rate of the capacity, the data is deleted in a stable and orderly manner, and the storage period of the metadata is double guaranteed. Reduce the dependence of metadata management on the timeline, always manage according to the principle of first-in, first-out, and objectively ensure the reasonable change of metadata.

By adopting the above technical solutions, metadata management starts from both time and space. On the one hand, it will determine whether the alarm for insufficient capacity is valid, preventing false alarms from being issued when the capacity acquisition is "unreliable"; on the other hand, it controls the deletion from the frequency of capacity demand. The data frequency keeps the capacity update at a certain "rate", so as to effectively protect the data from being deleted by other abnormal situations. Delete files in the order in which they are written, and does not depend on the server's timeline. When a time jump occurs on the server, the management of metadata is not affected.

Embodiment 3

FIG. 6 is a schematic structural diagram of a data storage space management apparatus provided in Embodiment 3 of the present application. As shown in Figure 6, the data storage space management device includes:

The trigger condition judgment module 610 is configured to determine whether the trigger condition includes both the first trigger condition and the second trigger condition if the trigger condition of the update capacity of the target data storage interval is detected; wherein, the first trigger condition includes A trigger condition generated based on the capacity space, the second trigger condition includes a trigger condition generated based on a preset time rule;

The data deletion module 620 is configured to determine the data to be deleted from each data in the target data storage interval based on a preset rule if the trigger condition judgment module judges that both the first trigger condition and the second trigger condition are included, and to The data to be deleted is deleted.

In the technical solutions provided by the embodiments of the present application, if a trigger condition for the update capacity of the target data storage interval is detected, it is determined whether the trigger condition includes both a first trigger condition and a second trigger condition; wherein, the first trigger condition The condition includes a trigger condition generated based on the capacity space, and the second trigger condition includes a trigger condition generated based on a preset time rule; if the first trigger condition and the second trigger condition are included at the same time, based on the preset rule, from the target data storage interval. The data to be deleted is determined in each data, and the deletion operation is performed on the to-be-deleted data. By adopting the technical solution provided by the present application, the effect of effectively managing the stored data according to the requirements, increasing the storage time of the data and not affecting the storage capability of the storage device for the newly incoming data is achieved.

On the basis of the above technical solutions, optionally, the method for obtaining the first trigger condition includes:

Determine whether the first preset condition is met according to the size relationship between the remaining capacity space of the target data storage interval and the capacity requirement of the data to be stored;

If so, a first trigger condition is generated.

On the basis of the above technical solutions, optionally, the method for obtaining the second trigger condition includes:

Determine the capacity timer of the target data storage section according to the remaining capacity space of the target data storage section and according to the data storage rate of the target data storage section;

When the timing of the capacity timer meets the second preset condition, a second trigger condition is generated.

On the basis of the above technical solutions, optionally, the device further includes:

The second trigger condition activation module is configured to: if it is determined that the trigger condition includes the first trigger condition, and the target data storage interval reaches the first trigger condition for the first time, then based on the storage time of each data in the target data storage interval The storage space capacity is updated, and the activation time trigger mechanism works, so as to generate a second trigger condition based on a preset time rule after activation.

On the basis of the above technical solutions, optionally, the device further includes:

a data labeling module, used for storing the data to be stored in the target data storage interval; wherein, the data to be stored includes a label field, and the label field is used to store the label value;

Correspondingly, the data deletion module is specifically used for:

The data to be deleted is determined based on the tag value of the tag field of each data.

On the basis of the above technical solutions, optionally, the device further includes:

The record table generation module is used to generate the mark value record table;

Correspondingly, the data deletion module is specifically used for:

The data to be deleted is determined based on the marked value in the record table, and the record table is updated after the data is deleted.

The above product can execute the method provided by any embodiment of the present application, and has functional modules and beneficial effects corresponding to the execution method.

Embodiment 4

Embodiments of the present application further provide a storage medium containing computer-executable instructions, where the computer-executable instructions are used to execute a data storage space management method when executed by a computer processor, and the method includes:

If a trigger condition for updating the capacity of the target data storage interval is detected, it is determined whether the trigger condition includes both a first trigger condition and a second trigger condition; wherein, the first trigger condition includes a trigger condition generated based on the capacity space, The second trigger condition includes a trigger condition generated based on a preset time rule;

If both the first trigger condition and the second trigger condition are included, the data to be deleted is determined from each data in the target data storage interval based on the preset rule, and the deletion operation is performed on the data to be deleted.

storage medium - any of various types of memory devices or storage devices. The term "storage medium" is intended to include: installation media, such as CD-ROMs, floppy disks, or tape devices; computer system memory or random access memory, such as DRAM, DDR RAM, SRAM, EDO RAM, Rambus RAM, etc. ; non-volatile memory, such as flash memory, magnetic media (eg hard disk or optical storage); registers or other similar types of memory elements, etc. The storage medium may also include other types of memory or combinations thereof. In addition, the storage medium may be located in the computer system in which the program is executed, or may be located in a different second computer system connected to the computer system through a network such as the Internet. The second computer system may provide program instructions to the computer for execution. The term "storage medium" may include two or more storage media that may reside in different locations (eg, in different computer systems connected by a network). The storage medium may store program instructions (eg, embodied as a computer program) executable by one or more processors.

Of course, a storage medium containing computer-executable instructions provided by the embodiments of the present application, the computer-executable instructions of which are not limited to the above-mentioned data storage space management operations, and can also perform data storage provided by any embodiment of the present application. Related operations in space management methods.

Embodiment 5

The embodiments of the present application provide an electronic device, in which the data storage space management apparatus provided by the embodiments of the present application can be integrated. FIG. 7 is a schematic structural diagram of an electronic device according to Embodiment 5 of the present application. As shown in FIG. 7 , this embodiment provides an electronic device 700, which includes: one or more processors 720; and a storage device 710 for storing one or more programs, when the one or more programs are The one or more processors 720 execute, so that the one or more processors 720 implement the data storage space management method provided by the embodiment of the present application, and the method includes:

If a trigger condition for updating the capacity of the target data storage interval is detected, it is determined whether the trigger condition includes both a first trigger condition and a second trigger condition; wherein, the first trigger condition includes a trigger condition generated based on the capacity space, The second trigger condition includes a trigger condition generated based on a preset time rule;

If both the first trigger condition and the second trigger condition are included, the data to be deleted is determined from each data in the target data storage interval based on the preset rule, and the deletion operation is performed on the data to be deleted.

Of course, those skilled in the art can understand that the processor 720 also implements the technical solution of the data storage space management method provided by any embodiment of the present application.

The electronic device 700 shown in FIG. 7 is only an example, and should not impose any limitations on the functions and scope of use of the embodiments of the present application.

As shown in FIG. 7 , the electronic device 700 includes a processor 720 , a storage device 710 , an input device 730 and an output device 740 ; the number of processors 720 in the electronic device may be one or more, and one processor 720 is used in FIG. 7 . For example; the processor 720 , the storage device 710 , the input device 730 and the output device 740 in the electronic device may be connected by a bus or in other ways, and the connection by the bus 750 is taken as an example in FIG. 7 .

As a computer-readable storage medium, the storage device 710 may be used to store software programs, computer-executable programs, and module units, such as program instructions corresponding to the data storage space management method in the embodiments of the present application.

The storage device 710 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the storage data area may store data created according to the use of the terminal, and the like. Additionally, storage device 710 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid-state storage device. In some examples, storage device 710 may further include memory located remotely from processor 720, the remote memory may be connected through a network. Examples of such networks include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

The input device 730 may be used to receive inputted numbers, character information or voice information, and generate key signal input related to user settings and function control of the electronic device. The output device 740 may include a display screen, a speaker, and the like.

The electronic device provided by the embodiment of the present application can effectively manage the stored data according to the requirements, and the storage time of the data is increased without affecting the storage capability of the storage device for the new data.

The data storage space management apparatus, storage medium and electronic device provided in the above embodiments can execute the data storage space management method provided by any embodiment of the present application, and have corresponding functional modules and beneficial effects for executing the method. For technical details not described in detail in the foregoing embodiments, reference may be made to the data storage space management method provided by any embodiment of the present application.

Note that the above are only preferred embodiments of the present application and applied technical principles. Those skilled in the art will understand that the present application is not limited to the specific embodiments described herein, and various obvious changes, readjustments and substitutions can be made by those skilled in the art without departing from the protection scope of the present application. Therefore, although the present application has been described in detail through the above embodiments, the present application is not limited to the above embodiments, and can also include more other equivalent embodiments without departing from the concept of the present application. The scope is determined by the scope of the appended claims.

Claims (9)

1. a data storage space management method, is characterized in that, comprises: If a trigger condition for updating the capacity of the target data storage interval is detected, it is determined whether the trigger condition includes both a first trigger condition and a second trigger condition; wherein, the first trigger condition includes a trigger condition generated based on the capacity space, The second trigger condition includes a trigger condition generated based on a preset time rule; If both the first trigger condition and the second trigger condition are included, determining data to be deleted from each data in the target data storage interval based on a preset rule, and performing a deletion operation on the data to be deleted; Wherein, the manner of obtaining the second trigger condition includes: Determine the capacity timer of the target data storage section according to the remaining capacity space of the target data storage section and according to the data storage rate of the target data storage section; When the timing of the capacity timer meets the second preset condition, a second trigger condition is generated. 2. The method according to claim 1, wherein the obtaining method of the first trigger condition comprises: Determine whether the first preset condition is met according to the size relationship between the remaining capacity space of the target data storage interval and the capacity requirement of the data to be stored; If so, a first trigger condition is generated. 3. The method according to any one of claims 1-2, wherein after detecting the triggering condition of the update capacity of the target data storage interval, the method further comprises: If it is determined that the trigger condition includes the first trigger condition, and the target data storage interval reaches the first trigger condition for the first time, the data storage space capacity is updated based on the storage time of each data in the target data storage interval, and activated The time trigger mechanism works to generate a second trigger condition based on a preset time rule after activation. 4. The method according to any one of claims 1-2, characterized in that, before detecting the triggering condition of the update capacity of the target data storage interval, the method further comprises: storing the data to be stored in the target data storage interval; wherein, the data to be stored includes a marker field, and the marker field is used to store a marker value; Correspondingly, the data to be deleted is determined from each data in the target data storage interval based on the preset rules, including: The data to be deleted is determined based on the tag value of the tag field of each data. 5. The method according to claim 4, wherein before determining the data to be deleted based on the marked value of the marked field of each data, the method further comprises: Generate mark value record table; Correspondingly, the data to be deleted is determined based on the marked value of the marked field of each data, including: The data to be deleted is determined based on the marked value in the record table, and the record table is updated after the data is deleted. 6. The method according to claim 5, wherein after generating the marked value record table, the method further comprises: Whether the first trigger condition is valid is determined according to the number of marked values in the record table; wherein, if the quantity exceeds the quota quantity threshold, it is determined that the first trigger condition is valid, and if the quantity does not exceed the quota quantity threshold , it is determined that the first trigger condition is invalid. 7. A data storage space management device, comprising: The trigger condition judgment module is configured to determine whether the trigger condition includes a first trigger condition and a second trigger condition at the same time if the trigger condition of the update capacity of the target data storage interval is detected; wherein, the first trigger condition includes based on a trigger condition generated by the capacity space, and the second trigger condition includes a trigger condition generated based on a preset time rule; A data deletion module, configured to determine the data to be deleted from each data in the target data storage interval based on a preset rule if the trigger condition judgment module determines that both the first trigger condition and the second trigger condition are included, and perform a Deleting the data to be deleted and performing the deletion operation; Wherein, the manner of obtaining the second trigger condition includes: Determine the capacity timer of the target data storage section according to the remaining capacity space of the target data storage section and according to the data storage rate of the target data storage section; When the timing of the capacity timer meets the second preset condition, a second trigger condition is generated. 8. A computer-readable storage medium on which a computer program is stored, characterized in that, when the program is executed by a processor, the data storage space management method according to any one of claims 1-6 is implemented. 9. An electronic device comprising a memory, a processor and a computer program stored on the memory and running on the processor, characterized in that, when the processor executes the computer program, any one of claims 1-6 is realized. The one described data storage space management method.

Images