CN113676688A

CN113676688A - Periodic storage method, device, equipment and medium

Info

Publication number: CN113676688A
Application number: CN202110920619.4A
Authority: CN
Inventors: 颜寒松
Original assignee: Kelong Shijing Biotechnology Shanghai Co ltd
Current assignee: Kelong Shijing Biotechnology Shanghai Co ltd
Priority date: 2021-08-11
Filing date: 2021-08-11
Publication date: 2021-11-19

Abstract

The application provides a periodic storage method, a device, equipment and a medium, which can continuously store M real-time video recording image data sets by providing a storage space; after the first round of M image data sets are stored in the storage space, respectively detecting the reserved value of each image data unit in each stored and to-be-stored image data set by using an image detection algorithm; the stored x image data units with the lowest retention value in each image data set are respectively replaced by the x image data units with the highest retention value in each image data set to be stored, so that the multi-round periodic storage corresponding to the shooting and recording period is realized. The method and the device can further improve the storage efficiency, store more core useful information with longer time by using limited space, and organically combine shooting, storage and transmission by utilizing the characteristic of sectional shooting of periodic shooting, so that the process is more automatic, intelligent, effective and stable in coordination.

Description

Periodic storage method, device, equipment and medium

Technical Field

The present application relates to the field of data storage technologies, and in particular, to a method, an apparatus, a device, and a medium for periodic storage.

Background

In some application fields, the real-time recording, storing and transmitting processes need to be automatically completed. But how can more core information be automatically stored in cases where local storage space is limited in some circumstances not controllable?

The automatically captured video information (e.g., image data) usually needs to be automatically stored in the local storage medium in real time, so that a local storage space specially configured for storing the video information is needed. Generally, when the local storage space is sufficient, the automatically recorded information can be all stored in the local storage space in real time. However, when the local storage space is full due to long-time recording, the earliest stored information is deleted in time sequence, the latest recorded information is stored, and the earliest information is covered by new information in batches in real time, and most monitoring devices or recorders adopt the mode at present.

However, the storage method has some defects that the storage efficiency is too low, too much invalid information is often stored in a limited space, and some really useful information is often deleted.

Therefore, how to further improve the storage efficiency and store the core useful information with a limited space for a longer time as much as possible is an urgent problem to be solved in the present application.

Disclosure of Invention

In view of the above-mentioned shortcomings of the prior art, an object of the present application is to provide a periodic storage method, apparatus, device and medium for solving at least one of the existing problems.

To achieve the above and other related objects, the present application provides a periodic storage method, including: providing a storage space for continuously storing M real-time shot image data sets; the image data set is obtained by continuously shooting and recording in a sectional mode according to a preset shooting and recording period; each image data set comprises n image data units; when the first round of M image data sets is full of the storage space, respectively detecting the reserved value of each image data unit in each image data set which is stored and is to be stored after the first round by using an image detection algorithm; the stored x image data units with the lowest retention value in each image data set are respectively replaced by the x image data units with the highest retention value in each image data set to be stored, so that the multi-round periodic storage corresponding to the shooting and recording period is realized.

In an embodiment of the present application, the method includes: when the second round of M image data sets are stored, replacing the stored x image data units with the lowest retention value in the first round of first image data sets with the x image data units with the highest retention value in the first image data sets to be stored; by parity of reasoning, the storage of the second image data set to the Mth image data set of the second round is respectively completed, so that the storage of the M image data sets of the second round is completed; when the M image data sets of the k-th round are stored, replacing the x image data units with the highest retention value in the first image data set to be stored in the round with the x image data units with the lowest retention value in the remaining n-x (k-2) image data units which are not replaced in the first image data set stored in the previous k-1 round; wherein k is a natural number not less than 2; by parity of reasoning, the storage of the second image data set to the Mth image data set is respectively completed so as to complete the storage of the Mth image data set in the k-th round; wherein, the replacement value x representing the number of replacing the image data units is a preset fixed value; wherein the value of x is minimum 1 and maximum not more than n; when x is set to 1, the storage space can store n rounds of M image data sets at most.

In an embodiment of the present application, the value of the replacement value x may be adjusted according to a recording duration or a size of pre-stored data; when the shooting time is longer or the pre-stored data is larger, the x value can be reduced; on the contrary, when the recording time is short or the pre-stored data is large, the x value can be increased.

In one embodiment of the present application, the reserved value relates to sharpness and critical/valid information contained; wherein, the most clear image data unit containing the most key information/effective information has the highest retention value; the image data unit with the most blur and the least key information/valid information is the least reserved value.

In an embodiment of the present application, the reference factors for determining the key information/valid information include: any one or more of reference object type, priority of reference object type, reference object size, reference object distance, reference object brightness, reference object number, reference object motion, and reference object sound.

In an embodiment of the present application, the method further includes: one or more image data units in an image data set are continuously and sectionally shot and recorded according to a preset shooting and recording period, and timely and synchronously and periodically stored according to the shooting and recording period; or, one or more image data units in the M image data sets of the storage space are periodically transmitted corresponding to the recording period.

To achieve the above and other related objects, the present application provides a periodic storage device, comprising: the configuration module is used for providing a storage space for continuously storing M real-time shot and recorded image data sets; the image data set is obtained by continuously shooting and recording in a sectional mode according to a preset shooting and recording period; each image data set comprises n image data units; the processing module is used for respectively detecting the reserved values of all image data units in each image data set which is stored and is to be stored after the first round by using an image detection algorithm after the first round of M image data sets are stored in the storage space; the stored x image data units with the lowest retention value in each image data set are respectively replaced by the x image data units with the highest retention value in each image data set to be stored, so that the multi-round periodic storage corresponding to the shooting and recording period is realized.

To achieve the above and other related objects, there is provided a processing apparatus, comprising: a memory, a processor, and a communicator; the memory is to store computer instructions; the processor executes computer instructions to implement the method as described above; the communicator is used for being in communication connection with the shooting, storing and transmitting integrated equipment so as to receive image data shot and recorded by the shooting, storing and transmitting integrated equipment in real time; and the communicator is also used for transmitting the stored image data to the outside.

To achieve the above and other related objects, the present application provides a shooting, storing and transmitting integrated device, including: the processing apparatus as described above; a camera for recording; the data card is used for storing image data; and the communicator is used for transmitting the image data.

To achieve the above and other related objects, the present application provides a computer readable storage medium storing computer instructions which, when executed, perform the method as described above.

In summary, the present application provides a periodic storage method, apparatus, device and medium, which provides a storage space for continuously storing M real-time recorded image data sets; the image data set is obtained by continuously shooting and recording in a sectional mode according to a preset shooting and recording period; each image data set comprises n image data units; when the first round of M image data sets is full of the storage space, respectively detecting the reserved value of each image data unit in each image data set which is stored and is to be stored after the first round by using an image detection algorithm; the stored x image data units with the lowest retention value in each image data set are respectively replaced by the x image data units with the highest retention value in each image data set to be stored, so that the multi-round periodic storage corresponding to the shooting and recording period is realized.

The following beneficial effects are achieved:

the storage method can further improve the storage efficiency, store more core useful information with longer time by using limited space, and organically combine shooting, storage and transmission by utilizing the characteristic of sectional shooting of periodic shooting, so that the processes of instant shooting, storage and transmission are more automatic, intelligent, effective and stable in coordination.

Drawings

Fig. 1 is a schematic flowchart of a periodic storage method in an embodiment of the present application.

Fig. 2 is a scene schematic diagram of an image data set according to an embodiment of the present application.

Fig. 3 is a schematic diagram of a periodic memory in an embodiment of the present application.

FIG. 4 is a block diagram of a periodic memory device according to an embodiment of the present disclosure.

Fig. 5 is a schematic structural diagram of a processing apparatus in an embodiment of the present application.

Fig. 6 is a schematic structural diagram of a shooting, storing and transmitting integrated device in an embodiment of the present application.

Detailed Description

The following description of the embodiments of the present application is provided by way of specific examples, and other advantages and effects of the present application will be readily apparent to those skilled in the art from the disclosure herein. The present application is capable of other and different embodiments and its several details are capable of modifications and/or changes in various respects, all without departing from the spirit of the present application. It should be noted that the embodiments and features of the embodiments in the present application may be combined with each other without conflict.

Embodiments of the present application will be described in detail below with reference to the accompanying drawings so that those skilled in the art to which the present application pertains can easily carry out the present application. The present application may be embodied in many different forms and is not limited to the embodiments described herein.

In order to clearly explain the present application, components that are not related to the description are omitted, and the same reference numerals are given to the same or similar components throughout the specification.

Throughout the specification, when a component is referred to as being "connected" to another component, this includes not only the case of being "directly connected" but also the case of being "indirectly connected" with another element interposed therebetween. In addition, when a component is referred to as "including" a certain constituent element, unless otherwise stated, it means that the component may include other constituent elements, without excluding other constituent elements.

Although the terms first, second, etc. may be used herein to describe various elements in some instances, these elements should not be limited by these terms. These terms are only used to distinguish one element from another. For example, the first interface and the second interface, etc. are described. Also, as used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context indicates otherwise. It will be further understood that the terms "comprises," "comprising," "includes" and/or "including," when used in this specification, specify the presence of stated features, steps, operations, elements, components, items, species, and/or groups, but do not preclude the presence, or addition of one or more other features, steps, operations, elements, components, species, and/or groups thereof. The terms "or" and/or "as used herein are to be construed as inclusive or meaning any one or any combination. Thus, "A, B or C" or "A, B and/or C" means "any of the following: a; b; c; a and B; a and C; b and C; A. b and C ". An exception to this definition will occur only when a combination of elements, functions, steps or operations are inherently mutually exclusive in some way.

The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. As used herein, the singular forms "a", "an" and "the" include plural forms as long as the words do not expressly indicate a contrary meaning. The term "comprises/comprising" when used in this specification is taken to specify the presence of stated features, regions, integers, steps, operations, elements, and/or components, but does not exclude the presence or addition of other features, regions, integers, steps, operations, elements, and/or components.

Terms indicating "lower", "upper", and the like relative to space may be used to more easily describe a relationship of one component with respect to another component illustrated in the drawings. Such terms are intended to include not only the meanings indicated in the drawings, but also other meanings or operations of the device in use. For example, if the device in the figures is turned over, elements described as "below" other elements would then be oriented "above" the other elements. Thus, the exemplary terms "under" and "beneath" all include above and below. The device may be rotated 90 or other angles and the terminology representing relative space is also to be interpreted accordingly.

In some application fields, the real-time recording, storing and transmitting processes need to be automatically completed. How can enough clear core useful information be automatically recorded under the condition that the environment is not controllable? How can more core information be automatically stored in the case of limited local storage space? How to transmit enough core information in real time in the case where the transmission speed is difficult to secure?

In order to solve the problems, the application provides a set of reasonable and feasible method and corresponding equipment for instant shooting, recording, storing and transmitting, so that the process is sufficiently automatic, intelligent, effective and stable. The reserved values of the stored and to-be-stored image data units are respectively detected for the image data sets obtained by periodic shooting, and the multi-round periodic storage can be realized by replacing the image data units with low reserved values by high reserved values, so that sufficient core information can be transmitted in real time conveniently.

The video data referred to in the present application is not limited to information data such as pictures or videos, and may include data in the form of audio, wave, sequence, or the like. In the present application, the picture and video information are mainly used as an example for explanation, and other information is generally less complex than the picture and video information, and can be analogized by using the same principle.

Fig. 1 is a schematic flow chart illustrating a periodic storage method according to an embodiment of the present application. As shown, the method comprises:

step S101: providing a storage space for continuously storing M real-time shot image data sets; the image data set is obtained by continuously shooting and recording in a sectional mode according to a preset shooting and recording period; each image data set includes n image data units.

For example, the storage space may be an existing storage space, may be provided by inserting an additional data card or a removable and portable storage medium, or may be a storage space divided from a storage medium with a large storage space, such as a removable hard disk or a solid state disk. That is, the storage space in the present application may be a storage space of a recorder of an existing monitoring or wearable device or a portable device, may be a storage space externally inserted or configured, and may be an independent, dedicated storage space or a storage space divided therefrom.

It should be noted that, the storage space in the present application is not limited to the size of the space, that is, the size of the storage space of the recorder of the existing monitoring or wearable device or portable device may also be the size of the storage space itself, the size of the single storage space may also be additionally inserted or configured, the super storage space of the independent and dedicated storage space may also be the super storage space, and a part of the storage space partitioned from the super storage space may also be the super storage space.

On one hand, the storage method of the application has no requirement on storage space, and the storage space of any existing device or storage medium can meet the method of the application. And the storage space of any storage device or medium is limited, so that the storage device or medium is full, and the application focuses on processing the stored data after storage so as to continuously store valuable image data and not lose the stored valuable core image data.

On the other hand, the focus of the present application is not on how many M are stored, but on how to reasonably replace the stored data with the data to be stored in the following.

Since the memory requirement of one image data set is usually very small, a general storage device or medium can store a plurality of image data sets. Of course, it is also possible to estimate how many image data sets can be stored by knowing the storage space in advance.

The present application provides a method for replacing video data, which replaces non-high-definition or invalid video data with low retention value by retaining high-definition or valid video data with high retention value, so as to store video data with more duration and not lose valid core information.

In an embodiment of the present application, the image data set is continuously captured in a sectional manner according to a predetermined capturing period; each image data set comprises n image data units, and the specific recording method comprises the following steps: presetting a shooting and recording period; and carrying out continuous sectional type shooting according to the shooting cycle so as to continuously obtain an image data set which corresponds to each shooting cycle and comprises a plurality of image data units.

As shown in fig. 2, a scene diagram of an image data set is shown. As shown, the first capturing period T1 corresponds to the capturing of the first image data set 1, each image data set includes n image data units, and so on, M image data sets can be captured.

For example, the image data set may be a video of a period of time, or a plurality of pictures taken continuously, or data in different forms such as audio; the video data unit refers to smaller data content, such as a frame of a video, a picture in a picture set, an audio segment per second in an audio, and so on.

The setting of the recording period comprises the following steps: 1) setting according to a preset shooting and recording time length; or, 2) setting according to the preset shooting number; or 3) setting according to the combination of the preset shooting time and the preset shooting number.

Preferably, the preset recording duration and the preset recording number are fixed values or series of numbers which change according to a preset rule.

In an embodiment of the present application, in order to obtain clear and more core useful information in real time during automatic recording, the recording process is set to be automatic periodic recording, and the duration of each recording period is T.

For example, T may be set to a fixed value, for example, T may be set to 500 milliseconds, or 2 seconds, or 3 seconds, etc., as the actual situation requires.

In another embodiment of the present application, the recording period T can also be set to a variable sequence as required.

The sequence of changes may be, for example, incremental or decremental.

In some other embodiments, the recording period T can be adjusted and changed according to the scene change.

The key factors of the thought are as follows: if it is assumed that each recording cycle can be followed by corresponding image data for extracting a piece of core information, the shorter the recording cycle of the key time period is, the more core information can be extracted.

For example, the recording period may be decreased when a moving object is detected by the on-board recorder, and increased when a moving object is not detected.

For another example, the scene conditions can also be changed like light and shadow, and when the change is faster, the shooting cycle is shorter, and vice versa; or, the more people detected, the shorter the recording period, and vice versa, and so on. In a word, the more and the faster the scene change in a shot is, the shorter the shooting cycle is; and when the scene change is less and slower, the shooting cycle is longer.

In addition, the periodic recording process may also be set in reverse, that is, the number of frames n of the video pictures to be recorded in each period is set, n may be a fixed number, or may be a certain number, and assuming that the duration of recording each frame of video pictures is T, each recording period T is n × T + the duration of single autofocus.

Step S102: and when the first round of M image data sets is full of the storage space, respectively detecting the reserved value of each image data unit in each image data set which is stored and is to be stored after the first round by using an image detection algorithm.

In an embodiment of the present application, one or more image data units in an image data set that is continuously and segmentally captured according to a predetermined capturing period are periodically stored in time and synchronously according to the capturing period.

In short, the automatic storage process is also set as periodic storage, the storage period is the same as the preset recording period, that is, the T time is taken as a storage period, and one or more image data units in the continuous segmented recorded image data set are periodically stored in real time and synchronously. For example, if an image data set including n image data units is acquired in one shooting cycle, the image data units of the image data set are synchronously stored; and after the shooting of the image data set acquired in the next shooting and recording period is finished, synchronously storing the next image data set.

Preferably, the storage period may be equal to the recording period, or may be an integer multiple of the recording period.

In the present application, the retention value relates to the definition and the key/valid information contained; wherein, the most clear image data unit containing the most key information/effective information has the highest retention value; the image data unit that is the most blurred and contains the least key information/valid information has the lowest retention value.

In particular, the reserved value relates to the definition and the key/valid information contained. On one hand, because of the relationship of light, brightness, object motion speed and the like, the situation that the information reading is affected by blurring or ghosting and the like sometimes occurs in the shot image data (such as pictures or video clips or certain frames of video) is, the better the definition of the image data is, the more worth keeping, or the poorer the definition of the image data is, the more the image data should be deleted; on the other hand, the key information or the effective information is mainly used for determining objects or reference objects which are concerned by certain scene requirements or user requirements. For example, in a traffic or vehicle-related place, a vehicle, a license plate number and the like are relatively concerned, and in a recorder scene of a security monitoring or wearable device or a portable device, a human face, an action or a voice is relatively concerned. I.e., when the content of interest is included, it is equivalent to including key information/valid information. Thus, the present application determines the retention value in two dimensions, the clarity and the key/valid information contained.

In one or more embodiments, a common detection method such as an image detection algorithm, an object detection algorithm, a voice recognition algorithm, or the like may be used to detect a reference object in an image or a video, determine what object belongs to (e.g., identify an image or an object such as a vehicle), track a motion, monitor a sound, or the like. Assuming that the image data is a picture or a video, the size, distance, brightness, quantity and other contents of the reference object can be further detected.

In one embodiment of the present application, the reference object includes: any one or more of human face, number, letter, character, building, animal and object.

For example, in some scenarios, for example, in application scenarios of devices such as monitors and recorders, people's faces that are interested in shooting are compared, and besides, the key information that is also interested in shooting is numbers, letters, and the like, such as license plate information and the like, and other objects, such as buildings, animals, and objects, such as vehicles, trunks, and mobile phones, are also compared. There may be a ranking of reference object priorities such as face > number > letter > other objects.

It should be noted that the priority is only possible to provide the ordering corresponding to some scenarios, but the present application is not limited to the above-mentioned exemplary references. For example, in a traffic environment, a monitor focuses more on a reference object of a vehicle and a pedestrian, and the vehicle and the pedestrian may be used as the reference object and arranged at a position with higher priority.

In short, the retention value in the present application is used as an evaluation index for the user to retain the image data. For example, under the same condition or similar conditions, the image data (such as pictures) has more reserved value of high definition than low definition; alternatively, in certain scenarios such as recorders for monitoring or wearable devices, portable devices, it may be more valuable to include face information than no front face or no portrait, or to include digital information (such as a license plate) than no digital information or no vehicle information, etc.

Step S103: the stored x image data units with the lowest retention value in each image data set are respectively replaced by the x image data units with the highest retention value in each image data set to be stored, so that the multi-round periodic storage corresponding to the shooting and recording period is realized.

As shown in fig. 3, a schematic diagram of the periodic storage of the present application is shown. As shown in the figure, specifically, when the second round of M image data sets is stored, the x image data units with the highest retention value in the first image data set to be stored are replaced with the x image data units with the lowest retention value in the first image data set of the first round that has been stored; and by parity of reasoning, the storage of the second image data set to the Mth image data set is respectively completed, so that the storage of the M image data sets in the second round is completed.

Further, when the k round of M image data sets are stored, replacing the x image data units with the highest retention value in the first image data set to be stored with the x image data units with the lowest retention value in the remaining n-x (k-2) image data units in the stored first image data set; wherein k is a natural number not less than 2; and by parity of reasoning, the storage of the second image data set to the Mth image data set is respectively completed, so that the storage of the Mth image data set in the k-th round is completed.

Wherein, the replacement value x representing the number of replacing the image data units is a preset fixed value; wherein the value of x is minimum 1 and maximum not more than n; when x is set to 1, the storage space can store at most n rounds of M image data sets.

In an embodiment of the present application, the value of the replacement value x may be adjusted according to a recording duration or a size of pre-stored data; when the shooting time is longer or the pre-stored data is larger, the x value can be reduced; conversely, when the recording time is shorter or the pre-stored data is smaller, the x value can be increased.

In short, the x value can be adjusted according to the recording duration or the size of the pre-stored data according to the specific recording environment and setting. For example, when the recording time is long, such as a recorder or a monitor, since it usually works continuously, the recorded image data thereof must store a large amount of unattended or repeated content, i.e. the occurrence frequency of the retainable image data is low, so that the value x can be reduced appropriately, i.e. the number of image data units corresponding to each recording cycle that need to be retained is reduced; on the contrary, if the portable law enforcement recorder is manually started, because each frame of picture recorded by the portable law enforcement recorder has high utilization and reference values, the occurrence frequency of the image data which can be preserved is high, and therefore the x value can be properly increased, namely the quantity which needs to be preserved in the image data unit corresponding to each shooting cycle is increased.

To further clarify the storage method of the present application, the following is exemplified by a multi-round periodic automatic storage embodiment:

in the first round, during the periodic storage, the automatic storage of the multiple image data sets periodically shot in real time is performed from the 1 st T period (which is a shooting period and also corresponds to a storage period) to the 2 nd T period, … …, until the M th T period. And storing the current n frames of pictures instantly every T period. After the automatic storage of the M-th T period is completed, the set storage space is full, and M x n frames of pictures are stored in total. In the n frames of pictures in each T period, the difference among a plurality of pictures is not large, and the similarity is high, so that more repeated information is stored in the pictures, and the storage efficiency has a larger space for improvement.

And in the second round, continuously carrying out periodic automatic storage, and carrying out intelligent image detection on the information when the 1 st T period shooting and recording information of the second round is to be stored: on one hand, detecting n frames of picture information stored in the 1 st T period of the previous round, reserving 1 picture containing most clear core information (note: x is 1 as an example, and can be set to other numbers smaller than n, and the principle is the same), and deleting the rest (n-1) pictures; on the other hand, n frames of picture information recorded in the 1 st T period to be stored in the second round is detected, 1 picture which is the most fuzzy picture and contains the least core information is deleted, the rest (n-1) pictures are reserved, and the (n-1) pictures are stored in the space vacated in the previous round.

It should be noted that, conversely, n frames of picture information stored in the 1 st T period of the previous round are detected, and 1 of the most blurred pictures containing the least core information is deleted; on the other hand, n-frame picture information recorded in the 1 st T period to be stored in the second round is detected, and only 1 of the most clear pictures containing the most core information are retained, which is also possible, and so on, and is not described again.

When the recording information of the 2 nd T period of the second round is to be stored, carrying out intelligent image detection on the information: on one hand, detecting n frames of picture information stored in the 2 nd T period of the previous round, reserving 1 picture which is the clearest and contains the most core information, and deleting the rest (n-1) pictures; on the other hand, detecting n frames of picture information recorded in the 2 nd T period of the round, deleting 1 picture which is most blurred and contains the least core information, reserving the rest (n-1) pictures, and storing the (n-1) pictures in the space vacated in the previous round.

And continuing the period storage process until the automatic storage of the second M-th T period is completed. Thus, the sharpest M pictures of the first round of M cycles and (n-1) M pictures of the second round, for a total of M n pictures, are stored.

And the third round, continuously and periodically and automatically storing, wherein in the round, when the 1 st T period shooting information of the round is to be stored, intelligent image detection is carried out on the information: on one hand, detecting (n-1) frame picture information stored in the 1 st T period of the previous round (second round), reserving the 1 clearest picture containing the most core information, and deleting the rest (n-2) pictures; on the other hand, detecting the n frames of picture information recorded in the 1 st T period of the current round, deleting 2 pictures with the most fuzzy picture containing the least core information, reserving the rest (n-2) pictures, and storing the (n-2) pictures in the space vacated in the previous round.

When the recorded information of the 2 nd T period of the third round is to be stored, carrying out intelligent image detection on the information: on one hand, detecting (n-1) frame picture information stored in the 2 nd T period of the previous round, reserving 1 picture containing the clearest core information, and deleting the rest (n-2) pictures; on the other hand, detecting the n frames of picture information recorded in the 2 nd T period of the current round, deleting the 2 pictures with the most fuzzy picture containing the least core information, reserving the rest (n-2) pictures, and storing the (n-2) pictures in the space vacated in the previous round.

And continuing the cycle storage process until the third round of the Mth T cycle of automatic storage is completed. Thus, the sharpest M pictures of the M cycles of the first round, and the sharpest M pictures of the M cycles of the second round, and the (n-2) × M pictures of the third round, for a total of M × n pictures, are stored.

The above process is circulated, so that more clear core information with longer time can be stored in a certain space. In wearable devices, portable devices, monitoring devices and recording devices, when the storage space is limited, how to mine the potential of the devices is a feasible solution.

In an embodiment of the present application, the periodic storage method described herein is further advantageous in that the recording, storage, and transmission processes can be performed in coordination with each other in combination with the recording and transmission processes of the same period. For example:

1) and one or more image data units are subjected to timely and synchronous periodic storage according to the shooting cycle.

Specifically, the obtained multiple image data units are synchronously and periodically stored in combination with sectional type periodic shooting, so that the problem that a large amount of image data is lost when shooting is interrupted or fails accidentally in a traditional mode that the shooting is finished and then stored after the shooting of the whole section is finished can be avoided.

2) And carrying out periodic transmission corresponding to a shooting cycle on one or more image data units in the M image data sets of the storage space.

In an embodiment of the present application, a method for periodic transmission includes:

A. detecting real-time transmission rate and stability of a plurality of configured transmission paths, and dividing a plurality of transmission levels according to the quality conditions;

B. selecting different transmission levels for the real-time shot image data sets or the stored M image data sets to perform periodic transmission corresponding to shooting periods or storage periods so as to adapt to different transmission requirements; the image data set is obtained by continuously shooting and recording in a sectional mode according to a preset shooting and recording period; each image data set comprises n image data units; the stored M image data sets are completely stored according to the storage period corresponding to the shooting period or a plurality of image data units with the highest retention value are retained for replacement storage.

Wherein the reserved value is related to the definition and the contained key/valid information; wherein, the most clear image data unit containing the most key information/effective information has the highest retention value; the image data unit with the most blur and the least key information/valid information is the least reserved value. The judgment reference factors of the key information/effective information include: any one or more of the reference object type, the priority of the reference object type, the size of the reference object, the distance of the reference object, the brightness of the reference object and the number of the reference objects.

Specifically, transmission paths that satisfy transmission rates and stabilities required for transmitting different numbers of units of image data of an image data set in one transmission cycle are defined as different transmission levels.

In addition, a transmission path with the fastest transmission rate and the best stability is detected in a transmission period; and matching a suitable number of image data units in an image data set to transmit according to the detected transmission requirement which can be met by the real-time speed of the transmission path.

In addition, according to the transmission rate and the stability detected in real time, the transmission level corresponding to the current transmission path is confirmed; and selecting the transmission quantity of the image data units in the image data set, which is met by the transmission requirements corresponding to the transmission level which is one or more than the current transmission level, for transmission.

In the present application, when the transmission environments of the plurality of transmission paths are not good, the recording period is increased to adapt to the transmission rate and stability of one or more lower transmission levels; or, reducing the number of image data units with the highest retention value when storing each image data set to adapt the transmission rate and stability of one or more lower transmission levels; or, one or more image data units to be transmitted are converted to reduce the quality of the image data units to the minimum quality requirement.

For example, during transmission, the real-time transmission rate and stability of a plurality of configured transmission paths can be detected, and a plurality of transmission levels can be divided according to the quality; the transmission modes are then ranked according to the transmission requirements for the image data units in an image data set during a transmission period. Based on the periodic characteristic of the image data, the whole segment data does not need to be transmitted during transmission, but more dispersed image data sets or image data units are transmitted, so that the time for each transmission can be reduced due to the reduction of transmission data, and the risks of low transmission efficiency and packet loss or transmission failure caused by the influence of the stability and the speed of a transmission path can be avoided.

In an embodiment of the present application, each time one or more image data sets or image data units are transmitted, one or more stored image data sets or image data units may be deleted in the storage space, so as to make room for storing one or more image data sets to be stored or the x image data units with the highest value in each image data set to be stored.

Specifically, by combining with the periodic storage and transmission, on one hand, a space can be made available for instant storage, and on the other hand, the periodic transmission can enable one or more image data units in the image data set of each segment to be transmitted according to the current optimal transmission path, so that the risk of low transmission efficiency and packet loss or transmission failure caused by the fact that the whole segment of data is transmitted together and is easily subjected to the image of the stability and the speed of the transmission path is avoided.

In addition, the method can also regularly remind the user to clean the storage space, or locally delete the stored information after backing up the information to an external medium, so that the local storage space is restored to the initial optimal state. This further increases the effective storage capacity.

In summary, the storage method of the present application can not only further improve the storage efficiency, store more core useful information with a longer duration in a limited space, but also make use of the characteristic of sectional shooting of periodic shooting to realize organic combination of shooting, storage and transmission, and coordinate with each other to make the processes of instant shooting, storage and transmission more automatic, intelligent, effective and stable.

FIG. 4 is a block diagram of a periodic memory device according to an embodiment of the present invention. As shown, the apparatus 400 includes:

a configuration module 401, configured to configure a storage space capable of storing M real-time captured image data sets, so as to continuously store the image data sets; the image data set is obtained by continuously shooting and recording in a sectional mode according to a preset shooting and recording period; each image data set comprises n image data units;

a processing module 402, configured to, when the storage space is full of M image data sets in the first round, respectively detect, by using an image detection algorithm, a reserved value of each image data unit in each image data set that has been stored and is to be stored; the X image data units with the highest retention value in each image data set to be stored are respectively replaced with the X image data units with the lowest retention value in each stored image data set, so that multi-round periodic storage is realized.

It should be noted that, because the contents of information interaction, execution process, and the like between the modules/units of the apparatus are based on the same concept as the method embodiment described in the present application, the technical effect brought by the contents is the same as the method embodiment of the present application, and specific contents may refer to the description in the foregoing method embodiment of the present application, and are not described herein again.

It should be further noted that the above division of the modules of the apparatus 400 is only a logical division, and the actual implementation may be wholly or partially integrated into one physical entity or may be physically separated. And these units can be implemented entirely in software, invoked by a processing element; or may be implemented entirely in hardware; and part of the modules can be realized in the form of calling software by the processing element, and part of the modules can be realized in the form of hardware. For example, the processing module 402 may be a separate processing element, or may be integrated into a chip of the apparatus, or may be stored in a memory of the apparatus in the form of program code, and a processing element of the apparatus calls and executes the functions of the processing module 402. Other modules are implemented similarly. In addition, all or part of the modules can be integrated together or can be independently realized. The processing element described herein may be an integrated circuit having signal processing capabilities. In implementation, each step of the above method or each module above may be implemented by an integrated logic circuit of hardware in a processor element or an instruction in the form of software.

For example, the above modules may be one or more integrated circuits configured to implement the above methods, such as: one or more Application Specific Integrated Circuits (ASICs); or, one or more microprocessors (digital signal processors, DSP for short); or one or more Field Programmable Gate arrays (FPGA for short), etc.; for another example, when one of the above modules is implemented in the form of a Processing element scheduler code, the Processing element may be a general-purpose processor, such as a Central Processing Unit (CPU) or other processor capable of calling program code; for another example, these modules may be integrated together and implemented in the form of a system-on-a-chip (SOC).

Fig. 5 is a schematic structural diagram of a processing apparatus according to an embodiment of the present application. As shown, the processing device 500 includes: a memory 501, a processor 502, and a communicator 503; the memory 501 is used for storing computer instructions; the processor 502 executes computer instructions to implement the method described in fig. 1. The communicator 503 is used for being in communication connection with the shooting, storing and transmitting integrated equipment.

In some embodiments, the number of the memories 501 in the processing apparatus 500 may be one or more, the number of the processors 502 may be one or more, the number of the communicators 503 may be one or more, and fig. 5 is taken as an example.

In an embodiment of the present application, the processor 502 in the processing device 500 loads one or more instructions corresponding to processes of an application program into the memory 501 according to the steps described in fig. 1, and the processor 502 executes the application program stored in the memory 501, thereby implementing the method described in fig. 1.

The Memory 501 may include a Random Access Memory (RAM), and may also include a non-volatile Memory (non-volatile Memory), such as at least one disk Memory. The memory 501 stores an operating system and operating instructions, executable modules or data structures, or a subset thereof, or an expanded set thereof, wherein the operating instructions may include various operating instructions for implementing various operations. The operating system may include various system programs for implementing various basic services and for handling hardware-based tasks.

The Processor 502 may be a general-purpose Processor, and includes a Central Processing Unit (CPU), a Network Processor (NP), and the like; the Integrated Circuit may also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other Programmable logic device, a discrete Gate or transistor logic device, or a discrete hardware component.

The communicator 503 is used to implement communication connection between the database access device and other devices (e.g., client, read-write library, and read-only library). The communicator 503 may include one or more sets of modules of different communication manners, for example, a CAN communication module communicatively connected to a CAN bus. The communication connection may be one or more wired/wireless communication means and combinations thereof. The communication method comprises the following steps: any one or more of the internet, CAN, intranet, Wide Area Network (WAN), Local Area Network (LAN), wireless network, Digital Subscriber Line (DSL) network, frame relay network, Asynchronous Transfer Mode (ATM) network, Virtual Private Network (VPN), and/or any other suitable communication network. For example: any one or a plurality of combinations of WIFI, Bluetooth, NFC, GPRS, GSM and Ethernet.

In some specific applications, the various components of the processing device 500 are coupled together by a bus system that may include a power bus, a control bus, a status signal bus, etc., in addition to a data bus. For clarity of illustration, the various buses are depicted in fig. 5 as a bus system.

Fig. 6 is a schematic structural diagram of a shooting, storing and transmitting integrated device according to an embodiment of the present application. As shown, the integrated device 600 includes: the processing device 601 as described in fig. 5; a camera 602 for recording; a data card 603 for storing image data; the communicator 604 is configured to transmit image data.

Preferably, the camera 602 has wide-angle recording, auto-focusing and higher-speed recording functions, and performs continuous sectional automatic recording according to the recording cycle under the control of the driving logic in the above-mentioned method.

Preferably, the communication path provided by the communicator 604 includes: a wired transmission path and/or a wireless transmission path; the wired transmission path includes: any one or more of USB1.0/2.0/3.x, MicroUSB, MiniUSB, serial interface, parallel interface and charging pile interface; the wireless transmission path includes: any one or a plurality of combinations of 2G/3G/4G/5G, Bluetooth, infrared, NB-IoT, Rola, Zigbee, MavLink, WIFI, NFC, GPRS, GSM and Ethernet.

Preferably, the shooting, storing and transmitting integrated device 600 can be used as any one of a wearable device, a portable device, a monitoring device and a recording device.

In an embodiment of the present application, a computer-readable storage medium is provided, on which a computer program is stored, which when executed by a processor implements the method described in fig. 1.

The present application may be embodied as systems, methods, and/or computer program products, in any combination of technical details. The computer program product may include a computer-readable storage medium having computer-readable program instructions embodied thereon for causing a processor to implement various aspects of the present application.

The computer readable storage medium may be a tangible device that can hold and store the instructions for use by the instruction execution device. The computer readable storage medium may be, for example, but is not limited to, an electronic memory device, a magnetic memory device, an optical memory device, an electromagnetic memory device, a semiconductor memory device, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a Static Random Access Memory (SRAM), a portable compact disc read-only memory (CD-ROM), a Digital Versatile Disc (DVD), a memory stick, a floppy disk, a mechanical coding device, such as punch cards or in-groove projection structures having instructions stored thereon, and any suitable combination of the foregoing. Computer-readable storage media as used herein is not to be construed as transitory signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through a waveguide or other transmission medium (e.g., optical pulses through a fiber optic cable), or electrical signals transmitted through electrical wires.

The computer-readable programs described herein may be downloaded from a computer-readable storage medium to a variety of computing/processing devices, or to an external computer or external storage device via a network, such as the internet, a local area network, a wide area network, and/or a wireless network. The network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers and/or edge servers. The network adapter card or network interface in each computing/processing device receives computer-readable program instructions from the network and forwards the computer-readable program instructions for storage in a computer-readable storage medium in the respective computing/processing device.

The computer program instructions for carrying out operations of the present application may be assembly instructions, Instruction Set Architecture (ISA) instructions, machine related instructions, microcode, firmware instructions, state setting data, integrated circuit configuration data, or source code or object code written in any combination of one or more programming languages, including an object oriented programming language such as Smalltalk, C + + or the like and procedural programming languages, such as the "C" programming language or similar programming languages. The computer-readable program instructions may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider). In some embodiments, the electronic circuitry can execute computer-readable program instructions to implement aspects of the present application by utilizing state information of the computer-readable program instructions to personalize the electronic circuitry, such as a programmable logic circuit, a Field Programmable Gate Array (FPGA), or a Programmable Logic Array (PLA).

In summary, the present application provides a method, an apparatus, a device, and a medium for periodic storage, which provide a storage space for continuously storing M real-time recorded image data sets; the image data set is obtained by continuously shooting and recording in a sectional mode according to a preset shooting and recording period; each image data set comprises n image data units; after the first round of M image data sets are stored in the storage space, respectively detecting the reserved value of each image data unit in each stored and to-be-stored image data set by using an image detection algorithm; the stored x image data units with the lowest retention value in each image data set are respectively replaced by the x image data units with the highest retention value in each image data set to be stored, so that the multi-round periodic storage corresponding to the shooting and recording period is realized.

The application effectively overcomes various defects in the prior art and has higher industrial utilization value.

The above embodiments are merely illustrative of the principles and utilities of the present application and are not intended to limit the invention. Any person skilled in the art can modify or change the above-described embodiments without departing from the spirit and scope of the present application. Accordingly, it is intended that all equivalent modifications or changes which can be made by those skilled in the art without departing from the spirit and technical spirit of the present invention be covered by the claims of the present application.

Claims

1. A method of periodic storage, the method comprising:

providing a storage space for continuously storing M real-time shot image data sets; the image data set is obtained by continuously shooting and recording in a sectional mode according to a preset shooting and recording period; each image data set comprises n image data units;

when the first round of M image data sets is full of the storage space, respectively detecting the reserved value of each image data unit in each image data set which is stored and is to be stored after the first round by using an image detection algorithm;

the stored x image data units with the lowest retention value in each image data set are respectively replaced by the x image data units with the highest retention value in each image data set to be stored, so that the multi-round periodic storage corresponding to the shooting and recording period is realized.

2. The method according to claim 1, characterized in that it comprises:

when the second round of M image data sets are stored, replacing the stored x image data units with the lowest retention value in the first round of first image data sets with the x image data units with the highest retention value in the first image data sets to be stored;

by parity of reasoning, the storage of the second image data set to the Mth image data set of the second round is respectively completed, so that the storage of the M image data sets of the second round is completed;

when the M image data sets of the k-th round are stored, replacing the x image data units with the highest retention value in the first image data set to be stored in the round with the x image data units with the lowest retention value in the remaining n-x (k-2) image data units which are not replaced in the first image data set stored in the previous k-1 round; wherein k is a natural number not less than 2;

by parity of reasoning, the storage of the second image data set to the Mth image data set is respectively completed so as to complete the storage of the Mth image data set in the k-th round;

wherein, the replacement value x representing the number of replacing the image data units is a preset fixed value; wherein the value of x is minimum 1 and maximum not more than n; when x is set to 1, the storage space can store n rounds of M image data sets at most.

3. The method according to claim 2, wherein the replacement value x is adjusted according to a recording duration or a pre-stored data size; when the shooting time is longer or the pre-stored data is larger, the x value can be reduced; conversely, when the recording time is shorter or the pre-stored data is smaller, the x value can be increased.

4. The method of claim 1, wherein the reserved value relates to sharpness and contained critical/valid information; wherein, the most clear image data unit containing the most key information/effective information has the highest retention value; the image data unit with the most blur and the least key information/valid information is the least reserved value.

5. The method according to claim 4, wherein the reference factors for determining the key information/valid information include: any one or more of reference object type, priority of reference object type, reference object size, reference object distance, reference object brightness, reference object number, reference object motion, and reference object sound.

6. The method of claim 1, further comprising:

one or more image data units in an image data set are continuously and sectionally shot and recorded according to a preset shooting and recording period, and timely and synchronously and periodically stored according to the shooting and recording period;

alternatively, the first and second electrodes may be,

and carrying out periodic transmission corresponding to a shooting cycle on one or more image data units in the M image data sets of the storage space.

7. A periodic storage device, the device comprising:

the configuration module is used for providing a storage space for continuously storing M real-time shot and recorded image data sets; the image data set is obtained by continuously shooting and recording in a sectional mode according to a preset shooting and recording period; each image data set comprises n image data units;

the processing module is used for respectively detecting the reserved values of all image data units in each image data set which is stored and is to be stored after the first round by using an image detection algorithm after the first round of M image data sets are stored in the storage space; the stored x image data units with the lowest retention value in each image data set are respectively replaced by the x image data units with the highest retention value in each image data set to be stored, so that the multi-round periodic storage corresponding to the shooting and recording period is realized.

8. A processing apparatus, characterized in that the apparatus comprises: a memory, a processor, and a communicator; the memory is to store computer instructions; the processor executes computer instructions to implement the method of any one of claims 1 to 6; the communicator is used for being in communication connection with the shooting, storing and transmitting integrated equipment so as to receive image data shot and recorded by the shooting, storing and transmitting integrated equipment in real time; and the communicator is also used for transmitting the stored image data to the outside.

9. A camera, storage and transmission integrated device, comprising:

the processing apparatus of claim 8;

a camera for recording;

the data card is used for storing image data;

and the communicator is used for transmitting the image data.

10. A computer-readable storage medium having stored thereon computer instructions which, when executed, perform the method of any one of claims 1 to 6.