CN110458009B

CN110458009B - Processing method for picture information, face detection and picture searching by picture and related equipment

Info

Publication number: CN110458009B
Application number: CN201910600660.6A
Authority: CN
Inventors: 李庆奇
Original assignee: Zhejiang Dahua Technology Co Ltd
Current assignee: Zhejiang Dahua Technology Co Ltd
Priority date: 2019-07-04
Filing date: 2019-07-04
Publication date: 2022-02-18
Anticipated expiration: 2039-07-04
Also published as: CN110458009A

Abstract

The application discloses a processing method for picture information, face detection and picture searching, and a related detection device and a storage device, wherein the processing method for the picture information comprises the following steps: the detection equipment receives a picture to be detected; judging whether the set characteristic information of the picture to be detected exists in the picture to be detected; if the set characteristic information of the picture to be detected exists in the picture to be detected, judging whether the set characteristic information meets a preset condition; and if the set characteristic information meets the preset condition, processing the picture to be detected through the set characteristic information. Through the mode, when the set characteristic information of the picture to be detected is detected to exist in the picture to be detected, the corresponding set characteristic information can be directly obtained from the picture to be detected to process the picture to be detected, so that the picture to be detected is prevented from being subjected to algorithm detection again, and precious algorithm operation resources are saved.

Description

Processing method for picture information, face detection and picture searching by picture and related equipment

Technical Field

The present application relates to the field of image information processing technologies, and in particular, to a processing method for image information, face detection, image searching, and a related detection device and storage device.

Background

Nowadays, since the attribute information corresponding to the picture information is stored in the database of the corresponding detection device, when performing face detection on a picture information stream, whenever a face picture is detected, the attribute information corresponding to the face picture, such as gender, age, expression, etc., needs to be extracted from the database of the corresponding detection device; similarly, in the image searching service, firstly, the algorithm detection is performed on the input image information, then, the data of the image information is modeled, and the model data is output, so that the comparison of the detection algorithm is performed through the model data and the existing model data in the corresponding database of the detection device, and finally, the target image is searched out.

However, when the detection device accesses multiple paths of picture streams and real-time video streams, the detected picture information streams need to be subjected to algorithm detection and extraction of corresponding attribute information again, which wastes the operation resources of the detection algorithms of the corresponding detection device, thereby failing to effectively perform algorithm detection on the real-time video streams. In the existing image searching service, the target image is searched based on the feature vector detected by the image information itself, and due to the difference of the reference system used in the detection and the multiple encoding and decoding of the image itself, the feature vector extracted from one image has a slight difference with the feature vector first detected by the image from the video stream, so that the slight difference of the detection algorithm in the image searching is caused, and the final search result is inconsistent.

Disclosure of Invention

The processing method can solve the problem that precious algorithm operation resources are wasted by carrying out algorithm detection on the picture to be detected again.

In order to solve the technical problem, the application adopts a technical scheme that: the processing method of the picture information is provided, wherein the processing method comprises the following steps: the detection equipment receives a picture to be detected; judging whether the set characteristic information of the picture to be detected exists in the picture to be detected; if the set characteristic information of the picture to be detected exists in the picture to be detected, judging whether the set characteristic information meets a preset condition; and if the set characteristic information meets the preset condition, processing the picture to be detected through the set characteristic information.

The set characteristic information also comprises version information of a detection algorithm of the picture to be detected; wherein, if the setting characteristic information of the picture to be detected exists in the picture to be detected, the step of judging whether the setting characteristic information meets the preset condition comprises the following steps: judging whether the version of the detection algorithm of the picture to be detected is not lower than the version of the detection algorithm stored in the detection equipment or not; and if the version of the detection algorithm of the picture to be detected is not lower than the version of the detection algorithm stored in the detection equipment, executing the step of processing the picture to be detected by setting the characteristic information.

If the version of the detection algorithm of the picture to be detected is lower than the version of the detection algorithm stored in the detection equipment, the set characteristic information of the picture to be detected is re-extracted, and the version of the detection algorithm and the set characteristic information of the picture to be detected are updated.

The step that the detection equipment receives the picture to be detected comprises the following steps: receiving an input picture information stream; and extracting the set characteristic information of each picture in the picture information stream, and storing the set characteristic information into the picture to be detected.

The method comprises the steps of extracting set characteristic information of each picture in a picture information stream, and storing the set characteristic information into a picture to be detected; and each image of the image information stream is coded into a JPEG format, and the set characteristic information of each image to be detected is stored into a redundant field corresponding to the JPEG format of the image to be detected.

If the set characteristic information of the picture to be detected does not exist in the picture to be detected, the set characteristic information of the picture to be detected is extracted and stored into a preset field of the picture to be detected.

The step of extracting the set characteristic information of the picture to be detected comprises the following steps: decoding a picture to be detected; and extracting attribute information, a characteristic vector and a detection algorithm version of the decoded picture.

In order to solve the above technical problem, the present application adopts another technical solution: a processing method for face detection is provided, wherein the processing method comprises the following steps: the method comprises the steps that a picture to be detected is received by detection equipment, wherein the picture to be detected comprises a face picture to be detected; judging whether the set characteristic information of the face picture to be detected exists in the face picture to be detected; and if the set characteristic information of the face picture to be detected exists in the face picture to be detected, directly acquiring the set characteristic information of the face picture to be detected from the face picture to be detected.

In order to solve the above technical problem, the present application adopts another technical solution: a processing method for searching a picture by a picture is provided, wherein the processing method comprises the following steps: the detection equipment receives a picture to be detected; judging whether set characteristic information of the picture to be detected exists in the picture to be detected or not, wherein the set characteristic information comprises a characteristic vector of the picture to be detected; and if the characteristic vector exists in the picture to be detected, directly acquiring the characteristic vector from the picture to be detected so as to search the target picture according to the characteristic vector.

In order to solve the above technical problem, the present application adopts another technical solution: provided is a picture information detection device, wherein the detection device comprises: the receiving module is used for receiving the picture to be detected; the detection module is coupled with the receiving module and used for judging whether the set characteristic information of the picture to be detected exists in the picture to be detected or not and further judging whether the set characteristic information meets a preset condition or not when the set characteristic information of the picture to be detected exists in the picture to be detected; and the processing module is coupled with the detection module and used for processing the picture to be detected through the set characteristic information when the set characteristic information of the picture to be detected exists in the picture to be detected and meets a preset condition.

In order to solve the above technical problem, the present application adopts another technical solution: there is provided a face detection apparatus, wherein the face detection apparatus comprises: the receiving module is used for receiving the picture to be detected, wherein the picture to be detected comprises a face picture to be detected; the detection module is coupled with the receiving module and used for judging whether the set characteristic information of the face picture to be detected exists in the face picture to be detected or not; and the processing module is coupled with the detection module and is used for directly acquiring the set characteristic information of the face picture to be detected from the face picture to be detected when the set characteristic information of the face picture to be detected exists in the face picture to be detected.

In order to solve the above technical problem, the present application adopts another technical solution: provided is a detection device for searching a picture with a picture, wherein the detection device comprises: the receiving module is used for receiving the picture to be detected; the detection module is coupled with the receiving module and used for judging whether the set characteristic information of the picture to be detected exists in the picture to be detected or not, wherein the set characteristic information comprises a characteristic vector of the picture to be detected; and the processing module is coupled with the detection module and is used for directly acquiring the characteristic vector from the picture to be detected when the characteristic vector exists in the picture to be detected so as to search the target picture according to the characteristic vector.

In order to solve the above technical problem, the present application adopts another technical solution: providing a detection device, wherein the detection device comprises a memory and a processor coupled to each other; the memory stores program data; the processor is used to execute the program data to implement the processing method as described above.

In order to solve the above technical problem, the present application adopts another technical solution: there is provided a storage device in which program data is stored, the program data being executable to implement a processing method as described above.

The beneficial effect of this application is: different from the prior art, the method for processing the picture information in the application comprises the following steps: the detection equipment receives a picture to be detected; judging whether the set characteristic information of the picture to be detected exists in the picture to be detected; if the set characteristic information of the picture to be detected exists in the picture to be detected, judging whether the set characteristic information meets a preset condition; and if the set characteristic information meets the preset condition, processing the picture to be detected through the set characteristic information. Through the mode, when the set characteristic information of the picture to be detected is detected to exist in the picture to be detected, the corresponding set characteristic information can be directly obtained from the picture to be detected to process the picture to be detected, so that the picture to be detected is prevented from being subjected to algorithm detection again, and precious algorithm operation resources are saved.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts. Wherein:

FIG. 1 is a flowchart illustrating a first embodiment of a method for processing picture information according to the present application;

FIG. 2 is a flowchart illustrating a second embodiment of a method for processing picture information according to the present application;

FIG. 3 is a flowchart illustrating a third embodiment of a method for processing picture information according to the present application;

FIG. 4 is a schematic flowchart of a processing method for face detection according to a first embodiment of the present application;

FIG. 5 is a flowchart illustrating a first embodiment of a processing method for searching graphs according to the present application;

FIG. 6 is a schematic structural diagram of a first embodiment of an apparatus for detecting picture information according to the present application;

FIG. 7 is a schematic structural diagram of a first embodiment of a face detection apparatus according to the present application;

FIG. 8 is a schematic structural diagram of a first embodiment of a detection apparatus for searching images according to the present application;

FIG. 9 is a schematic structural view of a first embodiment of the detection apparatus of the present application;

FIG. 10 is a schematic structural diagram of an embodiment of a memory device according to the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

Referring to fig. 1, fig. 1 is a schematic flow chart of a first embodiment of a method for processing picture information according to the present application, and the method includes the following steps:

s110: and the detection equipment receives the picture to be detected.

In this embodiment, when the target picture information needs to be processed, the corresponding detection device first performs recognition detection on the received multiple paths of picture information streams and the real-time video stream, so as to determine and receive the corresponding target picture as the picture to be detected.

In this embodiment, the detection device may be one of smart terminal devices having video and picture information processing functions, such as a mobile phone, a tablet computer, a wearable smart device, and a personal computer, which is not limited in this application.

S120: and judging whether the set characteristic information of the picture to be detected exists in the picture to be detected.

In this embodiment, after the detection device receives the corresponding picture to be detected, the picture to be detected is further detected to find whether corresponding intelligent information exists in the picture to be detected, where the intelligent information includes a detection algorithm version, attribute information, and a feature vector of the picture to be detected, and the intelligent information or one or more kinds of feature information in the intelligent information may be preset as the set feature information of the picture to be detected, for example, when performing face attribute detection, the corresponding set feature information may be the detection algorithm version and attribute information of the face picture, and when performing processing with a search picture, the set feature information may be the detection algorithm version and feature vector of the picture to be detected, and when the detection device receives the picture to be detected, the detection device determines whether the set feature information of the picture to be detected exists in the picture to be detected, so as to be able to carry out the next processing on the picture to be detected.

In an optional embodiment, the detection device obtains a target picture in the video stream, processes the target picture to encode the target picture into a picture in a preset Image Format, such as JPEG (joint Photographic Experts group), TIFF (Tag Image File Format), RAW (RAW Image File) and other Image formats, and uses the picture in the preset Image Format as a picture to be detected, and when an intelligent information of the picture to be detected is added to a preset field of the picture to be detected, for example, in a JPEG picture, the intelligent information of the picture to be detected includes a detection algorithm version, attribute information, and a feature vector of the picture to be detected, that is, when the intelligent information of the picture to be detected stored in a database corresponding to the detection device is added to the preset field of the picture to be detected, the detection device receives the picture to be detected from the video stream, whether the set characteristic information of the picture to be detected exists in the picture to be detected needs to be further judged.

When detecting that the setting feature information of the picture to be detected exists in the picture to be detected, S130 is executed, and when detecting that the setting feature information of the picture to be detected does not exist in the picture to be detected, S140 is executed.

S130: and judging whether the set characteristic information meets a preset condition or not.

In this embodiment, when it is detected that the to-be-detected picture has the set feature information, that is, when the intelligent information corresponding to the to-be-detected picture is added to the to-be-detected picture, it is further determined whether the set feature information meets a preset condition.

In an optional embodiment, the set feature information includes a version of a detection algorithm of the to-be-detected picture, and the preset condition may be that the version of the detection algorithm is not lower than the version of the detection algorithm currently stored in the detection device, that is, the version of the detection algorithm in the to-be-detected picture is higher than or the same as the version of the detection algorithm currently stored in the corresponding database of the detection device, that is, the generation setting or updating time of the version of the detection algorithm of the corresponding to-be-detected picture is closer to the current time point or the generation setting or updating time of the corresponding detection algorithm is the same, when the presence of the set feature information of the to-be-detected picture is detected in the to-be-detected picture, the set feature information is further determined, if the version of the detection algorithm of the corresponding to-detected picture is not lower than the version of the detection algorithm currently stored in the database of the detection device, i.e. whether the generation setting or the updated time of the detection algorithm of the picture to be detected is closer to the current time point.

In an optional embodiment, when it is detected that the set feature information of the picture to be detected does not exist in the picture to be detected, or the set feature information of the picture to be detected exists in the picture to be detected, but the set feature information does not satisfy a preset condition, if the version of the detection algorithm of the picture to be detected is lower than the version of the detection algorithm currently stored in the detection device, the set feature information of the picture to be detected, such as the detection algorithm version, the attribute information, and the feature vector of the picture to be detected, is extracted from the database of the corresponding detection device, and is added to and stored in a preset field, such as a corresponding redundant field, of the picture to be detected.

When it is detected that the setting characteristic information satisfies the preset condition, S150 is executed, and when the setting characteristic information does not satisfy the preset condition, S140 is executed.

S140: and extracting the set characteristic information of the picture to be detected and storing the set characteristic information into a preset field of the picture to be detected.

In this embodiment, when it is detected that the setting feature information of the picture to be detected does not exist in the picture to be detected, or the setting feature information of the picture to be detected exists in the picture to be detected, but the setting feature information does not satisfy the preset condition, and if the version of the detection algorithm of the picture to be detected is lower than the version of the detection algorithm currently stored in the detection device, the setting feature information of the picture to be detected, such as the detection algorithm version, the attribute information, and the feature vector of the picture to be detected, is extracted from the database of the corresponding detection device, and is stored in the preset field, such as the corresponding redundant field, of the picture to be detected.

In an optional embodiment, when it is detected that the set feature information of the picture to be detected does not exist in the picture to be detected, or the set feature information of the picture to be detected exists in the picture to be detected but the set feature information does not satisfy the preset condition, if the version of the detection algorithm of the picture to be detected is lower than the version of the detection algorithm currently stored in the detection device, the picture to be detected is decoded to perform algorithm detection on the picture to be detected again, and further, intelligent information corresponding to the decoded picture to be detected, such as attribute information, a feature vector and a detection algorithm version corresponding to the picture to be detected, is extracted to be stored in a preset field, such as a corresponding redundant field, of the picture to be detected.

S150: and processing the picture to be detected by setting the characteristic information.

In this embodiment, when it is detected that the setting feature information of the picture to be detected exists in the picture to be detected and the setting feature information meets the preset condition, the picture to be detected is directly processed through the setting feature information extracted from the picture to be detected.

Different from the prior art, the method for processing the picture information in the application comprises the following steps: the detection equipment receives a picture to be detected; judging whether the set characteristic information of the picture to be detected exists in the picture to be detected; if the set characteristic information of the picture to be detected exists in the picture to be detected, judging whether the set characteristic information meets a preset condition; and if the set characteristic information meets the preset condition, processing the picture to be detected through the set characteristic information. Through the mode, when the set characteristic information of the picture to be detected is detected to exist in the picture to be detected, the corresponding set characteristic information can be directly obtained from the picture to be detected to process the picture to be detected, so that the picture to be detected is prevented from being subjected to algorithm detection again, and precious algorithm operation resources are saved.

Referring to fig. 2, fig. 2 is a flowchart illustrating a second embodiment of a method for processing picture information according to the present application. It can be understood that the picture information processing method of the present embodiment is a flowchart illustration of a detailed embodiment of the picture information processing method of fig. 1, and includes the following steps:

s210, the detection equipment receives the picture to be detected.

Here, this step is the same as S110 in fig. 1, and please refer to S110 and the related text description thereof specifically, which is not described herein again.

S220: and judging whether the set characteristic information of the picture to be detected exists in the picture to be detected.

Here, this step is the same as S120 in fig. 1, and please refer to S120 and the related text description thereof specifically, which is not described herein again.

When it is detected that the setting feature information of the picture to be detected exists in the picture to be detected, S230 is executed, and when it is detected that the setting feature information of the picture to be detected does not exist in the picture to be detected, S240 is executed.

And S230, judging whether the version of the detection algorithm of the picture to be detected is not lower than the version of the detection algorithm stored in the detection equipment.

In this embodiment, the setting feature information of the picture to be detected includes a version of a detection algorithm of the picture to be detected, where the preset condition that the setting feature information needs to satisfy is that the version of the detection algorithm is not lower than the version of the detection algorithm stored in the current detection device, that is, the version of the detection algorithm in the picture to be detected is higher than or the same as the version of the detection algorithm currently stored in the corresponding database of the detection device, the time for generating or updating the corresponding detection algorithm in the picture to be detected is closer to the current time point, when it is detected that the corresponding setting feature information exists in the picture to be detected, it is further determined whether the version of the detection algorithm in the picture to be detected is not lower than the version of the detection algorithm currently stored in the detection device, that is, whether the version of the detection algorithm existing in the picture to be detected is higher than the version of the detection algorithm currently stored in the detection device, whether the generation or update time of the detection algorithm in the picture to be detected is closer to the current time point or whether the generation or update time is the same as the version of the detection algorithm currently stored by the detection equipment.

And executing S250 when detecting that the version of the detection algorithm of the picture to be detected is not lower than the version of the detection algorithm stored by the detection equipment, and executing S240 when detecting that the version of the detection algorithm of the picture to be detected is lower than the version of the detection algorithm stored by the detection equipment.

And S240, extracting the set characteristic information of the picture to be detected and storing the set characteristic information into a preset field of the picture to be detected.

In this embodiment, when it is detected that the set feature information of the picture to be detected does not exist in the picture to be detected, or the set feature information of the picture to be detected exists in the picture to be detected, but the version of the detection algorithm of the picture to be detected is lower than the version of the detection algorithm currently stored in the detection device, the set feature information of the picture to be detected, such as the detection algorithm version, the attribute information, and the feature vector of the picture to be detected, is extracted from the database of the corresponding detection device, and is stored in the preset field, such as the corresponding redundant field, of the picture to be detected.

In an optional implementation manner, when it is detected that the set feature information of the picture to be detected does not exist in the picture to be detected, or the set feature information of the picture to be detected exists in the picture to be detected, but the version of the detection algorithm of the picture to be detected is lower than the version of the detection algorithm currently stored by the detection device, the picture to be detected is decoded to perform algorithm detection on the picture to be detected again, and further, the attribute information, the feature vector and the detection algorithm version corresponding to the decoded picture to be detected are extracted and stored in a preset field, such as a corresponding redundant field, of the picture to be detected.

And S250, processing the picture to be detected by setting the characteristic information.

In this embodiment, when the detection device detects that the set feature information of the picture to be detected exists in the picture to be detected, and the version of the detection algorithm of the picture to be detected in the set feature information is not lower than the version of the detection algorithm stored in the detection device, that is, the version of the detection algorithm in the picture to be detected is higher or the same as the version of the detection algorithm currently stored in the detection device, and the generation or update time of the corresponding detection algorithm is closer to the current time point, the set feature information of the picture to be detected is directly extracted from the picture to be detected, so that the picture to be detected is processed through the set feature information, and therefore, the picture to be detected is prevented from being subjected to algorithm detection again.

In an optional implementation manner, when it is detected that the set feature information of the picture to be detected does not exist in the picture to be detected, or the set feature information of the picture to be detected exists in the picture to be detected, but the set feature information does not satisfy the preset condition, if the version of the detection algorithm of the picture to be detected is lower than the version of the detection algorithm currently stored in the detection device, the picture to be detected is decoded to perform algorithm detection on the picture to be detected again, and further, intelligent information corresponding to the decoded picture to be detected, such as attribute information, a feature vector and a detection algorithm version corresponding to the picture to be detected, is extracted, so that the picture to be detected is processed through the acquired attribute information, the feature vector and the detection algorithm version of the picture to be detected.

Referring to fig. 3, fig. 3 is a flowchart illustrating a method for processing picture information according to a third embodiment of the present application. The present embodiment is different from the first embodiment of the present application in fig. 1 in that before performing S110, the method further includes:

and S310, receiving the input picture information stream.

In this embodiment, the detection device first receives an input picture information stream, such as corresponding picture information in a multi-channel picture stream and a real-time video stream, to determine and detect a corresponding target picture as the current picture to be detected.

And S320, extracting the set characteristic information of each picture in the picture information stream, and storing the set characteristic information into the picture to be detected.

In this embodiment, when receiving an input picture information stream, a detection device extracts, from a database corresponding to the detection device, set feature information corresponding to each picture in the picture information stream, such as intelligent information corresponding to each picture, and a version, attribute information, and feature vector of a detection algorithm of the picture to be detected, where the set feature information may be the intelligent information of the picture to be detected or one or more feature information in the intelligent information, so as to store the set feature information in a preset field of the picture to be detected, such as storing the corresponding set feature information in a redundant field encoded as a JPEG picture.

In an optional embodiment, the detection device receives an input picture information stream, and encodes each image of the picture information stream into a JPEG format, where the JPEG format picture includes a file header, a redundant field, and picture data information, and accordingly, intelligent information corresponding to each picture in the picture information stream, such as a detection algorithm version, attribute information, and a feature vector of the picture, can be stored in the redundant field of the corresponding JPEG picture. When receiving an input picture information stream, the detection device extracts the set characteristic information corresponding to each picture in the picture information stream from a corresponding database of the detection device, and encodes each image of the picture information stream into a JPEG format so as to store the set characteristic information of each JPEG picture into a redundant field of the JPEG picture.

S330, S340, S350, and S360 in this embodiment are the same as S110, S120, S130, and S140 in fig. 1, respectively, for details, please refer to S110, S120, S130, and S140 and the related text descriptions thereof, which are not described herein again.

Based on the general inventive concept, the present application further provides a processing method for face detection, please refer to fig. 4, and fig. 4 is a flowchart illustrating a first embodiment of the processing method for face detection according to the present application.

The implementation mode comprises the following steps:

s410, the detection equipment receives the picture to be detected, wherein the picture to be detected comprises a face picture to be detected.

In this embodiment, when the target picture information needs to be processed, the corresponding detection device first performs recognition detection on the received multiple paths of picture information streams and the real-time video stream to determine and receive the target picture information as the picture to be detected, where the picture to be detected includes the face picture to be detected, and the detection device receives the multiple paths of picture information streams and the real-time video stream and performs recognition detection on the multiple paths of picture information streams and the real-time video stream to find the corresponding face picture, and determines the corresponding face picture as the picture to be detected, so as to perform the next detection processing.

And S420, judging whether the set characteristic information of the face picture to be detected exists in the face picture to be detected.

In this embodiment, after the detection device receives the picture to be detected, the picture to be detected is further detected to find whether intelligent information of a corresponding picture of the face to be detected exists in the picture of the face to be detected, where the intelligent information includes version information of a face detection algorithm, attribute information of the face and feature vectors of the face, the version of the detection algorithm of the corresponding picture of the face and the attribute information of the picture of the face are set as the feature information of the picture to be detected in advance, and after the detection device receives the picture to be detected, whether the version of the detection algorithm of the picture to be detected and the attribute information of the picture of the face exist in the picture to be detected is further determined.

When it is detected that the setting feature information of the picture to be detected exists in the picture to be detected, S430 is executed, and when it is detected that the setting feature information of the picture to be detected does not exist in the picture to be detected, S440 is executed.

And S430, directly acquiring the set characteristic information of the face picture to be detected from the face picture to be detected.

In this embodiment, when it is detected that the corresponding set feature information of the face picture to be detected exists in the corresponding face picture to be detected in the picture to be detected, that is, when the intelligent information corresponding to the face picture to be detected is added to the face picture to be detected, the attribute information and the feature vector of the face picture to be detected are directly obtained from the face picture to be detected, so as to avoid performing algorithm detection on the picture to be detected again, thereby saving precious algorithm operation resources.

In an optional embodiment, when it is detected that the set feature information of the face picture to be detected exists in the corresponding face picture to be detected, and the set feature information meets a preset condition, if the version of the detection algorithm of the face picture to be detected, which is included in the set feature information, is not lower than the version of the detection algorithm currently stored by the detection device, the attribute information and the feature vector of the face picture to be detected are directly obtained from the face picture to be detected, so that algorithm detection on the picture to be detected is avoided, and precious algorithm operation resources are saved.

In an optional implementation manner, the detection device obtains a target picture in a video stream, where the target picture includes a face picture to be detected, and codes the face picture to be detected into a picture in a preset image format, such as pictures in image formats like JPEG, TIFF, RAW, and the like, taking the picture in the JPEG image format as an example, where the picture in the JPEG format includes a file header, a redundant field, and picture data information, and correspondingly, information indicating existence of a face attribute, a length, an algorithm version, a face attribute, a face feature vector, and the like may be added to the redundant field of the JPEG face picture. Using the picture with the preset image format, such as a JPEG picture, as a picture to be detected, and adding intelligent information of the face picture to be detected in a corresponding redundant field, wherein the intelligent information comprises detection algorithm version information, attribute information and a feature vector of the face picture to be detected, namely extracting the intelligent information of the face picture to be detected from a corresponding storage database of a detection device to be added in the redundant field of the face picture to be detected, after the detection device receives the face picture to be detected, further detecting the face picture to be detected, so as to find whether the redundant field of the face picture to be detected, such as the JPEG format, has the version, attribute information and feature vector of the detection algorithm of the corresponding face picture to be detected, when the intelligent information of the face picture to be detected exists in the face picture to be detected, and directly acquiring the attribute information of the face picture to be detected and the characteristic vector of the face picture to be detected from the picture to be detected.

And S440, extracting the set characteristic information of the face picture to be detected and storing the set characteristic information into a preset field of the corresponding face picture to be detected.

In this embodiment, when the face picture to be detected is detected to have no setting feature information of the face picture to be detected, or the setting characteristic information of the face picture to be detected exists in the face picture to be detected, but the setting characteristic information does not meet the preset condition, if the version of the detection algorithm of the face picture to be detected included in the set feature information is lower than the version of the detection algorithm currently stored in the corresponding detection device, then the algorithm detection is carried out again on the picture to be detected so as to extract the setting characteristic information of the face picture to be detected currently stored in the detection equipment, wherein the set feature information can be the detection algorithm version, attribute information and feature vector of the face picture to be detected, and further updating and storing the image to be detected in a preset field of the image of the face to be detected, such as a corresponding redundant field.

Different from the prior art, the processing method for face detection in the application comprises the following steps: the method comprises the steps that a picture to be detected is received by detection equipment, wherein the picture to be detected comprises a face picture to be detected; judging whether the set characteristic information of the face to be detected exists in the picture to be detected; and if the set characteristic information of the face picture to be detected exists in the picture to be detected, directly acquiring the set characteristic information of the face picture to be detected from the picture to be detected. By the method, when the set characteristic information of the face picture to be detected exists in the face picture to be detected, the attribute information and the characteristic vector of the face picture to be detected can be directly obtained from the face picture to be detected, so that the situation that the algorithm detection is carried out on the picture to be detected again is avoided, and precious algorithm operation resources are saved.

Based on the general inventive concept, the present application further provides a processing method for searching a graph with a graph, please refer to fig. 5, and fig. 5 is a flowchart illustrating a first embodiment of the processing method for searching a graph with a graph according to the present application.

The implementation mode comprises the following steps:

and S510, the detection equipment receives the picture to be detected.

In this embodiment, when the received picture information needs to be used to search for the target picture, the corresponding detection device needs to identify and detect the received multiple paths of picture streams and the real-time video stream, so as to determine and receive the corresponding picture information as the current picture to be detected.

S520, judging whether the set characteristic information of the picture to be detected exists in the picture to be detected or not, wherein the set characteristic information comprises a characteristic vector of the picture to be detected.

In this embodiment, after the detection device receives the picture to be detected, the picture to be detected is further detected to find whether corresponding intelligent information of the picture to be detected exists in the picture to be detected, where the intelligent information includes version information of a detection algorithm of the picture to be detected, attribute information of the picture to be detected, and a feature vector of the picture to be detected, and the feature vector of the picture to be detected is set as the feature information of the picture to be detected in advance, so that after the detection device receives the picture to be detected, whether the feature vector of the picture to be detected exists in the picture to be detected is further determined.

When it is detected that the setting feature information of the picture to be detected exists in the picture to be detected, S530 is executed, and when it is detected that the setting feature information of the picture to be detected does not exist in the picture to be detected, S540 is executed.

S530, directly obtaining the characteristic vector of the picture to be detected from the picture to be detected, and searching the target picture according to the characteristic vector.

In this embodiment, when it is detected that the set feature information of the picture to be detected exists in the picture to be detected, the feature vector of the picture to be detected is directly obtained from the picture to be detected, and the target picture is searched according to the feature vector, so as to avoid performing algorithm detection on the picture to be detected again, thereby preventing the difference of the reference systems of the corresponding feature vectors and the influence of multiple encoding and decoding caused by performing algorithm detection for multiple times in the process of searching the picture by using the picture, and causing the difference of the feature vectors generated by the same picture, so that the searched target pictures are inconsistent.

In an optional embodiment, when it is detected that the set feature information of the to-be-detected picture exists in the to-be-detected picture, and the set feature information meets a preset condition, if the version of the detection algorithm of the to-be-detected picture, which is included in the set feature information, is not lower than the version of the detection algorithm currently stored by the detection device, the feature vector of the to-be-detected picture is directly obtained from the to-be-detected picture, and the target picture is searched according to the feature vector, so that algorithm detection on the to-be-detected picture is avoided, and therefore, difference of reference systems of corresponding feature vectors and influence of multiple encoding and decoding caused by multiple times of algorithm detection in the picture searching process can be prevented, and the searched target pictures are inconsistent.

In an optional embodiment, the detection device obtains a target picture in a video stream, where the target picture includes a to-be-detected face picture, encodes the to-be-detected face picture into a picture in a preset image format, such as pictures in image formats like JPEG, TIFF, RAW, and so on, and uses the picture in the preset image format as the to-be-detected picture, so as to add intelligent information of the to-be-detected face picture in a corresponding preset field, such as a redundant field, where the intelligent information includes detection algorithm version information, attribute information, and feature vectors of the to-be-detected picture, that is, the intelligent information of the to-be-detected picture is extracted from a corresponding storage database of the detection device, so as to be added to the preset field of the to-be-detected picture, so as to further detect the to-be-detected picture after the detection device receives the to-be-detected picture, so as to search for the to-be-detected picture, if the redundant field of the JPEG picture has the version, the attribute information and the characteristic vector of the detection algorithm of the corresponding picture to be detected, and if the picture to be detected has the intelligent information of the picture to be detected, the attribute information and the characteristic vector of the picture to be detected are directly obtained from the picture to be detected, and the target picture is searched according to the characteristic vector.

And S540, extracting the set characteristic information of the picture to be detected, wherein the set characteristic information comprises a characteristic vector of the picture to be detected, searching the target picture according to the characteristic vector, and storing the set characteristic information into a preset field of the corresponding picture to be detected.

In this embodiment, when it is detected that the setting feature information of the picture to be detected does not exist in the picture to be detected, or the picture to be detected has the set characteristic information of the picture to be detected, but the set characteristic information does not meet the preset condition, if the version of the detection algorithm of the picture to be detected included in the set characteristic information is lower than the version of the detection algorithm currently stored by the corresponding detection device, then the algorithm detection is carried out again on the picture to be detected so as to extract the set characteristic information of the picture to be detected stored in the current detection equipment, wherein the set feature information can be the detection algorithm version, attribute information and feature vector of the picture to be detected, and synchronously updating and storing the image to be detected in a preset field, such as a corresponding redundant field, so as to search the target image according to the re-extracted feature vector of the image to be detected.

Different from the prior art, the processing method for searching the image by the image in the application comprises the following steps: the detection equipment receives a picture to be detected; judging whether set characteristic information of the picture to be detected exists in the picture to be detected or not, wherein the set characteristic information comprises a characteristic vector of the picture to be detected; and if the set characteristic information exists in the picture to be detected and meets the preset condition, directly acquiring the characteristic vector from the picture to be detected so as to search the target picture according to the characteristic vector. Through the mode, when the characteristic vector of the picture to be detected exists in the picture to be detected, the characteristic vector of the picture to be detected can be directly obtained from the picture to be detected, the target picture is searched according to the characteristic vector, so that the picture is prevented from being subjected to algorithm detection again, and the situation that the difference of the characteristic vector generated by the same picture correspondingly and the inconsistency of the searched target picture are caused due to the fact that the algorithm detection is carried out for multiple times in the process of searching the picture by the picture of the picture information in the video stream and the picture information stream can be prevented.

Based on the general inventive concept, the present application further provides a device for detecting picture information, please refer to fig. 6, where fig. 6 is a schematic structural diagram of a first embodiment of the device for detecting picture information according to the present application. The picture information detecting device 60 includes a receiving module 610, a detecting module 620, and a processing module 630.

In this embodiment, the receiving module 610 is configured to receive a picture to be detected, and perform recognition detection on the received multiple picture streams and the real-time video stream by using corresponding detecting equipment to determine and receive target picture information as the picture to be detected, the detecting module 620 is coupled to the receiving module 610 and configured to determine whether set feature information of the picture to be detected, such as version information of a detecting algorithm of the picture to be detected, attribute information of the picture to be detected, and a feature vector of the picture to be detected, exists in the picture to be detected, and detect that the set feature information of the picture to be detected exists in the picture to be detected, then further determine whether the set feature information satisfies a preset condition, if the version information of the detecting algorithm of the picture to be detected is not lower than a version of the detecting algorithm stored in the current detecting equipment, the processing module 630 is coupled to the detecting module 620 and configured to exist the set feature information of the picture to be detected in the picture to be detected, and when the set characteristic information meets the preset condition, namely the version information of the detection algorithm of the picture to be detected is not lower than the version of the detection algorithm stored in the current detection equipment, processing the picture to be detected through the set characteristic information.

Different from the prior art, the detection device of the picture information in the application comprises: the receiving module is used for receiving the picture to be detected; the detection module is coupled with the receiving module and used for judging whether the set characteristic information of the picture to be detected exists in the picture to be detected or not and further judging whether the set characteristic information meets a preset condition or not when the set characteristic information of the picture to be detected exists in the picture to be detected; and the processing module is coupled with the detection module and used for processing the picture to be detected through the set characteristic information when the set characteristic information of the picture to be detected exists in the picture to be detected and meets a preset condition. Through the detection equipment, when the set characteristic information of the picture to be detected is detected to exist in the picture to be detected, the corresponding set characteristic information can be directly obtained from the picture to be detected to process the picture to be detected, so that the picture to be detected is prevented from being subjected to algorithm detection again, and precious algorithm operation resources are saved.

Based on the general inventive concept, the present application further provides a face detection device, please refer to fig. 7, and fig. 7 is a schematic structural diagram of a first embodiment of the face detection device of the present application. The face detection device 70 includes a receiving module 710, a detecting module 720 and a processing module 730.

In this embodiment, the receiving module 710 is configured to receive a picture to be detected, and when target picture information needs to be processed, first, corresponding detection equipment performs recognition detection on a received multiple paths of picture streams and a real-time video stream to determine and receive the target picture information as the picture to be detected, where the detected picture includes a face picture to be detected, the detection equipment receives the multiple paths of picture streams and the real-time video stream, performs recognition detection on the multiple paths of picture streams and the real-time video stream to find a corresponding face picture, and determines the face picture to be detected this time, and the detecting module 720 is coupled to the receiving module 710 and is configured to determine whether set feature information of the face picture to be detected exists in the picture to be detected, such as attribute information and feature vectors of the face picture; the processing module 730 is coupled to the detecting module 720, and configured to directly obtain attribute information and a feature vector of the face picture to be detected from the face picture to be detected when the set feature information of the face picture to be detected exists in the picture to be detected.

In an optional embodiment, the receiving module 710 is configured to receive a picture to be detected, where the picture to be detected includes a face picture to be detected, and when the detecting module 720 detects that the setting feature information of the face picture to be detected does not exist in the face picture to be detected, or the setting feature information of the face picture to be detected exists in the face picture to be detected, but the version of the detection algorithm of the picture to be detected is lower than the version of the detection algorithm currently stored in the detecting device, the processing module 730 is configured to perform picture decoding on the picture to be detected again to perform algorithm detection, extract the version information of the detection algorithm currently stored in the detecting device, and the attribute information and the feature vector of the face picture to be detected, and update and store the attribute information and the feature vector of the face picture to be detected in the corresponding face picture to be detected.

Be different from prior art, face check out test set includes in this application: the receiving module is used for receiving the picture to be detected, wherein the picture to be detected comprises a face picture to be detected; the detection module is coupled with the receiving module and used for judging whether the set characteristic information of the face picture to be detected exists in the face picture to be detected or not; and the processing module is coupled with the detection module and is used for directly acquiring the set characteristic information of the face picture to be detected from the face picture to be detected when the set characteristic information of the face picture to be detected exists in the face picture to be detected. By the detection equipment, when the set characteristic information of the face picture to be detected exists in the face picture to be detected, the attribute information and the characteristic vector of the face picture to be detected can be directly obtained from the face picture to be detected, so that the situation that the algorithm detection is carried out on the picture to be detected again is avoided, and precious algorithm operation resources are saved.

Based on the general inventive concept, the present application further provides a detection apparatus for searching a graph with a graph, please refer to fig. 8, and fig. 8 is a schematic structural diagram of a first embodiment of the detection apparatus for searching a graph with a graph according to the present application. The detecting device 80 for searching the image comprises a receiving module 810, a detecting module 820 and a processing module 830.

In this embodiment, the receiving module 810 is configured to receive a picture to be detected, when the received picture information is needed to search for a target picture, the corresponding detecting device needs to identify and detect the received multiple paths of picture streams and the real-time video stream first to determine and receive the corresponding picture information as the picture to be detected, the detecting module 820 is coupled to the receiving module 810 and configured to determine whether the set feature information of the picture to be detected exists in the picture to be detected, where the set feature information includes a feature vector of the picture to be detected, and the processing module 830 is coupled to the detecting module 820 and configured to directly obtain the feature vector of the picture to be detected from the picture to be detected when the feature vector of the picture to be detected exists in the picture to be detected, so as to search for the target picture according to the feature vector.

In an alternative embodiment, the receiving module 810 is configured to receive a picture to be detected, the detecting module 820 is coupled to the receiving module 810 and configured to determine whether the set feature information of the picture to be detected exists in the picture to be detected, where the set feature information includes a feature vector of the picture to be detected, and when the detecting module 820 detects that the set feature information of the picture to be detected does not exist in the picture to be detected or the set feature information of the picture to be detected exists in the picture to be detected but the version of the detection algorithm of the picture to be detected is lower than the version of the detection algorithm currently stored in the detecting device, the processing module 830 is further configured to perform picture decoding and algorithm detection again on the picture to be detected to extract the version information of the detection algorithm currently stored in the detecting device, and the attribute information and the feature vector of the picture to be detected and update and store the version information of the detection algorithm currently stored in the detecting device, and searching the target picture according to the re-acquired feature vector.

Different from the prior art, the detection device for searching the image by the image in the application comprises: the receiving module is used for receiving the picture to be detected; the detection module is coupled with the receiving module and used for judging whether the set characteristic information of the picture to be detected exists in the picture to be detected or not, wherein the set characteristic information comprises a characteristic vector of the picture to be detected; and the processing module is coupled with the detection module and is used for directly acquiring the characteristic vector from the picture to be detected when the characteristic vector exists in the picture to be detected so as to search the target picture according to the characteristic vector. By the detection equipment, when the characteristic vector of the picture to be detected exists in the picture to be detected, the characteristic vector of the picture to be detected can be directly obtained from the picture to be detected, the target picture is searched according to the characteristic vector, so that the picture is prevented from being subjected to algorithm detection again, and the situation that the characteristic vector difference generated by the same picture correspondingly and the searched target picture are inconsistent due to the fact that the algorithm detection is carried out for multiple times in the process of searching pictures by pictures of picture information in a video stream and a picture information stream can be prevented.

Based on the general inventive concept, the present application further provides a detection apparatus, please refer to fig. 9, and fig. 9 is a schematic structural diagram of a first embodiment of the detection apparatus of the present application. Wherein the detection device 90 comprises a memory 910 and a processor 920 coupled to each other.

In this embodiment, the detection device is one of the intelligent terminal electronic devices, and the detection device includes a memory 910 and a processor 920 that are coupled to each other, where the memory 910 stores corresponding program data for implementing processing methods of picture information, face detection, and searching for a picture with a picture, and the processor 920 is configured to execute the program data to implement any one of the processing methods described above.

Based on the general inventive concept, the present application further provides a memory device, please refer to fig. 10, where fig. 10 is a schematic structural diagram of an embodiment of the memory device of the present application. In the storage device 100, there is stored program data 1010 that can be executed to implement any of the processing methods described above.

In one embodiment, the storage device 100 may be a memory chip in a terminal, a hard disk, or a removable hard disk or a flash disk, an optical disk, or other readable and writable storage tool, and may also be a server or the like.

In the several embodiments provided in the present application, it should be understood that the disclosed method and apparatus may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, a division of a processor or a memory is merely a logical division, and an actual implementation may have another division, for example, a plurality of processors and memories may be combined to implement the functions or may be integrated into another system, or some features may be omitted, or not implemented. In addition, the shown or discussed mutual coupling or direct coupling or connection may be an indirect coupling or connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.

Units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the embodiment.

In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.

The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present application may be substantially implemented or contributed to by the prior art, or all or part of the technical solution may be embodied in a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, a network device, or the like) or a processor (processor) to execute all or part of the steps of the method according to the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.

The above description is only for the purpose of illustrating embodiments of the present application and is not intended to limit the scope of the present application, and all modifications of equivalent structures and equivalent processes, which are made by the contents of the specification and the drawings of the present application or are directly or indirectly applied to other related technical fields, are also included in the scope of the present application.

Claims

1. A picture information processing method is characterized by comprising the following steps:

the detection equipment receives a picture to be detected;

judging whether the set characteristic information of the picture to be detected exists in the picture to be detected; the set characteristic information comprises version information of a detection algorithm of the picture to be detected;

if the set characteristic information of the picture to be detected exists in the picture to be detected, judging whether the version of the detection algorithm of the picture to be detected is not lower than the version of the detection algorithm stored by the detection equipment or not;

and if the version of the detection algorithm of the picture to be detected is not lower than the version of the detection algorithm stored by the detection equipment, processing the picture to be detected through the set characteristic information.

2. The processing method according to claim 1, characterized in that it further comprises:

if the version of the detection algorithm of the picture to be detected is lower than the version of the detection algorithm stored in the detection equipment, re-extracting the set characteristic information of the picture to be detected, and updating the version of the detection algorithm and the set characteristic information of the picture to be detected.

3. The processing method according to claim 1, wherein the step of receiving, by the detection device, the picture to be detected comprises, before:

receiving an input picture information stream;

and extracting the set characteristic information of each picture in the picture information stream, and storing the set characteristic information into the picture to be detected.

4. The processing method according to claim 3, wherein the step of extracting the setting feature information of each picture in the picture information stream and storing the setting feature information in the picture to be detected comprises;

and coding each image of the image information stream into a JPEG format, and storing the set characteristic information of each image to be detected into a redundant field corresponding to the JPEG format of the image to be detected.

5. The processing method according to claim 1, characterized in that it further comprises:

and if the set characteristic information of the picture to be detected does not exist in the picture to be detected, carrying out algorithm detection on the picture to be detected again so as to extract the set characteristic information of the picture to be detected currently stored in the detection equipment, and updating and storing the set characteristic information into a preset field of the picture to be detected.

6. The processing method according to claim 2, wherein the step of extracting the setting feature information of the picture to be detected comprises:

decoding the picture to be detected;

and extracting attribute information, a characteristic vector and a detection algorithm version of the decoded picture.

7. A processing method for face detection is characterized by comprising the following steps:

the method comprises the steps that a picture to be detected is received by detection equipment, wherein the picture to be detected comprises a face picture to be detected;

judging whether the set characteristic information of the face picture to be detected exists in the face picture to be detected; the set characteristic information comprises version information of a detection algorithm of the face picture to be detected;

if the set characteristic information of the face picture to be detected exists in the face picture to be detected, directly acquiring the set characteristic information of the face picture to be detected from the face picture to be detected, and judging whether the version of the detection algorithm of the face picture to be detected is not lower than the version of the detection algorithm stored by the detection equipment or not;

and if the version of the detection algorithm of the face picture to be detected is not lower than the version of the detection algorithm stored by the detection equipment, processing the face picture to be detected through the set characteristic information.

8. A processing method for searching a picture by a picture is characterized by comprising the following steps:

the detection equipment receives a picture to be detected;

judging whether set characteristic information of the picture to be detected exists in the picture to be detected, wherein the set characteristic information comprises a characteristic vector of the picture to be detected and version information of a detection algorithm;

if the set characteristic information exists in the picture to be detected, judging whether the version of the detection algorithm of the picture to be detected is not lower than the version of the detection algorithm stored by the detection equipment;

and if the version of the detection algorithm of the picture to be detected is not lower than the version of the detection algorithm stored by the detection equipment, directly acquiring the feature vector from the picture to be detected so as to search a target picture according to the feature vector.

9. A detection apparatus of picture information, characterized in that the detection apparatus comprises:

the receiving module is used for receiving the picture to be detected;

the detection module is coupled with the receiving module and is used for judging whether the set characteristic information of the picture to be detected exists in the picture to be detected or not and further judging whether the version of the detection algorithm of the picture to be detected is not lower than the version of the detection algorithm stored by the detection equipment or not when the set characteristic information of the picture to be detected exists in the picture to be detected; the set characteristic information comprises version information of a detection algorithm of the picture to be detected;

and the processing module is coupled with the detection module and is used for processing the picture to be detected through the set characteristic information when the set characteristic information of the picture to be detected exists in the picture to be detected and the version of the detection algorithm of the picture to be detected is not lower than the version of the detection algorithm stored by the detection equipment.

10. A face detection apparatus characterized by comprising:

the receiving module is used for receiving a picture to be detected, wherein the picture to be detected comprises a face picture to be detected;

the detection module is coupled with the receiving module and used for judging whether the set characteristic information of the face picture to be detected exists in the face picture to be detected or not; the set characteristic information comprises version information of a detection algorithm of the face picture to be detected;

the processing module is coupled to the detection module and configured to, when the set feature information of the face picture to be detected exists in the face picture to be detected, directly acquire the set feature information of the face picture to be detected from the face picture to be detected and judge whether the version of the detection algorithm of the face picture to be detected is not lower than the version of the detection algorithm stored in the detection device, so that when the version of the detection algorithm of the face picture to be detected is not lower than the version of the detection algorithm stored in the detection device, the face picture to be detected is processed through the set feature information.

11. A detection apparatus for searching a picture with a picture, the detection apparatus comprising:

the receiving module is used for receiving the picture to be detected;

the detection module is coupled with the receiving module and used for judging whether set characteristic information of the picture to be detected exists in the picture to be detected or not, wherein the set characteristic information comprises a characteristic vector of the picture to be detected and version information of a detection algorithm;

and the processing module is coupled with the detection module and is used for judging whether the version of the detection algorithm of the picture to be detected is not lower than the version of the detection algorithm stored by the detection equipment or not when the set feature information exists in the picture to be detected, so that the feature vector is directly obtained from the picture to be detected when the version of the detection algorithm of the picture to be detected is not lower than the version of the detection algorithm stored by the detection equipment, and a target picture is searched according to the feature vector.

12. A detection device, comprising a memory and a processor coupled to each other;

the memory stores program data;

the processor is adapted to execute the program data to implement the processing method of any of claims 1-6 or 7 or 8.

13. A storage device, characterized in that it stores program data executable to implement a processing method according to any one of claims 1-6 or 7 or 8.