WO2021000829A1 - Multi-dimensional identity information identification method and apparatus, computer device and storage medium - Google Patents

Multi-dimensional identity information identification method and apparatus, computer device and storage medium Download PDF

Info

Publication number
WO2021000829A1
WO2021000829A1 PCT/CN2020/098801 CN2020098801W WO2021000829A1 WO 2021000829 A1 WO2021000829 A1 WO 2021000829A1 CN 2020098801 W CN2020098801 W CN 2020098801W WO 2021000829 A1 WO2021000829 A1 WO 2021000829A1
Authority
WO
WIPO (PCT)
Prior art keywords
preset
identified
identity information
statistical
recognized
Prior art date
Application number
PCT/CN2020/098801
Other languages
French (fr)
Chinese (zh)
Inventor
方成银
Original Assignee
平安科技(深圳)有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 平安科技(深圳)有限公司 filed Critical 平安科技(深圳)有限公司
Publication of WO2021000829A1 publication Critical patent/WO2021000829A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/24Classification techniques
    • G06F18/241Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches
    • G06F18/2411Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches based on the proximity to a decision surface, e.g. support vector machines
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/24Classification techniques
    • G06F18/241Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches
    • G06F18/2415Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches based on parametric or probabilistic models, e.g. based on likelihood ratio or false acceptance rate versus a false rejection rate
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/20Image preprocessing
    • G06V10/26Segmentation of patterns in the image field; Cutting or merging of image elements to establish the pattern region, e.g. clustering-based techniques; Detection of occlusion
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/40Extraction of image or video features
    • G06V10/50Extraction of image or video features by performing operations within image blocks; by using histograms, e.g. histogram of oriented gradients [HoG]; by summing image-intensity values; Projection analysis
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/40Extraction of image or video features
    • G06V10/56Extraction of image or video features relating to colour
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/40Scenes; Scene-specific elements in video content
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168Feature extraction; Face representation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V2201/00Indexing scheme relating to image or video recognition or understanding
    • G06V2201/07Target detection
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/178Human faces, e.g. facial parts, sketches or expressions estimating age from face image; using age information for improving recognition
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02PCLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/30Computing systems specially adapted for manufacturing

Definitions

  • This application relates to the field of artificial intelligence technology, in particular to a multi-dimensional identity information recognition method, device, computer equipment and storage medium.
  • the existing applications for target recognition and capture in video basically use the method of face recognition to track the target object.
  • the requirements for scenes such as the posture lighting of the face in the video are high, and the clarity of the video is also required.
  • Very high requirements the inventor realized that in the case of unsatisfactory recognition conditions, due to the small difference in facial features, the equipment requirements are high, and the misrecognition rate is high, which is not conducive to use in complex scenarios, and the recognition speed is not enough fast.
  • the main purpose of this application is to provide a multi-dimensional identification information identification method, device, computer equipment and storage medium, which can quickly identify the identity of the object to be identified in the video and improve the target identification speed in complex scenarios.
  • This application proposes a multi-dimensional identity information identification method, including:
  • the identification information of the object to be identified in the video is identified, and the identification probability of the object to be identified in all categories of the preset multi-dimensional identity information to be identified is obtained; where the preset multi-dimensional identity information to be identified includes N categories of first identity information to be identified in the human body feature dimension and M categories of second identity information to be identified in the clothing dimension; preset multi-dimensional identity information to be identified as the identity information corresponding to the target object, and both M and N Positive integer;
  • the first preset determination table Look up the corresponding first determination result in the first preset determination table according to the recognition probability to determine whether the corresponding type of preset multi-dimensional identity information to be recognized is recognized according to the first determination result; in the first preset determination table, If the types of multi-dimensional identity information to be identified are different, the judgment conditions corresponding to the identification probabilities are not completely the same;
  • This application also proposes a multi-dimensional identity information recognition device, including:
  • the recognition module is used to identify the identity information of the object to be identified in the video according to the target detection algorithm, and obtain the corresponding identification probability of the object to be identified in all categories of preset multi-dimensional identity information to be identified; wherein, the preset to be identified
  • the multi-dimensional identity information includes N categories of first identity information to be identified in the human body feature dimension and M categories of second identity information to be identified in the clothing dimension; the preset multi-dimensional identity information to be identified is the identity information corresponding to the target object, Both M and N are positive integers;
  • the first search module is configured to search for the corresponding first determination result in the first preset determination table according to the recognition probability, so as to determine whether the corresponding type of preset multi-dimensional identity information to be recognized is recognized according to the first determination result;
  • a predetermined judgment table presets the judgment conditions of the recognition probability, where different types of preset multi-dimensional identity information to be recognized have different types, and the judgment conditions corresponding to the recognition probabilities are not completely the same;
  • the second search module is used to perform statistics on a plurality of first determination results according to preset statistical rules, and search for corresponding second determination results in the second preset determination table according to the statistical results to determine whether the object to be identified is the target The objects match; second judgment results corresponding to different statistical results are preset in the second preset judgment table.
  • This application also proposes a computer device, including a memory and a processor, the memory stores a computer program, and the processor executes the computer program to realize the steps of a multi-dimensional identity information identification method:
  • the identification information of the object to be identified in the video is identified, and the identification probability of the object to be identified in all categories of the preset multi-dimensional identity information to be identified is obtained; where the preset multi-dimensional identity information to be identified includes N categories of first identity information to be identified in the human body feature dimension and M categories of second identity information to be identified in the clothing dimension; preset multi-dimensional identity information to be identified as the identity information corresponding to the target object, and both M and N Positive integer;
  • the first preset determination table Look up the corresponding first determination result in the first preset determination table according to the recognition probability to determine whether the corresponding type of preset multi-dimensional identity information to be recognized is recognized according to the first determination result; in the first preset determination table, If the types of multi-dimensional identity information to be identified are different, the judgment conditions corresponding to the identification probabilities are not completely the same;
  • This application also proposes a storage medium on which a computer program is stored.
  • the steps of a multi-dimensional identity information identification method are realized:
  • the identification information of the object to be identified in the video is identified, and the identification probability of the object to be identified in all categories of the preset multi-dimensional identity information to be identified is obtained; where the preset multi-dimensional identity information to be identified includes N categories of first identity information to be identified in the human body feature dimension and M categories of second identity information to be identified in the clothing dimension; preset multi-dimensional identity information to be identified as the identity information corresponding to the target object, and both M and N Positive integer;
  • the first preset determination table Look up the corresponding first determination result in the first preset determination table according to the recognition probability to determine whether the corresponding type of preset multi-dimensional identity information to be recognized is recognized according to the first determination result; in the first preset determination table, If the types of multi-dimensional identity information to be identified are different, the judgment conditions corresponding to the identification probabilities are not completely the same;
  • this application proposes a multi-dimensional identity information recognition method, device, computer equipment and storage medium.
  • the identity information of the object to be identified in the video is identified according to the preset multi-dimensional identity information to be identified and the target detection algorithm is used to obtain the preset multi-dimensional identity information to be identified.
  • the target detection algorithm is used to obtain the preset multi-dimensional identity information to be identified.
  • the recognition probability on the object it is finally determined whether the object to be recognized matches the target object according to the recognition probability.
  • this application uses relatively easy-to-obtain multi-dimensional identity information to be identified to quickly identify objects to be identified, and distinguishes the corresponding weights of different types of identity information to be identified, which improves Recognition speed and accuracy in complex scenes.
  • FIG. 1 is a schematic diagram of the steps of a multi-dimensional identity information identification method in an embodiment of this application;
  • FIG. 2 is a schematic diagram of modules of a multi-dimensional identity information identification device in an embodiment of the application
  • FIG. 3 is a schematic block diagram of modules of a computer device in an embodiment of the application.
  • FIG. 4 is a schematic block diagram of modules of a storage medium in an embodiment of the application.
  • a multi-dimensional identity information identification method which includes the following steps:
  • the identification information of the object to be identified in the video is identified, and the identification probability of the object to be identified in all categories of the preset multi-dimensional identity information to be identified is obtained; among them, the multi-dimensional identity to be identified is preset
  • the information includes N categories of first identification information to be identified in the human body feature dimension and M categories of second identification information to be identified in the clothing dimension; the preset multi-dimensional identification information to be identified is the identity information corresponding to the target object, M and N All are positive integers;
  • S2 Search for the corresponding first determination result in the first preset determination table according to the recognition probability to determine whether the corresponding category of identity information to be recognized is recognized according to the first determination result; in the first preset determination table, preset If the types of multi-dimensional identity information to be identified are different, the judgment conditions corresponding to the identification probability are not completely the same;
  • S3 Perform statistics on multiple first determination results according to preset statistical rules, and look up the corresponding second determination results in the second preset determination table according to the statistical results to determine whether the object to be identified matches the target object;
  • the second judgment results corresponding to different statistical results are preset in the second preset judgment table.
  • the method of this application does not directly recognize the face of the object to be identified when identifying the object to be identified in the video to be identified, but first uses the obtained preset multi-dimensional identity information to be identified as An identity information of the target object in order to identify the target object, and then the target detection algorithm is used to identify the object to be identified, and the identification probabilities corresponding to the identification information of the object to be identified in different dimensions are obtained.
  • the obtained recognition probability is searched for the corresponding determination result in the preset determination table to determine whether the object to be identified matches the acquired identity tag, that is, to determine whether the object to be identified is the target object.
  • the multi-dimensional identity information to be identified mainly includes the human body characteristic dimension and the clothing dimension.
  • the human body characteristic dimension refers to the characteristic information of the human body itself, which includes multiple different types of identity information to be identified, such as gender and age. , Body shape, hair, etc.; while the clothing dimension refers to the clothing of the target object, which also includes a number of different types of identification information to be identified, such as one or more of hats, glasses, tops, pants and shoes .
  • the acquired multi-dimensional identity information to be identified is "male, 35 years old, short hair, red hat, blue shirt, black pants", where "male, 35 years old, short hair” is a human body feature
  • "Red hat, blue top, and black pants” are the three different types of identification information to be identified in the clothing dimension.
  • the object to be identified in the video is performed according to the target detection algorithm.
  • the identification and screening of the multi-dimensional identity information to be identified can obtain the identification probabilities of different types of identity information to be identified in different dimensions of the object to be identified.
  • the gender recognition algorithm based on eigenface, the gender recognition method based on Fisher criterion, and the face based on Adaboost (Adaptive Boosting) + SVM (support vector machine) can be used.
  • Gender classification algorithm, etc. to determine whether the gender of the object to be identified in the video is consistent with the acquired identity information to be identified.
  • a face age estimation algorithm that combines LBP (local binarization mode) and HOG (gradient histogram) features can be used to extract the local statistical features of faces that are closely related to age changes, and use CCA
  • the method of (canonical correlation analysis) is integrated, and finally the age is estimated by the method of SVR (Support Vector Machine Regression) to determine whether the age of the object to be identified in the video is consistent with the obtained identity information to be identified.
  • SVR Small Vector Machine Regression
  • the recognition of age can be divided into age groups, such as "children”, “Juvenile”, “youth”, “middle-aged” and “aged”, etc., transform the regression problem of accurate age recognition into the classification problem of age recognition, improve the recognition speed and reduce the recognition error rate.
  • the RGB model or the HSV model can be used for recognition.
  • the image to be recognized can be converted into an HSV model through cvtColor(imgOriginal, imgHSV, COLOR_BGR2HSV); Then perform color detection, such as using void inRange(InputArray src, InputArray lowerb, InputArray upperb, OutputArray dst); function for color detection, the function of this function is to detect whether each pixel of the src image is between lowerb and upperb, if it is, this pixel is set to 255 , And save it in the dst image, otherwise it is 0; the binary image of the target color can be obtained through the function, and then the binary image is opened to remove the noise, and then the closed operation is used to connect the connected domains.
  • the specific color of the clothing of the object to be identified can be detected, so as to determine whether the clothing color of the object to be identified in the video is consistent with the acquired identity information to be identified. Further, the texture of the image can also be detected to learn the material of the clothes on the object to be identified.
  • the output of the vector machine according to the detection algorithm actually belongs to the classification probability of the object to be recognized, and all are a number. For example, in gender recognition, it belongs to "male” or "female". For two classification problems, the result obtained by the detection algorithm during detection is actually the recognition probability.
  • the recognition probability of a "male” object to be recognized is “0.78", and the recognition probability of a female is "0.22", then the output result is (male , 0.78; Female, 0.22), so it is determined that the gender of the identified object is male; for another example, the recognition probability of the top color of "red” is “0.6”, the recognition probability of "yellow” is “0.1”, and it is “blue”
  • the recognition probability of "color” is "0.08", the recognition probability of "green” is "0.12”, and the recognition probability of "orange” is "0.1”, then the output result is (red, 0.6; yellow, 0.1; blue, 0.08; green, 0.12; yellow, 0.1), so it is determined that the color of the shirt with the identification object is red.
  • various dimensions of the identification information to be identified are identified for the objects to be identified in the video, and the corresponding identification probabilities of the identification information to be identified in each category are obtained.
  • the corresponding first determination result is searched in the first preset determination table according to the identification probability to determine whether the multi-dimensional identification information to be identified is recognized. It is assumed that the judgment condition of the recognition probability is preset in the judgment table, wherein the judgment conditions corresponding to different types of identity information to be identified are different.
  • the identification information to be identified is "male, 35 years old, short hair, red hat, blue top, black pants", and statistics are obtained to obtain the identification probability of an object to be identified in different categories.
  • the preset probability threshold for gender is 0.8, that is, if the recognition probability of gender is greater than or equal to 0.8, the first judgment result is that the to-be-recognized
  • the preset probability threshold for age is 0.65, that is, if the recognition probability of a young age is greater than or equal to 0.65, the first judgment result is the youth of the subject to be identified according to the judgment condition, and other dimensions are different.
  • the multiple first judgment results are counted through the preset statistical rules, and according to the statistical results in the first Second, look up the corresponding second determination result in the preset determination table to determine whether the object to be identified matches the target object.
  • the second judgment results corresponding to different statistical results are preset in the second preset judgment table, and the second judgment results include three different results: "matching", "not matching” and "uncertain”.
  • the preset statistical rule only counts the number of "yes” or "no" in the first determination result, and the specific value of each recognition probability.
  • the first determination result is the category that recognizes the category If the identity information to be identified is "Yes”, if the category of identity information to be identified is not recognized, it is "No". According to the number of the first judgment results in the statistical results as "Yes” and “No", Look up the corresponding second determination result in the second preset determination table. In a specific embodiment, for example, only after the first determination result of all categories of identity information to be identified has passed, that is, "Yes", the determination The identity tag of the target object is recognized, the corresponding second determination result is found in the second preset determination table as "match”, and it is determined that the object to be recognized matches the target object. In another specific embodiment, for example, there are five different types of identification information to be identified.
  • the first determination results of the four different types of identification information to be identified are all "yes” , It is determined that the object to be identified matches the target object; further, other requirements can be made for the identification information to be identified that fails the final judgment result, such as limiting its identification probability to be between "0.3-0.7” It can serve as an auxiliary reference under the premise that the first judgment results of the other four different types of identity information to be identified are passed; for example, it can be set to find the corresponding in the second preset judgment table.
  • the second determination result of is "undefined", and the user can mark the object to be identified as a suspected target object according to the second determination result.
  • the identification information of the object to be identified in the video is identified according to the target detection algorithm, and the identification probability of the object to be identified in all categories of preset multi-dimensional identity information to be identified is obtained.
  • S11 Separate the object to be recognized from the background of the video to be recognized by an image segmentation algorithm
  • S12 Perform part key point detection on the separated object to be recognized, and segment the recognition area of the object to be recognized according to the key point of the part, and the recognition area includes the head, upper body, and lower body;
  • the object to be identified when performing the corresponding identification and detection of the object to be identified in the video to be identified, the object to be identified is first separated from the background of the video to be identified, that is, only the object to be identified is detected, and the object to be identified is not detected.
  • the video background is detected to reduce the amount of detection operations.
  • an image segmentation algorithm can be used to separate the object to be recognized from the background of the video to be recognized, such as fixed threshold segmentation based on threshold segmentation, histogram bimodal method, OTSU method (maximum between-class variance method), etc.; Various edge detection operators of edge detection methods; region growing method, split merging method and watershed segmentation method based on region segmentation; Normalized Cuts algorithm based on graph theory segmentation, Graph Cuts algorithm, Superpixel lattice algorithm, etc.; based on energy functional The segmentation method, wavelet-based segmentation method and neural network-based segmentation method, etc.
  • the recognition area includes the head, upper body and lower body, such as the neck between the head and upper body. It is a key point of a part.
  • the waist between the upper body and the lower body is also a key point of the part.
  • the hands, elbows, shoulders, chest, face, etc. are also key points of the part.
  • the key points of multiple parts are detected by the object to be recognized. Construct, divide the object to be recognized into three recognition areas, including the head, upper body and lower body, so as to subsequently identify the identity information to be recognized in the corresponding dimensions in each recognition area.
  • a haar cascade can be used to detect the head, upper body, and lower body of the object to be identified.
  • the identification area After dividing the object to be identified into different identification areas, identify the corresponding type of identity information to be identified in the identification area, and obtain the identification probability.
  • the recognition probability of "wearing a hat” is greater than or equal to 0.9, then it can be directly determined that the recognition probability of the corresponding "red hat” is that the probability of recognizing "red” is 0.8.
  • the probability calculation is specially limited. The same is true for the recognition of black pants in other recognition areas, such as the recognition area of the lower body, and there is no special restriction when calculating the recognition probability.
  • Step S2 includes:
  • S21 Search for a corresponding determination condition in the first preset determination table according to the corresponding category of the recognition probability; the determination condition includes the preset probability threshold of the recognition probability in the corresponding category;
  • S22 Compare the recognition probability with a preset probability threshold; the preset probability threshold includes a first preset probability threshold and a second preset probability threshold;
  • the determination conditions corresponding to the recognition probability are not completely the same, so the corresponding category according to the recognition probability is first A corresponding determination condition is searched in a predetermined determination table to determine how to determine the recognition probability of a given category, and the determination condition includes a predetermined probability threshold of the recognition probability in the corresponding category.
  • the recognition probability is compared with the found preset probability threshold. If it is higher than the first preset probability threshold, it is determined that the identification information of the category to be identified is recognized; if it is higher than the second preset probability threshold and lower than If the first preset probability threshold is not recognized, it is determined whether the category of identity information to be recognized is uncertain; if it is lower than the second preset probability threshold, it is determined that the category of identity information to be recognized is not recognized.
  • the type of identity information to be identified is different, and the corresponding preset probability threshold will also be different. For example, when performing age recognition on the object to be identified, relatively clear facial images are required for age recognition.
  • the first preset probability threshold can be set lower, for example, 0.7; while the object to be identified is identified by long shorts or whether there is a person wearing glasses During recognition, due to the large difference between trousers and shorts, and the difference between wearing glasses and not wearing glasses, and the requirements for image quality during detection are relatively low, the first preset probability threshold can be set Higher, for example 0.9.
  • the preset probability threshold is lower if the error rate is higher, and the preset probability threshold is higher if the error rate is low, so that the identified object can be treated as quickly as possible Make a judgment to determine whether it is consistent with the acquired identity information to be identified, while minimizing detection errors.
  • the first judgment result is divided into three categories: the identification information to be identified, the identification information to be identified is uncertain, and the identification information to be identified is not identified, instead of the simple binary processing of yes or no, so that It can be handled more flexibly when making comprehensive judgments.
  • the identification information to be identified is uncertain
  • the identification information to be identified is not identified, instead of the simple binary processing of yes or no, so that It can be handled more flexibly when making comprehensive judgments.
  • the first determination result of the four different types of identification information to be identified is that the corresponding category of identification information to be identified is recognized, It is determined that the object to be identified is consistent with the target object; further, other requirements can be made for the remaining identity information for which the first judgment result is not passed, such as limiting the first judgment result to be uncertain or not
  • the identification of the identity information to be identified in the corresponding category can serve as an auxiliary reference under the premise that the first determination result of the other four different categories of identity information to be identified is the identification of the identity information to be identified in the corresponding category.
  • the step S3 of performing statistics on the multiple first determination results according to a preset statistical rule includes:
  • the statistical score is assigned a value of 1; if it is determined that the identification information to be identified is uncertain according to the first determination result, then The statistical score is assigned a value of 0; if the identification information to be identified is not recognized according to the first judgment result, the statistical score is assigned a score of -1;
  • a corresponding statistical score is assigned to different first judgment results, such as score A, score B, and score C.
  • the statistical score is assigned a value of 1 (A); if it is determined according to the first determination result that it is uncertain whether the identity to be identified is identified Information, the statistical score is assigned a value of 0 (B); if the identification information to be identified is not recognized according to the first determination result, the statistical score is assigned a value of -1 (C).
  • the statistical scores of all the first judgment results are obtained, the statistical scores of all the first judgment results are superimposed and calculated to obtain the statistical result.
  • the statistical result is an intuitive score value. The higher the score value, the object to be identified The higher the match with the target audience. Then, according to the score value, the corresponding second determination result is searched in the second preset determination table to determine whether the object to be identified matches the target object.
  • a certain score threshold is preset, and when the statistical result is greater than the preset score threshold, the first object matching the target object is found. 2. Judgment results.
  • the step S32 of superimposing the statistical scores of all the first judgment results to obtain the statistical results includes:
  • W1, W2, and W3 are the statistical weights corresponding to different types of preset multi-dimensional identity information to be identified.
  • the statistical scores of all the first judgment results are superimposed according to the first formula to obtain the statistical results.
  • different types of identification information are to be identified.
  • the determination results have their corresponding statistical weights.
  • the statistical weights in the statistical results of the identification probability are defined as W1, W2, W3, W4,
  • the object to be identified is considered to be consistent with the acquired identity information, otherwise the object to be identified is considered to be the same
  • the identity information does not match.
  • the corresponding statistical weights will be different.
  • the statistical weight can be set lower, for example, 0.2; and when the object to be identified is recognized for long shorts or whether there is recognition of wearing glasses, due to the large difference between trousers and shorts , There is a big difference between wearing glasses and not wearing glasses, and the requirements for image quality during detection are relatively low, so the statistical weight can be set higher, for example, 0.5, a variety of different types of identity information to be identified The sum of its statistical weights is 1.
  • the statistical weight is lower if the error rate is higher, and the statistical weight is higher if the error rate is low.
  • the identity information to be identified minimizes the impact of errors caused by the identity information to be identified with a high error rate, so that accurate judgments can be made as quickly as possible on the object to be identified, and whether it is consistent with the acquired identity information to be identified. At the same time minimize detection errors.
  • the step of obtaining the statistical weights corresponding to different types of preset to-be-identified multi-dimensional identity information in the preset weight distribution table includes:
  • the current environmental factors include one or more of the current temperature, current air quality, current visibility, current geographic location, and height from the ground A combination of factors; among them, the current environmental factors pre-associated with different types of preset multi-dimensional identity information to be identified are not completely the same;
  • S3212 Determine the corresponding statistical weight in the preset weight distribution table according to the preset type of the multi-dimensional identity information to be identified and current environmental factors; set the corresponding preset weight distribution table in the category of the preset multi-dimensional identity information to be identified Multiple threshold ranges of environmental factors, and different threshold ranges of environmental factors correspond to different statistical weights.
  • the device first obtains the pre-associated current environmental factors according to the preset type of the multi-dimensional identity information to be identified, and then according to the preset type of the multi-dimensional identity information to be identified and the current environment
  • the factor determines the corresponding statistical weight in the preset weight distribution table. For example, when the device detects real-time video or detects certain specific videos, it can determine the statistical weights corresponding to different dimensions of identity information through the current environmental factors obtained.
  • the current environmental factors include current temperature, current air quality, current visibility, A combination of one or more environmental factors in the current geographic location and height from the ground. When the device is performing detection and identification, it can obtain the current environmental factors through the network.
  • the acquisition method can be the device actively search through the network, such as current environmental factors such as current temperature, current air quality, current geographic location, etc., or the device through the network Receive user input of current environmental factors.
  • the device can also acquire current environmental factors through sensors. For example, when acquiring the current environmental factor of the height from the ground, the distance between the camera and the ground can be obtained through the measurement of the distance sensor on the camera. Among them, the current environmental factors pre-associated with different types of preset multi-dimensional identity information to be identified are not completely the same.
  • the length of pants is mainly related to the current temperature, so the preset multi-dimensional identity information of the type of pants length to be identified
  • the pre-associated current environmental factors include the current temperature, and the pre-recognized multi-dimensional identity information of whether to wear glasses and hair length is not related to the current temperature, so the pre-associated current environmental factors do not include Current temperature; for example, the pre-recognized multi-dimensional identity information of the shoe color category has little correlation with current environmental factors such as current air quality, current visibility, and current geographic location, but it is related to the height from the ground.
  • the current environmental factors have a large correlation, so the current environmental factors pre-associated include the height from the ground.
  • the corresponding statistical weights are determined in the preset weight distribution table according to the preset types of the multi-dimensional identity information to be identified and the current environmental factors; Multiple environmental factor threshold ranges are set to identify the categories of multi-dimensional identity information, and different environmental factor threshold ranges correspond to different statistical weights. For example, when the current temperature is 0°C, although the recognition error rate is low when the object to be identified is identified by long shorts, since when the temperature is 0°C, people basically wear long pants, and the screening significance is more significant.
  • the identity information to be identified is trousers
  • its statistical weight is automatically reduced, for example, to 0.1; and when the current temperature is 0°C and the identity information to be identified is shorts, there are basically few people at this time. Will wear shorts, shorts have a more significant screening significance, then its statistical weight will be automatically increased, for example, to 0.7, and when the current temperature is 30°C, the statistical weight ratio of trousers and shorts will be reversed. People who wear shorts are more common, while those who wear long trousers are relatively small. The statistical weight of trousers is higher, and the statistical weight of shorts is lower. As for whether there is identity information to be identified for wearing glasses, because of whether they wear glasses It has little relationship with the current temperature, so its statistical weight does not change due to changes in the current temperature.
  • the image definition is generally poor, and the height of the video camera is generally relatively low. High, the shoes are not easy to shoot clearly, so the statistical weight of the recognition result of "blue shoes” is generally low, such as 0.1, but if the camera is relatively close to the ground, such as 1 meter, then In the video, a clearer shoe image can be obtained, and its statistical weight is automatically increased, for example, 0.5. The same is true for other types of current environmental factors.
  • the statistical weight is automatically increased; when the current environmental factors have a negative impact on the identification of a certain dimension of identity information to be identified, its statistical weight is automatically reduced; when the current environmental factors affect the identity of a certain dimension to be identified
  • the identification of information has no impact, the statistical weight is determined according to the preset statistical weight or the statistical weight is evenly distributed.
  • the identification information of the object to be identified in the video is identified according to the target detection algorithm, and the identification probabilities corresponding to all categories of the preset multi-dimensional identity information to be identified are obtained respectively.
  • step S1 it also includes:
  • S01 By receiving an input setting instruction of preset multi-dimensional identity information to be identified or performing identity information identification on a designated target object through a target detection algorithm, the preset multi-dimensional identity information to be identified is obtained.
  • the device when detecting the video to be recognized, it is first necessary to determine the preset multi-dimensional identity information of the target object to be recognized.
  • the device when the user knows how to accurately input the setting instructions or there is no image of the target object for identification, the device can receive the user's input settings of the multi-dimensional identity information to be identified through wired or wireless communication. Instructions to determine the identification information to be detected.
  • the user when the user does not know how to enter the identity information to be identified in the corresponding dimension or the device cannot receive the entered identity information to be identified, the user can designate a specific identification object as the target object, and then the device can pass The target detection algorithm recognizes the identity information of the specific identification object to actively obtain the multi-dimensional identity information to be identified.
  • the device detects and recognizes images specified by the user, such as detecting and recognizing a full-body photo of a specific recognized object, and obtains the gender, age, body type, and clothes of the specific recognized object as a pre-recognition.
  • images specified by the user such as detecting and recognizing a full-body photo of a specific recognized object, and obtains the gender, age, body type, and clothes of the specific recognized object as a pre-recognition.
  • multi-dimensional identity information to be identified and then perform detection and recognition in the video according to the identified preset multi-dimensional identity information to be identified, and find the object to be identified that matches the multi-dimensional identity information to be identified.
  • Dimensional identity information is used to detect people in the video that match the specific identification object in the image.
  • this application also proposes a multi-dimensional identity information recognition device, including:
  • the recognition module 10 is used to identify the identity information of the object to be recognized in the video according to the target detection algorithm, and obtain the corresponding recognition probability of the object to be recognized in all categories of preset multi-dimensional identity information to be recognized; Identifying multi-dimensional identity information includes N categories of first identity information to be identified in the human body feature dimension and M categories of second identity information to be identified in the clothing dimension; preset the multi-dimensional identity information to be identified as the identity information corresponding to the target object , M and N are both positive integers;
  • the first search module 20 is configured to search for the corresponding first determination result in the first preset determination table according to the recognition probability, so as to determine whether the corresponding type of preset multi-dimensional identity information to be recognized is recognized according to the first determination result;
  • the judgment conditions of the recognition probability are preset, wherein, if different types of preset multi-dimensional identity information to be identified have different types, the judgment conditions corresponding to the recognition probabilities are not completely the same;
  • the second search module 30 is configured to perform statistics on a plurality of first determination results according to preset statistical rules, and search for corresponding second determination results in the second preset determination table according to the statistical results, to determine whether the object to be identified is compatible with The target object matches; the second judgment result corresponding to different statistical results is preset in the second preset judgment table.
  • the aforementioned modules 10-30 correspondingly include sub-modules, units or sub-units for performing the subdivision steps of the foregoing multi-dimensional identity information identification method , I won’t repeat it here.
  • this application also proposes a computer device, including a memory 1003 and a processor 1002, the memory 1003 stores a computer program 1004, and the processor 1002 executes the computer program 1004 when implementing any of the above methods, including:
  • the identification information of the object to be identified in the video is identified, and the identification probability of the object to be identified in all categories of the preset multi-dimensional identity information to be identified is obtained;
  • the preset multi-dimensional identity information to be identified includes N categories of first identity information to be identified in the human body feature dimension and M categories of second identity information to be identified in the clothing dimension; preset multi-dimensional identity information to be identified as the identity information corresponding to the target object, and both M and N A positive integer;
  • the recognition probability look up the corresponding first judgment result in the first preset judgment table to determine whether the corresponding type of preset multi-dimensional identity information to be identified is recognized according to the first judgment result; in the first preset judgment In the table, if the types of the preset multi-dimensional identity information to be identified are
  • this application also proposes a computer storage medium 2001.
  • the storage medium 2001 may be a non-volatile storage medium or a volatile storage medium.
  • a computer program 2002 is stored thereon.
  • the steps of any one of the above methods include: identifying the object to be identified in the video according to the target detection algorithm to obtain the object to be identified Recognition probabilities corresponding to all categories of preset multi-dimensional identity information to be recognized; wherein, the preset multi-dimensional identity information to be recognized includes N categories of first identity information to be recognized in the human body feature dimension and M categories in the clothing dimension
  • the second identity information to be identified; the preset multi-dimensional identity information to be identified is the identity information corresponding to the target object, M and N are both positive integers; according to the identification probability, look up the corresponding first judgment result in the first preset judgment table , To determine whether the preset multi-dimensional identity information of the corresponding category is recognized according to the first determination result; in the first preset determination table, if the categories of the preset multi-dimensional identity information to

Abstract

The present application relates to the technical field of artificial intelligence. Provided are a multi-dimensional identity information identification method and apparatus, a computer device and a storage medium. The method comprises: during the tracking and identification of a target object in a video, after preset multi-dimensional identity information to be identified of the target object is acquired, identifying identity information of an object to be identified in the video according to the preset multi-dimensional identity information to be identified and by means of a target detection algorithm, so as to obtain a corresponding identification probability of said preset multi-dimensional identity information with respect to the object to be identified; and finally, determining, according to the identification probability, whether the object to be identified matches the target object. According to the present application, where a facial recognition condition is not ideal, the object to be identified is quickly distinguished by means of the multi-dimensional identity information to be identified, which information is relatively easily obtained, and different types of identity information to be identified are correspondingly distinguished by means of weights, such that the identification speed and precision in a complex scenario are improved.

Description

多维度身份信息识别方法、装置、计算机设备及存储介质Multi-dimensional identity information identification method, device, computer equipment and storage medium
本申请要求于2019年07月03日提交中国专利局、申请号为201910601411.9,发明名称为“多维度身份信息识别方法、装置、计算机设备及存储介质”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。This application claims the priority of a Chinese patent application filed with the Chinese Patent Office on July 3, 2019, the application number is 201910601411.9, and the invention title is "Multi-dimensional identification information identification methods, devices, computer equipment and storage media", and its entire contents Incorporated in this application by reference.
技术领域Technical field
本申请涉及到人工智能技术领域,特别是涉及到一种多维度身份信息识别方法、装置、计算机设备及存储介质。This application relates to the field of artificial intelligence technology, in particular to a multi-dimensional identity information recognition method, device, computer equipment and storage medium.
背景技术Background technique
现有的在视频中进行目标识别捕捉的应用中,基本上都是采用人脸识别的方法对目标对象进行追踪,对于视频中人脸的姿态光照等场景要求较高,对视频的清晰度也有很高要求,发明人意识到在识别条件不理想的情况下,由于人脸的特征差异较小,因此对设备要求高,且误识率高,不利于在复杂场景下进行使用,识别速度不够快速。The existing applications for target recognition and capture in video basically use the method of face recognition to track the target object. The requirements for scenes such as the posture lighting of the face in the video are high, and the clarity of the video is also required. Very high requirements, the inventor realized that in the case of unsatisfactory recognition conditions, due to the small difference in facial features, the equipment requirements are high, and the misrecognition rate is high, which is not conducive to use in complex scenarios, and the recognition speed is not enough fast.
技术问题technical problem
本申请的主要目的为提供一种多维度身份信息识别方法、装置、计算机设备及存储介质,对视频中待识别对象的身份进行快速甄别,提高复杂场景下的目标识别速度。The main purpose of this application is to provide a multi-dimensional identification information identification method, device, computer equipment and storage medium, which can quickly identify the identity of the object to be identified in the video and improve the target identification speed in complex scenarios.
技术解决方案Technical solutions
本申请提出一种多维度身份信息识别方法,包括:This application proposes a multi-dimensional identity information identification method, including:
根据目标检测算法对视频中的待识别对象进行身份信息识别,得出待识别对象在预设待识别多维度身份信息的所有类别上对应的识别概率;其中,预设待识别多维度身份信息包括人体特征维度中N个类别的第一待识别身份信息以及衣物维度中M个类别的第二待识别身份信息;预设待识别多维度身份信息为目标对象对应的身份信息,M和N均为正整数;According to the target detection algorithm, the identification information of the object to be identified in the video is identified, and the identification probability of the object to be identified in all categories of the preset multi-dimensional identity information to be identified is obtained; where the preset multi-dimensional identity information to be identified includes N categories of first identity information to be identified in the human body feature dimension and M categories of second identity information to be identified in the clothing dimension; preset multi-dimensional identity information to be identified as the identity information corresponding to the target object, and both M and N Positive integer;
根据识别概率在第一预设判定表中查找对应的第一判定结果,以根据第一判定结果判定是否识别到对应类别的预设待识别多维度身份信息;在第一预设判定表中,预设待识别多维度身份信息的类别不同,则识别概率对应的判定条件也不完全相同;Look up the corresponding first determination result in the first preset determination table according to the recognition probability to determine whether the corresponding type of preset multi-dimensional identity information to be recognized is recognized according to the first determination result; in the first preset determination table, If the types of multi-dimensional identity information to be identified are different, the judgment conditions corresponding to the identification probabilities are not completely the same;
根据预设统计规则对多个第一判定结果进行统计,并根据统计结果在第二预设判定表中查找对应的第二判定结果,以判定待识别对象是否与目标对象相匹配;在第二预设判定表中预设了不同统计结果对应的第二判定结果。Perform statistics on multiple first determination results according to preset statistical rules, and look up the corresponding second determination results in the second preset determination table according to the statistical results to determine whether the object to be identified matches the target object; in the second The second judgment result corresponding to different statistical results is preset in the preset judgment table.
本申请还提出了一种多维度身份信息识别装置,包括:This application also proposes a multi-dimensional identity information recognition device, including:
识别模块,用于根据目标检测算法对视频中的待识别对象进行身份信息识别,得出待识别对象在预设待识别多维度身份信息的所有类别上对应的识别概率;其中,预设待识别多维度身份信息包括人体特征维度中N个类别的第一待识别身份信息以及衣物维度中M个类别的第二待识别身份信息;预设待识别多维度身份信息为目标对象对应的身份信息,M和N均为正整数;The recognition module is used to identify the identity information of the object to be identified in the video according to the target detection algorithm, and obtain the corresponding identification probability of the object to be identified in all categories of preset multi-dimensional identity information to be identified; wherein, the preset to be identified The multi-dimensional identity information includes N categories of first identity information to be identified in the human body feature dimension and M categories of second identity information to be identified in the clothing dimension; the preset multi-dimensional identity information to be identified is the identity information corresponding to the target object, Both M and N are positive integers;
第一查找模块,用于根据识别概率在第一预设判定表中查找对应的第一判定结果,以根据第一判定结果判定是否识别到对应类别的预设待识别多维度身份信息;在第一预设判定表中预先设定了识别概率的判定条件,其中,不同类别的预设待识别多维度身份信息的类别不同,则识别概率对应的判定条件也不完全相同;The first search module is configured to search for the corresponding first determination result in the first preset determination table according to the recognition probability, so as to determine whether the corresponding type of preset multi-dimensional identity information to be recognized is recognized according to the first determination result; A predetermined judgment table presets the judgment conditions of the recognition probability, where different types of preset multi-dimensional identity information to be recognized have different types, and the judgment conditions corresponding to the recognition probabilities are not completely the same;
第二查找模块,用于根据预设统计规则对多个第一判定结果进行统计,并根据统计结果在第二预设判定表中查找对应的第二判定结果,以判定待识别对象是否与目标对象相匹配;在第二预设判定表中预设了不同统计结果对应的第二判定结果。The second search module is used to perform statistics on a plurality of first determination results according to preset statistical rules, and search for corresponding second determination results in the second preset determination table according to the statistical results to determine whether the object to be identified is the target The objects match; second judgment results corresponding to different statistical results are preset in the second preset judgment table.
本申请还提出了一种计算机设备,包括存储器和处理器,存储器存储有计算机程序,处理器执行计算机程序时实现一种多维度身份信息识别方法的步骤:This application also proposes a computer device, including a memory and a processor, the memory stores a computer program, and the processor executes the computer program to realize the steps of a multi-dimensional identity information identification method:
根据目标检测算法对视频中的待识别对象进行身份信息识别,得出待识别对象在预设待识别多维度身份信息的所有类别上对应的识别概率;其中,预设待识别多维度身份信息包括人体特征维度中N个类别的第一待识别身份信息以及衣物维度中M个类别的第二待识别身份信息;预设待识别多维度身份信息为目标对象对应的身份信息,M和N均为正整数;According to the target detection algorithm, the identification information of the object to be identified in the video is identified, and the identification probability of the object to be identified in all categories of the preset multi-dimensional identity information to be identified is obtained; where the preset multi-dimensional identity information to be identified includes N categories of first identity information to be identified in the human body feature dimension and M categories of second identity information to be identified in the clothing dimension; preset multi-dimensional identity information to be identified as the identity information corresponding to the target object, and both M and N Positive integer;
根据识别概率在第一预设判定表中查找对应的第一判定结果,以根据第一判定结果判定是否识别到对应类别的预设待识别多维度身份信息;在第一预设判定表中,预设待识别多维度身份信息的类别不同,则识别概率对应的判定条件也不完全相同;Look up the corresponding first determination result in the first preset determination table according to the recognition probability to determine whether the corresponding type of preset multi-dimensional identity information to be recognized is recognized according to the first determination result; in the first preset determination table, If the types of multi-dimensional identity information to be identified are different, the judgment conditions corresponding to the identification probabilities are not completely the same;
根据预设统计规则对多个第一判定结果进行统计,并根据统计结果在第二预设判定表中查找对应的第二判定结果,以判定待识别对象是否与目标对象相匹配;在第二预设判定表中预设了不同统计结果对应的第二判定结果。Perform statistics on multiple first determination results according to preset statistical rules, and look up the corresponding second determination results in the second preset determination table according to the statistical results to determine whether the object to be identified matches the target object; in the second The second judgment result corresponding to different statistical results is preset in the preset judgment table.
本申请还提出了一种存储介质,其上存储有计算机程序,计算机程序被处理器执行时实现一种多维度身份信息识别方法的步骤:This application also proposes a storage medium on which a computer program is stored. When the computer program is executed by a processor, the steps of a multi-dimensional identity information identification method are realized:
根据目标检测算法对视频中的待识别对象进行身份信息识别,得出待识别对象在预设待识别多维度身份信息的所有类别上对应的识别概率;其中,预设待识别多维度身份信息包括人体特征维度中N个类别的第一待识别身份信息以及衣物维度中M个类别的第二待识别身份信息;预设待识别多维度身份信息为目标对象对应的身份信息,M和N均为正整数;According to the target detection algorithm, the identification information of the object to be identified in the video is identified, and the identification probability of the object to be identified in all categories of the preset multi-dimensional identity information to be identified is obtained; where the preset multi-dimensional identity information to be identified includes N categories of first identity information to be identified in the human body feature dimension and M categories of second identity information to be identified in the clothing dimension; preset multi-dimensional identity information to be identified as the identity information corresponding to the target object, and both M and N Positive integer;
根据识别概率在第一预设判定表中查找对应的第一判定结果,以根据第一判定结果判定是否识别到对应类别的预设待识别多维度身份信息;在第一预设判定表中,预设待识别多维度身份信息的类别不同,则识别概率对应的判定条件也不完全相同;Look up the corresponding first determination result in the first preset determination table according to the recognition probability to determine whether the corresponding type of preset multi-dimensional identity information to be recognized is recognized according to the first determination result; in the first preset determination table, If the types of multi-dimensional identity information to be identified are different, the judgment conditions corresponding to the identification probabilities are not completely the same;
根据预设统计规则对多个第一判定结果进行统计,并根据统计结果在第二预设判定表中查找对应的第二判定结果,以判定待识别对象是否与目标对象相匹配;在第二预设判定表中预设了不同统计结果对应的第二判定结果。Perform statistics on multiple first determination results according to preset statistical rules, and look up the corresponding second determination results in the second preset determination table according to the statistical results to determine whether the object to be identified matches the target object; in the second The second judgment result corresponding to different statistical results is preset in the preset judgment table.
有益效果Beneficial effect
本申请与现有技术相比,有益效果是:本申请提出了一种多维度身份信息识别方法、装置、计算机设备及存储介质,在进行视频中目标对象的追踪识别时,在获取目标对象的预设待识别多维度身份信息之后,根据该预设待识别多维度身份信息以及通过目标检测算法对视频中的待识别对象进行身份信息的识别,得到预设待识别多维度身份信息在待识别对象上对应的识别概率,最后根据识别概率判定待识别对象与目标对象是否匹配。本申请在人脸识别条件不理想的情况下,通过相对较易获得的待识别多维度身份信息对待识别对象进行快速甄别,并对不同类别的待识别身份信息做了相应的权重区分,提高了在复杂场景下的识别速度和精度。Compared with the prior art, this application has the beneficial effect that: this application proposes a multi-dimensional identity information recognition method, device, computer equipment and storage medium. When tracking and recognizing a target object in a video, the After preset the multi-dimensional identity information to be identified, the identity information of the object to be identified in the video is identified according to the preset multi-dimensional identity information to be identified and the target detection algorithm is used to obtain the preset multi-dimensional identity information to be identified. According to the corresponding recognition probability on the object, it is finally determined whether the object to be recognized matches the target object according to the recognition probability. In the case of unsatisfactory face recognition conditions, this application uses relatively easy-to-obtain multi-dimensional identity information to be identified to quickly identify objects to be identified, and distinguishes the corresponding weights of different types of identity information to be identified, which improves Recognition speed and accuracy in complex scenes.
附图说明Description of the drawings
图1为本申请一实施例中多维度身份信息识别方法的步骤示意图;FIG. 1 is a schematic diagram of the steps of a multi-dimensional identity information identification method in an embodiment of this application;
图2为本申请一实施例中多维度身份信息识别装置的模块示意图;2 is a schematic diagram of modules of a multi-dimensional identity information identification device in an embodiment of the application;
图3为本申请一实施例中计算机设备的模块示意框图;FIG. 3 is a schematic block diagram of modules of a computer device in an embodiment of the application;
图4为本申请一实施例中存储介质的模块示意框图。FIG. 4 is a schematic block diagram of modules of a storage medium in an embodiment of the application.
本发明的最佳实施方式The best mode of the invention
应当理解,此处所描述的具体实施例仅仅用以解释本申请,并不用于限定本申请。It should be understood that the specific embodiments described here are only used to explain the application, and are not used to limit the application.
下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本申请的一部分实施例,而不是全部的实施例。基于本申请中的实施例,本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例,都属于本申请保护的范围。The technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in this application, all other embodiments obtained by those of ordinary skill in the art without creative work fall within the protection scope of this application.
需要说明,本申请实施例中所有方向性指示(诸如上、下、左、右、前、后……)仅用于解释在某一特定姿态(如附图所示)下各部件之间的相对位置关系、运动情况等,如果该特定姿态发生改变时,则该方向性指示也相应地随之改变,的连接可以是直接连接,也可以是间接连接。It should be noted that all directional indications (such as up, down, left, right, front, back...) in the embodiments of this application are only used to explain the difference between components in a specific posture (as shown in the accompanying drawings). The relative positional relationship, movement situation, etc., if the specific posture changes, the directional indication changes accordingly, and the connection can be a direct connection or an indirect connection.
另外,在本申请中如涉及“第一”、“第二”等的描述仅用于描述目的,而不能理解为指示或暗示其相对重要性或者隐含指明所指示的技术特征的数量。由此,限定有“第一”、“第二”的特征可以明示或者隐含地包括至少一个该特征。另外,各个实施例之间的技术方案可以相互结合,但是必须是以本领域普通技术人员能够实现为基础,当技术方案的结合出现相互矛盾或无法实现时应当认为这种技术方案的结合不存在,也不在本申请要求的保护范围之内。In addition, the descriptions related to "first", "second", etc. in this application are only for descriptive purposes, and cannot be understood as indicating or implying their relative importance or implicitly indicating the number of indicated technical features. Therefore, the features defined with "first" and "second" may explicitly or implicitly include at least one of the features. In addition, the technical solutions between the various embodiments can be combined with each other, but it must be based on what can be achieved by a person of ordinary skill in the art. When the combination of technical solutions is contradictory or cannot be achieved, it should be considered that such a combination of technical solutions does not exist. , Not within the scope of protection required by this application.
参照图1,本申请在一实施例中提出了一种多维度身份信息识别方法,包括如下步骤:1, in an embodiment of the present application, a multi-dimensional identity information identification method is proposed, which includes the following steps:
S1:根据目标检测算法对视频中的待识别对象进行身份信息识别,得出待识别对象在预设待识别多维度身份信息的所有类别上对应的识别概率;其中,预设待识别多维度身份信息包括人体特征维度中N个类别的第一待识别身份信息以及衣物维度中M个类别的第二待识别身份信息;预设待识别多维度身份信息为目标对象对应的身份信息,M和N均为正整数;S1: According to the target detection algorithm, the identification information of the object to be identified in the video is identified, and the identification probability of the object to be identified in all categories of the preset multi-dimensional identity information to be identified is obtained; among them, the multi-dimensional identity to be identified is preset The information includes N categories of first identification information to be identified in the human body feature dimension and M categories of second identification information to be identified in the clothing dimension; the preset multi-dimensional identification information to be identified is the identity information corresponding to the target object, M and N All are positive integers;
S2:根据识别概率在第一预设判定表中查找对应的第一判定结果,以根据第一判定结果判定是否识别到对应类别的待识别身份信息;在第一预设判定表中,预设待识别多维度身份信息的类别不同,则识别概率对应的判定条件也不完全相同;S2: Search for the corresponding first determination result in the first preset determination table according to the recognition probability to determine whether the corresponding category of identity information to be recognized is recognized according to the first determination result; in the first preset determination table, preset If the types of multi-dimensional identity information to be identified are different, the judgment conditions corresponding to the identification probability are not completely the same;
S3:根据预设统计规则对多个第一判定结果进行统计,并根据统计结果在第二预设判定表中查找对应的第二判定结果,以判定待识别对象是否与目标对象相匹配;在第二预设判定表中预设了不同统计结果对应的第二判定结果。S3: Perform statistics on multiple first determination results according to preset statistical rules, and look up the corresponding second determination results in the second preset determination table according to the statistical results to determine whether the object to be identified matches the target object; The second judgment results corresponding to different statistical results are preset in the second preset judgment table.
在上述步骤实施时,本申请方法在对待识别视频中的待识别对象进行身份识别时,并不直接对待识别对象的人脸进行识别,而是先将获取的预设待识别多维度身份信息作为目标对象的一个身份信息,以便对目标对象进行鉴别,然后通过目标检测算法对待识别对象进行识别,并分别得出待识别对象在不同维度上的待识别身份信息所对应的识别概率,最后根据得出的识别概率在预设判定表中查找对应的判定结果,以判定待识别对象是否匹配获取的身份标签,也即是判定待识别对象是否为目标对象。其中待识别多维度身份信息主要包括人体特征维度以及衣物维度,人体特征维度即是指的是人体本身所具有的特征信息,其下包括了多个不同类别的待识别身份信息,例如性别、年龄、体型、头发等;而衣物维度即指的是目标对象的衣着,其下也包括了多个不同类别的待识别身份信息,例如帽子、眼镜、上衣、裤子和鞋子中的一种或多种。When the above steps are implemented, the method of this application does not directly recognize the face of the object to be identified when identifying the object to be identified in the video to be identified, but first uses the obtained preset multi-dimensional identity information to be identified as An identity information of the target object in order to identify the target object, and then the target detection algorithm is used to identify the object to be identified, and the identification probabilities corresponding to the identification information of the object to be identified in different dimensions are obtained. The obtained recognition probability is searched for the corresponding determination result in the preset determination table to determine whether the object to be identified matches the acquired identity tag, that is, to determine whether the object to be identified is the target object. Among them, the multi-dimensional identity information to be identified mainly includes the human body characteristic dimension and the clothing dimension. The human body characteristic dimension refers to the characteristic information of the human body itself, which includes multiple different types of identity information to be identified, such as gender and age. , Body shape, hair, etc.; while the clothing dimension refers to the clothing of the target object, which also includes a number of different types of identification information to be identified, such as one or more of hats, glasses, tops, pants and shoes .
在一个具体的实施例中,例如获取的待识别多维度身份信息为“男,35岁,短发,红色帽子,蓝色上衣,黑色裤子”,其中“男,35岁,短发”即是人体特征维度上三个不同类别的待识别身份信息,“红色帽子,蓝色上衣,黑色裤子”即是衣物维度上三个不同类别的待识别身份信息,根据目标检测算法对视频中的待识别对象进行待识别多维度身份信息的识别筛选,分别得出待识别对象在不同维度上的不同类别待识别身份信息的识别概率。In a specific embodiment, for example, the acquired multi-dimensional identity information to be identified is "male, 35 years old, short hair, red hat, blue shirt, black pants", where "male, 35 years old, short hair" is a human body feature There are three different types of identification information to be identified in the dimension. "Red hat, blue top, and black pants" are the three different types of identification information to be identified in the clothing dimension. The object to be identified in the video is performed according to the target detection algorithm. The identification and screening of the multi-dimensional identity information to be identified can obtain the identification probabilities of different types of identity information to be identified in different dimensions of the object to be identified.
例如对于待识别对象的性别检测可以采用基于特征脸的性别识别算法、基于Fisher准则的性别识别方法和基于Adaboost(Adaptive Boosting,自适应增强)+SVM(support vector machine ,支持向量机)的人脸性别分类算法等,从而确定视频中的待识别对象的性别是否与获取的待识别身份信息一致。For example, for the gender detection of the object to be recognized, the gender recognition algorithm based on eigenface, the gender recognition method based on Fisher criterion, and the face based on Adaboost (Adaptive Boosting) + SVM (support vector machine) can be used. Gender classification algorithm, etc., to determine whether the gender of the object to be identified in the video is consistent with the acquired identity information to be identified.
对于待识别对象的年龄检测,则可以采用融合LBP(局部二值化模式)和HOG(梯度直方图)特征的人脸年龄估计算法提取与年龄变化关系紧密的人脸的局部统计特征,并用CCA(典型相关分析)的方法融合,最后通过SVR(支持向量机回归)的方法进行年龄估计,从而确定视频中的待识别对象的年龄是否与获取的待识别身份信息一致。由于对于年龄的精准识别对图像质量具有较高要求,且误差率可能较大,不利于对待识别视频中待识别对象进行快速筛选,因此可将对年龄的识别分成年龄段,例如“儿童”、“少年”、“青年”、“中年”和“老年”等,将关于年龄精准识别的回归问题转化成年龄段识别的分类问题,提高识别速度,减少识别误差率。For the age detection of the object to be recognized, a face age estimation algorithm that combines LBP (local binarization mode) and HOG (gradient histogram) features can be used to extract the local statistical features of faces that are closely related to age changes, and use CCA The method of (canonical correlation analysis) is integrated, and finally the age is estimated by the method of SVR (Support Vector Machine Regression) to determine whether the age of the object to be identified in the video is consistent with the obtained identity information to be identified. Because accurate age recognition has high requirements on image quality, and the error rate may be large, it is not conducive to rapid screening of the objects to be recognized in the video to be recognized. Therefore, the recognition of age can be divided into age groups, such as "children", "Juvenile", "youth", "middle-aged" and "aged", etc., transform the regression problem of accurate age recognition into the classification problem of age recognition, improve the recognition speed and reduce the recognition error rate.
对于待识别对象的衣物颜色检测,则可以采用RGB模型或HSV模型进行识别,例如将待识别图像通过cvtColor(imgOriginal, imgHSV, COLOR_BGR2HSV);转化成HSV模型,然后对彩色图像做直方图均衡化,接着再进行颜色检测,例如用void inRange(InputArray src, InputArray lowerb, InputArray upperb, OutputArray dst);函数进行颜色检测,这个函数的作用就是检测src图像的每一个像素是不是在lowerb和upperb之间,如果是,这个像素就设置为255,并保存在dst图像中,否则为0 ;通过函数就可以得到目标颜色的二值图像,接着对二值图像进行开操作,删除噪点,再使用闭操作,连接连通域,根据得到的数值就可以检测出待识别对象衣物的具体颜色,从而确定视频中的待识别对象的衣物颜色是否与获取的待识别身份信息一致。进一步地,还可以通过对图像纹理进行检测,从而得知待识别对象身上的衣物材质。For the clothing color detection of the object to be recognized, the RGB model or the HSV model can be used for recognition. For example, the image to be recognized can be converted into an HSV model through cvtColor(imgOriginal, imgHSV, COLOR_BGR2HSV); Then perform color detection, such as using void inRange(InputArray src, InputArray lowerb, InputArray upperb, OutputArray dst); function for color detection, the function of this function is to detect whether each pixel of the src image is between lowerb and upperb, if it is, this pixel is set to 255 , And save it in the dst image, otherwise it is 0; the binary image of the target color can be obtained through the function, and then the binary image is opened to remove the noise, and then the closed operation is used to connect the connected domains. According to the obtained value The specific color of the clothing of the object to be identified can be detected, so as to determine whether the clothing color of the object to be identified in the video is consistent with the acquired identity information to be identified. Further, the texture of the image can also be detected to learn the material of the clothes on the object to be identified.
在以上的目标检测算法中,根据检测算法的向量机输出的实际上都是属于对待识别对象的分类概率,都为一个数字,例如在性别识别中,即是属于“男”或“女”的二分类问题,检测算法在检测时得到的结果实际上是识别概率,例如待识别对象为“男”的识别概率是“0.78”,为女的识别概率是“0.22”,则输出结果为(男,0.78;女,0.22),因此判定该带识别对象的性别为男;再例如上衣颜色为“红色”的识别概率为“0.6”,为“黄色”的识别概率为“0.1”,为“蓝色”的识别概率为“0.08”,为“绿色”的识别概率为“0.12”,为“橙色”的识别概率为“0.1”,则输出结果为(红色,0.6;黄色,0.1;蓝色,0.08;绿色,0.12;黄色,0.1),因此判定该带识别对象的上衣颜色为红色。由此对视频中的待识别对象进行各种维度的待识别身份信息的识别,并得出各个类别的待识别身份信息相应的识别概率。In the above target detection algorithm, the output of the vector machine according to the detection algorithm actually belongs to the classification probability of the object to be recognized, and all are a number. For example, in gender recognition, it belongs to "male" or "female". For two classification problems, the result obtained by the detection algorithm during detection is actually the recognition probability. For example, the recognition probability of a "male" object to be recognized is "0.78", and the recognition probability of a female is "0.22", then the output result is (male , 0.78; Female, 0.22), so it is determined that the gender of the identified object is male; for another example, the recognition probability of the top color of "red" is "0.6", the recognition probability of "yellow" is "0.1", and it is "blue" The recognition probability of "color" is "0.08", the recognition probability of "green" is "0.12", and the recognition probability of "orange" is "0.1", then the output result is (red, 0.6; yellow, 0.1; blue, 0.08; green, 0.12; yellow, 0.1), so it is determined that the color of the shirt with the identification object is red. In this way, various dimensions of the identification information to be identified are identified for the objects to be identified in the video, and the corresponding identification probabilities of the identification information to be identified in each category are obtained.
得出不同类别的待识别身份信息相应的识别概率之后,根据识别概率在第一预设判定表中查找对应的第一判定结果,以判定是否识别到待识别多维度身份信息,在第一预设判定表中预先设定了识别概率的判定条件,其中,不同类别的待识别身份信息所对应的判定条件不同。在一个具体的实施例中,例如待识别身份信息为“男,35岁,短发,红色帽子,蓝色上衣,黑色裤子”统计得出一待识别对象的在不同类别的待识别身份信息识别概率分别为“男,0.85”, “青年,0.78”, “红色帽子,0.7”, “蓝色上衣,0.4”, “黑色裤子,0.68”,则按照得出的各项识别概率在第一预设判定列表中进行查找,例如在预设判定列表中,关于性别的预设概率阈值为0.8,即若性别为男的识别概率大于等于0.8,则根据该判定条件得到第一判定结果为该待识别对象的性别为男;关于年龄的预设概率阈值为0.65,即若年龄为青年的识别概率大于等于0.65,则根据该判定条件得到第一判定结果为该待识别对象的青年,其他维度下不同类别的待识别身份信息也是同理。After obtaining the corresponding identification probabilities of different types of identification information to be identified, the corresponding first determination result is searched in the first preset determination table according to the identification probability to determine whether the multi-dimensional identification information to be identified is recognized. It is assumed that the judgment condition of the recognition probability is preset in the judgment table, wherein the judgment conditions corresponding to different types of identity information to be identified are different. In a specific embodiment, for example, the identification information to be identified is "male, 35 years old, short hair, red hat, blue top, black pants", and statistics are obtained to obtain the identification probability of an object to be identified in different categories. They are "male, 0.85", "youth, 0.78", "red hat, 0.7", "blue shirt, 0.4", "black pants, 0.68", and the recognition probabilities obtained are set in the first preset Search in the judgment list. For example, in the preset judgment list, the preset probability threshold for gender is 0.8, that is, if the recognition probability of gender is greater than or equal to 0.8, the first judgment result is that the to-be-recognized The gender of the subject is male; the preset probability threshold for age is 0.65, that is, if the recognition probability of a young age is greater than or equal to 0.65, the first judgment result is the youth of the subject to be identified according to the judgment condition, and other dimensions are different The same is true for categories of identification information to be identified.
根据各项类别待识别身份信息的识别概率在第一预设判定列表中查找到对应的第一判定结果后,通过预设统计规则对多个第一判定结果进行统计,并根据统计结果在第二预设判定表中查找对应的第二判定结果,以判定待识别对象是否与目标对象相匹配。在第二预设判定表中预设了不同统计结果对应的第二判定结果,第二判定结果包括“匹配”、“不匹配”以及“不确定”三种不同的结果。在一个具体的实施例中,预设统计规则只是统计第一判定结果中“是”或者“否”的个数,以及各个识别概率的具体数值,其中第一判定结果若为识别到该类别的待识别身份信息,则为“是”,若为未识别到该类别的待识别身份信息,则为“否”,根据统计结果中第一判定结果为“是”和“否”的个数,在第二预设判定表中查找对应的第二判定结果,在一个具体的实施例中,例如只有所有类别的待识别身份信息的第一判定结果都通过,即为“是”之后,才判定识别到目标对象的身份标签,在第二预设判定表中查找到对应的第二判定结果为“匹配”,判定该待识别对象与目标对象相匹配。在另一个具体的实施例中,例如有五项不同类别的待识别身份信息,基于识别存在一定误差的考虑,若其中四项不同类别的待识别身份信息的第一判定结果都为“是”,就判定该待识别对象与目标对象相匹配;进一步地,对于剩下的最后一项判定结果不通过的待识别身份信息可以做其他要求,例如限定其识别概率要处于“0.3-0.7”之间,能够在其他四项不同类别的待识别身份信息的第一判定结果通过的前提下,起到一个辅助参考的作用;又例如,可以设定其在第二预设判定表中查找到对应的第二判定结果为“不确定”,用户根据该第二判定结果可将待识别对象标记为疑似目标对象。After finding the corresponding first judgment result in the first preset judgment list according to the identification probability of each category of identity information to be identified, the multiple first judgment results are counted through the preset statistical rules, and according to the statistical results in the first Second, look up the corresponding second determination result in the preset determination table to determine whether the object to be identified matches the target object. The second judgment results corresponding to different statistical results are preset in the second preset judgment table, and the second judgment results include three different results: "matching", "not matching" and "uncertain". In a specific embodiment, the preset statistical rule only counts the number of "yes" or "no" in the first determination result, and the specific value of each recognition probability. If the first determination result is the category that recognizes the category If the identity information to be identified is "Yes", if the category of identity information to be identified is not recognized, it is "No". According to the number of the first judgment results in the statistical results as "Yes" and "No", Look up the corresponding second determination result in the second preset determination table. In a specific embodiment, for example, only after the first determination result of all categories of identity information to be identified has passed, that is, "Yes", the determination The identity tag of the target object is recognized, the corresponding second determination result is found in the second preset determination table as "match", and it is determined that the object to be recognized matches the target object. In another specific embodiment, for example, there are five different types of identification information to be identified. Based on the consideration that there is a certain error in recognition, if the first determination results of the four different types of identification information to be identified are all "yes" , It is determined that the object to be identified matches the target object; further, other requirements can be made for the identification information to be identified that fails the final judgment result, such as limiting its identification probability to be between "0.3-0.7" It can serve as an auxiliary reference under the premise that the first judgment results of the other four different types of identity information to be identified are passed; for example, it can be set to find the corresponding in the second preset judgment table. The second determination result of is "undefined", and the user can mark the object to be identified as a suspected target object according to the second determination result.
在一个较优的实施例中,根据目标检测算法对视频中的待识别对象进行身份信息识别,得出待识别对象在预设待识别多维度身份信息的所有类别上对应的识别概率的步骤S1,包括:In a preferred embodiment, the identification information of the object to be identified in the video is identified according to the target detection algorithm, and the identification probability of the object to be identified in all categories of preset multi-dimensional identity information to be identified is obtained. Step S1 ,include:
S11:通过图像分割算法将待识别对象从待识别视频的背景中进行分离;S11: Separate the object to be recognized from the background of the video to be recognized by an image segmentation algorithm;
S12:对分离后的待识别对象进行部位关键点检测,并根据部位关键点对待识别对象进行识别区域分割,识别区域包括头部、上半身和下半身;S12: Perform part key point detection on the separated object to be recognized, and segment the recognition area of the object to be recognized according to the key point of the part, and the recognition area includes the head, upper body, and lower body;
S13:在识别区域内识别各自对应类别的待识别身份信息,并得出识别概率。S13: Identify the to-be-identified identity information of each corresponding category in the identification area, and obtain the identification probability.
在上述步骤实施时,对待识别视频中的待识别对象进行相应的待识别身份信息识别检测时,首先将待识别对象从待识别视频的背景中进行分离,即只对待识别对象进行检测,而不对视频背景进行检测,以减少检测运算量。具体地,可以采用图像分割算法将待识别对象从待识别视频的背景中进行分离,例如基于阈值的分割的固定阈值分割、直方图双峰法、OTSU法(最大类间方差法)等;基于边缘检测方法的各种边缘检测算子;基于区域分割的区域生长法、分裂合并法和分水岭分割方法等;基于图论分割的Normalized Cuts算法,Graph Cuts算法,Superpixel lattice算法等;基于能量泛函的分割方法、基于小波的分割方法以及基于神经网络的分割方法等。In the implementation of the above steps, when performing the corresponding identification and detection of the object to be identified in the video to be identified, the object to be identified is first separated from the background of the video to be identified, that is, only the object to be identified is detected, and the object to be identified is not detected. The video background is detected to reduce the amount of detection operations. Specifically, an image segmentation algorithm can be used to separate the object to be recognized from the background of the video to be recognized, such as fixed threshold segmentation based on threshold segmentation, histogram bimodal method, OTSU method (maximum between-class variance method), etc.; Various edge detection operators of edge detection methods; region growing method, split merging method and watershed segmentation method based on region segmentation; Normalized Cuts algorithm based on graph theory segmentation, Graph Cuts algorithm, Superpixel lattice algorithm, etc.; based on energy functional The segmentation method, wavelet-based segmentation method and neural network-based segmentation method, etc.
将待识别对象从视频背景中分离出来后,对分离后的待识别对象进行部位关键点检测并进行识别区域分割,识别区域包括头部、上半身和下半身,例如头部和上半身间的颈部即为一个部位关键点,上半身与下半身之间的腰部也是一个部位关键点,手部、肘部、肩膀、胸部、脸部等也为部位关键点,通过对待识别对象进行多个部位关键点的检测构建,将待识别对象分为三个识别区域,包括头部、上半身和下半身,以便后续对每个识别区域内对应维度的待识别身份信息进行识别。在一个具体的实施例中,可以采用haar cascade(哈尔梯级)对待识别对象的头部、上半身和下半身分别进行检测。After the object to be recognized is separated from the video background, the key points of the separated object to be recognized are detected and the recognition area is segmented. The recognition area includes the head, upper body and lower body, such as the neck between the head and upper body. It is a key point of a part. The waist between the upper body and the lower body is also a key point of the part. The hands, elbows, shoulders, chest, face, etc. are also key points of the part. The key points of multiple parts are detected by the object to be recognized. Construct, divide the object to be recognized into three recognition areas, including the head, upper body and lower body, so as to subsequently identify the identity information to be recognized in the corresponding dimensions in each recognition area. In a specific embodiment, a haar cascade can be used to detect the head, upper body, and lower body of the object to be identified.
将待识别对象划分为不同的识别区域后,在识别区域内识别对应类别的待识别身份信息,并得出识别概率。在一个具体的实施例中,在对“红色帽子”这一衣物维度上的待识别身份信息进行识别时,首先确认识别区域为待识别对象的头部区域,然后检测待识别对象的头部是否戴有帽子,若戴有帽子,则检测该帽子是否为红色,从而得出“红色帽子”的识别概率。在一个实施例中,若识别到“戴有帽子”的识别概率为0.9,且识别到“红色”的概率为0.8,则对应“红色帽子”的识别概率为0.9×0.8=0.72。在另一个实施例中,也可以通过若识别到“戴有帽子”的识别概率大于等于0.9,则直接判定对应“红色帽子”的识别概率即为识别到“红色”的概率为0.8,并不对其概率计算做特殊限定。对于在其他识别区域内,例如在下半身识别区域中对黑色裤子的识别也是同理,计算识别概率时并不做特殊限定。After dividing the object to be identified into different identification areas, identify the corresponding type of identity information to be identified in the identification area, and obtain the identification probability. In a specific embodiment, when recognizing the identity information to be recognized in the clothing dimension of "red hat", first confirm that the recognition area is the head area of the object to be recognized, and then check whether the head of the object to be recognized is If you wear a hat, check whether the hat is red, so as to get the recognition probability of "red hat". In one embodiment, if the recognition probability of recognizing "wearing a hat" is 0.9, and the probability of recognizing "red" is 0.8, then the recognition probability of the corresponding "red hat" is 0.9×0.8=0.72. In another embodiment, if the recognition probability of "wearing a hat" is greater than or equal to 0.9, then it can be directly determined that the recognition probability of the corresponding "red hat" is that the probability of recognizing "red" is 0.8. The probability calculation is specially limited. The same is true for the recognition of black pants in other recognition areas, such as the recognition area of the lower body, and there is no special restriction when calculating the recognition probability.
在一个较优的实施例中,根据识别概率在第一预设判定表中查找对应的第一判定结果,以根据第一判定结果判定是否识别到对应类别的预设待识别多维度身份信息的步骤S2,包括:In a preferred embodiment, the corresponding first determination result is searched in the first preset determination table according to the recognition probability, so as to determine whether the corresponding type of preset multi-dimensional identity information to be recognized is recognized according to the first determination result. Step S2 includes:
S21:根据识别概率的对应类别在第一预设判定表中查找对应的判定条件;判定条件包括识别概率在对应类别下的预设概率阈值;S21: Search for a corresponding determination condition in the first preset determination table according to the corresponding category of the recognition probability; the determination condition includes the preset probability threshold of the recognition probability in the corresponding category;
S22:将识别概率与预设概率阈值进行比较;预设概率阈值包括第一预设概率阈值以及第二预设概率阈值;S22: Compare the recognition probability with a preset probability threshold; the preset probability threshold includes a first preset probability threshold and a second preset probability threshold;
S23:若识别概率高于第一预设概率阈值,则根据第一判定结果判定识别到对应类别的待识别身份信息;S23: If the recognition probability is higher than the first preset probability threshold, it is determined according to the first determination result that the identity information to be recognized of the corresponding category is recognized;
S24:若识别概率高于第二预设概率阈值,且低于第一预设概率阈值,则根据第一判定结果判定不确定是否识别到对应类别的待识别身份信息;S24: If the recognition probability is higher than the second preset probability threshold and lower than the first preset probability threshold, it is determined whether it is uncertain whether the corresponding category of identity information to be recognized is recognized according to the first determination result;
S25:若识别概率低于第二预设概率阈值,则根据第一判定结果判定未识别到对应类别的待识别身份信息。S25: If the recognition probability is lower than the second preset probability threshold, it is determined according to the first determination result that the identity information to be recognized of the corresponding category is not recognized.
在上述步骤实施时,由于在第一预设判定表中,预设待识别多维度身份信息的类别不同,则识别概率对应的判定条件也不完全相同,因此先根据识别概率的对应类别在第一预设判定表中查找对应的判定条件,以确定针对给类别的识别概率如何判定,该判定条件包括识别概率在对应类别下的预设概率阈值。In the implementation of the above steps, since in the first preset determination table, the types of the multi-dimensional identity information to be recognized are preset to be different, the determination conditions corresponding to the recognition probability are not completely the same, so the corresponding category according to the recognition probability is first A corresponding determination condition is searched in a predetermined determination table to determine how to determine the recognition probability of a given category, and the determination condition includes a predetermined probability threshold of the recognition probability in the corresponding category.
然后将识别概率与查找到的预设概率阈值进行比较,若高于第一预设概率阈值,则判定识别到该类别的待识别身份信息;若高于第二预设概率阈值,且低于第一预设概率阈值,则判定不确定是否识别到该类别的待识别身份信息;若低于第二预设概率阈值,则判定未识别到该类别的待识别身份信息。在一个具体的实施例中,待识别身份信息的类别不同,相应的其预设概率阈值也会有所不同,例如在对待识别对象进行年龄识别时,由于年龄识别需要相对较为清晰的脸部图像,对图像质量要求较高,且误差率也相对较大,则其第一预设概率阈值可以设置的低一些,例如为0.7;而在对待识别对象进行长短裤的识别或者是否有戴眼镜的识别时,由于长裤与短裤之间的差别较大,戴眼镜与不戴眼镜也差别较大,且检测时对于图像质量的要求相对没那么高,因此可以将其第一预设概率阈值设置得高一些,例如为0.9。通过对不同类别的待识别身份信息赋予不同的预设概率阈值,误差率较高的则预设概率阈值低一些,误差率低的则预设概率阈值高一些,能够尽可能快速的对待识别对象做出判定,确定其是否与获取的待识别身份信息相符,同时尽量减少检测误差。Then the recognition probability is compared with the found preset probability threshold. If it is higher than the first preset probability threshold, it is determined that the identification information of the category to be identified is recognized; if it is higher than the second preset probability threshold and lower than If the first preset probability threshold is not recognized, it is determined whether the category of identity information to be recognized is uncertain; if it is lower than the second preset probability threshold, it is determined that the category of identity information to be recognized is not recognized. In a specific embodiment, the type of identity information to be identified is different, and the corresponding preset probability threshold will also be different. For example, when performing age recognition on the object to be identified, relatively clear facial images are required for age recognition. , The image quality requirements are high, and the error rate is relatively large, the first preset probability threshold can be set lower, for example, 0.7; while the object to be identified is identified by long shorts or whether there is a person wearing glasses During recognition, due to the large difference between trousers and shorts, and the difference between wearing glasses and not wearing glasses, and the requirements for image quality during detection are relatively low, the first preset probability threshold can be set Higher, for example 0.9. By assigning different preset probability thresholds to different types of identification information to be identified, the preset probability threshold is lower if the error rate is higher, and the preset probability threshold is higher if the error rate is low, so that the identified object can be treated as quickly as possible Make a judgment to determine whether it is consistent with the acquired identity information to be identified, while minimizing detection errors.
进一步地,将第一判定结果分为识别到待识别身份信息、不确定是否识别到待识别身份信息以及未识别到待识别身份信息三类,而不是简单做是与否的二分处理,使得在进行综合判定时能够更加灵活处理。例如,例如有五项不同类别的待识别身份信息,基于识别存在一定误差的考虑,在其中四项不同类别的待识别身份信息的第一判定结果为识别到对应类别的待识别身份信息之后,就判定该待识别对象与目标对象相符合;进一步地,对于剩下的最后一项第一判定结果不通过的待识别身份信息可以做其他要求,例如限定其第一判定结果要为不确定是否识别到对应类别的待识别身份信息,能够在其他四项不同类别的待识别身份信息的第一判定结果为识别到对应类别的待识别身份信息的前提下,起到一个辅助参考的作用。如此设置,在图像质量不是那么理想的情况下,那些识别难度较高、检测误差率较大的某些类别身份信息仍旧能够起到一个辅助参考的作用,而不仅仅是作为未识别到对应类别的待识别身份信息的第一判定结果被否决,能够尽可能快速的对待识别对象做出准确判定,确定其是否与获取的待识别多维度身份信息相符,同时尽量减少检测误差。Further, the first judgment result is divided into three categories: the identification information to be identified, the identification information to be identified is uncertain, and the identification information to be identified is not identified, instead of the simple binary processing of yes or no, so that It can be handled more flexibly when making comprehensive judgments. For example, for example, there are five different types of identification information to be identified. Based on the consideration of certain errors in recognition, after the first determination result of the four different types of identification information to be identified is that the corresponding category of identification information to be identified is recognized, It is determined that the object to be identified is consistent with the target object; further, other requirements can be made for the remaining identity information for which the first judgment result is not passed, such as limiting the first judgment result to be uncertain or not The identification of the identity information to be identified in the corresponding category can serve as an auxiliary reference under the premise that the first determination result of the other four different categories of identity information to be identified is the identification of the identity information to be identified in the corresponding category. With this setting, when the image quality is not so ideal, certain categories of identity information that are difficult to identify and have a large detection error rate can still serve as an auxiliary reference, not just as an unidentified corresponding category The first determination result of the to-be-identified identity information is rejected, it is possible to make an accurate determination as quickly as possible on the object to be identified, to determine whether it matches the acquired multi-dimensional identity information to be identified, and to minimize detection errors.
在一个较优的实施例中,通过预设统计规则对多个第一判定结果进行统计的步骤S3,包括:In a preferred embodiment, the step S3 of performing statistics on the multiple first determination results according to a preset statistical rule includes:
S31:根据预设统计规则,若根据第一判定结果判定识别到待识别身份信息,则对其统计评分的赋值为1;若根据第一判定结果判定不确定是否识别到待识别身份信息,则对其统计评分的赋值为0;若根据第一判定结果判定未识别到待识别身份信息,则对其统计评分的赋值评分为-1;S31: According to the preset statistical rules, if the identification information to be identified is determined according to the first determination result, the statistical score is assigned a value of 1; if it is determined that the identification information to be identified is uncertain according to the first determination result, then The statistical score is assigned a value of 0; if the identification information to be identified is not recognized according to the first judgment result, the statistical score is assigned a score of -1;
S32:将所有第一判定结果的统计评分进行叠加计算,得出统计结果。S32: Perform superposition calculation on the statistical scores of all the first judgment results to obtain statistical results.
在上述步骤实施时,为了让第一判定结果有一个更加直观的判定手段,对于不同的第一判定结果赋予一个相对应的统计评分,例如评分A、评分B和评分C。在一个具体的实施例中,若根据第一判定结果判定识别到待识别身份信息,则对其统计评分的赋值为1(A);若根据第一判定结果判定不确定是否识别到待识别身份信息,则对其统计评分的赋值为0(B);若根据第一判定结果判定未识别到待识别身份信息,则对其统计评分的赋值为-1(C)。通过对不同的第一判定结果赋予一个相对应的数字统计评分,使判定结果更加直观,易于统计。In the implementation of the above steps, in order to make the first judgment result have a more intuitive judgment method, a corresponding statistical score is assigned to different first judgment results, such as score A, score B, and score C. In a specific embodiment, if the identification information to be identified is determined according to the first determination result, the statistical score is assigned a value of 1 (A); if it is determined according to the first determination result that it is uncertain whether the identity to be identified is identified Information, the statistical score is assigned a value of 0 (B); if the identification information to be identified is not recognized according to the first determination result, the statistical score is assigned a value of -1 (C). By assigning a corresponding digital statistical score to different first judgment results, the judgment result is more intuitive and easy to count.
得出所有第一判定结果的统计评分之后,将所有第一判定结果的统计评分进行叠加计算,得出统计结果,该统计结果即为一个直观的分数值,分数值越高,则待识别对象与目标对象的匹配程度就越高。然后根据该分数值在第二预设判定表中查找对应的第二判定结果,以判定待识别对象是否与目标对象相匹配。在一个具体的实施例中,在第二预设判定表中,预设了一定的分数值阈值,当统计结果大于预设分数值阈值时,即查找到待识别对象与目标对象相匹配的第二判定结果。After the statistical scores of all the first judgment results are obtained, the statistical scores of all the first judgment results are superimposed and calculated to obtain the statistical result. The statistical result is an intuitive score value. The higher the score value, the object to be identified The higher the match with the target audience. Then, according to the score value, the corresponding second determination result is searched in the second preset determination table to determine whether the object to be identified matches the target object. In a specific embodiment, in the second preset judgment table, a certain score threshold is preset, and when the statistical result is greater than the preset score threshold, the first object matching the target object is found. 2. Judgment results.
在一个较优的实施例中,将所有第一判定结果的统计评分进行叠加计算,得出统计结果的步骤S32,包括:In a preferred embodiment, the step S32 of superimposing the statistical scores of all the first judgment results to obtain the statistical results includes:
S321:获取不同类别的待识别身份信息在预设权重分配表中的各自对应的统计权重;S321: Obtain respective statistical weights of different types of identity information to be identified in the preset weight distribution table;
S322:根据第一公式将所有第一判定结果的统计评分进行叠加计算,得出统计结果;其中,第一公式为:S322: Perform a superposition calculation on the statistical scores of all the first judgment results according to the first formula to obtain the statistical results; where the first formula is:
P=W1*A+W2*B+W3*C;P=W1*A+W2*B+W3*C;
W1、W2和 W3为不同类别的预设待识别多维度身份信息对应的统计权重。W1, W2, and W3 are the statistical weights corresponding to different types of preset multi-dimensional identity information to be identified.
在上述步骤实施时,得出所有第一判定结果各自对应的数字统计评分之后,将所有第一判定结果的统计评分按照第一公式进行叠加,得出统计结果,其中不同类别待识别身份信息的判定结果具有各自对应的统计权重。在一个具体的实施例中,假设有四个不同类别的待识别身份信息为A1、A2、A3、A4,定义其在识别概率的统计结果中的统计权重分别为W1、W2、W3、W4,相应的第一判定结果的统计评分为:1、0、-1、1,则该待识别对象与获取的待识别身份信息相符的概率P = W1 – W3 + W4,最后将该概率P与预设概率阈值比较,若超过预设概率阈值,则认为该待识别对象与获取的待识别身份信息相符,否则认为该待识别对象与获取的待识别身份信息不符。待识别身份信息的类别不同,相应的其统计权重也会有所不同,例如在对待识别对象进行年龄识别时,由于年龄识别需要相对较为清晰的脸部图像,对图像质量要求较高,且误差率也相对较大,则其统计权重可以设置的低一些,例如为0.2;而在对待识别对象进行长短裤的识别或者是否有戴眼镜的识别时,由于长裤与短裤之间的差别较大,戴眼镜与不戴眼镜也差别较大,且检测时对于图像质量的要求相对没那么高,因此可以将其统计权重设置得高一些,例如为0.5,多种不同类别的待识别身份信息的其统计权重总和为1。通过对不同类别的待识别身份信息赋予不同的统计权重,误差率较高的则统计权重低一些,误差率低的则统计权重高一些,在进行统计判定结果时,着重参考误差率较低的待识别身份信息,将误差率较高的待识别身份信息带来的误差影响降到最低,从而能够尽可能快速的对待识别对象做出准确判定,确定其是否与获取的待识别身份信息相符,同时尽量减少检测误差。In the implementation of the above steps, after obtaining the digital statistical scores corresponding to all the first judgment results, the statistical scores of all the first judgment results are superimposed according to the first formula to obtain the statistical results. Among them, different types of identification information are to be identified. The determination results have their corresponding statistical weights. In a specific embodiment, it is assumed that there are four different types of identification information to be identified as A1, A2, A3, and A4, and the statistical weights in the statistical results of the identification probability are defined as W1, W2, W3, W4, The corresponding statistical score of the first judgment result is: 1, 0, -1, 1, then the probability that the object to be identified matches the acquired identity information to be identified is P = W1 – W3 + W4, finally compare the probability P with the preset probability threshold. If it exceeds the preset probability threshold, the object to be identified is considered to be consistent with the acquired identity information, otherwise the object to be identified is considered to be the same The identity information does not match. Depending on the type of identity information to be identified, the corresponding statistical weights will be different. For example, when the object is to be identified for age recognition, because age recognition requires relatively clear facial images, the image quality requirements are high, and the error The rate is also relatively large, the statistical weight can be set lower, for example, 0.2; and when the object to be identified is recognized for long shorts or whether there is recognition of wearing glasses, due to the large difference between trousers and shorts , There is a big difference between wearing glasses and not wearing glasses, and the requirements for image quality during detection are relatively low, so the statistical weight can be set higher, for example, 0.5, a variety of different types of identity information to be identified The sum of its statistical weights is 1. By assigning different statistical weights to different types of identification information to be identified, the statistical weight is lower if the error rate is higher, and the statistical weight is higher if the error rate is low. When making statistical judgment results, focus on the lower error rate The identity information to be identified minimizes the impact of errors caused by the identity information to be identified with a high error rate, so that accurate judgments can be made as quickly as possible on the object to be identified, and whether it is consistent with the acquired identity information to be identified. At the same time minimize detection errors.
在一个较优的实施例中,获取不同类别的预设待识别多维度身份信息在预设权重分配表中对应的统计权重的步骤,包括:In a preferred embodiment, the step of obtaining the statistical weights corresponding to different types of preset to-be-identified multi-dimensional identity information in the preset weight distribution table includes:
S3211:根据预设待识别多维度身份信息的类别获取预关联的当前环境因素,当前环境因素包括当前气温、当前空气质量、当前可见度、当前地理位置、距离地面高度中的一种或多种环境因素的组合;其中,不同类别的预设待识别多维度身份信息预关联的当前环境因素不完全相同;S3211: Obtain pre-associated current environmental factors according to the preset categories of the multi-dimensional identity information to be identified. The current environmental factors include one or more of the current temperature, current air quality, current visibility, current geographic location, and height from the ground A combination of factors; among them, the current environmental factors pre-associated with different types of preset multi-dimensional identity information to be identified are not completely the same;
S3212:根据预设待识别多维度身份信息的类别以及当前环境因素在预设权重分配表中确定对应的统计权重;在预设权重分配表中对应预设待识别多维度身份信息的类别设置了多个环境因素阈值范围,不同的环境因素阈值范围对应不同的统计权重。S3212: Determine the corresponding statistical weight in the preset weight distribution table according to the preset type of the multi-dimensional identity information to be identified and current environmental factors; set the corresponding preset weight distribution table in the category of the preset multi-dimensional identity information to be identified Multiple threshold ranges of environmental factors, and different threshold ranges of environmental factors correspond to different statistical weights.
在上述步骤实施时,在一个具体的实施例中,设备先根据预设待识别多维度身份信息的类别获取预关联的当前环境因素,然后根据预设待识别多维度身份信息的类别以及当前环境因素在预设权重分配表中确定对应的统计权重。例如设备对实时视频进行检测或者对某些特定的视频进行检测时,可以通过获取的当前环境因素来确定不同维度身份信息对应的统计权重,当前环境因素包括当前气温、当前空气质量、当前可见度、当前地理位置、距离地面高度中的一种或多种环境因素的组合。设备在进行检测识别时,可以通过网络进行获取当前环境因素,该获取方式可以是设备通过网络进行主动查找,例如当前气温、当前空气质量、当前地理位置等当前环境因素,也可以是设备通过网络接收用户输入的当前环境因素。设备还可以通过传感器获取当前环境因素,例如在获取距离地面高度这一当前环境因素时,通过摄像头上的距离传感器测量来获取摄像头与地面的距离高度。其中,不同类别的预设待识别多维度身份信息预关联的当前环境因素不完全相同,例如裤子的长短主要和当前气温具有关联关系,因此裤长这一类别的预设待识别多维度身份信息预关联的当前环境因素就包括当前气温,而是否戴眼镜以及发长这一类别的预设待识别多维度身份信息与当前气温并不具有关联关系,因此其预关联的当前环境因素就不包括当前气温;再例如鞋子颜色这一类别的预设待识别多维度身份信息与当前空气质量、当前可见度、当前地理位置等当前环境因素之间的关联关系并不大,但是与距离地面高度这一当前环境因素关联关系较大,因此其预关联的当前环境因素就包括距离地面高度。When the above steps are implemented, in a specific embodiment, the device first obtains the pre-associated current environmental factors according to the preset type of the multi-dimensional identity information to be identified, and then according to the preset type of the multi-dimensional identity information to be identified and the current environment The factor determines the corresponding statistical weight in the preset weight distribution table. For example, when the device detects real-time video or detects certain specific videos, it can determine the statistical weights corresponding to different dimensions of identity information through the current environmental factors obtained. The current environmental factors include current temperature, current air quality, current visibility, A combination of one or more environmental factors in the current geographic location and height from the ground. When the device is performing detection and identification, it can obtain the current environmental factors through the network. The acquisition method can be the device actively search through the network, such as current environmental factors such as current temperature, current air quality, current geographic location, etc., or the device through the network Receive user input of current environmental factors. The device can also acquire current environmental factors through sensors. For example, when acquiring the current environmental factor of the height from the ground, the distance between the camera and the ground can be obtained through the measurement of the distance sensor on the camera. Among them, the current environmental factors pre-associated with different types of preset multi-dimensional identity information to be identified are not completely the same. For example, the length of pants is mainly related to the current temperature, so the preset multi-dimensional identity information of the type of pants length to be identified The pre-associated current environmental factors include the current temperature, and the pre-recognized multi-dimensional identity information of whether to wear glasses and hair length is not related to the current temperature, so the pre-associated current environmental factors do not include Current temperature; for example, the pre-recognized multi-dimensional identity information of the shoe color category has little correlation with current environmental factors such as current air quality, current visibility, and current geographic location, but it is related to the height from the ground. The current environmental factors have a large correlation, so the current environmental factors pre-associated include the height from the ground.
在获取到预关联的当前环境因素之后,根据预设待识别多维度身份信息的类别以及当前环境因素在预设权重分配表中确定对应的统计权重;在预设权重分配表中对应预设待识别多维度身份信息的类别设置了多个环境因素阈值范围,不同的环境因素阈值范围对应不同的统计权重。例如当获取到当前气温为0℃时,虽然在对待识别对象进行长短裤的识别时其识别误差率较低,但是由于在气温为0℃时,人们基本上都是穿着长裤,筛选意义较小,因此当待识别身份信息为长裤时,则自动降低其统计权重,例如为0.1;而当在当前气温为0℃时,且待识别身份信息为短裤时,由于此时基本很少人会穿着短裤,短裤具有较为显著的筛选意义,则自动提高其统计权重,例如为0.7,而在当前气温为30℃时,长裤与短裤二者的统计权重占比则会反过来,由于此时穿短裤的人较为普遍,而穿长裤的则相对较少,长裤的统计权重较高,短裤的统计权重则较低;而对于是否有戴眼镜的待识别身份信息,由于是否戴眼镜与当前气温关系不大,因此其统计权重不因当前气温的变化而变化。在又一个具体的实施例中,对于“蓝色鞋子”这一维度的待识别身份信息,由于在视频中鞋子一般占比较小,其图像清晰度一般较差,且由于视频摄像头的高度一般较高,鞋子不太容易拍摄清晰,因此对于“蓝色鞋子”的识别结果,其统计权重一般较低,例如为0.1,但是若获取到该摄像头距离地面高度较近,例如为1米,此时在视频中则能够获得较为清晰的鞋子影像,则自动提高其统计权重,例如为0.5.对于其他类型的当前环境因素也是同理,当当前环境因素对某一维度的待识别身份信息的识别具有积极影响时,则自动提高其统计权重;当当前环境因素对某一维度的待识别身份信息的识别具有消极影响时,则自动降低其统计权重;当当前环境因素对某一维度的待识别身份信息的识别无影响时,则根据预设统计权重确定其统计权重或者对其进行平均分配统计权重。通过获取预关联当前环境因素以及其所处的预设阈值范围,确定不同维度身份信息对应的统计权重,赋予筛选意义较高的待识别身份信息以较高的统计权重,筛选意义较低的待识别身份信息以较低的统计权重,尽量提高筛选速度,从而能够尽可能快速的对待识别对象做出准确判定,确定其是否与获取的待识别身份信息相符,同时尽量减少检测误差。After obtaining the pre-associated current environmental factors, the corresponding statistical weights are determined in the preset weight distribution table according to the preset types of the multi-dimensional identity information to be identified and the current environmental factors; Multiple environmental factor threshold ranges are set to identify the categories of multi-dimensional identity information, and different environmental factor threshold ranges correspond to different statistical weights. For example, when the current temperature is 0°C, although the recognition error rate is low when the object to be identified is identified by long shorts, since when the temperature is 0°C, people basically wear long pants, and the screening significance is more significant. Therefore, when the identity information to be identified is trousers, its statistical weight is automatically reduced, for example, to 0.1; and when the current temperature is 0℃ and the identity information to be identified is shorts, there are basically few people at this time. Will wear shorts, shorts have a more significant screening significance, then its statistical weight will be automatically increased, for example, to 0.7, and when the current temperature is 30℃, the statistical weight ratio of trousers and shorts will be reversed. People who wear shorts are more common, while those who wear long trousers are relatively small. The statistical weight of trousers is higher, and the statistical weight of shorts is lower. As for whether there is identity information to be identified for wearing glasses, because of whether they wear glasses It has little relationship with the current temperature, so its statistical weight does not change due to changes in the current temperature. In another specific embodiment, for the "blue shoes" dimension of the identity information to be identified, since shoes generally occupy a relatively small proportion in the video, the image definition is generally poor, and the height of the video camera is generally relatively low. High, the shoes are not easy to shoot clearly, so the statistical weight of the recognition result of "blue shoes" is generally low, such as 0.1, but if the camera is relatively close to the ground, such as 1 meter, then In the video, a clearer shoe image can be obtained, and its statistical weight is automatically increased, for example, 0.5. The same is true for other types of current environmental factors. When the current environmental factors have a certain dimension of identification information to be identified When there is a positive impact, the statistical weight is automatically increased; when the current environmental factors have a negative impact on the identification of a certain dimension of identity information to be identified, its statistical weight is automatically reduced; when the current environmental factors affect the identity of a certain dimension to be identified When the identification of information has no impact, the statistical weight is determined according to the preset statistical weight or the statistical weight is evenly distributed. By obtaining the pre-associated current environmental factors and the preset threshold range in which they are located, the statistical weights corresponding to the identity information of different dimensions are determined, and the identification information with higher significance to be screened is given higher statistical weight, and the ones with lower significance are selected. The identification information uses a lower statistical weight to increase the screening speed as much as possible, so that an accurate judgment can be made as quickly as possible on the object to be identified, whether it is consistent with the acquired identification information to be identified, and the detection error is minimized.
在一个较优的实施例中,在根据目标检测算法对视频中的待识别对象进行身份信息识别,并分别得出待识别对象在预设待识别多维度身份信息的所有类别上对应的识别概率的步骤S1之前,还包括:In a preferred embodiment, the identification information of the object to be identified in the video is identified according to the target detection algorithm, and the identification probabilities corresponding to all categories of the preset multi-dimensional identity information to be identified are obtained respectively. Before step S1, it also includes:
S01:通过接收预设待识别多维度身份信息的输入设定指令或通过目标检测算法对指定的目标对象进行身份信息识别,得到预设待识别多维度身份信息。S01: By receiving an input setting instruction of preset multi-dimensional identity information to be identified or performing identity information identification on a designated target object through a target detection algorithm, the preset multi-dimensional identity information to be identified is obtained.
在上述步骤实施时,在对待识别视频进行检测时,首先需要确定目标对象的预设待识别多维度身份信息。在一个具体的实施例中,在用户了解如何精确输入设定指令或者没有目标对象的图像以供识别时,设备可以通过有线或者无线的通讯方式接收用户的待识别多维度身份信息的输入设定指令,以确定所要进行检测的待识别身份信息。在另一个具体的实施例中,当用户不清楚该如何输入对应维度的待识别身份信息或者设备不能接收输入的待识别身份信息时,用户可以指定一个特定识别对象作为目标对象,然后设备可以通过目标检测算法对特定识别对象进行身份信息识别以主动获取待识别多维度身份信息。具体到实际应用中,设备通过对用户指定的图像进行检测识别,例如对特定识别对象的全身照进行检测识别,得出特定识别对象的性别、年龄、体型、衣服等待识别多维度身份信息作为预设待识别多维度身份信息,然后根据识别出的预设待识别多维度身份信息到视频中进行检测识别,找寻与该待识别多维度身份信息相符的待识别对象,即是通过该待识别多维度身份信息,在视频中检测与图像中的特定识别对象相符的人物。In the implementation of the above steps, when detecting the video to be recognized, it is first necessary to determine the preset multi-dimensional identity information of the target object to be recognized. In a specific embodiment, when the user knows how to accurately input the setting instructions or there is no image of the target object for identification, the device can receive the user's input settings of the multi-dimensional identity information to be identified through wired or wireless communication. Instructions to determine the identification information to be detected. In another specific embodiment, when the user does not know how to enter the identity information to be identified in the corresponding dimension or the device cannot receive the entered identity information to be identified, the user can designate a specific identification object as the target object, and then the device can pass The target detection algorithm recognizes the identity information of the specific identification object to actively obtain the multi-dimensional identity information to be identified. In practical applications, the device detects and recognizes images specified by the user, such as detecting and recognizing a full-body photo of a specific recognized object, and obtains the gender, age, body type, and clothes of the specific recognized object as a pre-recognition. Suppose multi-dimensional identity information to be identified, and then perform detection and recognition in the video according to the identified preset multi-dimensional identity information to be identified, and find the object to be identified that matches the multi-dimensional identity information to be identified. Dimensional identity information is used to detect people in the video that match the specific identification object in the image.
参照图2,本申请还提出了一种多维度身份信息识别装置,包括:2, this application also proposes a multi-dimensional identity information recognition device, including:
识别模块10,用于根据目标检测算法对视频中的待识别对象进行身份信息识别,得出待识别对象在预设待识别多维度身份信息的所有类别上对应的识别概率;其中,预设待识别多维度身份信息包括人体特征维度中N个类别的第一待识别身份信息以及衣物维度中M个类别的第二待识别身份信息;预设待识别多维度身份信息为目标对象对应的身份信息,M和N均为正整数;The recognition module 10 is used to identify the identity information of the object to be recognized in the video according to the target detection algorithm, and obtain the corresponding recognition probability of the object to be recognized in all categories of preset multi-dimensional identity information to be recognized; Identifying multi-dimensional identity information includes N categories of first identity information to be identified in the human body feature dimension and M categories of second identity information to be identified in the clothing dimension; preset the multi-dimensional identity information to be identified as the identity information corresponding to the target object , M and N are both positive integers;
第一查找模块20,用于根据识别概率在第一预设判定表中查找对应的第一判定结果,以根据第一判定结果判定是否识别到对应类别的预设待识别多维度身份信息;在第一预设判定表中预先设定了识别概率的判定条件,其中,不同类别的预设待识别多维度身份信息的类别不同,则识别概率对应的判定条件也不完全相同;The first search module 20 is configured to search for the corresponding first determination result in the first preset determination table according to the recognition probability, so as to determine whether the corresponding type of preset multi-dimensional identity information to be recognized is recognized according to the first determination result; In the first predetermined judgment table, the judgment conditions of the recognition probability are preset, wherein, if different types of preset multi-dimensional identity information to be identified have different types, the judgment conditions corresponding to the recognition probabilities are not completely the same;
第二查找模块30,用于根据预设统计规则对多个第一判定结果进行统计,并根据统计结果在第二预设判定表中查找对应的第二判定结果,以判定待识别对象是否与目标对象相匹配;在第二预设判定表中预设了不同统计结果对应的第二判定结果。The second search module 30 is configured to perform statistics on a plurality of first determination results according to preset statistical rules, and search for corresponding second determination results in the second preset determination table according to the statistical results, to determine whether the object to be identified is compatible with The target object matches; the second judgment result corresponding to different statistical results is preset in the second preset judgment table.
其中上述模块10-30分别用于执行的操作与前述实施方式的多维度身份信息识别方法的步骤一一对应,在此不再赘述。The operations performed by the aforementioned modules 10-30 respectively correspond to the steps of the multi-dimensional identity information identification method of the foregoing embodiment, and will not be repeated here.
进一步地,对应前述实施方式的多维度身份信息识别方法的细分步骤,上述模块10-30相应的包含了子模块、单元或子单元,用于执行前述多维度身份信息识别方法的细分步骤,在此也不再赘述。Further, corresponding to the subdivision steps of the multi-dimensional identity information identification method of the foregoing embodiment, the aforementioned modules 10-30 correspondingly include sub-modules, units or sub-units for performing the subdivision steps of the foregoing multi-dimensional identity information identification method , I won’t repeat it here.
参照图3,本申请还提出了一种计算机设备,包括存储器1003和处理器1002,存储器1003存储有计算机程序1004,处理器1002执行计算机程序1004时实现上述中任一项方法的步骤,包括:根据目标检测算法对视频中的待识别对象进行身份信息识别,得出待识别对象在预设待识别多维度身份信息的所有类别上对应的识别概率;其中,预设待识别多维度身份信息包括人体特征维度中N个类别的第一待识别身份信息以及衣物维度中M个类别的第二待识别身份信息;预设待识别多维度身份信息为目标对象对应的身份信息,M和N均为正整数;根据识别概率在第一预设判定表中查找对应的第一判定结果,以根据第一判定结果判定是否识别到对应类别的预设待识别多维度身份信息;在第一预设判定表中,预设待识别多维度身份信息的类别不同,则识别概率对应的判定条件也不完全相同;根据预设统计规则对多个第一判定结果进行统计,并根据统计结果在第二预设判定表中查找对应的第二判定结果,以判定待识别对象是否与目标对象相匹配;在第二预设判定表中预设了不同统计结果对应的第二判定结果。3, this application also proposes a computer device, including a memory 1003 and a processor 1002, the memory 1003 stores a computer program 1004, and the processor 1002 executes the computer program 1004 when implementing any of the above methods, including: According to the target detection algorithm, the identification information of the object to be identified in the video is identified, and the identification probability of the object to be identified in all categories of the preset multi-dimensional identity information to be identified is obtained; where the preset multi-dimensional identity information to be identified includes N categories of first identity information to be identified in the human body feature dimension and M categories of second identity information to be identified in the clothing dimension; preset multi-dimensional identity information to be identified as the identity information corresponding to the target object, and both M and N A positive integer; according to the recognition probability, look up the corresponding first judgment result in the first preset judgment table to determine whether the corresponding type of preset multi-dimensional identity information to be identified is recognized according to the first judgment result; in the first preset judgment In the table, if the types of the preset multi-dimensional identity information to be identified are different, the judgment conditions corresponding to the recognition probability are not completely the same; according to the preset statistical rules, the multiple first judgment results are counted, and the second pre- It is assumed that the corresponding second determination result is searched in the determination table to determine whether the object to be identified matches the target object; second determination results corresponding to different statistical results are preset in the second preset determination table.
参照图4,本申请还提出了一种计算机存储介质2001,上述存储介质2001可以是非易失性存储介质,也可以是易失性存储介质。其上存储有计算机程序2002,计算机程序2002被处理器执行时实现上述中任一项的方法的步骤,包括:根据目标检测算法对视频中的待识别对象进行身份信息识别,得出待识别对象在预设待识别多维度身份信息的所有类别上对应的识别概率;其中,预设待识别多维度身份信息包括人体特征维度中N个类别的第一待识别身份信息以及衣物维度中M个类别的第二待识别身份信息;预设待识别多维度身份信息为目标对象对应的身份信息,M和N均为正整数;根据识别概率在第一预设判定表中查找对应的第一判定结果,以根据第一判定结果判定是否识别到对应类别的预设待识别多维度身份信息;在第一预设判定表中,预设待识别多维度身份信息的类别不同,则识别概率对应的判定条件也不完全相同;根据预设统计规则对多个第一判定结果进行统计,并根据统计结果在第二预设判定表中查找对应的第二判定结果,以判定待识别对象是否与目标对象相匹配;在第二预设判定表中预设了不同统计结果对应的第二判定结果。4, this application also proposes a computer storage medium 2001. The storage medium 2001 may be a non-volatile storage medium or a volatile storage medium. A computer program 2002 is stored thereon. When the computer program 2002 is executed by the processor, the steps of any one of the above methods include: identifying the object to be identified in the video according to the target detection algorithm to obtain the object to be identified Recognition probabilities corresponding to all categories of preset multi-dimensional identity information to be recognized; wherein, the preset multi-dimensional identity information to be recognized includes N categories of first identity information to be recognized in the human body feature dimension and M categories in the clothing dimension The second identity information to be identified; the preset multi-dimensional identity information to be identified is the identity information corresponding to the target object, M and N are both positive integers; according to the identification probability, look up the corresponding first judgment result in the first preset judgment table , To determine whether the preset multi-dimensional identity information of the corresponding category is recognized according to the first determination result; in the first preset determination table, if the categories of the preset multi-dimensional identity information to be recognized are different, the identification probability corresponds to the determination The conditions are not exactly the same; the multiple first judgment results are counted according to the preset statistical rules, and the corresponding second judgment results are searched in the second preset judgment table according to the statistical results to determine whether the object to be identified is the target object Match; the second judgment results corresponding to different statistical results are preset in the second preset judgment table.
以上仅为本申请的优选实施例,并非因此限制本申请的专利范围,凡是利用本申请说明书及附图内容所作的等效结构或等效流程变换,或直接或间接运用在其他相关的技术领域,均同理包括在本申请的专利保护范围内。The above are only preferred embodiments of this application, and do not limit the scope of this application. Any equivalent structure or equivalent process transformation made using the content of the description and drawings of this application, or directly or indirectly used in other related technical fields , The same reason is included in the scope of patent protection of this application.

Claims (20)

  1. 一种多维度身份信息识别方法,其中,包括:A multi-dimensional identification information identification method, which includes:
    根据目标检测算法对视频中的待识别对象进行身份信息识别,得出所述待识别对象在预设待识别多维度身份信息的所有类别上对应的识别概率;其中,所述预设待识别多维度身份信息包括人体特征维度中N个类别的第一待识别身份信息以及衣物维度中M个类别的第二待识别身份信息;所述预设待识别多维度身份信息为目标对象对应的身份信息,所述M和N均为正整数;The identification information of the object to be identified in the video is identified according to the target detection algorithm, and the identification probability of the object to be identified in all categories of the preset multi-dimensional identity information to be identified is obtained; wherein, the preset number of identification information to be identified The dimensional identity information includes N categories of first identity information to be identified in the human body feature dimension and M categories of second identity information to be identified in the clothing dimension; the preset multi-dimensional identity information to be identified is the identity information corresponding to the target object , The M and N are both positive integers;
    根据所述识别概率在第一预设判定表中查找对应的第一判定结果,以根据所述第一判定结果判定是否识别到对应类别的所述预设待识别多维度身份信息;在所述第一预设判定表中,所述预设待识别多维度身份信息的类别不同,则所述识别概率对应的判定条件也不完全相同;Search for the corresponding first determination result in the first preset determination table according to the recognition probability to determine whether the corresponding category of the preset multi-dimensional identity information to be recognized is recognized according to the first determination result; In the first preset determination table, if the types of the preset multi-dimensional identity information to be recognized are different, the determination conditions corresponding to the recognition probability are not completely the same;
    根据预设统计规则对多个所述第一判定结果进行统计,并根据统计结果在第二预设判定表中查找对应的第二判定结果,以判定所述待识别对象是否与所述目标对象相匹配;在所述第二预设判定表中预设了不同所述统计结果对应的所述第二判定结果。Perform statistics on a plurality of the first determination results according to preset statistical rules, and look up the corresponding second determination results in the second preset determination table according to the statistical results to determine whether the object to be identified is the same as the target object Match; the second judgment results corresponding to different statistical results are preset in the second preset judgment table.
  2. 根据权利要求1所述的多维度身份信息识别方法,其中,所述根据目标检测算法对视频中的待识别对象进行身份信息识别,得出所述待识别对象在预设待识别多维度身份信息的所有类别上对应的识别概率的步骤,包括:The multi-dimensional identity information identification method according to claim 1, wherein the identity information of the object to be identified in the video is identified according to the target detection algorithm, and it is obtained that the object to be identified is preset in the multi-dimensional identity information to be identified The steps corresponding to the recognition probability of all categories include:
    通过图像分割算法将所述待识别对象从待识别视频的背景中进行分离;Separating the object to be recognized from the background of the video to be recognized by an image segmentation algorithm;
    对分离后的所述待识别对象进行部位关键点检测,并根据所述部位关键点对所述待识别对象进行识别区域分割,所述识别区域包括头部、上半身和下半身;Performing part key point detection on the separated object to be recognized, and segmenting the recognition area of the object to be recognized according to the part key point, the recognition area including a head, an upper body, and a lower body;
    在所述识别区域内识别各自对应类别的所述待识别身份信息,并得出对应的所述识别概率。Identify the to-be-identified identity information of respective corresponding categories in the identification area, and obtain the corresponding identification probability.
  3. 根据权利要求1所述的多维度身份信息识别方法,其中,所述根据所述识别概率在第一预设判定表中查找对应的第一判定结果,以根据所述第一判定结果判定是否识别到对应类别的所述预设待识别多维度身份信息的步骤,包括:The method for identifying multi-dimensional identity information according to claim 1, wherein the corresponding first determination result is searched in a first preset determination table according to the recognition probability to determine whether to recognize or not according to the first determination result The step of getting the preset multi-dimensional identity information to be identified in the corresponding category includes:
    根据所述识别概率的对应类别在所述第一预设判定表中查找对应的判定条件;所述判定条件包括所述识别概率在对应类别下的预设概率阈值;Searching for a corresponding determination condition in the first preset determination table according to the corresponding category of the recognition probability; the determination condition includes the preset probability threshold of the recognition probability in the corresponding category;
    将所述识别概率与所述预设概率阈值进行比较;所述预设概率阈值包括第一预设概率阈值以及第二预设概率阈值;Comparing the recognition probability with the preset probability threshold; the preset probability threshold includes a first preset probability threshold and a second preset probability threshold;
    若所述识别概率高于所述第一预设概率阈值,则根据所述第一判定结果判定识别到对应类别的所述待识别身份信息;If the recognition probability is higher than the first preset probability threshold, determining that the corresponding category of the identity information to be recognized is recognized according to the first determination result;
    若所述识别概率高于第二预设概率阈值,且低于所述第一预设概率阈值,则根据所述第一判定结果判定不确定是否识别到对应类别的所述待识别身份信息;If the recognition probability is higher than the second preset probability threshold and lower than the first preset probability threshold, it is determined according to the first determination result whether it is uncertain whether the identity information to be recognized of the corresponding category is recognized;
    若所述识别概率低于所述第二预设概率阈值,则根据所述第一判定结果判定未识别到对应类别的所述待识别身份信息。If the recognition probability is lower than the second preset probability threshold, it is determined according to the first determination result that the identity information to be recognized of the corresponding category is not recognized.
  4. 根据权利要求1所述的多维度身份信息识别方法,其中,所述通过预设统计规则对多个所述第一判定结果进行统计的步骤,包括:The multi-dimensional identity information identification method according to claim 1, wherein the step of performing statistics on a plurality of the first determination results according to a preset statistical rule comprises:
    根据所述预设统计规则,若根据所述第一判定结果判定识别到所述待识别身份信息,则对其统计评分的赋值为A;若根据所述第一判定结果判定不确定是否识别到所述待识别身份信息,则对其统计评分的赋值为B;若根据所述第一判定结果判定未识别到所述待识别身份信息,则对其统计评分的赋值评分为C;According to the preset statistical rule, if the identification information to be identified is determined according to the first determination result, the statistical score is assigned to A; if it is determined according to the first determination result that it is uncertain whether it is identified For the identity information to be identified, the statistical score is assigned a value of B; if it is determined that the identity information to be identified is not identified according to the first determination result, the statistical score is assigned a score of C;
    将所有所述第一判定结果的所述统计评分进行叠加计算,得出所述统计结果。The statistical scores of all the first determination results are superimposed and calculated to obtain the statistical results.
  5. 根据权利要求4所述的多维度身份信息识别方法,其中,所述将所有所述第一判定结果的所述统计评分进行叠加计算,得出所述统计结果的步骤,包括:The multi-dimensional identity information identification method according to claim 4, wherein the step of superimposing all the statistical scores of the first determination result to obtain the statistical result comprises:
    获取不同类别的所述预设待识别多维度身份信息在预设权重分配表中对应的统计权重;Acquiring the statistical weights corresponding to the preset to-be-identified multi-dimensional identity information of different categories in the preset weight allocation table;
    根据第一公式将所有所述第一判定结果的所述统计评分进行叠加计算,得出所述统计结果;其中,所述第一公式为:According to the first formula, the statistical scores of all the first determination results are superimposed and calculated to obtain the statistical results; wherein, the first formula is:
    P=W1*A+W2*B+W3*C;P=W1*A+W2*B+W3*C;
    所述W1、W2和 W3为不同类别的所述预设待识别多维度身份信息对应的所述统计权重。The W1, W2, and W3 are the statistical weights corresponding to the preset multi-dimensional identity information to be identified in different categories.
  6. 根据权利要求5所述的多维度身份信息识别方法,其中,所述获取不同类别的所述预设待识别多维度身份信息在预设权重分配表中对应的统计权重的步骤,包括:The method for identifying multi-dimensional identity information according to claim 5, wherein the step of obtaining the corresponding statistical weights of the preset to-be-identified multi-dimensional identity information of different categories in a preset weight distribution table comprises:
    根据所述预设待识别多维度身份信息的类别获取预关联的当前环境因素,所述当前环境因素包括当前气温、当前空气质量、当前可见度、当前地理位置、距离地面高度中的一种或多种环境因素的组合;其中,不同类别的所述预设待识别多维度身份信息预关联的所述当前环境因素不完全相同;Obtain pre-associated current environmental factors according to the preset categories of the multi-dimensional identity information to be identified. The current environmental factors include one or more of current temperature, current air quality, current visibility, current geographic location, and height from the ground. A combination of environmental factors; wherein, the current environmental factors pre-associated with the preset multi-dimensional identity information to be identified in different categories are not completely the same;
    根据所述预设待识别多维度身份信息的类别以及所述当前环境因素在所述预设权重分配表中确定对应的所述统计权重;在所述预设权重分配表中对应所述预设待识别多维度身份信息的类别设置了多个环境因素阈值范围,不同的所述环境因素阈值范围对应不同的所述统计权重。The corresponding statistical weight is determined in the preset weight distribution table according to the preset type of the multi-dimensional identity information to be identified and the current environmental factor; the preset weight distribution table corresponds to the preset The categories of the multi-dimensional identity information to be identified are set with multiple threshold ranges of environmental factors, and different threshold ranges of environmental factors correspond to different statistical weights.
  7. 根据权利要求1所述的多维度身份信息识别方法,其中,在所述根据目标检测算法对视频中的待识别对象进行身份信息识别,并分别得出所述待识别对象在预设待识别多维度身份信息的所有类别上对应的识别概率的步骤之前,还包括:The multi-dimensional identity information identification method according to claim 1, wherein the identification information of the object to be identified in the video is identified according to the target detection algorithm, and the identification information of the object to be identified is obtained in the preset number of identification information. Before the step of identifying the corresponding probabilities of all categories of dimensional identity information, it also includes:
    通过接收所述预设待识别多维度身份信息的输入设定指令或通过目标检测算法对指定的目标对象进行身份信息识别,得到所述预设待识别多维度身份信息。The preset multi-dimensional identity information to be identified is obtained by receiving the input setting instruction of the preset multi-dimensional identity information to be identified or performing identity information identification on the designated target object through a target detection algorithm.
  8. 一种多维度身份信息识别装置,其中,包括:A multi-dimensional identity information recognition device, which includes:
    识别模块,用于根据目标检测算法对视频中的待识别对象进行身份信息识别,得出所述待识别对象在预设待识别多维度身份信息的所有类别上对应的识别概率;其中,所述预设待识别多维度身份信息包括人体特征维度中N个类别的第一待识别身份信息以及衣物维度中M个类别的第二待识别身份信息;所述预设待识别多维度身份信息为目标对象对应的身份信息,所述M和N均为正整数;The recognition module is used to recognize the identity information of the object to be recognized in the video according to the target detection algorithm, and obtain the corresponding recognition probability of the object to be recognized in all categories of preset multi-dimensional identity information to be recognized; wherein, the The preset multi-dimensional identity information to be identified includes N categories of first identity information to be identified in the human body feature dimension and M categories of second identity information to be identified in the clothing dimension; the preset multi-dimensional identity information to be identified is a target Identity information corresponding to the object, where both M and N are positive integers;
    第一查找模块,用于根据所述识别概率在第一预设判定表中查找对应的第一判定结果,以根据所述第一判定结果判定是否识别到对应类别的所述预设待识别多维度身份信息;在所述第一预设判定表中预先设定了所述识别概率的判定条件,其中,不同类别的所述预设待识别多维度身份信息的类别不同,则所述识别概率对应的判定条件也不完全相同;The first search module is configured to search for the corresponding first determination result in the first preset determination table according to the recognition probability, so as to determine whether the corresponding category of the preset to-be-recognized multiple is recognized according to the first determination result. Dimensional identity information; the judgment condition of the recognition probability is preset in the first preset judgment table, wherein, if different types of the preset multi-dimensional identity information to be identified have different types, the recognition probability The corresponding judgment conditions are not exactly the same;
    第二查找模块,用于根据预设统计规则对多个所述第一判定结果进行统计,并根据统计结果在第二预设判定表中查找对应的第二判定结果,以判定所述待识别对象是否与所述目标对象相匹配;在所述第二预设判定表中预设了不同所述统计结果对应的所述第二判定结果。The second search module is configured to perform statistics on a plurality of the first determination results according to preset statistical rules, and search for the corresponding second determination results in the second preset determination table according to the statistical results, to determine the to-be-identified Whether the object matches the target object; the second judgment result corresponding to the different statistical result is preset in the second preset judgment table.
  9. 一种计算机设备,包括存储器和处理器,所述存储器存储有计算机程序,其中,所述处理器执行所述计算机程序时实现一种维度身份信息识别方法的步骤:A computer device includes a memory and a processor. The memory stores a computer program. The steps of a method for identifying dimensional identity information are implemented when the processor executes the computer program:
    根据目标检测算法对视频中的待识别对象进行身份信息识别,得出所述待识别对象在预设待识别多维度身份信息的所有类别上对应的识别概率;其中,所述预设待识别多维度身份信息包括人体特征维度中N个类别的第一待识别身份信息以及衣物维度中M个类别的第二待识别身份信息;所述预设待识别多维度身份信息为目标对象对应的身份信息,所述M和N均为正整数;The identification information of the object to be identified in the video is identified according to the target detection algorithm, and the identification probability of the object to be identified in all categories of the preset multi-dimensional identity information to be identified is obtained; wherein, the preset number of identification information to be identified The dimensional identity information includes N categories of first identity information to be identified in the human body feature dimension and M categories of second identity information to be identified in the clothing dimension; the preset multi-dimensional identity information to be identified is the identity information corresponding to the target object , The M and N are both positive integers;
    根据所述识别概率在第一预设判定表中查找对应的第一判定结果,以根据所述第一判定结果判定是否识别到对应类别的所述预设待识别多维度身份信息;在所述第一预设判定表中,所述预设待识别多维度身份信息的类别不同,则所述识别概率对应的判定条件也不完全相同;Search for the corresponding first determination result in the first preset determination table according to the recognition probability to determine whether the corresponding category of the preset multi-dimensional identity information to be recognized is recognized according to the first determination result; In the first preset determination table, if the types of the preset multi-dimensional identity information to be recognized are different, the determination conditions corresponding to the recognition probability are not completely the same;
    根据预设统计规则对多个所述第一判定结果进行统计,并根据统计结果在第二预设判定表中查找对应的第二判定结果,以判定所述待识别对象是否与所述目标对象相匹配;在所述第二预设判定表中预设了不同所述统计结果对应的所述第二判定结果。Perform statistics on a plurality of the first determination results according to preset statistical rules, and look up the corresponding second determination results in the second preset determination table according to the statistical results to determine whether the object to be identified is the same as the target object Match; the second judgment results corresponding to different statistical results are preset in the second preset judgment table.
  10. 根据权利要求9所述的计算机设备,其中,所述根据目标检测算法对视频中的待识别对象进行身份信息识别,得出所述待识别对象在预设待识别多维度身份信息的所有类别上对应的识别概率的步骤,包括:The computer device according to claim 9, wherein the identification information of the object to be identified in the video is identified according to the target detection algorithm, and it is obtained that the object to be identified is in all categories of preset multi-dimensional identity information to be identified The corresponding identification probability steps include:
    通过图像分割算法将所述待识别对象从待识别视频的背景中进行分离;Separating the object to be recognized from the background of the video to be recognized by an image segmentation algorithm;
    对分离后的所述待识别对象进行部位关键点检测,并根据所述部位关键点对所述待识别对象进行识别区域分割,所述识别区域包括头部、上半身和下半身;Performing part key point detection on the separated object to be recognized, and segmenting the recognition area of the object to be recognized according to the part key point, the recognition area including a head, an upper body, and a lower body;
    在所述识别区域内识别各自对应类别的所述待识别身份信息,并得出对应的所述识别概率。Identify the to-be-identified identity information of respective corresponding categories in the identification area, and obtain the corresponding identification probability.
  11. 根据权利要求9所述的计算机设备,其中,所述根据所述识别概率在第一预设判定表中查找对应的第一判定结果,以根据所述第一判定结果判定是否识别到对应类别的所述预设待识别多维度身份信息的步骤,包括:8. The computer device according to claim 9, wherein the corresponding first determination result is searched in a first preset determination table according to the recognition probability, so as to determine whether the corresponding category is recognized according to the first determination result The step of presetting multi-dimensional identity information to be identified includes:
    根据所述识别概率的对应类别在所述第一预设判定表中查找对应的判定条件;所述判定条件包括所述识别概率在对应类别下的预设概率阈值;Searching for a corresponding determination condition in the first preset determination table according to the corresponding category of the recognition probability; the determination condition includes the preset probability threshold of the recognition probability in the corresponding category;
    将所述识别概率与所述预设概率阈值进行比较;所述预设概率阈值包括第一预设概率阈值以及第二预设概率阈值;Comparing the recognition probability with the preset probability threshold; the preset probability threshold includes a first preset probability threshold and a second preset probability threshold;
    若所述识别概率高于所述第一预设概率阈值,则根据所述第一判定结果判定识别到对应类别的所述待识别身份信息;If the recognition probability is higher than the first preset probability threshold, determining that the corresponding category of the identity information to be recognized is recognized according to the first determination result;
    若所述识别概率高于第二预设概率阈值,且低于所述第一预设概率阈值,则根据所述第一判定结果判定不确定是否识别到对应类别的所述待识别身份信息;If the recognition probability is higher than the second preset probability threshold and lower than the first preset probability threshold, it is determined according to the first determination result whether it is uncertain whether the identity information to be recognized of the corresponding category is recognized;
    若所述识别概率低于所述第二预设概率阈值,则根据所述第一判定结果判定未识别到对应类别的所述待识别身份信息。If the recognition probability is lower than the second preset probability threshold, it is determined according to the first determination result that the identity information to be recognized of the corresponding category is not recognized.
  12. 根据权利要求9所述的计算机设备,其中,所述通过预设统计规则对多个所述第一判定结果进行统计的步骤,包括:The computer device according to claim 9, wherein the step of performing statistics on a plurality of the first determination results according to a preset statistical rule comprises:
    根据所述预设统计规则,若根据所述第一判定结果判定识别到所述待识别身份信息,则对其统计评分的赋值为A;若根据所述第一判定结果判定不确定是否识别到所述待识别身份信息,则对其统计评分的赋值为B;若根据所述第一判定结果判定未识别到所述待识别身份信息,则对其统计评分的赋值评分为C;According to the preset statistical rule, if the identification information to be identified is determined according to the first determination result, the statistical score is assigned to A; if it is determined according to the first determination result that it is uncertain whether it is identified For the identity information to be identified, the statistical score is assigned a value of B; if it is determined that the identity information to be identified is not identified according to the first determination result, the statistical score is assigned a score of C;
    将所有所述第一判定结果的所述统计评分进行叠加计算,得出所述统计结果。The statistical scores of all the first determination results are superimposed and calculated to obtain the statistical results.
  13. 根据权利要求12所述的计算机设备,其中,所述将所有所述第一判定结果的所述统计评分进行叠加计算,得出所述统计结果的步骤,包括:11. The computer device according to claim 12, wherein the step of superimposing all the statistical scores of the first determination result to obtain the statistical result comprises:
    获取不同类别的所述预设待识别多维度身份信息在预设权重分配表中对应的统计权重;Acquiring the statistical weights corresponding to the preset to-be-identified multi-dimensional identity information of different categories in the preset weight allocation table;
    根据第一公式将所有所述第一判定结果的所述统计评分进行叠加计算,得出所述统计结果;其中,所述第一公式为:According to the first formula, the statistical scores of all the first determination results are superimposed and calculated to obtain the statistical results; wherein, the first formula is:
    P=W1*A+W2*B+W3*C;P=W1*A+W2*B+W3*C;
    所述W1、W2和 W3为不同类别的所述预设待识别多维度身份信息对应的所述统计权重。The W1, W2, and W3 are the statistical weights corresponding to the preset multi-dimensional identity information to be identified in different categories.
  14. 根据权利要求13所述的计算机设备,其中,所述获取不同类别的所述预设待识别多维度身份信息在预设权重分配表中对应的统计权重的步骤,包括:The computer device according to claim 13, wherein the step of obtaining the corresponding statistical weights of the preset to-be-identified multi-dimensional identity information of different categories in a preset weight distribution table comprises:
    根据所述预设待识别多维度身份信息的类别获取预关联的当前环境因素,所述当前环境因素包括当前气温、当前空气质量、当前可见度、当前地理位置、距离地面高度中的一种或多种环境因素的组合;其中,不同类别的所述预设待识别多维度身份信息预关联的所述当前环境因素不完全相同;Obtain pre-associated current environmental factors according to the preset categories of the multi-dimensional identity information to be identified. The current environmental factors include one or more of current temperature, current air quality, current visibility, current geographic location, and height from the ground. A combination of environmental factors; wherein, the current environmental factors pre-associated with the preset multi-dimensional identity information to be identified in different categories are not completely the same;
    根据所述预设待识别多维度身份信息的类别以及所述当前环境因素在所述预设权重分配表中确定对应的所述统计权重;在所述预设权重分配表中对应所述预设待识别多维度身份信息的类别设置了多个环境因素阈值范围,不同的所述环境因素阈值范围对应不同的所述统计权重。The corresponding statistical weight is determined in the preset weight distribution table according to the preset type of the multi-dimensional identity information to be identified and the current environmental factor; the preset weight distribution table corresponds to the preset The categories of the multi-dimensional identity information to be identified are set with multiple threshold ranges of environmental factors, and different threshold ranges of environmental factors correspond to different statistical weights.
  15. 根据权利要求9所述的计算机设备,其中,在所述根据目标检测算法对视频中的待识别对象进行身份信息识别,并分别得出所述待识别对象在预设待识别多维度身份信息的所有类别上对应的识别概率的步骤之前,还包括:The computer device according to claim 9, wherein the identification information of the object to be identified in the video is identified according to the target detection algorithm, and the identification information of the object to be identified in the preset multi-dimensional identity information to be identified is obtained. Before the steps of identifying the probabilities corresponding to all categories, it also includes:
    通过接收所述预设待识别多维度身份信息的输入设定指令或通过目标检测算法对指定的目标对象进行身份信息识别,得到所述预设待识别多维度身份信息。The preset multi-dimensional identity information to be identified is obtained by receiving the input setting instruction of the preset multi-dimensional identity information to be identified or performing identity information identification on the designated target object through a target detection algorithm.
  16. 一种存储介质,其上存储有计算机程序,其中,所述计算机程序被处理器执行时实现一种维度身份信息识别方法的步骤:A storage medium having a computer program stored thereon, wherein the steps of a method for identifying dimensional identity information when the computer program is executed by a processor are as follows:
    根据目标检测算法对视频中的待识别对象进行身份信息识别,得出所述待识别对象在预设待识别多维度身份信息的所有类别上对应的识别概率;其中,所述预设待识别多维度身份信息包括人体特征维度中N个类别的第一待识别身份信息以及衣物维度中M个类别的第二待识别身份信息;所述预设待识别多维度身份信息为目标对象对应的身份信息,所述M和N均为正整数;The identification information of the object to be identified in the video is identified according to the target detection algorithm, and the identification probability of the object to be identified in all categories of the preset multi-dimensional identity information to be identified is obtained; wherein, the preset number of identification information to be identified The dimensional identity information includes N categories of first identity information to be identified in the human body feature dimension and M categories of second identity information to be identified in the clothing dimension; the preset multi-dimensional identity information to be identified is the identity information corresponding to the target object , The M and N are both positive integers;
    根据所述识别概率在第一预设判定表中查找对应的第一判定结果,以根据所述第一判定结果判定是否识别到对应类别的所述预设待识别多维度身份信息;在所述第一预设判定表中,所述预设待识别多维度身份信息的类别不同,则所述识别概率对应的判定条件也不完全相同;Search for the corresponding first determination result in the first preset determination table according to the recognition probability to determine whether the corresponding category of the preset multi-dimensional identity information to be recognized is recognized according to the first determination result; In the first preset determination table, if the types of the preset multi-dimensional identity information to be recognized are different, the determination conditions corresponding to the recognition probability are not completely the same;
    根据预设统计规则对多个所述第一判定结果进行统计,并根据统计结果在第二预设判定表中查找对应的第二判定结果,以判定所述待识别对象是否与所述目标对象相匹配;在所述第二预设判定表中预设了不同所述统计结果对应的所述第二判定结果。Perform statistics on a plurality of the first determination results according to preset statistical rules, and look up the corresponding second determination results in the second preset determination table according to the statistical results to determine whether the object to be identified is the same as the target object Match; the second judgment results corresponding to different statistical results are preset in the second preset judgment table.
  17. 根据权利要求16所述的存储介质,其中,所述根据目标检测算法对视频中的待识别对象进行身份信息识别,得出所述待识别对象在预设待识别多维度身份信息的所有类别上对应的识别概率的步骤,包括:The storage medium according to claim 16, wherein the identification information of the object to be identified in the video is identified according to the target detection algorithm to obtain that the object to be identified is in all categories of preset multi-dimensional identification information to be identified The corresponding identification probability steps include:
    通过图像分割算法将所述待识别对象从待识别视频的背景中进行分离;Separating the object to be recognized from the background of the video to be recognized by an image segmentation algorithm;
    对分离后的所述待识别对象进行部位关键点检测,并根据所述部位关键点对所述待识别对象进行识别区域分割,所述识别区域包括头部、上半身和下半身;Performing part key point detection on the separated object to be recognized, and segmenting the recognition area of the object to be recognized according to the part key point, the recognition area including a head, an upper body, and a lower body;
    在所述识别区域内识别各自对应类别的所述待识别身份信息,并得出对应的所述识别概率。Identify the to-be-identified identity information of respective corresponding categories in the identification area, and obtain the corresponding identification probability.
  18. 根据权利要求16所述的存储介质,其中,所述根据所述识别概率在第一预设判定表中查找对应的第一判定结果,以根据所述第一判定结果判定是否识别到对应类别的所述预设待识别多维度身份信息的步骤,包括:The storage medium according to claim 16, wherein the corresponding first determination result is searched in a first preset determination table according to the recognition probability, so as to determine whether the corresponding category is recognized according to the first determination result The step of presetting multi-dimensional identity information to be identified includes:
    根据所述识别概率的对应类别在所述第一预设判定表中查找对应的判定条件;所述判定条件包括所述识别概率在对应类别下的预设概率阈值;Searching for a corresponding determination condition in the first preset determination table according to the corresponding category of the recognition probability; the determination condition includes the preset probability threshold of the recognition probability in the corresponding category;
    将所述识别概率与所述预设概率阈值进行比较;所述预设概率阈值包括第一预设概率阈值以及第二预设概率阈值;Comparing the recognition probability with the preset probability threshold; the preset probability threshold includes a first preset probability threshold and a second preset probability threshold;
    若所述识别概率高于所述第一预设概率阈值,则根据所述第一判定结果判定识别到对应类别的所述待识别身份信息;If the recognition probability is higher than the first preset probability threshold, determining that the corresponding category of the identity information to be recognized is recognized according to the first determination result;
    若所述识别概率高于第二预设概率阈值,且低于所述第一预设概率阈值,则根据所述第一判定结果判定不确定是否识别到对应类别的所述待识别身份信息;If the recognition probability is higher than the second preset probability threshold and lower than the first preset probability threshold, it is determined according to the first determination result whether it is uncertain whether the identity information to be recognized of the corresponding category is recognized;
    若所述识别概率低于所述第二预设概率阈值,则根据所述第一判定结果判定未识别到对应类别的所述待识别身份信息。If the recognition probability is lower than the second preset probability threshold, it is determined according to the first determination result that the identity information to be recognized of the corresponding category is not recognized.
  19. 根据权利要求16所述的存储介质,其中,所述通过预设统计规则对多个所述第一判定结果进行统计的步骤,包括:The storage medium according to claim 16, wherein the step of performing statistics on a plurality of the first determination results according to a preset statistical rule comprises:
    根据所述预设统计规则,若根据所述第一判定结果判定识别到所述待识别身份信息,则对其统计评分的赋值为A;若根据所述第一判定结果判定不确定是否识别到所述待识别身份信息,则对其统计评分的赋值为B;若根据所述第一判定结果判定未识别到所述待识别身份信息,则对其统计评分的赋值评分为C;According to the preset statistical rule, if the identification information to be identified is determined according to the first determination result, the statistical score is assigned to A; if it is determined according to the first determination result that it is uncertain whether it is identified For the identity information to be identified, the statistical score is assigned a value of B; if it is determined that the identity information to be identified is not identified according to the first determination result, the statistical score is assigned a score of C;
    将所有所述第一判定结果的所述统计评分进行叠加计算,得出所述统计结果。The statistical scores of all the first determination results are superimposed and calculated to obtain the statistical results.
  20. 根据权利要求19所述的存储介质,其中,所述将所有所述第一判定结果的所述统计评分进行叠加计算,得出所述统计结果的步骤,包括:18. The storage medium according to claim 19, wherein the step of performing a superposition calculation on the statistical scores of all the first determination results to obtain the statistical results comprises:
    获取不同类别的所述预设待识别多维度身份信息在预设权重分配表中对应的统计权重;Acquiring the statistical weights corresponding to the preset to-be-identified multi-dimensional identity information of different categories in the preset weight allocation table;
    根据第一公式将所有所述第一判定结果的所述统计评分进行叠加计算,得出所述统计结果;其中,所述第一公式为:According to the first formula, the statistical scores of all the first determination results are superimposed and calculated to obtain the statistical results; wherein, the first formula is:
    P=W1*A+W2*B+W3*C;P=W1*A+W2*B+W3*C;
    所述W1、W2和 W3为不同类别的所述预设待识别多维度身份信息对应的所述统计权重。The W1, W2, and W3 are the statistical weights corresponding to the preset multi-dimensional identity information to be identified in different categories.
PCT/CN2020/098801 2019-07-03 2020-06-29 Multi-dimensional identity information identification method and apparatus, computer device and storage medium WO2021000829A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201910601411.9 2019-07-03
CN201910601411.9A CN110443137B (en) 2019-07-03 2019-07-03 Multi-dimensional identity information identification method and device, computer equipment and storage medium

Publications (1)

Publication Number Publication Date
WO2021000829A1 true WO2021000829A1 (en) 2021-01-07

Family

ID=68428507

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/098801 WO2021000829A1 (en) 2019-07-03 2020-06-29 Multi-dimensional identity information identification method and apparatus, computer device and storage medium

Country Status (2)

Country Link
CN (1) CN110443137B (en)
WO (1) WO2021000829A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113591539A (en) * 2021-06-01 2021-11-02 中国电子科技集团公司第三研究所 Target identification method and device and readable storage medium
CN117558035A (en) * 2024-01-11 2024-02-13 中国刑事警察学院 Figure identity recognition system and method based on image technology

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110443137B (en) * 2019-07-03 2023-07-25 平安科技(深圳)有限公司 Multi-dimensional identity information identification method and device, computer equipment and storage medium
WO2021098486A1 (en) * 2019-11-22 2021-05-27 重庆海尔洗衣机有限公司 Garment color recognition processing method, device, apparatus, and storage medium
CN111222856A (en) * 2020-01-15 2020-06-02 深信服科技股份有限公司 Mail identification method, device, equipment and storage medium
CN112966142A (en) * 2021-04-20 2021-06-15 南京云玑信息科技有限公司 Optimization method for improving accuracy and recognition speed
CN113343934A (en) * 2021-07-14 2021-09-03 华东理工大学 Hand ornament detection method based on local image difference analysis
CN117421729B (en) * 2023-12-18 2024-04-26 湖南森鹰科技有限公司 Automatic program attack detection method, device, system and medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008191760A (en) * 2007-02-01 2008-08-21 Toyota Central R&D Labs Inc Object detection device, object detection method and program
CN106503687A (en) * 2016-11-09 2017-03-15 合肥工业大学 The monitor video system for identifying figures of fusion face multi-angle feature and its method
JP2018120644A (en) * 2018-05-10 2018-08-02 シャープ株式会社 Identification apparatus, identification method, and program
CN109117801A (en) * 2018-08-20 2019-01-01 深圳壹账通智能科技有限公司 Method, apparatus, terminal and the computer readable storage medium of recognition of face
CN110443137A (en) * 2019-07-03 2019-11-12 平安科技(深圳)有限公司 The recognition methods of various dimensions identity information, device, computer equipment and storage medium

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8488023B2 (en) * 2009-05-20 2013-07-16 DigitalOptics Corporation Europe Limited Identifying facial expressions in acquired digital images
US8107726B2 (en) * 2008-06-18 2012-01-31 Samsung Electronics Co., Ltd. System and method for class-specific object segmentation of image data
CN107066983B (en) * 2017-04-20 2022-08-09 腾讯科技(上海)有限公司 Identity verification method and device
CN109948481B (en) * 2019-03-07 2024-02-02 惠州学院 Passive human body identification method based on narrowband radio frequency link sampling

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008191760A (en) * 2007-02-01 2008-08-21 Toyota Central R&D Labs Inc Object detection device, object detection method and program
CN106503687A (en) * 2016-11-09 2017-03-15 合肥工业大学 The monitor video system for identifying figures of fusion face multi-angle feature and its method
JP2018120644A (en) * 2018-05-10 2018-08-02 シャープ株式会社 Identification apparatus, identification method, and program
CN109117801A (en) * 2018-08-20 2019-01-01 深圳壹账通智能科技有限公司 Method, apparatus, terminal and the computer readable storage medium of recognition of face
CN110443137A (en) * 2019-07-03 2019-11-12 平安科技(深圳)有限公司 The recognition methods of various dimensions identity information, device, computer equipment and storage medium

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113591539A (en) * 2021-06-01 2021-11-02 中国电子科技集团公司第三研究所 Target identification method and device and readable storage medium
CN113591539B (en) * 2021-06-01 2024-04-16 中国电子科技集团公司第三研究所 Target identification method, device and readable storage medium
CN117558035A (en) * 2024-01-11 2024-02-13 中国刑事警察学院 Figure identity recognition system and method based on image technology
CN117558035B (en) * 2024-01-11 2024-04-16 中国刑事警察学院 Figure identity recognition system and method based on image technology

Also Published As

Publication number Publication date
CN110443137A (en) 2019-11-12
CN110443137B (en) 2023-07-25

Similar Documents

Publication Publication Date Title
WO2021000829A1 (en) Multi-dimensional identity information identification method and apparatus, computer device and storage medium
CN109558810B (en) Target person identification method based on part segmentation and fusion
CN102902959B (en) Face recognition method and system for storing identification photo based on second-generation identity card
Günther et al. Unconstrained face detection and open-set face recognition challenge
CN102194108B (en) Smile face expression recognition method based on clustering linear discriminant analysis of feature selection
Aiping et al. Face detection technology based on skin color segmentation and template matching
US9607211B2 (en) Face recognition apparatus, system and method for managing users based on user grouping
CN106503638B (en) Image procossing, vehicle color identification method and system for color identification
CN105205437B (en) Side face detection method and device based on contouring head verifying
WO2019153175A1 (en) Machine learning-based occluded face recognition system and method, and storage medium
CN106599880A (en) Discrimination method of the same person facing examination without monitor
Galiyawala et al. Person retrieval in surveillance video using height, color and gender
Hu et al. Fast face detection based on skin color segmentation using single chrominance Cr
CN106980864B (en) A kind of pedestrian's recognition methods again based on support sample indirect type
Das et al. Human face detection in color images using HSV color histogram and WLD
CN106022226B (en) A kind of pedestrian based on multi-direction multichannel strip structure discrimination method again
CN106407878B (en) Method for detecting human face and device based on multi-categorizer
Nguyen et al. Reliable detection of eye features and eyes in color facial images using ternary eye-verifier
KR101711328B1 (en) Method for classifying children and adult by using head and body height in images obtained from camera such as CCTV
Moi et al. A unified approach for unconstrained off-angle iris recognition
WO2023093241A1 (en) Pedestrian re-identification method and apparatus, and storage medium
CN105243380A (en) Single facial image recognition method based on combination of selective median filtering and PCA
CN109766860A (en) Method for detecting human face based on improved Adaboost algorithm
KR101851823B1 (en) Method for classifying children and adult bt using head and body height in images
Zhang et al. Eye Location Based on Adaboost and Random Forests.

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20834326

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20834326

Country of ref document: EP

Kind code of ref document: A1