CN113128437A - Identity recognition method and device, electronic equipment and storage medium - Google Patents

Identity recognition method and device, electronic equipment and storage medium Download PDF

Info

Publication number
CN113128437A
CN113128437A CN202110460309.9A CN202110460309A CN113128437A CN 113128437 A CN113128437 A CN 113128437A CN 202110460309 A CN202110460309 A CN 202110460309A CN 113128437 A CN113128437 A CN 113128437A
Authority
CN
China
Prior art keywords
information
library
personnel
target
image information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202110460309.9A
Other languages
Chinese (zh)
Inventor
孙贺然
王磊
李佳宁
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Sensetime Technology Development Co Ltd
Original Assignee
Beijing Sensetime Technology Development Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Sensetime Technology Development Co Ltd filed Critical Beijing Sensetime Technology Development Co Ltd
Priority to CN202110460309.9A priority Critical patent/CN113128437A/en
Publication of CN113128437A publication Critical patent/CN113128437A/en
Priority to PCT/CN2021/134598 priority patent/WO2022227562A1/en
Priority to TW111110509A priority patent/TW202242715A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161Detection; Localisation; Normalisation
    • G06V40/166Detection; Localisation; Normalisation using acquisition arrangements
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/40Extraction of image or video features
    • G06V10/44Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/70Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/74Image or video pattern matching; Proximity measures in feature spaces
    • G06V10/75Organisation of the matching processes, e.g. simultaneous or sequential comparisons of image or video features; Coarse-fine approaches, e.g. multi-scale approaches; using context analysis; Selection of dictionaries
    • G06V10/751Comparing pixel values or logical combinations thereof, or feature values having positional relevance, e.g. template matching
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/94Hardware or software architectures specially adapted for image or video understanding
    • G06V10/95Hardware or software architectures specially adapted for image or video understanding structured as a network, e.g. client-server architectures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168Feature extraction; Face representation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/172Classification, e.g. identification

Abstract

The present disclosure relates to an identity recognition method and apparatus, an electronic device, and a storage medium, the method including: acquiring image information acquired by target image acquisition equipment; determining a target personnel library associated with the target image acquisition equipment from a plurality of preset personnel libraries; and matching the image information based on the target personnel library, and determining the identity information corresponding to the image information. The embodiment of the disclosure can effectively improve the real-time performance and efficiency of identity recognition.

Description

Identity recognition method and device, electronic equipment and storage medium
Technical Field
The present disclosure relates to the field of computer technologies, and in particular, to an identity recognition method and apparatus, an electronic device, and a storage medium.
Background
The face recognition technology is one of biological feature recognition technologies, combines a plurality of research fields such as image processing technology, computer graphics, pattern recognition and the like, and is an effective means for identity recognition. An identity recognition method based on face recognition generally includes that a person library is constructed in advance, and when identity recognition is carried out, collected face images of a person to be verified are compared with face images in the person library to determine identity information of the person to be verified.
However, when a large number of face images are contained in the people library, the face comparison process consumes a large amount of time, and the real-time performance of the identity recognition is poor.
Disclosure of Invention
The present disclosure provides a technical scheme of identity recognition.
According to an aspect of the present disclosure, there is provided an identity recognition method, including: acquiring image information acquired by target image acquisition equipment; determining a target personnel library associated with the target image acquisition equipment from a plurality of preset personnel libraries; and matching the image information based on the target personnel library, and determining identity information corresponding to the image information.
In a possible implementation manner, a first corresponding relationship exists between a person library and a geographic area, and determining a target person library associated with the target image capturing device from a plurality of preset person libraries includes: acquiring deployment information of the target image acquisition equipment, and determining a target geographical area corresponding to the target image acquisition equipment based on the deployment information; determining the target people bank corresponding to the target geographic area from the plurality of people banks based on the first correspondence.
In a possible implementation manner, a second correspondence exists between the person library and the identification information of the image capturing device, and determining a target person library associated with the target image capturing device from a plurality of preset person libraries includes: and acquiring the identification information of the target image acquisition equipment, and determining the target personnel library corresponding to the identification information of the target image acquisition equipment from the plurality of personnel libraries on the basis of the second corresponding relation.
In a possible implementation manner, the determining, by matching the image information based on the target person library, identity information corresponding to the image information includes: extracting the features of the personnel image to obtain a first face feature; and searching first reference image information matched with the first face features in the target person library, and determining the identity information corresponding to the first reference image information as the identity information corresponding to the image information.
In a possible implementation manner, the determining, by matching the image information based on the target person library and determining identity information corresponding to the image information, the determining, by using the target person library, including: and searching second reference image information matched with the second face features in the target person library, and determining the identity information corresponding to the second reference image information as the identity information corresponding to the image information.
In one possible implementation, the method further includes: and creating a personnel library according to personnel information and the deployment information and/or the identification information of the image acquisition equipment, wherein the personnel information comprises the corresponding relation between the reference image information and the identity information of the personnel.
In a possible implementation manner, the creating a people library according to the people information and the deployment information and/or the identification information of the image capturing device includes: acquiring the personnel information; in response to the configuration operation of the personnel information, associating at least part of the personnel information with the identification information of one or more image acquisition devices or with a geographical area indicated by the deployment information of one or more image acquisition devices; a people library is created based on the person information associated with the same identification information or the same geographic area.
In a possible implementation manner, the matching the image information based on the target person library, and determining the identity information corresponding to the image information includes: under the condition that the target personnel library comprises a plurality of classification libraries, searching whether reference image information matched with the image information exists or not in the classification libraries from high to low according to the priority of the classification libraries until the reference image information matched with the image information is obtained; and determining the identity information corresponding to the reference image information as the identity information corresponding to the image information.
In one possible implementation manner, the classification library includes one or more of a focus attention object library, a common object library, and an abnormal object library.
In one possible implementation, in the educational scenario, the focus attention object library includes at least one of a teacher library and a student library; alternatively, in a retail scenario, the library of focus objects comprises at least one of a member library and an employee library.
According to an aspect of the present disclosure, there is provided an identification apparatus including: the acquisition module is used for acquiring image information acquired by the target image acquisition equipment; the determining module is used for determining a target personnel library related to the target image acquisition equipment from a plurality of preset personnel libraries; and the matching module is used for matching the image information based on the target personnel library and determining the identity information corresponding to the image information.
In one possible implementation, there is a first correspondence between a people bank and a geographic area, and the determining module includes: the first determining submodule is used for acquiring deployment information of the target image acquisition equipment and determining a target geographic area corresponding to the target image acquisition equipment based on the deployment information; a second determining sub-module, configured to determine, based on the first correspondence, the target people pool corresponding to the target geographic area from the plurality of people pools.
In a possible implementation manner, there is a second corresponding relationship between the personnel database and the identification information of the image capturing device, and the determining module includes: and the third determining submodule is used for acquiring the identification information of the target image acquisition equipment and determining the target personnel library corresponding to the identification information of the target image acquisition equipment from the plurality of personnel libraries on the basis of the second corresponding relation.
In one possible implementation manner, the target person library includes a plurality of reference image information, the image information includes a person image, and the matching module includes: the characteristic extraction submodule is used for extracting the characteristics of the personnel image to obtain first face characteristics; and the first searching sub-module is used for searching first reference image information matched with the first face features in the target person library, and determining the identity information corresponding to the first reference image information as the identity information corresponding to the image information.
In a possible implementation manner, the target person library includes a plurality of reference image information, where the image information includes a second face feature, and the matching module includes: and the second searching sub-module is used for searching second reference image information matched with the second face features in the target person library, and determining the identity information corresponding to the second reference image information as the identity information corresponding to the image information.
In one possible implementation, the apparatus further includes: the system comprises a creating module and an identifying module, wherein the creating module is used for creating a personnel library according to personnel information and the deployment information and/or the identification information of the image acquisition equipment, and the personnel information comprises the corresponding relation between the reference image information and the identity information of the personnel.
In one possible implementation, the creating module includes: the acquisition submodule is used for acquiring the personnel information; the configuration submodule is used for responding to configuration operation of the personnel information, and associating at least part of the personnel information with identification information of one or more image acquisition devices or a geographical area indicated by deployment information of one or more image acquisition devices; and the creating sub-module is used for creating a personnel library based on the personnel information associated with the same identification information or the same geographic area.
In a possible implementation manner, the matching the image information based on the target person library, and determining the identity information corresponding to the image information includes: under the condition that the target personnel library comprises a plurality of classification libraries, searching whether reference image information matched with the image information exists or not in the classification libraries from high to low according to the priority of the classification libraries until the reference image information matched with the image information is obtained; and determining the identity information corresponding to the reference image information as the identity information corresponding to the image information.
In one possible implementation manner, the classification library includes one or more of a focus attention object library, a common object library, and an abnormal object library.
In one possible implementation, in the educational scenario, the focus attention object library includes at least one of a teacher library and a student library; alternatively, in a retail scenario, the library of focus objects comprises at least one of a member library and an employee library.
According to an aspect of the present disclosure, there is provided an electronic device including: a processor; a memory for storing processor-executable instructions; wherein the processor is configured to invoke the memory-stored instructions to perform the above-described method.
According to an aspect of the present disclosure, there is provided a computer readable storage medium having stored thereon computer program instructions which, when executed by a processor, implement the above-described method.
In the embodiment of the disclosure, the target personnel library associated with the image acquisition device can be determined from the plurality of personnel libraries, and the image information is matched based on the target personnel library to determine the identity information, so that the range of matching the image information based on the personnel libraries can be reduced, the operation amount is reduced, and the real-time performance and efficiency of identity identification are effectively improved.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure. Other features and aspects of the present disclosure will become apparent from the following detailed description of exemplary embodiments, which proceeds with reference to the accompanying drawings.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the disclosure.
Fig. 1 shows a flow chart of an identification method according to an embodiment of the present disclosure.
Fig. 2a shows a first schematic diagram of a configuration interface according to an embodiment of the present disclosure.
FIG. 2b shows a second schematic diagram of a configuration interface according to an embodiment of the present disclosure.
Fig. 3 shows a block diagram of an identification device according to an embodiment of the disclosure.
Fig. 4 shows a block diagram of an electronic device in accordance with an embodiment of the disclosure.
Fig. 5 shows a block diagram of an electronic device in accordance with an embodiment of the disclosure.
Detailed Description
Various exemplary embodiments, features and aspects of the present disclosure will be described in detail below with reference to the accompanying drawings. In the drawings, like reference numbers can indicate functionally identical or similar elements. While the various aspects of the embodiments are presented in drawings, the drawings are not necessarily drawn to scale unless specifically indicated.
The word "exemplary" is used exclusively herein to mean "serving as an example, embodiment, or illustration. Any embodiment described herein as "exemplary" is not necessarily to be construed as preferred or advantageous over other embodiments.
The term "and/or" herein is an association relationship describing an associated object, meaning that three relationships may exist, e.g., a and/or B, may mean: a exists alone, A and B exist simultaneously, and B exists alone. In addition, the term "at least one" herein means any one of a plurality or any combination of at least two of a plurality, for example, including at least one of A, B, C, and may mean including any one or more elements selected from the group consisting of A, B and C.
Furthermore, in the following detailed description, numerous specific details are set forth in order to provide a better understanding of the present disclosure. It will be understood by those skilled in the art that the present disclosure may be practiced without some of these specific details. In some instances, methods, means, elements and circuits that are well known to those skilled in the art have not been described in detail so as not to obscure the present disclosure.
As described above, in the identity recognition method based on face recognition, a personnel database is usually pre-constructed, and during identity recognition, the collected face image of the person to be verified is compared with the face image in the personnel database to determine the identity information of the person to be verified.
The identity recognition method based on face recognition can be applied to scenes such as stations, markets, schools and the like, in the related art, a personnel database is usually set for one scene, for example, a personnel database corresponding to a certain school and a personnel database corresponding to a certain market, so that under the condition that the data volume of storing identity information in the personnel database is large, the calculation amount of face comparison is large, and the real-time performance and the efficiency of identity recognition can be reduced.
In the embodiment of the disclosure, the personnel database can be associated with the geographic area or the image acquisition equipment in the geographic area, so that a plurality of personnel databases can be preset for the same scene, and then in the process of identity recognition, the target personnel database can be determined from the plurality of personnel databases according to the corresponding relation between the plurality of personnel databases and the geographic area or the image acquisition equipment, so that identity recognition is realized based on the target personnel database, thereby reducing the range of image information matching based on the personnel database, reducing the operation amount, and effectively improving the real-time performance and efficiency of identity recognition.
In a possible implementation manner, the identification method may be performed by an electronic device such as a terminal device or a server, the terminal device may be a User Equipment (UE), a mobile device, a User terminal, a cellular phone, a cordless phone, a Personal Digital Assistant (PDA), a handheld device, a computing device, an in-vehicle device, a wearable device, or the like, and the method may be implemented by a processor calling a computer readable instruction stored in a memory. Alternatively, the method can be executed by a cloud server or an edge node.
The identity recognition method can be set to be executed in a cloud server or in a terminal device or an edge node according to actual requirements, and the embodiment of the present disclosure is not limited thereto. It should be understood that a plurality of preset person libraries may be stored in the electronic device executing the identity recognition method, so as to determine a target person library and match image information based on the target person library.
Fig. 1 shows a flowchart of an identification method according to an embodiment of the present disclosure, as shown in fig. 1, the identification method includes:
in step S11, image information acquired by the target image acquisition device is acquired;
in step S12, a target person library associated with the target image capturing device is determined from a plurality of preset person libraries;
in step S13, the image information is matched based on the target person library, and the identification information corresponding to the image information is determined.
It should be understood that a user may deploy one or more image capture devices within a geographic area, wherein the geographic area may be a school area, a mall area, a store area, a station area, or the like, where people's movement is typically counted; the image capturing apparatus may include: an Inter-Process Communication (IPC) device, an intelligent module (network version) device, a service module/service SDK device, and the like, which are not limited to the embodiments of the present disclosure.
The image acquisition equipment in the geographic area can be connected with the electronic equipment so as to send acquired image information to the electronic equipment, and the identity recognition method is realized. It should be understood that there is a correspondence between the image capture devices and the geographic region, and the target image capture device may be one or more image capture devices within the geographic region.
In one possible implementation, the image information may include: the image of the person collected by the target image collecting device and/or the human face characteristics of the image of the person.
When the image information is the face features of the person image, the face features of the acquired person image can be extracted through the image acquisition equipment, and the extracted face features are sent to the electronic equipment. By the method, the privacy of the object in the image information can be protected, and the probability of illegally acquiring the image of the person is reduced.
The face feature extraction network can be deployed in the image acquisition equipment so as to extract the face features of the acquired personnel images through the face feature extraction network. The embodiments of the present disclosure are not limited to the network structure, the network type, and the training mode of the face feature extraction network.
Considering that a partial image acquisition device may not have computing capability and storage capability, the image acquisition device may also send the acquired person image to the electronic device, and perform face feature extraction on the acquired person image in the electronic device.
In a possible implementation manner, the acquired image information may further include identification information of the image acquisition device, so that the identification information is used to distinguish which image acquisition device the image information is acquired by, and it is also convenient to determine a target person library associated with the image acquisition device, so as to implement matching of the image information based on the target person library. The identification information may be represented in a form of a character string, or in other representation forms, which is not limited to this embodiment of the present disclosure.
In a possible implementation manner, in step S12, the preset multiple staffing libraries may be staffing libraries pre-constructed according to actual requirements, and the number and the construction manner of the staffing libraries are not limited in the embodiment of the present disclosure, for example, an existing staffing library may be used as a construction basis, or a staffing library may be re-constructed, and the like. The personnel database can at least store reference image information of personnel and corresponding identity information, namely, the corresponding relation between the reference image information of the personnel and the identity information is stored.
The reference image information may include a face image and/or a face feature; the identity information may be, for example, a customer or an employee, a general customer or a member customer, and the content of the identity information is not limited in the embodiments of the present disclosure.
In a possible implementation manner, multiple people libraries may be associated with the image capturing device in advance, or multiple people libraries may be associated with the geographic area, that is, there is a correspondence between the multiple people libraries and the image capturing device and/or the geographic area. In this way, in step S12, the target person library associated with the target image capturing device can be determined from the preset plurality of person libraries based on the correspondence relationship.
In one possible implementation manner, in step S13, matching the image information based on the target person library, and determining the identity information corresponding to the image information may include: determining similarity between the image information and reference image information in a target personnel library; determining reference image information matched with the image information from the target personnel library according to the similarity; and determining the identity information corresponding to the reference image information matched with the image information as the identity information corresponding to the image information.
The similarity between the image information and the reference image information may be determined according to a distance between the image information and the reference image information, for example, the similarity between the image information and the reference image information may be determined according to a distance between a face feature in the image information and a face feature in the reference image information.
Wherein, the distance may include but is not limited to: cosine distance, Euclidean distance, Mahalanobis distance, etc. It should be understood that the distance and similarity may be negatively correlated, i.e., the closer the distance, the higher the similarity between the representative image information and the reference image information in the target person library; conversely, the farther the distance, the lower the similarity.
In one possible implementation, determining reference image information matching the image information from the target person library according to the similarity may include: and determining the reference image information with the similarity exceeding the similarity threshold in the target person library as the reference image information matched with the image information. The size of the similarity threshold may be set according to the extraction accuracy of the face features, the calculation accuracy of the similarity, the processing capability or resource occupation of the device for implementing the feature extraction and the similarity calculation, and the like, and may be set to 0.86, which is not limited in this embodiment of the disclosure.
In the embodiment of the disclosure, the target personnel library associated with the image acquisition device can be determined from the plurality of personnel libraries, and the image information is matched based on the target personnel library to determine the identity information, so that the range of matching the image information based on the personnel libraries can be reduced, the operation amount is reduced, and the real-time performance and efficiency of identity identification are effectively improved.
As described above, there may be correspondence between multiple people repositories and geographic areas. In a possible implementation manner, there is a first corresponding relationship between the people library and the geographic area, and in step S12, the determining a target people library associated with the target image capturing device from a plurality of preset people libraries includes:
acquiring deployment information of the target image acquisition equipment, and determining a target geographical area corresponding to the target image acquisition equipment based on the deployment information; based on the first correspondence, a target people pool corresponding to the target geographic area is determined from the plurality of people pools.
As described above, one or more image capture devices may be deployed within a geographic area. The geographic region in which the target image capture device is located may be the target geographic region.
The deployment information may include information such as a geographical location of the target image capturing device, a deployment area identifier, and the like. The geographic position can be a Global Positioning System (GPS) location, and the deployment area identifier represents a geographic area where the image acquisition device is located. It should be appreciated that the target geographic region corresponding to the target image capture device may be determined based on at least one of the deployment information described above.
As described above, the first corresponding relationship may include a corresponding relationship between the geographic area and the identification information of the image capturing device, and based on this, the target geographic area may also be determined according to the identification information of the target image capturing device.
In a possible implementation manner, the first corresponding relationship between the people library and the geographic area may be preset according to actual requirements, for example, the geographic area may be set to correspond to one or more people libraries, for example, the people library a may be set to correspond to a shop a, the people library B may be set to correspond to a shop B, and the people libraries C1 and C2 may correspond to a shop C, respectively, which is not limited in this disclosure. Based on this, the target people pool corresponding to the target geographic area may include one or more.
In the embodiment of the disclosure, the target personnel database can be determined based on the first corresponding relationship between the geographic area and the personnel database, and the matching between the image information in the same geographic area and the reference image information in the corresponding target personnel database can be effectively realized.
In view of the fact that the shooting coverage areas of the image acquisition devices in the geographic area are different, for example, for a school area, the image acquisition devices may be arranged in each class, and each class may correspond to its own personnel library, so that the personnel libraries of the classes may be set to be associated with the image acquisition devices in the class, and thus, according to the image acquisition devices associated with the class, a target personnel library may be determined for matching, so that the range of image information matching may be further reduced, the computation amount is reduced, and the real-time performance and efficiency of identity recognition are effectively improved.
As described above, there may be correspondence between a plurality of person libraries and the image capturing apparatus. In a possible implementation manner, it may be further configured that a second corresponding relationship exists between the personnel database and the identification information of the image capturing device, and in step S12, the determining, from a plurality of preset personnel databases, a target personnel database associated with the target image capturing device includes:
and acquiring the identification information of the target image acquisition equipment, and determining a target personnel library corresponding to the identification information of the target image acquisition equipment from the plurality of personnel libraries on the basis of the second corresponding relation.
As described above, the image information may carry identification information of the target image device, and the identification information may identify different image capturing devices, wherein the identification information of the target image device may be acquired from the image information.
It should be understood that the second correspondence between the identification information of the people library and the image capturing device is also a correspondence reflecting the correspondence between the people library and the image capturing device. The second corresponding relation between the personnel database and the identification information of the image acquisition equipment can be set according to actual requirements, and the target image acquisition equipment can correspond to one or more target personnel databases.
In the embodiment of the disclosure, the target person library with a small data volume corresponding to the target image acquisition device can be determined for the target image acquisition device, the range of image information matching based on the target person library can be reduced, the operation amount is reduced, and the real-time performance and the efficiency of identity recognition are effectively improved.
As described above, the image information may include an image of a person captured by the image capturing device. In a possible implementation manner, the step S13 of matching the image information based on the target person library to determine the identity information corresponding to the image information includes:
extracting the features of the personnel image to obtain a first face feature;
and searching first reference image information matched with the first face features in the target person library, and determining the identity information corresponding to the first reference image information as the identity information corresponding to the image information.
The human face feature extraction may be performed on the person image through the human face feature extraction network. It is understood that the image of the person may contain facial features of at least one object. It should be understood that the facial feature extraction network is deployed in the electronic device described above.
As described above, the reference image information in the target person library may include: face images and/or face features. In the case that the reference image information only includes a face image, searching the target person library for first reference image information matching with the first face feature may include: the face features of the face images in the target person library are extracted one by one and then matched with the first face features, so that first reference image information matched with the first face features is found out.
In a possible implementation manner, in a case that the reference image information in the target person library includes a human face feature, the first reference image information matching with the first human face feature may be found in the target person library according to the first human face feature. By the method, the real-time performance and the efficiency of identity recognition can be improved.
As described above, the reference image information that matches the image information may be determined according to the similarity between the image information and the reference image information. Searching the first reference image information matched with the first face feature in the target person library may include: and calculating the similarity between the face features in the target person library and the first face features one by one, and taking the face features in the target person library with the similarity smaller than a similarity threshold value as first reference image information matched with the first face features.
As described above, the person library stores therein reference image information and corresponding identity information. In the case where the first reference image information matching the first facial feature is determined, identity information corresponding to the first reference image information, for example, whether the object is a member or a general customer, may be obtained to facilitate statistical analysis of the person behaviors in the person library.
In a possible implementation manner, after the identity information corresponding to the image information is determined, behavior information of the object in the image information may be recorded based on the identity information, for example, the member 001 enters a shop at a certain time and leaves the shop at a certain time; it is also possible to count the number of times the general customer 002 enters the shop within a counting period, and the like.
In a possible implementation manner, a situation of first reference image information matching with the first facial feature may also not exist in the target person library, in this case, identity information and reference image information of an object having the first facial feature may be added in the target person library, and behavior information of the object is recorded, so that analysis of a passenger flow situation in a geographic area is facilitated, which is not limited in the embodiment of the present disclosure.
In the embodiment of the disclosure, the identity information corresponding to the image information can be effectively determined according to the first face feature in the image information and the target person library.
As described above, in order to protect the privacy of the object in the image information and reduce the probability of illegally acquiring the person image, the image information may also be the face feature of the person image. In a possible implementation manner, the step S13 of matching the image information based on the target person library to determine identity information corresponding to the image information includes:
and searching second reference image information matched with the second face features in the target person library, and determining the identity information corresponding to the second reference image information as the identity information corresponding to the image information.
As described above, the facial feature extraction network may be deployed in an image capturing apparatus, and facial feature extraction of a captured person image is performed in the image capturing apparatus. Based on this, the second face feature may be a face feature obtained by performing feature extraction on the acquired person image, which is performed in the image acquisition apparatus.
The searching for the second reference image information matched with the second face feature in the target person library may be performed in the same manner as the searching for the first reference image information matched with the first face feature in the target person library, and details are not repeated here.
As described above, the person library stores therein reference image information and corresponding identity information. Under the condition that second reference image information matched with the second face features is determined, identity information corresponding to the second reference image information can be obtained, and therefore statistical analysis of personnel behaviors in the personnel database is facilitated.
In the embodiment of the disclosure, not only the privacy of the object in the image information can be protected, but also the identity information corresponding to the image information can be effectively determined according to the second face feature and the target person library.
In one possible implementation, the method may further include: and creating a personnel library according to personnel information and the deployment information and/or the identification information of the image acquisition equipment, wherein the personnel information comprises the corresponding relation between the reference image information and the identity information of the personnel.
The reference image information of the person may include a pre-acquired person image and/or a face feature in a pre-extracted person image. The correspondence between the reference image information and the identity information may include: the image information is referred to, and the identity information corresponding to the reference image information, and the identity information may include information such as a person number and a person identity.
The personnel number can be information of a unique identification personnel such as a mobile phone number, a work number and/or an identification card number; the personnel identity may be information for representing the personnel identity set according to an application scenario of the personnel base, for example, for a shop scenario, the personnel identity may include a member, a staff, an abnormal customer, a normal customer, and the like; for school scenarios, the personnel identities may include students, teachers, abnormal visitors, normal visitors, and the like, without limitation to the embodiments of the present disclosure.
In one possible implementation manner, creating the staff base according to the staff information and the deployment information and/or the identification information of the image capturing device may include: establishing a personnel library according to personnel information; and setting a first corresponding relation between the personnel database and the geographic area indicated by the deployment information, and/or setting a second corresponding relation between the personnel database and the identification information of the image acquisition equipment to create the personnel database.
In the embodiment of the disclosure, the personnel library can be effectively created according to the personnel information and the deployment information and/or the identification information of the image acquisition equipment, so that the processing efficiency of the identity recognition can be improved in the identity recognition process.
In a possible implementation manner, the creating a people library according to the people information and the deployment information and/or the identification information of the image capturing device includes:
acquiring personnel information; in response to the configuration operation of the personnel information, associating at least part of the personnel information with the identification information of the one or more image acquisition devices or with the geographical area indicated by the deployment information of the one or more image acquisition devices; a people library is created based on the person information associated with the same identification information or the same geographic area.
The user can import the personnel information into the designated database so as to acquire the personnel information imported by the user. In a possible implementation manner, the person information may be imported into the specified database by adding one by one or importing in batches, and the embodiment of the present disclosure is not limited thereto.
The configuration operation aiming at the personnel information can be realized through a configuration interface of the personnel library configuration system. FIG. 2a is a first schematic diagram of a configuration interface according to an embodiment of the disclosure, as shown in FIG. 2a, a user may select a people pool bound in association with a geographic area, such as "people pool c 1" in FIG. 2a, at a drop-down box at "people pool" in FIG. 2 a; selecting an area identifier of the geographic area bound in association with the people bank in a drop-down box at the "geographic area" in fig. 2a, such as "area 0079" in the figure; and the association binding of the personnel database and the geographic area can be realized by clicking a 'completion' button.
FIG. 2b is a schematic diagram II illustrating a configuration interface according to an embodiment of the disclosure, and as shown in FIG. 2b, a user may select a people library bound in association with an image capture device, such as "people library c 2" in FIG. 2b, through a drop-down box at "people library" in FIG. 2 b; and selecting the image acquisition device associated and bound with the personnel database by the identification information of the single-choice or multi-choice image acquisition device in a drop-down list at the image acquisition device in fig. 2 b; and the association binding of the personnel database and the image acquisition equipment can be realized by clicking a 'completion' button. It should be understood that selection controls for single or multiple selections, as well as slider controls for sliding viewing of identifying information, may be provided in a drop down list, without limitation to the disclosed embodiments.
At least part of the personnel information in the personnel information is associated with the identification information of one or more image acquisition devices, which can be understood as that a certain image acquisition device can be configured to be associated with part or all of the personnel information imported by the user. At least part of the personnel information in the personnel information is associated with the geographical area indicated by the deployment information of one or more image acquisition devices, which can be understood as that a certain geographical area can be configured to be associated with part or all of the personnel information imported by the user. The geographical area indicated by the deployment information of the one or more image capturing devices, that is, the geographical area in which the one or more image capturing devices are located.
It should be understood that the person information imported by the user may be stored in one or more designated databases, or in one or more designated tables in the same designated database. Associating at least part of the person information with the image capturing device or with the geographical area may comprise: and associating at least part of the designated database or at least part of the designated table with the image acquisition equipment or with the geographic area, so as to create the personnel database based on the personnel information associated with the same identification information or the same geographic area.
The same identification information can be understood as the same image acquisition device, and the personnel information associated with the same identification information can be understood as the personnel information in a designated database or a designated table associated with the same image acquisition device. The person information associated with the same geographical area may be understood as person information in a designated database or a designated table associated with the same geographical area.
For example, the staff information may include all students and all teachers of a certain school. The staff information of all students in the school can be stored in one student database, and students of different classes can be stored in different class tables in the one student database. The number of teachers is small relative to the number of students, and all teachers can be stored in a grade table in a teacher database according to grades. Based on the information, the image acquisition equipment of each class can be configured to be associated with the student database, and the image acquisition equipment of each class can also be configured to be associated with the corresponding class table; and the image acquisition equipment of each class under different grades can be configured to be associated with the teacher database, and the image acquisition equipment of each class under the same grade can also be configured to be associated with the corresponding grade table.
In the embodiment of the disclosure, the personnel database can be effectively created according to the personnel information and the deployment information and/or the identification information of the image acquisition equipment, so that the range of image information matching based on the target personnel database during the identity recognition can be narrowed according to the deployment information and/or the identification information of the image acquisition equipment, the computation workload can be reduced, and the real-time performance and the processing efficiency based on the identity recognition can be improved.
It is contemplated that the people library may include one or more classification libraries, and in the case where the people library includes a plurality of classification libraries, priorities are set for the plurality of classification libraries, and matching reference image information is searched for according to the priorities. In one possible implementation manner, in step S13, matching the image information based on the target person library, and determining the identity information corresponding to the image information may include:
under the condition that the target personnel library comprises a plurality of classification libraries, searching whether reference image information matched with the image information exists or not in the classification libraries from high to low according to the priority of the classification libraries until the reference image information matched with the image information is obtained; and determining the identity information corresponding to the reference image information as the identity information corresponding to the image information.
In one possible implementation, the classification library includes one or more of a focus object library, a normal object library, and an abnormal object library. In an education scene, the key focus object library comprises at least one of a teacher library and a student library; alternatively, in a retail scenario, the library of focus objects comprises at least one of a member library and an employee library.
Wherein, the common object library may refer to a white list people library, for example, a common visitor library; the abnormal object library may refer to a blacklisted people library, for example, an abnormal visitor library.
It should be understood that the priorities of the classification libraries may be set according to actual requirements, and the embodiment of the present disclosure is not limited thereto, for example, the priorities may be set according to the data amount of each classification library, that is, the lower the data amount, the higher the priority of the classification library is, for example, the attention degree of the object class indicated by the classification library may be set, that is, the priority of the classification library corresponding to the most concerned object class is set to be the highest, and the like. For example: the priority of the member library, the employee library, the abnormal object library and the common object library is set to be decreased in sequence, that is, whether reference image information matched with the image information exists in the member library, the employee library, the abnormal object library and the common object library or not can be searched in sequence.
In order to facilitate understanding of the above process that whether reference image information matched with the image information exists is searched for class by class according to the sequence of priorities of the plurality of class libraries from high to low until the reference image information matched with the image information is acquired, taking the case that priorities of a membership library, an employee library, an abnormal object library and a common object library which are set in a retail scene are sequentially decreased as an example, the following is described:
the member library can be searched in the member library firstly; and under the condition that the member library finds the reference image information matched with the image information, determining the personnel identity of the visitor as a member. At this time, the behavior information of the member, such as the visit time, the visit times, etc., may be recorded, and the search may be ended. In the case where the member library does not search for reference image information matching the image information, the search may be continued in the next classification library (employee library).
And under the condition that the employee library finds the reference image information matched with the image information, determining the personnel identity of the visitor as the employee. At this point, the search may be ended. In the case where the employee library is not searched for reference image information matching the image information, the search may be continued in the next classification library (abnormal object library).
And under the condition that the abnormal object library finds the reference image information matched with the image information, determining the personnel identity of the visitor as blacklist personnel. At this time, behavior information of the blacklist person, such as the visit time, the visit times, and the like, may be recorded, and the present search may be ended. Optionally, alarm information of visiting blacklist personnel can be pushed to the end user. In the case where the abnormal object library does not find the reference image information matching the image information, the search may be continued in the next classification library (normal object library).
And under the condition that the common object library finds the reference image information matched with the image information, determining the personnel identity of the visitor as the common visitor. At this time, behavior information of the general visitor, such as visiting time, visiting times, and the like, may be recorded, and the search may be ended. In case that the general object library does not find the reference image information matching the image information, the face image and/or the face feature information of the general visitor may be added to the general object library, for example, it may indicate that a new customer comes from a shop.
In the embodiment of the disclosure, the classification libraries can be searched effectively and sequentially for image matching, so that the processing efficiency of identity recognition is improved.
In a possible implementation manner, after obtaining the identity information and the behavior information of the object, the method may further include: and sending at least one of identity information and behavior information of the object to the terminal.
In one possible implementation, the terminal includes a personal computer PC, a smartphone, a wearable device, a tablet computer, or the like. The cloud server can push various information to the terminal through the network. When the cloud server determines the identity information of the object, at least one of the identity information and the behavior information of the object can be pushed to the terminal. The behavior information may include one or more of visit time, visit times, visited areas, and the like.
In a possible implementation manner, for a retail scene, when the cloud server determines that the identity of the object is the member z, behavior information of the member z can be pushed to the terminal, so that a user can conveniently check the visiting condition of the member z, and corresponding measures can be taken. For example, products, sales promotion, and the like can be pushed to the member z with respect to information such as a history of shopping of the member z.
In one possible implementation, the creation process of the people library may include: establishing a personnel library; adding personnel in a personnel warehouse; setting an executive body of an identity recognition method; associating a people pool to a geographic area, or associating a people pool to an image capture device.
In a possible implementation manner, different types of staff libraries are established according to own needs, and the types of the staff libraries can be divided into six categories (member libraries, staff libraries, white list databases, black list databases, student libraries and teacher libraries), wherein the teacher libraries and the student libraries are mainly used for educational scenes, and the member libraries are mainly used for general store scenes.
In a possible implementation manner, after the personnel library is created, personnel can be added to a specific personnel library, or the personnel can enter a personnel management page to directly add the personnel. Can be added separately or introduced in batches. Importing the content divided into two parts, namely a plurality of pictures of people and an Excel table comprising information of all people, wherein the related items in the Excel table are unique corresponding items of each person in the pictures and the Excel and cannot be repeated. The personnel number is the only code for identifying the personnel identity, and can be a mobile phone number, a work number, an identity card number and the like.
In a possible implementation manner, whether the identity recognition function of comparing with a static face base (personnel base) is performed at a cloud or an edge node can be set according to personal needs, the default is at the cloud, and if the edge node or the intelligent terminal is selected, the identity recognition function is performed at the specific edge node or the intelligent terminal.
In a possible implementation manner, the staff database may be associated with a specific branch (geographic area), where the branch mainly refers to a certain store, a certain school, and the like, and if the staff database is bound to the branch, the same branch uses the one staff database for comparison.
In a possible implementation, if the number of people banks is too large, binding to a branch may result in too long comparison time for the base bank, for example, if a scene is a school, and different classes want to use different student banks, then the people banks may be bound to specific capturing devices (image capturing devices): including normal/intelligent IPC, intelligent modules (network version), service modules/service SDK. Therefore, the personnel library with smaller data volume can be obtained for each device, the probability that the false recognition rate is increased easily due to excessive personnel in the bottom library is reduced, and the time consumption of time comparison is reduced.
In a possible implementation manner, after the above-mentioned flow setting is completed, the data can be normally reported, at this time, the identities and the record conditions of different people compared with the personnel database can be checked, the number of people with special identities can be determined, and meanwhile, the report can be exported for further analysis.
According to the identity recognition method disclosed by the embodiment of the invention, aiming at various different terminal types: the intelligent module, the intelligent IPC, the service SDK and the edge node realize shunting processing of the personnel database by setting different image acquisition devices, and the performance and the accuracy are improved. And the user can flexibly configure whether the personnel library is bound to a branch office or a specific device according to the own requirements, and the use is convenient and intuitive.
In the personnel database use scene in the related art, a large personnel database is set for a merchant, so that the problem that when the quantity of the personnel database is very large, the processing time is too long, and the delay is large is caused. And because the personnel base is too big, the probability that the same person is identified as other people is also higher, and aiming at the situation, the embodiment of the disclosure splits the big personnel base into different personnel bases and sends the personnel bases to the bound image acquisition equipment, and different image acquisition equipment can perform corresponding differentiation processing aiming at different personnel bases, so that the problems can be effectively solved.
According to the identity identification method disclosed by the embodiment of the invention, aiming at the personnel library application scene, the binding and management of the personnel library and the equipment are carried out on the condition that a plurality of parties use the personnel library such as terminal equipment, edge nodes and cloud services, so that the distribution of the personnel library is better realized, the processing efficiency of the comparison of the personnel library is improved, and the calculated amount is reduced.
The identity recognition method can be applied to products needing personnel library management, such as schools, business supermarkets, stores, 4S stores and the like.
According to the identity recognition method disclosed by the embodiment of the disclosure, the targeted issuing of the personnel library on the edge node or the intelligent IPC equipment can be supported, and the time consumption for loading or processing the large library is reduced.
It is understood that the above-mentioned method embodiments of the present disclosure can be combined with each other to form a combined embodiment without departing from the logic of the principle, which is limited by the space, and the detailed description of the present disclosure is omitted. Those skilled in the art will appreciate that in the above methods of the specific embodiments, the specific order of execution of the steps should be determined by their function and possibly their inherent logic.
In addition, the present disclosure also provides an identity recognition apparatus, an electronic device, a computer-readable storage medium, and a program, which can be used to implement any one of the identity recognition methods provided by the present disclosure, and the corresponding technical solutions and descriptions and corresponding descriptions in the methods section are not repeated.
Fig. 3 shows a block diagram of an identification apparatus according to an embodiment of the present disclosure, as shown in fig. 3, the apparatus comprising:
the acquisition module 101 is used for acquiring image information acquired by target image acquisition equipment;
a determining module 102, configured to determine, from a plurality of preset person libraries, a target person library associated with the target image acquisition device;
and the matching module 103 is configured to match the image information based on the target person library, and determine identity information corresponding to the image information.
In a possible implementation manner, there is a first corresponding relationship between the people bank and the geographic area, and the determining module 102 includes: the first determining submodule is used for acquiring deployment information of the target image acquisition equipment and determining a target geographic area corresponding to the target image acquisition equipment based on the deployment information; a second determining sub-module, configured to determine, based on the first correspondence, the target people pool corresponding to the target geographic area from the plurality of people pools.
In a possible implementation manner, there is a second corresponding relationship between the personnel database and the identification information of the image capturing device, and the determining module 102 includes: and the third determining submodule is used for acquiring the identification information of the target image acquisition equipment and determining the target personnel library corresponding to the identification information of the target image acquisition equipment from the plurality of personnel libraries on the basis of the second corresponding relation.
In a possible implementation manner, the target person library includes a plurality of reference image information, the image information includes a person image, and the matching module 103 includes: the characteristic extraction submodule is used for extracting the characteristics of the personnel image to obtain first face characteristics; and the first searching sub-module is used for searching first reference image information matched with the first face features in the target person library, and determining the identity information corresponding to the first reference image information as the identity information corresponding to the image information.
In a possible implementation manner, the target person library includes a plurality of reference image information, where the image information includes a second human face feature, and the matching module 103 includes: and the second searching sub-module is used for searching second reference image information matched with the second face features in the target person library, and determining the identity information corresponding to the second reference image information as the identity information corresponding to the image information.
In one possible implementation, the apparatus further includes: the system comprises a creating module and an identifying module, wherein the creating module is used for creating a personnel library according to personnel information and the deployment information and/or the identification information of the image acquisition equipment, and the personnel information comprises the corresponding relation between the reference image information and the identity information of the personnel.
In one possible implementation, the creating module includes: the acquisition submodule is used for acquiring the personnel information; the configuration submodule is used for responding to configuration operation of the personnel information, and associating at least part of the personnel information with identification information of one or more image acquisition devices or a geographical area indicated by deployment information of one or more image acquisition devices; and the creating sub-module is used for creating a personnel library based on the personnel information associated with the same identification information or the same geographic area.
In a possible implementation manner, the matching the image information based on the target person library, and determining the identity information corresponding to the image information includes: under the condition that the target personnel library comprises a plurality of classification libraries, searching whether reference image information matched with the image information exists or not in the classification libraries from high to low according to the priority of the classification libraries until the reference image information matched with the image information is obtained; and determining the identity information corresponding to the reference image information as the identity information corresponding to the image information.
In one possible implementation manner, the classification library includes one or more of a focus attention object library, a common object library, and an abnormal object library.
In one possible implementation, in the educational scenario, the focus attention object library includes at least one of a teacher library and a student library; alternatively, in a retail scenario, the library of focus objects comprises at least one of a member library and an employee library.
In the embodiment of the disclosure, the target personnel library associated with the image acquisition device can be determined from the plurality of personnel libraries, and the image information is matched based on the target personnel library to determine the identity information, so that the range of matching the image information based on the personnel libraries can be reduced, the operation amount is reduced, and the real-time efficiency of identity identification is effectively improved.
In some embodiments, functions of or modules included in the apparatus provided in the embodiments of the present disclosure may be used to execute the method described in the above method embodiments, and specific implementation thereof may refer to the description of the above method embodiments, and for brevity, will not be described again here.
Embodiments of the present disclosure also provide a computer-readable storage medium having stored thereon computer program instructions, which when executed by a processor, implement the above-mentioned method. The computer readable storage medium may be a non-volatile computer readable storage medium.
An embodiment of the present disclosure further provides an electronic device, including: a processor; a memory for storing processor-executable instructions; wherein the processor is configured to invoke the memory-stored instructions to perform the above-described method.
The embodiments of the present disclosure also provide a computer program product, which includes computer readable code, and when the computer readable code runs on a device, a processor in the device executes instructions for implementing the identity recognition method provided in any one of the above embodiments.
The embodiments of the present disclosure also provide another computer program product for storing computer readable instructions, which when executed cause a computer to perform the operations of the identification method provided in any of the above embodiments.
The electronic device may be provided as a terminal, server, or other form of device.
Fig. 4 illustrates a block diagram of an electronic device 800 in accordance with an embodiment of the disclosure. For example, the electronic device 800 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, or the like terminal.
Referring to fig. 4, electronic device 800 may include one or more of the following components: processing component 802, memory 804, power component 806, multimedia component 808, audio component 810, input/output (I/O) interface 812, sensor component 814, and communication component 816.
The processing component 802 generally controls overall operation of the electronic device 800, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing components 802 may include one or more processors 820 to execute instructions to perform all or a portion of the steps of the methods described above. Further, the processing component 802 can include one or more modules that facilitate interaction between the processing component 802 and other components. For example, the processing component 802 can include a multimedia module to facilitate interaction between the multimedia component 808 and the processing component 802.
The memory 804 is configured to store various types of data to support operations at the electronic device 800. Examples of such data include instructions for any application or method operating on the electronic device 800, contact data, phonebook data, messages, pictures, videos, and so forth. The memory 804 may be implemented by any type or combination of volatile or non-volatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.
The power supply component 806 provides power to the various components of the electronic device 800. The power components 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the electronic device 800.
The multimedia component 808 includes a screen that provides an output interface between the electronic device 800 and a user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 808 includes a front facing camera and/or a rear facing camera. The front camera and/or the rear camera may receive external multimedia data when the electronic device 800 is in an operation mode, such as a shooting mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.
The audio component 810 is configured to output and/or input audio signals. For example, the audio component 810 includes a Microphone (MIC) configured to receive external audio signals when the electronic device 800 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals may further be stored in the memory 804 or transmitted via the communication component 816. In some embodiments, audio component 810 also includes a speaker for outputting audio signals.
The I/O interface 812 provides an interface between the processing component 802 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to: a home button, a volume button, a start button, and a lock button.
The sensor assembly 814 includes one or more sensors for providing various aspects of state assessment for the electronic device 800. For example, the sensor assembly 814 may detect an open/closed state of the electronic device 800, the relative positioning of components, such as a display and keypad of the electronic device 800, the sensor assembly 814 may also detect a change in the position of the electronic device 800 or a component of the electronic device 800, the presence or absence of user contact with the electronic device 800, orientation or acceleration/deceleration of the electronic device 800, and a change in the temperature of the electronic device 800. Sensor assembly 814 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 814 may also include a light sensor, such as a Complementary Metal Oxide Semiconductor (CMOS) or Charge Coupled Device (CCD) image sensor, for use in imaging applications. In some embodiments, the sensor assembly 814 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
The communication component 816 is configured to facilitate wired or wireless communication between the electronic device 800 and other devices. The electronic device 800 may access a wireless network based on a communication standard, such as a wireless network (WiFi), a second generation mobile communication technology (2G), a third generation mobile communication technology (3G), a Long Term Evolution (Long Term Evolution, LTE), or a fifth generation mobile communication technology (5G), or a combination thereof. In an exemplary embodiment, the communication component 816 receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 816 further includes a Near Field Communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.
In an exemplary embodiment, the electronic device 800 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic components for performing the above-described methods.
In an exemplary embodiment, a non-transitory computer-readable storage medium, such as the memory 804, is also provided that includes computer program instructions executable by the processor 820 of the electronic device 800 to perform the above-described methods.
Fig. 5 illustrates a block diagram of an electronic device 1900 in accordance with an embodiment of the disclosure. For example, the electronic device 1900 may be provided as a server. Referring to fig. 5, electronic device 1900 includes a processing component 1922 further including one or more processors and memory resources, represented by memory 1932, for storing instructions, e.g., applications, executable by processing component 1922. The application programs stored in memory 1932 may include one or more modules that each correspond to a set of instructions. Further, the processing component 1922 is configured to execute instructions to perform the above-described method.
The electronic device 1900 may also include a power component 1926 configured to perform power management of the electronic device 1900, a wired or wireless network interface 1950 configured to connect the electronic device 1900 to a network, and an input/output (I/O) interface 1958. The electronic device 1900 may operate based on an operating system, such as the Microsoft Server operating system (Windows Server), stored in the memory 1932TM) Apple Inc. of the present application based on the graphic user interface operating System (Mac OS X)TM) Multi-user, multi-process computer operating system (Unix)TM) Free and open native code Unix-like operating System (Linux)TM) Open native code Unix-like operating System (FreeBSD)TM) Or the like.
In an exemplary embodiment, a non-transitory computer readable storage medium, such as the memory 1932, is also provided that includes computer program instructions executable by the processing component 1922 of the electronic device 1900 to perform the above-described methods.
The present disclosure may be systems, methods, and/or computer program products. The computer program product may include a computer-readable storage medium having computer-readable program instructions embodied thereon for causing a processor to implement various aspects of the present disclosure.
The computer readable storage medium may be a tangible device that can hold and store the instructions for use by the instruction execution device. The computer readable storage medium may be, for example, but is not limited to, an electronic memory device, a magnetic memory device, an optical memory device, an electromagnetic memory device, a semiconductor memory device, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a Static Random Access Memory (SRAM), a portable compact disc read-only memory (CD-ROM), a Digital Versatile Disc (DVD), a memory stick, a floppy disk, a mechanical coding device, such as punch cards or in-groove projection structures having instructions stored thereon, and any suitable combination of the foregoing. Computer-readable storage media as used herein is not to be construed as transitory signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through a waveguide or other transmission medium (e.g., optical pulses through a fiber optic cable), or electrical signals transmitted through electrical wires.
The computer-readable program instructions described herein may be downloaded from a computer-readable storage medium to a respective computing/processing device, or to an external computer or external storage device via a network, such as the internet, a local area network, a wide area network, and/or a wireless network. The network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers and/or edge servers. The network adapter card or network interface in each computing/processing device receives computer-readable program instructions from the network and forwards the computer-readable program instructions for storage in a computer-readable storage medium in the respective computing/processing device.
The computer program instructions for carrying out operations of the present disclosure may be assembler instructions, Instruction Set Architecture (ISA) instructions, machine-related instructions, microcode, firmware instructions, state setting data, or source or object code written in any combination of one or more programming languages, including an object oriented programming language such as Smalltalk, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The computer-readable program instructions may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider). In some embodiments, the electronic circuitry that can execute the computer-readable program instructions implements aspects of the present disclosure by utilizing the state information of the computer-readable program instructions to personalize the electronic circuitry, such as a programmable logic circuit, a Field Programmable Gate Array (FPGA), or a Programmable Logic Array (PLA).
Various aspects of the present disclosure are described herein with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the disclosure. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer-readable program instructions.
These computer-readable program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks. These computer-readable program instructions may also be stored in a computer-readable storage medium that can direct a computer, programmable data processing apparatus, and/or other devices to function in a particular manner, such that the computer-readable medium storing the instructions comprises an article of manufacture including instructions which implement the function/act specified in the flowchart and/or block diagram block or blocks.
The computer readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other devices to cause a series of operational steps to be performed on the computer, other programmable apparatus or other devices to produce a computer implemented process such that the instructions which execute on the computer, other programmable apparatus or other devices implement the functions/acts specified in the flowchart and/or block diagram block or blocks.
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of instructions, which comprises one or more executable instructions for implementing the specified logical function(s). In some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The computer program product may be embodied in hardware, software or a combination thereof. In an alternative embodiment, the computer program product is embodied in a computer storage medium, and in another alternative embodiment, the computer program product is embodied in a Software product, such as a Software Development Kit (SDK), or the like.
Having described embodiments of the present disclosure, the foregoing description is intended to be exemplary, not exhaustive, and not limited to the disclosed embodiments. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The terminology used herein is chosen in order to best explain the principles of the embodiments, the practical application, or improvements made to the technology in the marketplace, or to enable others of ordinary skill in the art to understand the embodiments disclosed herein.

Claims (13)

1. An identity recognition method, comprising:
acquiring image information acquired by target image acquisition equipment;
determining a target personnel library associated with the target image acquisition equipment from a plurality of preset personnel libraries;
and matching the image information based on the target personnel library, and determining identity information corresponding to the image information.
2. The method of claim 1, wherein a first correspondence exists between the people bank and the geographic region,
the method for determining the target personnel library associated with the target image acquisition equipment from a plurality of preset personnel libraries comprises the following steps:
acquiring deployment information of the target image acquisition equipment, and determining a target geographical area corresponding to the target image acquisition equipment based on the deployment information;
determining the target people bank corresponding to the target geographic area from the plurality of people banks based on the first correspondence.
3. The method according to claim 1 or 2, characterized in that a second correspondence exists between the personnel repository and the identification information of the image acquisition device,
the method for determining the target personnel library associated with the target image acquisition equipment from a plurality of preset personnel libraries comprises the following steps:
and acquiring the identification information of the target image acquisition equipment, and determining the target personnel library corresponding to the identification information of the target image acquisition equipment from the plurality of personnel libraries on the basis of the second corresponding relation.
4. The method according to any one of claims 1 to 3, wherein a plurality of reference image information is included in the target person library, the image information including an image of a person,
the matching the image information based on the target person library and determining the identity information corresponding to the image information comprises:
extracting the features of the personnel image to obtain a first face feature;
and searching first reference image information matched with the first face features in the target person library, and determining the identity information corresponding to the first reference image information as the identity information corresponding to the image information.
5. The method according to any one of claims 1 to 4, wherein the target person library includes a plurality of reference image information, the image information including a second face feature,
the matching the image information based on the target person library and determining the identity information corresponding to the image information comprises:
and searching second reference image information matched with the second face features in the target person library, and determining the identity information corresponding to the second reference image information as the identity information corresponding to the image information.
6. The method according to any one of claims 1 to 5, further comprising:
and creating a personnel library according to personnel information and the deployment information and/or the identification information of the image acquisition equipment, wherein the personnel information comprises the corresponding relation between the reference image information and the identity information of the personnel.
7. The method according to claim 6, wherein the creating of the personnel library according to the personnel information and the deployment information and/or the identification information of the image acquisition device comprises:
acquiring the personnel information;
in response to the configuration operation of the personnel information, associating at least part of the personnel information with the identification information of one or more image acquisition devices or with a geographical area indicated by the deployment information of one or more image acquisition devices;
a people library is created based on the person information associated with the same identification information or the same geographic area.
8. The method according to any one of claims 1 to 7, wherein the matching the image information based on the target person library and determining identity information corresponding to the image information comprises:
under the condition that the target personnel library comprises a plurality of classification libraries, searching whether reference image information matched with the image information exists or not in the classification libraries from high to low according to the priority of the classification libraries until the reference image information matched with the image information is obtained;
and determining the identity information corresponding to the reference image information as the identity information corresponding to the image information.
9. The method of claim 8, wherein the classification library comprises one or more of a focus object library, a normal object library, and an abnormal object library.
10. The method of claim 9, wherein in an educational scenario, the library of focus objects comprises at least one of a teacher library and a student library;
alternatively, in a retail scenario, the library of focus objects comprises at least one of a member library and an employee library.
11. An identification device, comprising:
the acquisition module is used for acquiring image information acquired by the target image acquisition equipment;
the determining module is used for determining a target personnel library related to the target image acquisition equipment from a plurality of preset personnel libraries;
and the matching module is used for matching the image information based on the target personnel library and determining the identity information corresponding to the image information.
12. An electronic device, comprising:
a processor;
a memory for storing processor-executable instructions;
wherein the processor is configured to invoke the memory-stored instructions to perform the method of any one of claims 1 to 10.
13. A computer readable storage medium having computer program instructions stored thereon, which when executed by a processor implement the method of any one of claims 1 to 10.
CN202110460309.9A 2021-04-27 2021-04-27 Identity recognition method and device, electronic equipment and storage medium Pending CN113128437A (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
CN202110460309.9A CN113128437A (en) 2021-04-27 2021-04-27 Identity recognition method and device, electronic equipment and storage medium
PCT/CN2021/134598 WO2022227562A1 (en) 2021-04-27 2021-11-30 Identity recognition method and apparatus, and electronic device, storage medium and computer program product
TW111110509A TW202242715A (en) 2021-04-27 2022-03-22 Identity recognition method electronic equipment and computer-readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110460309.9A CN113128437A (en) 2021-04-27 2021-04-27 Identity recognition method and device, electronic equipment and storage medium

Publications (1)

Publication Number Publication Date
CN113128437A true CN113128437A (en) 2021-07-16

Family

ID=76780247

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110460309.9A Pending CN113128437A (en) 2021-04-27 2021-04-27 Identity recognition method and device, electronic equipment and storage medium

Country Status (3)

Country Link
CN (1) CN113128437A (en)
TW (1) TW202242715A (en)
WO (1) WO2022227562A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113688712A (en) * 2021-08-18 2021-11-23 上海浦东发展银行股份有限公司 Portrait identification method and device, electronic equipment and storage medium
WO2022227562A1 (en) * 2021-04-27 2022-11-03 北京市商汤科技开发有限公司 Identity recognition method and apparatus, and electronic device, storage medium and computer program product

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105868719A (en) * 2016-03-31 2016-08-17 中山艾华企业管理咨询有限公司 Face recognition and trace guiding system
CN108073577A (en) * 2016-11-08 2018-05-25 中国电信股份有限公司 A kind of alarm method and system based on recognition of face
CN109086669A (en) * 2018-06-29 2018-12-25 汉王科技股份有限公司 Recognition of face auth method, device, electronic equipment
CN109145707A (en) * 2018-06-20 2019-01-04 北京市商汤科技开发有限公司 Image processing method and device, electronic equipment and storage medium

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107886079A (en) * 2017-11-22 2018-04-06 北京旷视科技有限公司 Object identifying method, apparatus and system
TWI690856B (en) * 2019-01-07 2020-04-11 國立交通大學 Identity recognition system and identity recognition method
CN111369751A (en) * 2019-03-20 2020-07-03 杭州海康威视系统技术有限公司 Target control method, device, server and control system
CN110765938A (en) * 2019-10-22 2020-02-07 北京旷视科技有限公司 Identity recognition method and device, electronic equipment and computer readable storage medium
CN113128437A (en) * 2021-04-27 2021-07-16 北京市商汤科技开发有限公司 Identity recognition method and device, electronic equipment and storage medium

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105868719A (en) * 2016-03-31 2016-08-17 中山艾华企业管理咨询有限公司 Face recognition and trace guiding system
CN108073577A (en) * 2016-11-08 2018-05-25 中国电信股份有限公司 A kind of alarm method and system based on recognition of face
CN109145707A (en) * 2018-06-20 2019-01-04 北京市商汤科技开发有限公司 Image processing method and device, electronic equipment and storage medium
CN109086669A (en) * 2018-06-29 2018-12-25 汉王科技股份有限公司 Recognition of face auth method, device, electronic equipment

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2022227562A1 (en) * 2021-04-27 2022-11-03 北京市商汤科技开发有限公司 Identity recognition method and apparatus, and electronic device, storage medium and computer program product
CN113688712A (en) * 2021-08-18 2021-11-23 上海浦东发展银行股份有限公司 Portrait identification method and device, electronic equipment and storage medium

Also Published As

Publication number Publication date
WO2022227562A1 (en) 2022-11-03
TW202242715A (en) 2022-11-01

Similar Documents

Publication Publication Date Title
CN109089133B (en) Video processing method and device, electronic equipment and storage medium
CN110472091B (en) Image processing method and device, electronic equipment and storage medium
CN110942036B (en) Person identification method and device, electronic equipment and storage medium
WO2021093375A1 (en) Method, apparatus, and system for detecting people walking together, electronic device and storage medium
CN110569777B (en) Image processing method and device, electronic device and storage medium
CN111274426B (en) Category labeling method and device, electronic equipment and storage medium
US20220084056A1 (en) Methods and apparatuses for managing visitor information, electronic devices and storage media
CN110781813B (en) Image recognition method and device, electronic equipment and storage medium
CN110781957A (en) Image processing method and device, electronic equipment and storage medium
CN109635142B (en) Image selection method and device, electronic equipment and storage medium
CN109543566B (en) Information processing method and device, electronic equipment and storage medium
CN112101238A (en) Clustering method and device, electronic equipment and storage medium
WO2022227562A1 (en) Identity recognition method and apparatus, and electronic device, storage medium and computer program product
CN109101542B (en) Image recognition result output method and device, electronic device and storage medium
CN112991553A (en) Information display method and device, electronic equipment and storage medium
CN112101216A (en) Face recognition method, device, equipment and storage medium
CN111652107A (en) Object counting method and device, electronic equipment and storage medium
CN113688729B (en) Behavior recognition method and device, electronic equipment and storage medium
CN111814627B (en) Person detection method and device, electronic device and storage medium
CN110929545A (en) Human face image sorting method and device
CN110781975B (en) Image processing method and device, electronic device and storage medium
CN111651627A (en) Data processing method and device, electronic equipment and storage medium
CN111625671A (en) Data processing method and device, electronic equipment and storage medium
CN111062407A (en) Image processing method and device, electronic equipment and storage medium
CN111209769A (en) Identity authentication system and method, electronic device, and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
REG Reference to a national code

Ref country code: HK

Ref legal event code: DE

Ref document number: 40051318

Country of ref document: HK

RJ01 Rejection of invention patent application after publication

Application publication date: 20210716

RJ01 Rejection of invention patent application after publication