WO2020136795A1 - 情報処理装置、情報処理方法、およびプログラム - Google Patents
情報処理装置、情報処理方法、およびプログラム Download PDFInfo
- Publication number
- WO2020136795A1 WO2020136795A1 PCT/JP2018/048090 JP2018048090W WO2020136795A1 WO 2020136795 A1 WO2020136795 A1 WO 2020136795A1 JP 2018048090 W JP2018048090 W JP 2018048090W WO 2020136795 A1 WO2020136795 A1 WO 2020136795A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- information
- image
- face
- result
- area
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/172—Classification, e.g. identification
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/98—Detection or correction of errors, e.g. by rescanning the pattern or by human intervention; Evaluation of the quality of the acquired patterns
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/103—Static body considered as a whole, e.g. static pedestrian or occupant recognition
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/168—Feature extraction; Face representation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/70—Multimodal biometrics, e.g. combining information from different biometric modalities
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/98—Detection or correction of errors, e.g. by rescanning the pattern or by human intervention; Evaluation of the quality of the acquired patterns
- G06V10/993—Evaluation of the quality of the acquired pattern
Definitions
- the present invention relates to an information processing device, an information processing method, and a program that perform image recognition processing.
- Patent Document 1 describes a system that determines whether or not a predetermined person such as an inquirer or a wanted criminal is included in a moving image shot in a city or the like. This system generates the feature data of the face image included in each frame of the captured image and compares the generated feature data, so that the feature data of the same person becomes one group, and Classify into. Then, the system determines feature data representative for each person based on the classified feature data, and uses at least one of the determined feature data and a face image corresponding to the feature data as representative face data. Send to. The face authentication device compares the transmitted data with the face data of a predetermined person registered in the face data dictionary.
- Patent Document 2 describes an image processing device that automatically tracks a person by identifying the same person from images captured by different cameras. Different cameras take images of people from different directions.
- Patent Document 3 a walking state of a person is detected from a human image sequence obtained by a distant frame or a different camera, and based on the walking state, it is determined whether or not the persons included in different image sequences are the same. It is described to do.
- an object of the present invention is to provide a new method for identifying a person who cannot be identified by an original image by using image processing on another image.
- the first aspect relates to an information processing device.
- a first information processing apparatus is A first image obtained by extracting human region characteristic information about a region including a face other than the face of the search target person, The second image in which the face region is detected and the face region detected, and the face information stored in the storage unit and the face information extracted from the face region are compared. Result information, An acquisition means for acquiring each of the Display processing means for displaying at least two of the first image, the second image, and the result information on the same screen; Have.
- the second information processing apparatus A second image in which the matching result with the human area characteristic information regarding the area including the area other than the face of the search target person is coincident and the face area is detected; Acquiring means for acquiring result information indicating a comparison result between the face information stored in the storage unit and the face information extracted from the face area, Display processing means for displaying the acquired second image and the result information on the same screen; Have.
- a third information processing apparatus is A first image in which human-region characteristic information regarding a region other than the face of the search target person is extracted, An acquisition unit that acquires result information indicating a result of comparison between the face information extracted from the second image having a matching result with the human area characteristic information and the face information stored in the storage unit; Display processing means for displaying the acquired first image and the result information on the same screen; Have.
- the second aspect relates to an information processing method executed by at least one computer.
- the first information processing method according to the second aspect is The information processing device The first image used when generating the human area feature information indicating the features of the search target person, The second image in which the face region is detected and the face region detected, and the face information stored in the storage unit and the face information extracted from the face region are compared. Result information, Get each of the Displaying at least two of the first image, the second image, and the result information on the same screen.
- the second information processing method is The information processing device A second image in which the matching result with the human area characteristic information regarding the area including the area other than the face of the search target person is coincident and the face area is detected; Acquiring face information stored in the storage unit and result information indicating a comparison result of the face information extracted from the face area, And displaying the acquired second image and the result information on the same screen.
- the third information processing method is The information processing device A first image in which human-region characteristic information regarding a region other than the face of the search target person is extracted, Acquiring face information extracted from the second image having a matching result with the human area characteristic information and result information indicating a matching result of the face information stored in the storage unit, Displaying the acquired first image and the acquired result information on the same screen.
- the present invention may be a program that causes at least one computer to execute the method of the second aspect, or a computer-readable recording medium that records such a program. May be.
- the recording medium includes a non-transitory tangible medium.
- the computer program includes a computer program code which, when executed by a computer, causes the computer to execute the control method on the information processing device.
- the various constituent elements of the present invention do not necessarily have to be independently present independently, and a plurality of constituent elements are formed as one member, and one constituent element is formed by a plurality of members. May be present, a certain component may be a part of another component, a part of a certain component may overlap a part of another component, and the like.
- the plurality of procedures of the method and computer program of the present invention are not limited to being executed at different timings. For this reason, another procedure may occur during execution of a certain procedure, the execution timing of a certain procedure may partially or completely overlap the execution timing of another procedure, and the like.
- FIG. 8 is a flowchart showing details of the search process of step S110 of FIG. 7. It is a functional block diagram which shows the logical structure of the information processing apparatus which concerns on 2nd Embodiment. It is a figure which shows an example of the data structure of an authentication information database. 9 is a flowchart illustrating an example of a procedure of authentication processing of the information processing device. 9 is a flowchart showing another example of the operation of the information processing device. It is a figure which shows an example of the data structure of a 2nd characteristic information storage part. It is a functional block diagram which shows the logical structure of the information processing apparatus which concerns on 3rd Embodiment. It is a figure which shows an example of a result list screen displayed by an information processing apparatus.
- FIG. 18 is a flowchart showing an example of a detailed procedure of a display process of step S130 of FIG. It is a figure which shows the detail of the example of a display of the candidate display part of FIG. It is a figure which shows the detail of the example of a display of the candidate display part of FIG. It is a figure which shows the example of a detailed information window. It is a figure which shows the example of the procedure of the display process of an information processing apparatus. It is a figure which shows the example of the procedure of the display process of an information processing apparatus.
- FIG. 1 is a diagram conceptually showing the configuration of an image processing system according to an embodiment of the present invention.
- the image processing system 1 includes an information processing device 100.
- the information processing apparatus 100 searches for a certain person from the images captured by the plurality of cameras 5a, 5b, the cameras 5c,...
- the person to be searched for example, appears in the back image in the original image (second image 22), so face authentication may not be possible.
- the information processing apparatus 100 resembles the person from another image (first image 10) captured by the camera 5 using information such as body type (hereinafter, referred to as first characteristic information).
- a candidate is searched for, and a person is specified by face recognition using an image showing a face in the candidate.
- acquisition means that the device itself acquires data or information stored in another device or a storage medium (active acquisition), and outputs to the device itself from another device. Inputting data or information (passive acquisition) to be performed. Examples of active acquisition include requesting or inquiring another device to receive the reply, and accessing and reading the other device or a storage medium. Examples of passive acquisition include receiving information to be distributed (or transmitted, push notification, etc.). Further, “acquisition” may mean selecting and acquiring from received data or information, or selecting and receiving distributed data or information.
- the camera 5 is equipped with an image sensor such as a lens and a CCD (Charge Coupled Device) image sensor.
- an image sensor such as a lens and a CCD (Charge Coupled Device) image sensor.
- it is a network camera such as an IP (Internet Protocol) camera.
- the network camera has, for example, a wireless LAN (Local Area Network) communication function, and is connected to the information processing apparatus 100 via a communication network, that is, a relay device (not shown) such as a router.
- These cameras 5 may be so-called surveillance cameras installed in the city or inside and outside the building.
- the camera 5 may include a mechanism that follows the movement of a specific person to control the orientation of the camera body or mens, zoom control, focus adjustment, and the like.
- the camera 5 and the information processing device 100 may not be connected, may be directly connected, or may be indirectly connected via the communication network 3 or the like.
- the medium 7a and the medium 7b in which the images captured by the camera 5a and the camera 5b are recorded hereinafter, "media 7 The image data is read from and acquired.
- the camera 5c in the example connected to the information processing apparatus 100 via the communication network 3 has a wireless LAN (Local Area Network) communication function, and includes the communication network 3, that is, a relay device such as a router (not shown). ) Is connected to the information processing apparatus 100.
- the camera 5c is preferably a network camera such as an IP (Internet Protocol) camera.
- the timing of transmitting an image from the camera 5 to the information processing apparatus 100 may be real-time distribution, for example, streaming distribution, or images for a predetermined period may be transmitted at predetermined intervals. This transmission timing may be appropriately selected based on the memory capacity, the communication capacity, the image processing capacity of the camera 5 or the information processing apparatus 100, the communication status between the camera 5 and the information processing apparatus 100, or the like. , May be changed according to changes in the situation.
- the image data captured by the camera 5 may be directly transmitted to the information processing device 100, and the information processing device 100 may sequentially receive the image data.
- a storage device (not shown) that can be accessed by both the camera 5 and the information processing device 100 may be provided. In this case, the image data captured by the camera 5 is stored in the storage device. Then, the information processing apparatus 100 reads the image data from this storage device.
- the image data here may be at least one of a still image and a moving image.
- the data format, file format, file size, image size, image resolution, moving image frame rate, etc. are not particularly limited, and the specifications, standards, performance, etc. of the camera 5 and the information processing apparatus 100, the image analysis processing capability, Various types can be adopted depending on the accuracy and the like.
- at least one frame of this image data may be at least one of a first image 10 and a second image 22 described later.
- FIG. 2A is a diagram showing an example of the data structure of the video data 40.
- the video data 40 is captured by a camera 5, and is received from the camera 5 or recorded in the medium 7.
- the video data 40 includes a video ID for identifying the video data 40, a media ID for identifying the medium 7 on which the video data 40 is recorded, or a camera ID for identifying the camera 5 where the video data 40 is captured, and a shooting of the camera 5. It includes information indicating conditions (for example, shooting location, shooting time, etc.) and the main body of video data.
- FIG. 2B is a diagram showing an example of the data structure of the first image 10.
- the first image 10 is a part of the video data 40 captured by a camera 5, and may be a frame of the video data 40.
- the first image 10 includes an image ID for identifying the image, information indicating a video ID for identifying the video data 40 that is the source of the image, and a main body of the image data. When the main body of the image data is a frame, the first image 10 further includes information indicating a frame number that can identify the frame.
- the image ID may be a file name.
- the first image 10, unlike the second image 22, is an image to be searched for a person to be searched. Further, the first image 10 may be captured by the camera 5 different from the second image 22.
- FIG. 3 is a functional block diagram showing a logical configuration of the information processing apparatus 100 of this embodiment.
- the information processing device 100 includes a collating unit 102, an extracting unit 104, and a registering unit 106.
- the information processing apparatus 100 further includes a second characteristic information storage unit 110.
- the second characteristic information storage unit 110 may be integrated with the main body of the information processing device 100 or may be a separate body.
- the second characteristic information storage unit 110 may have a database structure or another data structure.
- the collation unit 102 performs collation processing for collating the first characteristic information indicating the characteristic of the search target person with the characteristic information of the human region extracted from the person included in the first image 10.
- the first characteristic information extracted from the second image 22 is characteristic information indicating the characteristic of the human region of the search target person, and is also referred to as the first characteristic information 14a hereinafter.
- the characteristic information of the human region extracted from the person included in the first image 10 to be searched is also referred to as first characteristic information 14b.
- the extraction unit 104 extracts the second characteristic information from the person included in the first image 10 when the matching results of the matching unit 102 are matched.
- the registration unit 106 causes the second feature information storage unit 110 to store the second feature information extracted from the person included in the first image 10. In other words, the registration unit 106 registers the second characteristic information extracted from the person included in the first image 10 in the second characteristic information storage unit 110.
- the matching unit 102 acquires the first image 10 by reading it from the medium 7 or by receiving it from the camera 5. Then, the matching unit 102 first specifies a human area from the acquired first image 10, and performs matching processing with the first characteristic information 14a for the specified human area. Here, there may be a plurality of first characteristic information 14a.
- FIG. 4A shows an example of the second image 22.
- the second image 22 is an image in which a person is shown but the person cannot be identified by face recognition or the like.
- the second image 22 is, for example, an image in which no face is visible such as a person facing backward, an image in which no face is captured to the extent that a matching accuracy equal to or higher than a reference value is obtained in face authentication, or low image quality in which face authentication is not possible Is an image of.
- the image in which the person cannot be specified is not limited to the case where face recognition cannot be performed. It may be an image in which the person cannot be identified by another authentication method.
- the other authentication method is, for example, biometric authentication, and is at least one of an iris, an auricle, a vein, and a fingerprint.
- the first characteristic information 14a may be extracted from the person area of the person without performing the person identification by the face authentication processing or other authentication processing for the person shown in the second image 22. That is, it is not always necessary to perform face authentication processing or other authentication processing on the second image 22.
- the second image 22 may be an image in which the person in the second image is not specified.
- the matching unit 102 determines that the human area whose degree of coincidence with the first characteristic information 14a is equal to or higher than the reference is the area corresponding to the first characteristic information 14a.
- the extraction unit 104 identifies a human region including a region in which the degree of coincidence with the first feature information 14a is equal to or greater than a reference from the first image 10, and further identifies a face region of the human region.
- the degree of coincidence is a value indicating the degree of matching, and in the present embodiment, the degree of coincidence is a numerical value of 0 to 1, with 1 for a perfect match and 0 for a perfect mismatch.
- the extraction unit 104 extracts the characteristic information of the specified face area to generate the second characteristic information, and the registration unit 106 stores the second characteristic information storage unit 110.
- the human area 16 and the face area 20 are specified from the first image 10. A person including these areas is a search target candidate.
- the extraction unit 104 extracts the first characteristic information 14a of the plurality of detection target persons from the human regions of the persons included in the plurality of different second images 22, and the registration unit 106 sets the same plurality of first characteristic information 14a. It may be stored in the first characteristic information storage unit 112 in association with each other as the person information.
- the matching unit 102 may perform the matching process using the plurality of first characteristic information 14a.
- the information processing apparatus 100 does not necessarily have to include the first feature information storage unit 112.
- the collation unit 102 may read and acquire the first characteristic information 14a from the first characteristic information storage unit 112, or may acquire the first characteristic information 14a by input from an external device.
- the first feature information storage unit 112 may also serve as the second feature information storage unit 110. In this case, the information processing apparatus 100 uses the generated second characteristic information as the first characteristic information.
- the human area includes areas corresponding to the first part and the second part.
- the second portion is, for example, at least one area of a face, an iris, an auricle, a vein, and a fingerprint.
- the second portion may be a human gait instead of the area.
- the first portion may or may not include the second portion.
- the first portion is the area of the whole person and the second portion is the face area.
- the first characteristic information (the first characteristic information 14a and the first characteristic information 14b) of the first portion is characteristic information indicating an apparent characteristic such as a person's profile or clothes.
- the first characteristic information is also referred to as “human area characteristic information”
- the second characteristic information is also referred to as “face information”.
- the first characteristic information includes height, shoulder width, ratio of body parts, clothes (shape, color, material, etc.), hairstyle (including hair color), ornaments (hat). , Glasses, accessories, etc.) and personal belongings (bags, umbrellas, canes, etc.) and the like.
- the human area feature information may include information such as the likelihood of the feature information.
- the first characteristic information 14a of the search target person is generated using the second image 22 showing the search target person.
- the second image 22 may be an image captured by the camera 5, an image captured by another imaging means, or an image read by a scanner.
- the information processing device 100 further includes a first characteristic information extraction unit (not shown).
- the first characteristic information generation unit generates the first characteristic information 14a using the second image 22 showing the person to be searched, and stores it in the first characteristic information storage unit 112.
- FIG. 5 is a flowchart showing an example of a procedure of a process in which the information processing device 100 generates the first characteristic information 14a.
- the first characteristic information generation unit acquires the image (second image 22) of the search target person (step S10), generates the second characteristic information (face information) from the acquired image, and generates the first characteristic information storage unit 112. (Step S20).
- FIG. 6A is a diagram showing an example of the data structure of the first characteristic information storage unit 112.
- the first feature information storage unit 112 stores the search target ID for identifying the search target person, the first feature information 14a of the person, and the image data of the original image from which the first feature information 14a is acquired in association with each other. There is.
- the first characteristic information storage unit 112 may store the main body of the image data, or may store the location where the image data is stored and the path indicating the file name.
- FIG. 6B is a diagram showing an example of the data structure of the second feature information storage unit 110.
- the second feature information storage unit 110 stores therein a candidate ID for identifying a candidate of a search target person and second feature information of the candidate in association with each other.
- the second characteristic information storage unit 110 stores information on candidates of at least one search target person.
- the second characteristic information storage unit 110 sets the candidate ID and the second characteristic information of the candidate as the search target ID that is the source of the candidate. May be associated.
- FIG. 7 is a flowchart showing an example of the operation of the information processing device 100.
- FIG. 8 is a flowchart showing details of the search process of step S110 of FIG.
- the collation unit 102 acquires the first characteristic information 14a (personal area characteristic information) of the search target person (step S101). Further, the matching unit 102 acquires the first image 10 (step S103). Then, the process proceeds to the search process of step S110 in FIG.
- the collation unit 102 firstly acquires the first feature information 14a of the search target person and the first feature information of the human region extracted from the person included in the first image 10. Collation processing with 14b is performed (step S111). If the matching results of the first characteristic information 14a and the first characteristic information 14b match, in other words, if the area where the degree of matching with the first characteristic information 14a is greater than or equal to the reference is found (YES in step S113), the extraction unit. 104 produces
- the extraction unit 104 identifies a human region including the region, identifies a face region from the identified human regions, extracts feature information of the identified face region, and then extracts second feature information (face information). May be generated. Then, the registration unit 106 stores the generated face information in the second feature information storage unit 110 (step S117).
- the extraction unit 104 causes the characteristic information of the face area of the person. Is generated, and the registration unit 106 stores it in the second characteristic information storage unit 110. Then, the feature information of the face area stored in the second feature information storage unit 110 is used for the person identifying process in the image processing.
- the human-region characteristic information first characteristic information 14a
- the person to be searched can be searched from the extracted person, and the feature information of the face of the person can be extracted and stored.
- FIG. 9 is a functional block diagram showing a logical configuration of the information processing device 100 according to the second embodiment.
- the information processing apparatus 100 of the present embodiment compares the second characteristic information stored in the second characteristic information storage unit 110 with the face authentication information registered in advance, and acquires candidate information of the search target person. Is the same as the above embodiment.
- the information processing apparatus 100 in FIG. 9 further includes an authentication unit 120 and an acquisition unit 122 in addition to the configuration shown in FIG.
- the authentication unit 120 uses the authentication information database 114 to perform collation processing on the second characteristic information stored in the second characteristic information storage unit 110.
- the second characteristic information of a specific person is registered in association with the information of the person.
- the acquisition unit 122 acquires, from the authentication information database 114, the information of the person associated with the second feature information determined to have the degree of coincidence equal to or higher than the reference by the matching process.
- FIG. 10 is a diagram showing an example of the data structure of the authentication information database 114.
- an authentication ID for identifying a specific person hereinafter, referred to as a registrant
- face feature information second feature information
- the face image data of the registrant, the name of the registrant, and the attribute information of the registrant are registered in association with each other.
- the substance of the face image data may be registered in the authentication information database 114, or the path where the face image data is stored and the file name may be registered.
- This face image data is used for screen display as described later, and the operator can browse the face photograph displayed on the screen together with the name and attribute information.
- the authentication information database 114 is a part of the information processing device 100.
- the authentication information database 114 may be integrated with the main body of the information processing device 100 or may be a separate body.
- the authentication information database 114 may be included in the same device as the second characteristic information storage unit 110, or may be included in different devices.
- the authentication information database 114 has a database structure, but may have another data structure.
- the collation unit 104 may have the function of the authentication unit 120 of this embodiment. Further, when the authentication results by the authentication unit 120 match, the information processing apparatus 100 reads out the identification information (authentication ID or name) corresponding to the facial feature information stored in the authentication information database 114 and outputs it to the output unit. An output processing unit (not shown) that performs output processing may be provided. The output process will be described later in detail.
- FIG. 11 is a flowchart showing an example of the procedure of the authentication processing of the information processing apparatus 100 of this embodiment.
- the authentication unit 120 uses the authentication information database 114 to perform a matching process on the second characteristic information stored in the second characteristic information storage unit 110 (step S121). Then, when there is a person who is determined to have the degree of coincidence equal to or higher than the reference by the matching process (YES in step S123), the authentication unit 120 acquires the information (name, etc.) of the person from the authentication information database 114 (step). S125).
- the registration unit 106 of the information processing device 100 stores the area corresponding to at least the first characteristic information 14a in the first image 10 in the second characteristic information storage unit 110 in association with the second characteristic information.
- the registration unit 106 associates the image data of the human region of the first image 10 with the second feature information (face information) to obtain the second feature information. You may make it memorize
- FIG. 13 is a diagram showing an example of a data structure of the second feature information storage unit 110 of this embodiment.
- the second feature information storage unit 110 adds to the information described in FIG. 6B, information on the degree of matching calculated in the matching processing in step S121 in FIG. 11 and image data of the person area.
- an image ID (shown as an original image ID in the drawing) that identifies the first image 10 that has acquired the person area may be stored in association with each other.
- the information processing apparatus 100 acquires the video ID from the first image 10 illustrated in FIG. 4B by associating the original image ID, and further captures the shooting location from the second image 22 illustrated in FIG. 4A. It is possible to acquire the information such as the above in association with the second characteristic information. Further, the information processing apparatus 100 may store the second characteristic information in the second characteristic information storage unit 110 in association with the photographing conditions such as the photographing location of the camera 5, the photographing direction, and the photographing time.
- the authentication unit 120 performs the matching process of the face information stored in the second feature information storage unit 110 with the face information registered in the authentication information database 114.
- the information of the similar person can be acquired by the acquisition unit 122.
- the same effect as that of the above-described embodiment is obtained, and further, the face of the candidate similar to the search target person is calculated from the first image 10 captured by the camera 5 using the human area feature information. It is possible to perform authentication processing and acquire information of similar persons.
- FIG. 14 is a functional block diagram showing a logical configuration of the information processing device 100 according to the third embodiment.
- the information processing apparatus 100 according to the present embodiment is the same as the second embodiment except that the information processing apparatus 100 according to the present embodiment has a configuration for displaying information about detected candidates.
- the information processing device 100 further includes a display processing unit 130 in addition to the configuration of FIG.
- the display processing unit 130 causes the display device 132 such as a liquid crystal display or an organic EL (ElectroLuminescence) display connected to the information processing device 100 to display various kinds of information.
- the acquisition unit 122 acquires a plurality of candidate person area images and information (name and attribute) from the authentication information database 114. Then, the display processing unit 130 displays each candidate person region image on the image display unit 214, and, for each candidate, information of at least one person detected as a candidate as a result of the face authentication processing is a candidate. It is displayed on the person display unit 222. Specifically, the display processing unit 130 displays at least two of the search target display unit 202, the search result display unit 210, and the authentication result display unit 220 on the same screen.
- FIG. 15 is a diagram showing an example of a result list screen 200 displayed by the information processing apparatus 100 of this embodiment.
- a search target display unit 202, a search result display unit 210, and an authentication result display unit 220 are displayed on the same result list screen 200.
- An example in which at least two of the search target display unit 202, the search result display unit 210, and the authentication result display unit 220 are displayed on the same screen will be described later.
- the acquisition unit 122 acquires at least a part of each information displayed by the display processing unit 130.
- Some of these pieces of information are, for example, the second image 22 extracted from the first characteristic information 14a (human area characteristic information) indicating the characteristics of the area other than the face of the search target person, the first characteristic information 14a (human area characteristic).
- the first image 10 (hereinafter also referred to as a candidate person area image) in which the matching result with (information) and the face area are detected, and the result information are included.
- the result information indicates the result of matching the face information stored in the authentication information database 114 with the second feature information extracted from the face area, and is generated by the authentication unit 120.
- the result information is data stored in the authentication result storage unit 116.
- the matching result with the first characteristic information 14a personal area characteristic information means that, for example, an area in which the degree of coincidence with the first characteristic information 14a (human area characteristic information) is equal to or higher than a reference is included.
- the search target display unit 202 displays the second image 22 showing the search target person.
- the second image 22 displayed on the search target display unit 202 is a part of the second image 22 including at least the human region of the search target person, and is generated by, for example, cutting out a rectangle including the human region of the search target person. It may be an image.
- the search result display unit 210 includes at least one candidate display unit 212.
- An image display unit 214 is included in each candidate display unit 212.
- the candidate person area image of the candidate is displayed on the image display unit 214 together with the image capturing condition (for example, image capturing location) of the image and the degree of coincidence with the second image 22 displayed on the search target display unit 202.
- the candidate person area image is at least a part of the first image 10, and may be, for example, an image generated by cutting out a rectangle including a person area that matches in the matching.
- the result of face recognition is displayed on the authentication result display unit 220, and the candidate display unit 222 is displayed for each candidate on the candidate display unit 212.
- the candidate display unit 222 includes an image display unit 224. At least the face image of a person who has a high degree of coincidence with the candidate person area image is displayed on the image display unit 224.
- the information displayed on the image display unit 224 is included in the above result information.
- the information of a plurality of candidates is displayed in descending order of the degree of coincidence with the first characteristic information 14a.
- the candidate display unit 222 the information of the plurality of candidates may be displayed in descending order of the degree of coincidence with the second characteristic information.
- the number of candidates displayed on the search result display unit 210 and the authentication result display unit 220 may be settable by a setting menu (not shown) or the like. Further, all candidates whose matching degree is equal to or higher than a predetermined reference value may be displayed by a list screen or scrolling. In this case, the predetermined reference value may be set in the setting menu.
- the information processing apparatus 100 further includes an authentication result storage unit 116.
- the authentication result storage unit 116 may be integrated with the main body of the information processing apparatus 100 or may be a separate body.
- the authentication result storage unit 116 may be included in the same device as the second feature information storage unit 110 and the authentication information database 114, or may be included in different devices.
- the authentication result storage unit 116 may have a database structure.
- FIG. 16 is a diagram showing an example of the data structure of the authentication result storage unit 116 of this embodiment.
- the authentication result storage unit 116 for each candidate, a candidate ID, an authentication result ID that identifies result information, a degree of coincidence of face authentication, and an authentication information ID that indicates the original authentication information from which the result information was obtained. Are associated and registered.
- FIG. 17 is a flowchart showing an example of the operation of the information processing device 100 of this embodiment.
- the acquisition unit 122 stores the information about the person acquired by the authentication process as result information in the authentication result storage unit 116 (step S127).
- the display processing unit 130 causes the display device 132 to display the acquired information (result list screen 200 of FIG. 15) (step S130).
- FIG. 18 is a flowchart showing an example of a detailed procedure of the display process of step S130 of FIG.
- the acquisition unit 122 acquires the image (second image 22) of the search target person from the first characteristic information storage unit 112 (step S131). Further, the acquisition unit 122 acquires a candidate image (first image 10) including a face region and a region whose degree of coincidence is equal to or higher than the reference from the second feature information storage unit 110 (step S133). Then, the acquisition unit 122 acquires the result information from the authentication result storage unit 116 (step S135).
- the display processing unit 130 displays the second image 22 acquired in step S131 on the search target display unit 202 of the result list screen 200, and the candidate image acquired in step S133 is the image display unit 214 of the search result display unit 210. Displayed on the authentication result display unit 220 (step S137).
- FIG. 19 is a diagram showing details of a display example of the candidate display part 212 of FIG.
- the candidate display unit 212 includes an image display unit 214, a candidate rank display unit 215, a coincidence degree display unit 216, and a shooting location display unit 218.
- An image including the candidate person area 16 may be displayed on the image display unit 214, and a frame surrounding the person area 16 and a frame surrounding the face area 20 may be displayed.
- FIG. 20 is a diagram showing details of a display example of the candidate display section 222 of FIG.
- the candidate display unit 222 includes an image display unit 224, a candidate rank display unit 225, a matching degree display unit 226, a name display unit 228, a candidate attribute information display unit 229, and a detail display button 230. ..
- the image display unit 224 displays the face image of the person detected by the face authentication processing.
- the name display section 228 displays the name of the person. At least one of the face image and identification information of the person detected by the face authentication process is displayed on the candidate display unit 222.
- the identification information of the person may be identification information of the authentication information database 114 (authentication ID in FIG. 10), or may be at least one of a name and an attribute.
- the candidate attribute information display unit 229 displays the attribute information of the person detected by the face authentication processing, such as gender and age.
- the detail display button 230 is an operation button for displaying further attribute information of the person.
- the detailed display button 230 is pressed, the detailed information window 240 of FIG. 21 is displayed.
- the detailed information displayed in the detailed information window 240 may be registered in the authentication information database 114 or may be stored in another storage device in association with the authentication ID.
- the authentication result storage unit 116 stores, as a part of the result information, information for reaching the detailed information.
- the display processing unit 130 causes the image of the search target person (second image 22) and the first image 10 captured by the camera 5 to include the first feature information 14a (person area feature). Information), the image of the human area of the candidate detected by the matching processing and the image and information of the candidate detected by the matching processing using the authentication information database 114 for the face area included in the human area are the same result. It is displayed on the list screen 200.
- the image of the candidate is detected from the first image 10 captured by the camera 5 based on the image (second image 22) of the detection target person whose face is not captured.
- the face image of the person registered in the authentication information database 114 and the attribute information regarding the face area from the image of the candidate can be viewed on the same result list screen 200.
- the information processing apparatus 100 can display images of at least one candidate on the search target display unit 202 and the candidate display unit 212, or can switch and display the candidates sequentially in order of rank. Further, the candidate display section 222 showing the face recognition result for the selected candidate is displayed.
- FIG. 22 to 24 are diagrams showing an example of the procedure of the display process of the information processing apparatus 100 according to the present embodiment. Further, FIG. 25 is a diagram for explaining the transition of the display screen. The display process of the information processing device 100 will be described below with reference to these drawings.
- the display processing unit 130 receives the designation of the search target person from the second image 22 and displays it on the search target display unit 202 of the screen 300 of FIG. 25A (step S201).
- the second image 22 includes a plurality of persons
- an operator may operate the second image 22 to display a frame that specifies the person area 16 of the target person.
- the screen 300 further includes a search button 302 and a cancel button 304.
- the number of search target persons is one, but when the matching process is performed using the first feature information 14a of the plurality of search target persons shown in the plurality of second images 22, a plurality of search target persons are obtained.
- a plurality of images of the search target person may be displayed on the search target display unit 202.
- At least one candidate display unit 212 may be displayed for each search candidate, or the information of a plurality of candidates obtained as a result of the matching process using the first feature information 14a of a plurality of search subjects may be candidates. You may display a plurality on the person display part 212.
- step S203 When the depression of the search button 302 is accepted (YES in step S203), the information processing apparatus 100 executes the search process described in FIG. 8 (step S110). During the search process, a message 306 indicating that the search is in progress is displayed (step S205). When the information processing apparatus 100 receives a press of the cancel button 304 during the search processing, the information processing apparatus 100 stops the detection processing and returns to step S201 (not shown).
- the screen 310 of FIG. 25(e) is displayed.
- This screen 310 includes a message 312 indicating that no candidate was found.
- the screen 310 may include a re-search button 314.
- the process may return to step S201, a message prompting re-selection of the second image 22 of the search target person may be displayed, and the re-selection may be accepted (not shown).
- the display method of candidates can be set in advance using a setting menu (not shown) or the like.
- the setting menu it is possible to select whether to display the detected candidates one by one or display all the detected candidates (every predetermined number of persons (for example, each of the top three persons)).
- the information processing apparatus 100 switches the display method of the candidate according to the setting (step S211). For example, if all (the top three in this example) are selected, the process proceeds to the authentication process of step S120, and the face authentication process is performed on the face area of each candidate. Then, the result list screen 200 (FIG. 15) showing the result of the face authentication processing is displayed (step S213).
- step S211 When the setting of sequentially displaying the candidates one by one is selected (sequential step S211), the information processing apparatus 100 proceeds to step S221 (FIG. 23).
- the counter i is set to 1 (step S221).
- a next button 332 for displaying the next candidate is displayed on the screen 330, and a previous button for displaying the previous candidate is displayed. Is not displayed (step S225).
- the search target display unit 202 and the candidate display unit 212 of the first candidate are displayed on the screen 330 (step S233).
- the screen 330 further displays a search button 334 for accepting the face authentication processing of the candidate.
- step S235 The process is switched according to the type of operation button pressed on the screen 330 (step S235).
- i is incremented to 2 (step S243), and the process returns to step S223. Since i is 2, NO in step S223 and the front button 342 is further displayed on the screen 340 (step S227).
- the process proceeds to step S233, and FIG.
- the candidate display part 212 of the second candidate is displayed on the screen 340 of c) (step S233).
- step S241 When the front button 342 is pressed (before step S235), i is decremented to 1 (step S241), and the process returns to step S223. Then, since i ⁇ 1, the process proceeds to step S225, the next button 332 is displayed, and the previous button 342 is not displayed. Then, the candidate display part 212 of the first candidate is displayed on the screen 330 (FIG. 25B) (step S235).
- step S235 face authentication processing is performed on the face area of the first candidate (step S120). Then, when the result information is acquired, the result screen 350 of FIG. 25D is displayed (step S237). On the result screen 350, the search target display unit 202, the candidate display unit 212, and the candidate display unit 222 are displayed, and further, the change button 352 for executing the face authentication processing of another candidate is displayed. May be done.
- step S239 When the change button 352 is pressed (YES in step S239), the process returns to step S223. Since i is 1 here, the screen 330 of FIG. 25B is displayed. Then, when the next button 332 is selected, the second candidate is displayed (step S233), and when the search button 334 is selected (search of step S235), face authentication processing is performed for the second candidate (step). S120).
- a predetermined number of people for example, the top three
- a person who performs face authentication processing may be selected from the candidates.
- An example of the procedure of the display process is shown in the flowchart of FIG.
- the screen 360 of FIG. 25(f) is displayed (step S251).
- the screen 360 displays the authentication result display unit 220 and the search result display unit 210 including the candidate display units 212 of a plurality of candidates (three in the example of this figure).
- the candidate display unit 212 displays a search button 362 that accepts selection of a candidate for face authentication processing.
- step S253 face authentication processing is executed by the authentication unit 120 for the selected candidate (step S120). Then, the result of the face authentication processing is displayed on the screen 350 of FIG. On the screen 350, the image of the candidate selected as the target of the face authentication process is displayed on the candidate display unit 212.
- the display processing unit 130 can display the screen 320 or the screen 360 including the search target display unit 202 and the search result display unit 210. Then, on the screen 320 or the screen 360, the operator can select a candidate to perform the face authentication process and perform the face authentication process. Therefore, the face authentication process can be omitted for a clearly different person. Is improved. Further, since the display content can be changed according to the size of the display, it is possible to display the screen easily.
- FIG. 26 is a diagram showing an example of the configuration of a computer 80 that realizes the information processing apparatus 100 of each of the above-described embodiments.
- the computer 80 stores a CPU (Central Processing Unit) 82, a memory 84, a program 90 that realizes the constituent elements of each information processing apparatus 100 of FIGS. 2, 9 and 11 loaded in the memory 84, and the program 90.
- a storage 85, an I/O (Input/Output) 86, and a network connection interface (communication I/F 87) are provided.
- the CPU 82, the memory 84, the storage 85, the I/O 86, and the communication I/F 87 are connected to each other via a bus 89, and the CPU 82 controls the entire information processing apparatus.
- the method of connecting the CPU 82 and the like to each other is not limited to bus connection.
- the memory 84 is a memory such as a RAM (Random Access Memory) or a ROM (Read Only Memory).
- the storage 85 is a storage device such as a hard disk, SSD (Solid State Drive), or memory card.
- the storage 85 may be a memory such as a RAM or a ROM.
- the storage 85 may be provided inside the computer 80, or may be provided outside the computer 80 and connected to the computer 80 by wire or wirelessly if the computer 80 is accessible. Alternatively, it may be detachably attached to the computer 80.
- each function of each unit of the information processing apparatus 100 of each embodiment can be realized.
- the I/O 86 controls input/output of data and control signals between the computer 80 and other input/output devices.
- the other input/output device includes, for example, an input device (not shown) such as a keyboard, a touch panel, a mouse, and a microphone connected to the computer 80, an output device (not shown) such as a display, a printer, and a speaker. These input/output devices and the interface of the computer 80 are included. Further, the I/O 86 may control the input/output of data to/from a reading/writing device (not shown) of another recording medium.
- the communication I/F 87 is a network connection interface for communicating between the computer 80 and an external device.
- the communication I/F 87 may be a network interface for connecting to a wired line or a network interface for connecting to a wireless line.
- the computer 80 that realizes the information processing apparatus 100 is connected to at least one camera 5 via the network by the communication I/F 87.
- Each component of the information processing apparatus 100 of each embodiment is realized by an arbitrary combination of hardware and software of the computer 80 in this figure. It will be understood by those skilled in the art that there are various modified examples of the method and device for realizing the same.
- the functional block diagram showing the information processing apparatus 100 of each of the above-described embodiments does not show a configuration in hardware units, but shows blocks in logical functional units.
- the information processing device 100 may be composed of a plurality of computers 80, or may be realized by a virtual server.
- the present invention can be implemented as an information processing system exemplified below as an example configured by a plurality of computers 80, but is not limited thereto.
- the extraction unit 104 and the matching unit 102 are implemented by different devices (computer 80).
- the information processing system may include a terminal device including the extraction unit 104 and a server device including the matching unit 102.
- the storage unit that realizes the second characteristic information storage unit 110 and the first characteristic information storage unit 112 may be realized by a plurality of devices.
- a storage device that stores the second characteristic information extracted from the person included in the first image and a storage device that stores the identification information of the specific person and the second characteristic information may exist separately. ..
- the extraction processing of the characteristic information from the first image 10 and the extraction processing of the characteristic information from the second image 20 are performed by different devices (computer 80).
- the information processing system may include a plurality of terminal devices having the extraction unit 104 for analyzing an image and a server device that integrates information from the terminal devices and performs a matching process.
- a plurality of terminal devices may be separately provided for each area, and the extraction unit 102 may be realized by a plurality of physical devices.
- It may be divided into different devices (computers 80) according to the type of feature information (face feature information and human region feature information) that is the target of image analysis (extracting unit 102 and collating unit 104).
- the feature information extracted from the human region of the person included in the first image 10 and the first feature information 14a of the search target person are matched in the first matching process and the matching process.
- the second matching process is performed between the second feature information extracted from the face area of the person in the first image 10 and the face feature information of the registrant.
- the collating unit 102 uses the first characteristic information 14a and the second characteristic information to determine whether the first image 10 and the second image 22 are different from the first image with respect to the third image. At least one of the matching process and the second matching process may be performed.
- the second matching process with the second feature information can be performed instead of the first matching process with the first feature information 14a. If the face area cannot be detected from the third image, the first matching process with the first feature information 14a may be performed. Then, the new second characteristic information generated by the first matching process may be stored in the second characteristic information storage unit 110.
- the matching process using the already acquired first characteristic information 14a or the second characteristic information with respect to the third image captured at a date and time different from the first image 10 is performed.
- the search target person can be searched for the third image as well.
- the first characteristic information is characteristic information extracted from the first portion of the human area
- the second characteristic information is characteristic information extracted from the second portion of the human area, particularly the facial area.
- other combinations of the first characteristic information and the second characteristic information are also possible.
- the first characteristic information is information indicating at least one of the color, age group, sex, and height of the person's clothes
- the second characteristic information is the person's face characteristic information.
- the search target person when face recognition cannot be performed because the face of the search target person is not shown in the second image 22, instead of performing the process of extracting the first feature information 14a from the human region of the second image 22.
- At least one of the color, age group, sex, and height of the search target person's clothes may be specified by an operator operation and stored in the first characteristic information storage unit 112 as the first characteristic information 14a. ..
- an operation accepting unit (not shown) that accepts the input of the first feature information of the search target person may be provided on the screen together with the search target display unit 202 that displays the second image 22. The operator can input the first feature information of the person while looking at the image of the person to be searched displayed on the search target display unit 202.
- the first feature information is feature information of the entire human area
- the second feature information is a plurality of biometric authentication information for performing a multi-modal biometric authentication process that combines a plurality of biometric information.
- the first feature information 14a is extracted from the human region of the person shown in the second image 22, the candidate is detected using the first feature information 14a for the first image 10, and the detected candidate is A person may be identified by a multi-modal biometric authentication process using a plurality of biometric information as the second characteristic information.
- a second image in which the matching result with the human area characteristic information regarding the area including the area other than the face of the search target person is coincident and the face area is detected;
- Acquiring means for acquiring result information indicating a comparison result between the face information stored in the storage unit and the face information extracted from the face area,
- Display processing means for displaying the acquired second image and the result information on the same screen;
- An information processing apparatus including. 3.
- a first image in which human-region characteristic information regarding a region other than the face of the search target person is extracted An acquisition unit that acquires the face information extracted from the second image having the matching result with the human region characteristic information and the result information indicating the matching result with the face information stored in the storage unit; Display processing means for displaying the acquired first image and the result information on the same screen; An information processing apparatus including. 4. 1. To 3. In the information processing device according to any one of The acquisition means acquires a plurality of the second images, The information processing apparatus, wherein the display processing unit displays the result information for each of the acquired second images. 5. 1. To 4. In the information processing device according to any one of The display processing means, An information processing apparatus for displaying the first image, the second image, and the result information on the same screen. 6. 1. To 5.
- the display processing means displays the first image and the second image on the same screen. 7. 6. In the information processing device according to The acquisition means acquires a plurality of the second images, The display processing means, when receiving a selection operation of selecting at least one image from the plurality of second images, displaying the result information on the selected second image. 8. 1. To 7. In the information processing device according to any one of The characteristic information of the face of the specific person and the information of the specific person are stored in the storage unit in association with each other. The information processing apparatus, wherein the result information includes at least one of a degree of coincidence with the feature information of the face stored in the storage unit and information of the specific person. 9. 8. In the information processing device according to The information of the specific person is An information processing apparatus including at least one of a face photograph and identification information of the specific person.
- the information processing device The first image used when generating the human area feature information indicating the features of the search target person, The second image in which the face region is detected and the face region detected, and the face information stored in the storage unit and the face information extracted from the face region are compared. Result information, Get each of the An information processing method, wherein at least two of the first image, the second image, and the result information are displayed on the same screen. 11.
- the information processing device A second image in which the matching result with the human area characteristic information regarding the area including the area other than the face of the search target person is coincident and the face area is detected; Acquiring face information stored in the storage unit and result information indicating a comparison result of the face information extracted from the face area, An information processing method in which the acquired second image and the acquired result information are displayed on the same screen.
- the information processing device A first image in which human-region characteristic information regarding a region other than the face of the search target person is extracted, Acquiring face information extracted from the second image having a matching result with the human area characteristic information and result information indicating a matching result of the face information stored in the storage unit, An information processing method, wherein the acquired first image and the acquired result information are displayed on the same screen. 13.
- the information processing device is Acquiring a plurality of the second images, An information processing method for displaying the result information for each of the acquired second images. 14. 10. To 13. In the information processing method described in any one of The information processing device is An information processing method for displaying the first image, the second image, and the result information on the same screen. 15. 10. To 14. In the information processing method described in any one of The information processing device is An information processing method for displaying the first image and the second image on the same screen. 16. 15. In the information processing method described in The information processing device is Acquiring a plurality of the second images, An information processing method of displaying the result information for the selected second image when a selection operation of selecting at least one image from a plurality of the second images is received.
- the characteristic information of the face of the specific person and the information of the specific person are stored in the storage unit in association with each other.
- the information processing method, wherein the result information includes at least one of a degree of coincidence with the feature information of the face stored in the storage unit and information of the specific person.
- 18. 17 in the information processing method described in The information of the specific person is An information processing method including at least one of a facial photograph and identification information of the specific person.
- a second image in which the matching result with the human area characteristic information regarding the area including the area other than the face of the search target person is coincident and the face area is detected;
- the display processing means A program for causing a computer to execute the procedure of displaying the first image, the second image, and the result information on the same screen. 24. 19. To 23.
- the display processing means is a program for causing a computer to execute a procedure for displaying the first image and the second image on the same screen. 25. 24.
- the acquisition unit acquires a plurality of the second images
- the display processing means causes a computer to execute a procedure of displaying the result information for the selected second image when receiving a selection operation of selecting at least one image from the plurality of second images. Program of. 26. 19. To 25.
- the characteristic information of the face of the specific person and the information of the specific person are stored in the storage unit in association with each other.
- the program, wherein the result information includes at least one of a degree of coincidence with the feature information of the face stored in the storage unit and information of the specific person. 27. 26.
- the information of the specific person is A program including at least one of a facial photograph and identification information of the specific person.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Health & Medical Sciences (AREA)
- Oral & Maxillofacial Surgery (AREA)
- General Health & Medical Sciences (AREA)
- Quality & Reliability (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Collating Specific Patterns (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Image Analysis (AREA)
- Processing Or Creating Images (AREA)
- Closed-Circuit Television Systems (AREA)
- Image Processing (AREA)
Abstract
Description
第一の側面に係る第1の情報処理装置は、
検索対象人物の顔以外を含む領域に関する人領域特徴情報を抽出した第1画像、
前記人領域特徴情報との照合結果が一致となり、かつ、顔領域が検知された第2画像、および
記憶部に記憶されている顔情報と前記顔領域から抽出された顔情報との照合結果を示す結果情報、
のそれぞれを取得する取得手段と、
前記第1画像、前記第2画像、および前記結果情報のうち少なくとも2つを同じ画面に表示させる表示処理手段と、
を有する。
第一の側面に係る第2の情報処理装置は、
検索対象人物の顔以外を含む領域に関する人領域特徴情報との照合結果が一致となり、かつ、顔領域が検知された第2画像と、
記憶部に記憶されている顔情報と前記顔領域から抽出された顔情報との照合結果を示す結果情報と、を取得する取得手段と、
取得した前記第2画像、および前記結果情報を同じ画面に表示させる表示処理手段と、
を有する。
第一の側面に係る第3の情報処理装置は、
検索対象人物の顔以外を含む領域に関する人領域特徴情報を抽出した第1画像と、
前記人領域特徴情報との照合結果が一致となった第2画像から抽出された顔情報と記憶部に記憶されている顔情報との照合結果を示す結果情報と、を取得する取得手段と、
取得した前記第1画像、および前記結果情報を同じ画面に表示させる表示処理手段と、
を有する。
第二の側面に係る第1の情報処理方法は、
情報処理装置が、
検索対象人物の特徴を示す人領域特徴情報を生成する際に用いられた第1画像、
前記人領域特徴情報との照合結果が一致となり、かつ、顔領域が検知された第2画像、および
記憶部に記憶されている顔情報と前記顔領域から抽出された顔情報との照合結果を示す結果情報、
のそれぞれを取得し、
前記第1画像、前記第2画像、および前記結果情報のうち少なくとも2つを同じ画面に表示させる、ことを含む。
第二の側面に係る第2の情報処理方法は、
情報処理装置が、
検索対象人物の顔以外を含む領域に関する人領域特徴情報との照合結果が一致となり、かつ、顔領域が検知された第2画像と、
記憶部に記憶されている顔情報と前記顔領域から抽出された顔情報との照合結果を示す結果情報と、を取得し、
取得した前記第2画像、および前記結果情報を同じ画面に表示させる、ことを含む。
第二の側面に係る第3の情報処理方法は、
情報処理装置が、
検索対象人物の顔以外を含む領域に関する人領域特徴情報を抽出した第1画像と、
前記人領域特徴情報との照合結果が一致となった第2画像から抽出された顔情報と記憶部に記憶されている顔情報との照合結果を示す結果情報と、を取得し、
取得した前記第1画像、および前記結果情報を同じ画面に表示させる、ことを含む。
このコンピュータプログラムは、コンピュータにより実行されたとき、コンピュータに、情報処理装置上で、その制御方法を実施させるコンピュータプログラムコードを含む。
また、本明細書の各図において、本発明の本質に関わらない部分の構成については省略してあり、図示されていない。
図1は、本発明の実施の形態に係る画像処理システムの構成を概念的に示す図である。
画像処理システム1は、情報処理装置100を備える。情報処理装置100は、複数のカメラ5a,5b,カメラ5c・・・(特に区別する必要がない場合は「カメラ5」と呼ぶ。)で撮像された画像から、ある人物を検索する。
図9は、第2の実施の形態の情報処理装置100の論理的な構成を示す機能ブロック図である。本実施形態の情報処理装置100は、第2特徴情報記憶部110に記憶された第2特徴情報を、予め登録されている顔認証情報と照合して検索対象人物の候補情報を取得する点以外は上記実施形態の同じである。
また、情報処理装置100は、認証部120による認証結果が一致となった場合、認証情報データベース114に記憶されている顔特徴情報に対応する識別情報(認証IDや氏名)を読み出して出力部に出力処理を行う出力処理部(不図示)を備えてもよい。出力処理については詳細に後述する。
まず、認証部120は、第2特徴情報記憶部110に記憶されている第2特徴情報に対して、認証情報データベース114を用いて照合処理を実行する(ステップS121)。そして、照合処理により基準以上の一致度を有すると判断される人物がいた場合(ステップS123のYES)、認証部120は、認証情報データベース114から当該人物の情報(氏名等)を取得する(ステップS125)。
図14は、第3の実施の形態に係る情報処理装置100の論理的な構成を示す機能ブロック図である。本実施形態の情報処理装置100は、検出された候補者の情報を表示する構成を有する点以外は第2実施形態と同じである。情報処理装置100は、図9の構成に加え、さらに表示処理部130を有している。表示処理部130は、情報処理装置100に接続された液晶ディスプレイ、有機EL(ElectroLuminescence)ディスプレイ等の表示装置132に各種情報を表示させる。
第1特徴情報14a(人領域特徴情報)との照合結果が一致となるとは、例えば、第1特徴情報14a(人領域特徴情報)に対する一致度が基準以上である領域を含むことである。
上記実施形態では、結果一覧画面200に同時に検索対象表示部202と、検索結果表示部210と、認証結果表示部220とが表示される構成について説明した。本実施形態の情報処理装置100は、検索対象表示部202と、候補者表示部212に少なくとも1人の候補者の画像を表示させ、または、順位順に順次候補者を切り替えて表示させることができ、さらに、選択された候補者について顔認証結果を示す候補者表示部222を表示する。
コンピュータ80は、CPU(Central Processing Unit)82、メモリ84、メモリ84にロードされた図2、図9および図11の各情報処理装置100の構成要素を実現するプログラム90、そのプログラム90を格納するストレージ85、I/O(Input/Output)86、およびネットワーク接続用インタフェース(通信I/F87)を備える。
(1)抽出部104と照合部102は別の装置(コンピュータ80)で実施する。例えば、情報処理システムは、抽出部104を有する端末装置と、照合部102を有するサーバ装置と備えてもよい。
(2)第2特徴情報記憶部110と第1特徴情報記憶部112を実現する記憶手段は、複数の装置によって実現されてもよい。例えば、第1の画像に含まれる人物から抽出された第2特徴情報を記憶する記憶装置と、特定の人物の識別情報および第2特徴情報が記憶されている記憶装置が別に存在してもよい。
(3)抽出部104の抽出処理のうち、第1画像10からの特徴情報の抽出処理と、第2画像20からの特徴情報の抽出処理を別の装置(コンピュータ80)で実施する。例えば、情報処理システムは、抽出部104とを有する映像を解析する複数の端末装置と、それらからの情報を統合して照合処理を行うサーバ装置とを含んでもよい。複数の端末装置はエリア毎に分かれて配備され、抽出部102は、複数の物理的装置によって実現されてもよい。
(4)映像の解析(抽出部102と照合部104)の対象となる特徴情報の種別(顔特徴情報と人領域特徴情報)で別々の装置(コンピュータ80)に分けてもよい。
例えば、上記実施形態では、第1画像10に含まれる人物の人領域から抽出された特徴情報と、検索対象者の第1特徴情報14aとの第1の照合処理、および当該照合処理で一致となった第1画像10の人物の顔領域から抽出された第2特徴情報と登録者の顔特徴情報との第2の照合処理を行っていた。他の実施形態では、第1特徴情報14aと、第2特徴情報とを用いて、照合部102は、第1画像10および第2画像22とは別の第3画像に対して、第1の照合処理および第2の照合処理の少なくともいずれか一方を行わせてもよい。
なお、本発明において利用者に関する情報を取得、利用する場合は、これを適法に行うものとする。
1. 検索対象人物の顔以外を含む領域に関する人領域特徴情報を抽出した第1画像、
前記人領域特徴情報との照合結果が一致となり、かつ、顔領域が検知された第2画像、および
記憶部に記憶されている顔情報と前記顔領域から抽出された顔情報との照合結果を示す結果情報、
のそれぞれを取得する取得手段と、
前記第1画像、前記第2画像、および前記結果情報のうち少なくとも2つを同じ画面に表示させる表示処理手段と、
を備える情報処理装置。
2. 検索対象人物の顔以外を含む領域に関する人領域特徴情報との照合結果が一致となり、かつ、顔領域が検知された第2画像と、
記憶部に記憶されている顔情報と前記顔領域から抽出された顔情報との照合結果を示す結果情報と、を取得する取得手段と、
取得した前記第2画像、および前記結果情報を同じ画面に表示させる表示処理手段と、
を備える情報処理装置。
3. 検索対象人物の顔以外を含む領域に関する人領域特徴情報を抽出した第1画像と、
前記人領域特徴情報との照合結果が一致となった第2画像から抽出された顔情報と記憶部に記憶されている顔情報との照合結果を示す結果情報と、を取得する取得手段と、
取得した前記第1画像、および前記結果情報を同じ画面に表示させる表示処理手段と、
を備える情報処理装置。
4. 1.から3.のいずれか一つに記載の情報処理装置において、
前記取得手段は、複数の前記第2画像を取得し、
前記表示処理手段は、取得した前記複数の第2画像毎に前記結果情報を表示させる情報処理装置。
5. 1.から4.のいずれか一つに記載の情報処理装置において、
前記表示処理手段は、
前記第1画像、前記第2画像、および前記結果情報を同じ画面に表示させる情報処理装置。
6. 1.から5.のいずれか一つに記載の情報処理装置において、
前記表示処理手段は、前記第1画像と前記第2画像とを同じ画面に表示させる、情報処理装置。
7. 6.に記載の情報処理装置において、
前記取得手段は、複数の前記第2画像を取得し、
前記表示処理手段は、複数の前記第2画像の中から少なくとも1つの画像を選択する選択操作を受け付けると、選択された前記第2画像に対する前記結果情報を表示させる情報処理装置。
8. 1.から7.のいずれか一つに記載の情報処理装置において、
特定人物の顔の特徴情報と、当該特定人物の情報とは互いに紐付けて記憶部に記憶され、
前記結果情報は、前記記憶部に記憶されている前記顔の特徴情報との一致度、および前記特定人物の情報の少なくともいずれか1つを含む、情報処理装置。
9. 8.に記載の情報処理装置において、
前記特定人物の情報は、
前記特定人物の顔写真および識別情報の少なくともいずれか1つを含む、情報処理装置。
検索対象人物の特徴を示す人領域特徴情報を生成する際に用いられた第1画像、
前記人領域特徴情報との照合結果が一致となり、かつ、顔領域が検知された第2画像、および
記憶部に記憶されている顔情報と前記顔領域から抽出された顔情報との照合結果を示す結果情報、
のそれぞれを取得し、
前記第1画像、前記第2画像、および前記結果情報のうち少なくとも2つを同じ画面に表示させる、情報処理方法。
11. 情報処理装置が、
検索対象人物の顔以外を含む領域に関する人領域特徴情報との照合結果が一致となり、かつ、顔領域が検知された第2画像と、
記憶部に記憶されている顔情報と前記顔領域から抽出された顔情報との照合結果を示す結果情報と、を取得し、
取得した前記第2画像、および前記結果情報を同じ画面に表示させる、情報処理方法。
12. 情報処理装置が、
検索対象人物の顔以外を含む領域に関する人領域特徴情報を抽出した第1画像と、
前記人領域特徴情報との照合結果が一致となった第2画像から抽出された顔情報と記憶部に記憶されている顔情報との照合結果を示す結果情報と、を取得し、
取得した前記第1画像、および前記結果情報を同じ画面に表示させる、情報処理方法。
13. 10.から12.のいずれか一つに記載の情報処理方法において、
前記情報処理装置が、
複数の前記第2画像を取得し、
取得した前記複数の第2画像毎に前記結果情報を表示させる情報処理方法。
14. 10.から13.のいずれか一つに記載の情報処理方法において、
前記情報処理装置が、
前記第1画像、前記第2画像、および前記結果情報を同じ画面に表示させる情報処理方法。
15. 10.から14.のいずれか一つに記載の情報処理方法において、
前記情報処理装置が、
前記第1画像と前記第2画像とを同じ画面に表示させる、情報処理方法。
16. 15.に記載の情報処理方法において、
前記情報処理装置が、
複数の前記第2画像を取得し、
複数の前記第2画像の中から少なくとも1つの画像を選択する選択操作を受け付けると、選択された前記第2画像に対する前記結果情報を表示させる情報処理方法。
17. 10.から16.のいずれか一つに記載の情報処理方法において、
前記情報処理装置が、
特定人物の顔の特徴情報と、当該特定人物の情報とは互いに紐付けて記憶部に記憶され、
前記結果情報は、前記記憶部に記憶されている前記顔の特徴情報との一致度、および前記特定人物の情報の少なくともいずれか1つを含む、情報処理方法。
18. 17.に記載の情報処理方法において、
前記特定人物の情報は、
前記特定人物の顔写真および識別情報の少なくともいずれか1つを含む、情報処理方法。
検索対象人物の特徴を示す人領域特徴情報を生成する際に用いられた第1画像、
前記人領域特徴情報との照合結果が一致となり、かつ、顔領域が検知された第2画像、および
記憶部に記憶されている顔情報と前記顔領域から抽出された顔情報との照合結果を示す結果情報、
のそれぞれを取得する手順、
前記第1画像、前記第2画像、および前記結果情報のうち少なくとも2つを同じ画面に表示させる手順、を実行させるためのプログラム。
20. コンピュータに、
検索対象人物の顔以外を含む領域に関する人領域特徴情報との照合結果が一致となり、かつ、顔領域が検知された第2画像と、
記憶部に記憶されている顔情報と前記顔領域から抽出された顔情報との照合結果を示す結果情報と、を取得する手順、
取得した前記第2画像、および前記結果情報を同じ画面に表示させる手順、を実行させるためのプログラム。
21. コンピュータに、
検索対象人物の顔以外を含む領域に関する人領域特徴情報を抽出した第1画像と、
前記人領域特徴情報との照合結果が一致となった第2画像から抽出された顔情報と記憶部に記憶されている顔情報との照合結果を示す結果情報と、を取得する手順、
取得した前記第1画像、および前記結果情報を同じ画面に表示させる手順、を実行させるためのプログラム。
22. 19.から21.のいずれか一つに記載のプログラムにおいて、
前記取得手段は、複数の前記第2画像を取得する手順、
前記表示処理手段は、取得した前記複数の第2画像毎に前記結果情報を表示させる手順、をコンピュータに実行させるためのプログラム。
23. 19.から22.のいずれか一つに記載のプログラムにおいて、
前記表示処理手段は、
前記第1画像、前記第2画像、および前記結果情報を同じ画面に表示させる手順、をコンピュータに実行させるためのプログラム。
24. 19.から23.のいずれか一つに記載のプログラムにおいて、
前記表示処理手段は、前記第1画像と前記第2画像とを同じ画面に表示させる手順、をコンピュータに実行させるためのプログラム。
25. 24.に記載のプログラムにおいて、
前記取得手段は、複数の前記第2画像を取得する手順、
前記表示処理手段は、複数の前記第2画像の中から少なくとも1つの画像を選択する選択操作を受け付けると、選択された前記第2画像に対する前記結果情報を表示させる手順、をコンピュータに実行させるためのプログラム。
26. 19.から25.のいずれか一つに記載のプログラムにおいて、
特定人物の顔の特徴情報と、当該特定人物の情報とは互いに紐付けて記憶部に記憶され、
前記結果情報は、前記記憶部に記憶されている前記顔の特徴情報との一致度、および前記特定人物の情報の少なくともいずれか1つを含む、プログラム。
27. 26.に記載のプログラムにおいて、
前記特定人物の情報は、
前記特定人物の顔写真および識別情報の少なくともいずれか1つを含む、プログラム。
Claims (15)
- 検索対象人物の顔以外を含む領域に関する人領域特徴情報を抽出した第1画像、
前記人領域特徴情報との照合結果が一致となり、かつ、顔領域が検知された第2画像、および
記憶部に記憶されている顔情報と前記顔領域から抽出された顔情報との照合結果を示す結果情報、
のそれぞれを取得する取得手段と、
前記第1画像、前記第2画像、および前記結果情報のうち少なくとも2つを同じ画面に表示させる表示処理手段と、
を備える情報処理装置。 - 検索対象人物の顔以外を含む領域に関する人領域特徴情報との照合結果が一致となり、かつ、顔領域が検知された第2画像と、
記憶部に記憶されている顔情報と前記顔領域から抽出された顔情報との照合結果を示す結果情報と、を取得する取得手段と、
取得した前記第2画像、および前記結果情報を同じ画面に表示させる表示処理手段と、
を備える情報処理装置。 - 検索対象人物の顔以外を含む領域に関する人領域特徴情報を抽出した第1画像と、
前記人領域特徴情報との照合結果が一致となった第2画像から抽出された顔情報と記憶部に記憶されている顔情報との照合結果を示す結果情報と、を取得する取得手段と、
取得した前記第1画像、および前記結果情報を同じ画面に表示させる表示処理手段と、
を備える情報処理装置。 - 請求項1から3のいずれか一項に記載の情報処理装置において、
前記取得手段は、複数の前記第2画像を取得し、
前記表示処理手段は、取得した前記複数の第2画像毎に前記結果情報を表示させる情報処理装置。 - 請求項1から4のいずれか一項に記載の情報処理装置において、
前記表示処理手段は、
前記第1画像、前記第2画像、および前記結果情報を同じ画面に表示させる情報処理装置。 - 請求項1から5のいずれか一項に記載の情報処理装置において、
前記表示処理手段は、前記第1画像と前記第2画像とを同じ画面に表示させる、情報処理装置。 - 請求項6に記載の情報処理装置において、
前記取得手段は、複数の前記第2画像を取得し、
前記表示処理手段は、複数の前記第2画像の中から少なくとも1つの画像を選択する選択操作を受け付けると、選択された前記第2画像に対する前記結果情報を表示させる情報処理装置。 - 請求項1から7のいずれか一項に記載の情報処理装置において、
特定人物の顔の特徴情報と、当該特定人物の情報とは互いに紐付けて記憶部に記憶され、
前記結果情報は、前記記憶部に記憶されている前記顔の特徴情報との一致度、および前記特定人物の情報の少なくともいずれか1つを含む、情報処理装置。 - 請求項8に記載の情報処理装置において、
前記特定人物の情報は、
前記特定人物の顔写真および識別情報の少なくともいずれか1つを含む、情報処理装置。 - 情報処理装置が、
検索対象人物の特徴を示す人領域特徴情報を生成する際に用いられた第1画像、
前記人領域特徴情報との照合結果が一致となり、かつ、顔領域が検知された第2画像、および
記憶部に記憶されている顔情報と前記顔領域から抽出された顔情報との照合結果を示す結果情報、
のそれぞれを取得し、
前記第1画像、前記第2画像、および前記結果情報のうち少なくとも2つを同じ画面に表示させる、情報処理方法。 - 情報処理装置が、
検索対象人物の顔以外を含む領域に関する人領域特徴情報との照合結果が一致となり、かつ、顔領域が検知された第2画像と、
記憶部に記憶されている顔情報と前記顔領域から抽出された顔情報との照合結果を示す結果情報と、を取得し、
取得した前記第2画像、および前記結果情報を同じ画面に表示させる、情報処理方法。 - 情報処理装置が、
検索対象人物の顔以外を含む領域に関する人領域特徴情報を抽出した第1画像と、
前記人領域特徴情報との照合結果が一致となった第2画像から抽出された顔情報と記憶部に記憶されている顔情報との照合結果を示す結果情報と、を取得し、
取得した前記第1画像、および前記結果情報を同じ画面に表示させる、情報処理方法。 - コンピュータに、
検索対象人物の特徴を示す人領域特徴情報を生成する際に用いられた第1画像、
前記人領域特徴情報との照合結果が一致となり、かつ、顔領域が検知された第2画像、および
記憶部に記憶されている顔情報と前記顔領域から抽出された顔情報との照合結果を示す結果情報、
のそれぞれを取得する手順、
前記第1画像、前記第2画像、および前記結果情報のうち少なくとも2つを同じ画面に表示させる手順、を実行させるためのプログラム。 - コンピュータに、
検索対象人物の顔以外を含む領域に関する人領域特徴情報との照合結果が一致となり、かつ、顔領域が検知された第2画像と、
記憶部に記憶されている顔情報と前記顔領域から抽出された顔情報との照合結果を示す結果情報と、を取得する手順、
取得した前記第2画像、および前記結果情報を同じ画面に表示させる手順、を実行させるためのプログラム。 - コンピュータに、
検索対象人物の顔以外を含む領域に関する人領域特徴情報を抽出した第1画像と、
前記人領域特徴情報との照合結果が一致となった第2画像から抽出された顔情報と記憶部に記憶されている顔情報との照合結果を示す結果情報と、を取得する手順、
取得した前記第1画像、および前記結果情報を同じ画面に表示させる手順、を実行させるためのプログラム。
Priority Applications (10)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
SG11202106468QA SG11202106468QA (en) | 2018-12-27 | 2018-12-27 | Information processing apparatus, information processing method, and program |
US16/611,121 US11361588B2 (en) | 2018-12-27 | 2018-12-27 | Information processing apparatus, information processing method, and program |
PCT/JP2018/048090 WO2020136795A1 (ja) | 2018-12-27 | 2018-12-27 | 情報処理装置、情報処理方法、およびプログラム |
BR112021011817-9A BR112021011817A2 (pt) | 2018-12-27 | 2018-12-27 | Aparelho de processamento de informações, método de processamento de informações e programa |
EP18945226.1A EP3905188A4 (en) | 2018-12-27 | 2018-12-27 | Information processing device, information processing method, and program |
JP2020562041A JP7238902B2 (ja) | 2018-12-27 | 2018-12-27 | 情報処理装置、情報処理方法、およびプログラム |
CONC2021/0008242A CO2021008242A2 (es) | 2018-12-27 | 2021-06-24 | Aparato de procesamiento de información, método de procesamiento de información y programa |
US17/670,643 US11704933B2 (en) | 2018-12-27 | 2022-02-14 | Information processing apparatus, information processing method, and program |
US17/671,878 US11710347B2 (en) | 2018-12-27 | 2022-02-15 | Information processing apparatus, information processing method, and program |
US17/671,816 US11704934B2 (en) | 2018-12-27 | 2022-02-15 | Information processing apparatus, information processing method, and program |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/JP2018/048090 WO2020136795A1 (ja) | 2018-12-27 | 2018-12-27 | 情報処理装置、情報処理方法、およびプログラム |
Related Child Applications (4)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/611,121 A-371-Of-International US11361588B2 (en) | 2018-12-27 | 2018-12-27 | Information processing apparatus, information processing method, and program |
US17/670,643 Continuation US11704933B2 (en) | 2018-12-27 | 2022-02-14 | Information processing apparatus, information processing method, and program |
US17/671,878 Continuation US11710347B2 (en) | 2018-12-27 | 2022-02-15 | Information processing apparatus, information processing method, and program |
US17/671,816 Continuation US11704934B2 (en) | 2018-12-27 | 2022-02-15 | Information processing apparatus, information processing method, and program |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2020136795A1 true WO2020136795A1 (ja) | 2020-07-02 |
Family
ID=71129363
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2018/048090 WO2020136795A1 (ja) | 2018-12-27 | 2018-12-27 | 情報処理装置、情報処理方法、およびプログラム |
Country Status (7)
Country | Link |
---|---|
US (4) | US11361588B2 (ja) |
EP (1) | EP3905188A4 (ja) |
JP (1) | JP7238902B2 (ja) |
BR (1) | BR112021011817A2 (ja) |
CO (1) | CO2021008242A2 (ja) |
SG (1) | SG11202106468QA (ja) |
WO (1) | WO2020136795A1 (ja) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2022037845A (ja) * | 2020-08-25 | 2022-03-09 | ネイバー コーポレーション | ユーザ認証方法、システム及びプログラム |
JP7435837B2 (ja) | 2018-12-27 | 2024-02-21 | 日本電気株式会社 | 情報処理システム、情報処理装置、情報処理方法、およびプログラム |
Families Citing this family (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP6760318B2 (ja) * | 2018-03-14 | 2020-09-23 | オムロン株式会社 | 顔画像識別システム、識別器生成装置、識別装置、画像識別システム、及び識別システム |
KR20200084395A (ko) * | 2018-12-20 | 2020-07-13 | 삼성전자주식회사 | 영상에서 오브젝트를 인식하는 전자 장치 및 그 동작 방법 |
US11361588B2 (en) * | 2018-12-27 | 2022-06-14 | Nec Corporation | Information processing apparatus, information processing method, and program |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2006013765A1 (ja) | 2004-08-03 | 2006-02-09 | Matsushita Electric Industrial Co., Ltd. | 人物判定装置及び人物検索追跡装置 |
JP2012212217A (ja) * | 2011-03-30 | 2012-11-01 | Secom Co Ltd | 画像監視装置 |
JP2013186546A (ja) * | 2012-03-06 | 2013-09-19 | Tokyo Denki Univ | 人物検索システム |
JP2013196043A (ja) * | 2012-03-15 | 2013-09-30 | Glory Ltd | 特定人物監視システム |
JP2015002547A (ja) | 2013-06-18 | 2015-01-05 | 富士通株式会社 | 画像処理装置、プログラム、および画像処理方法 |
JP2017182210A (ja) | 2016-03-28 | 2017-10-05 | パナソニックIpマネジメント株式会社 | 顔検出装置、顔検出方法及び顔認識システム |
JP2018198056A (ja) * | 2017-05-23 | 2018-12-13 | キヤノン株式会社 | 情報処理装置、情報処理方法及びプログラム |
Family Cites Families (16)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8764742B2 (en) * | 2007-04-04 | 2014-07-01 | St. Jude Medical, Atrial Fibrillation Division, Inc. | Irrigated catheter |
US8705813B2 (en) * | 2010-06-21 | 2014-04-22 | Canon Kabushiki Kaisha | Identification device, identification method, and storage medium |
JP5649601B2 (ja) | 2012-03-14 | 2015-01-07 | 株式会社東芝 | 照合装置、方法及びプログラム |
JP5855501B2 (ja) | 2012-03-22 | 2016-02-09 | 住友重機械工業株式会社 | 冷凍機 |
JP6013241B2 (ja) * | 2013-03-18 | 2016-10-25 | 株式会社東芝 | 人物認識装置、及び方法 |
JP6470503B2 (ja) * | 2014-05-20 | 2019-02-13 | キヤノン株式会社 | 画像照合装置、画像検索システム、画像照合方法、画像検索方法およびプログラム |
US9799539B2 (en) | 2014-06-16 | 2017-10-24 | Lam Research Ag | Method and apparatus for liquid treatment of wafer shaped articles |
CN106874826A (zh) * | 2015-12-11 | 2017-06-20 | 腾讯科技(深圳)有限公司 | 人脸关键点跟踪方法和装置 |
JP6789644B2 (ja) | 2016-03-09 | 2020-11-25 | 株式会社東芝 | 自動改札機 |
JP6961363B2 (ja) * | 2017-03-06 | 2021-11-05 | キヤノン株式会社 | 情報処理システム、情報処理方法及びプログラム |
WO2018161353A1 (zh) * | 2017-03-10 | 2018-09-13 | 华为技术有限公司 | 一种分享照片的方法和装置 |
EP3610410A1 (en) * | 2017-04-14 | 2020-02-19 | Koninklijke Philips N.V. | Person identification systems and methods |
US10885396B2 (en) * | 2017-05-24 | 2021-01-05 | Amazon Technologies, Inc. | Generating composite images using audio/video recording and communication devices |
US11100205B2 (en) * | 2017-11-13 | 2021-08-24 | Jpmorgan Chase Bank, N.A. | Secure automated teller machine (ATM) and method thereof |
US11641563B2 (en) * | 2018-09-28 | 2023-05-02 | Apple Inc. | System and method for locating wireless accessories |
US11361588B2 (en) * | 2018-12-27 | 2022-06-14 | Nec Corporation | Information processing apparatus, information processing method, and program |
-
2018
- 2018-12-27 US US16/611,121 patent/US11361588B2/en active Active
- 2018-12-27 BR BR112021011817-9A patent/BR112021011817A2/pt unknown
- 2018-12-27 SG SG11202106468QA patent/SG11202106468QA/en unknown
- 2018-12-27 EP EP18945226.1A patent/EP3905188A4/en active Pending
- 2018-12-27 JP JP2020562041A patent/JP7238902B2/ja active Active
- 2018-12-27 WO PCT/JP2018/048090 patent/WO2020136795A1/ja unknown
-
2021
- 2021-06-24 CO CONC2021/0008242A patent/CO2021008242A2/es unknown
-
2022
- 2022-02-14 US US17/670,643 patent/US11704933B2/en active Active
- 2022-02-15 US US17/671,878 patent/US11710347B2/en active Active
- 2022-02-15 US US17/671,816 patent/US11704934B2/en active Active
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2006013765A1 (ja) | 2004-08-03 | 2006-02-09 | Matsushita Electric Industrial Co., Ltd. | 人物判定装置及び人物検索追跡装置 |
JP2012212217A (ja) * | 2011-03-30 | 2012-11-01 | Secom Co Ltd | 画像監視装置 |
JP2013186546A (ja) * | 2012-03-06 | 2013-09-19 | Tokyo Denki Univ | 人物検索システム |
JP2013196043A (ja) * | 2012-03-15 | 2013-09-30 | Glory Ltd | 特定人物監視システム |
JP2015002547A (ja) | 2013-06-18 | 2015-01-05 | 富士通株式会社 | 画像処理装置、プログラム、および画像処理方法 |
JP2017182210A (ja) | 2016-03-28 | 2017-10-05 | パナソニックIpマネジメント株式会社 | 顔検出装置、顔検出方法及び顔認識システム |
JP2018198056A (ja) * | 2017-05-23 | 2018-12-13 | キヤノン株式会社 | 情報処理装置、情報処理方法及びプログラム |
Non-Patent Citations (1)
Title |
---|
See also references of EP3905188A4 |
Cited By (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP7435837B2 (ja) | 2018-12-27 | 2024-02-21 | 日本電気株式会社 | 情報処理システム、情報処理装置、情報処理方法、およびプログラム |
US11928181B2 (en) | 2018-12-27 | 2024-03-12 | Nec Corporation | Information processing apparatus, information processing method, and program |
US11934483B2 (en) | 2018-12-27 | 2024-03-19 | Nec Corporation | Information processing apparatus, information processing method, and program |
US11971952B2 (en) | 2018-12-27 | 2024-04-30 | Nec Corporation | Information processing apparatus, information processing method, and program |
JP2022037845A (ja) * | 2020-08-25 | 2022-03-09 | ネイバー コーポレーション | ユーザ認証方法、システム及びプログラム |
JP7125460B2 (ja) | 2020-08-25 | 2022-08-24 | ネイバー コーポレーション | ユーザ認証方法、システム及びプログラム |
Also Published As
Publication number | Publication date |
---|---|
US11704933B2 (en) | 2023-07-18 |
US20220172512A1 (en) | 2022-06-02 |
US20220165090A1 (en) | 2022-05-26 |
BR112021011817A2 (pt) | 2021-08-31 |
SG11202106468QA (en) | 2021-07-29 |
EP3905188A1 (en) | 2021-11-03 |
EP3905188A4 (en) | 2021-12-29 |
CO2021008242A2 (es) | 2021-08-30 |
US20220172513A1 (en) | 2022-06-02 |
US20210312164A1 (en) | 2021-10-07 |
JP7238902B2 (ja) | 2023-03-14 |
US11710347B2 (en) | 2023-07-25 |
US11704934B2 (en) | 2023-07-18 |
JPWO2020136795A1 (ja) | 2021-11-04 |
US11361588B2 (en) | 2022-06-14 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2020136795A1 (ja) | 情報処理装置、情報処理方法、およびプログラム | |
JP4725377B2 (ja) | 顔画像登録装置、顔画像登録方法、顔画像登録プログラム、および記録媒体 | |
KR20200113195A (ko) | 이미지 클러스터링 방법 및 장치, 전자 기기 및 저장 매체 | |
JP4444633B2 (ja) | 画像分類装置、画像分類方法、および、プログラム | |
JP5653131B2 (ja) | オブジェクト認識装置およびその認識方法 | |
CN105706108A (zh) | 用于基于虹膜的生物特征识别的装置和方法 | |
JP2024045460A (ja) | 情報処理システム、情報処理装置、情報処理方法、およびプログラム | |
JP2019185205A (ja) | 情報処理装置、情報処理方法、及びプログラム | |
WO2020115910A1 (ja) | 情報処理システム、情報処理装置、情報処理方法、およびプログラム | |
JP2013069024A (ja) | 画像検索プログラム及び画像検索装置 | |
JP4487247B2 (ja) | 人物画像検索装置 | |
JP5044664B2 (ja) | 人物画像検索装置 | |
JP7371806B2 (ja) | 情報処理装置、情報処理方法、およびプログラム | |
JP2024065888A (ja) | 照合支援プログラム、照合支援方法、および情報処理装置 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 18945226 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 2020562041 Country of ref document: JP Kind code of ref document: A |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
REG | Reference to national code |
Ref country code: BR Ref legal event code: B01A Ref document number: 112021011817 Country of ref document: BR |
|
ENP | Entry into the national phase |
Ref document number: 2018945226 Country of ref document: EP Effective date: 20210727 |
|
ENP | Entry into the national phase |
Ref document number: 112021011817 Country of ref document: BR Kind code of ref document: A2 Effective date: 20210617 |