JP2016051293A - Image collation system, image collation device, image collation method, and computer program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To effectively collect inquiry images that lead to finding of the subject of searching, while suppressing accesses to browse relevant information on the subject of search, to perform collation of the images.SOLUTION: An image collation system and image collation device 10 include: a terminal selection part 110 that selects a user's terminal related to a search event as a selected terminal; a relevant information browsing control part 111 that controls accesses from terminals to browse relevant information on the search event; and a collation processing control part 112 that performs image collation processing when inquiry images are sent from the selected terminal.SELECTED DRAWING: Figure 3

Description

  The present invention relates to an image matching system, an image matching device, an image matching method, and a computer program.

  With aging and increasing number of patients with dementia, the number of people with dementia and elderly people who are hesitant and missing is increasing. Even if a search for a missing person is requested, it often remains missing for many years.

  In recent years, in particular, there are increasing cases of elderly people who are deceived due to dementia being lost, killed, or protected by the police. In addition, there are cases where elderly people died in a railroad crossing accident and the remaining family members are required to pay compensation from the railway company, and the elderly man issue is an economic risk for families.

  Furthermore, as with the number of people with dementia missing, the number of elderly living alone is also increasing, so it can be said that it is difficult to suppress the trap itself.

  In addition, regarding the disclosure of photographs for searching for demented patients who have been missing, family members and relatives have not been able to complete the disclosure of personal information about patients with dementia, and local governments and public organizations are searching for missing persons. If you do, you must disclose your personal information, the face photo of the person you are searching for, and your personal information in order to search for lost persons. There are many cases that are not actively carried out due to consideration.

  This may be embarrassed for people with dementia and their families to be embarrassed that a third party other than their relatives knows that there is a senior citizen in their relatives. For this reason, photos, names, addresses, etc. Is not published, making it more difficult to find missing persons with dementia.

  Furthermore, even if a child or pet is missing, it is not a system that can obtain the cooperation of local governments and citizens, and requests are made to search for police, create posters, and search for specialists. However, there is an inconvenience that the effect is not so much improved.

  In addition, a system for finding search subjects who are lost or lost by putting information terminals such as communication tags on pets such as elderly people with dementia, children, and dogs, and embedding communication tags in the body is disclosed. ing.

  However, in such a system, since a communication tag or a terminal must be worn on the body or worn at all times, it is difficult to apply it particularly to elderly people with dementia. Moreover, it is psychologically difficult to embed outgoing tags in the body.

  As a related technology for these issues, a system for searching for an elderly person who is lost by a search object (pet, child, elderly person) who has lost his / her position from image data with location information photographed by a mobile phone camera or the like is disclosed. (Patent Document 1).

  In addition, as a related technique, a person searching for a lost child or a lost person searches an information database by specifying an image for a search target, and if an image with a high degree of matching exists, A system for displaying a position where a photograph is taken on a map is disclosed (Patent Document 2).

JP2011-239442A JP 2011-180893 A

  However, in the related technique described in the above-mentioned Patent Document 1, since many elderly people who are obsessed are walking pronely, a system using a fixed-point camera can acquire captured images and videos applicable to image matching. There is an inconvenience that it is difficult to perform image collation with appropriate accuracy.

  Moreover, in the related technique described in the above-mentioned Patent Document 2, it is necessary to completely publish a photograph of a search target person or a lost person (a pet such as a lost dog). When the inquiry images are collected by using them, there may be a problem that a large number of photographs unrelated to the disappeared persons sent by an unspecified number of third parties are sent. Further, in this case, there may be a disadvantage that the processing load related to the image search increases unnecessarily.

  Furthermore, in this related technology, when publishing photos of a lost person, it is not possible to publish it only to those who have some degree of involvement, so a large number of photos unrelated to the lost person are sent. This may hinder the search, and may cause inconveniences such as a photo of the lost person and public personal information being viewed by a third party.

[Object of invention]
The present invention has been made in view of the above problems, and an image matching system that effectively collects query images that lead to discovery of a search target and performs image matching while suppressing browsing access to related information of the search target , An image collation device, and a computer program.

  In order to achieve the above object, an image collation system according to the present invention performs an image collation process between an inquiry image, which is image data sent from a terminal via a network, and an accumulated image, which is image data stored in advance. An image matching system including a matching device and a related information storage unit that holds event-related information corresponding to each search event that requires the image matching processing, wherein the image matching device is a user associated with each search event. A terminal selection unit that selects a part of terminals corresponding to the selection terminal, a related information browsing control unit that performs control to allow browsing access to the event related information by the selection terminal, and the inquiry from each of the selection terminals A collation processing control unit that executes the image collation processing when an image is sent.

The image collation apparatus of the present invention has a related information storage unit that holds event-related information corresponding to each search event that requires image collation processing, and an inquiry image that is image data sent from a terminal via a network; An image matching apparatus that performs an image matching process with previously stored image data, wherein a terminal selection unit that selects a part of terminals corresponding to each user associated with the search event as a selection terminal; A related information browsing control unit that performs control to allow browsing access to the event related information, and a verification processing control unit that performs control to execute the image verification processing when the inquiry image is sent from each selected terminal. It is characterized by that.

Further, the image matching method of the present invention holds event related information corresponding to each search event that requires image matching processing, and an inquiry image that is image data sent from a terminal via a network and an image stored in advance. An image matching method for performing image matching processing with data,
A part of terminals corresponding to users related to the search events is selected as a selection terminal, and the selection terminal performs control to allow browsing access of the event related information by the terminal selected, and the selection terminals The image matching process is executed when the inquiry image is sent from.

  Further, in the present invention, event related information corresponding to each search event that requires image collation processing is held, and image collation between an inquiry image that is image data sent via a network and image data stored in advance is performed. A computer program to be executed by a computer included in an image collating device to perform, a selection terminal determination function for selecting a part of terminals corresponding to a user related to each search event as a selection terminal, and the above-mentioned thing by the selection terminal A related information browsing control function for performing control to allow browsing of the elephant related information, and a matching processing control function for executing the image matching processing when the inquiry image is sent from the terminal selected by each selected terminal. A computer program is provided.

  According to the present invention, it is possible to collect an inquiry image that can be used for finding a search target for image verification while suppressing information on the search target from being viewed by a third party. A collation system, an image collation apparatus, an image collation method, and a computer program can be provided.

It is the schematic which shows an example of the image collation system which concerns on Embodiment 1. FIG. 1 is a schematic diagram illustrating an internal configuration of an image collating device according to a first embodiment. It is the schematic which shows the functional block structure of the image collation apparatus of Embodiment 1. FIG. FIG. 6 is a table diagram illustrating an example of an allowable operation of a terminal in the first embodiment. It is the schematic which shows an example of the image collation system as a modification of Embodiment 1. FIG. 3 is a table diagram illustrating an example of terminal setting types according to the first exemplary embodiment. It is a flowchart which shows the operation | movement process step which concerns on the terminal in the image collation system disclosed in FIG. It is a flowchart which shows the whole operation | movement process step in the image collation system disclosed in FIG. FIG. 3 is a table diagram illustrating an example of terminal setting types according to the first exemplary embodiment. FIG. 10 is an explanatory diagram of an image matching process for a face image in the second embodiment. FIG. 10 is an explanatory diagram illustrating an example of an image matching processing procedure in the image matching system according to the second embodiment.

  Hereinafter, the basic configuration content of the embodiment of the present invention will be described. In all the drawings, the same components are denoted by the same reference numerals, and description thereof will be omitted as appropriate.

[Embodiment 1]
FIG. 1 is a simplified diagram of the entire image matching system 100.
As shown in FIG. 1, the image matching system 100 includes an image matching apparatus 10 connected to a plurality of different communication terminals (hereinafter referred to as “terminals”) 99a, 99b, 99c, and 99d via a network 1, and an image matching process. And a related information storage unit 12 for holding search event related information set in advance corresponding to a search event that requires a search event.

  In addition, the image matching device 10 includes a terminal selection unit 110 that selects a part of terminals corresponding to the users related to each search event as a selection terminal, and a terminal selected as the selection terminal (here, “99a”). The related information browsing control unit 111 that performs control for permitting browsing access to the event related information, and an image matching process between an inquiry image that is image data sent from the terminal 99a and a stored image that is image data stored in advance. A collation processing control unit 112 is included.

  In addition, as a search event in the present embodiment, for example, it is assumed that an elderly person with dementia has disappeared and is missing. For this reason, as event-related information, in addition to the face photo of the lost elderly person who is the subject of the search, personal information such as name, age, address, gender, height, and the name of the person or family who made the search request , Address, phone number, etc. In addition, information indicating a place where a search event has occurred, that is, lost, and information necessary for searching are shown.

  The collation processing control unit 112 also compares the inquiry image, which is image data sent from each of the terminals 99a, 99b, 99c, and 99d, and the accumulated image as the image data stored in the accumulated image storage unit 13 in advance. Perform image matching processing.

  The terminal selection unit 110 is a terminal 99a (corresponding to some terminals) that is a terminal corresponding to a preset related person (search target person) such as an acquaintance of a search target (search target person), a family, or a related person. Is elected.

  In addition, when a search event occurs, the terminal selection unit 110 receives a search request message sent from the search requester to the image matching device 10, and stores information such as event contents as event related information (search event related Information).

  In addition, the terminal selection part 110 determines as a selection terminal based on the content of each search event, for example, when the search object of a search event is a pet dog, a dog owner, It is assumed to indicate portable terminals of parties who are registered in advance, such as family members, pet search volunteers, and the like.

  In addition, since the related information browsing control unit 111 controls the browsing access to the related information to be searched, in the first embodiment, the related information of the elderly who has been missing from the terminal 99a that is the selected terminal. When there is browsing access to, control is performed to permit this browsing access.

  Thereby, the user of the terminal 99a can browse the information of the elderly person who has gone missing and information (search event information) related to the current disappearance using the terminal 99a.

  As described above, in the first embodiment, the browsing with respect to the related information (search target information) of the generated search event is related to the related parties (search target related persons) and the search related to the search target. Permits only for search personnel such as police and volunteers. For this reason, it is possible to effectively collect inquiry images that are likely to lead to discovery of the search target and to perform image matching while suppressing the search target information from being browsed mischievously.

  Further, when an inquiry image is sent from the terminal 99a set as the selected terminal, the verification processing control unit 112 uses the inquiry image as a verification target (registered image) and stores different verification images stored in the accumulated image storage unit 13. Image collation processing for calculating a collation score indicating the degree of similarity with each of them is performed.

  When the collation score exceeds a certain value, the collation processing control unit 112 extracts an image that has been collated successfully with respect to the inquiry image from the accumulated image.

  The network 1 is composed of various computer networks such as the Internet and a LAN (Local Area Network) or a combination thereof. Further, it is assumed that the terminals 99a to 99d (generally referred to as “terminal 99” hereinafter) and the image collating apparatus 10 are connected to the network 1 by wired or wireless communication.

  Further, as shown in FIG. 2, the image collating apparatus 10 in this embodiment includes a storage unit 23 as a secondary storage unit such as a hard disk drive for storing and holding computer programs and digital data, and a CPU (Central Processing Unit). And a main control unit that performs processing based on a computer program stored in the storage unit 23 and a communication unit that controls data communication with the network 1 including the communication interface of the image collating apparatus 10 for the network 1 The various functions in each functional block in the image collating apparatus 10 shown in FIG. 3 are realized by the functional operation in the computer.

  Hereinafter, the functional operation of each functional block in the image collating apparatus 10 will be described in detail with reference to FIG.

  The related information browsing control unit 111 of the image matching device 10 makes a part of event related information (hereinafter referred to as “partially disclosed information”) preset in the event related information corresponding to the generated search event in a viewable state. It has a function to set (partial disclosure setting function).

  Specifically, the related information browsing control unit 111 is a part that indicates some event related information set in advance, such as gender, age, height, and face photo, among the attribute information of the search target person that is search event related information. The disclosure information is set to a browsable state.

  In addition, the terminal selection unit 110 is a terminal (hereinafter referred to as “partial”) that allows the browsing of partial disclosure information on each terminal of a search event requester (search requester) and a target related person related to a search target. (Referred to as “access-permitted terminal”) (partial access terminal selection function).

  In addition, the terminal selection unit 110 performs a partial access in which the browsing of the partial disclosure information is permitted for each terminal (here, the terminal 99b) of the request related to the search event and the target related person related to the search target. Select as permitted terminal (partial access terminal selection means).

  At this time, the collation processing control unit 112 executes image collation processing on the inquiry image sent from the terminal 99b set as a partial access permitted terminal.

  It should be noted that the contents of the partial disclosure information are selected and designated in advance by the requester of the search event. Further, the collation processing control unit 112 is configured such that the inquiry image sent from a terminal set as a partial access-permitted terminal (here, “99b”) is partially permitted by the terminal that transmitted the inquiry image. Only when the terminal is set, the image matching process is executed.

  In addition, the above-mentioned partial access terminal selection function requests a search for the lost search target person as the search event requester (search requester) and the target related person determined to be related to the search target. Pre-registered persons (search target related) who have an exchange relationship with the search target person, such as the search requester, the circle friend of the search target person, and the terminal user who is connected via the SNS (social network service) Person).

  Here, the terminal 99b associated with each person to be searched is selected as a partial access permission terminal that is permitted browsing access to partial disclosure information.

  Thereby, the terminal 99b can perform browsing access to preset partial disclosure information among the related information (search event related information) of the search target person stored in the related information storage unit 12. .

  Here, as part of the disclosure information, search subject attribute information such as gender, age, height, face photo, address, etc., which is a part of search event related information, or a combination of these information can be set. .

  Thereby, the image verification device 10 collects search image information (inquiry image) for image verification without exposing the personal information (personal name, etc.) of the search subject to a third party other than the related parties. It becomes possible.

  Furthermore, the image collation apparatus 10 includes a meta information collection unit 113 that collects meta information including information indicating the shooting position and shooting date and time of the inquiry image from the inquiry image.

  Further, when there is a terminal (here, referred to as a terminal 99c) that has taken a query image within a certain area set based on the collected meta information, the terminal selection unit 110 selects the terminal 99c. Selected as a search cooperation terminal.

  At this time, it is assumed that the collation processing control unit 112 performs control to execute the image collation processing on the inquiry image sent from the terminal 99c that is the search cooperation terminal.

  In addition, the terminal selection unit 110 receives a request for participation in the search event that has occurred from the terminal 99c in a state before being selected as a search cooperation terminal (referred to as “general terminal”) to the image collation device 10. The terminal 99c may be set to be registered as a search cooperation terminal (search cooperation terminal registration means).

  Thereby, as shown in FIG. 4, the terminal selection unit 110 classifies the types of the terminals connected via the network into a selected terminal, a partial access permission terminal, a search cooperation terminal, and a general terminal.

  Note that FIG. 4 shows that the selected terminal is permitted browsing access to all search event related information of the corresponding search event, and some access-permitted terminals are part of the search event related information of the corresponding search event. This indicates that browsing access to the disclosed information is permitted. Further, it is indicated that the search cooperation terminal and the general terminal are not permitted to browse the search event related information.

  Further, in FIG. 4, with respect to the image matching process of the inquiry image, the image by the matching process control unit 112 is only applied to the inquiry image sent from the terminal set as the selected terminal, the partial access permission terminal, and the search cooperation terminal. It is shown that the verification process is performed.

  Note that the type settings of the terminals 99a to 99d are managed by table information included in the terminal selection unit 110, as shown in FIG.

  Further, in FIG. 6, in response to a specific search event, the terminal 99a is introduced as a selection terminal, the terminal 99b is partially access-permitted terminal, the terminal 99c is introduced as a search cooperation terminal, and the terminal 99d is installed with an inquiry image transmission application. It is shown that each is set to a general terminal that is not.

  The terminal selection unit 110 uses a terminal identification number (such as МAC address) to generate a terminal type management table (FIG. 6) and manage terminal type settings. Accordingly, the terminal selection unit 110 may be configured to record and manage the variation in the number of terminal types, the number of terminals, and the like.

  When each terminal 99a to 99d is installed as a general terminal, when it installs an inquiry image capturing / transmission application for search, it sends a request for participation in the search event to the image collating device 10. Shall be transmitted.

  Thereby, the terminal 99 changes the classification setting from the general terminal to the search cooperation terminal by installing the inquiry image transmission application in itself.

  In addition, when the search event occurs within a certain distance from the point where the terminal 99c set as the search cooperation terminal has taken the image, the image verification device 10 displays event occurrence information indicating that the search event has occurred. An event information notification unit 114 that notifies each terminal set as a search cooperation terminal including the terminal 99c is provided.

  In addition, the event information notification unit 114 may notify the browsing permission information indicating that browsing access to the partial disclosure information is permitted to each terminal set in advance as the partial access permission terminal.

  As a result, the event information notifying unit 114 indicates that a search event that requires a search has occurred in a nearby area for the user of the selected terminal and a part of the access-permitted terminal, and the search target person of the search event It can be notified that a part of the related information is disclosed.

  In addition, the terminal selection unit 110, when the number of times that the image matching process of the inquiry image transmitted from the terminal set as the search cooperation terminal (for example, 99c) has succeeded exceeds a predetermined number of times, the terminal 99c The search cooperation terminal that is in the set state may be set as a partial access permission terminal.

  Further, the terminal selection unit 110, based on the shooting position of the inquiry image that has been successfully image-matched, if there is a search cooperation terminal that has shot the inquiry image in an area within a certain distance from this shooting position, this search cooperation You may set a terminal as a partial access permission terminal.

  Here, when a plurality of different terminals that have taken an inquiry image within a certain range and within a certain time width are detected, all of the terminals are set as partial access-permitted terminals.

  The terminal selection unit 110 selects and sets the terminal 99c as a partly access-permitted terminal when the image matching of the inquiry image sent from the terminal set as the search cooperation terminal (here 99c) is successful. Good.

  Thereby, a part of search object person information can be disclosed with respect to the terminal (search cooperation terminal) with a high commitment with respect to the image collation system of this embodiment. For this reason, it is possible to effectively increase the possibility that the search cooperation terminal user captures an image that leads to the discovery of the search target person.

  Further, the related information browsing control unit 111 may be configured to generate a password required when a terminal (for example, 99b) set as a partial access-permitted terminal browses partially disclosed information.

  At this time, the event information notification unit 114 notifies the terminal 99b of browsing permission information indicating that browsing access to some disclosure information is permitted. The browsing permission information notified here is in a URL (Uniform Resource Locator) format, for example, and is displayed on the display screen of the terminal 99b.

  At this time, when the user of the terminal 99b taps (or clicks on) the browsing permission information as link information, a browsing access request is transmitted, whereby the terminal 99b sends a related information browsing control unit 111 to the browsing information. Thus, the setting may be such that browsing access to the corresponding partially disclosed information is performed.

  At this time, the related information browsing control unit 111 determines whether or not the browsing access request is transmitted when the browsing permission information is tapped based on the request type information included in the received browsing access request. Can be determined.

  Here, when the browsing access request is transmitted by an input operation (tap input) based on browsing permission information, the related information browsing control unit 111 determines that the preset password authentication is successful.

  Thereby, the user of the partial access permission terminal can perform browsing access to the partial disclosure information by a simple operation of tapping (clicking input) the link information displayed on the display screen of the terminal. It becomes possible.

  In addition, in the related information browsing control unit 111, when it is detected that the browsing access that has been sent is transmitted by an input operation (tap, click) on the link information, the set password authentication process has been successful It is determined that the access is permitted to allow browsing access.

Thereby, the user of a partial access permission terminal can perform browsing access to partial disclosure information, without performing the password input with respect to a terminal in which an erroneous input is easy to occur.
Note that the password set here may be a one-time password that is invalidated at regular intervals.

  This also allows browsing permission information, partial disclosure information with a password, and the like to be sent to a terminal (general terminal) in which a dedicated application for inquiry image transmission is not installed. For this reason, it is possible to provide information related to the search event even to a terminal that uses a terminal that wants to see temporary disclosure information but cannot install a dedicated application.

The browsing access password generation unit 117 may be configured to generate a password for each accessible partial disclosure information.
As a result, for example, even when the partial disclosure information that can be browsed and accessed by the partial access permission terminals e and f is different, the passwords associated with the different partial disclosure information are transmitted to different terminals (for example, 99c and d). Thus, the terminals 99c and 99d can perform browsing access to the partial disclosure information set as different combinations.

  As described above, in the first embodiment, the subject of the search for the elderly person or the lost person (pet such as a lost dog) is limited and the photograph of the lost person is related to some extent. It can be released only to people.

  In addition, while effectively suppressing the accidental browsing of photos and public information of the lost person by third parties, searchers who are likely to lead to the discovery of the lost person Collection is possible by using a terminal (smartphone application).

[Description of Operation of First Embodiment]
Next, the outline of the operation content of the first embodiment will be described.

  First, the terminal selection unit 110 selects a part of terminals corresponding to users related to each search event as a selection terminal (selected terminal determination function), and then an event by the terminal 99a in which the related information browsing control unit 111 is selected as the selection terminal Control is performed to allow browsing access to related information (related information browsing control function). Next, when an inquiry image is sent from the selected terminal 99a to the selected terminal, the collation processing control unit 112 performs this inquiry image Image collation processing is executed (collation processing control function).

  Here, the selected terminal determination function, the related information browsing control function, and the collation processing control function may be configured such that the execution contents are programmed and executed by a computer.

  Next, the operation content of the image collation system 100 according to the present embodiment will be described with reference to the flowcharts of FIGS.

  FIG. 7 shows an operation when determining the setting of each terminal 99 connected to the network 1. Here, it is assumed that event related information is stored in the related information storage unit 12 as related information search event related information corresponding to the generated search event.

  Here, the operation of selecting the terminal 99a as the selected terminal will be described (S151 to S152).

  First, a search event occurs. Next, the terminal selection unit 110 registers a terminal of a related party (target related party) set in advance as a selection terminal corresponding to the search target in the generated search event (S151). Here, the terminal 99a is registered as a selected terminal.

  Next, the related information browsing control unit 111 notifies the terminal 99a that a search event has occurred and that the user of the terminal 99a is a search target related person (S152).

At this time, the related information browsing control unit 111 may generate browsing permission information indicating that browsing access to the search event related information is permitted and notify the terminal 99a of the browsing permission information.
The browsing permission information may be a URL indicating a browsing access destination to the browsing permission information.

  As a result, the terminal 99a performs browsing access to the search event disclosure information by tapping (or clicking) a URL (link information) as a part of the browsing permission information output on the display screen.

An authentication password may be set for access to search event related information.
In this case, when the terminal 99a performs browsing access to the search event disclosure information via the notified browsing permission information, that is, when the terminal 99a user taps on the link information on the display screen, the browsing is performed. When access is performed, the related information browsing control unit 111 determines that the password authentication process has been successful, and performs control to allow browsing access from the terminal 99a.

  Thereby, the image collation apparatus 10 is set to a state waiting for an inquiry image to be sent. Here, when an inquiry image is sent from the terminal 99a via the network 1, the matching processing control unit 112 performs an image matching process on each of the query images sent from different terminals 99.

Thereby, the terminal 99a can perform browsing access to all the search event related information related to the search target person of the search event.
For this reason, when there is browsing access from the selected terminal (for example, the terminal 99a) for the search event related information (related information to be searched), control is performed to allow this.

  Next, as shown in FIG. 9, the operation content until the terminal 99b set in advance as a search cooperation terminal is set as a partial access permission terminal will be described.

First, when a search event that requires image verification occurs, the image verification device 10 is notified of the event content of the search event.
Here, the terminal selection unit 110 sets a preset user terminal such as a family to be searched or a related person as the selection terminal (S151).

  Next, the event information notification unit 114 notifies the terminal 99a, which is the selection terminal set corresponding to the search event, that the corresponding search event has occurred (S152: the search event has occurred). Notification).

  In addition, when the event content of the search event is notified, the related information browsing control unit 111 of the image matching device 10 browses the preset partial disclosure information among the event related information corresponding to the generated search event. A possible state is set (S161: partial disclosure information is set to a viewable state).

Here, the terminal selection unit 110 selects the terminal 99b as a target related person related to the search target as a partial access permission terminal (S162: selection of a partial access permission terminal).
Thereby, in the terminal selection part 110, the terminal 99b is registered as a partial access permission terminal in which browsing with respect to partial disclosure information was permitted.

  Next, the event information notification unit 114 indicates that the corresponding search event has occurred and the browsing access to the partial disclosure information is permitted for the terminal 99b which is the set partial access permission terminal. Browsing permission information is notified (S163: Notifying that some disclosure information can be browsed).

At this time, the related information browsing control unit 111 may be configured to generate browsing permission information indicating that browsing access to partial disclosure information is permitted and notify the terminal 99b of the browsing permission information.
Further, this browsing permission information may be a URL or the like indicating a browsing access destination of partially disclosed information.

Thereby, in the terminal 99b, browsing access to partial disclosure information is performed by the user tapping (clicking input) a URL (link information) as a part of the browsing permission information output on the display screen. .
Note that an authentication password may be set in advance for browsing access to some disclosure information.

  In this case, the terminal 99b can perform browsing access to the search event disclosure information via the notified browsing permission information. That is, browsing access is performed when the user of the terminal 99b taps the browsing permission information as the link information on the terminal 99b display screen.

  At this time, the related information browsing control unit 111 determines that the password authentication process has been successful, and performs control to permit browsing access to the partially disclosed information from the terminal 99b.

  At this time, collation process control part 112 will be in the state where it waits for an inquiry picture to be sent from terminal 99b set as a partial access permission terminal (S180).

Next, an operation in which the terminal selection unit 110 of the image matching device 10 sets the terminal 99c as a search cooperation terminal will be described.
First, the user of the terminal 99c installs an application for photographing / transmitting an inquiry image (hereinafter referred to as “search image inquiry application”) on the terminal 99c (S171: terminal application installation).

  In the process in which the terminal 99c installs the search image inquiry application, information indicating a request for participation in search cooperation for the search event (hereinafter referred to as “participation request”) is sent from the terminal 99c to the image collation apparatus 10 (S172: Search participation request).

  Next, the terminal selection unit 110 registers the terminal 99c as a search cooperation terminal in response to the participation request sent from the terminal 99c (S173: registration in the search cooperation terminal). Thereby, a general terminal and a search cooperation terminal are distinguished.

  Here, the setting may be such that the registration as the search cooperation terminal is completed and notified to the terminal 99c as the search cooperation terminal. In this case, for the inquiry image sent to the image matching device 10 from the terminal 99c set as the search cooperation terminal, the image matching processing by the matching processing control unit 112 is performed.

  Here, the image matching device 10 is set to a state (waiting for an inquiry image) waiting for an inquiry image to be sent via the network 1 (S180).

  Next, an operation in which an inquiry image is sent from each terminal 99 to the image matching device 10 and image matching processing is performed will be described based on the flowchart of FIG.

  Here, the users of the terminal 99a set as the selected terminal, the terminal 99b set as a partly access-permitted terminal, and the terminal 99c set as the search cooperation terminal use the terminals a, b, and c, respectively. Then, a photograph of an elderly person who is considered to be searched is photographed, and an inquiry image that is the photographed image is transmitted to the image collating device 10 for image collation (S181: photographing / transmission of inquiry image).

  Here, the meta information collection unit 116 collects meta information including the shooting position and the shooting time in each inquiry image sent from each of the terminal 99a, the terminal 99b, and the terminal 99c (S182: acquisition of meta information).

  Here, the meta information collection unit 116 analyzes the meta information sent from the terminal 99c, and whether the transmission source terminal of the inquiry image is any one of the selected terminal, the partial access permission terminal, or the search cooperation terminal. It is determined whether or not (S183: source terminal type determination). Here, it is assumed that the transmission source is the search cooperation terminal 99c.

  Here, when it is confirmed that the transmission source terminal is any one of the selection terminal, the partial access permission terminal, or the search cooperation terminal, the verification processing control unit 112 performs the 99c image verification process on the inquiry image. Execute (S184: Image collation process).

  Here, the verification processing control unit 112 informs the transmission source terminal of the inquiry image (here, the terminal 99c) that there is a high possibility that the person shown in the inquiry image is a search target person (referred to as “matching success”). (S185: Notify the success of collation).

  Here, the collation success is specifically determined as collation success when the degree of matching between the inquiry image and the face photo to be searched exceeds a predetermined value in advance (collation success). As a result, it is determined that the person shown in the inquiry image has a high possibility of being a search target person.

  At this time, the terminal selection unit 110 sets the terminal 99c that has captured the inquiry image that has been successfully verified as a partial access-permitted terminal (S186: set as a partial access-permitted terminal).

  As a result, since the terminal 99c is set as a partly access-permitted terminal, the event information notifying unit 114 generates a corresponding search event for the terminal 99c that is a partly access-permitted terminal, as in S163. And browsing permission information indicating that browsing access to the partial disclosure information is permitted (notification that partial disclosure information can be browsed).

  Thereby, the terminal 99c user is notified that the temporary disclosure information can be browsed. For this reason, it becomes possible for the user of the terminal 99c to photograph a person who seems to be a search target person with more certainty.

Note that the terminal 99c can browse part of the disclosed information.
The terminal 99c set as the partial access permission terminal performs browsing access to the partial disclosure information via the notified browsing permission information.

  Here, the related information browsing control unit 111 detects that the browsing access request sent from the terminal 99c is sent by tap input for the request type information.

  For this reason, the related information browsing control unit 111 determines that the password authentication set in the partial disclosure information is successful, and allows browsing access from the terminal 99c.

  Next, it is assumed that the partially disclosed information that can be browsed is, for example, gender and age (gender: male, age: 88 years), and a face photograph. As a result, the user of the terminal 99c can take a picture of a person who is considered to be searched using the browsed partial disclosure information as a clue (to S181).

  As described above, in the first embodiment, the browsing access to the related information (search target information) is limited to the related person (search related person) related to the search event. Therefore, it is possible to effectively collect inquiry images that are likely to lead to discovery of the search target and to perform image matching while suppressing the search target information from being browsed unnecessarily.

[Configuration of Modified Example of Embodiment 1]
Next, as a modification of the first embodiment, as shown in FIG. 5, as shown in FIG. 5, an image matching system 200 provided with a short-range wireless communication device 50 that is installed connected to a network and wirelessly detects a terminal by short-range wireless communication. Will be described.

  The image matching system 200 has a configuration in which the short-range wireless communication device 50 is connected to the network 1 of the first embodiment by wire connection. In this modification, as shown in FIG. 5, a network in which the short-range wireless communication device 50 is connected by wire is referred to as a network 2.

The short-range wireless communication device 50 is installed by wire connection to the network 2 and wirelessly detects a terminal (for example, 99d) located within a certain distance from the set position.
Here, when the terminal 99d located within a certain distance is a partly access-permitted terminal, the event information notification unit 114 detects this via the short-range wireless communication device 50, and the terminal 99d Notify browsing permission information.

  Note that the short-range wireless communication device 50 is installed and operated in, for example, a convenience store. As a result, the short-range wireless communication device 50 detects the terminals (99a to 99d) located within a circle having a radius of several meters centered on itself by short-range wireless communication.

  The short-range wireless communication device 50 is installed in a commercial facility such as a convenience store or a public facility, and performs wireless communication using BLE (Bluetooth (registered trademark) Low Energy). Specifically, it communicates with a smartphone on which a specific application is operating using BLE.

  Further, it is assumed that the short-range wireless communication device 50 is installed in a public place such as a store or a government office while being connected to the Internet (network 2). Here, the short-range wireless communication device 50 detects terminals (for example, 99a to 99d) by short-range wireless communication.

  In addition, the short-range wireless communication device 50 detects a partial access permission terminal or a search cooperation terminal located within a certain distance (referred to as a “short-range wireless area”) from its installation location.

  Since the short-range wireless communication device 50 can measure the positional relationship (distance) between itself and the terminal 99, different notifications, data, and the like are given to the terminal 99 according to the measured positional relationship. Can be sent.

  In addition, when a search event occurs within an event region distance longer than the terminal detection distance of the short-range wireless communication device 50, the short-range wireless communication device 50 that wirelessly detected the search cooperation terminal (terminal 99d) The setting which notifies the search cooperation terminal of the information which shows that the search event notified from 114 generate | occur | produced within the event area | region distance may be sufficient.

  Note that the event area distance indicates, for example, several kilometers from the installation point of the short-range wireless communication device 50.

  In addition, the short-range wireless communication device 50 is configured to detect when the terminal 99d is located in a range of several meters from itself and perform push notification of information such as a password to some disclosure information. There may be.

[Embodiment 2]
Next, a second embodiment having a configuration for collecting image data stored in another server computer system as an accumulated image and an inquiry image for the image collating apparatus 10 according to the first embodiment will be described.

  The image collation apparatus 10 according to the second embodiment includes a face image data collection unit 120 that extracts and collects face images (face images for collation) including face regions such as people, dogs, and cats included in the image data, Using the set front face image to be searched as a reference registration image, the reference registration image and the collected face image for verification are compared, and the partial similarity to the reference registration image in each of the verification face images A partial similarity calculating unit 121 that calculates a matching score and a partial similar image determining unit 123 that stores a face image with a matching score exceeding a certain value as an accumulated image are provided.

  Here, the partial similar image determination unit 123 accumulates the face image including the face area when the partial similarity in the face area calculated for the matching face image and the reference registered image exceeds a predetermined ratio. Stored and saved in the image storage unit 13.

  That is, the image collation apparatus 10 according to the second embodiment is attached to the internal configuration of the image collation apparatus 10 according to the first embodiment shown in FIG. 3, and the face image data collection unit 120, the partial similarity calculation unit 121, and the partial similarity. The difference from the first embodiment is that an image determination unit 123, an inquiry face image collection unit 124, and a related user face image collection unit 125 are provided.

Hereinafter, the internal configuration of the image collating apparatus 10 according to the second embodiment will be described in detail.
The face image data collection unit 120 collects collation images as face images including face regions of humans, dogs, cats, and the like by searching for websites and blogs on the Internet.

  The face image data collection unit 120 performs face detection processing on each image, and determines a face area in the image when a face area is detected. Further, the face image data collection unit 120 may include a function (face feature point detection function) for obtaining facial feature points such as eyes, nose, and mouth edge in the face area in each face image.

  As a result, the position and size of the face area can be normalized for the matching process based on the obtained feature point positions, so that the accuracy of the matching process in the partial similarity calculation unit 121 can be effectively improved. .

In the partial similarity calculation unit 121, a front face image to be searched that is registered in advance is stored as a reference registration image (master image (M)).
The partial similarity calculation unit 121 calculates the partial similarity of the face area in each of a plurality of different collation images based on the master image (M).

  By the way, the face image collected as the collation image includes a posture variation image in which a face feature point is missing due to illumination variation or partial occlusion or is not facing the front.

  These collation images may be accompanied by a change in posture, illumination, facial expression, and secular change as compared with the reference registration image. In this case, the collation performance is deteriorated.

  For this reason, the partial similarity calculation unit 121 estimates and renders the three-dimensional shape of the face region in the face image, or generates an image with different illumination conditions, and based on this, the matching score in each face image is obtained. calculate. Further, a matching score may be calculated by extracting a local feature from the face area of the face image and quantifying the feature.

  When the target is a dog or a cat, the matching score is calculated based on the feature of the nose pattern in the reference registration image. In this case, the setting may be such that the color or size of the search target is estimated based on the size of the object reflected in the image to detect the dog breed or cat breed.

  Here, the partial similarity refers to a matching score of similarity in a characteristic part in the face area in the registered image and the matching image.

  When the collation score value is higher than a certain value, the partial similar image determination unit 123 determines that the person in the face area in the reference registered image and the collation image is the same person, that is, the person in the collation image is the person in the registration image. At this time, the partial similar image determination unit 123 stores the collation image in the accumulated image storage unit 13 as an accumulated image.

  As a result, the image collation apparatus 10 according to the second embodiment can perform face collation with high accuracy even for face images with posture fluctuations and illumination fluctuations, and thus face photographs from various angles as face images of the search target person. (Face images) can be collected and stored as accumulated images, and furthermore, the collation accuracy in the image collation processing executed by the collation processing control unit 112 can be effectively improved.

  In addition, the image collation apparatus 10 according to the second embodiment collects a face image that is image data including a face area stored on the web, and on the web after occurrence of a search event based on meta information in the face image. An inquiry face image collection unit 124 that selects and obtains public face images is provided.

  Here, it is assumed that the collation processing control unit 112 performs image collation processing using the acquired face image as an inquiry image.

  The inquiry face image collection unit 124 performs a face detection process on each acquired image in the same manner as the face image data collection unit 120, and determines a face region in the image when a face region is detected. There may be. In addition, it has the function to obtain facial feature points such as eyes, nose, mouth edge, etc. in each facial area, and to normalize the position and size of the facial area for matching processing based on the obtained feature point positions. Also good.

  As a result, the inquiry face image collection unit 124 can send the normalized face image as an inquiry image to the partial similarity calculation unit 121, which effectively improves the accuracy of the matching process in the partial similarity calculation unit 121. Can be improved.

  Furthermore, the image matching apparatus 10 includes a related user face image collection unit 125 that collects face images for a web application site such as SNS (social network service) associated with a user account related to a search target. It is good also as a structure provided.

  Here, as a target party, a search requester who has requested a search for a lost search target, or, if the search target is a pet, via the buyer's circle friend or SNS (social network service) Includes connected terminal users.

  In addition, the target for searching and collecting facial images is a user who has been detected to be related on a web application used by a search target related person, and a web page or image on the web application used by the user. Includes databases.

  For this reason, the related user face image collection unit 125 performs a cyclic search using a user account as a query for a social network service associated with the user or an image database set in a so-called cloud on the Internet.

  This effectively increases the possibility of acquiring registrants who can become search subjects in the future, face images related to search targets, and face images that registrants and search subjects appear accidentally. It becomes possible.

[Description of Operation of Embodiment 2]
The operation contents of the image collating apparatus 10 according to the second embodiment including a face image data collection unit that collects face images as image data including a face photograph of the search target person will be described.

  As shown in FIG. 10, the image collating apparatus 10 according to the second embodiment uses a preset front face image of a search target person as a reference registered image (master image (M)), and the master image (M) and face The partial similarity of face areas in one or a plurality of different image data (referred to as “collation images”) collected by the image data collection unit 120, for example, A to D, is calculated.

  Further, when the partial similarity image determination unit 123 of the image matching device 10 has a calculated partial similarity that exceeds a certain ratio or a preset threshold value, the matching image is lower than the identity of the master image. Is stored as a stored image in the stored image storage unit as a stored image.

  As a result, in the second embodiment, a face image having a partial similarity with a certain width from the master image registered in advance from the face image collected by the face image data collection unit 120 (A, FIG. 10). B, C, D) can be extracted and stored as an accumulated image.

  Note that the face image collected by the face image data collection unit 120 may be set to employ a face image supplied by a related person or a related person such as a search requester.

  In this case, there is a high possibility that the search target is reflected in the registered and stored images, so even if the matching threshold for matching the person is set low, a face image of another person different from the search target is selected. The possibility can be suppressed.

In addition, this makes it easier to acquire a photograph that can make the face image effective even when it is a face image that cannot be identified by a single person when performing image matching on the inquiry image.
For this reason, it is possible to have various face angles of the search target by adopting many images of the search target (such as elderly people) as accumulated images by making a gentle match determination compared to the image matching for search. An image collation apparatus (system) with extremely high collation accuracy in which other images (collation images) of various angles corresponding to the search target are accumulated can be realized.

  That is, the accumulated image storage unit 13 stores, for example, face photographs with various different angles and brightness of the search target person as accumulated images, so that the collation accuracy of the image collation process performed by the collation process control unit 112 is improved. It becomes possible to improve effectively.

  It should be noted that the similarity determination by the partially similar image determination unit 123 is a rough determination with a lower collation threshold value than the image collation processing determination performed by the collation processing control unit 112. Thereby, it is conceivable that an image stored as an accumulated image includes a person, a dog, a cat, and the like that are different from the imaging target.

  However, in the image matching process performed by the matching processing control unit 112, face images of various angles are sent as the query image. Therefore, when such a query image is a target for matching (registered image). Since the collation image (accumulated image) includes an image having a partial similarity with the master image to some extent, the accuracy of image collation can be further improved.

  In addition, the image collation apparatus 10 according to the second embodiment includes an inquiry face image collection unit that collects face images that are image data including face photographs stored on a web server after a search event occurs. Also good.

  At this time, the collation processing control unit 112 performs image collation processing in which the face image collected by the inquiry face image collection unit is used as the inquiry image.

  As described above, in the second embodiment, face images uploaded to SNS (Social Network Service) and image information taken by a third party unrelated to the search target are also used as collation targets. . For this reason, it is possible to collate a large number of photographs with various angles as an inquiry image, so that the accuracy of image collation (face recognition) can be effectively increased.

  In the second embodiment, other web sites such as SNS and web application sites are randomly searched regardless of the search target person. For this reason, images, articles, and related information related to the search event can be acquired by chance.

  In addition, here, an image matching process is performed in which the image data randomly acquired by the cyclic search is used as an inquiry image. For this reason, it becomes possible to detect the search target person accidentally reflected in the image photographed by the user unrelated to the search target person.

This embodiment includes the following technical ideas.
(1) An image matching device that performs an image matching process between an inquiry image that is image data sent from a terminal via a network and an accumulated image that is image data stored in advance, and a search event that requires the image matching process An image collation system having a related information storage unit for holding event related information corresponding to each,
The image matching device
A terminal selection unit that selects a part of the terminals corresponding to the users related to the search events as selection terminals;
A related information browsing control unit that performs control to allow browsing access to the event related information by the selected terminal;
An image collation system comprising: a collation processing control unit that executes the image collation processing when the inquiry image is sent from each of the selected terminals.
(2) The related information browsing control unit sets a part disclosure information indicating a part of the event related information set in advance among the event related information corresponding to the search event in a state where browsing access is possible,
The terminal selection unit selects the terminal corresponding to a user related to a search target of the search event or a search requester as a partial access permission terminal that is permitted browsing access to the partial disclosure information,
The image verification system according to (1), wherein the verification process control unit performs control to execute the image verification process on the inquiry image sent from the partial access permission terminal.
(3) The image collating apparatus includes a meta information collection unit that collects meta information including information indicating a shooting position and a shooting date and time of the inquiry image from the inquiry image.
The terminal selection unit selects the terminal that has taken the inquiry image within a certain area set based on the meta information as a search cooperation terminal,
The said collation process control part is an image collation system as described in (2) which performs control which performs the said image collation process with respect to the said inquiry image sent from the said search cooperation terminal.
(4) An event information notification unit for notifying the search cooperation terminal of event occurrence information indicating that the search event has occurred when a search event has occurred within a certain distance from the point where the search cooperation terminal has taken a picture. The image collation system according to (3), comprising:
(5) The image verification system according to (4), wherein the event information notification unit notifies the partial access permission terminal of browsing permission information indicating that the browsing access to the partial disclosure information is permitted. .
(6) The terminal selection unit may partially access the search cooperation terminal when the number of times that the image matching process of the inquiry image transmitted from the search cooperation terminal is successful exceeds a predetermined number of times. The image matching system according to (4) or (5) selected as
(7) The terminal selection unit sets, as a partial access permission terminal, the search cooperation terminal that captured the inquiry image in an area within a certain distance from the imaging position based on the imaging position of the inquiry image that has been successfully collated. The image collation system according to (4).
(8) The terminal selection unit sets the search cooperation terminal as a partly access-permitted terminal when the image matching of the inquiry image sent from the search cooperation terminal is successful, any of (4) to (7) The image collation system according to one item.
(9) having a short-range wireless communication device that is connected to the network and wirelessly detects the terminal located within a certain distance from the set position;
When the partial access-permitted terminal located within the certain distance is detected, the event information notification unit sends the event information notification unit to the partial access-permitted terminal. The image verification system according to any one of (4) to (8), in which browsing permission information indicating that the browsing access to the partial disclosure information is permitted is notified.
(10) A short-range wireless communication device that is connected to the network and wirelessly detects the search cooperation terminal located within a detection distance indicating a fixed distance from the installation position indicates a fixed distance longer than the detection distance. When the search event occurs within the event area distance, the search cooperation terminal is notified of information indicating that the search event notified from the event information notification unit is generated within the event area distance ( The image collation system according to any one of 4) to (9).
(11) The image collating device is
A face image collection unit that extracts a face image by detecting a face region from image data acquired via a network;
A partial similarity calculation unit that calculates a partial similarity in each of the face images using a front face image of a search target set in advance as a reference registration image;
The image matching system according to any one of (2) to (10), further including a partial similar image determination unit that stores a face image in which the partial similarity exceeds a predetermined value set in advance as the accumulated image.
(12) Collecting facial images published on the web, and using the facial images published on the web after the occurrence of the search event based on meta information in the facial images as an inquiry image to the collation processing control unit The image collation system according to any one of (2) to (11), further including an inquiry face image collection unit for selective collection.
(13) A related user face image collection unit that collects the face image for a web application site associated with an account on the web of a search target related person related to the search target is provided. The image collation system according to (12).
(14) An inquiry image, which is an image data sent from a terminal via a network, and an image stored in advance, having a related information storage unit that holds event related information corresponding to each search event that requires image matching processing An image matching device that performs image matching processing with data,
A terminal selection unit that selects a part of the terminals corresponding to the users related to each search event as a selection terminal;
A related information browsing control unit that performs control to allow browsing access to the event related information by the selected terminal;
An image collation apparatus comprising: collation processing control means for performing control to execute the image collation processing when the inquiry image is sent from each selected terminal.
(15) Event matching information corresponding to each search event that requires image matching processing is held, and image matching processing between an inquiry image, which is image data sent from a terminal via a network, and image data stored in advance is performed. An image matching method for performing
A part of terminals corresponding to the users related to each search event is selected as a selection terminal, and a control is performed to allow browsing access to the event related information by the terminal selected by the selection terminal. An image matching method, comprising: causing the image matching process to be executed when the inquiry image is sent from a user.
(16) Image collation that holds event-related information corresponding to each search event that requires image collation processing and performs image collation between an inquiry image that is image data sent via a network and pre-stored image data A computer program for causing a computer included in the apparatus to execute the program,
Selected terminal determination function for selecting a part of the terminal corresponding to the user related to each search event as a selected terminal;
A related information browsing control function for performing control to allow browsing of the event related information by the selected terminal;
A computer program including a collation process control function for executing the image collation process when the inquiry image is sent from the terminal selected by each selected terminal.

  The present invention can be usefully applied to a lost child searching system for children and pets in addition to searching for elderly people.

100, 200 Image collation system 1, 2 Network 10 Image collation device 12 Search related information storage unit 13 Accumulated image storage unit 21 Main control unit 22 Communication unit 23 Storage unit 50 Short-range wireless communication devices 99a, 99b, 99c, 99d Terminal 110 Terminal selection unit 111 Related information browsing control unit 112 Collation processing control unit 113 Meta information collection unit 114 Event information notification unit 120 Face image data collection unit 121 Partial similarity calculation unit 123 Partial similarity image determination unit 124 Query face image collection unit 125 Related User face image collection unit

In order to achieve the above object, an image collation system according to the present invention performs an image collation process between an inquiry image, which is image data sent from a terminal via a network, and an accumulated image, which is image data stored in advance. An image matching system having a matching device and a related information storage unit that holds event-related information corresponding to each search event that requires the image matching processing, wherein the image matching device receives a participation request from a terminal The communication unit and a part of the terminal corresponding to the user related to the search event are selected as selection terminals, and the part of the terminal corresponding to the user related to the search target of the search event or the search requester is partially accessed elected as an authorized terminal, a terminal selection unit for selecting the terminal that has transmitted the participation request to the communication unit as a search cooperation terminal, to the selected terminal Said event allow viewing access to relevant information, sets some disclosure information indicating the event-related information of a part which is set in advance in view accessible state to the partially permissions terminals that, A related information browsing control unit for controlling the event related information and the partial disclosure information to be set in a state in which browsing access is prohibited for the search cooperation terminal ; the selection terminal ; the partial access permission terminal; and a verification processing control unit which respectively perform the image matching processing when the query image from the search cooperation terminal is sent, the terminal selecting unit, the storing by the image matching process according to the verification processing control unit The search cooperation terminal that has sent the inquiry image that has been successfully collated with an image is set as the partial access permission terminal .

The image collation apparatus of the present invention has a related information storage unit that holds event-related information corresponding to each search event that requires image collation processing, and an inquiry image that is image data sent from a terminal via a network; An image matching apparatus that performs an image matching process with previously stored image data , wherein a communication unit that receives a participation request from a terminal and a part of the terminals corresponding to the user related to each search event are selected as selection terminals And selecting a part of the terminal corresponding to the search target of the search event or the user related to the search requester as a partly access-permitted terminal, and searching for the terminal that has transmitted the participation request to the communication unit some disclosure information indicating a terminal selection unit for selecting a terminal, to allow viewing access to the event-related information by the selected terminal, a part which is set in advance the event-related information Was set to browse accessible state to the partially permission terminal, a control for setting a state in which viewing access is prohibited the event-related information and the portion disclosed information to the search cooperation terminal A related information browsing control unit to perform, and a collation processing control unit that performs control to execute the image collation processing when the inquiry image is sent from the selection terminal, the partial access permission terminal, and the search cooperation terminal , respectively. Bei example, that the terminal selecting unit, the search cooperation terminal that sent the query image verification succeeds and the stored image by the image matching process according to the verification processing control unit is set to the part permissions terminal Characterize .

Further, the image matching method of the present invention holds event related information corresponding to each search event that requires image matching processing, and an inquiry image that is image data sent from a terminal via a network and an image stored in advance. An image matching method for performing image matching processing with data, wherein a part of terminals corresponding to a user related to each search event is selected as a selection terminal, and is related to a search target of the search event or a search requester A part of the terminal corresponding to the user to be selected as a partly access-permitted terminal, the terminal that transmitted the participation request to the communication unit is selected as a search cooperation terminal, and the event related information by the selected terminal viewed traffic allows, some disclosure information indicating the event-related information of a part which is set in advance in view accessible state to the partially permissions terminals for Constant, and have line control for setting a state in which viewing access is prohibited the event-related information and the portion disclosed information to the search cooperation terminal, the selected terminal, the portion permissions terminal and the search When the inquiry image is sent from a cooperation terminal, control is performed to execute the image matching process, and the search cooperation terminal that has sent the inquiry image that has been successfully matched with the stored image by the image matching process, It is set to a part access permission terminal .

Further, in the present invention, event related information corresponding to each search event that requires image collation processing is held, and image collation between an inquiry image that is image data sent via a network and image data stored in advance is performed. A computer program to be executed by a computer included in the image collating device to perform, selecting a part of the terminal corresponding to the user related to each search event as a selection terminal, to the search target of the search event or the search requester A selection terminal determination process in which a part of terminals corresponding to related users is selected as a partly access-permitted terminal, and the terminal that has transmitted the participation request to the communication unit is selected as a search cooperation terminal, and the selection terminal allow viewing of the event-related information by the partial permission some disclosure information indicating the event-related information of the part that has been set in advance Set browsing accessible state relative end, relevant information browsing control process the event-related information and the portion disclosures performs control for setting a state in which viewing access is prohibited to the search cooperation terminal A collation process control process for executing the image collation process when the inquiry image is sent from the selection terminal, the partial access permission terminal, and the search cooperation terminal, and the stored image by the image collation process. There is provided a computer program for causing the computer to execute a process of setting the search cooperation terminal that has sent the inquiry image that has been successfully verified as the partial access permission terminal .

Here, the source terminal is selected terminal, if it is any one of a portion permissions terminals or search cooperation terminal, is confirmed, the verification processing control unit 112, an image matching action for the query image Execute (S184: Image collation process).

Claims (16)

Corresponding to each image search device that performs image matching processing between an inquiry image, which is image data sent from a terminal via a network, and an accumulated image, which is prestored image data, and a search event that requires the image matching processing An image collation system having a related information storage unit for holding event related information,
The image matching device
A terminal selection unit that selects a part of the terminals corresponding to the users related to the search events as selection terminals;
A related information browsing control unit that performs control to allow browsing access to the event related information by the selected terminal;
And a collation processing control unit that executes the image collation processing when the inquiry image is sent from each of the selected terminals. The related information browsing control unit sets a part of disclosure information indicating a part of the event related information set in advance among the event related information corresponding to the search event in a state where browsing access is possible,
The terminal selection unit selects the terminal corresponding to a user related to a search target of the search event or a search requester as a partial access permission terminal that is permitted browsing access to the partial disclosure information,
The image collation system according to claim 1, wherein the collation processing control unit performs control to perform the image collation processing on the inquiry image sent from the partial access permission terminal. The image collating device has a meta information collecting unit that collects meta information including information indicating a shooting position and a shooting date and time of the inquiry image from the inquiry image;
The terminal selection unit selects the terminal that has taken the inquiry image within a certain area set based on the meta information as a search cooperation terminal,
The image matching system according to claim 2, wherein the matching processing control unit performs control to execute the image matching processing on the inquiry image sent from the search cooperation terminal.   When a search event has occurred within a certain distance from the point where the search cooperation terminal has taken a picture, an event information notification unit is provided for notifying the search cooperation terminal of event occurrence information indicating that the search event has occurred. The image collation system according to claim 3.   The image verification system according to claim 4, wherein the event information notification unit notifies the partial access permission terminal of browsing permission information indicating that the browsing access to the partial disclosure information is permitted.   The terminal selection unit selects the search cooperation terminal as a partly access-permitted terminal when the number of times that the image matching process of the inquiry image sent from the search cooperation terminal is successful exceeds a predetermined number of times set in advance. The image collation system according to claim 4 or 5.   The terminal selection unit sets, as a partial access permission terminal, the search cooperation terminal that has captured the inquiry image in an area within a certain distance from the imaging position based on the imaging position of the inquiry image that has been successfully collated with the image. The image matching system described in 1.   The said terminal selection part sets the said search cooperation terminal as a partial access permission terminal, when the image collation of the inquiry image sent from the said search cooperation terminal succeeds. Image matching system. A short-range wireless communication apparatus that is connected to the network and wirelessly detects the terminal located within a certain distance from the set position;
When the partial access permission terminal located within the fixed distance is detected, the event information notification unit notifies the partial access permission terminal of the event information notification unit. The image collation system according to any one of claims 4 to 8, wherein the browsing permission information indicating that the browsing access to the partial disclosure information is permitted to the terminal.   The short-range wireless communication device that is installed in connection with the network and wirelessly detects the search cooperation terminal located within a detection distance indicating a certain distance from the installation position is an event region distance indicating a certain distance longer than the detection distance The search cooperation terminal is notified of information indicating that the search event notified from the event information notification unit is generated within the event area distance when the search event occurs in the search area. The image collating system according to any one of 9. The image matching device is
A face image collection unit that extracts a face image by detecting a face region from image data acquired via a network;
A partial similarity calculation unit that calculates a partial similarity in each of the face images using a front face image of a search target set in advance as a reference registration image;
The image collation system according to any one of claims 2 to 10, further comprising a partial similar image determination unit that stores a face image in which the partial similarity exceeds a predetermined value set in advance as the accumulated image.   Collects face images published on the web, and selects and collects face images published on the web after the occurrence of the search event as inquiry images to the collation processing control unit based on meta information in the face images The image collation system according to any one of claims 2 to 11, further comprising an inquiry face image collection unit.   13. The related user face image collection unit configured to collect the face image for a web application site associated with an account on a web of a search target related person related to the search target. The image matching system described in 1. It has a related information storage unit that holds event related information corresponding to each search event that requires image matching processing, and an inquiry image that is image data sent from a terminal via a network and image data stored in advance An image matching device that performs image matching processing,
A terminal selection unit that selects a part of the terminals corresponding to the users related to each search event as a selection terminal;
A related information browsing control unit that performs control to allow browsing access to the event related information by the selected terminal;
An image collation apparatus comprising: collation processing control means for performing control to execute the image collation processing when the inquiry image is sent from each selected terminal. Holds event-related information corresponding to each search event that requires image matching processing, and performs image matching processing between the query image that is image data sent from the terminal via the network and pre-stored image data An image matching method,
A part of terminals corresponding to the users related to each search event is selected as a selection terminal, and a control is performed to allow browsing access to the event related information by the terminal selected by the selection terminal. An image matching method, comprising: causing the image matching process to be executed when the inquiry image is sent from a user. An image matching apparatus that holds event-related information corresponding to each search event that requires image matching processing and performs image matching between an inquiry image that is image data sent via a network and image data that has been stored in advance A computer program for causing a computer to execute,
Selected terminal determination function for selecting a part of the terminal corresponding to the user related to each search event as a selected terminal;
A related information browsing control function for performing control to allow browsing of the event related information by the selected terminal;
A computer program including a collation process control function for executing the image collation process when the inquiry image is sent from the terminal selected by each selected terminal.

Images