JP4742734B2 - Judgment device, authentication system, data distribution method and program - Google Patents

Description

  The present invention relates to a technique for easily performing face authentication processing.

  Conventionally, when the general public cooperates for police investigation (investigation) or arrest of a specific person such as a wanted offender, a general person who remembered a picture of a wanted offender on a police box seems to be a criminal When a person was found, it was necessary to report to the police, or it was necessary to verbally respond to the police officer's inquiry about the information of the suspicious person when there was an incident such as an empty nest.

  However, even though I think it is a wanted offender, I think it's a memory mistake, or I'm scared and I can't look into my face well.In addition, the range of suspicious information that can be heard is limited. In many cases, it became obsolete and it was difficult to arrest.

Here, a video camera that captures people around you, a mobile phone carried by a police officer, a face detection unit that cuts out a face image from the image, and a facial feature that creates facial feature data of the user from the face image A quantity data creation unit, a face matching unit that collates face feature data of a specific person registered in the registration information database and user face feature data, and determines the possibility of being a user's specific person from the matching result And a notification data generation unit that generates and transmits data for notification to the police station when the user is highly likely to be a specific person, thereby detecting the face of the specific person to be detected A technique has been proposed that can detect and notify a person with a high degree of similarity using image data (see, for example, Patent Document 1).
JP 2003-187352 A

  However, the conventional example described above has the following problems.

  When collating face authentication data with a centralized management device such as a server device that has a registration information database, mobile phones carried by police officers are places where radio waves do not reach, such as in the shade of buildings, mountainous areas, underground, etc. If it exists, the face authentication cannot be performed immediately because the server device cannot be accessed.

  In addition, every time authentication processing is required, it is necessary to connect to the network in order to access the server device, which takes time and effort for processing, and shortens the search processing as the search target data increases. It becomes difficult to execute in time.

  The present invention has been made in view of the circumstances described above, and an object thereof is to simply execute face authentication processing on the terminal side and perform face authentication in any place in a short time.

In order to solve the above problems, a determination device according to the present invention refers to a storage unit in which data for face authentication is stored by one mobile terminal based on data of a person photographed by an imaging unit. , Collect face authentication result data from multiple area servers that acquired face authentication result data, analyze the result data, identify one area with high authentication level, In order to transmit data for performing face authentication of a person taken by one mobile terminal to another mobile terminal located in the area controlled by the area server, the one mobile terminal Data for performing face authentication of a photographed person is distributed.

The authentication system of the present invention, based on the data of the person photographed by the imaging means, by referring to the storage unit in which data is stored for face authentication, a mobile terminal intends row face authentication, the mobile terminal from acquired result data of the face authentication, and analyze the results data, when higher the authentication of the face authentication of a person portable terminal has taken other mobile terminals located in the area where the own device is competent In an authentication system consisting of an area server that transmits data to be performed, face authentication result data is collected from a plurality of area servers, the result data is analyzed, one area with a high degree of authentication is identified, In order to transmit data for face authentication of a person photographed by one mobile terminal to another mobile terminal located in the area controlled by the area server, to the area server that controls the area. Terminal further comprising a determination device that distributes data for performing face authentication of the person photographed.

Further, in the data distribution method of the present invention, one terminal performs face authentication based on the data of a person photographed by the imaging means with reference to a storage unit storing data for face authentication. Area server that collects face authentication result data from multiple area servers that acquired the face authentication result data, analyzes the result data, identifies one area with a high degree of authentication, and has jurisdiction over one area In order to perform face authentication of a person photographed by one terminal in order to transmit data for performing face authentication of the person photographed by one terminal to other terminals located in the area controlled by the area server The data is distributed .

Further, according to the program of the present invention, one terminal performs face authentication with reference to a storage unit in which data for face authentication is stored based on data of a person photographed by an imaging unit. Collect face authentication result data from multiple area servers that have acquired face authentication result data, analyze the result data, identify one area with a high degree of authentication, and to the area server that has jurisdiction over one area Data for performing face authentication of a person photographed by one terminal to transmit data for performing face authentication of the person photographed by one terminal to other terminals located in the area under the control of the area server It is characterized by causing a computer to execute a process of distributing a message.

  According to the present invention, face authentication processing can be easily executed on the terminal side, and face authentication can be performed in any place in a short time.

  Hereinafter, a first embodiment of the present invention will be described in detail with reference to the drawings. In addition, the same code | symbol is attached | subjected to the common part in each figure.

  Referring to FIG. 1, the authentication system according to the present embodiment is arranged in a system server 10, area servers 20a and 20b as an example of area server 20 that divides and governs the location of a mobile terminal into a plurality of areas, and the area. Mobile terminals 301 to 306 as an example of a plurality of mobile terminals. The system server 10, the area servers 20a and 20b, and the portable terminals 301 to 306 operate under program control and are connected via a network 500 or a mobile communication network. The network 500 may be any network, and may be, for example, an optical fiber, the Internet, a public line, a LAN (Local Area Network), an ADSL (Asymmetric Digital Subscriber Line), or the like. The communication method may be wired or wireless.

  The system server 10 is an information processing apparatus such as a work station. For example, an operation input unit, a ROM (Read Only Memory), a RAM (Random Access Memory), a communication interface, an HD (Hard Disk), A CPU (Central Processing Unit) is provided, and these units are connected by a bus.

  The operation input unit includes a keyboard and a mouse, and outputs an operation signal corresponding to the operation of the keyboard and mouse to the CPU. The ROM stores a program that controls basic control of each part of the apparatus. The RAM is used as a work area for the CPU, and temporarily stores programs executed by the CPU and various data.

  The communication interface is connected to the Internet and controls data communication performed with the communication device.

  The HD stores various software for controlling the own device such as an operating system.

  The system server 10 has a function of receiving face authentication result data based on image data captured from the area servers 20a and 20b and determining the area server 20 in an area where a face closer to the search target data is captured. Yes.

  The mobile terminals 301 to 306 are communication devices such as a mobile phone, a PDA, and a notebook personal computer. Hereinafter, in this embodiment, for convenience of explanation, it is assumed to be a mobile phone.

  Further, in detail with reference to FIG. 2, the mobile terminals 301 to 306 acquire a radio communication unit 31 that transmits and receives radio signals to and from the base station via an antenna, and acquires (shoots) image information. A display unit 35 that includes an imaging unit 32 to perform, a face authentication unit 33 to perform face authentication processing, and a face authentication DB 34, and which displays various information such as characters and images, which is a known configuration of a mobile phone; An operation unit 36 including a numeric keypad and a scroll / decision key for inputting various information operations, a transmitter unit for inputting and outputting to a voice processing unit for performing voice signal processing, a receiver unit, A speaker for outputting musical sounds, notification sounds, etc., a memory for storing telephone directory information, transmitted / received mail information, incoming / outgoing call information, content information, program information, various settings of mobile phone terminals, etc., telephone function, mail function, web Continued and a like with Internet function, the control unit for performing a camera function and a mobile communication terminal control units. In addition to the base station ID, the mobile device ID for uniquely identifying the mobile phone (for example, the mobile phone number or serial number) may be stored in the memory. Moreover, you may have the GPS function for acquiring the positional information on an own machine. At the timing of transmitting face data, the built-in GPS reception function receives radio waves from GPS satellites and acquires current position information. The current location information is obtained when the mobile phone performs wireless communication with a base station that covers the wireless cell in which the mobile phone is located, receives a communication service provided by a mobile communication network, May be acquired by intermittently receiving identification information (base station ID) of the base station from a base station under the control of the base station and storing the received base station ID in a memory.

  The face authentication DB 34 is, for example, a predetermined size or number (for example, a number of face data stored in a predetermined database of a server provided in a police station corresponding to a limited memory of a mobile phone) It is assumed that data of 10 face data is acquired and stored. As an example, according to the address of a person who needs attention and the crime occurrence site, the user's mobile phone living in the neighboring area can store the data of the person and perform an efficient search.

  The mobile communication network is a network that provides a communication service to a mobile phone accommodated in the mobile communication network, and includes a base station, a service control station, a gateway server, and a plurality of switching stations.

  A large number of base stations are installed in the communication service area, and perform wireless communication with a mobile phone located in a wireless cell covered by the base station.

  Here, in this embodiment, this base station corresponds to the area servers 20a and 20b, and realizes its function.

  Next, the flow of face authentication processing in the present embodiment will be described. In the situation shown in FIG. 1, there are a plurality of users in an area covered by a predetermined base station, the users carry mobile phones, and the mobile phones used by these users are It is assumed that the device has already been registered with the system.

  Further, it is assumed that a predetermined number of face authentication data are stored in the face authentication DB 34 of each of the mobile terminals 301 to 306.

  Referring to FIG. 3, first, each of the mobile terminals 301 to 306 starts the imaging when the user is using the device for any purpose such as a call, e-mail, or Web content browsing (S301). Alternatively, it may always be automatically performed from the imaging unit 32 realized by a predetermined camera mechanism even when it is not used for any purpose. The user unconsciously starts imaging without performing any special operation.

  In addition, when the camera is used for taking still images or moving images, the image may be acquired as a background from the imaging unit 32 realized by a predetermined camera mechanism. The user unconsciously captures a person in the background of a subject such as an original still image.

  Next, the face authentication unit 33 of each of the mobile terminals 301 to 306 refers to the face authentication DB 34 based on still image data captured from captured still image data or moving image data, and performs face authentication processing. Is executed (S302). This face authentication process may be executed by using various known techniques.

  And the wireless communication part 31 of each portable terminal 301-306 transmits authentication result data to the area server 20 (S303). Here, the authentication result data is set to a small number from “0.0 to 1.0” where “1.0” is a perfect face match, and as shown in FIG. , 302 transmits “0.3”, 303 transmits “0.2” to the area server 20a, “0.3” for the mobile terminal 304, “0.5” for 305, and “0.8” for 306. Is transmitted to the area server 20b.

  The area servers 20a and 20b transmit the authentication result data received from the mobile terminals 301 to 306 to the system server 10 via the network 500 (S304).

  The system server 10 aggregates the authentication result data in each of the mobile terminals 301 to 306 received from the area servers 20a and 20b, and analyzes an area where there is a high possibility that the search target person exists (S305). For example, when there is a data distribution as shown in FIG. 4, there is only one or a small number of portable terminals with a high degree of authentication, and therefore it is determined that there is a high possibility that there is a search target person in that area. Can do. Then, as the processing of this system is implemented, the distribution map is such that the number of mobile terminals with high authentication levels gradually increases. In addition, even when there is a mobile terminal that shows an authentication level that is significantly higher than the average value of the analysis target data in one area, it is possible to determine that there is a high possibility that a search target person exists in that area.

  As a result of the analysis in step S305 described above, the system server 10 identifies one area that is highly likely to contain the search target person from the plurality of areas (S306). If it demonstrates using the data value shown in FIG. 1, although the authentication result data in each portable terminal 304-306 received from the area server 20b are "0.3", "0.5", and "0.8". Since there is a mobile terminal 306 having a high authentication level of “0.8”, it is determined here that there is a high possibility that there is a search target person in area B.

  The system server 10 notifies the area server 20b having jurisdiction over the area B that the face authentication data and the one area are specified (S307).

  The area server 20b notifies each mobile terminal existing in the area B in charge of information for identifying the search target person (S308). Specifically, as information for identifying a search target person, a name and the like are notified in addition to face data necessary for face authentication. In FIG. 1, not only the mobile terminals 304 to 306 but also a mobile terminal newly entering the area B is notified. In FIG. 1, it is assumed that the mobile terminals 304 to 306 already have information for identifying the search target person in the face authentication DB 34. For example, some of the mobile terminals 304 to 306 have the face authentication DB 34. If there is no information for identifying the search target person notified from the area server 20b, as shown in FIG. Assuming that the data is symbols A, B, C, D, and E, and only the face authentication data for four persons can be stored in the face authentication DB 34, the data is deleted from the face authentication DB 34 and the search target person is identified. Information may be added to the face authentication DB 34.

  The face authentication unit 33 such as each of the mobile terminals 304 to 306 existing in the area B refers to the face authentication DB 34 based on the captured still image data or the still image data captured from the moving image data. Face authentication processing is executed (S309). This face authentication process is the same as step S302 described above, and may be executed by using various known techniques. Each mobile terminal in area B receives a predetermined notification from the area server 20b, the user of each mobile terminal notices the notification, and starts imaging by an operation such as pressing a button. Alternatively, each mobile terminal that has received a predetermined notification may automatically start imaging without requiring a user operation.

  Then, when the authentication level becomes considerably high, for example, when it becomes 0.8 to 0.9 or when it becomes 0.8 to 1.0, a warning is issued to the police (S310). ). This warning may be transmitted as data from the system server or the like to the information processing device on the police side, or may be reported by voice by telephone by the user.

  Upon receiving the warning, the police contact a police officer or the like located in the vicinity of the area, and the police officer who has received the contact goes to the scene and contacts the person to be searched. The contact with the police officer may be realized by automatically transmitting necessary information from the information processing apparatus on the police side to the mobile communication terminal owned by the person.

  According to the above embodiment, the face authentication technology generally has a characteristic that data obtained by photographing a person's face from the front tends to be close to perfect match, so the face cannot be photographed from the front and face authentication is performed. Even if it is relatively low, collation is performed based on information from surrounding imaging devices (particularly located near the front of the person to be photographed most) and face authentication is performed from a plurality of imaging devices. It can be carried out. In particular, when the person to be searched for is a person who has a strong alert to the surroundings such as a criminal, it is particularly effective because it is often difficult to photograph the face from the front with one terminal device.

  In addition, by transmitting face authentication data stored in limited memory resources of mobile communication terminals such as mobile phones to surrounding mobile phones based on highly authenticated information, various mobile phones can By taking an image from the direction, the probability of photographing from the front of the face of the person to be searched increases, the face authentication accuracy can be improved efficiently, and the efficiency of the investigation can be further improved.

  Next, a second embodiment of the present invention will be described in detail with reference to the drawings.

  Referring to FIG. 6, the authentication system according to the present embodiment is different from the first embodiment described above in that the system server 10 is not included in the configuration, but the other points are basically the same. A duplicate description is omitted.

  Each area server 20a, 20b receives face authentication result data based on image data captured from each of the mobile terminals 301 to 303 and each of the mobile terminals 304 to 306 present in the area under its jurisdiction. When the terminal authentication level is higher than the specified value and it is determined that there is a high possibility that the search target person exists in the area, or when the average authentication level of each terminal is considerably high, etc. Information for identifying the person to be searched is notified to each portable terminal. Specifically, as the information for identifying the search target person, a name and the like are notified in addition to face data necessary for face authentication.

  Here, if the area under the control of each area server 20 is a general large-scale accommodation base station unit, the approximate direction and distance can be calculated based on the directivity of radio waves from the mobile terminal and the radio wave intensity. Since the search range is comparatively large, such as several tens of kilometers, accurate location information is collected using the GPS function of each mobile terminal, for example, mapping as shown in FIG. If the information for identifying the person to be searched is notified only to each mobile terminal located near the mobile terminal higher than the predetermined value, the search efficiency can be improved.

  Note that the GPS function may not be used depending on the surrounding environment such as an underground mall, weather, and valleys of buildings, and therefore, measurement in units of base stations is particularly useful in such a case.

  The flow of the other face authentication processing in the present embodiment is basically the same as that in the first embodiment.

  Next, a third embodiment of the present invention will be described in detail with reference to the drawings.

  Referring to FIG. 8, the authentication system according to the present embodiment is different from the first and second embodiments described above in that the system server 10 and the area server 20 are not included in the configuration. Since the configuration is basically the same, redundant description is omitted.

  Each mobile terminal in the present embodiment has a function of performing close proximity communication between mobile terminals. For example, infrared rays and BLUETOOTH.

  When each mobile terminal determines that the authentication level of the face data of the person imaged by its own device is higher than a predetermined value and the person to be searched is likely to exist in an area near its own device, Information identifying the person to be searched is notified to each mobile terminal located around by proximity communication. Specifically, as information for identifying the search target person, a name, face data, and the like are transmitted within a radius of 10 meters.

  Note that the information may be transmitted only once from the first portable terminal that becomes the master in order to avoid the infinite diffusion of information for identifying the search target person.

  According to the above embodiment, the face authentication is performed on the mobile terminal side as needed, and the face authentication data is broadcast to the surrounding mobile terminals without using a server device and the search area is widened. This is also effective when the is moving.

  Furthermore, in addition to the above-described embodiments, a mechanism for obtaining a reward depending on the degree of usefulness in the investigation may be added. For example, 10 million yen, which is a reward for a wanted arranger, is distributed among a plurality of persons who have provided information. The distribution reference at this time may be distributed on condition that the user of the terminal that has transmitted data with the highest face authentication accuracy or the user of the terminal that has transmitted similar data for face authentication for a long time. As described above, by incorporating the billing system, it becomes a motivation to join the system, and the effect of increasing the effectiveness of the system can be expected by increasing the number of system subscribers.

  Each of the above-described embodiments is a preferred embodiment of the present invention, and various modifications can be made without departing from the scope of the present invention. For example, in the present embodiment, the mobile terminals 301 to 306 are mobile phones. However, if the functions of the mobile terminal can be realized, the camera mechanism that projects the side and rear of the vehicle, the area specification of the toll road You may implement | achieve by the camera provided in the apparatus, the elevator, the train, other imaging devices, etc.

  Moreover, the process which implement | achieves the function of each apparatus by making each apparatus read the program for implement | achieving the function of the system server 10, area server 20a, 20b, and the portable terminals 301-306 in said embodiment, and executing it. May be performed. Further, the program is transmitted to another computer system by a transmission wave via a computer-readable recording medium such as a CD-ROM or a magneto-optical disk, or via a transmission medium such as the Internet or a telephone line. Also good.

  In each of the above-described embodiments, the system configuration in which the area servers 20a and 20b and the mobile terminals 301 to 306 are separately connected has been described. However, for each configuration and function in which each function is realized as one computer system. Of course, the present invention can also be applied to a configuration in which a plurality of devices are added.

It is a schematic block diagram of the authentication system in the 1st Embodiment of this invention. It is a functional block diagram of the terminal device in the 1st Embodiment of this invention. It is a sequence diagram which shows the authentication process operation | movement in the 1st Embodiment of this invention. It is a distribution map of the authentication result data in the 1st Embodiment of this invention. It is a figure which shows the data structure of face authentication DB in the 1st Embodiment of this invention. It is a schematic block diagram of the authentication system in the 2nd Embodiment of this invention. It is a figure which shows an example of the mapping in the 2nd Embodiment of this invention. It is a schematic block diagram of the authentication system in the 3rd Embodiment of this invention.

Explanation of symbols

10 system server 20a, 20b area server 301-306 portable terminal 500 network

Claims (4)

  One mobile terminal refers to a storage unit storing data for face authentication based on the data of a person photographed by the imaging means, and obtains face authentication result data. Collecting the face authentication result data from the plurality of area servers, analyzing the result data, identifying one area with a high degree of authentication, and providing the area server with jurisdiction over the one area to the area server In order to perform face authentication of a person photographed by the one portable terminal in order to transmit data for performing face authentication of the person photographed by the one portable terminal to another portable terminal located in an area controlled by the server The determination apparatus characterized by delivering the data. A portable terminal for performing face authentication with reference to a storage unit storing data for face authentication based on data of a person photographed by an imaging unit;
Obtaining face authentication result data from the portable terminal, analyzing the result data, and when the degree of authentication is high, the portable terminal has taken a picture of another portable terminal located in the area under its jurisdiction In an authentication system comprising an area server that transmits data for performing human face authentication ,
The result data of the face authentication is collected from a plurality of the area servers, the result data is analyzed, one area having a high degree of authentication is specified, and the area server having jurisdiction over the one area In order to perform face authentication of a person photographed by the one portable terminal in order to transmit data for performing face authentication of the person photographed by the one portable terminal to another portable terminal located in an area controlled by the server An authentication system further comprising a determination device that distributes the data . One terminal refers to a storage unit in which data for face authentication is stored based on the data of the person photographed by the imaging means, and acquires face authentication result data. The face authentication result data is collected from a plurality of area servers, the result data is analyzed, one area having a high degree of authentication is specified, and the area server having jurisdiction over the one area is Deliver data for face authentication of a person photographed by the one terminal so as to transmit data for face authentication of the person photographed by the one terminal to other terminals located in an area under the jurisdiction of A data distribution method characterized by: One terminal refers to a storage unit in which data for face authentication is stored based on the data of the person photographed by the imaging means, and acquires face authentication result data. The face authentication result data is collected from a plurality of area servers, the result data is analyzed, one area having a high degree of authentication is specified, and the area server having jurisdiction over the one area is Deliver data for face authentication of a person photographed by the one terminal so as to transmit data for face authentication of the person photographed by the one terminal to other terminals located in an area under the jurisdiction of A program that causes a computer to execute processing to be performed.

Images