JP5676210B2 - Monitoring device, monitoring method, and program - Google Patents

Description

  The present invention relates to a monitoring device, a monitoring method, and a program that use face recognition technology.

  In recent years, with the development of face recognition technology, monitoring systems using face recognition technology have been proposed (see, for example, Patent Documents 1 and 2). Such monitoring systems are being introduced in stores such as department stores, supermarkets, convenience stores, and rental video stores, as well as offices, private homes, apartment houses, and the like.

  For example, Patent Literature 1 discloses a monitoring system for an apartment house. The monitoring system disclosed in Patent Document 1 first captures the face of a visitor with a camera, and compares the captured face image data with the image data of the resident's face registered in advance. If the two do not match, the monitoring system further compares the photographed face image data with the pre-registered suspicious person face image data, and the photographed face image data and the suspicious person A notification is sent to the outside on the condition that the image data of the face matches.

  Patent Document 2 discloses a monitoring system that monitors illegal intruders that enter a building. The monitoring system disclosed in Patent Document 2 determines whether or not the face image data of a person photographed by a monitoring camera matches the face image data of a related person registered in advance. In addition, it is judged that there has been an illegal intrusion and a report is made.

JP 2006-120084 A JP 2010-2111514 A

  By the way, as described above, the monitoring systems disclosed in Patent Documents 1 and 2 compare the captured face image data with the pre-registered face image data to determine whether the two match. Judging by value.

  On the other hand, in general, in face recognition technology, a match rate (recognition rate) with respect to the latter of the former is obtained by comparing captured face image data with pre-registered face image data. If the rate is equal to or greater than the threshold value, it is determined that they match.

  Therefore, in the monitoring systems disclosed in Patent Documents 1 and 2, it is important to set a threshold value in the coincidence determination. For example, if the threshold value is too low in the coincidence determination between the image data of the captured face and the image data of the suspicious person's face registered in advance, the result of frequent notifications is a heavy burden on the administrator. End up. Also, if the threshold is too high, there is a possibility that monitoring will leak and allow suspicious persons to enter.

  An example of an object of the present invention is to provide a monitoring device, a monitoring method, and a program that can solve the above-described problems and reduce the burden on an administrator while suppressing a monitoring failure of a suspicious person.

In order to achieve the above object, a monitoring device according to one aspect of the present invention includes:
An imaging unit that causes a camera to capture a face of a person existing in a set area and obtains image data of the captured face;
A storage unit that stores pre-registered person face image data;
Comparing the image data acquired by the imaging unit and the image data stored in the storage unit, the ratio of the face that has been captured and the face of a person registered in advance is calculated. An arithmetic unit;
A determination unit that performs stepwise determination according to the value of the ratio calculated by the calculation unit;
It is characterized by having.

In order to achieve the above object, a monitoring method according to one aspect of the present invention includes:
(A) causing the camera to capture a face of a person existing in the set area, and obtaining image data of the captured face;
(B) The image data acquired in the step (a) and the image data of the face of the person registered in advance are compared, and the photographed face matches the face of the person registered in advance. Calculating the percentage of steps, and
(C) performing stepwise determination according to the value of the ratio calculated in the step (b);
It is characterized by having.

Furthermore, in order to achieve the above object, a program according to one aspect of the present invention is provided.
On the computer,
(A) causing the camera to capture a face of a person existing in the set area, and obtaining image data of the captured face;
(B) The image data acquired in the step (a) and the image data of the face of the person registered in advance are compared, and the photographed face matches the face of the person registered in advance. Calculating the percentage of steps, and
(C) performing stepwise determination according to the value of the ratio calculated in the step (b);
Is executed.

  As described above, according to the monitoring device, the monitoring method, and the program of the present invention, it is possible to suppress monitoring of a suspicious person while reducing the burden on the administrator.

FIG. 1 is a block diagram showing a configuration of a monitoring apparatus according to an embodiment of the present invention. FIG. 2 is a diagram illustrating an example of a determination criterion for determination by the monitoring device according to the embodiment of the present invention. FIG. 3 is a diagram showing an example of a search screen when searching for past data by the monitoring apparatus according to the embodiment of the present invention. FIG. 4 is a flowchart showing the basic operation of the monitoring apparatus according to the embodiment of the present invention. FIG. 6 is a flowchart showing search processing of the monitoring device according to the embodiment of the present invention. FIG. 6 is a block diagram illustrating an example of a computer that implements the monitoring device according to the embodiment of the present invention.

(Embodiment)
Hereinafter, a monitoring device, a monitoring method, and a program according to an embodiment of the present invention will be described with reference to FIGS. First, the configuration of the monitoring device 10 in the present embodiment will be described with reference to FIGS. 1 and 2. FIG. 1 is a block diagram showing a configuration of a monitoring apparatus according to an embodiment of the present invention. FIG. 2 is a diagram illustrating an example of a determination criterion for determination by the monitoring device according to the embodiment of the present invention.

  As shown in FIG. 1, the monitoring device 10 in this embodiment constitutes a monitoring system 40 together with a camera 20 and a display device 30. In addition, the monitoring device 10 includes an imaging unit 11, a calculation unit 12, a storage unit 13, and a determination unit 14.

  The imaging unit 11 is connected to the camera 20 and causes the camera 20 to capture a face of a person existing in a set area (for example, a specific store in a store). Then, the imaging unit 11 acquires image data of a photographed person's face from the camera, and outputs the acquired image data to the calculation unit 12.

  In the present embodiment, the camera 20 is installed so that the face of a person passing through a set area falls within the shooting range. In addition, when the imaging unit 11 instructs the camera 20 to start shooting, the camera 20 performs shooting at a set interval regardless of whether a person exists in the set area. The image data of the captured still image is output to the imaging unit 11. In other words, in the present embodiment, the camera 20 always shoots at a set interval. Therefore, there are cases where the face of the person is not included in the image data, but the person is within the set area. Is present, the image data of the person's face is acquired.

  The storage unit 13 stores image data of a person's face registered in advance. Here, the person whose face image data is registered in advance includes a person who is determined to be a person requiring attention by the administrator of the monitoring apparatus 10. For example, if the monitoring device 10 is a retailer such as a supermarket or a bookstore, the shopkeeper is a shoplifting addict.

  The calculation unit 12 compares the image data acquired by the imaging unit 11 (imaging data) with the image data stored in the storage unit 13 to obtain a photographed face and a person's face registered in advance. Calculate the percentage that matches.

  In the present embodiment, the calculation unit 12 can calculate a ratio (hereinafter referred to as “matching rate”) in which both match using an existing face recognition technique. As the existing face recognition technology, for example, the face recognition technology disclosed in JP-A-9-134432, JP-A-2003-187229, JP-A-2003-296735, JP-A-2004-139596, etc. Raised. Note that the face recognition technology used by the calculation unit is not limited to the existing technology, and may be a face recognition technology to be developed in the future.

  In addition, the determination unit 14 performs stepwise determination according to the value of the coincidence rate calculated by the calculation unit 12. The relationship between the match rate value and the content of the determination is set in advance according to the purpose of use. Furthermore, the determination unit 14 can perform a stepwise warning according to the determined step.

  For example, in the example of FIG. 2, when the matching rate is 80% or more and 100% or less, the determination unit 14 determines that they are completely matched, and displays a red alarm on the screen of the display device 30. When the matching rate is 70% or more and less than 80%, the determination unit 14 determines that they are substantially matched, and displays a yellow warning on the screen of the display device 30. Furthermore, the determination unit 14 can output different warning sounds according to the determination.

  In this way, the monitoring device 10 performs step-by-step determination on whether or not a suspicious person should be careful. Therefore, the administrator may pay attention according to the determination result, and the burden on the administrator is reduced. Further, since the monitoring device 10 can prompt the administrator to be alerted by the notification even when the coincidence rate is not so high, occurrence of monitoring omission of the suspicious person is suppressed.

  Here, the configuration and function of the monitoring apparatus 10 in the present embodiment will be described more specifically with reference to FIG. FIG. 3 is a diagram showing an example of a search screen when searching for past data by the monitoring apparatus according to the embodiment of the present invention.

  In the present embodiment, the monitoring apparatus 10 further includes a database 15 and a search unit 16 in addition to the imaging unit 11, the calculation unit 12, the storage unit 13, and the determination unit 14. Each time the determination unit 14 makes a determination, the database 15 stores the determination result in association with the image data that is the basis of the determination. Note that the image data that is the basis of the determination is image data acquired by the imaging unit 11 and used for calculating the coincidence rate. In the present embodiment, the calculated match rate may be stored in the database 15 together with the determination result and the image data.

  Further, in the present embodiment, the determination result (in the case where the stepwise determination is not performed in the database 15, specifically, even when the matching rate is less than 70% in the example of FIG. 2 ( (Coincidence rate) and the image data on which the determination is based are accumulated. Furthermore, when the coincidence rate is less than 70%, when the coincidence rate cannot be calculated (in the case of 0%), specifically, a photographed face, a pre-registered face, However, it is not similar at all, and the case where the calculation unit 12 cannot identify the image data serving as a reference for calculating the coincidence rate is also included.

  When the search unit 16 receives an input of information indicating stepwise determination via an external input device (not shown in FIG. 1), the search unit 16 performs a search for the database 15 based on the received information. Run. Then, the search unit 16 acquires past data corresponding to the received information, that is, the past judgment, the image data that is the basis of the judgment, and the matching rate.

  For example, in the present embodiment, the search unit 16 can display the search screen 31 shown in FIG. 4 on the screen of the display device 30. In this case, when the administrator of the monitoring device 10 uses the input device such as a mouse to check the check box 32 regarding the determination to be searched and selects (clicks) the search button 36, the search unit 16 performs stepwise. Input of information indicating the determination is accepted. Further, the administrator can directly input the target matching rate by checking the check box 35. In this case, the matching rate is accepted as information indicating stepwise judgment.

  In addition, as shown in FIG. 4, the administrator checks the date and time start point check box 33 and the date and time end point check box 34, and further inputs a specific date and time for each of the date and time start point and the date and time end point. It is also possible to specify the period during which The search result is displayed in the result display field 37 for each item such as “date and time”, “judgment”, “image”, and “match rate”.

  In the present embodiment, as the camera 20, a camera used in a general monitoring system can be used. In addition, the camera 20 may be an IP (Internet Protocol) camera that can output image data into a digital signal via a network, or a camera that outputs image data in an analog signal state. Also good.

  Next, operation | movement of the monitoring apparatus 10 in embodiment of this invention is demonstrated using FIG. FIG. 4 is a flowchart showing the basic operation of the monitoring apparatus according to the embodiment of the present invention. In the following description, FIG. 1 is taken into consideration as appropriate. Moreover, in this Embodiment, the monitoring method in this Embodiment is implemented by operating the monitoring apparatus 10. FIG. Therefore, the description of the monitoring method in the present embodiment is replaced with the following description of the operation of the monitoring device 10.

  As shown in FIG. 4, first, the imaging unit 11 acquires image data of a person's face existing in the set area from the camera 20 (step A1). Note that, as described above, the camera 20 captures images at a set interval regardless of whether or not a person exists in the set area. Therefore, the image data acquired by the imaging unit 11 from the camera 20 is not included in the image data. In some cases, the face of a person is not included. In this case, step A1 is executed again.

  Next, the calculation unit 12 accesses the storage unit 13 to acquire image data of a person's face registered in advance, and the storage unit 13 stores the image data (imaging data) acquired by the imaging unit 11. Contrast with the image data. Then, based on the comparison result, the calculation unit 12 calculates a ratio (match rate) that the photographed face matches the face of a person registered in advance (step A2). Although not shown in FIG. 4, as described above, when the image data of the face of the person registered in advance cannot be acquired and the coincidence rate cannot be calculated, step S2 is performed instead of step A2. A5 is executed.

  Next, the determination unit 14 performs stepwise determination according to the value of the coincidence rate calculated by the calculation unit 12 using the determination criteria shown in FIG. 2 (step A3). Next, the determination unit 14 issues a warning to the administrator according to the determination result (step A4).

  Next, the determination unit 14 stores the determination result in step A3 and the image data that is the basis of the determination in the database 15 and accumulates it as a history (step A5). In the present embodiment, in step A5, the match rate calculated in step A2 is also stored in the database 15. If the coincidence rate cannot be calculated in step A2, the image data (imaging data) acquired in step A1 and the coincidence rate (0%) are stored in the database 15.

  Moreover, the process in the monitoring apparatus 10 is once complete | finished by execution of step A5. However, step A1 is executed again after the elapse of the set time or immediately after the end of step A5. In the monitoring device 10, steps A1 to A5 are repeatedly executed.

  Further, in the present embodiment, the monitoring apparatus 10 also executes a search process separately from steps A1 to A7. Here, the operation of the monitoring apparatus 10 in the search process will be described with reference to FIG. FIG. 5 is a flowchart showing search processing of the monitoring apparatus according to the embodiment of the present invention.

  As shown in FIG. 5, first, the search unit 16 determines whether or not a search is instructed via the search screen 31 (see FIG. 4) (step B1). If the search is not instructed as a result of the determination in step B1, the search unit 16 enters a standby state. On the other hand, if the search is instructed as a result of the determination in step B1, the search unit 16 executes step B2.

  In step B2, the search unit 16 accesses the database 15, and according to the information (search conditions) input via the search screen 31, the past data from the database 15, that is, the past judgment, the judgment. The image data that is the basis of the and the matching rate are acquired.

  Next, the search unit displays the acquired past data (search result) on the screen of the display device 30 (step B3). Specifically, in the present embodiment, as shown in FIG. 4, the search result is displayed in the result display column 37 for each item such as “date and time”, “judgment”, “image”, and “match rate”. Is done.

  As described above, according to the present embodiment, as described above, monitoring of a suspicious person can be suppressed while reducing the burden on the administrator. In addition, since it is possible to search for past judgments at each judgment stage, the administrator can easily perform a behavior analysis of a suspicious person.

  Moreover, the program in this Embodiment should just be a program which makes a computer perform step A1-A5 shown in FIG. 5, and step B1-B3 shown in FIG. By installing and executing this program on a computer, the monitoring device 10 and the monitoring method in the present embodiment can be realized.

  In this case, a CPU (Central Processing Unit) of the computer functions as the imaging unit 11, the calculation unit 12, the determination unit 14, and the search unit 16, and performs processing. In the present embodiment, a storage device such as a hard disk provided in the computer can function as the storage unit 13 and the database 15.

  Here, a computer that implements the monitoring apparatus 10 by executing the program according to the embodiment will be described with reference to FIG. FIG. 6 is a block diagram illustrating an example of a computer that implements the monitoring device according to the embodiment of the present invention.

  As shown in FIG. 6, the computer 110 includes a CPU 111, a main memory 112, a storage device 113, an input interface 114, a display controller 115, a data reader / writer 116, and a communication interface 117. These units are connected to each other via a bus 121 so that data communication is possible.

  The CPU 111 performs various calculations by developing the program (code) in the present embodiment stored in the storage device 113 in the main memory 112 and executing them in a predetermined order. The main memory 112 is typically a volatile storage device such as a DRAM (Dynamic Random Access Memory). Further, the program in the present embodiment is provided in a state of being stored in a computer-readable recording medium 120. Note that the program in the present embodiment may be distributed on the Internet connected via the communication interface 117.

  Specific examples of the storage device 113 include a hard disk and a semiconductor storage device such as a flash memory. The input interface 114 mediates data transmission between the CPU 111 and an input device 118 such as a keyboard and a mouse. The display controller 115 is connected to the display device 119 and controls display on the display device 119. The data reader / writer 116 mediates data transmission between the CPU 111 and the recording medium 120, and reads a program from the recording medium 120 and writes a processing result in the computer 110 to the recording medium 120. The communication interface 117 mediates data transmission between the CPU 111 and another computer.

  Specific examples of the recording medium 120 include general-purpose semiconductor storage devices such as CF (Compact Flash) and SD (Secure Digital), magnetic storage media such as a flexible disk, or CD-ROM (Compact Disk). Optical storage media such as Read Only Memory).

  ADVANTAGE OF THE INVENTION According to this invention, when monitoring a suspicious person, the monitoring omission of a suspicious person can be suppressed, reducing an administrator's burden. The present invention is useful in the field of monitoring devices and monitoring methods.

DESCRIPTION OF SYMBOLS 10 Monitoring apparatus 11 Imaging part 12 Calculation part 13 Storage part 14 Judgment part 15 Database 16 Search part 20 Camera 21 Person 22 Store 30 Display apparatus 31 Search screen 32, 33, 34, 35 Check box 36 Search button 37 Result display column 110 Computer 111 CPU
112 Main Memory 113 Storage Device 114 Input Interface 115 Display Controller 116 Data Reader / Writer 117 Communication Interface 118 Input Device 119 Display Device 120 Recording Medium 121 Bus

Claims (6)

An imaging unit that causes a camera to capture a face of a person existing in a set area and obtains image data of the captured face;
A storage unit that stores pre-registered person face image data;
Comparing the image data acquired by the imaging unit and the image data stored in the storage unit, the ratio of the face that has been captured and the face of a person registered in advance is calculated. An arithmetic unit;
A determination unit that performs stepwise determination according to the value of the ratio calculated by the calculation unit;
A database for storing the result of the determination and the ratio and the image data acquired by the imaging unit, which are the basis of the determination, in association with each other when the determination is performed by the determination unit;
A search unit that receives input of information indicating the stepwise determination, and executes a search for the database based on the received information;
A monitoring device comprising:   The monitoring apparatus according to claim 1, wherein the determination unit performs a stepwise warning according to the determined step. (A) causing the camera to capture a face of a person existing in the set area, and obtaining image data of the captured face;
(B) The image data acquired in the step (a) and the image data of the face of the person registered in advance are compared, and the photographed face matches the face of the person registered in advance. Calculating the percentage of steps, and
(C) performing stepwise determination according to the value of the ratio calculated in the step (b);
(D) Each time a determination is made in step (c), the result of the determination and the ratio and the image data acquired in step (a), which are the basis of the determination, are stored in a database. , Associate and accumulate, steps,
(E) receiving an input of information indicating the stepwise determination, and executing a search for the database based on the received information;
The monitoring method characterized by having. ( F ) The monitoring method according to claim 3 , further comprising a step of performing stepwise warning according to the step determined by the step (c). On the computer,
(A) causing the camera to capture a face of a person existing in the set area, and obtaining image data of the captured face;
(B) The image data acquired in the step (a) and the image data of the face of the person registered in advance are compared, and the photographed face matches the face of the person registered in advance. Calculating the percentage of steps, and
(C) performing stepwise determination according to the value of the ratio calculated in the step (b);
(D) Each time a determination is made in step (c), the result of the determination and the ratio and the image data acquired in step (a), which are the basis of the determination, are stored in a database. , Associate and accumulate, steps,
(E) receiving an input of information indicating the stepwise determination, and executing a search for the database based on the received information;
A program that executes ( F ) The program according to claim 5 , further causing the computer to execute a step of performing stepwise warning according to the step determined by the step of (c).

Images