JP2006155435A - Suspicious individual detector - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To detect any suspicious individual outside a door without requiring large-scale equipment. <P>SOLUTION: A suspicious individual detection system 10 uses a suspicious individual detector 20 to determine whether or not a person 8 outside an entrance door 12 is a suspicious individual. When he or she is regarded as a suspicious individual, this is reported to a TV 30, a data storage 40, a cell phone 60, and a security company's terminal 66 in a residence by use of signal lines 28, 46, 68 and the like. The suspicious individual detector 20 includes an image pickup camera 22, a radio transmitter 24 for transmitting image pickup data thereof to the outside by radio, and a set top box 26 having a function of determining whether or not the person is suspicious based on the image pickup data transmitted from the radio transmitter 24. Whether the person is suspicious or not is determined based on whether or not the face of the person 8 facing forward, i.e., facing the door 12, is recognized to match front face data a plurality of times. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a suspicious person detection device, and more particularly to a suspicious person detection device that detects a suspicious person outside a door that partitions the outside from the inside.

  In order to monitor a suspicious person, it is widely known to provide a monitoring camera in an appropriate place and use the imaged data. In addition, from the image data of the person imaged by the imaging camera, the operation of the person is analyzed. For example, in Patent Literature, detecting the direction of a person's face facing from the image data of a monitoring camera provided in an automatic cash deposit / withdrawal device, etc., and estimating the degree of attention and operation state of the person Is stated.

  Further, Patent Document 2 discloses a method capable of measuring a three-dimensional movement of the head in real time from a face image of an unspecified person with hardware having low calculation ability. Here, the head region is extracted from the image data by extracting the skin color, the luminance of the extracted head region is averaged and normalized, and the eyes and mouth candidates in the head region are determined from the fixed threshold determination. Extract regions. Then, it is described that the three-dimensional posture information of the head estimated from these is used to reproduce both eyes and the mouth area when the target person faces the front. That is, according to this method, it is described that a method capable of calculating at a relatively high speed, such as color area determination and threshold determination, can be used to determine that the target person is facing the front even with hardware having low calculation ability. ing.

Japanese Patent Laid-Open No. 9-147119 JP 2003-108980 A

  According to Patent Document 1, it is possible to determine the gaze direction of the person being photographed from the image data, and according to Patent Document 2, it is possible to determine whether the person being photographed is facing the front from the image data.

  By the way, detection of a suspicious person by a general monitoring camera is performed by sending the image data to a monitor in a monitoring room, and a staff member constantly looks at the screen to find a suspicious behaviour, or the image by the monitoring camera is directly used as a database. It is often accumulated and analyzed for the first time in the event. In addition, it is quite difficult to automatically distinguish a suspicious person from a normal person from only image data, and it is at most possible to determine the direction of the line of sight or whether the face is in front as described above. Thus, in order to reliably detect a suspicious person, a considerably large system is required.

  Therefore, it is difficult to provide a large-scale monitoring system for monitoring suspicious persons in ordinary homes and small offices. Normally, when a doorbell of a front door is used, the outside of the door is viewed from the door's viewing window. Determine if you are a suspicious person. Proceeding with this, an imaging camera is installed outside the door, and if a doorbell rings, a small indoor monitor connected to the imaging camera is used to check whether the visitor is a suspicious person. Yes.

  However, since the small monitor is not always watched, it is difficult to detect a suspicious person who does not ring the doorbell and is scolding outside the door unless he / she is careful.

  As described above, in the related art, a considerably large-scale system is required to reliably detect a suspicious person who is looking outside the door.

  An object of the present invention is to provide a suspicious person detection device capable of detecting a suspicious person outside a door without requiring a large facility. Another object of the present invention is to provide a suspicious person detection device that can detect a suspicious person outside a door that does not require a large facility and does not ring a doorbell. The following means serve at least one of the above purposes.

  The suspicious person detection device according to the present invention is provided on the inside side of a peephole of a door that partitions the outside and the inside, an imaging camera that images the outside from the peephole, and imaging data acquired at each time by the imaging camera Whether each of the acquired image data is the front face data of the face when the person is facing the front by comparing each with the identification database and distinguishing the eyes, mouth and nose of the person A face recognition unit for recognizing whether or not, and a determination unit for determining that there is a suspicious person outside the peephole based on recognition of a plurality of front face data in the face recognition unit, and outputting a suspicious person signal. Features.

  Moreover, it is preferable that the determination unit outputs a suspicious person signal when receiving the recognition result of the front face data continuously from the face recognition unit for a predetermined period. Further, it is preferable that the determination unit issues a suspicious person signal when receiving a recognition result of front face data exceeding the threshold number in a predetermined period from the face recognition unit.

  In addition, the suspicious person detection device according to the present invention includes a monitor activation unit that receives a suspicious person signal from the determination unit, activates the display screen to a monitor having a display screen, and transfers and displays front face data. It is preferable.

  Further, in the suspicious person detection device according to the present invention, a transmission unit that receives a suspicious person signal from the determination unit and transmits a warning signal and front face data accompanying the suspicious person signal to a wireless portable display terminal that is arbitrarily determined in advance. It is preferable to provide.

  Further, in the suspicious person detection device according to the present invention, a suspicious person signal is received from the determination part, and a warning part for notifying a predetermined notification destination is provided when a warning condition is satisfied with reference to a predetermined warning condition. It is preferable to provide.

  With the above-described configuration, the face recognition unit recognizes front face data from data obtained by imaging the outside from the viewing window of the door. That is, it is recognized that there is a person facing the front in the viewing window. Then, the determination unit determines whether the person is a suspicious person based on the recognition result of the plurality of front face data in the face recognition unit. In other words, a person who is facing the front of the peephole seems to be suspicious because he is looking into the peephole or at least looking at the front of the door, but he happens to point his face to the front of the door. It may be. Therefore, on the condition that there are a plurality of front face data, it is determined as a suspicious person.

  The face recognition unit only needs to recognize whether or not the face is facing the front, whether it is an acquaintance or stranger, whether it is suspicious, whether it is dressed, age, gender, etc. I don't need it. For example, what is comprised with the hardware with low calculation capability as described in patent document 2 can be used. Therefore, it is possible to detect a suspicious person outside the door without requiring a large facility.

  Further, since the determination unit outputs a suspicious person signal based on the recognition result of the face recognition unit, it is possible to detect a suspicious person outside the door without requiring a trigger such as a doorbell.

  In addition, as a condition for outputting the suspicious person signal, it is assumed that the recognition result of the front face data is received continuously for a predetermined period of time. You can be a suspicious person facing the front. In addition, since it is assumed that a suspicious person signal is output upon receiving recognition of front face data exceeding the threshold number in a predetermined period of time, for example, peeping through the observation window many times during a short period, or A person who is facing the front of the door can be a suspicious person.

  Further, since the monitor is activated by the suspicious person signal, it is possible to detect the suspicious person outside the door without requiring a trigger such as a doorbell.

  Moreover, since front image data etc. are sent to a wireless portable display terminal by a suspicious person signal, it becomes possible to detect a suspicious person outside the door even when going out.

  In addition, since the notification is made when the warning condition is satisfied, it is possible to protect against a suspicious person.

  As described above, according to the suspicious person detection device of the present invention, it is possible to detect a suspicious person outside the door without requiring a large facility. In addition, it is possible to detect a suspicious person outside the door without ringing a doorbell without requiring a large facility.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. In the following, the suspicious person detection device will be described as using a peephole in the front door in a general home, but it is provided in front of the door even if it is not a peephole from which a human looks into the outside. An imaging hole may be used. The peephole may be provided with an optical system that allows a human to peep and take an image. Moreover, even if it is not a general household, the outside and the inside are separated by doors, for example, each residence having an entrance door in an apartment house such as an apartment or an apartment, an office building having an entrance door, a plurality of offices, etc. It may be each office or office room having an entrance door in an assembly building.

  FIG. 1 is a diagram illustrating a configuration of a suspicious person detection system 10 including a suspicious person detection device 20. The suspicious person detection system 10 determines whether or not the person 8 outside the front door 12 is a suspicious person by using the suspicious person detection device 20 in a general home, and when detecting the suspicious person as a suspicious person, wired / wireless etc. This is a system for informing the TV (30), the data storage device 40, the mobile phone 60, and the security company terminal 66 in the room of the residence by using the signal transmission path of, for example, the signal lines 28, 46, and 68.

  The suspicious person detection device 20 includes an imaging camera 22 provided on the indoor side of the peephole 14 of the door 12, a wireless transmitter 24 that wirelessly transmits imaging data of the imaging camera 22, and signals from the wireless transmitter 24. The set top box 26 having a function of determining whether or not the person 8 is a suspicious person based on the image data of the person 8 is received.

  The imaging camera 22 has a function of constantly passing through the peephole 14 by an internal power source or an external power source (not shown), imaging the state outside the door 12 within the field of view, and outputting the imaging data to the wireless transmitter 24. Have. As the imaging camera 22, a general small imaging camera, for example, a CCD (Charge Coupled Device) type can be used.

  The wireless transmitter 24 is connected to the imaging camera 22 through an appropriate interface, and has a function of receiving imaging data from the imaging camera 22, converting it into a radio signal, and transmitting it from the antenna to the outside. Since the transmission partner of the wireless transmitter 24 is the set top box 26 in the room, this wireless communication is performed by a method suitable for short-range wireless communication, such as a short-range wireless LAN (Local Area Network), a Bluetooth method, or the like. Can be used. As the wireless transmitter 24, a general wireless transmission device suitable for the employed wireless communication method can be used. Depending on indoor conditions, the wireless transmitter 24 may not be used, and the imaging camera 22 may be connected to the set top box 26 with a wired signal line.

  The set-top box 26 analyzes the imaging data of the imaging camera 22 transmitted via the wireless transmitter 24 and outputs a suspicious person signal when determining that the person 8 is a suspicious person based on the image data of the person 8. An electronic device having a function of outputting. When a suspicious person signal is output, data and the like are transmitted to various terminals as described above. First, the suspicious person signal is transmitted to the indoor TV (30) through a plurality of signal lines 28. Therefore, it is convenient that the device that outputs such a suspicious person signal is placed on or near the TV (30), and the name of the set top box 26 is derived from this. The detailed internal configuration of the set top box 26 will be described later.

  The TV (30) is an ordinary TV receiver placed in a room inside the door 12, and is connected to the set top box 26 via a signal line. The TV 30 is related to a suspicious person under the control of the set top box 26 as will be described later. It has a function as a monitor device for displaying information. Therefore, instead of the TV receiver, an appropriate monitor device such as a dedicated display device may be used.

  The data storage device 40 is connected to the set top box 26 via a signal line 46 and has a function of storing data relating to the set top box 26. The data storage device 40 is connected to a signal line 46 via a hub 48, and the signal line 46 is further connected to the Internet 52 via a router / modem 50 and can communicate with the mobile phone 60. The data storage device 40 includes a face image data server 42 that stores face image data that is imaging data, and a mail data server 44 that stores mail data to be updated with the mobile phone 60 from the set top box 26 via the Internet 52. The data is distributed in the hub 48.

  The cellular phone 60 is a wireless portable display terminal having a function of receiving information regarding a suspicious person from the set top box 26 via the Internet 52 and having a display screen 62. Thereby, the holder of the mobile phone 60 can obtain such information regarding the suspicious person from the set top box 26 outside the room, for example, outside. As such a mobile phone, a general mobile phone with a display screen can be used, and its address is registered in the set top box 26.

  The security company terminal 66 is a terminal device arranged in a security company that has a security security contract with the home where the set top box 26 is placed. The security company terminal 66 is connected to the set top box 26 via the signal line 68 and has a function as a report destination for receiving information on the suspicious person. Since it is convenient to use a public telephone line for communication with the security company, the signal line 68 can use a public telephone line, and the address of the security company terminal 66 is registered in the set top box 26.

  FIG. 2 is a block diagram of the set top box 26. The set top box 26 is an electronic circuit block that is housed in a small casing and performs data processing. Specifically, between the CPU (70) and the camera I / F (72) which is an interface between the imaging camera 22 via the wireless transmitter 24 and the TV (30) via the signal line 28. A data communication control unit 76 that communicates with the data storage device 40, the Internet 52, and the mobile phone 60 via a signal line 46, and a signal line 68 that is a public telephone line. And a telephone communication control unit 78 that communicates with the security company terminal 66. These elements are connected to each other by an internal bus.

  The CPU (70) receives and analyzes imaging data from the imaging camera 22, and has a function of recognizing whether or not it is front face data of a face when a person faces the front, a face recognition unit A determination unit 82 having a function of determining whether or not the person is a suspicious person based on the recognition result 80 is provided. The determination unit 82 includes a suspicious person signal output module 84 having a function of outputting a suspicious person signal when it is determined to be a suspicious person. Further, the CPU (70) further transmits data and the like to the monitor activation unit 86, the data storage device 40, and the mobile phone 60 having a function of issuing a command to activate the TV (30) as a monitor based on the suspicious person signal. A data transmission unit 88 having a function and a reporting unit 90 having a function of reporting to the security company terminal 66 are provided. These functions can be realized by software, specifically, by executing a corresponding suspicious person detection program. Moreover, you may comprise so that a part of each function may be implement | achieved by hardware.

  The operation of the suspicious person detection system 10 including the suspicious person detection apparatus 20 having the above-described configuration, in particular, each function of the CPU (70) of the set top box 26 will be described with reference to flowcharts. FIG. 3 is a flowchart showing a procedure for detecting a suspicious person and displaying the suspicious person. This procedure is started when the suspicious person detection program is first activated in the set top box 26. When this program is activated, initialization and the like are performed, and imaging data from the imaging camera 22 is received (S10). Specifically, a signal from the wireless transmitter 24 is captured in time series via the camera I / F (72) by the function of the CPU (70) to acquire image data.

  Next, the image data at each time is processed by the function of the face recognition unit 80 of the CPU (70), and face recognition is performed as to whether or not the face data is the face when the person faces the front (S12). . More specifically, for each piece of imaging data at each time, it is determined whether or not the entire one piece of imaging data is data representing the front on a human face. In face recognition, it is only necessary to judge and recognize whether or not the entire image data is front face data, and no other recognition is required. For example, it is not necessary to determine whether the person is an acquaintance, suspicious behavior, dress, age, sex, or the like.

  The method described in Patent Document 2 can be used to determine whether the imaging data is front face data. That is, the skin color is extracted from the entire imaging data, the head region is extracted, the luminance of the extracted head region is averaged and normalized, and the candidate regions of both eyes and mouth in the head region are determined based on the fixed threshold determination. Extract. Then, using the three-dimensional posture information of the head estimated from these, both eyes and the mouth area when the target person faces the front are reproduced. By comparing the eyes and mouth area of the head area reproduced in this way with criteria such as an identification database, whether the reproduced one can be recognized as a face when a person faces the front Decide if. The identification database refers to the relationship between the eyes and mouth in the skin color area when a person is facing the front, and can be obtained by categorizing and organizing various face data.

  Such recognition / recognition of face-front data uses a technique that can be calculated at a relatively high speed, such as color area discrimination, threshold discrimination, and coincidence judgment by comparison with an identification database, as described above. This can be realized by executing a corresponding program using hardware, for example, a general microprocessor. The result of the determination recognition is sent to the determination unit 82 of the CPU (70).

  Next, by the function of the determination unit 82, the recognition result of the plurality of front face data is compared with the suspicious person condition to determine whether the person 8 is a suspicious person (S14). As the suspicious person condition, the recognition result of the front face data can be received continuously for a predetermined period. For example, it is possible to set the suspicious person condition to set 30 seconds as an arbitrary period and receive the recognition result that the face front data is 30 seconds continuously. That is, the fact that the front of the face is directed toward the door 12 for 30 seconds continuously means that the person 8 does not face the door 12 and is consciously scolding the door 12. This is because it can be considered.

  As another suspicious person condition, it is possible to receive a recognition result of front face data exceeding a threshold number in a predetermined period. For example, the suspicious person condition may be that an arbitrary period is 2 minutes, the threshold is 5 times, and the recognition result that the face front data is received more than 5 times in 2 minutes. That is, it is considered that the person 8 facing the door 12 over and over again is not a suspicious person who is consciously scolding the door 12 instead of facing the door 12. Because it can.

  If it is not determined that the suspicious person condition is satisfied, the process of S14 is continued as it is. If it is determined that the suspicious person condition is satisfied, a suspicious person signal is output by the function of the suspicious person signal output module 84 of the determining unit 82 (S16). Using the suspicious person signal, notification thereof, transmission of front face data, and the like are performed as follows.

  First, when a suspicious person signal is output, the screen of the TV (30) as a monitor device is activated by the function of the monitor activation unit 86 (S20). Specifically, a monitor power supply control signal is generated from the output of the suspicious person signal, and further, the front face data is converted into a TV display signal, for example, an NTSC signal, via the monitor I / F (74) and the signal line 28, Output to the TV (30). In the TV (30), when the power is not yet turned on, the power is turned on and the operation is started by the received monitor power control signal. Then, the front face data converted and transmitted to the NTSC signal is displayed on the display screen 32 of the TV (30) as an image. When it is projected, you may make a sound such as chimes. In addition, on the display screen 32, “This screen is an image of a person outside the door. You may display a suspicious person notification message such as “I am talking.” As a result, a person in the room can know that there is a suspicious person outside the door and can see the front face of the person without a ringing bell.

  When the suspicious person signal is output, the front face data is transmitted by the function of the data transmission unit 88 (S22). Specifically, an access signal to the data storage device 40 is generated based on the output of the suspicious person signal, and the front face data is converted into a storage data format associated with time data or the like. Then, the data is transmitted to the data storage device 40 via the data communication control unit 76 and the signal line 46. The data storage device 40 stores the front face data and the like transmitted to the face image data server 42 in accordance with the received access signal.

  At the same time, an access signal for the mobile phone 60 in which the e-mail address is registered in advance is generated from the output of the suspicious person signal, and the front face data is converted into a display signal for displaying on the display screen 62 of the mobile phone 60. Then, it is transmitted to the cellular phone 60 via the Internet 52 (S24). In the cellular phone 60, the received access signal is turned on when the power is not yet turned on, and its operation is started. Then, the front face data converted into the display signal output and transmitted is displayed on the display screen 62 of the mobile phone 60 as an image. When projected, a notification sound such as a chime or a notification light such as a flash may be emitted. On the display screen 62, “This screen is an image of a person outside the door. You may display a suspicious person notification message such as “I'm hitting the door.” Thus, the holder of the mobile phone 60 can know that there is a suspicious person outside the door in his / her residence and see the front face even when he / she is out. The content of the mail communication to the mobile phone 60 is stored in the mail data server 44 of the data storage device 40.

  Further, the function of the reporting unit 90 compares the output status of the suspicious person signal with the warning condition, and determines whether or not to report to the security company (S18). As a warning condition, it can be said that a suspicious person signal was output in a predetermined time zone. For example, it is possible to define an arbitrary time zone from 10:00 p.m. at night to 5 o'clock in the next morning and output a suspicious person signal during this time zone as a warning condition. That is, it can be considered that the detection of a person who satisfies the suspicious person in such a time zone should be wary.

  As another alert condition, a suspicious person signal may be output during a predetermined period. For example, the absence period such as when the whole family is traveling can be defined as an arbitrary period, and the warning condition can be that a suspicious person signal is output during this period. That is, even if a person who satisfies the suspicious person is detected during such a period, the family and the like are far away from the residence, so it is considered that the security company should be alerted.

  When it is not determined that the warning condition is satisfied, the process of S18 is continued as it is. If it is determined that the warning condition is satisfied, the notification unit 90 notifies the security company terminal 66 registered in advance of a warning request by, for example, synthetic voice via the signal line 68 that is a telephone line. (S26). At the same time, front face data and data such as the time may be transmitted using a separate transmission means.

It is a figure which shows the structure of the suspicious person detection system containing the suspicious person detection apparatus of embodiment which concerns on this invention. It is a block diagram of the set top box in the embodiment according to the present invention. It is a flowchart which shows procedures, such as a suspicious person detection and its display in embodiment which concerns on this invention.

Explanation of symbols

  8 persons, 10 suspicious person detection system, 12 door, 14 peephole, 20 suspicious person detection device, 22 imaging camera, 24 wireless transmitter, 26 set top box, 28, 46, 68 signal line, 30 TV, 32, 62 Display screen, 40 Data storage device, 42 Face image data server, 44 Mail data server, 52 Internet, 60 Mobile phone, 66 Security company terminal, 70 CPU, 72 Camera I / F, 74 Monitor I / F, 76 Data communication control Unit, 78 telephone communication control unit, 80 face recognition unit, 82 determination unit, 84 suspicious person signal output module, 86 monitor activation unit, 88 data transmission unit, 90 reporting unit.

Claims (6)

An imaging camera provided on the inside of the door of the peephole of the door that partitions the outside and the inside, and imaging the outside from the peephole;
By processing the imaging data acquired at each time by the imaging camera and comparing the eyes, mouth and nose of the person compared with the identification database, the person faces the front for each of the acquired imaging data. A face recognition unit for recognizing whether the face data of the face when
Based on the recognition result of the plurality of front face data in the face recognition unit, a determination unit that determines that there is a suspicious person outside the peephole and outputs a suspicious person signal;
A suspicious person detection device comprising: In the suspicious person detection device according to claim 1,
The decision part
A suspicious person detection device that outputs a suspicious person signal when receiving a recognition result of front face data continuously from a face recognition unit for a predetermined period. In the suspicious person detection device according to claim 1,
The decision part
A suspicious person detection device which outputs a suspicious person signal when receiving a recognition result of front face data exceeding a threshold number of times in a predetermined period from a face recognition unit. In the suspicious person detection device according to claim 1,
A suspicious person detection device comprising: a monitor activation unit that receives a suspicious person signal from a determination unit, activates a display screen to a monitor having a display screen, and transfers and displays front face data. In the suspicious person detection device according to claim 1,
A suspicious person detection device comprising: a transmission unit that receives a suspicious person signal from a determination unit and transmits a warning signal and front face data associated with the suspicious person signal to a wireless portable display terminal arbitrarily determined in advance. In the suspicious person detection device according to claim 1,
A suspicious person detection apparatus comprising: a notification unit that receives a suspicious person signal from a determination unit, refers to a predetermined warning condition, and notifies a predetermined notification destination when a warning condition is satisfied.

Images