JP4135731B2 - Door phone system - Google Patents

Description

  The present invention relates to a door phone system.

  Conventionally, as a doorphone system that has a doorphone main unit installed indoors and a doorphone child unit installed outdoors, and makes calls between indoors and outdoors, the presence of intruders and visitors in the detection area is projected and confirmed as a video. For this reason, some cameras with sensors are installed outdoors and monitored on the side of the doorphone master. In such doorphone systems, when a person enters the detection area, an image is transmitted to the doorphone master. Recording.

As a human body sensing method for detecting the intrusion of a person into the detection region, a method for detecting an image signal of a surveillance camera using an image processing type human body detector or a hot-wire human body detector is used. When a camera with a sensor equipped with such a human body detection means detects an intrusion of a person, it transmits the current real-time image signal to the intercom base unit following the previous image signal before detection ( For example, see Patent Document 1).
JP 2003-32523 A (paragraph numbers [0036] [0043], FIG. 2 and FIG. 3)

  However, in the above prior art, since the past image signal is transmitted first from the sensor-equipped camera to the doorphone master unit, and the real-time image signal is transmitted after that, the monitor screen of the doorphone master unit has more than the real-time image. The past image is displayed first. For this reason, even if an intruder or the like is detected and an attempt is made to confirm the current situation, the past image is displayed first and the current situation cannot be immediately confirmed.

  There is also a desire to record captured images before and after human body detection and reproduce them later to check the situation at that time.

  The present invention has been made in view of the above-mentioned reasons, and its purpose is that when an intruder or the like is detected with a sensor-equipped camera, the current situation can be immediately confirmed on the doorphone master unit side, and imaging before and after human body detection is performed. The purpose is to provide a doorphone system that can record and play back images and check the situation at that time.

The invention according to claim 1 includes a door phone main unit installed indoors and a door phone sub unit installed outdoors, and enables telephone conversation between indoors and outdoors, and the human body detecting means detects the presence of a person in the detection area. Then, in the door phone system in which the image captured by the camera is monitored by the door phone master unit, the camera detects the presence of a person by the imaging means for capturing the visual field region, the image storing means for storing the captured image signal, and the human body detecting means. In this case, after the real-time image signal that captures the current situation is transmitted to the intercom master unit or at the same time, the human body detection means captures the past image signal that has been captured and stored in the image storage means before detecting the presence of a person. and a transmitting means for transmitting to the indoor apparatus, the doorphone master station, when receiving an image signal from the camera, and displays the previous image Following real-time image monitoring According to the present invention, a real-time image is detected when an intruder or the like is detected by a camera with a sensor, and a recording means for recording a real-time image and a past image, and a reproducing means for reproducing the recorded image. Is displayed so that the current situation can be immediately confirmed on the side of the doorphone master unit, and past images and real-time images before and after human body detection can be recorded, and this recorded image can be played back later to confirm the situation at that time. Also, when detecting a human body, the door phone master unit monitors the real-time image first and then monitors the past image, so you can immediately know the current situation that the householder is concerned about, and the situation before the human body detection. You can also know.

  According to a second aspect of the present invention, in the first aspect, the past image signal transmitted to the intercom master unit is compressed with respect to the time axis, and the real-time image signal is not compressed with respect to the time axis. .

According to the present invention, since the past image signal is compressed, the real-time image and the past image can be effectively monitored within the limited time .

According to a third aspect of the present invention, in the first or second aspect, the reproduction means reproduces a real-time image after reproducing a past image.

According to the present invention, the past image is played back first, and the real-time image is played back later, so that the past image and the real-time image are played back in the order of time and the event can be easily confirmed .

As described above, in the present invention, when an intruder or the like is detected with a sensor-equipped camera, the current situation can be immediately confirmed on the doorphone master unit side, and further, the captured images before and after the human body detection are recorded and reproduced later. You can check the situation at the time, and when detecting a human body, the door phone master unit monitors the real-time image first and then the past image, so you can immediately know the current situation that the householder is interested in. Furthermore, there is an effect that it is possible to know the situation before the human body detection .

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

(Basic configuration)
1 and 2 show the basic configuration of a door phone system, in which a door phone master unit B is installed indoors in a house H, a door phone slave unit C is installed outdoors, and a garden with a light 3a is attached. Camera A is installed.

  First, the sensor-equipped camera A includes an image processing human body detector 1, a hot-wire human body detector (PIR) 2, and a notification unit 3.

  The image processing type human body detector 1 includes an imaging unit 10, an image processing unit 11, a contour image storage unit 12, a YUV / NTSC conversion unit 13, a transmission unit 14, an FPGA 15, a RAM 16, and a signal processing unit 17. And performing image processing on the captured image to detect a human body and transmit the image captured by the imaging unit 10 to the intercom base unit B.

  The imaging unit 10 generates an image sensor that continuously captures the field of view in time series, converts the image output from the image sensor into digital data, generates grayscale image data, and outputs the YUV signal. It consists of a converter. As the imaging device, a solid-state imaging device such as a CCD, a CMOS image sensor, or the like is used. Further, if the device itself outputs a digital signal like a general CMOS camera, the A / D converter at the subsequent stage is not necessary.

  The image processing unit 11 includes a contour extracting unit 11a, a moving contour extracting unit 11b, a moving region detecting unit 11c, and a region feature amount detecting unit 11d.

  The contour extracting unit 11a performs differential processing on the grayscale image data obtained from the imaging unit 10 via the FPGA 15 by using a generally known SOBEL filter or the like to extract edges (contours), and for each image. Are stored in the contour image storage unit 12 for a certain period of time.

  The moving contour extraction unit 11b performs logical synthesis using the time-series edge images stored in the contour image storage unit 12, and creates a synthesized image in which only the edges of the moving object are extracted.

  The movement area detection unit 11c labels the composite image created by the movement outline extraction unit 11b to detect an area corresponding to a moving body (hereinafter referred to as a movement area). If this moving area is represented by a moving frame such as a rectangle circumscribing the outline of the moving object, the amount of data will be reduced and calculation will be easier. Only the edges of can be extracted.

  The area feature quantity detection unit 11d determines the direction value of the moving edge portion in the moving area based on the edge image stored in the contour image storage unit 12 and the moving area of the moving object detected by the moving area detection unit 11c. Extract and create the edge direction value distribution. Then, using this edge direction value distribution as the feature quantity in the edge direction of the moving area, it is determined whether the area movement is due to a disturbance or a person based on the feature quantity in the edge direction. If there is, the human body detection signal is output to the signal processing unit 17. Here, the edge of the human body has more curved parts than the straight part and has a complicated shape, so the edge direction is distributed in all directions, while the edge of the shadow of the structure has many linear components. The edge distribution tends to be a biased distribution.

  In addition, in order to determine whether or not a certain moving area represents a human body, it is also possible to store the edge direction value distribution in a table and compare the distribution with the edge direction value distribution table based on the movement of the human body. .

  The contour image storage unit 12 stores the edge image extracted by the contour extraction unit 11a for a certain period.

  The YUV / NTSC converter 13 converts the YUV signal output from the imaging unit 10 via the FPGA 15 into an NTSC signal.

  The transmission unit 14 transmits the captured image by outputting the NTSC signal output from the YUV / NTSC conversion unit 13 to the intercom base unit B.

  The FPGA 15 performs control and switching to output an image signal (YUV signal) from the imaging unit 10 to the image processing unit 11 and the YUV / NTSC conversion unit 13 and to store the image signal in the RAM 16.

  The signal processing unit 17 is configured by a CPU or the like. The signal processing unit 17 is connected to the hot-wire human body detector 2 to control the operation of each unit of the image processing human body detector 1 and performs notification control of the notification unit 3.

  The heat ray type human body detector 2 detects a human body in the detection region by a method different from that of the image processing type human body detector 1 and does not cause a decrease in sensitivity even at night, and collects heat rays from the detection region. A lens 2a constituting an optical system that emits light, a pyroelectric element 2b that converts a change in condensed heat rays into an electric signal, an amplifier circuit 2c that amplifies the electric signal, and compares the level of the amplified signal with a threshold value And a comparator 2d that detects the stay of a person in the detection area, and outputs a human body detection signal to the signal processing unit 17 when the human body is detected by heat rays emitted from the human body.

  The intercom base unit B includes a receiving unit 4, a signal processing unit 5, a display unit 6, a recording unit 7, a storage unit 7a, and a playback unit 8, and an image signal from the camera A with a sensor. Is received by the receiving unit 4, demodulated by the signal processing unit 5 and displayed on the display unit 6, thereby monitoring the image captured by the sensor-equipped camera A by configuring a monitor unit for the captured image, and further recording. The unit 7 records an image in the storage unit 7 a and the reproduction unit 8 reproduces the recorded image on the display unit 6. In addition, a call is made with the doorphone slave unit C.

  The notification unit 3 includes a light 3a and a buzzer.

  Hereinafter, the image signal transmission operation at the time of human body detection will be described with reference to FIGS. First, the signal processing unit 17 of the sensor camera A stores the image signal from the imaging unit 10 in the RAM 16 at predetermined intervals via the FPGA 15. This image is stored as a still image captured at a predetermined interval (see FIG. 3C).

  Then, the signal processing unit 17 detects the human body detection signal (see FIG. 3A) from the hot-wire human body detector 2 and the human body detection signal (see FIG. b) (refer to b)), it is determined that a human body has been detected when both human body detection signals are input (human body detection timing t1, t2), and a notification operation is performed by the notification unit 3, The image signal is transmitted to the intercom base unit B through the FPGA 15, the YUV / NTSC conversion unit 13, and the transmission unit 14.

  The image signal transmitted from the sensor-equipped camera A to the door phone base unit B is a real-time image signal Sa (corresponding to a moving image obtained by imaging the current situation after human body detection (predetermined period T1 from human body detection timings t1 and t2). 3 (e)) and the past image signal Sb1 corresponding to two still images that are transmitted after the real-time image signal Sa and imaged immediately before the human body detection timings t1 and t2 and stored in the RAM 16. , Sb2 (see FIG. 3D).

  When receiving the image signal from the sensor-equipped camera A, the doorphone master unit B displays only the moving image based on the real-time image signal Sa on the display unit 6. Therefore, when detecting a human body, only the real-time image (moving image) can be monitored by the doorphone master unit B, so that the current situation that the householder cares about can be immediately known, and the sense of security increases.

  The recording unit 7 performs recording by storing the image signal in the storage unit 7a. First, the moving image based on the real-time image signal Sa is recorded in the order in which the image signal is received, and then the past image signal Sb1, A still image based on Sb2 is recorded (see FIG. 3F).

  At the time of the reproduction operation, the reproduction unit 8 reads out the image signal from the storage unit 7a and reproduces the image. At this time, unlike the recorded order, first, the past image is reproduced and then the real-time image is reproduced. Playback is performed (see FIG. 3G). In other words, the image signal to be transmitted is recorded in the order received to reduce the circuit load during recording, and during playback, past images recorded later in time are played back first and recorded earlier in time. By replaying the real-time image later, the past image and the real-time image are replayed in the order of the temporal flow so that the event can be easily confirmed.

  Further, the past image signal while the past image signals Sb1 and Sb2 are being transmitted may be transmitted following the past image signals Sb1 and Sb2.

In this basic configuration , the past image signals Sb1 and Sb2 are transmitted after the real-time image signal Sa is transmitted. However, the past images Sb1 and Sb2 are inserted between frames of the real-time image Sa and transmitted in real time. The image signal Sa and the past image signals Sb1 and Sb2 may be transmitted simultaneously.

( Embodiment 1 )
The configuration of the door phone system of the present embodiment is the same as the basic configuration, and the same components are denoted by the same reference numerals and description thereof is omitted.

  In the present embodiment, the door phone base unit B has three monitor modes, and for the real-time image signal Sa transmitted from the sensor-equipped camera A and the subsequent past image signal Sb (see FIG. 4A). Thus, it is possible to switch between three modes: real-time image + past image monitor (see FIG. 4B), real-time image monitor (see FIG. 4C), and no monitor (see FIG. 4D).

  When a human body is detected during real-time image + past image monitoring, the doorphone master unit B preferentially displays the real-time image Ma on the display unit 6 and then displays the past image Mb, so that the current state of concern of the householder can be immediately known. You can also know the situation before human detection.

When a human body is detected during real-time image monitoring, only the real-time image Ma is displayed on the display unit 6 as in the case of the basic configuration , so that the current situation that the householder is interested in can be immediately known and the sense of security is increased.

  If a human body is detected without a monitor, no image is displayed on the display unit 6 regardless of the presence or absence of an image signal from the camera A with a sensor.

( Embodiment 2 )
The configuration of the door phone system of the present embodiment is the same as that of the first embodiment, and the same components are denoted by the same reference numerals and description thereof is omitted.

  In the first embodiment, the real-time image Sa is transmitted from the sensor-equipped camera A to the intercom base unit B, and then the past image signals Sb1 and Sb2 corresponding to two still images are transmitted. In the present embodiment, FIG. As shown in (a) to (e), when transmitting past image signals, past image signals Sb1 to Sbn corresponding to n still images are compressed with respect to the time axis (for example, 30 fps) and transmitted.

  In the intercom base B, the image signal received by the receiving unit 4 on the display unit 6 is displayed on the display unit 6 over a certain time T3 after the human body detection timing t3. Since the compression is performed, the intercom base B can increase the amount of past image information and monitor many past images, and can effectively monitor the real-time image and the past image within a limited time T3.

( Embodiment 3 )
In the second embodiment , only the past image signal is compressed and transmitted, but in this embodiment, not only the past image signal but also the real-time image signal is compressed and transmitted as shown in FIGS. 6 (a) and 6 (b). . The compression rate of the past image signal and the real-time image signal in this embodiment is low compression (for example, 15 fps).

  In the intercom base unit B, the image signal received by the receiving unit 4 is displayed on the display unit 6 over a certain time T4 after the human body detection timing t4, but in the present embodiment, only the past image signal is displayed. In addition, since the real-time image signal is also compressed, the information amount of the past image increases within the limited time T4, and the current situation can be confirmed.

( Reference example )
The configuration of the door phone system of the present reference example is the same as the basic configuration, and the same components are denoted by the same reference numerals and description thereof is omitted.

  Hereinafter, an image signal transmission operation during human body detection will be described with reference to FIGS. First, the signal processing unit 17 of the sensor camera A stores the image signal from the imaging unit 10 in the RAM 16 at predetermined intervals via the FPGA 15. This image is stored as a still image captured at a predetermined interval (see FIG. 7C).

  The signal processing unit 17 then detects the human body detection signal (see FIG. 7A) from the hot-wire human body detector 2 and the human body detection signal from the image processing unit 11 (see FIG. b) (refer to b)), it is determined that the human body is detected when both human body detection signals are input (human body detection timings t5 and t6), and the notification unit 3 performs a notification operation. The image signal is transmitted to the intercom base unit B through the FPGA 15, the YUV / NTSC conversion unit 13, and the transmission unit 14.

  The image signal transmitted from the sensor-equipped camera A to the doorphone master unit B includes a display real-time image signal Sa for displaying the current state after human body detection on the display unit 6 by the doorphone master unit B, and the doorphone master unit. The recording unit 7 includes recording past image signals Sb1 and Sb2 and a recording real-time image signal Sa ′ for the recording unit 7 to store in the storage unit 7a. Here, the real-time image signal Sa for display is a moving image obtained by imaging the current situation after human body detection (predetermined period T5 from human body detection timings t5 and t6), and is also stored in the RAM 16. The past images Sb1 and Sb2 for recording are two still images that are captured and stored in the RAM 16 immediately before the human body detection timings t5 and t6, and the real-time image signal Sa ′ for recording is stored in the RAM 16. This is a moving image that is generated by reading out the real-time image signal Sa for display and that captures the situation after human detection (predetermined period T5 from human detection timings t5 and t6).

  At the time of human body detection, the transmission unit 14 inserts the recording past images Sb1 and Sb2 between the frames of the display real-time image signal Sa, thereby displaying the display real-time image signal Sa and the recording past images Sb1 and Sb2. Are transmitted in a time-sharing manner. When the transmission of the past recording images Sb1 and Sb2 is completed, the recording real-time image signal Sa ′ and the recording real-time image signal Sa ′ are inserted between the frames of the display real-time image signal Sa. The real-time image signal Sa ′ is transmitted in a time division manner (see FIGS. 7D and 7E).

  When receiving the image signal from the sensor-equipped camera A, the doorphone master unit B displays only the moving image based on the display real-time image signal Sa on the display unit 6. Therefore, when detecting a human body, only the real-time image (moving image) can be monitored by the doorphone master unit B, so that the current situation that the householder cares about can be immediately known, and the sense of security increases.

  The recording unit 7 first records a still image based on the past images Sb1 and Sb2 for recording in the order in which the image signals are received, and then records a moving image based on the real-time image signal Sa ′ for recording (FIG. 7). (Refer to (f)).

  At the time of the reproduction operation, the reproduction unit 8 reads out the image signal from the storage unit 7a, and first reproduces the past image and then reproduces the real-time image in the order in which they are recorded (see FIG. 7G). That is, the circuit load is reduced by recording the image signals to be transmitted in the order in which they are received and reproducing them in the order in which they were recorded.

In this reference example , the display image and the recorded image are transmitted as separate signals. However, a decrease in transmission efficiency can be suppressed by time-division transmission.

  The real-time image signal Sa for display, the past images Sb1 and Sb2 for recording, and the real-time image signal Sa ′ for recording may be transmitted by other multiplex transmission methods, for example, frequency division. In the case of frequency division transmission, for example, the high frequency region is assigned to the real time image signal Sa for display, and the low frequency region is assigned to the past images Sb1 and Sb2 for recording and the real time image signal Sa ′ for recording.

It is a figure which shows the block configuration of the door phone system of the basic composition of this invention. It is a figure which shows the installation condition of a door phone system same as the above. It is a figure which shows the image signal transmission operation | movement of (a)-(g) same as the above. (A)-(d) It is a figure which shows the image monitor operation | movement of Embodiment 1 of this invention. (A)-(e) It is a figure which shows the image signal transmission operation | movement of Embodiment 2 of this invention. (A) (b) It is a figure which shows the image signal transmission operation | movement of Embodiment 3 of this invention. (A)-(g) It is a figure which shows the image signal transmission operation | movement of the reference example of this invention.

Explanation of symbols

A Sensor-equipped camera B Doorphone master unit C Doorphone slave unit 1 Image processing type human body detector 2 Hot wire type human body detector 5 Signal processing unit 6 Display unit 7 Recording unit 8 Playback unit 10 Imaging unit 14 Transmission unit 16 RAM

Claims (3)

A door phone main unit installed indoors and a door phone sub unit installed outdoors allow communication between indoors and outdoors, and when the human body detection means detects the presence of a person in the detection area, an image captured by the camera is displayed. In the door phone system monitored by the door phone master unit,
When the camera detects the presence of a person, the imaging unit that captures the field of view, the image storage unit that stores the captured image signal, and the human body detection unit detect a real-time image signal that captures the current situation in the door phone master unit. After the transmission, or at the same time, including a transmission means for capturing the previous image signal stored in the image storage means and transmitting to the doorphone master unit before the human body detection means detects the presence of a person,
When receiving an image signal from the camera, the intercom master unit includes a monitor unit that displays a past image following the real-time image, a recording unit that records the real-time image and the past image, and a playback unit that reproduces the recorded image. A door phone system characterized by comprising. The door phone system according to claim 1, wherein the past image signal transmitted to the door phone master unit is compressed with respect to the time axis, and the real time image signal is not compressed with respect to the time axis. Before SL reproducing means, according to claim 1 or 2 doorphone system, wherein the reproducing the real-time image from playing the past image.

Images