JP2007243270A - Video image surveillance system and method therefor - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To select a video image corresponding to a request from among a plurality of camera video images while the feature amount of a person to be monitored is set in advance, and output the selected video image. <P>SOLUTION: The situation of a surveillance area is made into a video image by imaging devices 12a-12n, and image measuring devices 13a-13n measure the feature amount of the person from the video images outputted from the imaging devices 12a-12n. An output video image switching device 14 allocates video images outputted into surveillance monitors 15a-15k in response to setting conditions out of the feature amount of the person measured in the image measuring devices 13a-13n, and the video images outputted by the output video image switching device 14 are displayed on the surveillance monitors 15a-15k. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a video monitoring system and method for monitoring the movement of a person in a monitoring area using video from a plurality of television cameras.

  In general, in a video monitoring system that monitors the movement of a person in a monitoring area using video from a plurality of TV cameras, a method in which a plurality of camera videos are displayed on a monitor and visually confirmed by a supervisor is used. ing. A method for displaying images on multiple monitors to display multiple camera images, a method for displaying multiple images by dividing one screen, a method for switching and displaying images in order at regular time intervals, etc. When a supervisor finds a suspicious person from a plurality of images displayed by these methods, the person is monitored by switching the picture according to the judgment of the supervisor. In addition, in a video surveillance system that performs unattended surveillance using video from a plurality of television cameras, the presence or absence of a person in the surveillance area is determined by image processing, and the result is output.

As such a video surveillance system, there are a surveillance camera that captures the inside of a surveillance area, an intrusion detection device that detects the presence and location of an intruder from the image signal of the camera, and a control device that performs camera angle control based on the detection output There is an unmanned intrusion monitoring device (see, for example, Patent Document 1). In addition, as a behavior measurement technique for quantifying a person's behavior in a video by image processing, a video means for visualizing a monitoring area, an image measurement means for measuring human behavior information, and a person's behavior are quantified. There is an information collection system including information creation means (see, for example, Patent Document 2).
JP-A-3-226195 JP-A-2005-33518

  However, since the video monitoring system of Patent Document 1 is intended to detect the presence or absence of an intruder, it cannot be applied to discriminating and outputting the characteristics of the person being monitored.

  In addition, in the behavior measurement technology of Patent Document 2, information related to a person's behavior and an object with which the person has contacted is quantified. It cannot be measured.

  The present invention has been made in order to solve the above-described problems. A feature amount of a person to be monitored is set in advance, and an image according to a request is selected from a camera image and output. An object of the present invention is to provide a video surveillance system and method.

  An image monitoring system according to the present invention includes an imaging device that visualizes a state of a monitoring area, an image measuring device that measures a feature amount of a person from a video output from the imaging device, and a person measured by the image measuring device. An output video switching device for allocating a video for outputting a feature amount according to a setting condition, and a monitor for displaying the video output by the output video switching device.

  According to the present invention, since the feature amount is set in advance, it is possible to select and output a video according to the request from the camera video, thereby reducing the burden on the observer in the long-time monitoring work and monitoring. The area can be monitored efficiently.

(First embodiment)
FIG. 1 is a block diagram of a video surveillance system according to the first embodiment of the present invention. A plurality of imaging devices 12a to 12i are installed at a position where the monitoring area 11a can be imaged, and similarly, a plurality of imaging devices 12a at a position where the monitoring area 11b can be imaged is also set for another monitoring area 11b. Imaging devices 12j to 12n are installed. The images of the respective imaging devices 12a to 12n are input to the image measuring devices 13a to 13n, respectively. The image measuring devices 13a to 13n measure the feature amount of the person to be monitored.

  The output video switching device 14 assigns video to be output to the monitor monitors 15a to 15k based on the measurement results of the image measuring devices 13a to 13n and the image output conditions set in advance. The monitoring monitors 15a to 15k display the video assigned by the output video switching device 14.

  The plurality of imaging devices 12a to 12n installed in the monitoring areas 11a and 11b constantly output video information in the monitoring areas 11a and 11b to the image measuring devices 13a to 13n. That is, the imaging devices 12a to 12n condense the images of the monitoring areas 11a and 11b onto the photoelectric conversion element by the optical lens, convert the electrical output signal into the video format or the image format, and output the image to the image measurement devices 13a to 13n. Yes.

  The types of the imaging devices 12a to 12n are changed according to the shooting purpose. For example, in an environment where a constant illuminance is maintained, such as indoors, monitoring is performed by visualizing visible light, but the outdoor where the constant illuminance is not maintained. In particular, for monitoring at night, an imaging device that visualizes the amount of infrared rays is used. In addition, even when indoors, when the infrared radiation amount of a person is used as a feature amount, monitoring is performed by imaging the infrared radiation amount.

  Each video or each image output from the imaging devices 12a to 12n is sent to dedicated image measuring devices 13a to 13n to which the imaging devices 12a to 12n are connected. The image is transferred to a memory or a recording medium in the image measuring devices 13a to 13n, and the video is converted into an image by a built-in A / D converter and transferred to the memory or the recording medium.

  Each of the image measuring devices 13a to 13n detects the position of a person from a time-series image in a memory or a recording medium, and measures the person's action state and physical feature amount. A person's action state corresponds to information about a person's movement such as a person's action trajectory and action range. The physical characteristics of a person correspond to information such as gender, height, and clothes. A monitor who requests video output to the monitoring monitor sets the monitoring target information in the output video switching device 14 in advance. The output video switching device 14 outputs video to the requested monitoring monitors 15a to 15k when the feature amount of the person output from the image measuring devices 13a to 13n satisfies the setting condition.

  FIG. 2 is a block diagram of the output video switching device 14 according to the first embodiment of the present invention. The output video switching device 14 includes an image output condition setting unit 16, a video switching table 17, and a divided display setting unit 18. The image output condition setting unit 16 sets conditions for specifying the feature amount of the monitoring target video, and includes an action trajectory setting unit 19, a physical feature setting unit 20, an action date and time setting unit 21, and an action range setting unit 22. I have.

  FIG. 3 is an explanatory diagram of a person's action trajectory setting condition set by the action trajectory setting unit 19. As shown in FIG. 3, the action trajectory setting unit 19 sets an output condition requested by each of the monitoring monitors 15 a to 15 k for information related to a person's action trajectory.

  For example, in a commercial facility such as a department store or a supermarket, when a person's behavior is measured by the imaging devices 12a to 12n installed at entrances, passages, sales floors, etc., a person enters each of the monitoring areas 11a and 11b. The movement trajectory is tracked and the action trajectory is measured.

  An action trajectory that seems to be suspicious is set in advance, such as a person who hesitates in the monitoring areas 11a and 11b, a person who stays for a long time, or a person who makes an unnatural movement in front of a product shelf. Thereby, the video switching table 17 as shown in FIG. 4 is automatically determined, and the video satisfying the setting condition is displayed on the monitoring monitors 15a to 15k. For example, the camera (imaging device) C1 displays and outputs video satisfying the setting condition on the monitor monitor M2, and the camera C3 displays and outputs video satisfying the setting condition on the monitor monitor M4. In this way, by setting a person's movement such as a person's action trajectory and staying time in the action trajectory setting unit 19 of the output video switching device 14, a suspicious person can be detected and displayed on the monitoring monitors 15a to 15k. it can.

  FIG. 5 is an explanatory diagram of a person's physical feature setting condition set by the physical feature setting unit 20. As shown in FIG. 5, the physical feature setting unit 20 sets output conditions required by the monitoring monitors 15 a to 15 k for information such as a person's sex, age, height, body shape, hairstyle, and clothing.

  For example, in a commercial facility, when searching for a lost child in a store, conditions such as height and clothes information are set. In this case, the determination is automatically made by the video switching table 17 as shown in FIG. Thereby, since the image | video which satisfy | fills setting conditions is displayed on the monitor monitors 15a-15k, the child who became lost can be displayed on the monitor monitors 15a-15k. That is, by setting the physical characteristics of a person, the person having the characteristics can be displayed on the monitoring monitors 15a to 15k.

  FIG. 6 is an explanatory diagram of the action date and time setting conditions of the person set by the action date and time setting unit 21. As shown in FIG. 6, the action date and time setting unit 21 sets output conditions required by the monitoring monitors 15 a to 15 k for information such as business days, store business hours, or employee scheduled work hours.

  For example, when monitoring the unattended state in the store outside the business hours of the store, the presence / absence of a person in the monitoring areas 11a and 11b is set as a condition. Also in this case, the video switching table 17 as shown in FIG. 4 is automatically discriminated, and when there are persons in the monitoring areas 11a and 11b, they are displayed on the monitoring monitors 15a to 15k. Thereby, the person who acts other than the predetermined date and time can be displayed on the monitoring monitors 15a to 15k.

  FIG. 7 is an explanatory diagram of a person's action range setting condition set by the action range setting unit 22. As shown in FIG. 7, the action range setting unit 22 sets output conditions required by the monitoring monitors 15 a to 15 k for information such as an entry prohibited area and a dangerous place.

  For example, when monitoring the entry / exit to the restricted entry area except for employees wearing uniforms, detection of persons other than employees is set in the areas set in the monitoring areas 11a and 11b. Also in this case, it is automatically determined by the video switching table 17 as shown in FIG. 4, and when there is a person who illegally enters the prohibited area in the monitoring areas 11a and 11b, it is displayed on the monitoring monitors 15a to 15k. Thereby, the person who committed the approach to the restricted entry area can be displayed on the monitoring monitors 15a to 15k.

  Next, the divided display setting unit 18 of the output video switching device 14 divides and displays the screen displayed on one monitoring monitor 15. The division display setting unit 18 sets the division number manually or automatically.

  For example, when there are a plurality of videos that satisfy the setting conditions given by the setting units 19 to 22 of the image output condition setting unit 16, the screen displayed on one monitoring monitor 15 is divided and displayed. FIG. 8 is an explanatory diagram of a display screen divided by the divided display setting unit 18. As shown in FIG. 8, the monitor screen is divided into four to display a plurality of images simultaneously. As a result, the persons captured by the plurality of imaging devices 12a to 12n can be simultaneously displayed on the screen.

  Although FIG. 8 shows a display screen divided into four, it may be divided into 16 display screens. In addition, for this divided display setting, 4 or 16 images are converted into a video signal in a state of being collectively displayed on the screen and displayed on the monitor monitor 15, or the monitor display is used for high-definition image display. Although there is a method of displaying, any of them may be used. FIG. 8 shows a case where it is displayed on the monitor 15.

  Here, the video switching table 17 of the output video switching device 14 will be described. The video switching table 17 is a table for allocating videos of the imaging devices 12a to 12n based on the setting conditions given from the setting units 19 to 22 of the image output condition setting unit 16 by the operators of the monitoring monitors 15a to 15n. .

  FIG. 9 is a flowchart showing a procedure for registering setting conditions in the video switching table 17. The operator of each of the monitoring monitors 15a to 15n registers the video conditions to be monitored in advance in the table according to the procedure shown in FIG. First, an action locus setting condition is set (S1), a physical feature setting condition is set (S2), an action date setting condition is set (S3), and an action range setting condition is set (S4). Then, whether or not to register in the video switching table 17 is confirmed and registered (S5).

  In this case, it is possible to register a plurality of items. For example, the monitoring monitors 15a to 15n may have a behavior trajectory—long stay (FIG. 3), physical features—clothing (setting conditions (video output conditions) shown in FIGS. 3, 5, 6, and 7). When (cap) (FIG. 5), action date-holiday (FIG. 6), action range-emergency passage (FIG. 6) are set, the process is executed according to the procedure shown in FIG.

  FIG. 10 is a flowchart showing the operation of the video surveillance system according to the first embodiment of the present invention. In FIG. 10, the images of the imaging devices 12a to 12n are processed by one or a plurality of image measuring devices 13a to 13n, and measurement is performed on four items of behavior trajectory, physical characteristics, behavior date and time, and behavior range. (S6). The measurement result is written and stored in the feature amount database 23. Then, a process for creating the image switching table 17 is performed (S7), and a display process is performed (S8).

  FIG. 11 is a flowchart showing the contents of creation processing of the image switching table 17. First, measurement data is read from the feature amount database 23 saved by the image measurement process (S9). Next, the number of monitors having a monitoring request is detected (S10), and the monitor number Mn from 1 is assigned to each (S11). With reference to the condition table for the monitor number Mn from 1 to the number of units (S12), it is determined whether or not there is an image satisfying the condition in the feature amount database 23 (S13). If there is no video satisfying the monitor number Mn condition table, the monitor number Mn is incremented and the process returns to step S12 (S14).

  Here, when four items are set as described above, a condition table as shown in FIG. 12 is obtained. When the video of each camera number (imaging device number) Cn is satisfied for the condition of M1 with the monitor number being 1, registration processing is performed in this video switching table 17 (S15). The video switching table 17 in FIG. 13 means that the C2 video is satisfied, and the C2 video is output to M1. FIG. 14 shows an example of the video output of the monitoring monitor in that case. Accordingly, it is possible to determine whether there is a video of the imaging devices 12a to 12n that satisfies the condition among the plurality of imaging devices 12a to 12n, and to output the video according to the request to the monitoring monitors 15a to 15k. .

  According to the first embodiment, since various feature quantities of a person to be monitored are set in advance, it is possible to display videos according to requests on the monitor monitors 15a to 15k. As a result, it is possible to reduce the burden on the monitoring staff during long-time monitoring work and to efficiently monitor a plurality of monitoring areas.

  Further, by installing the imaging devices 12a to 12n so that there are no blind spots between the monitoring areas 11a and 11b, and evaluating the connection of the images output from these imaging devices 12a to 12n, continuous action information of the person Can be obtained. In addition, wired and wireless communication networks may be used as information communication means, and an efficient form may be used in situations where wiring is difficult or in remote locations.

(Second Embodiment)
FIG. 15 is a block diagram of a video surveillance system according to the second embodiment of the present invention. This second embodiment is different from the first embodiment shown in FIG. 1 in that the image measuring devices 13a to 13n are switched by switching the video signals imaged by the imaging devices 12a to 12n at a fixed time or an arbitrary time distribution. Is provided with an input video switching device 24 for outputting to the screen. The same elements as those in FIG. 1 are denoted by the same reference numerals, and redundant description is omitted.

  In FIG. 15, video signals from a plurality of imaging devices 12a to 12n are input to an input video switching device 24 and output to at least one image measuring device 13a to 13n at least for a video switched at a predetermined time or arbitrary time distribution. To do. Since the switched video is output to the image measurement devices 13a to 13n, the number of image measurement devices can be reduced.

  According to the second embodiment, since the switched video is output to the image measuring devices 13a to 13n by the input video switching device 24, the number of image measuring devices can be reduced and efficient monitoring can be performed. . This is effective when the video monitoring time is relatively long and the image measurement is not so burdened.

(Third embodiment)
FIG. 16 is a block diagram of a video surveillance system according to the third embodiment of the present invention. Compared to the first embodiment shown in FIG. 1, the third embodiment is provided with a sensor 25 for obtaining information on a person in the monitoring area, and an output signal of the sensor 25 is input to the output video switching device 14. It is what you do. The same elements as those in FIG. 1 are denoted by the same reference numerals, and redundant description is omitted.

  In FIG. 16, a sensor 25 that obtains information on a person in the monitoring areas 11a and 11b is provided in the monitoring areas 11a and 11b in addition to the imaging devices 12a to 12n. Examples of the sensor 25 include a photoelectric sensor, a laser sensor, an ultrasonic sensor, a microphone, and a smoke sensor. The sensor 25 is used to detect a feature amount related to the person's action and a situation change caused by the person's action, and input an output signal of the sensor 25 to the output video switching device 14. The output video switching device 14 displays the video to be output on the assigned monitoring monitors 15a to 15k according to the output signal of the sensor 25. For example, the passage or height of a person is detected by photoelectric sensors installed on both sides of the passage, abnormal sounds or emergency speech are detected by a microphone, or abnormalities are detected by a sensor that senses smoke or odor.

  According to the third embodiment, in addition to the effects of the first embodiment, the output of the sensor 25 is also taken into account to detect the feature amount related to the person's action and the situation change caused by the person's action. The monitoring areas 11a and 11b can be efficiently monitored.

(Fourth embodiment)
FIG. 17 is a block diagram of a video surveillance system according to the fourth embodiment of the present invention. In the fourth embodiment, in contrast to the first embodiment shown in FIG. 1, instead of the imaging devices 12a to 12n, control imaging devices 26a to 26n capable of changing the magnification of the optical lens are provided and controlled. The magnification of the optical lens of the control imaging devices 26a to 26n is changed by the device 27 as necessary.

  In FIG. 17, the optical lenses applied to the control imaging devices 26 a to 26 n can be changed according to the imaging range, and the number of the control imaging devices 26 a to 26 n is increased by widening the monitoring range by using a lens with a wide angle of view. It is possible to reduce the number of images and to capture a clear image of a person in the distance by using a telephoto lens. As a result of the image measurement result and the image output determination, when the person is monitored with higher accuracy, the control device 27 moves the optical axes of the control imaging devices 26a to 26n to the person position, and the person appears larger in the screen. Automatically adjust the magnification of the optical lens.

  According to the fourth embodiment, high-accuracy monitoring can be performed by controlling with the control device 27 so as to follow the movement of the person and capture at an optimum size.

1 is a configuration diagram of a video surveillance system according to a first embodiment of the present invention. The block block diagram of the output image switching device in the 1st Embodiment of this invention. Explanatory drawing of the person's action locus | trajectory setting conditions set in the action locus | trajectory setting part of the output image switching device in the 1st Embodiment of this invention. Explanatory drawing of the video switching table of the output video switching apparatus in the 1st Embodiment of this invention. Explanatory drawing of the physical feature setting condition of the person set in the physical feature setting part of the output image switching device in the 1st Embodiment of this invention. Explanatory drawing of the action date setting condition of the person set in the action date setting part of the output image switching apparatus in the 1st Embodiment of this invention. Explanatory drawing of the person's action range setting conditions set in the action range setting part of the output image switching device in the 1st Embodiment of this invention. Explanatory drawing of the display screen divided | segmented by the division | segmentation display setting part of the output image switching device in the 1st Embodiment of this invention. The flowchart which shows the registration procedure of the setting conditions to the video switching table of the output video switching apparatus in the 1st Embodiment of this invention. The flowchart which shows operation | movement of the video surveillance system concerning the 1st Embodiment of this invention. The flowchart which shows the production processing content of the image switching table of the output video switching apparatus in the 1st Embodiment of this invention. Explanatory drawing of the condition table at the time of creating the image switching table of the output video switching apparatus in the 1st Embodiment of this invention. Explanatory drawing of the other example of the image switching table of the output video switching apparatus in the 1st Embodiment of this invention. Explanatory drawing of an example of the video output of the monitoring monitor in the 1st Embodiment of this invention. The block diagram of the video surveillance system concerning the 2nd Embodiment of this invention. The block diagram of the video surveillance system concerning the 3rd Embodiment of this invention. The block diagram of the video surveillance system concerning the 4th Embodiment of this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 11 ... Monitoring area, 12 ... Imaging device, 13 ... Image measuring device, 14 ... Output video switching device, 15 ... Monitoring monitor, 16 ... Image output condition setting part, 17 ... Video switching table, 18 ... Divided display setting part, 19 DESCRIPTION OF SYMBOLS ... Action locus setting part, 20 ... Physical feature setting part, 21 ... Action date setting part, 22 ... Action range setting part, 23 ... Feature-value database, 24 ... Input image switching device, 25 ... Sensor, 26 ... Imaging for control Device, 27 ... control device

Claims (8)

An imaging device that visualizes the state of the monitoring area, an image measuring device that measures a person's feature value from the video output from the imaging device, and a setting condition out of the person's feature value measured by the image measuring device A video monitoring system comprising: an output video switching device that allocates a video for outputting a feature amount in response to this; and a monitoring monitor that displays the video output by the output video switching device. An imaging device that visualizes the state of the monitoring area, an input video switching device that inputs video output from the imaging device and switches the output video according to a fixed or arbitrary time distribution, and video output from the input video switching device An image measuring device for measuring the feature amount of a person from the output video switching device for assigning a video for outputting the feature amount according to the setting condition among the feature amount of the person measured by the image measuring device, and the output video switching A video monitoring system comprising a monitoring monitor for displaying a video output by the apparatus. 3. The video monitoring system according to claim 1 or 2, wherein when a video to be monitored by the output video switching device is assigned, the control device changes the magnification of the optical lens by directing the optical axis of the imaging device to a person position. A video surveillance system comprising: 3. The video monitoring system according to claim 1, wherein the output video switching device assigns and outputs a corresponding video in accordance with output information of a sensor that detects a change in a person's situation. system. 3. The video monitoring system according to claim 1, wherein the output video switching device allocates and outputs a corresponding video in response to a request for monitoring a person's action date / time and stay time measured by the image measuring device. A video surveillance system characterized by: 3. The video monitoring system according to claim 1 or 2, wherein the output video switching device assigns a corresponding video to a request for monitoring a physical feature of a person measured by the image measuring device as a feature quantity. A video surveillance system characterized by output. 3. The video monitoring system according to claim 1, wherein the output video switching device outputs a plurality of videos according to a feature amount of a person measured by the image measuring device, and the monitoring monitor outputs the output video. A video monitoring system, wherein a plurality of videos output by a switching device are divided and displayed on a monitor. Visualize the state of the monitoring area, measure the person's feature amount from the visualized video, assign the video that outputs the feature amount according to the setting condition among the measured person's feature amount, and assign the assigned video A video monitoring method characterized by displaying the video.

Images