JP4309900B2 - Video surveillance system - Google Patents

Description

  The present invention relates to a video monitoring system for monitoring an area photographed by a surveillance camera based on a video displayed on a display device.

2. Description of the Related Art In recent years, photographing and monitoring systems that include a monitoring camera and a display device have been widely used in commercial fields, financial institutions, and the like for purposes such as crime prevention.
Then, there is a demand for acquiring the entire monitoring area image and the enlarged image of the target in the entire image based on the image input from the photographic camera to improve the monitoring accuracy.
In the prior art, a wide-angle camera is installed to acquire the image of the entire monitoring area, and a camera is installed in each section (plurality) of the monitoring area to acquire an enlarged image of one section of the monitoring area. If there is a part you want to pay attention to based on the whole video shot with a wide-angle camera, you can get an enlarged video shot with the camera installed in that section, and get an image of the entire monitoring area and an enlarged video of the target An imaging monitoring system using a plurality of cameras has been used.
However, an imaging monitoring system that requires a plurality of cameras has problems such as device cost, installation work, maintenance, and camera installation space, and a simple configuration is required.

In recent years, with the advent of high-resolution CCD cameras, it is possible to acquire high-resolution wide-angle images with one high-resolution and wide-angle camera, and target areas can be obtained from high-resolution images acquired from one camera. Technology to cut out the video (target video) and display it on the monitor. (For example, see Patent Document 1)
Japanese Patent Application No. 2002-167310

When displaying an enlarged target image on the monitor based on the high-resolution whole video input from the surveillance camera, the video is partially cut out from the whole video based on the detected position information (address) of the target. Display the enlarged image on the monitor.
Therefore, in order for the observer who observes the image displayed on the monitor to accurately grasp the abnormality in the monitoring area, the target is accurately detected from the entire image according to the situation, and the enlarged image is displayed on the monitor. It is hoped that. Further, in order to reduce the burden on the observer who observes the monitor, it is desired to display so that the position of the detected target can be easily grasped.

  In order to achieve the above object, the present invention displays an entire image of the monitoring area on the entire image display area of the monitor based on a camera image obtained by photographing the entire monitoring area, and an enlarged image of the target in the entire image. Is a video monitoring system that displays the image in the enlarged video display area of the monitor, and automatically tracks the motion-detected target for a certain period of time or until no motion is detected based on the camera video of the entire surveillance area. The auto-tracking function that cuts out the video from the whole video and displays it enlarged, and the whole video is displayed on the monitor based on the camera video shot of the entire surveillance area, and the operator uses the whole video on the monitor (whole video). A specified tracker that automatically tracks the target specified in the specified time or until no motion is detected, and cuts out the image of the area from the entire image and displays it in an enlarged manner. The entire image is displayed on the monitor based on the camera image of the entire monitoring area, and the operator designates the position specified over time on the monitor (entire image) based on the image displayed on the monitor. The tracking area is based on the manual tracking function that tracks the specified area for a certain period of time or until the specified period disappears, and cuts out the entire area from the entire image and displays the enlarged image. The auto pan function that cuts out and enlarges the video of a certain section that moves over time as it circulates in the interior, and displays the entire video on the monitor based on the camera video that captured the entire surveillance area. Originally, the operator designates a target on the monitor (whole video), and has a home position function that cuts out the video of the area from the whole video and displays it in an enlarged manner. The enlarged image display area is divided according to the number of targets detected by the tail function, specified tracking function, manual tracking function, auto pan function, and home position function, and the enlarged image of the target detected by each of the above functions is displayed. is there.

  Embodiments of the present invention will be described below with reference to the drawings.

FIG. 1 shows a block diagram of a video surveillance system according to an embodiment of the present invention.
In this embodiment, the entire monitoring area is photographed using four cameras 1a to 1d, and the camera images of the entire monitoring area are acquired by connecting the respective images.
Images captured by the cameras 1a to 1d are respectively input to the A / D converters 2a to 2d, then input to the synchronous memories 3a to 3d, and then input to the connecting unit 4. Then, the connecting unit 4 connects the camera images to acquire the camera image of the entire monitoring area.

The camera video of the entire monitoring area is input to the frame memory 5 and also to the display video setting unit 6, and the display video setting unit 6 selects the target video according to the purpose from the camera video stored in the frame memory 5. The video is cut out and input to the monitor 10 via the D / A converter 9.
That is, the entire video of the monitoring area is read (cut out) from the camera video stored in the frame memory 5 and the video of the target area (hereinafter referred to as target) is read (cut out) from the whole video. The entire image of the area and the enlarged image of the target can be displayed on the monitor.

In this embodiment, the cursor position register 7 and the cursor display unit 8 are provided, and the position of the target video to be enlarged (video cut out from the video stored in the frame memory 5) is displayed in the whole monitoring area. The cursor is displayed in the video.
When simultaneously displaying the entire image of the monitoring area and the enlarged image of the target on the monitor, the cursor position register 7 is set to display / hide the cursor, and the type and color of the cursor display are set. Based on this, the cursor display unit 8 displays a cursor at the position of the target in the entire image so that the position of the enlarged target in the entire image can be easily grasped.

FIG. 2 shows an example of a camera arrangement for photographing a wide monitoring area.
In the arrangement example of the camera shown in FIG. 2A, four cameras (shooting angle of view 30 °) 1a to 1d are arranged in a fan shape and photographed, and four camera images C1 that are continuous (adjacent to each other) are captured. Obtain ~ C4. Then, the camera images C1 to C4 are input to the connecting unit 4 to connect the images, and a camera image (shooting angle of view 120 °) of the entire monitoring area is acquired.

  In the arrangement example of the camera shown in FIG. 2B, two cameras (shooting angle of view 30 °) 1a and 1b arranged in a fan shape are grouped, and two camera images C5 having continuity (adjacent to each other) and C6 is acquired, and two cameras (shooting angle of view 30 °) 1c and 1d arranged in a fan shape are grouped, and two continuous (adjacent) camera images C7 and C8 are acquired. Camera images C <b> 5 to C <b> 8 are respectively input to the connecting unit 4. And while acquiring the whole image which connected each camera image C5-C8, about the said whole image, the camera images C5 and C6 image | photographed with the cameras 1a and 1b, the camera image C7 and C8 image | photographed with the cameras 1c and 1d, Each grouped camera image (image angle of view 60 °) is classified and handled.

  The entire monitoring area may be photographed by one camera, and the display image setting unit 6 may read (cut out) the image from the frame memory 5 based on the camera image and display it on the monitor.

Next, a method for displaying an enlarged image of the target on the monitor based on the camera video stored in the frame memory 5 will be described with reference to FIG.
FIG. 3 is a block diagram of the display video setting unit 6 according to the embodiment of the present invention.

  The video monitoring system according to this embodiment cuts and enlarges the target video from the camera video based on the camera video obtained by shooting the entire monitoring area. The enlarged image of the target is simultaneously displayed on the monitor.

  According to this embodiment, (1) based on the camera image obtained by capturing the entire monitoring area, the target detected in the sensing area set in the monitoring area is automatically tracked for a certain period of time or until no movement is detected, An automatic tracking function that cuts out and displays the video of the area (target) from the entire video, and (2) based on the camera video obtained by capturing the entire monitoring area, the target detected from the entire monitoring area for a certain period of time or Auto-tracking function that automatically tracks until no motion is detected, cuts out the video of the area (target) from the entire video, and displays the enlarged video. (3) The entire video is displayed on the monitor based on the camera video of the entire surveillance area. Display and automatically track the target specified by the operator on the monitor (whole image) for a certain period of time or until no motion is detected. A specified tracking function that cuts out and enlarges the video of the area (target) from the entire video, and (4) displays the entire video on the monitor based on the camera video that captured the entire surveillance area, and the video displayed on the monitor Based on the above, the position specified by the operator over time on the monitor (whole image) is tracked for a certain period of time following the operator's designation or until the designation disappears. And a manual tracking function for cutting and enlarging and displaying.

  In addition, (5) based on the camera image obtained by capturing the entire monitoring area, the fixed section is moved over time so as to circulate in the monitoring area, and the image of the fixed section that circulates is cut out and enlarged and displayed. (6) Display the entire video on the monitor based on the camera video of the entire surveillance area, and the operator designates the target on the monitor (entire video) based on this overall video. It has a home position function that cuts out an image from the entire image and displays it in an enlarged manner.

In the embodiment shown in FIG. 3, the first motion detector 11 detects motion within a sense area set by the operator. The entire image is displayed in the entire image display area of the monitor based on the camera image obtained by photographing the entire monitoring area, and the operator sets an arbitrary section in the image as the sense area based on the entire image (see FIG. 6), the first motion detection unit 11 performs motion detection within the sense area based on the camera image, and detects the number of motion-detected targets and their positions.
The second motion detection unit 12 performs motion detection on the entire camera image obtained by capturing the entire monitoring area, and detects the number and positions of the targets whose motion has been detected.
The designated tracking setting unit 13 detects the position of the target when the operator designates the target in the entire video displayed on the monitor using an instruction device such as a mouse, a keyboard, or a button.
When the operator designates a target in the entire video displayed on the monitor using an instruction device such as a mouse, a keyboard, or a button, the manual tracking setting unit 14 detects the position of the target following the operator's instruction. .

  Information on the number and position of the detected targets is input to the tracking priority determination unit 17 for each detection means. The tracking priority determination unit 17 selects a target according to the priority set by the priority setting unit 15, and prioritizes the targets detected by the first motion detection unit 11, the second motion detection unit 12, and the designated tracking setting unit 13. Targets with higher ranks are automatically tracked by the automatic tracking units 18a and 18b, respectively. When the manual tracking unit 14 detects the target, the manual tracking unit 19 performs manual tracking following the instruction from the operator.

In this embodiment, the priority setting unit 15 sets priorities in the order of the first motion detection unit 11, the second motion detection unit 12, the designated tracking setting unit 13, and the manual tracking setting unit 14. In addition, two targets are selected from the targets input from the first motion detection unit 11, the second motion detection unit 12, and the designated tracking setting unit 13 according to the priority order, and are automatically tracked. That is, when the first motion detection unit 11 that performs motion detection in the sense area does not detect motion, the target detected by the second motion detection unit 12 that performs motion detection from the entire video in the monitoring area is selected.
Then, the first and second automatic tracking units 18a and 18b are provided, and the two targets selected by the tracking priority determination unit 17 are automatically tracked by the first automatic tracking unit 18a with the first target having the highest priority. Is set to automatically track the second target by the second automatic tracking unit 18b.

  Note that the operation (used / unused) of the second motion detector 12 that detects motion in the entire monitoring region (entire image) is controlled, and the operator does not use the second motion detector 12 that detects motion from the entire monitoring region. When the target detected for motion in the sense area set based on the video (entire video) of the monitoring area is not detected, the target specified by the specified tracking setting unit 13 may be selected.

In the first and second automatic tracking units 18a and 18b, automatic tracking of the target is continued for a certain time after the target is detected for motion or until no motion is detected.
In this embodiment, when the target is automatically tracked until the movement of the automatically tracked target is no longer detected, in this embodiment, the target is automatically tracked until a certain time has elapsed after the target is no longer detected. Even if no motion is detected, if motion is detected before a certain period of time has elapsed since motion is no longer detected, automatic tracking of the target is continued.
In the first and second automatic tracking units 18a and 18b, when the movement detection of the automatically tracked target is continued, the position information of the detected target is input to the first or second cutout counters 20a and 20b, When the movement of the automatically tracked target is not detected, the position information of the last detected target is input to the cut-out counters 20a and 20b during a certain period after the movement is not detected. Based on the target position information, the automatically tracked target video is cut out from the camera video stored in the frame memory 5.

  The position information of the targets automatically tracked by the first and second automatic tracking units 18a and 18b is input to the first and second cutout counters 20a and 20b, respectively, and the position information is output from the first and second cutout counters 20a and 20b. The target video cutout range is set according to the display size, and based on this cutout range (read address), the target video is cut out from the camera video stored in the frame memory 5 (see FIG. 1) and monitored. The target auto-tracking video is enlarged and displayed.

In this embodiment, when the two targets are automatically tracked in the first and second automatic tracking units 18a and 18b, the video of the target clipped by the first and second cutout counters 20a and 20b is enlarged and displayed. The enlarged video display area is divided into two tracking screens.
In addition, when the two targets are automatically tracked in the first and second automatic tracking units 18a and 18b, the first and second tracking units 18a and 18b are displayed in parallel on the two tracking screens in accordance with the positional relationship (left-right relationship) of each target. The position information of each target automatically tracked by the automatic tracking sections 18a and 18b is input to the display position determination section 26, and the position of the target is determined.
When two targets are automatically tracked, the two tracking screens set in the enlarged image display area of the monitor are combined to display the two targets comprehensively when the targets are close to each other. Position information of each target (position information of each target automatically tracked by the first and second automatic tracking units 18a and 18b) input to the determination unit 26 is input to the tracking screen determination unit 27 to combine and divide the tracking screen Was judged.

In the embodiment shown in FIG. 3, the tracking target detection unit 33 for not only video monitoring using automatic tracking video but also warning by an alarm or the like is provided.
For example, as in the monitoring method by the video monitoring system shown in FIG. 4, the monitoring area is monitored based on the camera images obtained by photographing the entire monitoring area with four cameras 1a to 1d, and two cameras are grouped. When preferentially monitoring a target that has entered a specific area photographed in 1a and 1b, the target automatically detected in the specific area (camera images photographed by grouped cameras 1a and 1b) is automatically tracked and automatically tracked. An enlarged image of the target was displayed on the monitor and an alarm was sounded.
In this embodiment, a sense area is set at the entrance of a specific area based on the camera video (the operator sets a sense area in the video), the target enters the specific area through the sense area, When the target is detected by the first motion detection unit 11 and the target is automatically tracked by the first or second automatic tracking unit 18a or 18b, an alarm or the like is sounded to indicate that the target has entered the specific area. In order to warn, the tracking target detection unit 33 is configured to output a detection signal and sound an alarm while the target is automatically tracked by the first or second automatic tracking unit 18a, 18b. In this embodiment, the target is automatically tracked only within the video of the specific area captured by the grouped cameras 1a and 1b.

  The position information of the target manually tracked by the manual tracking unit 19 is input to the third cutout counter 20c, and the cutout range of the target video is set according to the position information and the display size in the third cutout counter 20c. Based on the range (read address), the target video is cut out from the camera video stored in the frame memory 5 (see FIG. 1), and the target manual tracking video is enlarged and displayed on the monitor.

Further, in the embodiment shown in FIG. 3, the auto pan function is set by the auto pan counter 21, and based on a camera image obtained by photographing the entire monitoring area, a fixed section that moves with time so as to circulate in the monitoring area. It has an auto pan function that cuts out and enlarges the video.
In this embodiment, by setting the movement pattern and its speed by the auto pan function in the auto pan counter 21, the position information (for example, the center of the constant section) that moves with time so as to circulate in the monitoring area is set. Coordinate). The position information is input to the fourth cutout counter 20d. The fourth cutout counter 20d sets a video cutout range by autopan according to the position information and the display size, and is based on the cutout range (read address). Thus, the video is cut out from the camera video stored in the frame memory 5 (see FIG. 1), and the cyclically moving video in the monitoring area by the auto pan function is enlarged and displayed on the monitor.

  That is, the position information input from the auto pan counter 21 to the fourth cutout counter 20 d is determined by the movement pattern and movement speed set in the auto pan counter 21. Then, according to the movement pattern set in the auto pan counter 21, for example, the movement direction is turned around to move around, move from the right end to the left end, change direction at the left end, move from the left end to the right end, and further move to the right end. The video of a certain section that changes direction and moves again from the right end to the left end is enlarged and displayed on the monitor, for example, by moving in one direction repeatedly, moving in one direction from the left end to the right end, or It is possible to enlarge and display an image of a certain section that repeatedly moves in one direction from the right end to the left end in the enlarged image display area of the monitor.

  Note that the auto pan function that cuts out and enlarges the video of a fixed section that moves over time so as to circulate in the monitoring area based on the camera video that captures the entire monitoring area is a specific range in the camera video. It may be set so that a video of a certain section that moves with time so as to circulate within a range that is excluded and not excluded is cut out and enlarged.

  For example, as shown in FIG. 2B, when the monitoring area is photographed using the grouped cameras 1a and 1b and the grouped cameras 1c and 1d, the grouped cameras 1a and 1b are photographed. The range of the captured camera images C5 and C6 is excluded, and the image of a certain section that cyclically moves with time is cut out and enlarged and displayed within the range of the camera images C7 and C8 taken by the grouped cameras 1c and 1d. It may be set.

  Furthermore, the position of the target detected by the second motion detection unit 12 that detects the motion of the entire camera image is obtained, and a range that includes the positions of all the targets that have been detected for motion is obtained. You may set so that the video of a certain section may be cut out and enlarged.

  In this embodiment, a third motion detection unit 16 that detects motion within a range arbitrarily set by the operator is provided, and the motion detection by the third motion detection unit 16 exceeds the threshold set in the auto pan determination unit 28. In this case, the automatic tracking function that automatically tracks the target detected by the first and second motion detectors 11 and 12 is not used, and the automatic cyclic moving image by the auto pan function is cut out and displayed in an enlarged manner.

As shown in FIG. 5, an arbitrary range set by the operator is detected by the third motion detector 16 based on the entire video displayed on the monitor, and a large number of people are present in the set range. When a motion is detected, the enlarged image of the target detected by the automatic tracking function is not displayed preferentially, but an enlarged image of a fixed section moving around the entire monitoring area is displayed. As a result, when many movements are detected in the monitoring area, the entire monitoring area can be monitored.
In this embodiment, when motion is detected by the third motion detection unit, motion detection is performed except for the video range of the target automatically tracked by the first and second automatic tracking units 18a and 18b (cutout range by automatic tracking).
When a large number of movements are detected in the setting range and the threshold set in the auto pan determination unit 28 is exceeded, the enlarged display of the target by the auto tracking function is not used and the enlarged display by the auto pan function is preferentially selected. The display area determination unit 30 is set so that the display control unit 31 controls the multiplexer 32 based on the information of the display area determination unit 30 to control the cutout of the video from the frame memory 5.

  When there are a large number of people in the monitoring area, instead of displaying an enlarged image of the target detected by the automatic tracking function, monitoring is performed by displaying an enlarged image of a certain section so that the entire monitoring area is moved. You can see the whole area.

Further, in the embodiment shown in FIG. 3, the entire image of the monitoring area is displayed on the monitor based on the camera image obtained by photographing the entire monitoring area, and the operator can set the home position on the monitor (entire image) based on the entire image. A home position function is provided for designating a target and cutting out the video of that area from the entire video and displaying it in an enlarged manner.
In this embodiment, when an operator designates a target on the monitor (overall image) as a home position based on the entire image displayed in the entire image display area of the monitor using an instruction device such as a mouse, a keyboard, or a button. The home position (target) position (for example, position coordinates designated by the operator) is detected by the home position register 22.
This position information is input to the fifth cutout counter 20e. In the fifth cutout counter 20e, a video cutout range by the home position function is set according to the position information and the display size, and the cutout range (reading address) is set in this cutout range (reading address). Based on this, the video is cut out from the camera video stored in the frame memory 5 (see FIG. 1), and the video at the home position set in the monitoring area is enlarged and displayed on the monitor.

  In this embodiment, the home position register 22 is configured so that a first home position with a high display priority and a second home position with a low display priority can be set. That is, when the video of the home position (target) is cut out from the whole video and enlarged and displayed, the home position register 22 sets the position that is always displayed on the monitor as the first home position, and the enlarged video of the first home position. Is displayed with priority. In addition, when the first home position is not set, the video of the home position (target) having a lower display priority than the video cut out by the automatic tracking function, the designated tracking function, the manual tracking function, or the auto pan function is used as the second home position. If the target is not detected by the automatic tracking function, the designated tracking function, the manual tracking function, or the auto pan function, the enlarged image of the target set as the second home position is displayed.

The first and second cutout counters 20a and 20b are input with the position information of the targets automatically tracked by the first and second automatic tracking units 18a and 18b and the display size calculated by the tracking screen determination unit 27, In addition, the position information of the target detected by the manual tracking unit 19, the auto pan counter 21, and the home position register 22 and the display size calculated by the display frame determination unit 23 are input to the fifth cutout counters 20c to 20e. Based on the position information and the display size, each cutout counter 20a to 20e sets each cutout range, and each cutout counter 20a to 20e stores in the frame memory 5 based on the cutout range (read address). The target video is partially cut out (read out) from the camera image being displayed, and the enlarged video of each target is displayed in the enlarged video display area of the monitor.
The sixth cut-out counter 20f receives a display size for displaying the entire video of the monitoring area in the entire video display area of the monitor, and the sixth cut-out counter 20f starts from the camera video stored in the frame memory 5. The entire monitoring area is cut out (read out), and the entire video is displayed in the entire video display area of the monitor based on the display size.

The display size input to the first to fifth cutout counters 20a to 20e is calculated by the display frame determination unit 23 and the tracking screen determination unit 27.
The size of the entire enlarged video display area is input to the display frame determination unit 23 in advance. Based on the size of the entire enlarged video display area and the number of targets detected by each function such as an automatic tracking function, The display size of the target detected by each of the automatic tracking function, designated tracking function, manual tracking function, auto pan function, and home position function is calculated. The display size of the target detected by the automatic tracking function and the specified tracking function (that is, the target tracked by the first and second automatic tracking units) is the display size calculated by the display frame determination unit 23 and the display position determination unit. 26 is calculated based on the positional relationship (proximity / separation) of the target detected at 26 and input to the first and second cutout counters 20a and 20b.

  In the embodiment shown in FIG. 3, the display frame determination unit 23 divides the enlarged video display area according to the number of targets tracked by the first and second automatic tracking units 18 a and 18 b and the manual tracking unit 19, and the division is performed. The display size is calculated based on the number. That is, the display frame determination unit 23 determines the number of screen divisions based on the number of targets detected by each of the automatic tracking function, the specified tracking function, and the manual tracking function, and the automatic tracking function, the specified tracking function, the manual tracking function, the auto tracking function, The target display size detected by each function of the pan function and the home position function was calculated.

In this embodiment, when the target is detected by the automatic tracking function, the designated tracking function, and the manual tracking function, and the target is tracked by the first and second automatic tracking units 18a and 18b or the manual tracking unit 19, the tracking is performed. The enlarged image display area is divided according to the number of targets that have been selected.
If there is no target tracked by the first and second automatic tracking units 18a and 18b or the manual tracking unit 19, the enlarged video display area is not divided, and the enlarged video of the target by the auto pan function or the home position function is enlarged. Display in the video display area. In addition, when a target is detected by both the auto pan function and the home position function, according to the priority set in the display item determination unit 25, a target image with a high priority is displayed with priority.

  In addition, the display frame determination unit 23 uses the automatic tracking function, the specified tracking function, the manual tracking function, the auto pan function, the home position based on the number of targets detected by the automatic tracking function, the specified tracking function, and the manual tracking function. When calculating the display size of the target detected by each function of the function, if the first home position to be always displayed on the monitor is set by the home position register 22, the first and second automatic tracking units 18a and 18b or manual tracking The enlarged video display area of the monitor is divided by the number of targets tracked by the unit 19 plus the number of targets set as the first home position, and the video of the target tracked with the first home position is displayed. You may comprise.

  Further, when the display size is calculated by the display frame determination unit 23, not only the number of targets tracked by the first and second automatic tracking units 18 a and 18 b and the manual tracking unit 19, but also the auto pan counter 21 and the home position register 22. The number of targets detected in step 1 is input to the display frame determination unit 23, and the display size is calculated based on the total number of these targets. The automatic tracking function, the designated tracking function, the manual tracking function, the auto pan function, the home The enlarged video display area may be divided in accordance with the number of targets detected by each function of the position function, and the target detected by each function may be displayed.

The display size calculated by the display frame determination unit 23 is input to the display area determination unit 30. When the display area determination unit 30 constructs a monitor screen, it matches the number of targets detected by each function such as an automatic tracking function. The monitor screen is constructed to divide the enlarged video display area.
As a result, the enlarged image of the target detected by each of the auto tracking function, specified tracking function, manual tracking function, auto pan function, and home position function can be displayed on a screen divided into the enlarged image display area of the monitor. Can do.

Furthermore, in this embodiment, when the display area determination unit 30 constructs a monitor screen, an upper limit is set on the number of divisions (screen division number) of the enlarged video display area.
When the upper limit value is set in the display frame determination unit 23 and the total number of targets detected by the automatic tracking function, the specified tracking function, and the manual tracking function exceeds the upper limit, the display size is determined based on the upper limit value. Based on this display size and the number of screen divisions, the display area determination unit 30 constructs a monitor screen, and the enlarged video display area is divided by the upper limit value. Further, the display priority setting unit 24 sets the display priority of each function of the automatic tracking function, the designated tracking function, the manual tracking function, the auto pan function, and the home position function in the display item determination unit 25, and the priority order of the display items. The number of screen divisions set by the display frame determination unit 23 is input to the display item determination unit 25 in which is set.
The display control unit 31 controls the multiplexer 32 based on the priority order set in the display item determination unit 25 and the number of screen divisions input to the display item determination unit 25. That is, in the multiplexer 32, a cutout counter for cutting out the video of the display item set with a high priority is selected with priority, cut out from the camera video in the frame memory 5 by the selected cutout counter, and the target video is enlarged and displayed.

  For example, in the display priority setting unit 24, the first home position set in the home position register 22, the target automatically tracked by the first and second automatic tracking units 18a and 18b, the target tracked by the manual tracking unit 19, auto pan The priority order of the display items is set in the order of auto pan set by the counter 22 and second home position set by the home position register 22, and the division upper limit value of the enlarged video display area set in the display frame determination unit 23 is set to “ 2 ”, when the total number of targets detected by the display frame determination unit 23 exceeds two, the display frame determination unit 23 inputs the upper limit value of the number of screen divisions to the display item determination unit 25 and further displays the screen. The display size calculated in accordance with the number of divisions (upper limit value) of the display area determination unit 30 and the third to fifth cuts To be input to the counter 20c~20e. The first and second cutout counters 20a and 20b have the display size calculated by the tracking screen setting unit 27 based on the display size calculated according to the number of divisions (upper limit value) and the target position information. input.

  Then, based on the number of screen divisions and the display size, the display area determination unit 30 displays an entire video display area for displaying the entire video and an enlarged video display area for displaying the target enlarged video, as shown in FIG. In addition to setting, a monitor screen in which the enlarged video display area is divided into two is constructed. The display control unit 31 controls the multiplexer 32 based on the information input to the display area determination unit 30, and the multiplexer 32 cuts out two based on the display item priority set in the display item determination unit 25. A counter is selected, and the target video is partially cut out from the camera video stored in the frame memory 5 by the selected cut-out counter.

  Furthermore, in this embodiment, the third motion detection unit 16 performs motion detection within a range arbitrarily set by the operator, and this motion detection exceeds a threshold (for example, “4”) set in the auto pan determination unit 28. Is configured not to use the automatic tracking function for automatically tracking the targets detected by the first and second motion detection units 11 and 12, but to use the auto pan function with priority.

  In the embodiment shown in FIG. 3, an entire video setting unit 29 for setting display / non-display of the entire video is provided for displaying the entire video of the monitoring area on the monitor. Is set to be displayed, the information is input to the display area determination unit 30, the display control unit 31 controls the multiplexer 32 based on this information, selects the sixth cutout counter 20f by the multiplexer 32, and the sixth The video of the entire monitoring area was cut out from the camera video stored in the frame memory 5 by the cutout counter 20f, and the entire video of the monitoring area was displayed in the whole video display area set in the monitor.

  That is, the display area determination unit 30 displays the display item input from the display item determination unit 25, the display size input from the display frame determination unit 23 or the tracking screen determination unit 27, and the information input from the auto pan determination unit 28. The monitor screen is constructed based on the information input from the entire video setting unit 29, and the display control unit 31 controls the multiplexer 32 based on the monitor screen construction information.

FIG. 7 shows an example of construction of a monitor screen in the display area determination unit 30.
The monitor screen shown in FIG. 7A sets an entire image display area for displaying an entire image and an enlarged image display area for displaying an enlarged image of a target, as well as an automatic tracking function, a specified tracking function, The enlarged image display area is divided into two according to the number (two) of targets detected by each function of the manual tracking function, and an enlarged image of the target detected by each function is displayed.
When an upper limit is set for the number of screen divisions in the enlarged video display area, if a target exceeding the upper limit is detected, the enlarged video display area is divided by the upper limit to build a monitor screen and display item determination The display control unit 31 controls the multiplexer 32 based on the priority order of the display items set in the unit 25 and the information of the auto pan determination unit 28, selects a cutout counter with a high priority, and matches the number of screen divisions. The target video is cut out based on the calculated display size, and the enlarged video of each target is displayed in the enlarged video display area. Note that the target image detected by the automatic tracking function or the designated tracking function is cut out based on the display size calculated by the tracking screen determination unit 27. When two targets are close to each other, the combination set in the enlarged image display area is used. An image including two targets on the screen is enlarged and displayed.

Further, in constructing the monitor screen in the display area determination unit 30, as shown in FIG. 7B, the enlarged video display area of the monitor is divided, and the display position for displaying the target video detected by the automatic tracking function ( Display section), a display position (display section) for displaying the target image detected by the designated tracking function, a display position (display section) for displaying the target image detected by the manual tracking function, and auto The display position (display section) for displaying the video of the fixed section detected by the pan function and the display position (display section) for displaying the target image set by the home position function are set respectively. A monitor screen may be constructed so that an enlarged image of the target detected by each function is displayed at each display position set in (1).
The display area determination unit 30 further divides the display position set for each of the automatic tracking function, the specified tracking function, the manual tracking function, the auto pan function, and the home position function, and each of the plurality of targets detected by each function is divided. The monitor screen may be constructed so as to display at the display position.
In addition, an upper limit is set for the number of display position divisions set for each function, and when the number of targets detected by each function exceeds the upper limit for the number of divisions, the display position set for each function is divided by the upper limit value. In addition, the display frame determination unit 23 and the display item determination unit 25 may be set so as to select a target for each function according to the priority.

As described above, in this embodiment, the display area determination unit 30 constructs a monitor screen, and the display control unit 31 controls the multiplexer 32 based on this information. In addition, the video cutout range is set based on the display size input to the first to sixth cutout counters 20a to 20f, and stored in the frame memory 5 by the cutout counter selected by the multiplexer 32 controlled by the display control unit 31. The video is cut out (read out) from the camera image being displayed, the entire video of the monitoring area is displayed in the entire video display area of the monitor, and the enlarged video of the target is displayed in the enlarged video display area.
That is, under the control of the display control unit 31, the enlarged image of the target detected by each function is automatically displayed in the enlarged image display area of the monitor with the display format switched.

The position information of the target automatically tracked by the first automatic tracking unit 18a and the display size information calculated by the tracking screen determination unit 27 are input to the first cut-out counter 20a. Based on these information, the frame memory 5 The video cutout range from the camera video stored in is determined.
The second cut-out counter 20b receives the position information of the target automatically tracked by the first automatic tracking unit 18b and the display size information calculated by the tracking screen determination unit 27. Based on these information, the frame memory 5 A video cut-out range (read address) from the camera video stored in is determined.

The first and second cutout counters 20a and 20b acquire position information including the X coordinate of the center of the circumscribed rectangle of the automatically tracked target and the Y coordinate of the upper end of the circumscribed rectangle, and the cutout range is based on the position information and the display size. Set (read address). Thereby, the video of the target automatically tracked can be enlarged and displayed without the video of the upper body of the target being interrupted.
In addition, when two automatically tracked targets are close to each other and the screen combination is set by the tracking screen determination unit 27, the position information of the two targets (the X coordinate of the center of the circumscribed rectangle of the target and the Y coordinate of the upper end of the circumscribed rectangle) For the coordinate), position information consisting of the middle point coordinate (X coordinate) of each X coordinate and the larger coordinate (Y coordinate) of each Y coordinate is acquired, and based on this position information and the display size of the combined screen Thus, one of the first and second cutout counters 20a and 20b sets a cutout range (read address). When two adjacent targets are separated from each other and the screen division is set by the tracking screen determination unit 27, the respective positions including the X coordinate of the circumscribed rectangle center and the Y coordinate of the upper end of the circumscribed rectangle of the automatically tracked target are set. Based on the information and the display size of the tracking screen, a cutout range (read address) is set in each of the first and second cutout counters 20a and 20b.

  The position information of the target tracked by the manual tracking unit 19 and the display size information calculated by the display frame determination unit 23 are input to the third cutout counter 20c and stored in the frame memory 5 based on these information. Determine the video clipping range from the selected camera video. The third cutout counter 20c acquires the position coordinates in the entire image of the area specified by the operator using an instruction device such as a mouse, keyboard, or button based on the entire image displayed on the monitor, and A cutout range (read address) is set based on the display size so as to cut out a certain range centered on the position coordinates.

  The fourth cut-out counter 20d receives the position information of the fixed section (cyclic section) set by the auto pan counter 21 and the display size information calculated by the display frame determination unit 23, and based on these information, the frame The video cutout range from the camera video stored in the memory 5 is determined. The fourth cutout counter 20d acquires the position coordinates set by the auto pan counter 21, and cuts out based on the display size so as to cut out a certain range (constant section) centered on the position coordinates in the entire video. Set the range (read address).

  The fifth cutout counter 20e receives the position information of the home position set by the home position register 22 and the display size information calculated by the display frame determination unit 23, and stores them in the frame memory 5 based on these information. A video cut-out range from the captured camera video is determined. Based on the entire image displayed on the monitor, the position coordinates in the entire image of the area specified by the operator are obtained using an instruction device such as a mouse, keyboard, or button, and the position coordinates in the entire image are fixed. A cutout range (read address) is set based on the display size so as to cut out the range.

  Information from the first to fifth cutout counters 20a to 20e is input to the multiplexer 32 controlled by the display control unit 31, and the cutout counter is selected by the multiplexer 32 based on the priority order of the display items and the number of screen divisions. Based on the cutout range (reading address) of the selected cutout counter, a video is partially cut out from the camera video stored in the frame memory 5 (see FIG. 1), and this partially cutout video is enlarged on the monitor. indicate.

  In this embodiment, the display size of the entire image is set (input) in advance in the sixth cutout counter 20f, and information from the sixth cutout counter 20f is input to the multiplexer 32 controlled by the display control unit 31. . When displaying the entire video, the multiplexer 32 selects the sixth cutout counter 20f, and based on the information of the sixth cutout counter 20f, the video of the entire monitoring area is extracted from the camera video stored in the frame memory 5. Cut out (see FIG. 1) and display the entire video in the entire video display area of the monitor.

  In addition, as shown in FIG. 6, when displaying the enlarged image of the target detected by the automatic tracking function, the designated tracking function, the manual tracking function, the auto pan function, and the home position function and the entire image of the monitoring area at the same time, It is preferable that the position where the target image detected by the above is cut out is displayed as a cursor in the entire image, and the cursor is displayed by distinguishing the cursor for each function.

1 is a block diagram of a video surveillance system according to an embodiment of the present invention. The figure which shows the example of arrangement | positioning of a camera. The block diagram of the display image | video setting part by embodiment of this invention. The figure explaining the Example of the monitoring method by the video surveillance system of this invention. The figure explaining the motion detection by a 3rd motion detection part. The figure explaining the display method by the video surveillance system of this invention. The figure which shows the construction example of a monitor screen.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1a-1d Camera 2a-2d A / D converter 3a-3d Synchronous memory 4 Connection part 5 Frame memory 6 Display image setting part 7 Cursor position register 8 Cursor display part 9 D / A converter 10 Monitor 11 1st motion detection part 12 Second motion detection unit 13 Designated tracking setting unit 14 Manual tracking setting unit 15 Priority setting unit 16 Third motion detection unit 17 Tracking priority determination unit 18a, 18b First and second automatic tracking unit 19 Manual tracking unit 20a to 20f First to sixth cutout counters 21 Auto pan counter 22 Home position register 23 Display frame determination unit 24 Display priority setting unit 25 Display item determination unit 26 Display position determination unit 27 Tracking screen determination unit 28 Auto pan determination unit 29 Whole video Setting unit 30 Display area determination unit 31 Display control unit 32 Multiplexer

Claims (3)

Video monitoring that displays the entire video of the monitoring area in the overall video display area of the monitor and the enlarged video of the target in the overall video in the enlarged video display area of the monitor, based on the camera video taken of the entire surveillance area A system,
Based on the camera image that captured the entire surveillance area, automatically track the target that has been detected for a certain period of time or until no motion is detected.
The entire image is displayed on the monitor based on the camera image of the entire surveillance area, and the operator automatically tracks the target specified on the monitor (entire image) for a certain period of time or until no motion is detected. Specified tracking function to cut out the video of the area from the entire video and display it enlarged,
The entire image is displayed on the monitor based on the camera image of the entire surveillance area, and the operator designates the position on the monitor (entire image) over time based on the image displayed on the monitor. A manual tracking function that tracks the video for a certain period of time or until it is no longer specified, cuts out the video in that area from the entire video,
Based on the camera image that captured the entire surveillance area, auto pan function to cut out and enlarge the video of a certain section that moves over time so as to circulate in the surveillance area,
The entire image is displayed on the monitor based on the camera image of the entire surveillance area, the operator specifies the target on the monitor (entire image) based on this entire image, and the image in that area is cut out from the entire image. Home position function
The enlarged image display area is divided according to the number of targets detected by the auto tracking function, specified tracking function, manual tracking function, auto pan function, and home position function, and the enlarged image of the target detected by each of the above functions is displayed. A video surveillance system characterized by   If there is an upper limit for the number of divisions in the enlarged video display area and the total number of targets detected by the auto tracking function, specified tracking function, manual tracking function, auto pan function, and home position function exceeds the upper limit, 2. The video surveillance system according to claim 1, wherein a target to be enlarged and displayed is selected according to the priority of the function.   When dividing the enlarged video display area for each function of the auto tracking function, designated tracking function, manual tracking function, auto pan function, and home position function, an upper limit is set for the number of divisions for each function, and each function is detected. The video surveillance system according to claim 1, wherein when the number of targets exceeds an upper limit, the target is selected for each function according to the priority.

Images