JP2005141695A - Monitoring system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To prevent failures in counting processing of the number of people when operation is performed by an operator for PTZ operation of a camera. <P>SOLUTION: The system is provided with an imaging device 31 capable of changing imaging areas, a counting means 32 for counting the number of people based on an image acquired by the imaging device 31, an operation means NS for performing change operation of the imaging area for monitoring by the imaging device 31, and counting control means 23, 24, 21, and 34 for controlling so as to perform counting by the counting means 32 at a prescribed timing. The change operation of the imaging area by the operation means NS is inhibited, when the counting means 32 performs counting by controlling of the counting control means 23. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to a monitoring system that monitors whether there is an abnormality in a large store such as a supermarket or other facilities.

  Conventionally, in a commercial facility or a public facility such as a supermarket, a monitoring camera (imaging device) is installed at each important point in order to monitor whether there is an abnormality in a passage or facility. Such a camera has pan (P), tilt (T), and zooming (Z) functions for the purpose of monitoring, and the imaging area can be changed by the PTZ operation. That is, it is possible to take an image of an arbitrary place around the PTZ operation, and to take a specific person in the vicinity and perform zooming and tracking.

  On the other hand, for the purpose of marketing and the like, people are detected based on images obtained from these cameras, and the number of people who enter the facility and the number of people passing by are counted. In this case, the camera is controlled so as to capture an image of a predetermined imaging area, for example, from the ceiling to directly below so that the number of people can be easily counted.

For example, according to the monitoring system disclosed in Patent Document 1, a plurality of cameras capable of changing an imaging region by a PTZ operation are installed in a passage or the like, and the number of persons is counted according to a predetermined time table. When the count result of the number of people changes from 0 to 1 or when the number of people changes from 1 to 1, the PTZ operation is automatically performed to track the one person and record an image. Further, the operator (monitorer) selects one of a plurality of cameras as necessary, and performs an operation for performing a PTZ operation to perform monitoring. An image captured by the camera is displayed on a display device provided in a monitor room or the like.
JP2002-245560

  However, in the conventional monitoring system described above, the counting process is interrupted when the operator performs the PTZ operation of the camera and the counting process is interrupted. There was a problem that could not be performed accurately.

  The present invention has been made in view of such problems, and it is an object of the present invention to prevent a failure in the counting process of the number of persons when an operator performs an operation for a PTZ operation of the camera.

  The monitoring system of the present invention includes an imaging device capable of changing an imaging region, a counting unit that counts the number of people based on an image obtained by the imaging device, and a change of the imaging region for monitoring by the imaging device. An operation means for performing an operation, and a count control means for controlling to perform counting by the counting means at a predetermined timing, and while the counting means is counting by the control of the counting control means, It is configured such that an operation for changing the imaging region by the operating means is prohibited.

  Preferably, there is provided a notifying means for notifying an operator that the number of persons is being counted by the counting means when the operating means is operated while an operation for changing the imaging area by the operating means is prohibited.

  In addition, when the operation unit is operated while the operation area changing operation by the operation unit is prohibited, the operator is notified that the counting unit is counting and the counting of the number of people is interrupted. The counting control means controls the counting by the counting means to be interrupted when the operator selects to stop counting the number of people.

  In addition, while the counting unit is counting by the control of the counting control unit, there is a notification unit that notifies the operator to that effect.

  Furthermore, when the operation unit is operated with respect to an imaging apparatus in which an operation of changing the imaging region by the operation unit is prohibited, the counting by the counting unit may be controlled to be interrupted.

  An imaging device capable of changing an imaging region, a counting unit that counts the number of persons based on an image obtained by the imaging device, and an imaging region that performs change control of the imaging region for monitoring by the imaging device Control means and count control means for controlling the counting means to perform counting at a predetermined timing, and when the counting means starts counting under the control of the counting control means, the imaging of the imaging device The area is forcibly set as a preset area for counting the number of people, and change control of the imaging area by the imaging area control means is prohibited during counting.

  In that case, it is preferable to have a notification means for notifying the operator of the start of counting before the counting means starts counting under the control of the counting control means.

  According to the present invention, when the operator performs an operation for the PTZ operation of the camera, it is possible to prevent a failure in the number counting process due to the operation.

  FIG. 1 is a diagram showing an example of the overall configuration of a monitoring system 1 showing an embodiment of the present invention, FIG. 2 is a diagram showing an example of the arrangement and imaging area of a camera 3, and FIG. 3 is a functional configuration of the monitoring system 1 FIG. 4 is a diagram illustrating an example of the monitoring screen HG1.

  In FIG. 1, the monitoring system 1 includes a host computer 2, a plurality of cameras 3, a communication line 4, and the like. The host computer 2 and each camera 3 are connected to each other via a communication line 4. As the communication line 4, a LAN, a public line, a dedicated line, the Internet, or the like is used.

  The monitoring system 1 is a large-scale store such as a supermarket or a department store, an underground mall where a large number of specialty stores gathered, a terminal building such as an airport or a station, a museum, or an event venue, etc. Used in. In the present embodiment, a monitoring system 1 used in a supermarket will be described.

  The camera 3 operates in response to a command from the host computer 2 and images a subject (including a background) to acquire an image (image data). The camera 3 has pan (P), tilt (T), and zooming (Z) functions, and the imaging area can be changed by the PTZ operation. Images acquired by imaging are sequentially sent to the server 2 via the communication line 4. The camera 3 captures images at a constant time interval T1, and sequentially outputs the obtained images. As the time interval T1, for example, 1/30 second, 1/15 second, or 1/10 second is set. When it is set to perform imaging once every 1/30 second, an image with an imaging speed of 30 frames / second is obtained. This corresponds to a general moving image (video image). As the camera 3, a digital camera provided with a driving device for PTZ operation, particularly a digital camera capable of capturing a moving image, a digital video camera, or the like is used.

  As shown in FIG. 2, one camera 3 is provided in each of the areas (passengers may be referred to as “passage area” hereinafter) TE where a person (passerby) passes, such as a supermarket entrance or a passage. . The traffic area TE is an area where the number of people passing through the camera 3 is counted. The camera 3 is attached to the ceiling so that the head of a person passing through the traffic area can be imaged from directly above.

  Each traffic area TE is given an area name for identification. For example, “1F-No1” is given to the first passage on the first floor, “1F-No2” is given to the second passage on the first floor, and “2F-No3” is given to the third passage on the second floor. It has been. The name of the traffic area TE monitored by the camera 3 is recorded in the ROM or flash memory of each camera 3.

  Control or setting of the imaging region SR of the camera 3 is different between a counting mode for counting the number of people in the traffic area TE and a monitoring mode for monitoring the surroundings. In the counting mode, the image is controlled so as to capture the image in the vertical direction, that is, the floor (floor) from directly above, with the widest angle of view. That is, the range including the traffic area TE directly below each camera 3 is set to be the imaging region SR. Such a setting state of the camera 3 may be described as a “counting mode position”.

  In the monitoring mode, the PTZ operation can be performed so that a specific person is captured and automatically tracked. In this case, the PTZ operation is performed according to the movement of the person so that the range including the face of the specific person becomes the imaging region SR. It is also possible for the operator to manually change the imaging region SR by manually performing an operation for the PTZ operation.

  FIG. 2 shows an example of the imaging area SR1 in the counting mode and the imaging areas SR2 and 3 in the monitoring mode.

  Each camera 3 enters a counting mode when a predetermined time (timing) is reached in accordance with a command from the host computer 2. When the counting mode is entered, the PTZ operation is automatically performed to return to a predetermined counting mode position regardless of the state of the imaging area until then. In this sense, the count mode position is sometimes referred to as “preset position”. The imaging area SR at the “counting mode position” or “preset position” corresponds to the “preset area” in the present invention.

  As shown in FIG. 3, the camera 3 includes an imaging unit 31, a count processing unit 32, a data transmission unit 33, a control unit 34, a recording medium 35, a PTZ driving unit 36, and the like. The control unit 34 controls the imaging unit 31, the count processing unit 32, the data transmission unit 33, and the PTZ drive unit 36 in accordance with a command (control signal) transmitted from the host computer 2.

  The imaging unit 31 includes an image sensor such as a CCD, an optical system, a control circuit, and the like. The imaging unit 31 captures an image in accordance with a command from the control unit 34 and outputs an image (image data 70). Thereby, the image data 70 of the number of frames (frame number) according to the imaging speed is obtained. The obtained image data 70 is temporarily stored in a recording medium 35 such as a RAM or a flash memory.

  In the counting mode, the counting processing unit 32 performs a process of counting the number of people passing through the traffic area TE handled by each camera 3 (hereinafter, may be referred to as “counting process”). The counting result data 71 is generated and output by the counting process. The counting process will be described in detail later. The data transmission unit 33 transmits data obtained by processing of each unit of the camera 3 to the host computer 2. The PTZ drive unit 36 performs driving for pan, tilt, and zooming operations. The configuration and operation of the PTZ drive unit 36 are known per se. The imaging region is changed by the operation of the PTZ driving unit 36.

  The count processing unit 32, the data transmission unit 33, and the control unit 34 are realized by a processor (control circuit). Alternatively, part or all of the processing may be performed by a computer program. In this case, the computer program is stored in a ROM or flash memory, and is executed by the CPU. The imaging unit 31 may also be configured to perform a part of processing by a computer program.

  The host computer 2 includes a computer main body PC, a display device DP, a hard disk HD, an input device NS, and the like. The host computer 2 is installed in a supermarket manager's room or guard room, etc., controls each camera 3, acquires image data 70 mainly showing each traffic area TE and its surroundings, and each traffic area TE. The counting result data 71 is acquired, and various notifications are given to a manager or a supervisor. As the host computer 2, a personal computer or a workstation is used.

  As shown in FIG. 3, the computer main body PC of the host computer 2 has functions such as a control unit 21, a data receiving unit 22, a time table 23, a count mode setting unit 24, a monitoring mode setting unit 25, and a message output unit 26. Is provided. These functions are realized by hardware or software, or a combination thereof. For example, it is realized by executing a computer program by a CPU.

  The control unit 21 controls the entire host computer 2 and outputs a control command to each camera 3. The data receiving unit 22 receives image data 70 and count result data 71 transmitted from each camera 3.

  The time table 23 records the time or time interval at which each camera 3 is set to the counting mode. For example, the time when the camera 3 is set to the counting mode, the time when the counting mode is canceled, and the like are recorded. Also, the time for performing the counting mode and the time for releasing the counting mode are recorded. Specifically, in the former case, for example, the counting mode is set from 0 to 5 minutes per hour. In the latter case, for example, a 5-minute counting mode is set, then the 5-minute counting mode is canceled, and this is repeated. The time may be other than 5 minutes. The time when the counting mode is set may be different from the time when it is released. In the time table 23, the same time or time interval may be set for each of the multiple cameras 3, or different times or time intervals may be set. In addition, different times or time intervals may be set for each camera group (camera group) including a plurality of cameras 3. The contents of the time table 23 can be freely set by the operator through an input operation from the input device NS.

  The counting mode setting unit 24 performs processing for setting the counting mode for the camera 3 in accordance with the contents of the time table 23 and the input operation from the input device NS. The monitoring mode setting unit 25 performs processing for setting the monitoring mode for the camera 3 in accordance with the contents of the time table 23 and the input operation from the input device NS.

  The message output unit 26 outputs various messages regarding the mode set in the camera 3 and the like. The output message is displayed at an appropriate position on the display surface HG of the display device DP.

  The display device DP displays data or an image output from the computer main body PC on the display surface HG. The input device NS is used for inputting various commands and data to the computer main body PC by the operation of the operator. The input device NS is also used to perform an operation input for the PTZ operation of the camera 3 by an operator and arbitrarily change the imaging region of the camera 3 when the camera 3 is set to the monitoring mode.

  The hard disk HD records image data 70, count result data 71, and the like. At that time, the counting result data 71 is recorded for each camera 3 in association with the traffic area TE and the date / time that are the objects of counting.

  Therefore, the counting mode is set for each camera 3 according to the contents of the time table 23. When the counting mode is set, as described above, each camera 3 automatically performs a PTZ operation to set the counting mode position. In the counting mode, each camera 3 performs a counting process based on the captured image. The result of the counting process (counting result data 71) and the image obtained by imaging (image data 70) are transmitted from the camera 3 to the host computer 2 and displayed on the display device DP.

  As shown in FIG. 4, a monitoring screen HG1 is displayed on the display surface HG of the display device DP. On the monitoring screen HG1, for each camera 3, an area name of the traffic area TE, an image (video) indicating the current traffic area TE, and a count result indicating the traffic volume are displayed.

  Now, while the counting mode is set in the camera 3, the PTZ operation by the input operation from the input device NS is prohibited. That is, each camera 3 has the PTZ drive unit 36 fixed while the counting mode is set, and cannot be changed even if the operator operates the input device NS to change the imaging region of the camera 3. Thus, in the counting mode, the lock is applied so that the PTZ operation cannot be performed.

  In other words, the lock unit (locking unit) that controls to prohibit the PTZ operation by the input operation from the input device NS while the counting mode is set in the camera 3 is a part of the control unit 34 of the camera 3. Alternatively, it is provided as a part of the control unit 21 of the host computer 2 or the like.

  When the counting mode is canceled according to the time table 23, the monitoring mode is set. In the monitoring mode, the lock of the PTZ operation is released, and the operator can operate the input device NS to operate the PTZ driving unit 36 and change the imaging region of the camera 3.

  In the monitoring mode, an image (image data 70) obtained by imaging with the camera 3 is displayed on the display device DP. In that case, the operator can select one or a plurality of cameras 3 for displaying an image by the input device NS. When a plurality of cameras 3 are selected, the display surface of the display device DP is divided and each image is displayed. It is also possible to provide a plurality of display devices DP. For example, one display device DP may be provided for one camera 3.

  Next, the counting process performed in the counting processor 32 will be described.

  FIG. 5 is a flowchart illustrating an example of the flow of counting processing, FIG. 6 is a diagram illustrating an example of an image obtained during the counting period Tm, FIG. 7 is a flowchart illustrating a variation of the counting processing flow, and FIG. It is a figure which shows the example of the image acquired in the period Tm.

  The counting process is performed in the procedure shown in the flowchart of FIG. 5 based on the image of the traffic area TE captured during the counting period Tm, which is a set period (time).

  For example, assume that images GA to GD as shown in FIGS. 6A to 6D are obtained in the counting period Tm. These four images are older as the left one and newer as the right one. In addition to these four images, a large number of images are acquired, and adjacent images in FIG. 6 are not necessarily continuous frames. Below the images GA to GD, the overlapping positions of passersby (pedestrians) H and counting lines L1 and L2 described later are indicated by bold lines.

  First, a background portion is deleted from an image (GA to GD, etc.) using a background reference image in which a person is not captured and is captured in advance. That is, background difference processing is performed (# 101 in FIG. 5).

  An image in which the passer-by H is shown is searched from the obtained images in order from the oldest, and an image area in which the passer-by H is present is extracted from the images. Further, an image in which the image region (that is, the passerby H) first overlaps one of the counting lines L1 and L2 is searched (# 102). As a result, the image GB shown in FIG. 6B is obtained.

  The “counting line” is a line serving as a reference for performing counting. The counting lines L1 and L2 are set so as to be parallel to each other in the direction from the one side wall of the traffic area to the other side wall (the vertical axis direction in the image). The interval between the counting lines L1 and L2 is determined by the walking speed of the person and the shooting speed. For example, when the shooting speed is set to 30 frames per second and the walking speed of a person is assumed to be 1 to 2 m / sec, the interval between the counting lines L1 and L2 is set to about 20 cm on the floor surface of the actual traffic area. Set to correspond to. Note that two lines may be drawn in advance on the floor (floor) of the traffic area at an interval of about 20 cm, and these lines shown in the image may be used as the counting lines L1 and L2.

  The passerby H should overlap the other count line L2 soon after crossing the count line L1. In addition, the overlap position should substantially coincide with the position where the overlap position K1 between the passer-by H and the counting line L1 is moved straight in parallel with the wall (that is, in the traveling direction of the passer-by H). Therefore, if the search for the image after the image GB is continued as if the passer-by H is being tracked, the image area of the passer-by H overlaps with the other counting line L2 at the overlapping position K2 in the image GC immediately thereafter. (# 103). At this time, passers-by H are counted (# 104).

  Thus, the number of people who have passed through the traffic area is counted by searching for the passer-by H that overlaps both the counting lines L1 and L2. In addition, the number of passersby in each traveling direction (from the right to the left of the image or in the opposite direction) can be counted based on the order of crossing the counting lines L1 and L2.

  Alternatively, the counting process may be performed in the procedure shown in the flowchart of FIG. 7 using the optical flow method instead of the background difference method.

  For example, it is assumed that a large number of images including images GE to GH as shown in FIGS. 8A to 8D are obtained in the counting period Tm. Optical flows are obtained for these images in order from the oldest (# 201). While extracting the image area of the passer-by H based on the result (# 202), the passer-by H is tracked until the user H overlaps the count line L3 as shown in FIG. 8B (# 203). If it can be confirmed that it overlaps the counting line L3, the passer-by H is counted, and the traveling direction is obtained based on the optical flow of the passer-by H (# 204). In this way, the number of people who have passed through the traffic area can be counted for each traveling direction.

  FIG. 9 is a flowchart showing an outline of overall processing in the monitoring system 1.

  In FIG. 9, when monitoring of passersby is started, the host computer 2 first inputs an initial frame image of the camera 3 at time T = T0 (# 1), and creates a brightness image of the image (#). 2). If the counting process is performed by the background difference method described with reference to FIGS. 5 and 6, a background reference image is created (# 3).

  Images showing the traffic area are sequentially input from the camera 3 (# 5). When the camera 3 is in the counting mode position (Yes in # 6), the background reference image is appropriately updated using those images (# 7).

  Counting processing is executed according to the time table 23 (Yes in # 8, # 9). For example, when “from 0 to 5 minutes per hour” is set as the counting period Tm, the counting process is executed every time 0 minutes per hour. The counting process is executed using the background difference method described with reference to FIGS. 5 and 6 or the optical flow method described with reference to FIGS.

  A video indicating the result of the counting process for each traffic area and the current state is displayed on the display device DP (# 10). When a new frame image is input from the camera 3 and it is not in the counting mode, the input frame image is displayed on the display device DP without performing the counting process.

  Steps # 4 to # 10 are executed as needed until there are no more images for counting, that is, until monitoring is finished (No in # 4).

  FIG. 10 is a flowchart showing processing when an operation for PTZ operation is performed.

  In FIG. 10, when the operator performs an operation for PTZ operation with the input device NS (# 31), when not in the counting mode, that is, in the monitoring mode (No in # 32), the PTZ driving unit 36 is driven to drive the PTZ. The operation is performed (# 33). Thereby, the imaging region SR of the camera 3 is changed. However, in the counting mode (Yes in # 32), even if the operator performs an operation for the PTZ operation, the actual PTZ operation is not performed.

  As described above, even if the operator tries to cause the camera 3 to perform the PTZ operation during the counting mode, the PTZ operation during the counting mode is prohibited and the camera 3 cannot perform the PTZ operation. The area SR is not changed. Therefore, the counting process in the counting mode is normally performed, and it is possible to prevent a failure in the counting process for the number of people.

Hereinafter, a modified example of the processing related to the counting mode when the operator performs an operation for the PTZ operation of the camera 3 will be described.
[Modification 1]
FIG. 11 is a flowchart showing a first modification of the processing relating to the counting mode, and FIG. 12 is a diagram showing an example of a notification screen HG3 displayed in the counting mode.

  In FIG. 11, when the operator performs an operation for the PTZ operation with the input device NS (# 41), when not in the counting mode (No in # 42), the PTZ operation is performed (# 43). However, when in the counting mode (Yes in # 42), even if the operator performs an operation for the PTZ operation, the operator is notified that the current mode is the counting mode without performing the PTZ operation (# 44). .

  As shown in FIG. 12, for example, the operator is presented with a screen HG3 displaying a message MS indicating that the PTZ operation cannot be performed in the counting mode, superimposed on the normal screen HG2 in the counting mode. On the screen HG3 shown in FIG. 12B, a message MS1 “Number of people is being counted. PTZ is not possible” is displayed.

  By performing such notification, the operator can know that the reason why the camera 3 does not perform the PTZ operation is that the counting process is being performed, and can distinguish it from the case where the PTZ operation is not performed due to a failure or the like. .

Note that the content and display method of such a message MS may be various other than those described above. In addition to displaying on the display surface HG, or instead of displaying, notification may be performed by outputting sound from the speaker SP. In that case, the content of the message MS may be read out by synthesized speech, or a false sound for notification may be generated. The same applies to the following modifications.
[Modification 2]
FIG. 13 is a flowchart showing a second modification of the processing relating to the counting mode, and FIG. 14 is a diagram showing an example of a notification screen HG5 displayed in the counting mode.

  In FIG. 13, when the operator performs an operation for the PTZ operation with the input device NS (# 51), when not in the counting mode (No in # 52), the PTZ operation is performed (# 53). However, when in the counting mode (Yes in # 52), even if the operator performs an operation for the PTZ operation, the operator is notified that the current mode is the counting mode without performing the PTZ operation. Is asked to have the operator select whether or not to interrupt (# 54).

  For example, as shown in FIG. 14, an inquiry to the operator is superimposed on the normal screen HG4 in the counting mode, and a message that prompts the user to input that the counting mode is not possible and that the counting process is interrupted. A screen HG5 displaying the MS is presented to the operator. On the screen HG5 shown in FIG. 14 (b), a message MS2 “Counting the number of people is interrupted?”, “YES” button BT1, and “NO” button BT2 are displayed. The operator operates the mouse or the like of the input device NS, moves the cursor to one of the buttons BT1, 2 and clicks.

  When the operator selects the interruption (Yes in # 55), the counting mode is canceled (# 56). When the operator selects continuation (No in # 55), the counting mode is not canceled and the PTZ operation is not performed.

  According to this example, the operator can determine, as necessary, at which point of time the counting mode or the monitoring mode should be set, that is, which of the counting process and the monitoring should be prioritized.

It should be noted that an appropriate key in the input device NS may be operated and input for selection of interruption of the counting mode.
[Modification 3]
FIG. 15 is a flowchart showing a third modification of the processing relating to the counting mode.

  In FIG. 15, when the counting mode is set and the counting process is started (Yes in # 61), the operator is notified that the current mode is the counting mode (# 62). As a notification method, for example, the message MS1 shown on the screen HG3 in FIG.

Accordingly, since the operator knows in advance that the counting process is being performed, the operator can refrain from performing the PTZ operation, and unnecessary operations can be eliminated.
[Modification 4]
FIG. 16 is a flowchart showing a fourth modification of the processing relating to the counting mode.

  In FIG. 16, when the operator performs an operation for the PTZ operation with the input device NS (# 71), when not in the counting mode (No in # 72), the PTZ operation is performed (# 73). However, when in the counting mode (Yes in # 72), even if the operator performs an operation for the PTZ operation, the operator is notified that the current mode is the counting mode without performing the PTZ operation (# 74). .

  Thereafter, when the operator further performs an operation for the PTZ operation with the input device NS (Yes in # 75), the counting mode is canceled (# 76), and the PTZ operation can be performed according to the operation.

  According to this example, when the operator inputs the operation for the PTZ operation even though the counting mode is notified, the counting process can be stopped and the actual PTZ operation can be performed. As a result, oversight can be prevented when monitoring is urgent.

In step # 74, the operator is notified that the counting mode is set. In this case, even if no operation for the PTZ operation is performed in step # 71, the step # 72 is set to the counting mode. 74 notifications may be performed. Further, the notification in step # 74 may be performed only once in the counting mode, or may be repeated as many times as necessary.
[Modification 5]
FIG. 17 is a flowchart showing a fifth modification of the processing relating to the counting mode.

  In FIG. 17, when the operator is performing an operation for the PTZ operation with the input device NS (# 80), when it is time to set the count mode and start the counting process (Yes in # 82), the input device Control is performed to forcibly prohibit the PTZ operation so that the PTZ operation by NS cannot be performed (# 84), and the camera 3 is returned to the counting mode position (# 85). That is, the camera 3 enters the counting mode and is forcibly set to the counting mode position. Then, the counting process is started (# 86).

According to this example, even if the operator performs an operation for the PTZ operation using the input device NS, the camera 3 automatically performs control for the count mode when the time table 23 is to perform the counting process. Thus, the counting process in the counting mode is normally performed, and the failure of the counting process for the number of people can be prevented in advance.
[Modification 6]
FIG. 18 is a flowchart showing a sixth modification of the processing relating to the counting mode, and FIG. 19 is a diagram showing an example of a notice screen HG7 displayed in the monitoring mode.

  In FIG. 18, when a predetermined time before the count mode is set by the time table 23, for example, one minute before (Yes in # 91), a notice to that effect is given to the operator (# 92).

  For example, as shown in FIG. 19, the operator is presented with a screen HG7 displaying a message MS indicating that the counting mode is about to start, superimposed on the screen HG6 in the monitoring mode. On the screen HG7 shown in FIG. 19B, a message MS3 “Counting process will start soon” is displayed. This alerts the operator who is performing an operation for the PTZ operation at that time.

  When the counting mode is set and the counting process is started (Yes in # 93) and the operator is still performing an operation for the PTZ operation (Yes in # 94), the counting mode is changed. Without setting, the monitoring mode is set (or the monitoring mode is continued) (# 95). As a result, as shown in FIG. 19D, the screen HG9 in the monitoring mode is continued. If the operator is not performing an operation for the PTZ operation (No in # 94), the counting mode is set (# 96). As a result, as shown in FIG. 19C, the screen is switched to the screen HG8 in the counting mode.

  According to this example, the operator can decide whether to give priority to counting or monitoring by notifying or announcing the operator in advance before the counting process starts. It is not necessary to interrupt the process.

  In the embodiment described above, the counting process is performed in each camera 3. However, only the image may be transmitted from the camera 3 to the host computer 2, and the host computer 2 may perform the counting process. As the input device NS that performs operation input for the PTZ operation, various keys, a mouse, a joystick, a touch panel, and other various operation means can be used.

  In the embodiment described above, the configuration, shape, dimension, function, number, processing content, processing order, display content, etc. of the entire camera 3, host computer 2, or monitoring system 1 or each part are within the scope of the present invention. Can be changed accordingly.

  It is used to monitor whether there are any abnormalities in passages and facilities in commercial facilities and public facilities, and to count the number of visitors and traffic.

It is a figure which shows the example of the whole structure of the monitoring system which shows embodiment of this invention. It is a figure which shows the example of arrangement | positioning of a camera, and an imaging region. It is a figure which shows the example of a functional structure of the monitoring system. It is a figure which shows the example of the screen for monitoring. It is a flowchart explaining the example of the flow of a count process. It is a figure which shows the example of the image acquired in the counting period. It is a flowchart explaining the modification of the flow of a count process. It is a figure which shows the example of the image acquired in the counting period. It is a flowchart which shows the outline of the whole process in the monitoring system. It is a flowchart of a process when operation for PTZ operation | movement is performed. It is a flowchart which shows the modification 1 of the process regarding count mode. It is a figure which shows the example of the notification screen displayed in count mode. It is a flowchart which shows the modification 2 of the process regarding count mode. It is a figure which shows the example of the notification screen displayed in count mode. It is a flowchart figure which shows the modification 3 of the process regarding a count mode. It is a flowchart which shows the modification 4 of the process regarding count mode. It is a flowchart which shows the modification 5 of the process regarding count mode. It is a flowchart which shows the modification 6 of the process regarding count mode. It is a figure which shows the example of the preview screen displayed in monitoring mode.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Monitoring system 2 Host computer 21 Control part (counting control means)
23 Time table (counting control means)
24 Counting mode setting unit (counting control means)
25 monitoring mode setting unit 26 message output unit (notification means)
3 Camera (imaging device)
31 Imaging unit (imaging device)
32 Counting processing unit (counting means)
34 Control unit (counting control means)
36 PTZ driving unit (imaging area control means)
NS input device (operation means)
DP display device (notification means)
SP speaker (notification means)
SR imaging area

Claims (7)

An imaging device capable of changing the imaging area;
Counting means for counting the number of people based on the image obtained by the imaging device;
Operation means for performing an operation of changing the imaging region for monitoring by the imaging device;
Counting control means for controlling to perform counting by the counting means at a predetermined timing,
While the counting unit is counting by the control of the counting control unit, the operation region changing operation by the operation unit is prohibited.
A monitoring system characterized by that. A notification means for notifying an operator that the number of persons is being counted by the counting means when the operation means is operated while the operation of changing the imaging area by the operating means is prohibited;
The monitoring system according to claim 1. Whether to notify the operator that the number of persons is being counted by the counting means and interrupt the counting of the number of persons when the operation means is operated while the operation of changing the imaging area by the operating means is prohibited A notification means for allowing the operator to select whether or not,
The counting control means controls so that counting by the counting means is interrupted when the operator selects to stop counting the number of people.
The monitoring system according to claim 1. While the counting means is counting by the control of the counting control means, it has a notification means for notifying the operator to that effect,
The monitoring system according to claim 1. A notification means for notifying an operator of the fact while the counting means is counting under the control of the counting control means;
When the operation unit is operated with respect to an imaging apparatus for which an operation of changing the imaging region by the operation unit is prohibited, the counting by the counting unit is controlled to be interrupted.
The monitoring system according to claim 1. An imaging device capable of changing the imaging area;
Counting means for counting the number of people based on the image obtained by the imaging device;
Imaging region control means for performing change control of the imaging region for monitoring by the imaging device; and count control means for controlling to perform counting by the counting means at a predetermined timing;
When the counting means starts counting under the control of the counting control means, the imaging area of the imaging device is forcibly set to a preset area for counting the number of people, and during the counting, the imaging area control means Prohibiting change control of the imaging area;
A monitoring system characterized by that. Before the counting means starts counting by the control of the counting control means, it has a notifying means for notifying the operator of the start of counting,
The monitoring system according to claim 6.

Images