JP2019176518A - Imaging device - Google Patents

Abstract

To provide an imaging device that can reduce a burden on a detection range setting work.SOLUTION: An imaging device picks up an image of an imaging area including a body to be detected and generates picked-up image data showing a picked-up image. The imaging device includes a storage unit and a control unit. The storage unit stores a detection range in the picked-up image. The control unit detects a change of the picked-up image in the detection range on the basis of the picked-up image data. When detecting the change of the picked-up image in the detection range, the control unit changes the detection range so that the detection range includes an image of the body to be detected showing the body to be detected. The control unit changes the position of the detection range on the basis of the relative positions of the image of the body to be detected and the detection range before the body to be detected moves.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an imaging apparatus.

  Patent Document 1 discloses a camera setting device. The camera setting device disclosed in Patent Literature 1 includes a camera server device and an operation terminal. The camera server device is connected to the camera. The camera server device captures an image captured by the camera and performs an abnormality detection process. The operation terminal is connected to the camera server device via the network, and sets various parameters used for abnormality detection processing. Specifically, the operation terminal displays a user interface screen. The terminal operator sets various parameters on the interface screen. Specifically, the terminal operator sets a rectangular detection range on the user interface screen using a pointing device. The camera server device detects the occurrence of an abnormality based on a change in luminance value in the detection range.

JP 2004-248090 A

  However, in the technique as disclosed in Patent Document 1, when the position where the detection target is arranged changes, it is necessary to reset the detection range.

  In view of the above problems, an object of the present invention is to provide an imaging apparatus capable of reducing the burden of detection range setting work.

  The imaging device according to the first aspect of the present invention captures an imaging region including a detection target, and generates captured image data indicating the captured image. The imaging apparatus includes a storage unit and a control unit. The storage unit stores data indicating a detection range in the captured image. The control unit detects a change in the captured image in the detection range based on the captured image data. When the control unit detects a change in the captured image in the detection range, the control unit changes the detection range so that the detection range includes a detection target image indicating the detection target. The control unit changes the position of the detection range based on a relative position between the detection target image and the detection range before the detection target moves.

  The imaging device according to the second aspect of the present invention images an imaging region including a detection target, and generates captured image data indicating the captured image. The imaging apparatus includes a storage unit and a control unit. The storage unit stores data indicating a detection range in the captured image. The control unit detects a change in the captured image in the detection range based on the captured image data. When the control unit detects a change in the captured image in the detection range, the control unit changes the detection range so that the detection range includes a detection target image indicating the detection target. When a part of the detection range is located outside the captured image, the control unit changes the position of the detection range so that the detection range is included in the captured image.

  The imaging device according to the third aspect of the present invention captures an imaging region including a detection target, and generates captured image data indicating the captured image. The imaging apparatus includes a storage unit and a control unit. The storage unit stores data indicating a detection range in the captured image. The control unit detects a change in the captured image in the detection range based on the captured image data. When the control unit detects a change in the captured image in the detection range, the control unit changes the detection range so that the detection range includes a detection target image indicating the detection target. When a part of the detection range is located outside the captured image, the control unit changes the size of the detection range so that the detection range is included in the captured image.

  The imaging device according to the fourth aspect of the present invention images an imaging region including a detection target, and generates captured image data indicating the captured image. The imaging apparatus includes a storage unit and a control unit. The storage unit stores data indicating a detection range in the captured image. The control unit detects a change in the captured image in the detection range based on the captured image data. When the control unit detects a change in the captured image in the detection range, the control unit changes the detection range so that the detection range includes a detection target image indicating the detection target. The control unit acquires a change in the size of the detected object image, and changes the detection range according to the change in the size of the detected object image.

  An imaging device according to a fifth aspect of the present invention images an imaging region including a detection target, and generates captured image data indicating the captured image. The imaging apparatus includes a first storage unit, a control unit, a notification unit, and a second storage unit. The first storage unit stores data indicating a detection range in the captured image. The control unit detects a change in the captured image in the detection range based on the captured image data. The notification unit notifies the user of information. The second storage unit stores an authentication image of the detected object. When the control unit detects a change in the captured image in the detection range, the control unit changes the detection range so that the detection range includes a detection target image indicating the detection target. When the matching rate between the authentication image and the detected object image is lower than a threshold value, the control unit causes the notification unit to notify a message to change the direction of the detected object.

  According to the present invention, it is possible to reduce the burden of detection range setting work.

It is a figure which shows the structure of the monitoring system which concerns on Embodiment 1 of this invention. It is a figure which shows an example of the setting screen which concerns on Embodiment 1 of this invention. It is a figure which shows an example of the captured image after the to-be-detected body image shown in FIG. 2 moved. It is a figure which shows an example of the captured image after the detection range shown in FIG. 3 changed. It is a flowchart which shows the detection range change process which concerns on Embodiment 1 of this invention. It is a figure which shows the other example of the captured image which concerns on Embodiment 1 of this invention. It is a figure which shows the 1st other example of the captured image after the to-be-detected body image shown in FIG. 2 moved. It is a figure which shows an example of the captured image after the detection range shown in FIG. 7 changed. It is a figure which shows the 2nd other example of the captured image after the to-be-detected body image shown in FIG. 2 moved. It is a figure which shows an example of the captured image after the detection range shown in FIG. 9 changed. It is a flowchart which shows the detection range change process which concerns on Embodiment 2 of this invention. It is a figure which shows the other example of the captured image after the detection range shown in FIG. 9 changed. It is a figure which shows an example of the captured image which concerns on Embodiment 3 of this invention. It is a figure which shows an example of the captured image after the to-be-detected body shown in FIG. 13 moved. It is a flowchart which shows the detection range change process which concerns on Embodiment 3 of this invention. It is a figure which shows the structure of the monitoring system which concerns on Embodiment 4 of this invention. It is a figure which shows an example of the 1st captured image and 2nd captured image which concern on Embodiment 4 of this invention. It is a figure which shows an example of the 1st captured image after the to-be-detected body image shown in FIG. 17 moved, and a 2nd captured image. It is a flowchart which shows the detection range change process which concerns on Embodiment 4 of this invention. It is a figure which shows the other examples of the 1st captured image after the to-be-detected body image shown in FIG. 17 moved, and a 2nd captured image. It is a figure which shows the other examples of the 1st captured image and 2nd captured image which concern on Embodiment 4 of this invention. It is a figure which shows an example of the 1st captured image after the to-be-detected body image shown in FIG. 21 moved, and a 2nd captured image.

  Embodiments of the present invention will be described below with reference to the drawings. In the drawings, the same or corresponding parts are denoted by the same reference numerals and description thereof is not repeated.

[Embodiment 1]
First, a monitoring system 100 according to an embodiment of the present invention will be described with reference to FIG. FIG. 1 is a diagram illustrating a configuration of a monitoring system 100 according to the first embodiment. The monitoring system 100 according to the present embodiment detects the occurrence of an event for the detected object. The object to be detected is set (designated) by the administrator of the monitoring system 100. The detected body is, for example, “an object installed in a public place”. The event for the detected object is, for example, “take away”.

  As shown in FIG. 1, the monitoring system 100 includes a first camera 1 and a control device 5. The first camera 1 is an example of a first imaging device.

  The first camera 1 includes an image sensor 11, a camera communication unit 12, a camera storage unit 13, and a camera control unit 14. The camera storage unit 13 is an example of a first storage unit. The camera control unit 14 is an example of a control unit.

  The image sensor 11 captures an image area. The image sensor 11 generates data indicating the captured image and transmits the data to the camera control unit 14. Hereinafter, data indicating a captured image is referred to as “captured image data”. The imaging device 11 is, for example, a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary Metal Oxide Semiconductor) image sensor.

  The camera communication unit 12 can communicate with an electronic device equipped with a communication device that uses the same communication method (protocol). The camera communication unit 12 communicates with the control device 5 via a network such as a LAN (Local Area Network). The camera communication unit 12 is a communication module (communication device) such as a LAN board, for example. In the present embodiment, the camera communication unit 12 transmits captured image data to the control device 5.

  The camera storage unit 13 stores various data such as captured image data. The camera storage unit 13 is configured by a semiconductor memory. The semiconductor memory includes, for example, a RAM (Random Access Memory) and a ROM (Read Only Memory).

  The camera control unit 14 controls the operation of each unit included in the first camera 1 by executing a camera control program stored in the camera storage unit 13. The camera control unit 14 is configured by a processor such as an MPU (micro processing unit), for example.

  The camera control unit 14 detects a change in the captured image in the detection range based on the captured image data. In the present embodiment, the detection range is preset by the administrator. Data indicating the detection range is stored in the camera storage unit 13.

  For example, the camera control unit 14 detects a change in the captured image by the background subtraction method. Or the camera control part 14 detects the change of a captured image by the difference method between adjacent frames.

  When detecting a change in the captured image in the detection range, the camera control unit 14 causes the flag to transition from the off state to the on state. The flag indicates that the captured image in the detection range has changed. Data indicating the flag is stored in the camera storage unit 13.

  When detecting a change in the captured image in the detection range, the camera control unit 14 causes the camera storage unit 13 to store the captured image data. When the camera control unit 14 detects a change in the captured image in the detection range, the camera control unit 14 transmits data indicating that the change in the captured image in the detection range is detected to the control device 5 via the camera communication unit 12. Hereinafter, data indicating that a change in the captured image in the detection range is detected is referred to as “change detection data”.

  The control device 5 includes a device communication unit 51, an input device 52, an output device 53, a device storage unit 54, and a device control unit 55. The device communication unit 51 and the output device 53 are an example of a notification unit. The device storage unit 54 is an example of a second storage unit. The device control unit 55 is an example of a control unit. The control device 5 is, for example, a server.

  The device communication unit 51 can communicate with an electronic device equipped with a communication device that uses the same communication method (protocol). The device communication unit 51 communicates with the camera communication unit 12 via a network such as a LAN. The device communication unit 51 is, for example, a communication module (communication device) such as a LAN board. In the present embodiment, the device communication unit 51 receives captured image data from the camera communication unit 12. Further, when the camera control unit 14 detects a change in the captured image, the device communication unit 51 receives change detection data from the camera communication unit 12.

  The input device 52 accepts input of user instructions to the control device 5. In the present embodiment, the input device 52 includes a keyboard and a mouse. Note that the input device 52 may include a touch sensor.

  The output device 53 outputs a captured image based on the captured image data received by the device communication unit 51. In the present embodiment, the output device 53 includes a display such as a liquid crystal display.

  The device storage unit 54 stores various data such as captured image data. The device storage unit 54 includes a storage device and a semiconductor memory. The storage device is configured by, for example, an HDD (Hard Disk Drive) and / or an SSD (Solid State Drive). The semiconductor memory constitutes a RAM and a ROM, for example.

  The device control unit 55 controls the operation of each unit included in the control device 5 by executing a device control program stored in the device storage unit 54. The device control unit 55 is configured by a processor such as a CPU (Central Processing Unit), for example.

  When the input device 52 receives an instruction to output a captured image, the device control unit 55 causes the output device 53 to output a captured image based on the captured image data received by the device communication unit 51. Alternatively, the device control unit 55 causes the output device 53 to output a captured image based on the captured image data stored in the device storage unit 54.

  Moreover, the apparatus control part 55 receives the detection range and the setting of a to-be-detected body by an administrator. In the present embodiment, the device control unit 55 causes the output device 53 to display a setting screen for setting a detection range and a detection target.

  Next, the setting screen S according to the present embodiment will be described with reference to FIGS. 1 and 2. FIG. 2 is a diagram illustrating an example of the setting screen S according to the first embodiment. In the following, the embodiment will be described with the longitudinal direction of the captured image SG1 as the X-axis direction and the short direction of the captured image SG1 as the Y-axis direction. Further, an embodiment will be described in which one side (right side in FIG. 2) in the longitudinal direction (X-axis direction) of the captured image SG1 is the X1 side and the other side (left side in FIG. 2) is the X2 side. Further, the embodiment will be described in which one side (upper side in FIG. 2) in the short side direction (Y-axis direction) of the captured image SG1 is the Y1 side and the other side (lower side in FIG. 2) is the Y2 side.

  As shown in FIG. 2, the setting screen S includes a display unit S1 and a setting receiving unit S2. The device control unit 55 displays the captured image SG1 on the display surface of the display unit S1 based on the captured image data received by the device communication unit 51. In the example illustrated in FIG. 2, the captured image SG1 includes a fire extinguisher image GF indicating a fire extinguisher and a painting image GP indicating a painting. In other words, the first camera 1 (image sensor 11) images an imaging area where a fire extinguisher and a picture are installed.

  The setting receiving unit S2 receives the setting (registration) of the detection range 4 and the detected object. Specifically, the setting reception unit S2 includes a setting target selection unit S21, an OK button S22, and a cancel button S23. The administrator can select either “detected body” or “detection range” as a setting target by operating the setting target selection unit S21 using the input device 52. Specifically, the setting target selection unit S21 includes radio buttons. The administrator can select either “detected object” or “detection range” as a setting target by changing the selection state of the radio button using the input device 52.

  When the administrator selects “detected object” as the setting target, the administrator can specify the detected object on the captured image SG1 displayed on the display unit S1. Specifically, the administrator uses the input device 52 to select the image 3 indicating the detected object from the images indicating the objects included in the captured image SG1 (for example, the fire extinguisher image GF and the painting image GP) ( For example, the object to be detected can be specified by clicking. Hereinafter, the image 3 indicating the detected object is referred to as “detected object image 3”.

  When the administrator selects the detection range 4 as a setting target, the administrator selects an arbitrary range including the detected object image 3 on the captured image SG1 displayed on the display unit S1 using the input device 52 (for example, The detection range 4 can be specified by dragging to draw a rectangular figure. When the detection range 4 is designated, an image (for example, a one-dot chain line) surrounding the detection range 4 is displayed on the captured image SG1. The image surrounding the detection range 4 shows the outline of the detection range 4.

  The administrator designates the detected object (detected object image 3) and the detection range 4, and then presses the OK button S22 using the input device 52, thereby detecting the detected object (detected object image 3) and The detection range 4 can be set (registered). When detecting that the OK button S22 is pressed, the device control unit 55 acquires data indicating the detected object image 3 and data indicating the detection range 4. In the present embodiment, the administrator sets the fire extinguisher (fire extinguisher image GF) as the detected object (detected object image 3), and the range including the detected object image 3 (fire extinguisher image GF) is the detection range 4. Set as. In addition, when detecting that the cancel button S23 is pressed, the device control unit 55 ends the display of the setting screen S without acquiring data indicating the detected object image 3 and data indicating the detection range 4. Hereinafter, data indicating the detected object image 3 is referred to as “detected object image data”, and data indicating the detection range 4 is referred to as “detection range data”.

  When acquiring the detected object image data and the detection range data, the apparatus control unit 55 causes the apparatus storage unit 54 to store the detected object image data as authentication image data. In addition, the device control unit 55 stores the authentication image data and the detection range data in the device storage unit 54 in association with each other according to a predetermined condition. Specifically, the device control unit 55 determines one pixel among the pixels constituting the outline of the detection range 4 as the first identification pixel G1 according to a predetermined condition, and determines the pixels constituting the detected object image 3. One of the pixels is determined as the second identification pixel G2. The first identification pixel G1 indicates, for example, a pixel displayed at a position closest to the origin PS (for example, the upper left corner) of the display surface among the pixels constituting the outline of the detection range 4. In the present embodiment, when there are a plurality of pixels displayed at the position closest to the origin PS on the display surface, the device control unit 55 determines the pixel displayed closest to the Y1 side as the first identification pixel G1. Similarly, the second identification pixel G2 indicates a pixel displayed at a position closest to the origin PS on the display surface among the pixels constituting the detected object image 3. In the present embodiment, when there are a plurality of pixels displayed at the position closest to the origin PS on the display surface, the device control unit 55 determines the pixel displayed closest to the Y1 side as the second identification pixel G2.

  When determining the first identification pixel G1 and the second identification pixel G2, the device control unit 55 generates relative position data indicating the relative positional relationship between the first identification pixel G1 and the second identification pixel G2. The relative position data is generated based on the position (coordinates) where the first identification pixel G1 is displayed and the position (coordinates) where the second identification pixel G2 is displayed. The device control unit 55 stores the generated relative position data in the device storage unit 54.

  In addition, when the detection range 4 is set, the device control unit 55 transmits detection range data to the camera communication unit 12 via the device communication unit 51. When the camera communication unit 12 receives the detection range data, the camera control unit 14 stores the detection range data in the camera storage unit 13. The image sensor 11 detects a change in the captured image in the detection range 4 indicated by the detection range data.

  Next, the processing of the monitoring system 100 when the camera control unit 14 detects that the captured image has changed in the detection range 4 will be described with reference to FIGS. FIG. 3 is a diagram illustrating an example of the captured image SG1 after the detected object image 3 illustrated in FIG. 2 has moved. FIG. 4 is a diagram illustrating an example of the captured image SG1 after the detection range 4 illustrated in FIG. 3 has changed.

  As shown in FIGS. 2 and 3, the detected object (fire extinguisher image GF) moves, and the camera control unit 14 described with reference to FIG. 1 detects a change in the captured image in the detection range 4. Then, the change detection data is transmitted to the device communication unit 51.

  When the device communication unit 51 receives the change detection data, the device control unit 55 stores the captured image data received by the device communication unit 51 in the device storage unit 54 and executes a detection range change process. Specifically, as shown in FIGS. 3 and 4, the device control unit 55 changes the position of the detection range 4 according to the movement of the detection target (fire extinguisher image GF). Specifically, the device control unit 55 changes the position of the detection range 4 so that the detection range 4 includes the detected object image 3.

  More specifically, as shown in FIG. 4, one image (third identification pixel G3) constituting the detected object image 3 after change and one pixel (first identification) constituting the outline of the detection range 4 The position of the detection range 4 is changed so that the relative positional relationship with the pixel G1) matches the relative position indicated by the relative position data stored in the device storage unit 54. For example, the device control unit 55 acquires, as the third identification pixel G3, a pixel displayed at a position closest to the origin PS on the display surface among the pixels constituting the detected object image 3 after the movement. The position (coordinates) at which the pixel G3 is displayed is acquired. In addition, when there are a plurality of pixels displayed at the position closest to the origin PS on the display surface of the display unit S1, the device control unit 55 acquires the pixel displayed closest to the Y1 side as the third identification pixel G3.

  The device control unit 55 displays the first identification pixel G1 based on the data (coordinate data) indicating the position where the third identification pixel G3 is displayed and the relative position data stored in the device storage unit 54. Determine (coordinates). In other words, the device control unit 55 sets the position of the detection range 4 so that the relative positional relationship between the first identification pixel G1 and the third identification pixel G3 matches the relative position indicated by the relative position data. Change.

  Next, the detection range changing process according to the first embodiment will be further described with reference to FIG. FIG. 5 is a flowchart illustrating the detection range changing process according to the first embodiment. The detection range changing process is started when the device communication unit 51 receives change detection data.

  As illustrated in FIG. 5, when the device communication unit 51 receives the change detection data, the device control unit 55 waits until the standby time elapses (No in step S102). The waiting time is preset by the administrator and stored in the device storage unit 54. For example, the administrator sets, as the standby time, a time that is assumed to be required for the third person who takes away the detected object to move out of the imaging region. The waiting time is, for example, 1 minute.

  If the device control unit 55 determines that the standby time has elapsed (step S102: Yes), based on the captured image data received by the device communication unit 51 and the authentication image data stored in the device storage unit 54, An image that matches the authentication image indicated by the authentication image data is searched from the captured image SG1, and it is determined whether or not the detected object image 3 is included in the captured image SG1 (step S104). Specifically, the device control unit 55 searches for the detected object image 3 by pattern matching processing. Specifically, the device control unit 55 compares the authentication image data stored in the device storage unit 54 with the captured image data, and an image whose matching rate with the authentication image is equal to or greater than a first threshold is captured image. It is determined whether or not the detected object image 3 is included in the captured image SG1 depending on whether or not it exists in SG1. The first threshold is set in advance by an administrator, for example.

  If the device control unit 55 determines that the detected object image 3 is not included in the captured image SG1 (step S104: No), the device control unit 55 ends the detection range changing process and notifies the device that the carry-out has occurred. The communication unit 51 is notified. Specifically, the device control unit 55 transmits a mail indicating that the take-away has occurred to the administrator via the device communication unit 51. Alternatively, the device control unit 55 causes the output device 53 to display a message indicating that the carry-out has occurred.

  On the other hand, if the apparatus control unit 55 determines that the detected object image 3 is included in the captured image SG1 (step S104: Yes), in other words, if it is determined that the position where the detected object is arranged has changed, the detection is performed. The position of range 4 is changed (step S106). When the position of the detection range 4 is changed, the device control unit 55 deletes the captured image data stored in the device storage unit 54. In addition, the device control unit 55 transmits the detection range data indicating the detection range 4 after the change and a request to turn off the flag to the camera communication unit 12 via the device communication unit 51. When the camera communication unit 12 receives the detection range data indicating the detection range 4 after the change, the camera control unit 14 converts the detection range data stored in the camera storage unit 13 into the detection range data indicating the detection range 4 after the change. Update to Further, when the camera communication unit 12 receives a request to turn off the flag, the camera control unit 14 changes the flag to the off state. When the camera control unit 14 changes the flag to the off state, the captured image data stored in the camera storage unit 13 is deleted. Thereby, the detection range changing process ends.

  The camera communication unit 12 detects a change in the captured image SG1 based on detection range data indicating the detection range 4 after the change stored in the camera storage unit 13.

  The first embodiment has been described above. According to the present embodiment, when the detected object moves, the device control unit 55 changes the position of the detection range 4 so as to include the detected object image 3. Therefore, the administrator does not need to reset the detection range 4. As a result, the burden of setting the detection range 4 by the administrator can be reduced.

  In the present embodiment, the configuration in which the output device 53 is a display has been described. However, the output device 53 may be, for example, a printer that outputs an image to a sheet such as paper.

  Further, in the present embodiment, the case where the shape of the detection range 4 is rectangular has been described as an example, but the shape of the detection range 4 is not particularly limited as long as the shape includes the detected object image 3. The shape of the detection range 4 may be, for example, a shape along the contour of the detected object image 3.

  In addition, for example, when the direction of the detected object after movement is different from the direction of the detected object before movement, the coincidence ratio between the detected object image 3 after movement and the authentication image is smaller than the second threshold value. There is. The second threshold is set by the administrator. The second threshold has a value higher than the first threshold. If the match rate is lower than the second threshold value and higher than the first threshold value, the device control unit 55 outputs a message to the output device 53 urging to change the angle of the detected object with respect to the first camera 1 and to place it again. The administrator may be notified. The second threshold value is an example of a threshold value.

  In the present embodiment, the detected object image 3 (an image showing the detected object viewed from one direction) included in the captured image SG is stored in the device storage unit 54 as an authentication image. A plurality of images obtained by viewing the detected object from multiple directions may be included. In this case, the device control unit 55 calculates a match rate using a plurality of recognition images stored in the device storage unit 54, and selects an authentication image showing the highest match rate from the plurality of authentication images. Then, the detected object image 3 is searched.

  In this embodiment, the case where the authentication image data is the detected object image 3 has been described as an example. However, the authentication image data may be data indicating the shape (contour) of the detected object, for example. Good.

  Alternatively, when the captured image SG1 includes the identification image 31 for identifying the detection target, the authentication image data may be data indicating the identification image 31. The device control unit 55 acquires the identification image 31 by using a function of OCR (Optical Character Recognition), for example. Specifically, the device control unit 55 acquires the identification image 31 by analyzing the character image included in the captured image SG1 using the OCR function. FIG. 6 is a diagram illustrating another example of the captured image SG1 according to the first embodiment. When the detected object is a fire extinguisher as in the example illustrated in FIG. 6, the identification image 31 indicates the characters “fire extinguisher”.

  In this embodiment, the configuration in which the imaging region captured by the imaging device 11 is constant has been described as an example. However, the camera control unit 14 moves the detected object based on the change in the pixels included in the detection range 4. When detecting, the imaging region of the imaging device 11 may be changed so as to track the detection target. For example, as shown in FIGS. 2 and 7, when the detected object image 3 moves in the X1 direction, the imaging region changes in the X1 direction. FIG. 7 is a diagram illustrating a first other example of the captured image SG1 after the detected object image 3 illustrated in FIG. 2 has moved. FIG. 8 is a diagram illustrating an example of the captured image SG after the detection range 4 illustrated in FIG. 7 has changed. As illustrated in FIG. 8, as described with reference to FIGS. 2 to 5, the device control unit 55 changes the position of the detection range 4 so as to include the detected object image 3 after movement.

  In this embodiment, the standby time is set to a time that is assumed to be required for a third person who takes away the detected object to move out of the imaging area, but the standby time may be changed. For example, when there is a plan to use the detected object, the standby time may be temporarily changed by the apparatus control unit 55 during the period in which the detected object is used. Specifically, when the detected object is a fire extinguisher, the standby time may be changed to a period in which evacuation training or the like is scheduled. Thereby, it is suppressed that the detected object is erroneously detected as being carried away.

  In the present embodiment, the device control unit 55 detects the occurrence of an event for the detected object. However, the camera control unit 14 may detect the occurrence of an event for the detected object.

[Embodiment 2]
Next, the monitoring system 100 according to the second embodiment will be described with reference to FIGS. 1, 2, and 9 to 11. The second embodiment is different from the first embodiment in that the device control unit 55 changes the detection range 4 when the detection range 4 is located outside the captured image SG1. Hereinafter, the matters different from the first embodiment will be described for the second embodiment, and the description of the parts overlapping with the first embodiment will be omitted.

  First, the detection range 4 according to the second embodiment will be described with reference to FIGS. 9 and 10. FIG. 9 is a diagram illustrating a second other example of the captured image SG1 after the detected object image 3 illustrated in FIG. 2 has moved. FIG. 10 is a diagram illustrating an example of the captured image SG1 after the detection range 4 illustrated in FIG. 9 has changed. In FIG. 10, the detection range 4 (see Embodiment 1) changed based on the relative position data is indicated by a two-dot chain line.

  When the detected object image 3 after movement is located at the end of the captured image SG1, if the position of the detection range 4 is changed based on the relative position data, a part of the changed detection range 4 is captured. It may be located outside the image SG1. For example, as shown in FIGS. 9 and 10, when the detected object image 3 after movement is located at the end of the captured image SG1 in the X2 direction, the position of the detection range 4 is changed based on the relative position data. Then, the outline on the X2 side of the detection range 4 is located outside the captured image SG1. In this embodiment, when the outline of the detection range 4 is located outside the captured image SG1 by moving the detection range 4 based on the relative position data, the device control unit 55 causes all of the detection ranges 4 to be moved. The position of the detection range 4 is further changed so that the outer contour is located inward of the captured image SG1. In the example illustrated in FIG. 10, the device control unit 55 further moves the detection range 4 to the X1 side so that the X2 side outline of the detection range 4 is positioned inward of the captured image SG1. Specifically, the device control unit 55 moves the detection range 4 to the X1 side so that the X coordinate of the outline on the X2 side of the detection range 4 indicates a value of “0”. In the example shown in FIG. 9, the X coordinate of the position where the first identification pixel G1 in the detection range 4 changed based on the relative position data is displayed indicates a negative value.

  FIG. 11 is a flowchart illustrating detection range change processing according to the second embodiment. As illustrated in FIG. 11, when the device control unit 55 changes the position of the detection range 4 based on the relative position data (step S106), a part of the outline of the detection range 4 after the movement is outside the captured image SG1. It is determined whether it is located in the direction (step S202). When the device control unit 55 determines that a part of the outline of the detection range 4 is located outside the captured image SG1 (step S202: Yes), all the outlines of the detection range 4 are located inside the captured image SG1. As described above, the position of the detection range 4 is changed (step S204), and the detection range change process is terminated. On the other hand, when the device control unit 55 determines that a part of the outline of the detection range 4 is not located outside the captured image SG1 (step S202: No), the detection range change process is terminated.

  The second embodiment has been described above. According to this embodiment, when a part of the outline of the detection range 4 after movement is located outside the captured image SG1, the apparatus control unit 55 places all the outlines of the detection range 4 inside the captured image SG1. The position of the detection range 4 is changed so that is positioned. Therefore, the burden of the setting work of the detection range 4 by the administrator can be reduced.

  In the present embodiment, the device control unit 55 determines that all the outlines of the detection range 4 are positioned inside the captured image SG1 when a part of the outline of the detection range 4 is positioned outside the captured image SG1. The detection range 4 is moved so that all the outlines of the detection range 4 may be located inside the captured image SG1. For example, all the outlines of the detection range 4 are captured image SG1. The size or shape of the detection range 4 may be changed so as to be located inward. Specifically, as illustrated in FIG. 12, the device control unit 55 may delete the detection range 4 located outside the captured image SG1, and extend the detection range 4 in the X1 direction and the Y1 direction. In FIG. 12, the area indicated by hatching is an expanded area. FIG. 12 is a diagram illustrating another example of the captured image SG1 after the detection range 4 illustrated in FIG. 9 has changed. When the size of the detection range 4 is changed, the size of the detection range 4 after the change is preferably the same as the size of the detection range 4 before the change or larger than the detection range 4 before the change. Thereby, for example, it is possible to detect an image change around the detected object such as a person approaching the detected object. As a result, it is possible to detect the occurrence of an event for the detected object at an earlier timing.

[Embodiment 3]
Subsequently, the monitoring system 100 according to the third embodiment will be described with reference to FIGS. 1, 2, and 13 to 15. The third embodiment is different from the first and second embodiments in that the size of the detection range 4 is changed in accordance with the change in the size of the detected object image 3.

  FIG. 13 is a diagram illustrating an example of the captured image SG1 according to the third embodiment. FIG. 14 is a diagram illustrating an example of the captured image SG after the detection target illustrated in FIG. 13 has moved. In FIG. 14, the detection range 4 before the change (the detection range 4 shown in FIG. 13) is indicated by a two-dot chain line for easy understanding.

  In the present embodiment, when the detected object moves in a direction approaching the first camera 1 or in a direction away from the first camera 1, the apparatus control unit 55 determines the size of the detection range 4 according to the change in the detected object image 3. To change. Specifically, the camera control unit 14 operates the image sensor 11 so that the focus of the image sensor 11 is aligned with the object to be detected when the object to be detected moves toward the first camera 1 or away from the first camera 1. (Auto focus function is executed). When the camera control unit 14 changes the focus position so that the focus of the image sensor 11 matches the detection target, in addition to the captured image data and the change detection data, the camera control unit 14 determines whether the focus position before the change and the focus position after the change. The focal length change data indicating the distance between them is transmitted to the apparatus communication unit 51 via the camera communication unit 12.

  When the device communication unit 51 receives the focal length change data, the device control unit 55 enlarges or reduces the recognition image indicated by the recognition image data stored in the device storage unit 54 based on the focal length change data. The device control unit 55 searches for the detected object image 3 from the captured image SG1 using the enlarged or reduced recognition image, and the third of the detected object image 3 as described with reference to FIG. The position for displaying the identification pixel G3 is determined.

  Further, the device control unit 55 determines the position where the first identification pixel G1 is displayed based on the focal length change data, the relative position data, and the data indicating the position (coordinates) where the third identification pixel G3 is displayed. As described with reference to FIG. 4, the position of the detection range 4 is changed. Specifically, the device control unit 55 sets the first identification pixel G1 so that the distance between the third identification pixel G3 and the first identification pixel G1 becomes a distance expanded or shortened based on the focal length change data. Determine the position to display.

  Thereafter, the device control unit 55 enlarges or reduces the size of the detection range 4 based on the focal length change data.

  In the example illustrated in FIGS. 13 and 14, the detection target moves so as to approach the first camera 1. Therefore, the device control unit 55 enlarges the recognition image. Next, the device control unit 55 searches for the detected object image 3 from the captured image SG1 using the enlarged recognition image. The device control unit 55 acquires the third identification pixel G3 from the pixels constituting the detected object image 3 to be searched.

  In the example illustrated in FIG. 14, the third identification pixel G3 is a pixel that is displayed at a position where the distance from the origin PS of the display surface of the display unit S1 is the shortest among the pixels constituting the detected object image 3. In addition, when there are a plurality of pixels displayed at the position closest to the origin PS on the display surface of the display unit S1, the device control unit 55 acquires the pixel displayed closest to the Y1 side as the third identification pixel G3. Then, the device control unit 55 determines and determines the position at which the first identification pixel G1 is displayed based on the data indicating the position at which the third identification pixel G3 is displayed, the relative position data, and the focal length change data. The position of the detection range 4 is moved so that the first identification pixel G1 is displayed at the position. Thereafter, the device control unit 55 expands the size of the detection range 4 based on the focal length change data received by the device communication unit 51.

  Subsequently, the detection range changing process according to the third embodiment will be described with reference to FIG. FIG. 15 is a flowchart illustrating detection range change processing according to the third embodiment. The detection range changing process according to the present embodiment is started when the apparatus communication unit 51 receives focal length change data in addition to the change detection data.

  As illustrated in FIG. 15, when the device control unit 55 determines that the standby time has elapsed (step S102: Yes), the device control unit 55 searches for the detected object image 3 (step S302). Specifically, the device control unit 55 selects from the captured image SG1 based on the captured image data received by the device communication unit 51, the focal length change data, and the authentication image data stored in the device storage unit 54. Search for an image that matches the authentication image. More specifically, the device control unit 55 enlarges or reduces the recognition image indicated by the recognition image data stored in the device storage unit 54 based on the focal length change data, and uses the enlarged or reduced authentication image. Thus, the detected object image 3 is searched from the captured image SG1. When searching for the third detected object image 3, the device control unit 55 acquires a position where the third identification pixel G <b> 3 is displayed. Next, the device control unit 55 changes the position of the detection range 4 (step S306). Specifically, the position for displaying the first identification pixel G1 is determined based on the focal length change data, the relative position data, and the data indicating the position where the third identification pixel G3 is displayed, and the position of the detection range 4 is determined. Change. Next, the device control unit 55 enlarges or reduces the size of the detection range 4 based on the focal length change data (step S308), and ends the detection range change process. Note that the order of step S306 and step S308 can be interchanged.

  The third embodiment has been described above. According to the present embodiment, even when the detected object moves in a direction approaching the first camera 1 or in a direction away from the first camera 1, the device control unit 55 does not move the detected object image 3. The position and size of the detection range 4 are changed according to the position. Therefore, the burden of the setting work of the detection range 4 by the administrator can be reduced.

[Embodiment 4]
Next, the monitoring system 100 according to the fourth embodiment will be described with reference to FIGS. The fourth embodiment is different from the first to third embodiments in that there are a plurality of cameras. Hereinafter, the matters different from the first to third embodiments will be described for the fourth embodiment, and the description of the parts overlapping with the first to third embodiments will be omitted.

  First, the configuration of the monitoring system 100 according to the fourth embodiment will be described with reference to FIG. FIG. 16 is a diagram illustrating a configuration of the monitoring system 100 according to the fourth embodiment. As shown in FIG. 16, the monitoring system 100 further includes a second camera 2. The second camera 2 captures an image capturing area different from that of the first camera 1. Hereinafter, the imaging area of the first camera 1 is referred to as a “first imaging area”, and the imaging area of the second camera 2 is referred to as a “second imaging area”. Further, the captured image SG1 captured by the first camera 1 is described as “first captured image SG1”, and the captured image SG2 captured by the second camera 2 is described as “second captured image SG2”. In the present embodiment, the first imaging region and the second imaging region are adjacent but do not overlap each other. The second camera 2 is an example of a second imaging device.

  As shown in FIG. 16, the second camera 2 includes an image sensor 11, a camera communication unit 12, a camera storage unit 13, and a camera control unit 14.

  The configuration of the image sensor 11, the camera communication unit 12, the camera storage unit 13, and the camera control unit 14 included in the second camera 2 includes the image sensor 11, the camera communication unit 12, the camera storage unit 13, and the camera 1 included in the first camera 1. The configuration of the camera control unit 14 is substantially the same. For this reason, the description about the structure of the image pick-up element 11, the camera communication part 12, the camera memory | storage part 13, and the camera control part 14 with which the 2nd camera 2 is provided is abbreviate | omitted.

  The camera communication unit 12 included in the second camera 2 transmits captured image data to the device communication unit 51. Further, when detecting a change in the captured image, the camera control unit 14 of the second camera 2 transmits change detection data to the device communication unit 51 via the camera communication unit 12 of the second camera 2.

  Next, processing of the monitoring system 100 according to the fourth embodiment will be described with reference to FIGS.

  FIG. 17 is a diagram illustrating an example of the first captured image SG1 and the second captured image SG2 according to the fourth embodiment. FIG. 18 is a diagram illustrating an example of the first captured image SG1 and the second captured image SG2 after the detected object image 3 illustrated in FIG. 17 has moved. In the example illustrated in FIGS. 17 and 18, the detection target moves from the first imaging region to the second imaging region. In the following description, of the display unit S1, the display unit S1 that displays the first captured image SG1 is referred to as “first display unit S11”, and the display unit S1 that displays the second captured image SG2 is referred to as “second display”. Part S12 ". The origin PS of the first display unit S11 is described as “first origin PS1”, and the origin PS of the second display unit S12 is described as “second origin PS2”.

  As shown in FIGS. 17 and 18, when the detected object moves and the camera control unit 14 of the first camera 1 detects that the captured image has changed in the detection range 4, the change detection data becomes the first camera 1. Are transmitted from the camera communication unit 12 to the device communication unit 51. When the device communication unit 51 receives the change detection data, the device control unit 55 uses the captured image data received by the device communication unit 51 from the camera communication unit 12 of the first camera 1 and the camera communication unit 12 of the second camera 2. While making it memorize | store in the memory | storage part 54, a detection range change process is performed. Hereinafter, the captured image data transmitted from the camera communication unit 12 of the first camera 1 is referred to as “first captured image data”, and the captured image data transmitted from the camera communication unit 12 of the second camera 2 is referred to as “second image data”. “Captured image data”.

  In the detection range changing process according to the present embodiment, the device control unit 55 uses the first captured image SG1 or the second captured image SG2 as the detected body image 3 based on the first captured image data and the second captured image data. Judge whether to include. When determining that the first captured image SG1 or the second captured image SG2 includes the detected object image 3, the device control unit 55 includes the detected object image 3 among the first captured image SG1 and the second captured image SG2. The camera that captures the captured image is determined as the main camera. In other words, the device control unit 55 determines a camera that captures an image of the entire detected object as the main camera. When the apparatus control unit 55 determines the main camera, as described with reference to FIG. 4, in the main captured image captured by the main camera, the detection range 4 includes the detection range image 4. Change the position of.

  In the example illustrated in FIG. 18, the second captured image SG <b> 2 includes the detected object image 3. Therefore, the device control unit 55 determines the second camera 2 as the main camera. And the apparatus control part 55 changes the position of the detection range 4 so that the to-be-detected body image 3 may be included in 2nd captured image SG2 which the 2nd camera 2 images. Specifically, the device control unit 55 includes one image (third identification) that constitutes the detected object image 3 (the detected object image 3 after movement) in the main captured image (second captured image SG2) captured by the main camera. The detection range 4 so that the relative positional relationship between the pixel G3) and one pixel (first identification pixel G1) constituting the outline of the detection range 4 matches the relative position indicated by the relative position data. Change the position of. For example, the device control unit 55 sets, as the third identification pixel, a pixel displayed at a position closest to the second origin PS2 on the display surface of the second display unit S12 among the pixels constituting the detected object image 3 after movement. Obtained as G3, the position where the third identification pixel G3 is displayed is obtained. In addition, when there are a plurality of pixels displayed at the position closest to the second origin PS2 on the display surface of the second display unit S12, the device control unit 55 sets the pixel displayed closest to the Y1 side as the third identification pixel G3. get.

  The device control unit 55 displays the position (coordinates) for displaying the first identification pixel G1 based on the data indicating the position where the third identification pixel G3 is displayed and the relative position data stored in the device storage unit 54. decide. In other words, the position of the detection range 4 is changed so that the relative positional relationship between the first identification pixel G1 and the third identification pixel G3 matches the relative position indicated by the relative position data.

  Subsequently, a detection range changing process according to the fourth embodiment will be described with reference to FIGS. FIG. 19 is a flowchart illustrating detection range change processing according to the fourth embodiment.

  As illustrated in FIG. 19, when the device control unit 55 determines that the standby time has elapsed (step S102: Yes), based on the first captured image data and the second captured image data received by the device communication unit 51, An image that matches the authentication image (detected object image 3) is searched from the first captured image SG1 or the second captured image SG2, and the detected object image is found in the first captured image SG1 or the second captured image SG2. 3 is determined (step S402). Specifically, the device control unit 55 analyzes the first captured image data and the second captured image data, and determines whether or not the detected object image 3 is included in the first captured image SG1 or the second captured image SG2. Determine.

  When determining that the detected object image 3 is included in the first captured image SG1 or the second captured image SG2 (step S402: Yes), the device control unit 55 determines the main camera (step S404). Specifically, the apparatus control unit 55 determines a camera that captures a captured image including the detected object image 3 out of the first captured image SG1 and the second captured image SG2 as a main camera.

  Next, the device control unit 55 changes the position of the detection range 4 so that the detection range 4 includes the detected object image 3 in the main captured image captured by the main camera (step S406). Specifically, the device control unit 55 acquires the third identification pixel G3 from the pixels constituting the detected object image 3 after movement, and the relative relationship between the first identification pixel G1 and the third identification pixel G3. The position of the detection range 4 is changed so that the correct positional relationship matches the relative position indicated by the relative position data. Then, the device control unit 55 transmits detection range data indicating the detection range 4 after the change to the camera communication unit 12 of the main camera via the device communication unit 51. When the camera communication unit 12 receives the detection range data indicating the detection range 4 after the change, the camera control unit 14 of the main camera stores the detection range data indicating the detection range 4 after the change in the camera storage unit 13 of the main camera. To do. Alternatively, the detection range data stored in the camera storage unit 13 of the main camera is updated to detection range data indicating the detection range 4 after the change. As a result, the detection range changing process ends.

  On the other hand, when the device control unit 55 determines that the detected body image 3 is not included in the first captured image SG1 or the second captured image SG2 (step S402: No), the detection range changing process ends, and the removal is not performed. The apparatus communication unit 51 is notified of a notification indicating that it has occurred. Specifically, the device control unit 55 transmits a mail indicating that the take-away has occurred to the administrator via the device communication unit 51. Alternatively, the device control unit 55 causes the output device 53 to display a message indicating that the carry-out has occurred.

  The embodiment 4 has been described above. According to the present embodiment, an imaging area (second imaging area) captured by a camera (second camera 2) different from a camera (first camera 1) that captures an imaging area (first imaging area) including the detected object. ), It is not necessary to set the detection range 4 again. Therefore, the burden of the setting work of the detection range 4 by the administrator can be reduced.

  In the present embodiment, the case where the first captured image SG1 or the second captured image SG2 includes the detected object image 3 has been described as an example. However, each of the first captured image SG1 and the second captured image SG2 is the target image. You may include the image which shows a part of detection body. FIG. 20 is a diagram illustrating another example of the first captured image SG1 and the second captured image SG2 after the detected object image 3 illustrated in FIG. 17 has moved. For example, as shown in FIG. 20, each of the first captured image SG1 and the second captured image SG2 may include an image showing different portions of the detection target. In this case, the apparatus control unit 55 determines the captured image having the larger area of the image indicating a part of the detected object from the first captured image SG1 and the second captured image SG2, and determines the determined captured image. The camera to be imaged is determined as the main camera.

  In the example illustrated in FIG. 20, the second camera 2 that captures the second captured image SG2 is determined as the main camera. When determining the main camera, the device control unit 55 acquires the third identification pixel G3 from the pixels constituting the detected object image 3 after movement, and between the first identification pixel G1 and the third identification pixel G3. The position where the first identification pixel G1 is displayed is determined so that the relative positional relationship of the first and second pixels coincides with the relative position indicated by the relative position data. In addition, when a part of the outline of the detection range 4 after the change is located outside the imaging region of the main camera, the apparatus control unit 55, as described with reference to FIG. The detection range 4 may be further moved so that the outline is located inside the captured image SG1.

  In this embodiment, the case where the first imaging region and the second imaging region do not overlap each other has been described as an example. However, the first imaging region and the second imaging region may partially overlap each other. . FIG. 21 is a diagram illustrating another example of the first captured image SG1 and the second captured image SG2 according to the fourth embodiment. FIG. 22 is a diagram illustrating an example of the first captured image SG1 and the second captured image SG2 after the detected object image 3 illustrated in FIG. 21 has moved.

  As shown in FIGS. 21 and 22, when the first imaging region and the second imaging region overlap, the first captured image SG1 and / or the second captured image SG2 indicate a part of the detected object after movement. When an image is included (in the example illustrated in FIG. 22, the second captured image SG2 includes an image indicating a part of the detected object after movement), the device control unit 55 performs the first captured image SG1 or the second captured image. The administrator is notified of a message to move the detected object so that SG2 includes an image (detected object image 3) indicating the entire detected object. In other words, the administrator is notified of a message to move the detected object so that either the first camera 1 or the second camera 2 captures the entire detected object. Specifically, the device control unit 55 notifies the administrator by mail via the device communication unit 51. For example, the apparatus control unit 55 attaches the first captured image data and the second captured image data to the mail when transmitting the mail to the administrator via the apparatus communication unit 51. Thereby, the administrator can easily know how much the detected object should be moved by viewing the first captured image SG1 and the second captured image SG2.

  The embodiment of the present invention has been described above with reference to the drawings (FIGS. 1 to 22). However, the present invention is not limited to the above-described embodiment, and can be implemented in various modes without departing from the gist thereof. The configuration shown in the above embodiment is merely an example and is not particularly limited, and various modifications can be made without departing from the effects of the present invention.

  For example, in the embodiment of the present invention, the case where the control device 5 is a server has been described as an example, but the present invention is not limited to this. In the present invention, for example, the control device 5 may be an administrator terminal used by an administrator such as a personal computer. Alternatively, the control device 5 may be configured with a server and an administrator terminal connected to the server.

  In the embodiment of the present invention, the configuration in which the monitoring system 100 includes two cameras has been described. However, the number of cameras included in the monitoring system 100 is not limited to two. The surveillance system 100 can comprise more than two cameras.

  In addition, the matter demonstrated in each Embodiment 1-4 can be combined suitably. For example, the configuration described in the second embodiment and the configuration described in the third embodiment may be combined.

  The present invention is useful in the field of monitoring systems.

1 First Camera 13 Camera Storage Unit 14 Camera Control Unit 55 Device Control Unit 100 Monitoring System

Claims (7)

An imaging device that captures an imaging region including a detected object and generates captured image data indicating a captured image,
A storage unit for storing data indicating a detection range in the captured image;
A controller that detects a change in the captured image in the detection range based on the captured image data, and
When the control unit detects a change in the captured image in the detection range, the control unit changes the detection range so that the detection range includes a detection target image indicating the detection target,
The said control part is an imaging device which changes the position of the said detection range based on the relative position of the said to-be-detected body image and the said detection range before the said to-be-detected body moves. An imaging device that captures an imaging region including a detected object and generates captured image data indicating a captured image,
A storage unit for storing data indicating a detection range in the captured image;
A controller that detects a change in the captured image in the detection range based on the captured image data, and
When the control unit detects a change in the captured image in the detection range, the control unit changes the detection range so that the detection range includes a detection target image indicating the detection target,
When the part of the detection range is located outside the captured image, the control unit changes the position of the detection range so that the detection range is included in the captured image. An imaging device that captures an imaging region including a detected object and generates captured image data indicating a captured image,
A storage unit for storing data indicating a detection range in the captured image;
A controller that detects a change in the captured image in the detection range based on the captured image data, and
When the control unit detects a change in the captured image in the detection range, the control unit changes the detection range so that the detection range includes a detection target image indicating the detection target,
The control unit, when a part of the detection range is located outside the captured image, changes the size of the detection range so that the detection range is included in the captured image. An imaging device that captures an imaging region including a detected object and generates captured image data indicating a captured image,
A storage unit for storing data indicating a detection range in the captured image;
A controller that detects a change in the captured image in the detection range based on the captured image data, and
When the control unit detects a change in the captured image in the detection range, the control unit changes the detection range so that the detection range includes a detection target image indicating the detection target,
The said control part is an imaging device which acquires the change of the magnitude | size of the said to-be-detected body image, and changes the said detection range according to the change of the magnitude | size of the to-be-detected body image. An imaging device that captures an imaging region including a detected object and generates captured image data indicating a captured image,
A first storage unit that stores data indicating a detection range in the captured image;
A control unit that detects a change in the captured image in the detection range based on the captured image data;
A notification unit for notifying the user of information,
A second storage unit that stores an authentication image of the detected object,
When the control unit detects a change in the captured image in the detection range, the control unit changes the detection range so that the detection range includes a detection target image indicating the detection target,
The control unit, when a matching rate between the authentication image and the detected object image is lower than a threshold value, causes the notification unit to notify the notification unit of a message to change the direction of the detected object.   The imaging apparatus according to claim 5, wherein the authentication image includes an image indicating a shape of the detection target.   The imaging apparatus according to claim 5, wherein the authentication image includes an identification image for identifying the detected object.

Images