JP6808398B2 - Control device, imaging device, control method, and program - Google Patents

Description

The present invention relates to a technique for controlling an imaging device.

For example, in the case of an imaging device for surveillance purposes, the lens may be sprayed or covered with a cloth to interfere with imaging (imaging interference). If such interference occurs, the image pickup device that interferes with the image pickup cannot take an image, or the image pickup range becomes narrow.

As a countermeasure, when an imaging interference is detected, a technique is known in which the area that was being imaged when the imaging was disturbed is notified to another imaging device, and the notified imaging area is imaged by another imaging device. (For example, Patent Document 1).

In addition, there is a function of periodically changing the imaging area of the imaging apparatus so that the imaging areas of a plurality of positions (preset positions) are automatically imaged in order. In addition, there is a function to periodically change the imaging area of the imaging device so that when a scream is detected, the direction is captured. Further, a function of changing the imaging area of the imaging apparatus by a user operation is also known. Due to these functions, the imaging area of the imaging apparatus may be changed even after the imaging is disturbed.

Japanese Unexamined Patent Publication No. 2006-279516

In the method described in Patent Document 1, for example, when the imaging region of the imaging apparatus that interferes with imaging is changed, there arises a problem that the imaging region after the change cannot be monitored. Further, in addition to the image pickup interference, when a certain image pickup device supplements the image pickup in another image pickup device, there is a problem that the image pickup cannot be appropriately supplemented when the image pickup area of the other image pickup device is changed.

Therefore, an object of the present invention is to provide a technique capable of appropriately supplementing an image pickup in another imaging device even when the image pickup region changes.

As one means for solving the above problems, the control device of the present invention has the following configuration.

That is, an event detecting means for detecting that a predetermined event related to the first imaging device has occurred, and a second imaging region in which the second imaging region is imaged before the predetermined event is detected by the event detecting means. When the predetermined event is detected for the second imaging device, the angle of view includes at least a part of the first imaging region imaged by the first imaging device together with the second imaging region. A communication means for transmitting a request command requesting the second image pickup device to the second image pickup device so as to take an image, a changing means for changing the image pickup area to be imaged by the first image pickup device, and the like. have a, the communication unit, after transmitting the request command, by the changing means, the imaging area imaged by the first imaging device is changed to the third imaging region from the first imaging region Then, the second imaging device issues a request command for requesting the second imaging device to take an image at an angle of view including at least a part of the third imaging region together with the second imaging region. It is characterized by sending to.

According to the present invention, even when the imaging region is changed, imaging by another imaging device can be appropriately supplemented.

It is a figure which shows the system including the image pickup apparatus which concerns on each embodiment of this invention. It is a functional block of an image pickup apparatus and a client apparatus which concerns on 1st Embodiment of this invention. It is a flowchart which shows the detection process of the imaging region which concerns on each embodiment of this invention. It is a flowchart which shows the process at the time of detecting the image pickup interference which concerns on 1st Embodiment of this invention. It is a flowchart which shows the preset patrol processing which concerns on 1st and 2nd Embodiment of this invention. It is a flowchart which shows the process at the time of receiving the change request of the imaging area which concerns on each embodiment of this invention. It is a functional block diagram of the image pickup apparatus and the client apparatus which concerns on 2nd Embodiment of this invention. It is a functional block diagram of the image pickup apparatus and the client apparatus which concerns on 3rd Embodiment of this invention. It is a flowchart which shows the process in 3rd Embodiment of this invention. It is a functional block of an image pickup apparatus and a client apparatus which concerns on 4th Embodiment of this invention. It is a figure for demonstrating the process at the time of receiving the change request of the imaging area which concerns on each embodiment of this invention. It is a flowchart which shows the process in 5th Embodiment of this invention. It is a figure which shows the arrangement example of the image pickup apparatus in each embodiment. It is a block diagram which shows the hardware configuration of each apparatus.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. The configuration shown in the following embodiments is only an example, and the present invention is not limited to the configurations described in the following embodiments. In addition, "interfering with imaging" is appropriately referred to simply as "interference" or "interference with imaging". In addition, the state in which imaging is disturbed, which will be described below, means that, for example, a part or all of the image captured by the imaging device is an external factor of the imaging device (for example, behavior of a person or animal, wind or rain). This is a state in which the subject to be imaged cannot be captured well due to a meteorological phenomenon such as). Here, the state in which the subject to be imaged cannot be captured well is a state in which the visibility of the subject to be imaged in the captured image is lower than the normal state. Further, the event used as a trigger to supplement the imaging in another imaging device is not limited to the imaging interference, and various events may be triggered.

<First Embodiment>
The system configuration according to this embodiment will be described below with reference to FIG.

FIG. 1A of FIG. 1A is a diagram showing an image pickup apparatus 100 in each embodiment. In the following, when the image pickup device 100 is simply described, it is assumed that the items common to each image pickup device are explained. Further, the number of image pickup devices may be three or more, and is not limited to two.

The image pickup apparatus 100 has a pan mechanism 151, a tilt mechanism 152, and a zoom mechanism 153.

The pan mechanism 151 changes the imaging direction of the imaging device 100a to the pan direction. The tilt mechanism 152 changes the imaging direction of the imaging device 100a to the tilt direction. The zoom mechanism 153 changes (enlarges or reduces) the angle of view of the image pickup apparatus 100a.

As shown in FIG. 1B, the image pickup device 100a, the image pickup device 100b, and the client device 200 are connected to each other via the network 150 in a communicable state. The image pickup apparatus 100a transmits a command such as a request command regarding an imaging region, which will be described later, to the image pickup apparatus 100b. The image pickup apparatus 100b transmits a response to those commands to the image pickup apparatus 100a. The transmission and reception of these commands may be mediated by the client device 200.

Next, the image pickup apparatus 100a and the image pickup apparatus 100b will be described with reference to FIG. Although the image pickup device 100a will be described, it is assumed that the image pickup device 100b also has the same function as the image pickup device 100a.

The image pickup unit 101 has a plurality of lenses (imaging lenses), an image pickup element, and the like, and images a subject. Specifically, the image pickup unit 101 receives the light collected through the lens with the image sensor and converts the light into an electric signal (photoelectric conversion).

The image processing unit 102 performs predetermined image processing and compression coding processing on the signal photoelectrically converted by the imaging unit 101 to generate image data.

The disturbance detection unit 103 detects whether or not the imaging has been disturbed. In the present embodiment, when a change in illuminance of a certain amount or more occurs within a certain period of time using the illuminance sensor, it is determined that foreign matter has adhered to the lens, and this is detected as an imaging disturbance. However, as described in other embodiments, the method for detecting imaging interference is not limited to this. The interference detection unit 103 functions as an event detection unit that detects an event called interference.

The pan drive unit 104 drives the pan mechanism 151 described above. The pan drive unit 104 has a mechanical drive system for pan operation and a motor for the drive source. The operation of the pan drive unit 104 is controlled by the pan tilt zoom control unit 107.

The tilt drive unit 105 drives the tilt mechanism 152 described above. The tilt drive unit 105 has a mechanical drive and a drive source motor that performs a tilt operation. The operation of the tilt drive unit 105 is controlled by the pan / tilt zoom control unit 107.

The zoom drive unit 106 includes a drive system for driving the focus lens and the zoom lens in the image pickup unit 101, and a motor for the drive source thereof. The zoom drive unit 106 changes the imaging angle of view in the imaging unit 101. For example, the focus lens or zoom lens is driven so as to enlarge or reduce the imaging angle of view. The operation of the zoom drive unit 106 is controlled by the pan / tilt zoom control unit 107.

As described above, the pan / tilt zoom control unit 107 controls the pan drive unit 104, the tilt drive unit 105, and the zoom drive unit 106. That is, the pan / tilt zoom control unit 107 functions as a changing means for changing the imaging region imaged by the imaging device 100a.

The imaging region detection unit 108 detects the position of the imaging region (angle of view), which is the region that the imaging device 100a is capturing. The imaging region detection unit 108 detects the position of the imaging region that the imaging device 100a is imaging based on the position where the imaging device 100a is installed and the imaging direction of the imaging device 100a.

The position information indicating the position where the image pickup apparatus 100a is installed is stored by, for example, the client apparatus 200.

FIG. 13 is a diagram showing how each imaging device 100 (100a, 100b, 100c, 100d) is arranged. For example, as shown in FIG. 13, a region in which each imaging device 100 is arranged is shown.

The position of each imaging device 100 is a coordinate (X coordinate, Y coordinate) with a predetermined position as the origin, and the planar position thereof is represented. Further, the height (Z coordinate) in which each image pickup device 100 is installed is also stored by the client device 200. The height may be zero on the floor.

Further, the imaging region of each imaging device 100 can be known from the drive information of the pan mechanism 151, the tilt mechanism 152, and the zoom mechanism 153. This drive information is, for example, information represented by an angle of the current imaging direction with respect to a predetermined reference position. This drive information can be acquired from each drive unit.

The imaging region detection unit 108 detects the position of the imaging region based on the position information and the driving information. In addition, the imaging region can be detected more accurately by using the information indicating the focus position in each imaging device 100.

Returning from the description of FIG. 2, the communication unit 109 transmits the generated image data to the client device 200. Further, each command transmitted from the image pickup apparatus 100b and the client apparatus 200 is received and transmitted to the control unit 110. Further, the response to the command is transmitted to the image pickup apparatus 100b and the client apparatus 200.

The control unit 110 analyzes the transmitted command and performs processing according to the command. For example, the control unit 110 causes the image processing unit 102 to perform image quality adjustment. It also controls each drive unit.

Further, when the interference detection unit 103 detects an imaging interference, the imaging area detection unit 108 acquires the imaging area information indicating the imaging area, and issues a request command (imaging area change request) according to the imaging area information. It is transmitted to the communication unit 109. Details of these operations will be described later.

Next, each part of the client device 200 will be described with reference to FIG.

The client device 200 can be realized by causing a general-purpose computer such as a personal computer to execute a specific program.

The display unit 201 can be realized by, for example, a liquid crystal display device. The display unit 201 displays an image acquired from the image pickup device 100a or the image pickup device 100b, or displays a graphic user interface (GUI) for controlling the image pickup device.

The operation unit 202 can be realized by a pointing device such as a keyboard and a mouse. Moreover, you may use a touch panel. The user of the client device 200 inputs an operation to the GUI via the operation unit 202.

The system control unit 203 generates a control command according to the operation of the user to the GUI, and transmits the control command to the image pickup device 100a and the image pickup device 100b via the communication unit 204. Further, the system control unit 203 causes the display unit 201 to display the image data from the image pickup device 100a and the image pickup device 100b received via the communication unit 204.

In this way, the client device 200 can acquire the captured image captured by the imaging device 100 and control the imaging device 100 via the network 150.

Next, a method of detecting an imaging region of the imaging apparatus 100 will be described with reference to FIG.

First, in S300, the control unit 110 acquires the drive information of the pan mechanism 151. This drive information is, for example, information indicating an angle from a reference position (for example, the front direction) in the pan direction.

In S301, the control unit 110 acquires the drive information of the tilt mechanism 152. This drive information is, for example, information indicating an angle from a reference position (for example, a horizontal direction) in the tilt direction.

In S302, the control unit 110 acquires the drive information of the zoom mechanism 153. This drive information is, for example, information indicating a magnification based on a reference magnification (for example, the widest angle of view).

In S303, the control unit 110 acquires information indicating the installation position of the image pickup device 100 stored by the client device 200.

In S304, the control unit 110 detects the position of the imaging region based on the information acquired in S300 to S303. The imaging region is, for example, a range corresponding to the imaging angle of view of the imaging device 100 on a plane in focus. Alternatively, the imaging region may be an region on the floor surface or the wall surface. The range corresponding to the imaging angle of view on these surfaces is the imaging region. The imaging area information indicating the position of the imaging area is represented by, for example, the above-mentioned three values of the X coordinate, the Y coordinate, and the Z coordinate. Since the imaging region is basically a rectangle, it is represented by, for example, two coordinates on the diagonal of the rectangle. Further, the imaging region information may be represented by coordinates indicating each of the four vertices of the imaging region.

Next, with reference to FIG. 4, a process when the interference detection unit 103 of the image pickup apparatus 100a detects an image pickup interference will be described.

When the interference detection unit 103 of the image pickup device 100a detects the image pickup interference, in S401, the control unit 110 of the image pickup device 100a detects the image pickup region in the disturbed image pickup device 100a.

Next, in S402, the control unit 110 of the imaging device 100a transmits a request command (imaging area change request) for requesting the uninterrupted imaging device 100b to change the imaging area via the communication unit 109. .. This request command includes image pickup area information indicating the position of the image pickup area in the image pickup apparatus 100a.

In this way, when imaging interference occurs, an imaging request is made to another imaging device 100b. The imaging device 100b starts imaging to supplement the imaging of the imaging device 100a. Further, as will be described next, when the imaging region of the imaging apparatus 100a is changed thereafter, a further change request for the imaging region is made.

Hereinafter, an example of such processing will be described with reference to FIG. Specifically, a process will be described when the interference detection unit 103 detects an imaging interference when the image pickup device 100a is performing imaging by preset patrol. The preset patrol is a function of sequentially capturing a plurality of locations (imaging areas) preset by the user. For example, when five positions are specified, imaging is performed at those imaging positions in order for a predetermined time (for example, one minute).

When the imaging device 100a starts imaging in the first imaging region, it first waits for a predetermined time until it moves to the next imaging region in S500.

After a lapse of a predetermined time, in S501, the pan / tilt zoom control unit 107 controls the pan drive unit 104, the tilt drive unit 105, and the zoom drive unit 106, and changes the image pickup area in the image pickup apparatus 100 so as to image the next image pickup area. To do.

Next, in S502, the control unit 110 confirms whether the interference detection unit 103 has detected the imaging interference. If the image disturbance is being detected, the process proceeds to S503, and if the image interference is not being detected, the process proceeds to S505.

In the next S503, the control unit 110 causes the image pickup area detection unit 108 to detect the current image pickup area. Then, the control unit 110 acquires the image pickup area information indicating the detected image pickup area from the image pickup area detection unit 108.

In the next S504, the control unit 110 transmits a request command for requesting the other image pickup apparatus 100b to change the image pickup region via the communication unit 109. This request command includes the imaging area information acquired in S503.

In S505, it is confirmed whether to end the preset patrol. If it is the last imaging region, the preset patrol process is ended, and if it is not finished, the process returns to S500. If it is the last imaging region, it may return to the first imaging region.

Next, processing when the control unit 110 of the imaging device 100b receives a request command from the imaging device 100a will be described with reference to FIGS. 6 and 11. This request command was transmitted in S504. 11 (a) is a top view and FIG. 11 (b) is a perspective view.

First, in S600, the control unit 110 analyzes the request command to acquire the image pickup region of the disturbed image pickup device 100a. This imaging region is an region that may not be imaged due to interference.

In S601, the control unit 110 determines an imaging angle of view that can include the acquired imaging region of the imaging device 100a and the current imaging region of the imaging device 100b as the imaging region of the new imaging device 100b. If possible, the imaging region of the imaging device 100a and the current imaging region of the imaging device 100b may be included in full.

However, at least a part of the image pickup region of the image pickup apparatus 100a and a part of the current image pickup region of the image pickup apparatus 100b may be included. In this case, a part of the imaging region of the imaging apparatus 100a to be included in the new imaging region may be, for example, an region including a specific object such as a person. The position of the person is detected by the person detection unit of the image pickup apparatus 100a (not shown). The information indicating the position of the person may be included in the imaging area information and transmitted.

In addition, it is necessary to widen the zoom magnification in order to capture a wider area, but this makes it impossible to capture a fine image. How much area is included in the imaging area can be appropriately set according to the monitoring purpose and the like. In order to image a wider area, the imaging area of the imaging device 100a and the current imaging area of the imaging device 100b may be captured as wide as possible with the zoom magnification set to the widest range.

Next, in S602, the pan / tilt zoom control unit 107 controls the pan drive unit 104, the tilt drive unit 105, and the zoom drive unit 106 so as to image the imaging region determined in S601, and changes the imaging angle of view. As a result, the imaging region in the imaging apparatus 100b is changed from the imaging region 151 to the imaging region 152.

As described above, in the first embodiment, the disturbance detection unit 103 is used to detect that the imaging of the imaging device is disturbed. Then, when the imaging is disturbed, the imaging device 100b, which is not disturbed, is requested to further change the imaging region. After that, when the imaging region is changed by preset patrol or the like, the imaging apparatus 100b that is not disturbed is requested to change the imaging region. The imaging device 100b that has received the request to change the imaging region changes the imaging direction and the zoom magnification so as to include both the imaging region of the requesting imaging device 100a and the monitoring region of the imaging device 100b that is not disturbed. As a result, even if the imaging region is changed by preset patrol or the like after the imaging device 100a is disturbed, continuous monitoring becomes possible.

That is, even when the imaging region of the imaging device 100a changes, the imaging can be appropriately supplemented by another imaging device 100b.

In the above description, the method of detecting the image pickup interference by the interference detection unit 103 of the image pickup apparatus 100a has been described, but the present invention is not limited to this. For example, an impact detection sensor that detects that a strong impact is applied to the image pickup apparatus 100a may be used.

<Second Embodiment>
In the first embodiment, an example in which an image pickup interference is detected by a sensor has been described, but in the present embodiment and others, image data is acquired from the image processing unit 102, and the image is analyzed to detect the image pickup interference.

A second embodiment of the present invention will be described below. The same parts as those in the first embodiment will be omitted as appropriate.

FIG. 7 is a block diagram showing the configuration of the image pickup apparatus 100a according to the second embodiment.

The interference detection unit 111 in the present embodiment periodically (for example, every 60 frames) acquires image data from the image processing unit 102. Then, when the number of difference pixels, which is the difference between the currently acquired image data and the previously acquired image data, becomes a certain ratio or more with respect to the entire image, it is detected as an imaging interference. When the image pickup interference is detected, the control unit 110 is notified that the image pickup interference is detected.

As described above, in the second embodiment, it is detected that the image pickup of the image pickup apparatus is disturbed by the image analysis. There is no need for a sensor to detect imaging interference.

<Third Embodiment>
In the first embodiment, the case where the imaging area is changed by the preset patrol after the imaging is disturbed has been described. In addition, as a function of changing the imaging region, the control unit 110 of the imaging apparatus 100a receives a signal from an external device, and when the signal includes a predetermined signal, the predetermined imaging region is imaged. , There is a function to change the imaging direction and zoom magnification. This embodiment is an embodiment adapted to such a function. The same parts as those in the first embodiment will be omitted as appropriate.

FIG. 8 is a block diagram showing the configurations of the image pickup device 100a and the image pickup device 100b. The signal analysis unit 112 receives the request from the control unit 110 and outputs the signal corresponding to the request to the external device 1013. Further, the signal analysis unit 112 receives the signal from the external device 1013.

Here, the external device 1013 is, for example, a microphone installed corresponding to the image pickup device and collecting sound around the image pickup device. The signal analysis unit 112 receives an audio signal from the external device 1013. Then, it detects whether or not the voice contains a specific sound (for example, a scream). When the signal analysis unit 112 detects a scream, the pan / tilt zoom control unit 107 controls each drive unit so as to image a predetermined position (for example, a position where the scream occurs).

Further, the external device 1013 is, for example, a sensor such as a motion sensor that detects the presence of an object. The signal analysis unit 112 receives the sensor output signal from the external device 1013. Then, based on the signal, it detects whether or not an object exists. When the presence of an object is detected by the signal analysis unit 112, the pan / tilt zoom control unit 107 controls each drive unit so as to image a predetermined position (for example, an entrance).

FIG. 9 is a flowchart showing the processing in the present embodiment. At the stage of starting this process, it is assumed that the image pickup apparatus 100b is capturing the imaging region of the imaging apparatus 100a before the imaging region is changed.

In S900, the signal analysis unit 112 determines whether to change the imaging region by determining whether or not the signal acquired from the external device 1013 includes a predetermined signal. For example, it is determined whether the predetermined signal includes an audio signal including a scream or a sensor signal indicating the presence of a person. Then, when the signal analysis unit 112 determines that the predetermined signal is included, the control unit 110 of the image pickup apparatus 100a determines that the imaging region needs to be changed. If it is determined that the imaging area needs to be changed, the process proceeds to S901, and if it is determined that it is not necessary, the process shown in FIG. 9 ends.

Next, in S901, the pan-tilt zoom control unit 107 of the image pickup apparatus 100a controls each drive unit so as to image a predetermined position (for example, a position where a scream occurs). That is, the pan / tilt zoom control unit 107 controls the pan drive unit 104, the tilt drive unit 105, and the zoom drive unit 106, and changes the image pickup region in the image pickup apparatus 100a.

Next, in S902, it is confirmed whether the interference detection unit 103 has detected the imaging interference. If imaging interference is being detected, the process proceeds to S903, and if imaging interference is not being detected, the process shown in FIG. 9 ends.

In the next S903, the control unit 110 causes the image pickup area detection unit 108 to detect the image pickup area. Then, the control unit 110 acquires the detected image pickup area information from the image pickup area detection unit 108.

In S904, the control unit 110 transmits a request command for requesting the other image pickup apparatus 100b to change the image pickup region via the communication unit 109. This request command includes the imaging area information acquired in S903.

As described above, in the third embodiment, even when the imaging region of the imaging device 100a is changed based on the signal from the external device, the imaging can be appropriately supplemented by the other imaging device 100b.

The external device 1013 may not necessarily be provided outside the image pickup apparatus 100 depending on the type of the external device 1013. For example, a microphone may be provided inside the image pickup device.

<Fourth Embodiment>
In another embodiment, the detection of the imaging interference is used as a trigger to request the uninterrupted imaging device to change the imaging area. In the present embodiment, during recording to the recording unit 114 such as an SD card or a hard disk drive, the amount of data recorded in the recording unit 114 exceeds a predetermined amount of data (for example, the maximum amount of data). It is used as a trigger for requesting another imaging device 101b to change the imaging area.

Such a fourth embodiment will be described with reference to FIG. The description of the same parts as those of the other embodiments will be omitted as appropriate.

FIG. 10 is a block diagram showing the configurations of the image pickup device 100a and the image pickup device 100b. The recording control unit 113 reads the data from the recording unit 114 and writes the data to the recording unit 114. The recording control unit 113 also deletes the data recorded in the recording unit 114. In addition, it is also determined whether or not the amount of data recorded in the recording unit 114 exceeds a predetermined amount of data. That is, the recording control unit 113 functions as an event detection unit that detects an event that the amount of data recorded in the recording unit 114 exceeds a predetermined amount of data.

As described above, in the present embodiment, the fact that the amount of data recorded in the recording unit 114 exceeds a predetermined amount of data is used as a trigger for requesting another imaging device 101b to change the imaging area.

That is, when this embodiment is applied to the first embodiment, in FIG. 4, when the amount of data recorded in the recording unit 114 exceeds a predetermined amount of data, S401 and subsequent steps are executed.

Further, the processing in S502 of the first embodiment may be performed as follows. That is, instead of S502, the control unit 110 determines whether the amount of data recorded in the recording unit 114 is equal to or greater than the predetermined amount of data. If the amount of data exceeds a predetermined amount, the process proceeds to S503, and if not, the process proceeds to S505.

Further, when applied to the third embodiment, the processing in S902 may be performed as follows. That is, it is determined whether the amount of data recorded in the recording unit 114 instead of S902 is equal to or greater than the predetermined amount of data. When the amount of data exceeds the predetermined amount, the process proceeds to S903, and if not, the process shown in FIG. 9 ends.

It should be noted that both the detection of imaging interference and the fact that the amount of data exceeds a predetermined amount may be used as a trigger for requesting a change in the imaging area.

As described above, in the fourth embodiment, it is detected that the amount of data in the recording unit 114 is equal to or greater than the predetermined amount of data. Then, the image pickup apparatus whose data amount is not equal to or more than the predetermined data amount is requested to change the image pickup area. The imaging device that has received the request to change the imaging region changes the imaging direction and the zoom magnification so as to include both the imaging region of the requesting imaging device and the imaging region of its own imaging device. As a result, in a certain imaging device, it is possible to continuously monitor even after the amount of data exceeds a predetermined amount. That is, the imaging can be appropriately supplemented by another imaging device 100b.

As the recording unit 114, for example, a recording server connected by the network 150 may be used.

<Fifth Embodiment>
In each of the embodiments described so far, the other imaging apparatus 101b is requested to change the imaging region. After that, when the imaging region of the imaging device 101a was changed, the imaging device 101b was requested to further change the imaging region. However, depending on the installation position, it may not be possible to change the imaging region of the imaging device 101b so as to include both the imaging region of the imaging device 101a and the imaging region of the imaging device 101b.

Therefore, it is conceivable that the imaging device 101a acquires the current imaging region and the imageable region from another imaging device 101, and determines whether or not the imaging region of the imaging device 101a can be imaged. The processing of such an embodiment will be described below. The description of the same parts as those of the other embodiments will be omitted.

The process shown in FIG. 12 below is a process that can be replaced with the imaging area change request step (S401, S504, S904, S112) in another embodiment. That is, the present embodiment and each embodiment and the like can be combined as appropriate.

In S120, the control unit 110 of the image pickup device 100a searches for another image pickup device 100 connected to the network 150. Then, if there is another imaging device 100 for which the imaging region information has not been acquired, the process proceeds to S121. If there is no other imaging device for which the imaging area information has not been acquired, the process shown in FIG. 12 ends.

In the next S121, the imaging region information and the information indicating the imageable region are acquired from the other imaging apparatus 100. The imageable region is the entire range in which the pan / tilt zoom control unit 107 can control the pan drive unit 104, the tilt drive unit 105, and the zoom drive unit 106 to take an image.

In the next S122, the control unit 110 of the image pickup device 100a takes an image of the image pickup device 100a by the other image pickup device 100 based on the image pickup area information acquired from the other image pickup device 100 and the information indicating the imageable region. Determine if it is possible to image the area. If possible, proceed to S401. If it is not possible, return to S120.

As described above, in the fifth embodiment, for example, an uninterrupted imaging device 100 that can include an imaging region of the imaging device 100a whose imaging is disturbed is searched for, and a request for changing the imaging region is requested. Do. Further, after that, when the imaging region is changed, the uninterrupted imaging device 100, which can include the imaging region of the disturbed imaging device 100a, is requested to change the imaging region. The imaging device 100 that has received the request to change the imaging region changes the imaging direction and the zoom magnification so as to include both the imaging region of the requesting imaging device 100a and its own imaging region. As a result, even if the imaging region is changed by preset patrol or the like after the imaging device 100a is disturbed, continuous monitoring becomes possible.

That is, even when the imaging region of the imaging device 100a changes, the imaging can be appropriately supplemented by another imaging device 100.

(Other Examples)
Next, the hardware configuration of the control unit 100 and the image processing unit 102 of the image pickup apparatus 100 in each embodiment will be described with reference to FIG. The system control unit 203 in the client device 200 can also be realized with the same hardware configuration.

The RAM (Random Access Memory) 222 temporarily stores a computer program executed by the CPU (Central Processing Unit) 221. Further, the RAM 222 temporarily stores data or the like acquired from the outside via the communication unit. The RAM 222 also provides a work area used by the CPU 221 to execute various processes. Further, the RAM 222 functions as, for example, a frame memory or a buffer memory.

The CPU 221 executes a computer program stored in the RAM 222. In addition to the CPU, a processor such as a DSP (Digital Signal Processor) or an ASIC (Application Specific Integrated Circuit) may be used.

The HDD (Hard Disk Drive) 223 stores operating system programs and image data. The HDD 223 also stores a computer program.

The computer programs and data stored in the HDD 223 are appropriately loaded into the RAM 222 and executed by the CPU 221 according to the control by the CPU 221. In addition to the HDD, another storage medium such as a flash memory may be used. Bus 224 connects each piece of hardware. Each hardware exchanges data via the bus 224. The above is the hardware configuration in each embodiment.

In the present invention, a program that realizes one or more functions of each embodiment is supplied to a system or an apparatus via a network or a storage medium, and one or more processors in the computer of the system or the apparatus read the program. It can also be realized by the processing to be executed. It can also be realized by a circuit (for example, ASIC) that realizes one or more functions.

Further, each of the above-mentioned flowcharts can be executed by the CPU performing processing based on the program read into the memory.

Further, the present invention is not limited to each of the embodiments described above, and various modifications can be made without departing from the gist of the present invention. For example, a combination of the respective embodiments is also included in the disclosure contents of the present specification. Further, although the example of being implemented by the control unit 100 of the imaging device has been described, each of the above embodiments may be executed by the system control unit 203 of the client device. That is, each embodiment may be executed by an external device capable of communicating with each image pickup device 100.

100a Imaging device 100b Imaging device 107 Pan-tilt zoom control unit 109 Communication unit 110 Control unit 111 Interference detection unit

Claims (11)

An event detecting means for detecting the occurrence of a predetermined event related to the first imaging device, and
When the predetermined event is detected with respect to the second imaging device that has captured the second imaging region before the predetermined event is detected by the event detecting means, the second imaging region At the same time, the second imaging device issues a request command to the second imaging device so as to image at an angle including at least a part of the first imaging region imaged by the first imaging device. Communication means to send to
A changing means for changing the imaging region imaged by the first imaging device, and
Have,
The communication means
After the request command is transmitted, when the imaging region imaged by the first imaging apparatus is changed from the first imaging region to the third imaging region by the changing means, the second imaging region At the same time, a control characterized by transmitting a request command requesting the second imaging device to the second imaging device so as to image at an angle of view including at least a part of the third imaging region. apparatus. The event detecting means is characterized in that, as the predetermined event, it detects that the amount of data in the recording means for recording the image data captured by the first imaging device is equal to or greater than the predetermined amount of data. The control device according to claim 1. The event detecting means cannot image the subject to be imaged by the first imaging device as the predetermined event, or the visibility of the subject in the image captured by the first imaging device. The control device according to claim 1 or 2, wherein the control device is detected to be lower than a predetermined state. The control device according to any one of claims 1 to 3, wherein the event detecting means detects that foreign matter has adhered to the image pickup lens of the first image pickup device as the predetermined event. .. The control device according to any one of claims 1 to 4, further comprising a changing means for changing an imaging region imaged by the second imaging device. When the audio signal generated by the sound collecting means corresponding to the first imaging device includes a predetermined audio signal, the changing means is such that the first imaging device or the first imaging device captures a predetermined imaging region. The control device according to claim 5, wherein the imaging region imaged by the second imaging device is changed. When the sensor outside the first imaging device outputs a signal indicating that an object has been detected, the changing means has the first imaging device or the second imaging device so as to image a predetermined imaging region. The control device according to any one of claims 5 to 6, wherein the image pickup region imaged by the image pickup device is changed. The communication means
Any one of claims 1 to 7, wherein a request command for imaging an imaging region including the entire imaging region imaged by the first imaging apparatus is transmitted to the second imaging apparatus. The control device described in. An acquisition means for acquiring information indicating an area that can be imaged by another imaging device, and
Control to determine another imaging device that transmits a request command for imaging an imaging region including at least a part of the imaging region imaged by the first imaging device based on the information acquired by the acquisition means. Have means and
The control device according to any one of claims 1 to 8, wherein the communication means transmits the request command to the image pickup device determined by the control means. An event detection step for detecting that a predetermined event related to the first imaging device has occurred, and
When the predetermined event is detected with respect to the second imaging device that has captured the second imaging region before the predetermined event is detected by the event detection step, the second imaging region At the same time, the second imaging device issues a request command to the second imaging device so as to image at an angle including at least a part of the first imaging region imaged by the first imaging device. Communication process to send to
A changing step of changing the imaging region imaged by the first imaging device, and
Have,
The communication process is
After transmitting the request command, by the changing step, when the imaging area imaged by the first imaging device is changed to the third imaging region from the first imaging area, the second imaging region At the same time, a control characterized by transmitting a request command requesting the second imaging device to the second imaging device so as to image at an angle of view including at least a part of the third imaging region. Method. A program characterized in that a computer functions as each means of the control device according to any one of claims 1 to 9.

Images