JP6611525B2 - Imaging apparatus and imaging system - Google Patents

Description

  The present invention relates to an imaging device, and particularly relates to an imaging device including an illumination device.

  Conventionally, imaging devices with illumination for illuminating low-light subjects at night or in dark places are known, but if the subject contains a person, the illumination intensity is controlled in consideration of the effect on the human body. There is a need to. In such a case, for example, Patent Document 1 discloses a method for changing the light distribution characteristics of illumination according to a shooting angle of view and a range as an imaging device that controls the illumination intensity depending on the shooting range and the presence or absence of a person. Yes. Patent Document 2 discloses a method of changing the intensity of illumination when a subject such as a person is detected.

Japanese Patent Laid-Open No. 2005-094080 JP 2012-11840 A

  However, in the above-described conventional technology, since a person is detected from a photographed image and the illumination intensity is changed, the illumination intensity may not be appropriately controlled during the period in which the illumination intensity is changed from the detection. It was. In addition, when a light source capable of emitting light with a wavelength outside the visible light region is used for the lighting device, the irradiated person is not aware that the light is being applied to the lighting device, and increases the amount of light above a certain level. In some cases, the time was directly viewed.

  Accordingly, an object of the present invention is to appropriately control the illumination intensity to be irradiated and to perform illumination irradiation after confirming the illumination intensity in advance, thereby suppressing the influence of illumination even when the subject includes a human body. An image pickup apparatus that picks up images is provided.

  In order to achieve the above-mentioned target, the present invention is an imaging apparatus that communicates via a network, and includes an imaging unit that images a subject and an irradiation unit that irradiates the subject with irradiation light, the terminal via the network Receiving means for receiving a command from the apparatus, control means for controlling the intensity of the irradiation light emitted from the irradiation unit, and changing means for changing the irradiation angle of the irradiation light. Includes a control command for controlling the changing means, and the control means limits the intensity to a predetermined intensity or less when the receiving means receives the control command.

  According to the present invention, by appropriately controlling the illumination intensity to be irradiated and performing illumination irradiation after confirming the illumination intensity in advance, even when a subject includes a human body, imaging is performed while suppressing the influence of illumination. It is possible to provide an imaging device that performs the above.

It is a figure for demonstrating the 1st Example of this invention. It is a figure for demonstrating the principal part (operation by the operation user interface of an imaging device) of 1st Example. It is a figure for demonstrating the principal part (the imaging | photography of an imaging device, the control method of illumination) of 1st Example. It is a flowchart for demonstrating the principal part (limitation of the illumination intensity at the time of operation by a user) of 1st Example. It is a figure for demonstrating the 2nd Example of this invention. It is a figure for demonstrating the principal part (operation by the operation user interface of an imaging device) of 2nd Example. It is a flowchart for demonstrating the principal part (limitation of the illumination intensity at the time of operation by a user) of 2nd Example.

  Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. The configurations shown in the following embodiments are merely examples, and the present invention is not limited to the illustrated configurations.

Example 1
Hereinafter, an imaging apparatus and an imaging system according to the first embodiment of the present invention will be described with reference to FIG.

  A lens group 101 includes a zoom lens group, a focus lens group, a diaphragm mechanism, and the like (not shown). Each mechanism includes a drive unit such as an actuator (not shown) and is driven based on a control signal from a CPU 110 described later.

  Reference numeral 102 denotes an infrared cut filter, which is configured by a mechanism for moving the infrared cut filter in and out of the optical axis. The infrared cut filter is a dielectric multilayer film that can transmit visible light without transmitting (reflecting) infrared light. By inserting and removing this infrared cut filter with respect to the optical axis, it is possible to selectively switch whether to receive infrared rays. More specifically, when there is an infrared cut filter, only visible light component light is captured, and when no infrared cut filter is present, visible light component + infrared component light is captured. Reference numeral 103 denotes an infrared filter control circuit that controls the insertion and removal of the infrared cut filter based on a control signal from the CPU 110 described later.

  An image sensor 104 converts an optical image formed on the image sensor surface via the lens group 101 into an electric signal. The amplifier 105 amplifies the electric signal output from the image sensor 104 to a predetermined signal level. The image sensor 104 is driven by a signal from a timing generator (not shown), sampled in accordance with the timing of the output signal, analog-digital signal converted, and output. Note that the image sensor 104 also has sensitivity in the infrared region, and the amount of output signal can be increased by receiving infrared component light in addition to the visible light component. Note that each component for imaging a subject including the lens group 101, the infrared cut filter 102, the imaging element 104, and the amplifier 105 corresponds to the imaging unit in this embodiment.

  Reference numeral 106 denotes infrared illumination, which includes illumination including an infrared light source having a spectral distribution in the infrared region. For example, at night when the illumination is low, by turning on the infrared illumination and irradiating the irradiation light, it is possible to take a bright image by turning on the illumination in a state where it is not recognized by the human eye that the illumination is on. It becomes possible. Reference numeral 107 denotes an infrared illumination control circuit which performs illumination ON / OFF control and brightness (intensity) control based on a control signal from a CPU 110 described later. Note that the infrared illumination 106 is not limited to a light source that emits infrared light, but may include a light source that can emit visible light or ultraviolet light. In this embodiment, the infrared illumination 106 corresponds to an irradiating unit that irradiates a subject with irradiation light.

  Reference numeral 100 denotes a pan / tilt circuit (hereinafter also referred to as a PT circuit), which changes the direction of the lens group 101, the infrared illumination 106, etc. to the pan direction or the tilt direction. More specifically, it is a pan head that indicates each component, and is configured to be capable of being panned or tilted using an actuator or the like around the indicated axis. In this embodiment, the PT circuit 100 corresponds to an angle-of-view changing unit that changes the angle of view of the imaging unit in the pan or tilt direction.

  Reference numeral 108 denotes a video processing circuit that performs various types of video processing. The video signal from the image sensor 104 is subjected to processing such as gain processing, signal development processing, color balance processing, gamma processing, and noise reduction processing, and is converted into an image signal.

  Reference numeral 109 denotes a network processing circuit, which converts the output from the video processing circuit 108 into a format conforming to the communication protocol and distributes it over the network. In addition, control signals for controlling the imaging apparatus are transmitted and received in accordance with a communication protocol.

  A CPU 110 controls the video processing circuit 108 and the network processing circuit 109. In addition, the infrared filter control circuit 103 and the infrared illumination control circuit 107 are also controlled. Further, the CPU 110 executes a program stored in a data storage unit memory (not shown). The memory is used as a program storage area executed by the CPU 110, a work area during program execution, a data storage area, and the like. In addition, the memory holds various parameters that are setting information used by the CPU 110 to control each component. In addition, it is possible to perform measurement for a predetermined period at an arbitrary timing including a timing unit (not shown).

  Reference numeral 111 denotes an example of an imaging apparatus that includes the above-described 101 to 110 and has a predetermined angle of view and images a subject. More specifically, it is assumed that the network camera is used for monitoring.

  Reference numeral 112 denotes a local area network (LAN) on the network. The imaging device 111 is connected by a LAN cable, and includes a router, a switch, a cable, and the like that satisfy a communication standard such as Ethernet (registered trademark). A plurality of camera devices, a PC, which will be described later, and the like are connected to the LAN. For example, the LAN 112 may be configured by the Internet, a wired LAN (Local Area Network), a wireless LAN (Wireless LAN), a WAN (Wide Area Network), or the like. Note that the imaging apparatus 111 in the present embodiment may be compatible with, for example, PoE (Power Over Ethernet (registered trademark)), and may be supplied with power via a LAN cable.

  Reference numeral 113 denotes a client terminal device, which is an example of an external device such as a PC. The client terminal device 113 includes a memory for storing predetermined files and programs, and a CPU for executing them. Furthermore, a display (display unit) that displays an image or the like stored in the memory and an input unit that receives an instruction from a user who operates the client terminal device 113 are provided. Further, the client terminal device 113 is connected to a state in which the client terminal device 113 can communicate with the imaging device 111 via the network via the LAN 112 using a communication unit (not shown). The client terminal 113 performs various controls by receiving, displaying, and recording video from the imaging device 111 and transmitting / receiving control information for controlling the imaging device 111 using a control tool described later.

  Here, the control information includes commands and parameters for performing imaging control, irradiation control, and the like in the imaging apparatus 111. The client terminal device 113 can operate the imaging device 111 from the outside by transmitting a control command corresponding to a user instruction that is an operation result input from the input unit. Further, by receiving a response corresponding to the transmitted control command from the imaging apparatus 111, it is possible to know parameters and states held by the imaging apparatus 111.

  Here, the monitoring system including the imaging device 111 and the client terminal device 113 in this embodiment corresponds to an imaging system.

  Next, an operation UI for operating the imaging apparatus will be described with reference to FIGS.

  Reference numeral 201 denotes an operation UI (user interface) displayed on the display unit of the client terminal device 113. By operating the operation UI using an input unit such as a mouse or a touch panel, the captured image can be confirmed and recorded by the imaging device 111, and the operation and setting of the camera device can be performed.

  Reference numeral 202 denotes a camera display screen, which is imaged by the imaging device 111 and received via the network 112, or stored in the client terminal device 113 or a storage on the network and displayed.

  Reference numeral 203 denotes a pan / tilt control button, which performs driving in a panning and tilting directions (not shown) for changing the shooting direction of the imaging device 111. The operation when the panning / tilting direction is changed will be described with reference to FIG.

  In FIG. 3, it is assumed that a subject 301 is imaged using the imaging device 111. The range of the imaging angle of view 302 indicated by the solid line is changed depending on the panning or tilting direction as indicated by 304. By capturing the subject 301 within the imaging angle of view 302, the subject 301 can be imaged. Also, a dotted line indicates an irradiation angle of view 303 with the infrared illumination 106 and is attached in a direction substantially coincident with the imaging angle of view 302. The illumination angle of view 303 is also changed depending on the panning or tilting direction as with the imaging angle of view 302. That is, the irradiation angle of view 303 can be changed by changing the imaging angle of view 302.

  Returning to the description of FIG. Reference numeral 204 denotes a camera control button, which includes buttons for changing camera control of the imaging apparatus 111. The zoom button can change the camera angle of view and change WIDE (wide angle) -TELE (telephoto). The focus button can change the focus of the camera and change NEAR (near distance) -FAR (far distance). With the exposure button, the exposure of the camera can be changed, and the brightness / dark setting of the screen can be changed. Exposure control consists of changing the aperture of the lens, changing the shutter speed due to sensor exposure, and changing the gain of the sensor signal. When the exposure is changed, the exposure for imaging is changed as indicated by reference numeral 305 in FIG.

  Reference numeral 205 denotes an infrared illumination control button, which enables the infrared illumination of the camera device to be changed. When a camera operation such as a change in panning / tilting direction or a change in exposure is performed, the shooting situation is changed, and the shooting subject is changed. When the subject is changed, there is a possibility that a person enters the shooting range, and the infrared illumination is limited in the sense that safety for the person is taken into consideration. Moreover, the display of the mode for lighting the present infrared illumination is included. Specifically, there are indicators indicating the normal mode and the illumination reduction mode, and the indicator corresponding to the current mode is set to light up. The CPU 110 issues a command in response to a request from the client terminal device 113 or at the time of mode switching, and notifies the client terminal device 113 of the current mode. Based on the notified command, the client terminal device 113 determines the mode in the imaging device 111 and changes the corresponding operation UI 201. Details of each mode will be described in detail with reference to FIG.

  Here, when each operation button of the operation UI 201 is operated, the client terminal device 113 transmits a command or parameter corresponding to each operation button to the imaging device 111 via the network 112. The CPU 110 controls each element based on the received command.

  Next, an operation for reducing the illumination intensity when a camera operation is performed will be described with reference to the flowchart of FIG. Note that the processing of this flowchart is executed by the CPU 110.

  In step 401, when the process is started, the CPU 110 starts control of each component. Then, the process proceeds to step 402.

  In step 402, the CPU 110 determines whether an operation button is operated by the user on the camera operation UI on the client terminal device 113. If the operation button has been pressed, the process proceeds to step 403. On the other hand, if the operation button has not been pressed, the process proceeds to step 409. Here, the CPU 110 determines whether or not the user has operated the operation button based on the presence or absence of a command from the client terminal device 113.

  In step 403, if the operation button is pressed, the CPU 110 determines that the camera setting by the user has been changed, and shifts to the illumination reduction mode. Then, the process proceeds to step 404. Here, the camera settings include settings for changing the exposure, settings for starting / stopping imaging, and the like in addition to settings for changing the imaging field angle 302 such as panning, tilting, and zoom. In this embodiment, the CPU 110 corresponds to an exposure setting unit that sets an exposure imaged by the imaging unit.

  In step 404, the CPU 110 controls the infrared illumination control circuit 107 by limiting to the illumination reduction mode, and limits the emission intensity of the infrared illumination 106. More specifically, the amount of electric power supplied to the infrared illumination 106 is reduced, and the illumination intensity is controlled to be a predetermined intensity or less. Then, the process proceeds to step 405. Here, the predetermined strength may be stored in a memory or the like at the time of factory shipment, or may be set from the outside. When the infrared illumination 106 includes a plurality of light sources, control may be performed so as to reduce the number of light sources to be lit in order to reduce the illumination intensity. In addition, when the infrared illumination 106 includes a plurality of light sources having different illumination angles 303, the predetermined intensity for limiting the illumination intensity may be changed according to the illumination angle of view 303 of the light source to be turned on. Good. Specifically, the predetermined intensity may be increased when the irradiation angle of view 303 is wide, and may be set low when it is narrow.

  In step 405, the CPU 110 compensates for the brightness reduction caused by limiting the illumination intensity by increasing the gain in the imaging device 111. Then, the process proceeds to step 406. In addition to compensating for the brightness reduction by increasing the gain, the control may be performed to widen the aperture diameter and to set the shutter speed to a long second. As a result, it is possible to prevent the screen from becoming dark if the image is taken as it is while limiting the illumination intensity to reduce the influence on the human body.

  In step 406, the CPU 110 starts an operation due to the operation button being pressed. That is, a command corresponding to the operated operation button is received, and an operation designated by the command is started. Then, the process proceeds to step 407.

  In step 407, CPU 110 stands by until the operation started in step 406 is completed. If the operation is finished, the process proceeds to step 408.

  In step 408, the CPU 110 cancels the illumination reduction mode performed in step 403. That is, the illumination intensity limited in step 404 and the gain amount increased in step 405 are restored. Then, the process proceeds to step 409.

  In step 409, the CPU 110 shifts to the normal mode after returning all settings to the original. Then, the process ends. The mode transition is preferably performed based on a user instruction from the client terminal device 113. However, the mode may be automatically transitioned to after detecting the presence or absence of a moving object or a human body in the captured image. .

  In this way, when the operation button is operated, by shifting to the illumination reduction mode, it is possible to cause the influence of the human body included in the subject unintentionally even when the screen cannot be confirmed. Become.

  In this embodiment, an example in which the operation unit of the client terminal device 113 is operated is shown. However, the imaging device 111 also has an operation unit that is used at the time of installation. In such a case, the same effect can be obtained by performing the same operation when the operation unit of the imaging apparatus 111 is operated.

  In the present embodiment, the case where each operation button of the operation UI 201 is operated has been described. However, the operation of the present embodiment is limited to a part of the operation buttons (for example, the camera control button 204). Also good.

  In step 403 or step 409 in FIG. 4, a warning display to the user or the like may be performed when the mode is switched. More specifically, a dialog as to whether or not to allow mode switching is displayed on the operation UI 201, and the mode is switched only when permitted by the user. By operating in this way, it is possible to prevent the mode from being switched intentionally.

  If it is determined in step 402 that the operation button has been operated, the operation of limiting the intensity of the irradiation light is performed, but the present invention is not limited to this. For example, when the intensity of the irradiation light is weaker than a predetermined amount, it is not necessary to perform the limiting operation. That is, in step 402, when the intensity of irradiation light is a predetermined amount or more, the process may be advanced to step 403 to shift to the illumination reduction mode.

  If it is determined in step 402 that the operation button has been operated, the operation of limiting the intensity of the irradiation light is performed, but the present invention is not limited to this. For example, when the operation of the operation button is a panning or tilting operation, it is not necessary to perform a limiting operation when the change amount of the imaging angle of view 302 is smaller than a predetermined amount. That is, when the change amount of the imaging angle of view 302 (irradiation angle of view 303) is greater than or equal to a predetermined amount in step 402, the processing may be advanced to step 403 to shift to the illumination reduction mode.

(Example 2)
Hereinafter, with reference to FIGS. 5, 6, and 7, a control method for limiting the illumination intensity when a user performs an imaging operation according to the second embodiment of the present invention will be described. The same components as those in the first embodiment are denoted by the same reference numerals, and the description thereof is omitted. In the second embodiment, the configuration of illumination control in the camera device (FIGS. 1 to 3) is the same, but the control in indicator LED and illumination confirmation mode setting is different.

  In FIG. 5, reference numeral 501 denotes an indicator LED which is turned on in the illumination confirmation mode for confirming the illumination intensity of illumination.

  In FIG. 6, reference numeral 601 denotes a display unit in the illumination confirmation mode, which is lit and displayed when adjusting the illumination level.

  Next, an operation for reducing infrared illumination when a camera operation is performed will be described with reference to a flowchart of FIG.

  In step 801, when the process is started, the CPU 110 starts control of each component. Then, the process proceeds to step 802.

  In step 802, the CPU 110 determines whether an operation button has been operated by the user on the camera operation UI on the client terminal device 113. If the operation button has been pressed, the process proceeds to step 803. On the other hand, if the operation button has not been pressed, the process proceeds to step 813.

  In step 803, if the operation button is pressed, the CPU 110 determines that the camera setting by the user has been changed, and shifts to the illumination reduction mode. Then, the process proceeds to step 804.

  In step 804, the CPU 110 controls the infrared illumination control circuit 107 to limit the light emission intensity of the infrared illumination 106 by shifting to the illumination reduction mode. More specifically, the amount of electric power supplied to the infrared illumination 106 is reduced, and the illumination intensity is controlled to be a predetermined intensity or less. Then, the process proceeds to step 805.

  In step 805, the CPU 110 compensates for the brightness reduction caused by limiting the illumination intensity by increasing the gain in the imaging device 111. Then, the process proceeds to step 806. In addition to compensating for the brightness reduction by increasing the gain, the control may be performed to widen the aperture diameter and to set the shutter speed to a long second.

  In step 806, the CPU 110 starts an operation due to pressing of the operation button. That is, a command corresponding to the operated operation button is received, and an operation designated by the command is started. Then, the process proceeds to step 807.

  In step 807, CPU 110 waits until the operation started in step 806 is completed. If the operation is finished, the process proceeds to step 808.

  In step 808, the CPU 110 cancels the illumination reduction mode performed in step 403. That is, the illumination intensity limited in step 804 and the gain amount increased in step 805 are restored. Then, the process proceeds to step 809.

  In step 809, the CPU 110 shifts to the illumination confirmation mode for the camera setting changed in step 807. Then, the process proceeds to step 810. Here, the illumination confirmation mode is a state in which the restriction of the illumination intensity is temporarily released in order to confirm the illumination intensity, and a warning that the illumination intensity is temporarily increased is displayed on the display unit of the client terminal device 113 or the like. Display or turn on the indicator LED 501. With these operations, it is possible to notify the user or the like that the lighting confirmation mode is being performed. Further, during the illumination confirmation mode, the illumination confirmation mode indicator 601 is turned on in the operation UI 201.

  In step 810, the CPU 110 turns on the indicator LED 501. By turning on the indicator LED, it is possible to guide the user to the illumination confirmation mode. Then, the process proceeds to step 811.

  In step 811, the CPU 110 sets the intensity level of illumination in an environment where shooting is actually performed. This setting may be performed by the user through the operation UI 201 and the intensity level may be set, or the CPU 110 may set it based on the subject brightness. Then, the process proceeds to step 812.

  In step 812, the CPU 110 determines whether or not the illumination confirmation mode for setting the illumination intensity ends. If not completed, the steps of the illumination confirmation mode are repeated. On the other hand, when the illumination confirmation mode ends, the process proceeds to step 813. The mode is preferably terminated based on a user instruction from the client terminal device 113. However, when there is no instruction for a predetermined time, the mode may be automatically shifted to the illumination reduction mode.

  In step 813, the CPU 110 returns all settings to the original state and then shifts to the normal mode. Then, the process proceeds to step 814.

  In step 814, the CPU 110 turns off the indicator LED in the illumination confirmation mode. Then, the process ends.

  As described above, when the intensity is restored after limiting the intensity of illumination, it is possible to prevent unintentionally setting a high illumination intensity by providing a confirmation mode.

  Before shifting to the normal mode, an announcement such as “Did you confirm the illumination intensity in the illumination confirmation mode?” Not shown may be displayed on the operation UI. This makes it possible to perform a monitoring operation after the illumination intensity has been confirmed by the user.

  As mentioned above, although preferable embodiment of this invention was described, this invention is not limited to these embodiment, A various deformation | transformation and change are possible within the range of the summary.

106 Infrared Illumination 111 Camera Device 113 Client Terminal Device 201 Camera Operation UI

Claims (11)

An imaging apparatus that communicates via a network, comprising: an imaging unit that images a subject; and an irradiation unit that irradiates the subject with irradiation light,
Receiving means for receiving a command from the terminal device via the network;
And control means for controlling the intensity of the irradiation light irradiated the irradiation unit or al,
Changing means for changing an irradiation angle of view of the irradiation light;
With
The command includes a control command for controlling the changing means,
The image pickup apparatus, wherein the control unit limits the intensity to a predetermined intensity or less when the control unit receives the control command. An exposure setting means for setting an exposure to be imaged by the imaging unit;
The imaging apparatus according to claim 1, wherein the exposure setting unit performs setting to increase exposure when the control unit limits the intensity to a predetermined intensity or less. The changing means includes an angle-of-view changing means for changing an imaging angle of view of the imaging unit in a pan or tilt direction,
3. The imaging apparatus according to claim 1, wherein the changing unit changes an irradiation angle of view in accordance with a change of an imaging angle of view by the angle of view changing unit. The irradiation unit is an imaging device according to any one of claims 1 to 3, characterized in that it comprises an infrared light source for irradiating infrared rays. The control means includes a selection means for selecting a light source irradiated by the irradiation unit,
The imaging apparatus according to claim 4 , wherein the control unit limits the intensity when the infrared light source is selected and the receiving unit receives the control command. Wherein when the intensity of the irradiation light irradiated from the irradiation unit is equal to or greater than a predetermined amount, the control means imaging apparatus according to any one of claims 1 to 5, characterized in that the limit of the intensity. If the amount of change in firing angle for changing said changing means by said control command is equal to or larger than the predetermined amount, the control means in any one of claims 1 to 5, characterized in that the limit of the intensity The imaging device described. A determination means for determining whether or not the operation based on the control command is completed;
It said control means, the image pickup apparatus according to any one of claims 1 to 7, characterized in that releasing the restriction when it is determined that the operation is completed by the determination unit. A terminal device that communicates with an imaging device via a network, comprising: an imaging unit that images a subject; an irradiation unit that irradiates the subject with irradiation light; and a changing unit that changes an irradiation angle of view of the irradiation light
Operating means for controlling the imaging device;
A transmission means for transmitting a command including an operation result of the operation means to the imaging device via the network;
Display means for displaying the state of the imaging device;
With
The command includes a control command for controlling the changing unit,
The terminal device displays a warning that limits the intensity of irradiation by the irradiation unit to a predetermined intensity or less when the control unit transmits the control command. A control method for an imaging apparatus that communicates via a network, comprising: an imaging unit that images a subject; an irradiation unit that irradiates the subject with irradiation light; and a change unit that changes an irradiation angle of view of the irradiation light.
A receiving step for receiving a command from the terminal device via the network;
A first control step of controlling the intensity of irradiation light emitted from the irradiation unit;
With
The command includes a control command for controlling the changing unit,
In the control step, when the control command is received in the reception step, the intensity is limited to a predetermined intensity or less. A determination step of determining whether or not the operation based on the control command is completed;
Method for controlling an image sensing apparatus according to claim 1 0, characterized in that it comprises a second control step of releasing the restriction when it is determined that the operation is completed by the determination step.

Images