JP2018037747A - Information processing device, and control method and program of same - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a UI capable of setting a suitable exposure time by changing the display ranges of the upper limit and lower limit of an exposure time or the values, in response to an exposure mode.SOLUTION: In the embodiment of this invention, a UI which realizes setting of exposure control of an information processing device by selecting an exposure mode and the upper limit and lower limit of an exposure time by a user operation is characterized by changing the value of an exposure time selectable in response to a set exposure mode.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an information processing apparatus, a control method thereof, and a program, and more particularly to setting of an exposure time during automatic exposure control.

  Conventionally, imaging apparatuses that can set a lower limit (slow shutter) of exposure time during automatic exposure control have been mainstream. On the other hand, surveillance cameras that operate for 24 hours have a function of limiting the upper limit (high-speed shutter) of the exposure time. The Open Network Video Interface Forum (hereinafter referred to as ONVIF) is also standardized as an interface having the same function.

  However, in an imaging apparatus having a large number of exposure modes, the user can select the limit value on the long second side (hereinafter referred to as the upper limit value) and the limit value on the short second side (hereinafter referred to as the lower limit value) in common with the exposure mode. In some cases, the performance and effects unique to the exposure mode cannot be satisfied. For example, in an exposure mode intended to reduce flicker caused by the influence of a fluorescent lamp or the like, if a specific exposure time is selected, the flicker reduction effect may not be exhibited.

  For example, the imaging apparatus described in Patent Document 1 discloses a method of changing a control range of an exposure time that can be controlled by controlling the exposure time according to a detection result of a subject image.

  In the imaging apparatus described in Patent Document 2, a camera shake lower limit shutter speed is defined, exposure control is always performed at a speed equal to or higher than the lower shutter speed, and when the sensitivity and aperture value reach the limits, the shutter speed is slower than the lower shutter speed. A method is disclosed.

JP 2013-70413 A JP 2007-25129 A

  However, in Patent Document 1, since the control range of the exposure time is changed according to the detection result of the subject regardless of the user's intention, for example, flicker may occur when trying to capture a high-speed subject.

  In Patent Document 2, the lower limit exposure time is set based on the photometric value. However, since the upper limit value is not set, depending on the subject, the exposure time may be too short and flicker may occur. There is.

  Therefore, an object of the present invention is to provide means capable of setting an exposure time suitable for the exposure mode when setting the exposure time in order to solve the above-described problems.

  In order to achieve the above object, the present invention provides an exposure mode selection unit that sets an exposure mode of an imaging unit, an exposure time selection unit that can set a control range of an exposure time of the imaging unit, and an upper limit of the control range. And a display means for selectively displaying at least one of the lower limit values, and a control means for changing a value that the display means displays in a selectable manner based on the exposure mode.

  According to the present invention, when setting the exposure time, the exposure time suitable for the purpose of the exposure mode can be set.

The figure which shows the structural example of the imaging device which concerns on embodiment of this invention. The figure which shows the structural example of the imaging part of the imaging device which concerns on embodiment of this invention. The figure which shows the example of UI which concerns on the 1st Embodiment of this invention The flowchart which shows the setting process of the exposure time which concerns on the 1st Embodiment of this invention. The figure which shows the example of the program diagram at the time of the flicker reduction mode which concerns on the 1st Embodiment of this invention The figure which shows the example of the selection range of the upper limit in the flicker reduction mode which concerns on the 1st Embodiment of this invention, and a lower limit The figure which shows the example of the selection range of the upper limit and lower limit in the auto exposure mode which concerns on the 1st Embodiment of this invention The flowchart which shows the setting process of the exposure time which concerns on the 2nd Embodiment of this invention.

  Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. Below, the case where a camera is used as an imaging device is demonstrated.

  FIG. 1 is a diagram illustrating a configuration example of an imaging apparatus according to an embodiment of the present invention. The information processing apparatus according to the present embodiment includes a display device 11 for remotely controlling the imaging device 10. In the present embodiment, an example in which the imaging device 10 and the display device 11 are separate has been described. However, the imaging device 10 and the display device 11 may be integrated.

  The imaging device 10 can capture light from the outside to generate an image signal, and can distribute the generated image signal to an external device such as the display device 11 or a server (not shown) via the communication unit 103.

  The display device 11 is used for presenting the state of the system, processing results, and the like to the user, and displays information such as images acquired by the communication unit 114 via the external network. Also, control information for controlling the operation of the system is input to the information displayed on the display device 11 using an external terminal such as a touch panel or a personal computer (PC).

  The imaging apparatus 10 includes an imaging unit (imaging means) 101, an image signal processing unit 102, a communication unit 103, an exposure control unit 104, an exposure mode setting unit 105, an exposure time setting unit 106, and a system control unit 107.

  The imaging unit 101 captures light from the outside and captures an image, thereby generating an image signal of a surrounding subject.

  The image signal processing unit 102 performs predetermined processing on the image signal generated by being captured by the imaging unit 101, and outputs a luminance signal and a color signal for each pixel. For example, it is configured by Digital Signal Processing (DSP) and the like, and performs predetermined image processing such as gamma processing for performing color conversion on the digital signal and tone conversion of the signal processed image, and noise reduction processing. Predetermined image processing is performed to generate output image data, and parameters for camera control can be calculated. Examples of the parameters for performing camera control include those used in aperture control, focus adjustment control, white balance control for adjusting color, and the like.

  The communication unit 103 distributes the image data processed by the image processing unit 102 to an external client device such as the display device 11 or a server. The output destination of the image data may be an LCD built in the camera or an external display. Further, the control information of the imaging device 10 instructed from an external terminal such as the display device 11 is acquired.

  In the exposure control unit 104, exposure control is automatically performed in accordance with an exposure target, mainly for an exposure time when imaged by the imaging unit 101 and an AGC amplifier described later with reference to FIG. In the present embodiment, the exposure time corresponds to the charge accumulation time in the imaging unit. However, the exposure time using a mechanical shutter or liquid crystal may be used. At this time, exposure control is performed along a program diagram determined for each exposure mode. A drive-type diaphragm, a variable neutral density filter, or the like not shown may be controlled.

  The exposure mode setting unit 105 sets an exposure mode when the exposure control unit 104 controls exposure.

  The exposure time setting unit 106 sets an exposure time (exposure time) when the exposure control unit 104 controls exposure. Here, a fixed exposure time may be set, or an upper limit value and a lower limit value may be set. In the embodiment of the present invention, the shorter exposure time is the upper limit, the longer exposure time is the lower limit, that is, the faster shutter speed is the upper limit, and the slower exposure time is the lower limit.

  The system control unit 107 includes a CPU, a memory (ROM), and a memory (RAM) (not shown), and the CPU controls each functional block of the imaging apparatus 10 and performs a calculation necessary for that according to a program loaded from the ROM. The memory (ROM) stores a control program executed by the CPU and various constant values necessary for executing the program. The memory (RAM) is an area for storing various temporary data necessary for executing the program.

  Here, the imaging unit 101 will be described in detail with reference to FIG. FIG. 2 is a diagram illustrating a detailed configuration example of the imaging unit 101. The imaging unit 101 includes a lens 201 made up of several lens groups, and an imaging element 202 such as a CCD or CMOS. Furthermore, a correlated double sampling (CDS) circuit 203, a gain control amplifier circuit (Automatic Gain Control: AGC) 204, and an A / D conversion 205 are provided.

  The lens 201 is an optical system that condenses incident light from the subject on the image sensor 202. The lens 201 is a lens group that includes a plurality of optical systems, and includes a focus lens that performs a focusing operation on a subject, a zoom lens that adjusts an angle of view, and the like.

  The image sensor 202 converts a subject image formed through a lens 201 as an imaging optical system into an electric signal.

  The CDS circuit 203 performs correlated double sampling (CDS) processing for reducing noise on the electrical signal output from the image sensor 202.

  The AGC amplifier 204 is a gain control amplifier circuit (Automatic Gain Control: AGC) that automatically controls the gain of the camera. Amplification processing is performed on the electrical signal output from the CDS circuit 203.

  The A / D converter 205 converts the analog signal amplified by the AGC amplifier 204 into a digital signal.

  The display device 11 includes an image display unit 111, an exposure mode selection unit 112, an exposure time selection unit 113, a communication unit 114, and a system control unit 115.

  The image display unit 111 displays information such as image data acquired via the communication unit 114. In addition, an operation screen for enabling the imaging device 10 to be controlled by a user operation can be displayed.

  The exposure mode selection unit 112 is a UI (user interface) that displays a plurality of exposure modes so that the user can select a plurality of exposure modes in order to set the exposure mode of the imaging apparatus 10. An exposure mode selected by a user operation from among a plurality of modes displayed on the exposure mode selection unit 112 is determined as an exposure mode to be set for the imaging apparatus 10.

  The exposure time selection unit 113 is a UI (user interface) that displays an upper limit value and a lower limit value of the exposure time so as to be set by a user operation in order to set the exposure time of the imaging apparatus 10. The exposure time selected by the user operation from the exposure times displayed on the exposure time selection unit 113 is determined as the exposure time set for the imaging device 10.

  The communication unit 114 distributes control information such as the exposure mode and the exposure time set by the exposure mode selection unit 112 and the exposure time upper / lower limit value selection unit 113 to the imaging device 10. Also, an image and other control information are acquired from an external terminal such as the imaging device 10.

  The system control unit 115 includes a CPU (not shown), a memory (ROM), and a memory (RAM). The CPU controls each functional block of the display device 11 and performs a calculation necessary for the function according to a program loaded from the ROM. The memory (ROM) stores a control program executed by the CPU and various constant values necessary for executing the program. The memory (RAM) is an area for storing various temporary data necessary for executing the program.

(First embodiment)
Here, the first embodiment of the present invention will be described with reference to FIGS. First, an example of selecting an upper limit value and a lower limit value of the camera exposure mode and exposure time (exposure time) from the UI unit 11 of the present embodiment will be described with reference to the flowchart of FIG. Here, the exposure time will be described with the shorter one as the upper limit and the longer one as the lower limit. That is, the faster shutter speed (high-speed shutter side) is the upper limit, and the slower shutter speed (slow shutter side) is the lower limit.

  FIG. 3 is a diagram illustrating an example of a UI according to the first embodiment of the present invention. Details of the image display unit 111, the exposure mode selection unit 112, and the exposure time selection unit 113 are the same as those described above with reference to FIG.

  FIG. 4 is a flowchart showing exposure time setting processing according to the first embodiment of the present invention. The flowchart of FIG. 4 illustrates a processing procedure executed by the system control unit 115 controlling each processing block. This is realized by developing a program stored in a memory (ROM) of each system control unit in the memory (RAM) and executing it by the CPU. The processing shown in the flowchart is realized by the main operation of the image display unit 111, the exposure mode selection unit 112, the exposure time selection unit 113, and the communication unit 114.

  First, in step S301, the exposure selection unit 112 selects an exposure mode. The exposure mode selection unit 112 on the display device 11 displays the exposure mode so as to be selectable by a user operation, and determines the exposure mode in response to an operation of the user selecting the displayed exposure mode. Typical exposure modes include normally used auto, shutter priority mode in which exposure control is performed with a fixed exposure time, and aperture priority mode in which exposure control is performed with a fixed aperture. As an exposure mode corresponding to a specific scene, there is a flicker reduction mode for suppressing flicker due to the influence of a fluorescent lamp or the like. The flicker reduction mode is an exposure mode in which a program diagram that uses a lot of exposure time synchronized with the emission frequency of the fluorescent lamp on the program diagram is applied. In the present embodiment, an exposure mode for the purpose of suppressing 50 Hz flicker will be described as an example of the flicker reduction mode.

  Here, FIG. 5 is an example of a program diagram of the flicker reduction mode based on the exposure times of 1/50 seconds and 1/100 seconds used when the emission frequency of the fluorescent lamp is 50 Hz. The vertical axis represents the aperture value, and the horizontal axis represents the exposure time. When the light emission frequency of a fluorescent lamp or the like is NHz (N = 50 or more and 60 or less), 1 / N second and 1/2 N second may be used as a reference for the program diagram for the flicker reduction mode. For example, when the emission frequency of the fluorescent lamp is 60 Hz, 1/30 seconds and 1/120 seconds are used as a reference.

  Next, in step S302, it is determined whether or not the exposure mode is a specific exposure mode for the purpose of reducing flicker, for example. If it is a specific exposure mode, the process proceeds to step S303. If it is not a specific exposure mode, the process proceeds to step S304 without passing through step S303. Here, the specific exposure mode is not limited to the flicker reduction mode, but can be applied to known exposure modes such as the night view mode and the sports mode, in addition to the shutter priority mode and the aperture fixed mode described above. The relationship between the exposure time, the upper limit value, and the lower limit value that can be set for each exposure mode is held in a table, and this embodiment may be applied with each held exposure mode as a specific exposure mode.

  In step S303, the range of the upper limit value and the lower limit value of the exposure time that can be selected by the user for display by the exposure time selection unit 113 in the specific exposure mode is set. For example, the range of the upper limit value and the lower limit value of the exposure time corresponding to the set specific exposure mode is specified with reference to the above-described table.

  For example, when the specific exposure mode is the flicker reduction mode, the upper limit value and the lower limit value of the exposure time (exposure time) are set as shown in FIG. FIG. 6 shows a selection range of exposure times (exposure times) that can be selected by the exposure time selection unit 113 when the exposure mode is the flicker reduction mode. When the emission frequency of the fluorescent lamp is 50 Hz and the flicker reduction mode is selected, the flicker is reduced if the exposure time between 1/50 and 1/100 can be selected with respect to the upper limit value or the lower limit value of the exposure time. Because it cannot be done, it is excluded from the selection range. In order to prevent selection of an exposure time between 1 / N and 1 / 2N under a light source with a frequency of NHz, the upper limit selectable value range is 1 / 2N or less (short seconds side) The range of selectable values is 1 / N or more (long seconds side).

  FIG. 7 shows a selection range of the upper limit value and the lower limit value of the exposure time (exposure time) when the exposure mode is auto. When the exposure mode is auto, the selectable range of the upper limit and lower limit of the exposure time is the same. When the user selects the same exposure time for the upper limit value and the lower limit value of the exposure time, the operation is the same as in the shutter priority mode in which exposure control is performed with the selected exposure time fixed. Further, when the user tries to select a value that reverses the relationship between the upper limit value and the lower limit value of the exposure time, a warning may be displayed on the display device 11, or the upper limit value and the lower limit value of the exposure time may be displayed. The values may be forcibly changed so as to be the same.

  Although the flicker reduction mode has been described here, it can be selected from the exposure time (exposure time), the upper limit value, and the lower limit value held in correspondence with each exposure mode in the other exposure modes described above. The upper and lower limits of the exposure time can be set.

  Next, in step S304, the exposure time selection unit 113 presents the upper and lower limits of the exposure time that can be selected in the currently selected exposure mode, and the user selects the upper and lower limits of arbitrary exposure time. To do. In the case of a specific exposure mode, the upper limit value and the lower limit value set in step S303 are displayed in a selectable manner. If it is not a specific exposure mode, for example, as shown in FIG. 7, all exposure times are displayed as selectable upper and lower limit values. Alternatively, a default value preset by a program or the like may be displayed. At this time, the exposure time selected by the user may be only the upper limit value or only the lower limit value.

  In step S305, the upper limit value and lower limit value of the exposure mode and exposure time selected in steps S303 and S304 are transmitted to the imaging apparatus 10. In the imaging apparatus 11 that has received the upper limit value and lower limit value of the exposure mode and exposure time, the exposure control unit 105 and the exposure time setting unit 106 set the received exposure mode and exposure time upper and lower limit values, and the exposure control unit. 104 performs exposure control according to the set mode and exposure time.

  As described above, according to the present embodiment, when the user can set the exposure mode and the exposure time, the upper limit value and the lower limit value of the exposure time that can be selected according to the selected exposure mode are limited. It is possible to set an exposure time suitable for the exposure mode.

  In addition, when the exposure mode is determined, the upper limit value and the lower limit value of the exposure time may be calculated on the imaging device 10 side, and the display device 11 may be instructed and displayed. Further, instead of the exposure time (exposure time), it is also possible to adopt a configuration in which the range of exposure control is determined by setting an upper limit value and a lower limit value of the shutter speed.

(Second Embodiment)
Next, an example of correspondence between the upper limit value and the lower limit value of the exposure time when the exposure mode is changed will be described in detail with reference to FIG. In addition, the part which performs the same process as embodiment mentioned above is shown with the same symbol, and abbreviate | omits description.

  FIG. 8 is a flowchart showing exposure time setting processing according to the second embodiment of the present invention. The flowchart in FIG. 8 illustrates a processing procedure executed by the system control unit 115 controlling each processing block. This is realized by developing a program stored in a memory (ROM) of each system control unit in the memory (RAM) and executing it by the CPU.

  First, in step S401, the exposure mode is selected by the exposure mode selection unit 112 on the display device 11 to change the exposure mode. The exposure mode selection unit 112 on the display device 11 displays the exposure mode so as to be selectable by a user operation, and determines the exposure mode in response to an operation of the user selecting the displayed exposure mode. Here, description will be made assuming that the exposure mode is changed from the auto exposure mode to the flicker reduction mode.

  In step S402, it is determined whether an upper limit value or a lower limit value of the exposure time is selected. If at least one of the upper limit value and the lower limit value has been selected, the process proceeds to step S403. If neither is set, the process proceeds to step S303. Subsequent steps S303 to S305 are the same processing as that of the same symbol in FIG.

  If at least one of the upper limit value and the lower limit value has been selected, the process proceeds to step S403, and it is determined whether or not the upper limit value of the exposure time is within the range of the upper limit value associated with the set exposure mode. If it is within the range, the process proceeds to step S405. If it is out of the range, the process proceeds to step S404 to change the upper limit value. Here, the shorter exposure time is the upper limit and the longer exposure time is the lower limit. That is, the faster shutter speed (high-speed shutter side) is the upper limit, and the slower shutter speed (slow shutter side) is the lower limit.

  In step S404, the upper limit value is changed so as to be within a range corresponding to the changed exposure mode. For example, when the upper limit value of the exposure time (exposure time) is 1/4 second in the exposure auto mode, the range of the upper limit value of the exposure time in the flicker reduction mode is 1/100 second to 1 under a light source with a frequency of 50 Hz. Since it is / 16000 seconds, it is forcibly changed to 1/100 seconds. In the case of a light source with a frequency of NHz, for example, when the upper limit value is longer than 1 / 2N, it is forcibly changed to 1 / 2N. If the upper limit value is not set, the upper limit value may be determined by causing the exposure time selection unit 113 to display the range within the range corresponding to the exposure mode and to select it by a user operation.

  In step S405, it is determined whether or not the lower limit value of the exposure time is within the range of the lower limit value associated with the set exposure mode. If it is within the range, the process proceeds to step S407. If it is out of the range, the process proceeds to step S406 to change the lower limit value.

  In step S406, the lower limit value is changed so as to be within the lower limit range corresponding to the changed exposure mode. For example, when the lower limit value of the exposure time (exposure time) is 1/500 seconds during exposure auto, the lower limit value of the exposure time in the flicker reduction mode is from 1/2 seconds to 1/50 seconds. Forcibly change to 1/50 second. In the case of a light source with a frequency of NHz, for example, when the lower limit value is shorter than 1 / N, it is forcibly changed to 1 / N. If the lower limit value is not set, the lower limit value may be determined by displaying on the exposure time selection unit 113 within a range corresponding to the exposure mode and selecting it by a user operation.

  In step S407, the selected exposure mode and the upper limit value and lower limit value of the exposure time are transmitted to the imaging apparatus 10. In the imaging apparatus 11 that has received the upper limit value and lower limit value of the exposure mode and exposure time, the exposure control unit 105 and the exposure time setting unit 106 set the received exposure mode and exposure time upper and lower limit values, and the exposure control unit. 104 performs exposure control according to the set mode and exposure time.

  As described above, according to the present embodiment, the upper limit value or the lower limit value of the exposure time that has already been determined is changed to a setting value corresponding to the changed exposure mode, thereby allowing the user to set again. Without changing the exposure time corresponding to the selected exposure mode.

  In the above-described embodiment, for example, each process of the exposure control unit 104, the exposure mode setting unit 105, the exposure time setting unit 106, the image display unit 111, the exposure mode selection unit 112, the exposure time selection unit 113, and the like is programmed by the CPU. You may implement | achieve by performing.

  The above is a description of a preferred embodiment of the present invention. However, the present invention is not limited to the above-described embodiment within the scope of the technical idea of the present invention, and is adapted as appropriate according to the target circuit form. What to do. For example, the camera described as the imaging device in the above-described embodiment can be applied to a digital still camera or a digital video camera.

  Further, the present invention can be embodied as a system, apparatus, method, computer program, or recording medium, for example. Specifically, the present invention can be applied to a system composed of a plurality of apparatuses even if it is realized by one apparatus. May be. Each means of the imaging apparatus according to the present embodiment and each step of the imaging apparatus control method can also be realized by operating a program stored in a memory of a computer or the like. The computer program and a computer-readable recording medium on which the program is recorded are included in the present invention.

  The present invention supplies a program that realizes one or more functions of the above-described embodiments to a system or apparatus via a network or a storage medium, and one or more processors in a computer of the system or apparatus read and execute the program This process can be realized. It can also be realized by a circuit (for example, ASIC) that realizes one or more functions.

DESCRIPTION OF SYMBOLS 10 Imaging device 11 Display apparatus 101 Imaging part 102 Image signal processing part 103 Communication part 104 Exposure control part 105 Exposure mode setting part 106 Exposure time setting part 111 Display part 112 Exposure mode selection part 113 Exposure time selection part

Claims (11)

Exposure mode selection means for setting the exposure mode of the imaging means;
Exposure time selection means capable of setting a control range of exposure time of the imaging means;
Display means for selectively displaying at least one of an upper limit and a lower limit of the control range;
Based on the exposure mode, control means for changing the value displayed by the display means so as to be selectable;
An information processing apparatus comprising:   The information processing apparatus according to claim 1, wherein the exposure mode setting unit selects one exposure mode from a plurality of exposure modes.   The information processing apparatus according to claim 1, wherein the exposure modes selectable by the exposure mode setting unit include at least a flicker reduction mode for reducing flicker. When the exposure mode selected by the exposure mode setting means is the flicker reduction mode,
The control means sets the selectable value of the upper limit to 1 / 2N (N = 50 or more and 60 or less) and the selectable value of the lower limit to 1 / N or more. The information processing apparatus according to claim 3.   In the exposure mode selection means, when the control mode is changed to the flicker reduction mode, if the upper limit value of the control range is longer than 1 / 2N, the upper limit value of the exposure time is changed to 1 / 2N. The information processing apparatus according to claim 3 or 4.   In the exposure mode setting means, when the lower limit value of the control range is shorter than 1 / N when the flicker reduction mode is changed, the lower limit value of the exposure time is changed to 1 / N. The information processing apparatus according to any one of claims 3 to 5.   The information processing apparatus according to claim 1, wherein the exposure time includes a charge accumulation time of an imaging unit.   The information processing apparatus according to claim 1, wherein the image pickup unit is built in. An exposure mode selection step for setting the exposure mode of the imaging means;
An exposure time selection step capable of setting a control range of the exposure time of the imaging means;
A display step for selectively displaying at least one of an upper limit and a lower limit of the control range;
Based on the exposure mode, a control step of changing a value to be displayed selectably in the display step;
A method for controlling an information processing apparatus, comprising:   A computer program for causing a computer to execute each step according to claim 9.   The computer-readable recording medium which described the program of Claim 10.

Images