JP4894844B2 - Imaging apparatus and imaging operation processing method - Google Patents

Description

  The present invention relates to an imaging apparatus and an imaging operation processing method, and more particularly to operations of various automatic processing functions in the imaging apparatus.

JP-A-5-292389 Japanese Patent Laid-Open No. 2-174471 JP 2001-177741 A JP-A-4-23576 JP 7-87372 A JP 2000-350088 A

  In general, imaging apparatuses such as video cameras and digital still cameras are equipped with automatic processing functions such as auto iris, auto white balance, and flare correction. At the time of imaging, evaluation values for these processes are detected from the captured video signal, and automatic adjustment is performed so that an appropriate captured video signal is obtained.

By the way, in an imaging device, for example, an enlarged image signal may be recorded after being enlarged, displayed, or transferred to an external device.
The enlargement process is a process of generating an enlarged video signal by extracting a part of a pixel range (image frame range) obtained by the imaging device unit as a captured video signal, for example.

Considering the case where such an enlarged video signal is output for recording or the like, the various automatic processing functions described above may not be executed properly.
That is, the above-mentioned various automatic processing functions detect an evaluation value with an image frame range obtained by an image sensor unit such as a CCD as a detection target, and perform predetermined signal processing or lens system by feedback control or the like according to the detection value. And so on. However, when an enlarged video is output, the output video signal is a partial range of the image frame range obtained by the imaging element unit.
In other words, the detection target for the automatic processing function includes a pixel signal outside the range of the video signal to be output, and accurately reflects the state of the enlarged video signal (for example, the luminance state and the color state). It will not be.
For this reason, when the enlargement process is performed, the automatic processing function is not properly executed, and an appropriate video signal may not be obtained.
On the other hand, depending on the type of the automatic processing function, there are cases where it is better to use the image frame range obtained by the image sensor unit as a detection target when performing the enlargement process.

  Therefore, an object of the present invention is to appropriately execute various automatic processing functions in an imaging apparatus in which enlargement processing may be performed.

An imaging device of the present invention includes an imaging unit that performs photoelectric conversion of incident light and obtains an imaging video signal;
An enlargement processing unit that can output the imaged video signal obtained by the imaging unit as it is and extract a part of the range from the image frame range of the imaged video signal and perform video enlargement processing; A first area setting unit that sets an effective detection area of the captured video signal, a second area setting unit that sets an effective detection area of the captured video signal output from the enlargement processing unit, and the first For the effective detection area of the imaged video signal set in the area setting unit, the flare processing function, the black balance processing function, and the auto black shading processing function all or part of the processing functions as the first type automatic processing function The effective detection area of the picked-up video signal output from the enlargement processing unit set by the first detection unit for obtaining the detection value for the image and the second area setting unit As the second type of automatic processing function, detection for all or a part of the processing functions of the auto white balance processing function, the dynamic contrast control processing function, the low light alarm processing function, the auto iris processing function, and the auto hue processing function A second detection unit for obtaining a value; a third area setting unit for setting an effective detection area of the captured video signal output from the enlargement processing unit and subjected to gamma processing and knee processing; and the third area setting unit A third detection unit that obtains a detection value for an auto white balance processing function as a third type automatic processing function for the effective detection area of the imaged video signal set in step 1, and the first and second types , based on the detected value detected by the third detector, the first type, second type, and a control unit for controlling the operation of the third type of automatic processing functions, the control Under the control of, comprising the first type, second type, and one or more processing units to execute the automatic processing function of the third kind.

The second area setting unit is configured to change the setting by a control signal for controlling the enlargement processing unit.

Alternatively, the second area setting unit is configured to change the setting according to the enlargement setting of the enlargement setting processing unit.

The imaging operation processing method of the present invention includes a first setting step for setting an effective detection area of a captured video signal obtained by performing photoelectric conversion of incident light, and a part of the captured video signal and the captured video signal. A second setting step for setting the effective detection area of any one of the picked-up video signals obtained by extracting the range and the effective detection area set in the first setting step as targets. As one type of automatic processing function, a first detection step for obtaining detection values for all or a part of the flare processing function, black balance processing function, and auto black shading processing function, and the second setting step described above Targeting the effective detection area set in Step 2. Auto white balance processing function and dynamic contrast control processing as the second type of automatic processing function Ability, wax light alarm processing function, auto iris processing function, a second detecting step of obtaining a detection value for all or part of the processing functions of the auto Hugh processing function, a part of the video image signal and the image pickup video signal A third setting step for setting an effective detection area of the imaged video signal that is any one of the imaged video signals that have been extracted and expanded and that has undergone gamma processing and knee processing; A third detection step for obtaining a detection value for an auto white balance processing function as a third type automatic processing function for the effective detection area of the captured video signal set in the setting step; Based on the detection values detected in the second and third detection steps, an automatic processing step for executing the first type, second type, and third type automatic processing functions is performed. To.

That is, the present invention described above classifies various automatic processing functions into the first type, the second type, and further the third type, and the target for detecting the evaluation value differs depending on the type. To do.
For the first type automatic processing function, evaluation value detection is performed for the image frame range of the captured image signal obtained by the image sensor, that is, the entire captured image range.
For the second type automatic processing function, among the image frame ranges of the captured image signal obtained by the image sensor, the image frame range after the enlargement process, that is, a part of the image range extracted by the enlargement process. Evaluation value detection is performed as a target.
For the third type of automatic processing function, it is the image frame range after enlargement processing within the image frame range of the captured image signal obtained by the image sensor, but it is evaluated for the video signal after gamma processing. Perform value detection.
Thus, appropriate detection according to the video signal to be output is performed for each automatic processing function.

According to the present invention, various automatic processing functions are performed effectively by performing appropriate detection according to the video signal to be output for various automatic processing functions, and the video signal to be output is output. Even if is an enlarged video signal, a high-quality video signal can be obtained.
For example, regardless of execution or non-execution of enlargement processing, flare processing function, black balance processing function, auto black shading processing function, auto white shading processing function, stationary auto white balance processing function, dynamic contrast control processing function, low light alarm Each of the processing function, the auto iris processing function, the auto hue processing function, the start-up auto white balance processing function, etc. can effectively exhibit the operation function.

Hereinafter, embodiments of the present invention will be described in the following order.
[1. First Configuration Example of Imaging Device]
[2. Execution procedure of automatic processing function]
[3. Second Configuration Example of Imaging Device]
[4. Third Configuration Example of Imaging Device]

[1. First Configuration Example of Imaging Device]

A configuration example of a main part of the imaging apparatus 1 according to the embodiment is shown in FIG.
The imaging device 1 includes an imaging optical system 2, an imaging element unit 3, an analog video processing unit 4, an A / D conversion unit 5, a lens driving unit 6, a timing generator 7, a DSP (Digital Signal Processor) 10, and a controller 30.

The imaging optical system 2 and the imaging element unit 3 perform photoelectric conversion of incident light from the subject to obtain an imaging video signal.
The imaging optical system 2 includes a plurality of optical lens groups such as a focus lens and a zoom lens, and a diaphragm mechanism that adjusts the amount of incident light by opening and closing.
The lens driving unit 6 includes a transfer mechanism that transfers the focus lens and the zoom lens in the imaging optical system 2 in the optical axis direction, and a driving mechanism for a diaphragm mechanism. The lens driving unit 6 drives the lens transfer and the diaphragm mechanism based on the control of the controller 30. Thereby, focus control, zoom operation, and exposure adjustment are executed.

A light beam from the subject passes through the imaging optical system 2, and a subject image is formed on the imaging element unit 3.
The image sensor unit 3 photoelectrically converts the subject image to be imaged and outputs a captured video signal corresponding to the subject image.
The imaging device unit 3 has a rectangular imaging region composed of a plurality of pixels, and sequentially outputs video signals, which are analog signals corresponding to the charges accumulated in the pixels, in units of pixels. 4 is output. For example, a CCD (Charge Coupled Device) sensor array, a CMOS (Complementary Metal Oxide Semiconductor) sensor array, or the like is used as the imaging element unit 3.

The analog video processing unit 4 includes a CDS (correlated double sampling) circuit, an AGC (auto gain control) circuit, and the like, and performs predetermined analog processing on the video signal input from the image sensor unit 3. .
The analog video processing unit 4 also performs auto black balance (ABB) processing and auto black shading (ABS) processing.

  The A / D converter 5 converts the analog video signal processed by the analog video processor 4 into a digital video signal and supplies the digital video signal to the DSP 10.

The timing generator 7 is controlled by the controller 30 and controls the timing of each operation of the imaging device unit 3, the analog video processing unit 4, and the A / D conversion unit 5.
That is, the timing generator 7 captures an exposure / charge readout timing signal, a timing signal as an electronic shutter function, a transfer clock, a synchronization signal corresponding to a frame rate, and the like in order to control the imaging operation timing of the imaging device unit 3. It supplies to the element part 3. The analog video processing unit 4 also supplies the timing signals to the analog video processing unit 4 so that the processing is performed in synchronization with the transfer of the video signal in the image sensor unit 3.
The controller 30 can set the frame rate of the captured image and perform electronic shutter control (exposure time variable control in a frame) by controlling each timing signal generated by the timing generator 7.

The DSP 10 performs various digital signal processing on the captured video signal input from the A / D converter 5.
In the DSP 10, for example, as shown in the drawing, processing functions such as a digital video processing unit 11, an enlargement circuit 12, a gamma / knee circuit 13, detection units 14, 15, 16, and area setting units 17, 18, 19, etc. And realized by software.

  The digital video processing unit 11 performs processing on an input captured video signal. For example, white correction is performed as stationary auto white balance (ATW) processing and start-up auto white balance (AWB). Also, white shading correction is performed as an auto white shading (AWS) process. Further, flare correction is performed as flare processing.

The enlargement circuit 12 performs image enlargement processing. In accordance with the control of the controller 30, a process for enlarging the video image, for example, twice is performed.
FIG. 2 schematically shows the enlargement process. An image frame A <b> 1 in FIG. 2A indicates the range of all pixels obtained by photoelectric conversion in the image sensor unit 3.
On the other hand, the enlargement circuit 12 extracts, for example, a pixel region as the enlargement range A3 in FIG. 2B, performs pixel interpolation, etc., and produces an enlarged image as shown in FIG. 2C. An enlarged video signal similar to A1, that is, an enlarged image signal of the image content in the enlarged range A3 is generated.
Note that when there is no enlargement instruction from the controller 30 (or when an enlargement factor of 1 is instructed), the enlargement circuit 12 outputs the captured video signal as it is without performing enlargement processing.

The gamma / knee circuit 13 performs gamma correction processing, knee correction processing, and dynamic contrast control (DCC) processing on the captured video signal.
The output of the gamma / knee circuit 13 is supplied as an imaged video signal to another circuit system (not shown). For example, it is supplied to the display unit for monitoring display, or supplied to the recording unit for moving image recording or still image recording. Further, the data is supplied to the external interface unit and transferred to an external device.

The detection units 14, 15, and 16 receive captured image signals, respectively, and perform evaluation value detection for various processing functions.
The detection unit 14 receives a captured video signal output from the digital video processing unit 11, that is, before being processed by the enlargement circuit 12. The detection unit 14 detects the evaluation value from the signal of each pixel as the effective detection area A2 in FIG.
The detection unit 14 detects evaluation values for FLARE processing, ABB processing, ABS processing, and AWS processing. Hereinafter, the evaluation values detected by the detection unit 14 for each processing are referred to as FLARE detection value, ABB detection value, ABS detection value, and AWS detection value.

The detection unit 15 receives a captured video signal at the output stage of the enlargement circuit 12. The detection unit 15 detects the evaluation value from the signal of each pixel in the effective detection area, with the captured video signal as the output of the enlargement circuit 12 as a target. In this case, if the enlargement circuit 12 is not performing enlargement processing, the effective detection area is the effective detection area A2 in FIG. On the other hand, when the enlargement circuit 12 performs the enlargement process, for example, an evaluation value is detected from the signal of each pixel as the effective detection area A4 in FIG.
The detection unit 15 detects evaluation values for ATW processing, DCC processing, low light (LOW_LIGHT) processing, auto iris (AUTO_IRIS) processing, and auto hue (AUTO_HUE) processing. Hereinafter, the evaluation values detected by the detection unit 15 for each process are referred to as an ATW detection value, a DCC detection value, a LOW_LIGHT detection value, an AUTO_IRIS detection value, and an AUTO_HUE detection value.

The detection unit 16 receives a captured video signal at the output stage of the gamma / knee circuit 13. The detection unit 16 performs a detection operation on the captured video signal as the output of the gamma / knee circuit 13. Also in this case, if the enlargement circuit 12 is not performing enlargement processing, the effective detection area is the effective detection area A2 in FIG. On the other hand, when the enlargement circuit 12 performs the enlargement process, for example, an evaluation value is detected from the signal of each pixel as the effective detection area A4 in FIG. The detection unit 16 detects an evaluation value for the AWB process. The evaluation value detected by the detection unit 16 is hereinafter referred to as an AWB detection value.

The area setting units 17, 18, and 19 set an effective detection area for each input captured video signal. For example, the area setting unit 17 sets the effective detection area A2 from the original image frame A1 with a vertical side ratio of 80% and a horizontal side ratio of 80%. The same applies to the area setting units 18 and 19. For example, the effective detection area is set for the input captured video signal with a vertical side ratio of 80% and a horizontal side ratio of 80%.
For example, when the effective detection area A2 is set with a vertical side ratio of 80% and a horizontal side ratio of 80%, the area ratio is 64% with respect to the original image frame A1.
Further, in the situation of FIG. 2B, the enlargement range A3 is ½ times (that is, in the case of a double-enlarged image) both vertically and horizontally with respect to the original image frame A1, and the effective detection area of FIG. A2 (= A4 range) is a region having an area ratio of 16% with respect to the original image frame A1 before enlargement shown in FIG.

When the operation of the detection units 14, 15, and 16 is viewed in units of pixels, for example, when the original image frame A1 is targeted, a method of detecting a luminance value with an average of four pixels as shown in FIG. May be adopted. On the other hand, when an enlarged image is considered, the 4 pixels are within the range of 16 pixels in FIG. In this case, it is conceivable to cancel the average of four pixels and detect the luminance value for each pixel.

In FIG. 1, the controller 30 realizes various control functions by software processing as shown.
The enlargement control unit 41 controls enlargement processing for the enlargement circuit 12 of the DSP 10 in response to an enlargement instruction signal Dex by a user operation or a software program, for example.
If the enlargement instruction signal Dex is a signal for instructing execution / non-execution of enlargement, for example, the enlargement control unit 41 instructs the enlargement circuit 12 to perform, for example, double enlargement processing when instructing enlargement execution. When the enlargement non-execution instruction is given, the enlargement circuit 12 is instructed not to execute the enlargement process, for example.
If the enlargement instruction signal Dex is a signal for instructing an enlargement magnification, the enlargement control unit 41 controls the enlargement circuit 12 to perform enlargement processing at the magnification specified by the enlargement instruction signal Dex.

FIGS. 4A and 4B show the processing of the enlargement control unit 41 of the controller 30 and the processing on the DSP 10 side.
When the enlargement instruction signal Dex is generated as step F101 in FIG. 4A, the enlargement control unit 41 performs video enlargement control corresponding to the enlargement instruction signal Dex on the enlargement circuit 12 of the DSP 10 in step F102.
On the DSP side, when there is a control signal input from the enlargement control unit 41 in step F201 as shown in FIG. 4B, enlargement setting is performed by the enlargement circuit 12 in step F202.
As a result, the captured video signal input to the enlargement circuit 12 thereafter is enlarged in the set state.

The auto iris control unit 31 controls the automatic exposure adjustment operation by the gain control unit 31a, the shutter control unit 31b, and the light amount control unit 31c.
The AUTO_IRIS detection value from the detection unit 15 is supplied to the auto iris control unit 31. In accordance with the AUTO_IRIS detection value, the gain control unit 31a, the shutter control unit 31b, and the light amount control unit 31c each calculate an exposure adjustment value.
The gain control unit 31a supplies a gain value as an exposure adjustment value to the analog video processing unit 4 and controls the gain to be given to the captured video signal.
The shutter control unit 31b supplies an electronic shutter control value as an exposure adjustment value to the timing generator 7, and adjusts the shutter speed (exposure time within the frame period).
The light amount control unit 31c supplies an aperture driving signal as an exposure adjustment value to the lens driving unit 6 to execute the incident light amount adjustment by the aperture mechanism.

The stationary system white correction control unit 32 and the activation system white correction control unit 33 perform white balance adjustment control.
The stationary white correction control unit 32 is supplied with the ATW detection value from the detection unit 15. The stationary white correction is a steady white automatic tracking correction function. The stationary white correction control unit 32 always calculates a white balance correction value according to the ATW detection value and supplies the white balance correction value to the digital video processing unit 11 to execute white balance correction.

  The activation white correction control unit 33 is supplied with the AWB detection value from the detection unit 16. The startup system white correction is a function that performs white balance correction non-stationarily such as at startup or upon user request. The activation system white correction control unit 33 calculates a white balance correction value according to the AWB detection value when necessary, and supplies the white balance correction value to the digital video processing unit 11 to execute white balance correction.

The flare control unit 34 performs flare correction control. The flare control unit 34 calculates a flare correction value based on the FLARE detection value supplied from the detection unit 14. Then, the flare correction value is supplied to the digital video processing unit 11 to execute the flare correction.
The black control unit 35 performs auto black balance adjustment control. The black control unit 35 calculates a black balance correction value based on the ABB detection value supplied from the detection unit 14. Then, the black balance correction value is supplied to the analog video processing unit 4 to execute black balance correction.

The black shading control unit 36 performs auto black shading adjustment control. The black shading control unit 36 calculates a black shading correction value based on the ABS detection value supplied from the detection unit 14. Then, the black shading correction value is supplied to the analog video processing unit 4 to execute black shading correction.
The white shading control unit 37 performs auto white shading adjustment control. The white shading control unit 37 calculates a white shading correction value based on the AWS detection value supplied from the detection unit 14. Then, the white shading correction value is supplied to the digital video processing unit 11 to execute white shading correction.

The knee control unit 38 controls the knee correction operation. The knee control unit 38 is supplied with the DCC detection value from the detection unit 15. The knee control unit 38 calculates a knee correction value based on the DCC detection value and supplies the knee correction value to the gamma / knee circuit 13 to execute knee correction processing.
The color detection / zebra output unit 39 performs auto hue processing control. The color detection / zebra output unit 39 is supplied with an AUTO_HUE detection value from the detection unit 15, thereby performing detail detection on a specific color or color detection of a target for color adjustment. Also outputs a zebra signal.
The message control unit 40 performs alarm output control in a low luminance state. The message control unit 40 is supplied with the LOW_LIGHT detection value from the detection unit 15, and the message control unit 40 determines whether or not the luminance of the entire screen has reached a certain level. If the luminance level is insufficient as a determination result, alarm message output control is performed.

[2. Execution procedure of automatic processing function]

For example, an execution procedure of various automatic processes in the imaging apparatus 1 having the above configuration will be described.
As described above, the detection units 14, 15, and 16 are provided as detection units that obtain detection values as luminance information and color information for automatic processing.
In this example, the detection unit 14 performs detection according to the first type automatic processing function, the detection unit 15 performs detection according to the second type automatic processing function, and the detection unit 16 performs the third type automatic processing function. Detection according to the processing function is performed.

In this example, the first type automatic processing function is a flare processing function, a black balance processing function, an auto black shading processing function, and an auto white shading processing function. Evaluation value detection corresponding to these is performed by the detection unit 14.
The second type of automatic processing function is a stationary auto white balance processing function, a dynamic contrast control processing function, a low light alarm processing function, an auto iris processing function, and an auto hue processing function. The detection unit 15 performs evaluation value detection according to these.
The third type automatic processing function is a start-up auto white balance processing function, and the detection unit 16 performs evaluation value detection for this purpose.

The automatic processing function is controlled according to the flow shown in FIG.
In step ST1, an imaged video signal is obtained by processing of the image sensor unit 3, the analog video processing unit 4, and the A / D conversion unit 5, and this is input to the DSP 10.
As steps ST2, ST3, ST4, the detection units 14, 15, 16 perform evaluation value detection corresponding to the automatic processing functions as the first type, the second type, and the third type, respectively.
As step ST5, the detection values from the detection units 14, 15, 16 are supplied to the control function units of the controller 30 as described above.
As step ST6, each control function unit of the controller 30 calculates a correction value according to the detection value as described above. The lens driving unit 6, timing generator 7, analog video processing unit 4, digital video processing unit 11, gamma / knee circuit 13, and message output are controlled. As a result, each automatic processing function is executed.

Here, the processing of steps ST2, ST3, ST4, that is, the detection units 14, 15, and 16 respectively perform evaluation value detection on the captured video signals at different processing stages, so that each automatic processing function is appropriately executed. Will be.
This will be described for each of the automatic processing functions.

・ Flare processing function (type 1)
As the FLARE detection value for correcting the flare, the luminance of each color of R / G / B is obtained by the detection unit 14. For this flare processing, it is appropriate to use a detection value before passing through various image quality processes in the DSP 10.
Since the flare affects the entire area of the CCD or the like as the image sensor section 3, it is necessary to always perform correction in the area of the image frame range A1 of the imaged video signal regardless of the enlargement of the video. At 14, the FLARE detection value is obtained.

・ Black balance processing function (type 1)
In order to correct black, the values of RG and BG are obtained as ABB detection values. Also in this case, since it is necessary to always perform correction in the image frame range A1 as the entire imaging range, the detection unit 14 obtains the ABB detection value.

-Auto black shading processing function (type 1)
In order to correct black shading, R, G, and B values are obtained as ABS detection values. Also in this case, since it is necessary to always perform correction in the image frame range A1 as the entire imaging range, the detection unit 14 obtains the ABS detection value.

・ Auto white shading processing function (type 1)
In order to correct white shading, R, G, and B values are obtained as AWS detection values. Also in this case, since it is necessary to always perform correction in the image frame range A1 as the entire imaging range, the detection unit 14 obtains the AWS detection value.
However, since it is operated only at the time of maintenance, there is no need to do anything particularly regarding this function during normal operation including enlargement.

-Steady state auto white balance processing function (type 2)
This is a white automatic tracking automatic processing function that operates constantly. For this, the values of RG and BG are obtained as ATW detection values.
It is appropriate to use the detected value before passing through various image quality processes in the DSP 10. For example, when the enlargement circuit 12 is used for double enlargement, for example, it is appropriate to detect the enlargement range A3 in FIG. 2B. If the image frame range A1 is the target, the color outside the enlarged image is detected and corrected, which causes a problem that the enlarged image is not appropriately white.
Therefore, the detection unit 15 obtains the ATW detection value for the captured video signal after the enlargement process.

-Dynamic contrast control processing function (type 2)
In order to perform contrast automatic correction control mainly for securing a gradation in a high-luminance portion, a luminance peak value is obtained as a DCC detection value.
For example, when the enlargement circuit 12 is used for double enlargement, it is appropriate to detect the enlargement range A3 in FIG. If the image frame range A1 is the target, the peak luminance outside the enlarged image may be detected and corrected, and an appropriate gradation of the high luminance portion cannot be obtained.
Therefore, the detection unit 15 obtains the DCC detection value for the captured video signal after the enlargement process and before the gamma correction.

・ Low light alarm processing function (type 2)
This is an alarm function when the brightness of the entire screen does not reach a certain level. The luminance average value of the entire screen is obtained as the LOW_LIGHT detection value.
For example, when the enlargement circuit 12 is used for double enlargement, it is appropriate to detect the enlargement range A3 in FIG. If the image frame range A1 is the target, the average luminance value is detected including the outside of the enlarged image. For example, even if the brightness of the enlarged image is secured to a certain level, a low light alarm may occur if the outside brightness is low.
Therefore, the detection unit 15 obtains a LOW_LIGHT detection value for the captured image signal after the enlargement process.

・ Auto iris processing function (type 2)
Correction control is performed so that an appropriate exposure is obtained by an aperture mechanism, an electronic shutter, and gain adjustment. For this reason, the luminance average value and the peak value of the entire screen are obtained as the AUTO_IRIS detection value.
In this case, it is appropriate to use the detection value before passing through the image quality process circuit such as the gamma / knee circuit 13 in the DSP 10. For example, when the enlargement circuit 12 is used for double enlargement, it is appropriate to detect the enlargement range A3 in FIG. If the image frame range A1 is targeted, the luminance average value and the peak value are detected including the outside of the enlarged image. For example, when the average brightness outside the enlarged image is low, the AUTO_IRIS detection value shifts in the direction of insufficient light quantity, and the enlarged image becomes brighter than necessary.
Therefore, the detection unit 15 obtains the AUTO_IRIS detection value for the captured video signal before the gamma correction and after the enlargement process.

・ Auto-hue processing function (type 2)
In order to add detail to a specific color or perform color adjustment, target color detection is performed. In this case, R, G, and B luminance values are obtained as AUTO_HUE detection values.
It is appropriate to use the detected value before passing through an image quality process circuit such as the gamma / knee circuit 13 in the DSP 10. For example, when the enlargement circuit 12 is used for double enlargement, it is appropriate to detect the enlargement range A3 in FIG. If the image frame range A1 is the target, a larger area is detected than the color detection area when not enlarged. Regardless of enlargement / non-expansion, the area for color detection is required to be a constant area. Therefore, the detection unit 15 obtains the AUTO_HUE detection value for the captured video signal before the gamma correction and after the enlargement process.

・ Start-up auto white balance processing function (type 3)
Correct white. However, this is not a steady white correction.
In order to perform correction so as to be white even after the gamma correction, the detection unit 16 obtains an AWB detection value for the captured video signal after passing through the gamma / knee circuit 13.

As described above, it is appropriate that each automatic processing function performs evaluation value detection at an appropriate stage according to the contents of the processing function.
Therefore, in this example, the detection units 14, 15, and 16 perform evaluation value detection for the automatic processing functions of the first type, the second type, and the third type classified as described above. This ensures that each automatic processing function functions properly.
Therefore, regardless of whether the enlargement process is executed or not, each function is appropriately exhibited, and a high-quality captured video signal can be output.
As can be seen from the description of each function, what is classified as the first type is an automatic processing function that is suitable for detecting an evaluation value for an image frame range obtained by the image sensor unit 3. In addition, what is classified as the second type is an automatic processing function that is suitable for subsequent display output by detecting an evaluation value for the image frame range of the enlarged portion at the time of enlargement. Further, it is an appropriate automatic processing function to be classified into the third type to detect an evaluation value for a captured video signal after gamma correction.

[3. Second Configuration Example of Imaging Device]

FIG. 6 shows a second configuration example of the imaging apparatus 1. The same parts as those in FIG. 1 are denoted by the same reference numerals, and description thereof is omitted.
The example of FIG. 6 is different from that of FIG. 1 in that the detection units 14 and 15 both input the captured video signal of the preceding stage of the enlargement circuit 12.
The enlargement control unit 41 of the controller 30 also controls the area setting unit 18.

  The detection unit 14 is the same as that in the configuration of FIG. 1, but the detection unit 15 corresponding to the second type automatic processing function obtains a detection value for the image frame range after the enlargement by the enlargement circuit 12. Is appropriate. Therefore, the area setting unit 18 switches the detection target in the detection unit 15 according to the control of the enlargement control unit 41.

FIGS. 4A and 4C are processing examples in this case.
When the enlargement instruction signal Dex is generated in Step F101 of FIG. 4A, the enlargement control unit 41 performs video enlargement control on the DSP 10 in accordance with the enlargement instruction signal Dex in Step F102.
On the DSP side, when there is a control signal input from the enlargement control unit 41 in step F210 as shown in FIG. 4C, enlargement setting is performed by the enlargement circuit 12 in step F211. In step F212, the area setting unit 18 changes the setting of the detection target range in the detection unit 15. For example, when the enlargement process is not performed, the detection range that has been detected by the detection unit 15 for the image frame range A1 (effective detection area A2) in FIG. The setting is changed to target A3 (effective detection area A4).

As a result, the captured video signal input to the enlargement circuit 12 is subsequently enlarged in the set state, and the detection unit 15 sets a detection value for the enlarged image frame range. Will be able to get.
Therefore, as in the case of the configuration example of FIG. 1, the effects of the automatic processing functions are appropriately exhibited.

[4. Third Configuration Example of Imaging Device]

FIG. 7 shows a third configuration example of the imaging apparatus 1. The same parts as those in FIG. 1 are denoted by the same reference numerals, and description thereof is omitted.
The example of FIG. 7 is the same as that of FIG. 6 in that both the detection units 14 and 15 are configured to input the imaged video signal in the previous stage of the enlargement circuit 12, but the enlargement circuit 12 has the enlargement setting. Accordingly, the area setting unit 18 is also controlled.
That is, in this example, the target range of the detection unit 15 is switched inside the DSP 10.

4A and 4D are processing examples in this case.
When the enlargement instruction signal Dex is generated in Step F101 of FIG. 4A, the enlargement control unit 41 performs video enlargement control on the DSP 10 in accordance with the enlargement instruction signal Dex in Step F102.
On the DSP side, when there is a control signal input from the enlargement control unit 41 in step F220 as shown in FIG. 4D, enlargement setting is performed by the enlargement circuit 12 in step F221. In step F222, the enlargement circuit 12 instructs the area setting unit 18 according to the enlargement setting. In step F223, the area setting unit 18 changes the setting of the detection target range in the detection unit 15. For example, when the enlargement process is not performed, the detection range that has been detected by the detection unit 15 for the image frame range A1 (effective detection area A2) in FIG. The setting is changed to target A3 (effective detection area A4).

As a result, the captured video signal input to the enlargement circuit 12 is subsequently enlarged in the set state, and the detection unit 15 sets a detection value for the enlarged image frame range. Will be able to get.
Therefore, as in the case of the configuration example of FIGS. 1 and 6, the effects of the automatic processing functions are appropriately exhibited.

  Although the embodiment has been described above, the present invention is not limited to the example described in the embodiment, and various modifications can be considered. For example, other types of automatic processing functions may be considered, and evaluation value detection may be performed at an appropriate video signal stage according to the function.

It is a block diagram of the imaging device of a 1st embodiment of the present invention. It is explanatory drawing of the expansion process and detection target range of embodiment. It is explanatory drawing of the detection of the pixel unit of embodiment. It is a flowchart of control at the time of enlargement processing switching of an embodiment. It is a flowchart of the automatic processing procedure of an embodiment. It is a block diagram of the imaging device of a 2nd embodiment. It is a block diagram of the imaging device of a 2nd embodiment.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 Imaging device, 2 Imaging optical system, 3 Imaging element part, 4 Analog image processing part, 5 A / D conversion part, 6 Lens drive part, 7 Timing generator, 10 DSP 11 Digital image processing part, 12 Expansion circuit, 13 Gamma / Knee circuit, 14, 15, 16 detector, 17, 18, 19 area setting unit, 30 controller, 41 enlargement control unit

Claims (4)

An imaging unit that performs photoelectric conversion of incident light and obtains an imaged video signal;
An enlargement processing unit that can output the imaged video signal obtained by the imaging unit as it is and extract a part of the range from the image frame range of the imaged video signal and perform video enlargement processing; ,
A first area setting unit for setting an effective detection area of the captured video signal;
A second area setting unit for setting an effective detection area of the captured video signal output from the enlargement processing unit;
For the effective detection area of the captured video signal set by the first area setting unit, the flare processing function, the black balance processing function, and the auto black shading processing function are all or one of the first type automatic processing functions. A first detection unit for obtaining a detection value for the processing function of the unit;
For the effective detection area of the picked-up video signal output from the enlargement processing unit set by the second area setting unit, as an automatic processing function of the second type, an auto white balance processing function, a dynamic contrast control process A second detection unit that obtains detection values for all or a part of the functions, the low light alarm processing function, the auto iris processing function, and the auto hue processing function;
A third area setting unit configured to set an effective detection area of the captured video signal output from the enlargement processing unit and subjected to gamma processing and knee processing;
A third detection unit that obtains a detection value for an auto white balance processing function as a third type automatic processing function for the effective detection area of the captured video signal set by the third area setting unit; ,
A control unit that performs operation control of the automatic processing function of the first type, the second type , and the third type based on the detection values detected by the first, second , and third detection units;
Based on the control of the control unit, one or more processing units for executing the first type, second type and third type automatic processing functions;
An imaging apparatus comprising: The imaging apparatus according to claim 1 , wherein the second area setting unit is changed in setting by a control signal that controls the enlargement processing unit. The imaging apparatus according to claim 1 , wherein the second area setting unit is changed in setting according to an enlargement setting of the enlargement setting processing unit. A first setting step for setting an effective detection area of a captured video signal obtained by performing photoelectric conversion of incident light;
A second setting step of setting an effective detection area of any one of the imaged video signal and an imaged video signal obtained by extracting and enlarging a partial range of the imaged video signal;
For the effective detection area set in the first setting step, as a first type of automatic processing function, the flare processing function, black balance processing function, auto black shading processing function for all or part of processing functions A first detection step for obtaining a detection value;
Targeting the effective detection area set in the second setting step above The second type of automatic processing functions are auto white balance processing function, dynamic contrast control processing function, low light alarm processing function, auto iris processing function, auto hue processing A second detection step for obtaining detection values for all or part of the processing functions;
One of the imaged video signal and the imaged video signal expanded by extracting a part of the imaged video signal, and an effective detection area of the imaged video signal after gamma processing and knee processing A third setting step to set;
A third detection step for obtaining a detection value for an auto white balance processing function as a third type automatic processing function for the effective detection area of the imaged video signal set in the third setting step;
An automatic processing step for executing the first type, second type, and third type automatic processing functions based on the detection values detected in the first, second, and third detection steps;
An imaging operation processing method in which is performed.

Images