JP5353499B2 - Imaging device - Google Patents

Description

  The present invention relates to an imaging apparatus.

  A feature amount representing the feature of the image data is extracted from the image data generated based on the optical image to be photographed, and it is determined whether or not the feature amount satisfies a predetermined determination condition. When it is determined that the determination condition is satisfied, there is an apparatus that controls an imaging system by selecting an imaging condition at the time of exposure suitable for an imaging target that satisfies the determination condition (see Patent Document 1).

JP 2002-10135 A

  However, if the feature amount frequently fluctuates in the vicinity of the boundary of whether or not the determination condition is satisfied, there is a possibility that the selected imaging condition may also fluctuate frequently and the determination result of the imaging condition becomes unstable. In particular, if the imaging conditions frequently fluctuate even though the same imaging target is continuously photographed, the user may be misunderstood that the reliability for the selected imaging conditions is low.

  The present invention has been made in consideration of such circumstances, and has been made to solve the above-described problems, and an object of the present invention is to provide an imaging apparatus that can reduce fluctuations in imaging conditions in the vicinity of the boundary of determination conditions. is there.

In order to solve the above-described problem, an imaging apparatus according to the present invention is obtained by imaging a subject and controlling an imaging unit that generates image data according to selected imaging conditions, and imaging by the imaging unit. based was on the information criterion, a determination unit for selecting the imaging condition, based on the information obtained by imaging by the imaging unit, and calculates the amount of change in an imaging object, wherein selected by the determination unit An analysis unit that determines whether or not there is a change amount of the imaging target within an allowable range that is allowed as a change amount that does not change the imaging condition, and the change amount of the imaging target is within the allowable range by the analysis unit. A control unit that changes the determination criterion to a value that does not change the imaging condition when the image capturing condition is determined to be present, the control unit generates a luminance color difference signal based on the image data, and A change amount of the imaging target based on information obtained by multiplying a difference between the plurality of luminance color difference signals obtained at different time intervals by a different weighting factor for each time interval. It is characterized by including the 3rd determination part which determines whether it is inside.

  According to the present invention, it is possible to reduce the fluctuation of the imaging condition in the vicinity of the boundary of the determination condition.

It is a block diagram which shows an example of a structure of the imaging device which concerns on one Embodiment of this invention. It is a block diagram which shows an example of a structure of CPU contained in the imaging device which concerns on one Embodiment of this invention. It is a block diagram which shows an example of a structure of the scene analysis part contained in the imaging device which concerns on one Embodiment of this invention. It is the schematic explaining an example of the method of the brightness | luminance color difference signal in the imaging device which concerns on one Embodiment of this invention. It is a reference figure for explaining an example of a scene judging method of an imaging device concerning one embodiment of the present invention. It is a reference figure for explaining an example of a scene judging method of an imaging device concerning one embodiment of the present invention.

Hereinafter, an embodiment of an imaging apparatus according to the present invention will be described with reference to the drawings. FIG. 1 is a schematic diagram showing a configuration of an imaging apparatus 1 according to an embodiment of the present invention.
As illustrated in FIG. 1, the imaging device 1 according to the present embodiment includes an imaging unit 10, a CPU (Central processing unit) 11, an operation unit 12, an image processing unit 13, a display unit 14, a storage unit 15, A buffer memory unit 16, a communication unit 17, and a bus 18 are provided.
In addition, the imaging apparatus 1 according to the present embodiment determines what the imaging target is based on the analysis result of the CPU 11 on the image data obtained by imaging, the position information indicating the position of the lens controlled by the imaging unit 10, and the like. And a scene determination function for determining an imaging condition suitable for the determined imaging target. The scene determination function is, for example, a predetermined imaging target (hereinafter referred to as a scene) such as “macro”, “landscape”, “night view”, “backlight”, “portrait”, etc. This is a function of determining a scene suitable for an imaging target to be imaged by the imaging apparatus 1 from now on. Then, the imaging apparatus 1 controls the imaging system in accordance with predetermined imaging conditions suitable for imaging each scene determined by the scene determination function.

The imaging unit 10 includes an optical system 101, an imaging element 102, an A / D (Analog / Digital) conversion unit 103, a lens driving unit 104, and a photometric element 105, and sets imaging conditions (for example, an aperture value). , Exposure value, and the like), the optical image by the optical system 101 is formed on the image sensor 102, and image data based on the optical image converted into a digital signal by the A / D conversion unit 103 is generated. .
The optical system 101 includes a zoom lens 101a, a focus adjustment lens (hereinafter referred to as an AF (Auto Focus) lens) 101b, and a spectral member 101c. The optical system 101 guides the optical image that has passed through the zoom lens 101a, the AF lens 101b, and the spectral member 101c to the light receiving surface of the image sensor 102. The optical system 101 guides the optical image separated by the spectroscopic member 101 c between the AF lens 101 b and the image sensor 102 to the light receiving surface of the photometric element 105.
The image sensor 102 includes, for example, 25 (5 × 5) photoelectric conversion surfaces (hereinafter referred to as divided regions), converts an optical image formed on the light receiving surface into an electric signal, and performs A / D. The data is output to the conversion unit 103.
Further, the image sensor 102 causes the storage medium 20 to store image data obtained when a shooting instruction is received via the operation unit 12 as shot image data of a shot still image. On the other hand, the imaging element 102 outputs continuously obtained image data to the CPU 11 and the display unit 14 as through image data in a state where no imaging instruction is received via the operation unit 12.

The A / D converter 103 digitizes the electronic signal converted by the image sensor 102 and outputs image data that is a digital signal.
The lens driving unit 104 includes a detecting unit that detects a zoom position that represents the position of the zoom lens 101a and a focus position that represents the position of the AF lens 101b, and a driving unit that moves the zoom lens 101a and the AF lens 101b. Further, the lens driving unit 104 outputs the zoom position and the focus position detected by the detection unit to the CPU 11. Further, when a drive control signal is generated by the CPU 11 based on these pieces of information, the drive means of the lens drive unit 104 controls the positions of both lenses according to this drive control signal.
The photometric element 105 forms an optical image separated by the spectroscopic member 101 c on the light receiving surface, obtains a luminance signal representing the luminance distribution of the optical image, and outputs it to the A / D conversion unit 103. The photometric element 105 includes, for example, 25 (5 × 5) photoelectric conversion surfaces (hereinafter referred to as divided regions), and the luminance signal for each divided region is transmitted via the A / D conversion unit 103. It outputs to CPU11.

The operation unit 12 includes, for example, a power switch, a shutter button, and other operation keys. The operation unit 12 receives a user operation input when operated by the user and outputs the operation input to the CPU 11.
The image processing unit 13 refers to the image processing conditions stored in the storage unit 15 and performs image processing on the image data recorded in the storage medium 20.
The display unit 14 is, for example, a liquid crystal display, and displays image data obtained by the imaging unit 10, an operation screen, and the like.
The storage unit 15 stores determination conditions that are referred to when the CPU 11 determines a scene, imaging conditions associated with each scene determined by the scene determination, and the like.
The buffer memory unit 16 temporarily stores image data and the like captured by the imaging unit 10.

The communication unit 17 is connected to a removable storage medium 20 such as a card memory, and performs writing, reading, or erasing of information on the storage medium 20.
The bus 18 is connected to the imaging unit 10, the CPU 11, the operation unit 12, the image processing unit 13, the display unit 14, the storage unit 15, the buffer memory unit 16, and the communication unit 17, and outputs from each unit. The transferred data is transferred.
The storage medium 20 is a storage unit that is detachably connected to the imaging device 1 and stores, for example, image data generated (captured) by the imaging unit 10.

Next, the CPU 11 will be described with reference to FIG. FIG. 2 is a block diagram illustrating an example of the CPU 11.
As shown in FIG. 2, the CPU 11 is a main control unit 110, a through image processing unit 111, a scene analysis unit 112, and a scene determination unit 113 as functional units that function as components of the CPU 11 by executing a program. With.
When the luminance signal for each divided area obtained by the photometric element 105 is input, the main control unit 110 calculates a luminance value (hereinafter referred to as a Bv (Brightness value) value) of each divided area based on the luminance signal. To do. Further, the main control unit 110 obtains the zoom position of the zoom lens 101 a from the lens driving unit 104.
Further, the main controller 110 continuously obtains Bv values {Bv (t−1), Bv (t), Bv (t + 1)...} And a zoom position {ZP (t− 1), ZP (t), ZP (t + 1)...} Are output to the scene analysis unit 112.
Further, the main control unit 110 averages the sum of the Bv values of all the divided areas based on the Bv values (Bv1, Bv2,..., Bv25) obtained for each divided area of the photometric element 105. BvMean, the maximum luminance value BvMax that is the maximum among the Bv values of all the divided regions, and the minimum luminance value BvMin that is the minimum are calculated and output to the scene determination unit 113.

  When the through image data obtained by the image sensor 102 is input, the through image processing unit 111 calculates a luminance color difference signal YUV based on the through image data. The through image processing unit 111 outputs the luminance and color difference signals YUV {YUV (t−1), YUV (t), YUV (t + 1)...} Continuously obtained at predetermined intervals to the scene analysis unit 112. To do. The luminance color difference signal YUV includes luminance information Y indicating luminance, difference information U (Cb) that is a difference between the luminance information Y and a blue component, and difference information V (that is a difference between the luminance information Y and a red component. Cr).

The scene analysis unit 112 receives the Bv value and the zoom position from the main control unit 110 and the luminance color difference signal YUV from the through image processing unit 111. The scene analysis unit 112 calculates the amount of change of the imaging target in the image data based on the information obtained by imaging by the imaging unit 10, and determines whether or not the amount of change is within an allowable range. Here, the permissible range refers to a range in which if there is a change in image data as a whole and attention is paid to an imaging target included in the image data, the imaging target is considered not to have changed so much. Specifically, it shows the fluctuation amount when the determination condition is changed so that the scene selected at that time is not changed by the scene determination function. In other words, the allowable range is a range in which the imaging target is not changed even if the information obtained by imaging changes so that the scene selected by the scene determination function is not changed.
Hereinafter, the scene analysis unit 112 will be described in detail with reference to FIG. FIG. 3 is a block diagram illustrating a configuration example of the scene analysis unit 112.

As shown in FIG. 3, the scene analysis unit 112 includes a first determination unit 112a, a second determination unit 112b, a third determination unit 112c, a pattern analysis unit 112d, a comprehensive determination unit 112e, and a first buffer 112f. , A second buffer 112g and a third buffer 112h.
The first determination unit 112a receives Bv (t) and the zoom position ZP (t) obtained by the main control unit 110 at the current time (t) and is temporarily stored in the first buffer 112f. Bv (t-1) and zoom position ZP (t-1) before the frame are received.
The first buffer 112f has Bv values {Bv (t−1), Bv (t)...} And zoom positions {ZP (t−1), ZP (t) continuously input from the main control unit 11. ... Are received, and Bv (t-1) one frame before and zoomed together with the timing of Bv (t) and zoom position ZP (t) output from the main control unit 11 to the first determination unit 112a. The position ZP (t−1) is output to the first determination unit 112a.
The first determination unit 112a is not limited to this configuration, and a buffer corresponding to the first buffer 112f may be built in the first determination unit 112a. For example, when Bv (t) is input, the first determination unit 112a sequentially stores Bv (t) in a built-in buffer, and the past Bv (t− 1) is read from the buffer. Thereby, the first determination unit 112a obtains both the input Bv (t) and the read B (t−1).

Further, the first determination unit 112a calculates a difference between the data at the current time (t) and the data at the time (t-1) one frame before, and calculates the difference between the current and past Bv values [Bv ( Based on (t-1) −Bv (t)], it is determined whether or not the difference is larger than a predetermined threshold value Th1.
For example, based on the determination result with the threshold value Th1 as a reference, the first determination unit 112a determines that it is in the fine movement state when the difference in the Bv value is equal to or less than the threshold value Th1, and sets the first scene change determination value JDG1 = 0. obtain. On the other hand, based on the determination result, the first determination unit 112a determines that the difference is greater than the threshold value Th1 and is in a fluctuating state, and obtains the first scene change determination value JDG1 = 1. This determination is shown in the following reference formula.

(Reference formula 1)
If (X (t) -X (t-1)>Th1; threshold)
JDG1 = 1 (non-stationary) else JDG1 = 0 (to the second and third determination units)

  Thereby, the first determination unit 112a is based on the difference between the Bv value at the time (t) and the Bv value at the time (t-1) one frame before, and the permissible range in which the difference is recognized as a fine movement state. It is judged whether it is in. That is, the first determination unit 112a calculates the change amount of the imaging target in the image data based on the Bv value, and when the obtained change amount (difference in the Bv value) is within the allowable range (threshold value Th1 or less), the fine movement state If the allowable range is exceeded (greater than the threshold value Th1), it is determined that the state is in a fluctuating state.

In addition, the first determination unit 112a calculates a difference [ZP (t) −ZP (t−1)] between the current and past zoom positions, and whether the difference is greater than a predetermined threshold Th′1. Judge whether or not. In the same manner as in the case of the Bv value described above, the first determination unit 112a determines, based on the determination result, that the difference is equal to or smaller than the threshold value Th′1, and that the difference is greater than the threshold value Th′1. In this case, it is determined that the state is a fluctuation state.
When both the determination result based on the difference in the Bv value and the determination result based on the difference in the zoom position are in a fine movement state, the first determination unit 112a sends the first scene change determination value “JDG1 = 0” to the general determination unit 112d. Output. On the other hand, the first determination unit 112a sets the first scene change determination value “JDG1 = 1” when at least one of the determination result based on the difference in the Bv value or the determination result based on the difference in the zoom position is in a changing state. It outputs to the comprehensive determination part 112d.

Note that the fine movement state refers to a state in which the imaging device 1 is slowly panned, for example, and the angle of view varies very little. That is, it means a state in which the state of the subject in the through image data imaged by the imaging device 1 hardly changes and is within an allowable range equal to the stationary state.
On the other hand, the fluctuation state refers to a state where the fluctuation of the angle of view exceeds an allowable range in which it is determined that the movement is fine. That is, the state change of the subject in the through image data captured by the imaging device 1 is a non-still state that is no longer stationary, and the determination result by the scene determination unit 113 is also highly likely to change. Say.
Hereinafter, the fine movement state is regarded as a stationary state, hereinafter referred to as a stationary state, and is represented by a first scene change determination value JDG = “0”. On the other hand, the fluctuation state is referred to as a non-still state, and is represented by a first scene change determination value JDG = “1”.

The luminance / color difference signal YUV {YUV (t−1), YUV (t), YUV (t + 1)...} Obtained by the through image processing unit 111 is continuously input to the pattern analysis unit 112d.
The pattern analysis unit 112d uses the luminance color difference signals YUV {YUV (t−1), YUV (t), YUV (t + 1)...} According to a predetermined combination among the analysis patterns 1 to 7. Analysis results Y {Y (t−1), Y (t), Y (t + 1)...} Are calculated and output to the second determination unit 112b and the third determination unit 112c. In addition, the pattern analysis unit 112d temporarily stores the obtained pattern analysis result in the primary storage unit 112f.
Here, an analysis pattern used by the pattern analysis unit 112d will be described with reference to FIG. FIG. 4 is a schematic diagram for explaining an analysis pattern of the luminance color difference signal YUV.

  FIGS. 4A to 4G show seven examples of analysis patterns of the pattern analysis result Y based on the luminance color difference signal YUV. In addition, as this analysis pattern, a plurality of combinations are possible according to the purpose of use of the pattern analysis result Y from all the divided areas divided into 25 in the image sensor 102. Further, the divided luminance color difference signal {y (1,1), y (1,2)... Y (5,5)} of the luminance color difference signal YUV of each divided region represents the position of the divided region on the matrix. They are distinguished by numbers in parentheses.

FIG. 4A shows an analysis pattern Y1 in which the sum of the divided luminance color difference signals {y1, 1), y (1, 2)... Y (5, 5)} is calculated as the pattern analysis result Y.
FIG. 4B shows the pattern analysis result of the sum of the divided luminance color difference signals {y (2, 2), y (2, 3)... Y (4, 4)} in the central portion of the divided areas. This is an analysis pattern Y2 calculated as Y.
FIG. 4C shows a pattern analysis of the sum of the divided luminance color difference signals {y (1,1), y (1,2)... Y (4,4)} in the peripheral edge portion of the divided area. This is an analysis pattern Y3 calculated as the result Y.
FIG. 4D shows the sum of the divided luminance color difference signals {y (1,1), y (2,1)... Y (5,1)} at the left end of the divided area and the right end. This is analysis pattern 4 in which the difference from the sum of the divided luminance color difference signals {y (1,5), y (2,5)... Y (5,5)} is calculated as the pattern analysis result Y. The pattern 4 includes the sum of the divided luminance color difference signals {y (1,1), y (1,2)... Y (1,5)} at the upper end and the right end of the divided area. The difference from the sum of the divided luminance color difference signals {y (5,1), y (5,2)... Y (5,5)} is also calculated as the pattern analysis result Y.

FIG. 4E shows divided luminance color difference signals {y (1,1), y (1,2), y (2,1)... Y (4,5) at four corners in the divided area. , Y (5,4), y (5,5)} is an analysis pattern Y5 calculated as the pattern analysis result Y.
FIG. 4F shows the sum of the divided luminance color difference signals {y (3, 2), y (3, 3), y (3,4)}} in the central horizontal direction portion of the divided areas and the central vertical direction. This is an analysis pattern 6 in which the difference from the sum of the partial divided luminance color difference signals {y (2,3), y (3,3), y (4,3)} is calculated as the pattern analysis result Y.
FIG. 4G shows the sum of the divided luminance color difference signals {y (2,1)... Y (2,5)} in the first horizontal portion of the divided regions, and the second horizontal portion. Sum of divided luminance color difference signals {y (4,1)... Y (4,5)}, divided luminance color difference signals {y (1,2). )} And an analysis pattern 7 for calculating the pattern analysis result Y based on the combination of the sums of the divided luminance color difference signals {y (1,4)... Y (5,4)} in the second vertical direction portion. It is.

Here, returning to FIG. 3, the pattern analysis unit 112d will be described.
The pattern analysis unit 112d receives the luminance color difference signal YUV (t) obtained by the through image processing unit 111 at the current time (t), and the luminance one frame before temporarily stored in the second buffer 112g. The color difference signal YUV (t−1) is received.
In addition, the pattern analysis unit 112d performs the luminance color difference signal YUV {YUV (t−1), YUV (t), YUV (t + 1)...} According to a predetermined combination among the analysis patterns 1 to 7 described above. , The pattern analysis result Y {Y (t−1), Y (t), Y (t + 1)...} Is calculated and output to the second determination unit 112b and the third determination unit 112c.
Further, the pattern analysis unit 112d temporarily stores the obtained pattern analysis result Y in the third buffer 112h.

The second buffer 112g receives the luminance color difference signals YUV {YUV (t−1), YUV (t), YUV (t + 1)...} That are continuously input from the through image processing unit 111, and the through image processing unit. In synchronization with the timing of YUV (t) output from 111 to the pattern analysis unit 112d, YUV (t-1) one frame before is output to the pattern analysis unit 112d.
The third buffer 112h receives the pattern analysis result Y {Y (t−1), Y (t), Y (t + 1)...} Continuously input from the pattern analysis unit 112d, and receives the pattern analysis result 112d from the pattern analysis unit 112d. Along with the timing of the pattern analysis result Y (t) output to the third determination unit 112c, a plurality of pattern analysis results Y {Y (t-1), Y (t-2) past the time (t). , Y (t-3), Y (t-4)} are output to the third determination unit 112c.
Similar to the first buffer 112f, the second buffer 112g may be included in the pattern analysis unit 112d, and the third buffer 112h may be included in the third determination unit 112c.

The second determination unit 112b receives the pattern analysis result Y (t) obtained by the pattern analysis unit 112d, and the pattern analysis result Y (t−1) one frame before temporarily stored in the second buffer 112g. ).
The second determination unit 112b calculates a difference [Y (t) −Y (t−1)] between the current and past pattern analysis results Y, and whether or not the difference is larger than a predetermined threshold Th2. Judging. The second determination unit 112b obtains the pattern analysis result obtained at the same timing (time (t) and time (t-1)) as when the Bv value and zoom position used in the first determination unit 112b are detected. It is assumed that the difference of Y is calculated.
The second determination unit 112b determines that the frame is stationary when the difference between the pattern analysis results Y is equal to or less than the threshold Th2 based on the determination result obtained by comparing the difference between the pattern analysis results Y for one frame and the threshold Th2. Thus, the second scene change determination value JDG2 = 0 is obtained. On the other hand, based on the determination result, when the difference between the pattern analysis results Y is greater than the threshold value Th2, the second determination unit 112b determines that the state is non-stationary and obtains the second scene change determination value JDG2 = 1. This determination is shown in the following reference formula.

(Reference formula 2)
If (Y (t) -Y (t-1)>Th2; threshold)
JDG2 = 1 (non-stationary) else JDG2 = 0 (to the third determination unit)

  In this way, the second determination unit 112b determines that 1 (t) is based on the pattern analysis result Y (t) at time (t) and the pattern analysis result Y (t-1) at time (t-1) one frame before. It is determined whether or not the difference between the pattern analysis results Y for different frames is within an allowable range in which it is recognized that the frame is stationary. That is, the second determination unit 112b calculates the change amount of the imaging target in the image data based on the pattern analysis result Y obtained from the luminance color difference signal, and the obtained change amount (difference in the pattern analysis result Y) is within the allowable range. If it is (threshold value Th2 or less), it is determined that it is a stationary state, and if it exceeds the allowable range (greater than the threshold value Th2), it is determined that it is a non-stationary state.

In addition, the second determination unit 112b is configured to change the luminance color difference signal YUV of the peripheral portion in the through image data in the time series in the center portion based on the pattern analysis result Y of the analysis pattern 2 and the analysis pattern 3. Determines whether or not the change in the series is large, and functions as a zoom determination means that detects that the subject is moving in the zoom direction within the live view image data screen when the change in the peripheral part is greater To do.
Further, the second determination unit 112b determines that the change in the time series of the sum of the luminance color difference signals YUV at the upper end and the lower end in the through image data screen based on the pattern analysis result Y of the analysis pattern 4 is the right end. If the change in the time series of the value obtained by summing the luminance color difference signals YUV in the left and right ends is larger than the time series change, and if the change in the upper end and the lower end is larger, It functions as a tilt determination means for detecting that the subject is changing in the tilt direction (up and down direction of the image data screen).

Similarly, based on the pattern analysis result Y of the analysis pattern 4, the second determination unit 112b changes the time-series change in the value obtained by summing up the luminance color difference signals YUV at the right end and the left end in the through image data screen. If the change in the time series of the sum of the luminance color difference signals YUV at the upper end and the lower end is larger than the change in the time series, and if the change at the right end and the left end is larger, the screen of the through image data It functions as a pan determination means for detecting that the subject is changing in the pan direction (left and right direction of the image data screen).
The second determination unit 112b calculates the change amount of the imaging target in the image data based on the difference between the pattern analysis results Y obtained using the zoom determination unit, the tilt determination unit, and the pan determination unit. When the amount of change is within the allowable range (threshold value Th2 or less), it may be determined that the state is stationary, and when the amount exceeds the allowable range (greater than the threshold value Th2), it may be determined that the state is non-stationary.

The third determination unit 112c receives the pattern analysis result Y (t) obtained by the pattern analysis unit 112d, and a plurality of patterns past the time point (t) temporarily stored in the third buffer 112h. The analysis result Y {Y (t-1), Y (t-2), Y (t-3), Y (t-4)} is received.
In addition, the third determination unit 112c performs pattern analysis results Y {Y at a plurality of past time points {(t-1), (t-2), (t-3), (t-4)} at different timings. The difference between (t-1), Y (t-2), Y (t-3), Y (t-4)} and the current pattern analysis result Y (t) is calculated. The third determination unit 112c weights the difference between the current and past pattern analysis results Y according to the current and past time difference, and obtains the determination result H at the time point (t).
That is, the third determination unit 112c determines the difference h1 between the past and the current pattern analysis result Y between the frames 1, the difference h2 between the pattern analysis results Y between the frames, the difference h3 between the pattern analysis results Y between the three frames, and Each difference h4 of the pattern analysis results Y between the four frames is multiplied by a weighting coefficient (regression coefficient), and a determination result H is obtained by linear combination.
Hereinafter, an arithmetic expression (Formula 1) of the determination result H by the third determination unit 112c is shown.

  Note that “i” is the number of types of pattern analysis results Y obtained by the pattern analysis unit 112d, “fr” is an inter-frame difference recognizer indicating a frame difference (time difference), “a” is a weighting factor, and “k”. Is a weighting coefficient given in accordance with the difference of frames.

  In addition, when the determination result H is equal to or greater than the threshold value Th3, the third determination unit 112c determines that the state is a non-still state and obtains a third scene change determination value JDG3 = 1. On the other hand, when the determination result H is less than the threshold value Th3, the third determination unit 112c determines that the state is the still state, and obtains the third scene change determination value JDG3 = 0. This determination is shown in the following reference formula.

(Reference formula 3)
If (H ≧ Th3; threshold) JDG3 = 1 (non-stationary) else JDG3 = 0 (stationary)

  In this way, the third determination unit 112c determines that the pattern analysis result Y (t) at the time (t) and the past pattern analysis results Y {Y (t−1). Based on (t−n)}, it is determined whether or not the determination result H is within an allowable range in which it is recognized that the vehicle is stationary. That is, the third determination unit 112c calculates the difference between the current and past pattern analysis results Y obtained at different intervals as the amount of change of the imaging target in the image data, and uses this difference according to the current and past intervals. The determination result H that has been weighted is calculated. Thereby, the 3rd determination part 112c can detect the change of the imaging target obtained by observing in time series. When the obtained change amount (judgment result H) is within the allowable range (less than the threshold Th3), it is determined that it is in a stationary state, and when it exceeds the allowable range (greater than or equal to the threshold Th3), to decide.

  The overall determination unit 112e is input from the first scene change determination value JDG1 input from the first determination unit 112a, the second scene change determination value JDG2 input from the second determination unit 112b, and the third determination unit 112c. Based on the third scene change determination value JDG3, if all of the first to third scene change determination values JDG1 to JDG3 are “0”, it is determined to be in a stationary state, otherwise it is non-stationary information. Judge. This determination is shown in the following reference formula.

(Reference formula 4)
If (JDG1 = 0 & JDG2 = 0 & JDG3 = 0)
JDG_all = 0 (stationary) else JDG_all = 1 (non-stationary)

The comprehensive determination unit 112e outputs the comprehensive determination result JDG_all obtained in this way to the main control unit 110 as scene change information.
Further, the third determination unit 112 c calculates the reliability of the scene change information based on the determination result H and outputs it to the main control unit 110. The reliability is information indicating the degree to which the subject is changing in the screen. For example, when the determination result H is gradually increased, the change in the imaging target is observed gradually in time series. It shows that it is getting bigger. Therefore, in this case, the reliability that the scene change information is “1” (non-stationary state) is high. When the determination result H is gradually reduced, the reliability that the scene change information is “0” (still state) is high. Further, the smaller the determination result H is than the threshold value Th3, the higher the reliability that the scene change information is “0” (still state). Conversely, the larger the determination result H is than the threshold value Th3, the more the scene change information is. Is highly reliable that it is “1” (non-stationary state). In this way, the level of reliability (high, medium, low) of the scene change information can be represented according to the magnitude of the determination result H.

Next, returning to FIG. 2, the scene determination unit 113 will be described.
As shown in FIG. 2, the scene determination unit 113 includes a control unit 114 and an auto scene determination unit 115.
The control unit 114 performs a determination threshold control process for controlling the determination threshold Pth of the determination condition P referred to by the auto scene determination unit 115 based on the scene change information obtained by the scene analysis unit 112. Here, the determination condition P is represented by the determination data using a determination threshold Pth that is predetermined for each determination data according to the determination data (Bv value, zoom position, Wb information, face detection information) as a determination criterion. This is a determination condition for obtaining the feature amount of the scene mode. For example, it is a condition for determining whether or not “average brightness” that is information representing the characteristics of the imaging target satisfies a criterion that is the determination threshold value Pth based on the average luminance value BvMean that is determination data. The scene mode is determined in advance according to the types of a plurality of scenes, and imaging conditions suitable for this scene are associated with each scene mode. Each of these scene modes is associated with an imaging condition set to an optimum parameter.
The control unit 114 calculates a determination threshold value Pth ′ based on the scene change information obtained by the scene analysis unit 112 and replaces the determination threshold value Pth that is predetermined in the determination condition P. In addition, the control unit 114 calculates a determination threshold value Pth ′ using an arithmetic expression (Expression 2) shown below.

  The determination threshold value Pth is an initial setting value of a determination threshold value determined in advance as the determination condition P of the auto scene determination unit 115, and “SG” is a scene change coefficient obtained based on the scene change information, “R” is an allowable value.

That is, the control unit 114 obtains “0” as the scene change coefficient SG when the scene change information is “1” (non-stationary state).
In addition, when the scene change information represents “0” (still state), the control unit 114 determines for each determination condition P (for example, P_Bv value, P_zoom position, P_WB information, P_face detection information, etc.). The magnitude relationship between the data and the determination threshold value Pth that is an initial setting value is determined. When “current (t) determination data> previous (t−1) determination value”, the control unit 114 sets “+1” as the scene change coefficient SG based on the scene change information obtained by the scene analysis unit 112. Get. On the other hand, if “current (t) determination data ≦ previous (t−1) determination value”, the control unit 114 obtains “−1” as the scene change coefficient SG. Then, the scene change coefficient SG obtained in this way is multiplied by an allowable value R determined in advance according to each determination condition P, and added to the determination threshold value Pth which is an initial setting value. Thereby, when the scene change information is “0 (still information)”, the determination threshold value Pth can be shifted in the direction in which the determination data is changing. For example, when the determination data changes in the decreasing direction, the determination threshold value Pth can be lowered, and when the determination data changes in the increasing direction, the determination threshold value Pth can be increased. Therefore, even when the determination data exceeds the determination threshold Pth (exceeds the allowable range), it is determined that the scene mode determined by the auto scene determination unit 115 has changed as long as the determination threshold P′th is not exceeded. Will not be.
The allowable value R is a value that is predetermined for each determination data as the above-described allowable range.

The auto scene determination unit 115 determines whether or not the scene satisfies a predetermined determination condition P based on the Bv value, contrast, zoom position, WB information, face detection information, and the like output from the main control unit 110. I do. Examples of the scene include “macro”, “landscape”, “night view”, “backlight”, “portrait”, “nightscape portrait”, “backlight portrait”, “auto”, and the like.
For example, the determination condition P for the scene “landscape” is determined in advance such that the average luminance value BvMean is equal to or greater than the determination threshold Pth_ (average brightness) and the minimum luminance value BvMin is equal to or greater than the determination threshold Pth_ (shadow). Yes.
The determination condition P for the scene “night view” is that the average luminance value BvMean is less than the determination threshold value Pth_ (average brightness), and the contrast (maximum luminance value BvMax−minimum luminance value BvMin) is the determination threshold value Pth_ (contrast). ) Or more.
Further, when the determination threshold value Pth ′ is input from the control unit 114, the auto scene determination unit 115 replaces the determination threshold value Pth of the corresponding determination condition P with the determination threshold value Pth ′, and the determination input from the main control unit 110. The scene is determined by comparing the data with the determination threshold value Pth ′.
For example, when the average brightness value BvMean is equal to or greater than the determination threshold value Pth_ (average brightness), the auto scene determination unit 15 obtains “01” as a comparison result of information indicating “average brightness”. On the other hand, when the average luminance value BvMean is less than the determination threshold value Pth_ (average brightness), the auto scene determination unit 15 obtains “00” as a comparison result of information indicating “average brightness”.
Further, the auto scene determination unit 115 reads out the imaging condition associated with the determined scene mode from the storage unit 15 and outputs the image capturing condition to the main control unit 110.

Next, an example of the scene determination method of the imaging apparatus 1 according to the present embodiment will be described with reference to FIG. FIG. 5 is a schematic diagram illustrating an example of the scene determination method of the imaging apparatus 1 according to the present embodiment.
As shown in FIG. 5, the glag indicating the change in the determination data shows the relationship between the determination data and the determination threshold value Pth ′, with the horizontal axis as time T and the vertical axis as determination data. Hereinafter, an example of determination processing that uses the average luminance value BvMean as the determination data and compares the average luminance value BvMean with the determination threshold value Pth_ (average brightness) will be described.
As shown in the figure, at the time (t−1) one frame before, the average luminance value BvMean that is the determination data is equal to or greater than the determination threshold value Pth. Therefore, the auto scene determination unit 115 obtains “01” as the comparison result of the information indicating “average brightness”. Although not illustrated, when the minimum luminance value BvMin is greater than or equal to the determination threshold value Pth_ (shadow) as the determination data, the auto scene determination unit 115 obtains “00” as a comparison result of information indicating “shadow”. As described above, when the determination condition (average brightness: 01 & shadow: 00) for the scene “landscape” is satisfied, the auto scene determination unit 115 determines the scene at the time (t−1) as “landscape”. It is assumed that the auto scene determination unit 115 obtains the respective comparison results by comparing the other determination data with the determination threshold value Pth in the same manner.

In this state, the scene determination method at time (t) will be described in detail below.
First, an optical image incident on the optical system 101 is incident on the image sensor 102 and the photometric element 105, respectively. Light incident on the image sensor 102 is photoelectrically converted and output to the CPU 11 as through image data via the A / D converter 103. On the other hand, the light incident on the photometric element 105 is photoelectrically converted and output to the main controller 110 as a luminance signal via the A / D converter 103.
Then, the through image processing unit 111 calculates a luminance color difference signal YUV (t) based on the through image data, and outputs it to the scene analysis unit 112. On the other hand, the main control unit 110 calculates a Bv value (t) for each divided region based on the luminance signal, outputs the Bv value (t) to the scene analysis unit 112, and sets the zoom position ZP (t) obtained from the lens driving unit 104 to the scene. The data is output to the analysis unit 112.
Next, the first determination unit 112a of the scene determination unit 112 receives the Bv value {Bv (t), Bv (t-1)} input from the main control unit 110 and the zoom position {ZP (t), ZP (t− 1)}, it is determined whether or not the difference between the Bv values is larger than the threshold value Th1. Then, a determination is made according to the above-described reference formula 1, and a first scene change determination value JDG1 corresponding to the determination result is obtained. At this time, the first determination unit 112a may be configured to perform the determination result as to whether or not the zoom position is larger than the threshold value Th ′ to obtain the first scene change determination value JDG1.

On the other hand, the second determination unit 112b uses the pattern analysis result Y {Y (t), Y (t) calculated by the pattern analysis unit 112d based on the luminance color difference signal YUV {YUV (t), YUV (t-1)}. -1)} is used to obtain the second scene change determination value JDG2.
In addition, the third determination unit 112c performs patterning based on the luminance color difference signal YUV {YUV (t), YUV (t-1), YUV (t-2), YUV (t-3), YUV (t-4)}. The determination result H is calculated using the pattern analysis result Y {Y (t-1), Y (t-2), Y (t-3), Y (t-4)} calculated by the analysis unit 112d. . Then, the third determination unit 112c makes a determination according to the reference expression 3, and obtains a third scene change determination value JDG3 according to the determination result.

In this way, the first determination unit 112a, the second determination unit 112b, and the third determination unit 112b obtain the obtained first scene change determination value JDG1, second scene change determination value JDG2, and third scene change determination value. JDG3 is output to the comprehensive determination unit 112e.
Then, based on the first scene change determination value JDG1, the second scene change determination value JDG2, and the third scene change determination value JDG3, the comprehensive determination unit 112e obtains scene change information and reliability at the time (t), Output to the main control unit 110.
Here, it is assumed that the obtained scene change information is “0” (still state).

Next, the main control unit 110 displays the Bv value (including the average luminance value BvMean, the maximum luminance value BvMax, and the minimum luminance value BvMin), the contrast (difference between the maximum luminance value BvMax and the minimum luminance value BvMin), and the zoom position ZP (t). WB information, face detection information, scene change information “1”, reliability, and the like are output to the scene determination unit 113.
The control unit 114 of the scene determination unit 113 determines the magnitude relationship between the determination data at the time (t) and the determination data at the time (t-1) one frame before. Here, as an example of the determination data at the time (t), the average luminance value BvMean is smaller than the average luminance value BvMean at the time (t-1) as shown in FIG. Based on the scene change information “0”, the control unit 114 obtains “−1” as the scene change coefficient SG.
Therefore, the control unit 114 substitutes SG = “− 1” in the above (Formula 2) to obtain the determination threshold value Pth ′.
Therefore, the determination threshold value Pth ′ is a determination threshold value PthMin that is smaller than the determination threshold value Pth, which is an initial setting value, by an allowable value R.
As a result, as shown in FIG. 5, the determination data at the time (t) is not more than the determination threshold value Pth that is the initial setting value, but is not less than the lower limit value PthMin obtained as the determination threshold value Pth ′. For this reason, the auto scene determination unit 115 obtains “01” as the comparison result of the information indicating the “average brightness” of the determination condition P.

In this manner, the control unit 114 calculates the determination threshold value Pth ′ based on the scene change information obtained by the scene analysis unit 112 and outputs the same to the control unit 114 in the same manner under other determination conditions P. Then, the auto scene determination unit 115 determines a magnitude relationship with respect to the determination threshold value Pth ′ obtained by the control unit 114 for each determination data, and obtains a comparison result.
Then, the auto scene determination unit 115 performs scene determination by combining the comparison results based on each determination data. For example, when the comparison result of the information indicating “average brightness” is “01” and the comparison result of the information indicating “shadow” is “00” as the determination condition P, the auto scene determination unit 115 The scene mode is determined as “landscape”.

On the other hand, in the imaging apparatus not according to the present embodiment, since the determination data is equal to or less than the determination threshold value Pth at the time (t) illustrated in FIG. 5, the auto scene determination unit includes information indicating “average brightness”. As a result of comparison, “00” is obtained. If the contrast scene determination result is “01”, the auto scene determination unit determines that the scene is “night view”. That is, the scene determined by the auto scene determination unit 115 is changed from “landscape” to “night view”. As a result, the auto scene determination unit reads out the imaging condition corresponding to the scene mode “night view” from the storage unit and outputs it to the main control unit. Therefore, at the time (t-1) one frame before, the main control unit that has controlled the imaging unit according to the imaging condition associated with the scene “landscape” corresponds to the imaging condition of the scene mode “night view”. Must be changed to
However, when the imaging device in which the scene mode is determined in this manner continuously pans and shoots the same subject, the determination by the auto scene determination unit is “landscape” or “night view” after several frames. There is a problem that the determined scene mode becomes unstable.

In contrast, the imaging apparatus 1 according to the present embodiment calculates scene change information based on the Bv value, the zoom position, the luminance color difference signal, and the like, thereby changing the operation state of the imaging apparatus 1 and the state change of the imaging target. It was made to detect. Thereby, when the determination data fluctuates in the vicinity of the determination threshold value Pth (that is, near the boundary where the scene determination is switched), or when the imaging device 1 is slowly panned, the angle of view changes slightly. Even if it is, it is determined that the state change of the imaging target is almost equal to the stationary state, and the determination threshold value Pth ′ by the auto scene determination unit 115 can be changed within the allowable range corresponding to the allowable value R. it can. Therefore, when there is no change by the determination threshold value Pth ′, the reference value Pth is exceeded, the scene determined by the scene determination is changed from “landscape” to “night view”, and further, “night view” is changed to “landscape”. Variation in scene determination due to being performed can be prevented.
Therefore, when the imaging apparatus 1 is slowly panning with respect to the same imaging target, a situation in which the scene determined by the auto scene determination unit 115 fluctuates unnecessarily is avoided, and stable scene determination is performed. Can be realized.

  In addition, the imaging apparatus 1 according to the present embodiment obtains a determination result by the scene analysis unit 112 using an arithmetic expression as shown in Expression 2. When the determination result is the scene change information “1” indicating the non-still state, the scene change coefficient SG is set to “0”, and the determination threshold value Pth ′ = the determination threshold value Pth. Thereby, in the non-still state, the determination threshold value does not change, and the scene determination according to the determination condition normally performed by the auto scene determination unit 115 can be executed. In other words, the determination threshold can be changed only when it is determined that the camera is stationary.

Next, an example of a scene determination method different from that in FIG. 5 will be described with reference to FIG. Note that detailed description of the same contents as shown in FIG. 5 is omitted.
As shown in FIG. 6, at the time (t−1) one frame before, the average luminance value BvMean that is the determination data is equal to or less than the determination threshold Pth. Therefore, the auto scene determination unit 115 obtains “00” as the comparison result of the information indicating “average brightness”. Although not shown, the contrast (maximum luminance value BvMax−minimum luminance value BvMin) is equal to or greater than the determination threshold value Pth_ (contrast), and the auto scene determination unit 115 sets “01” as the comparison result of the information indicating “contrast”. obtain. Thereby, the auto scene determination unit 115 determines that the scene mode at the time (t−1) is “night view”.

At time (t), scene change information is obtained by the scene analysis unit 112 based on the optical image incident on the optical system 101, as described above with reference to FIG. Here, it is assumed that the obtained scene change information is “0” (still state).
Next, the control unit 114 of the scene determination unit 113 determines the magnitude relationship between the determination data at the time (t) and the determination data at the time (t−1) one frame before. Here, since the average luminance value BvMean of the determination data at the time (t) is larger than the determination data at the time (t−1) as shown in FIG. 6, “the determination data at the present (t)> the past (t− 1), and the control unit 114 obtains “+1” as the scene change coefficient SG.
Therefore, the control unit 114 assigns “+1” to the scene change coefficient SG shown in (Expression 2) described above to calculate the determination threshold value Pth ′.
Accordingly, the determination threshold value Pth ′ is an upper limit value PthMax that is larger than the determination threshold value Pth, which is an initial setting value, by an allowable value R.

As a result, as shown in FIG. 6, the determination data at the time (t) is equal to or greater than the determination threshold value Pth that is the initial setting value, but is equal to or less than the upper limit value PthMax obtained as the determination threshold value Pth ′. Therefore, the auto scene determination unit obtains “01” as a comparison result of information indicating “average brightness” of the determination condition P.
Then, the auto scene determination unit 115 performs scene determination by combining the comparison results based on the respective determination data. For example, as the determination condition P, the comparison result of information indicating “average brightness” is “00”. When the comparison result of the information indicating “Contrast” is “01”, the auto scene determination unit 115 determines that the scene mode is “night view”.

In the present embodiment, the scene analysis unit 112 has been described as an example of obtaining scene change information by multiplying all the determination results of the first determination unit 112a, the second determination unit 112b, and the third determination unit 112c. The present invention is not limited to this, and the scene change information may be obtained according to the determination result of each determination unit.
That is, when the first determination unit 112a determines that the amount of change in the imaging target exceeds the allowable range (when the first scene change information JDG1 is “1”), the overall determination unit 112e determines that the second determination unit 112b. Regardless of the determination by the third determination unit 112c, the determination by the first determination unit 112a is prioritized, and it is determined that the change amount of the imaging target exceeds the allowable range, and the scene change information “1” is output.
When the second determination unit 112b determines that the change amount of the imaging target exceeds the allowable range (when the second scene change information JDG2 is “1”), the comprehensive determination unit 112e is configured to perform the third determination unit 112c. Regardless of the determination, priority is given to the determination by the second determination unit 112b, and it is determined that the amount of change in the imaging target exceeds the allowable range, and the scene change information “1” is output.

As described above, the overall determination unit 112e gives the highest priority to the determination result of the first determination unit 112a, and determines the scene change information according to the priority order of the first determination unit 112a> the second determination unit 112b> the third determination unit 112c. It may be determined. This is because when the change amount of the imaging target changes the most, the determination result of the first determination unit 112a often becomes a non-stationary state, and the change amount of the imaging target in the first determination unit 112a falls within an allowable range. This is because, when it is determined that the number is exceeded, the determination result by the second determination unit 112b or the third determination unit 112c is likely to be the same as the determination result of the first determination unit 112a. Therefore, when the first determination unit 112a determines that the change amount of the imaging target exceeds the allowable range, the determination by the second determination unit 112b or the third determination unit 112c may be omitted.
Further, since the Bv value, the zoom position, and the like used for determination by the first determination unit 112a are determination data determined by the auto scene determination unit 115, they are directly related to the change of the scene mode. For this reason, it is possible to directly control the scene mode criterion (determination threshold Pth) by giving priority to the determination result of the first determination unit 112a.

Further, the second determination unit 112b and the third determination unit 112c can determine the change of the imaging target based on the through image data obtained by the imaging element 102. Thereby, the comprehensive determination part 112e can determine the change of the imaging target in the image data with higher accuracy. Therefore, a subtle change in the image data can be detected by combining with the determination result of the first determination unit 112a.
Further, the third determination unit 112c calculates the determination result H to determine whether or not the change of the imaging target is within the allowable range based on the cumulative change of the imaging target obtained by observation in time series. Judgment can be made. Thereby, it can be judged by a higher system whether the imaging object really changed.

Therefore, as described above, when the reliability is obtained based on the determination result H, the control unit 114 may determine the accuracy of the scene change information input from the scene analysis unit 112 based on the reliability. Good. For example, in the scene analysis unit 112, when only the first scene change determination value JDG1 of the first determination unit 112a is “1” and the reliability of the determination result H is low, the control unit 114 receives a scene change from the scene analysis unit 112. As information, “1” and information indicating a low reliability (for example, reliability “2” represented by about 1 to 10) may be input. Here, the control unit 114 determines whether or not the input reliability is equal to or higher than a certain threshold (for example, reliability “3”), and since the reliability is “2”, the input scene change is performed. The information “1” may be replaced with “0”, and the determination criterion of the determination condition P may be the determination threshold value Pth. Further, the control unit 114 may change the determination threshold Pth of the determination condition P to the determination threshold Pth ′ based on the scene change information “1” as long as the reliability is “3” or higher.
Thereby, it is possible to determine whether or not the change amount of the imaging target is within the allowable range with higher accuracy.

In addition, the present invention is not limited to this. For example, the image processing unit 13 may process an image according to an image processing condition determined in advance according to the scene mode determined by the auto scene determination unit 115. Good. In this case, the scene determination unit 113 outputs image processing conditions corresponding to the scene mode read from the storage unit 15 to the image processing unit 13, and the image processing unit 13 captures image data captured according to the input image processing conditions. The image processing may be performed on the image processing apparatus. In addition, a configuration may be adopted in which image display conditions determined in advance according to the scene mode are stored in the storage unit 15. In this case, the main control unit 110 determines the scene determined by the auto scene determination unit 115. The captured image data may be displayed on the display unit 14 in accordance with image display conditions corresponding to the mode.
Furthermore, in the above-described embodiment, the example in which the luminance signal is obtained by the photometric element 105 has been described. However, the present invention is not limited to this, and for example, a configuration obtained by using the imaging element 102 may be used.

  Further, when the focal length is calculated based on the zoom position and the focus position obtained by the lens driving unit 104 and the focal length is equal to or less than the threshold value, the scene mode “macro (close-up)” is set by the auto scene determination unit 115. It may be determined.

Furthermore, in the present embodiment, the first determination unit 112a and the second determination unit 112b are configured to determine the first and second scene change determination values JDG1, 2 based on the difference between the Bv value of the previous frame and the zoom position luminance / color difference signal YUV. However, the present invention is not limited to this, and any configuration may be used as long as it determines a change in the imaging target based on a difference such as a Bv value with different timing.
For example, the second determination unit 112b determines whether or not the difference in the pattern analysis result Y is larger than the threshold Th2 based on the difference in the pattern analysis result Y obtained at intervals of one frame or more. The second scene change determination value JDG2 may be obtained according to 2.
In addition, the third determination unit 112c determines that the pattern analysis result Y (t) at the time (t) and the past pattern analysis results Y {Y (t−1). n)}, it may be determined whether the determination result H is equal to or greater than the threshold Th3, and the third scene change determination value JDG3 may be obtained according to the above-described reference equation 3.

  The scene analysis unit 112 according to the present embodiment may be configured to detect a change in the imaging target. For example, the scene analysis unit 112 of the imaging device 1 itself detected by the second determination unit 112b by an angular velocity sensor (not shown). Based on the information indicating the amount of change, it may be determined whether it is a non-stationary state or a stationary state.

  DESCRIPTION OF SYMBOLS 1 ... Imaging device, 10 ... Imaging part, 11 ... CPU, 12 ... Operation part, 13 ... Image processing part, 14 ... Display part, 15 ... Memory | storage part, 16 ...... Buffer memory unit, 17 ... Communication unit, 18 ... Bus, 20 ... Storage medium, 101 ... Optical system, 102 ... Image sensor, 103 ... A / D conversion unit 104 ... Lens drive unit, 105 ... Photometry element, 110 ... Main control unit, 111 ... Through image processing unit, 112 ... Scene analysis unit, 113 ... Scene determination unit, 114 ... Control unit, 115 ... Auto scene determination unit, 112a ... First determination unit, 112b ... Second determination unit, 112c ... Third determination unit, 112d ... Pattern analysis unit, 112e... Comprehensive judgment unit, 112f. The primary storage unit

Claims (5)

A control unit that controls an imaging unit that images a subject and generates image data according to the selected imaging condition;
A determination unit that selects the imaging condition based on information obtained by imaging by the imaging unit and a determination criterion;
Based on the information obtained by imaging by the imaging unit, and calculates the amount of change in an imaging subject, the imaging subject within the tolerance to said imaging condition selected by the determination unit is permitted as the amount of change which is not changed An analysis unit for determining whether or not there is a change amount;
A controller that changes the determination criterion to a value that does not change the imaging condition when the analysis unit determines that the amount of change in the imaging target is within the allowable range;
The controller is
A luminance color difference signal is generated based on the image data,
The analysis unit
Based on information obtained by multiplying a difference between the plurality of luminance color difference signals obtained at different time intervals by different weighting factors for each time interval, the amount of change of the imaging target is within the allowable range. An imaging apparatus comprising a third determination unit that determines whether or not. The controller is
Based on the image data, a luminance signal representing the brightness of the imaging target is generated,
The analysis unit
The apparatus according to claim 1, further comprising: a first determination unit configured to determine whether the change amount of the imaging target is within the allowable range based on a difference between the plurality of luminance signals obtained at different timings. The imaging device described. The first determination unit includes:
Based on a plurality of pieces of position information obtained at different timings, the position information representing the position of the lens included in the image pickup unit is determined whether or not the amount of change of the image pickup target is within the allowable range. The imaging apparatus according to claim 2. The controller is
A luminance color difference signal is generated based on the image data,
The analysis unit
2. A second determination unit that determines whether or not a change amount of the imaging target is within the allowable range based on a difference between the plurality of luminance color difference signals obtained at different timings. The imaging device according to any one of 3 to 3. A control unit that controls an imaging unit that images a subject and generates image data according to the selected imaging condition;
A determination unit that selects the imaging condition based on information obtained by imaging by the imaging unit and a determination criterion;
Based on the information obtained by imaging by the imaging unit, and calculates the amount of change in an imaging subject, the imaging subject within the tolerance to said imaging condition selected by the determination unit is permitted as the amount of change which is not changed An analysis unit for determining whether or not there is a change amount;
A controller that changes the determination criterion to a value that does not change the imaging condition when the analysis unit determines that the amount of change in the imaging target is within the allowable range;
The controller is
Based on the image data, generating a luminance signal representing the brightness of the imaging target, generating a luminance color difference signal based on the image data,
The analysis unit
A first determination unit configured to determine whether or not a change amount of the imaging target is within the allowable range based on a difference between the plurality of luminance signals obtained at different timings;
A second determination unit that determines whether or not a change amount of the imaging target is within the allowable range based on a difference between the plurality of luminance color difference signals obtained at different timings;
Based on information obtained by multiplying a difference between the plurality of luminance color difference signals obtained at different time intervals by different weighting factors for each time interval, the amount of change of the imaging target is within the allowable range. A third determination unit for determining whether or not
When the first determination unit determines that the change amount of the imaging target is outside the allowable range, the determination by the first determination unit is prioritized regardless of the determination of the second determination unit and the third determination unit. And determined that it is out of the allowable range,
When the second determination unit determines that the change in the imaging target is outside the allowable range, the determination by the second determination unit is prioritized outside the allowable range regardless of the determination of the third determination unit. you and determines that there imaging device.

Images