JP6456038B2 - Electronic device, light amount change characteristic calculation method, program, and storage medium - Google Patents

Description

  The present invention relates to a technique for calculating a light quantity change characteristic of light from a photometric object.

  In recent years, the sensitivity of imaging devices such as digital cameras and mobile phones has been increasing. For this reason, even in a relatively dark environment such as a room, it has become possible to acquire a bright image with reduced blur by shooting with a high shutter speed (short exposure time).

  In addition, fluorescent lamps that are widely used as indoor light sources cause flicker, which is a phenomenon in which illumination light periodically fluctuates due to the influence of the commercial power supply frequency. When shooting with such a flickering light source (hereinafter referred to as a flicker light source) at a high shutter speed, exposure unevenness or color unevenness occurs in one image, or a plurality of images shot continuously. Variations in exposure and color temperature may occur between images.

  In order to solve such a problem, Patent Document 1 detects a flicker state of illumination light, and adjusts the imaging timing so that the center of the exposure time substantially coincides with the timing at which the amount of illumination light exhibits a maximum value. Has been proposed.

JP 2006-222935 A

  However, in the technique described in Patent Document 1, when the integrated value changes due to a factor different from the blinking of illumination light such as the movement of the subject or the composition change, the blinking cycle of the illumination light illuminance is accurately calculated. I can't.

  Accordingly, an object of the present invention is to enable accurate calculation of the light quantity change characteristic of light from a photometric object.

To achieve the above object, an electronic apparatus according to the present invention includes a sensor of the charge accumulation type, and a control means for controlling the driving of the sensor, by the control unit, continuous in a plurality of times using the sensor based on a plurality of data obtained by performing charge accumulation and reading, comprising: a calculating means for calculating a light amount change characteristic of the light from the subject, the previous SL calculation means, among the plurality of data, each other physician by changing the difference of the data set of data with each other obtained by the first distance calculating a first evaluation value more determined, in a second interval different from each other bur said first interval Obtaining a plurality of differences between the obtained data by changing a data set to calculate a second evaluation value, and calculating the light quantity change characteristic based on the first evaluation value and the second evaluation value; It is characterized by.

  According to the present invention, it is possible to accurately calculate the light quantity change characteristic of light from a photometric object.

1 is a schematic configuration diagram of an imaging apparatus according to an embodiment of the present invention. It is a flowchart figure which shows the operation | movement for performing imaging | photography which reduced the influence of the flicker of the imaging device which concerns on embodiment of this invention. It is a figure which shows the accumulation | storage timing of the charge for flicker detection, and the read-out timing of an image signal. It is a figure which shows the relationship between the number of vertical pixel additions, and reading time. It is a figure explaining an example of the method of calculating the timing of the peak of the light quantity of a flicker light source. It is a figure which shows the relationship between the light quantity change of a flicker light source, and the generation timing of a flicker synchronizing signal and a shutter start signal. It is a figure which shows the table which linked | related the value of T_ShutterWait and the value of shutter speed. It is a figure which shows the operation | movement sequence of the photometry sensor 108 and ICPU112 between the frames of continuous imaging | photography.

  Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.

  FIG. 1 is a schematic configuration diagram of an imaging apparatus according to the present embodiment. The imaging apparatus according to the present embodiment includes a camera body 100 and a lens unit 200 that can be attached to and detached from the camera body 100.

  First, the configuration of the camera body 100 will be described. A microcomputer CPU (hereinafter, camera microcomputer) 101 controls each part of the camera body 100. The memory 102 is a memory such as a RAM or a ROM connected to the camera microcomputer 101.

  The image sensor 103 is an image sensor such as a CCD or CMOS including an infrared cut filter, a low-pass filter, and the like, and photoelectrically converts a light beam incident through the lens unit 200 and outputs an image signal.

  The shutter 104 travels in a light shielding state in which the image sensor 103 is shielded from a light beam incident through the lens unit 200 and a retracted state in which the light beam incident through the lens unit 200 is guided to the image sensor 103.

  The half mirror 105 is movable between a position for guiding the light beam incident through the lens unit 200 to the image sensor 103 (mirror up state) and a position for guiding it to the photometric sensor 108 (mirror down state). In other words, the half mirror 105 changes the optical path of the light beam that has entered through the lens unit 200 between the state leading to the image sensor 103 and the state leading to the photometric sensor 108. Further, when it is at a position to be guided to the photometric sensor 108, the light beam incident through the lens unit 200 is imaged on the focus plate 106.

  The display element 107 is a display element using PN liquid crystal or the like, and displays a frame (AF frame) indicating a focus detection area used for automatic focus adjustment control (AF control). The photometric sensor 108 uses not only photometry but also subject face detection and subject tracking based on the output image signal by using a charge storage type imaging device that accumulates charges according to the amount of incident light such as a CCD or CMOS. Flicker detection can be performed. The pentaprism 109 guides the light beam incident through the lens unit 200 reflected by the half mirror 105 to the photometric sensor 108 and an optical finder (not shown). The focus detection circuit 110 performs focus detection for AF control, and a part of the light beam incident through the lens unit 200 and passing through the half mirror 105 is guided by the AF mirror 111.

  The CPU 112 is a CPU for driving control of the photometric sensor 108 and image processing / calculation (hereinafter referred to as ICPU). Based on an output signal (image signal) from the photometric sensor 108, photometry, subject face detection, and subject tracking are performed. Performs various calculations related to Further, the CPU 112 determines the timing at which the light quantity change period and the light quantity of the light from the photometric target satisfy a predetermined condition based on the output signal (image signal) from the photometric sensor 108 (for example, the timing and the light quantity at which the light quantity is maximized). The light quantity variation characteristic such as the minimum timing is calculated. The memory 113 is a memory such as a RAM or a ROM connected to the ICPU 112. In the present embodiment, a configuration in which the ICPU 112 is provided separately from the camera microcomputer 101 will be described. However, a configuration in which processing executed by the ICPU 112 is executed by the camera microcomputer 101 may be used.

  The operation unit 114 includes a release button for the user to instruct the camera body 100 to start a shooting preparation operation or a shooting operation, and a setting button for the user to make various settings for the camera body 100. The operation unit 114 includes a power switch for the user to turn on / off the power of the camera body 100, a mode dial for the user to select an operation mode of the camera body 100 from a plurality of modes, a touch panel, and the like. .

  Next, the configuration of the lens unit 200 will be described. The lens CPU 201 (hereinafter referred to as LPU) controls each part of the lens unit 200, for example, a focus lens, a zoom lens, a diaphragm driving unit, and the like, and transmits information about the lens to the camera microcomputer 101.

  Next, an operation for performing photographing with reduced influence of flicker will be described with reference to FIG. FIG. 2 is a flowchart illustrating an operation for performing imaging with reduced influence of flicker of the imaging apparatus according to the present embodiment.

  When the power of the camera body 100 is turned on by the user's operation on the power switch, a photometric operation is performed in step S101. In the photometric operation, charge is accumulated and the image signal is read by the photometric sensor 108, and the ICPU 112 performs a calculation related to photometry (hereinafter referred to as photometric calculation) based on the obtained image signal to obtain a photometric value.

  Note that this photometric operation is performed when the accumulation time of the photometric sensor 108 is set to be approximately an integral multiple of the flicker cycle so that the photometric value does not vary due to the change in the light amount of the flicker light source even under a flicker light source. Good. Here, the frequency at which the light amount of the flicker light source changes (hereinafter referred to as the flicker frequency) is twice the commercial power supply frequency. Therefore, in an area where the commercial power supply frequency is 50 Hz, the flicker frequency is 100 Hz, and the light quantity change period is 10 ms as the reciprocal of the flicker frequency. Similarly, in a region where the commercial power supply frequency is 60 Hz, the flicker frequency is 120 Hz, and the light quantity change period is 8,33 ms which is the reciprocal of the flicker frequency.

  In order to deal with these two types of flicker frequencies, the accumulation time of the photometric sensor 108 is set to a time substantially equal to the average value of 10 ms and 8,33 ms, for example, 9 ms. Then, regardless of whether the commercial power supply frequency is 50 Hz or 60 Hz, the accumulation time of the photometric sensor 108 is substantially equal to one cycle of the light amount change of the flicker light source, and a stable photometric value can be obtained even under the flicker light source.

  Further, based on the obtained photometric value, the camera microcomputer 101 determines an aperture value Av, an exposure control value, a shutter speed (exposure time) Tv, and an ISO sensitivity (imaging sensitivity) Sv. In determining Av, Tv, and Sv, the camera microcomputer 101 determines the program using a program diagram stored in advance in the memory 102.

  Next, in step S102, as shown in FIG. 3, the photometric sensor 108 accumulates a plurality of charges for flicker detection and reads out an image signal. FIG. 3 is a diagram showing the charge accumulation timing for flicker detection and the image signal readout timing. Accumulation / readout is continuously performed 12 times at a cycle of 600 fps and about 1,667 ms. This 600 fps is a value equal to the least common multiple of the flicker frequencies (100 Hz and 120 Hz) assumed in advance. In addition, by accumulating 12 times at 600 fps, the accumulation is performed in a period of 20 ms as a whole, and the light quantity change of the flicker light source is included in two cycles regardless of whether the commercial power supply frequency is 50 Hz or 60 Hz. become.

  Here, a method for driving the photometric sensor 108 at 600 fps (cycle of 1,667 ms) will be described.

  In this embodiment, based on the image signal output from the photometry sensor 108, not only photometry but also subject face detection, subject tracking, flicker detection, and the like are performed. In order to accurately detect the face of the subject, the number of pixels of the photometric sensor 108 needs to be a certain number, for example, the number of pixels equivalent to QVGA. In order to read out all pixel signals of an image sensor having a number of pixels that can accurately detect the face of the subject at a frame rate of 600 fps or more, the circuit configuration becomes complicated and the cost increases.

  Therefore, the frame rate is set to 600 fps (cycle of 1,667 ms) by reading out all pixel signals for the image signal for detecting the face of the subject and performing pixel addition reading and thinning-out reading for the image signal for detecting flicker. Adjust to.

  In the case of using a CCD for the photometric sensor 108, it is preferable to shorten the readout time by artificially reducing the number of readout lines by pixel addition readout by adding and reading out pixel signals. For example, by performing vertical pixel addition with a CCD having a stripe arrangement, there is an effect of shortening the readout time as shown in FIG. FIG. 4 is a diagram showing the relationship between the number of vertical pixel additions and the readout time. A CCD in which the readout time is 6,25 ms when all pixel signals are read out without adding pixel signals (the number of vertical pixel additions is 1). Will be described as an example. In the case of a CCD having the characteristics shown in FIG. 4, by adding nine pixels, the readout time is 1,66 ms, and the frame rate can be about 600 fps. The image signal read out at this time has 1/9 the number of pixels in the vertical direction as compared with the image signal read out without adding the pixel signals. However, in flicker detection, the photometric values between the image signals are compared. Therefore, there is no problem even if the image signal has a reduced number of pixels in the vertical direction.

  In the case where a CMOS is used for the photometric sensor 108, it is preferable to adjust so that the total time of accumulation and readout becomes a period of about 1,667 ms by so-called thinning readout in which horizontal lines for reading out pixel signals are limited.

  This completes the description of the method for driving the photometric sensor at about 600 fps (about 1,667 ms cycle). The accumulation / reading cycle of the photometric sensor described above is merely an example, and the frame rate may not be about 600 fps (about 1,667 ms cycle). For example, since the longer the accumulation time is, the more effective the environment is for low illuminance, the one accumulation time may be longer than about 1,667 ms and the frame rate may be smaller than 600 fps. Alternatively, since the time required for flicker detection is shortened as the accumulation / reading cycle is shorter, one accumulation time may be shorter than about 1,667 ms. At this time, the vertical pixel addition number may be a pixel addition number that makes the readout time shorter than 1,66 ms, and the frame rate may be larger than 600 fps. Further, the relationship between the vertical pixel addition number and the readout time shown in FIG. 4 is merely an example. However, since the difference between the accumulation / reading cycle of the photometric sensor and the cycle of the change in the amount of light of the flicker light source increases as the frame rate increases from 600 fps, a frame rate within 600 fps ± 1 to 2% is preferable. That is, the photometric period of the photometric sensor is preferably a period substantially equal to the reciprocal of the least common multiple of the frequency twice the first commercial power supply frequency and the frequency twice the second commercial power supply frequency.

  When the accumulation of the charge for flicker detection and the reading of the image signal are finished in S102, the ICPU 112 performs a flicker detection calculation based on the read image signal in S103.

  FIG. 3A shows changes in charge accumulation timing, image signal readout timing, and photometric value when the commercial power supply frequency is 50 Hz. The n-th accumulation is “accumulation n”, the readout of the accumulation n is “read n”, and the photometric value obtained from the result of the readout n is “AE (n)”. Note that although one photometric value is obtained by each accumulation, the light quantity of the flicker light source is not constant during the accumulation period. Therefore, the photometric value obtained by each accumulation is regarded as a value corresponding to the light amount of the flicker light source at the central point in each accumulation period.

  When the commercial power supply frequency is 50 Hz, the light amount change period of the flicker light source is about 10 ms and 10 ÷ 1,667≈6. Therefore, as shown in FIG. Accumulation is performed at substantially the same timing. That is, the relationship of AE (n) ≈AE (n + 6) is established.

  Similarly, when the commercial power supply frequency is 60 Hz, the light amount change period of the flicker light source is about 8,33 ms and is 8,33 ÷ 1,667≈5. Therefore, as shown in FIG. Accumulation is performed at a timing when the amount of light of the flicker light source is approximately equal in period. That is, AE (n) ≈AE (n + 5).

  On the other hand, AE (n) is substantially constant regardless of n if the light source has no change in light quantity. Therefore, an evaluation value is calculated using the following equations (1) and (2) based on a plurality of photometric values obtained by accumulation for flicker detection.

  Flicker is obtained by comparing the evaluation value F50 and the evaluation value F60 with a predetermined threshold value F_th, with the evaluation value calculated using the equation (1) as F50 and the evaluation value calculated using the equation (2) as F60. Perform detection. Specifically, in the case of F50 <F_th and F60 <F_th, it can be said that all of a plurality of photometric values obtained by accumulating for flicker detection are substantially equal, and therefore it is determined that no flicker occurs. In the case of F50 <F_th and F60 ≧ F_th, a plurality of photometric values obtained by accumulating for flicker detection are substantially equal in six cycles and not substantially equal in five cycles. It can be said. Therefore, it is determined that a flicker with a light quantity change period of 10 ms is generated (under a flicker light source with a commercial power supply frequency of 50 Hz).

  In the case of F50 ≧ F_th and F60 <F_th, a plurality of photometric values obtained by accumulating for flicker detection are substantially equal in five cycles and are not substantially equal in six cycles. It can be said. Therefore, it is determined that a flicker with a light amount change period of 8,33 ms is generated (under a flicker light source with a commercial power supply frequency of 60 Hz).

  It should be noted that the photometric value may change greatly to satisfy F50 ≧ F_th and F60 ≧ F_th when panning or other imaging device movement or subject movement occurs during flicker detection accumulation. Conceivable. In that case, flicker detection is performed by comparing F50 and F60.

  Specifically, when F50 ≧ F_th, F60 ≧ F_th, and F50 <F60, it is determined that a flicker with a light quantity change period of 10 ms is generated (under a flicker light source with a commercial power supply frequency of 50 Hz). On the other hand, when F50 ≧ F_th, F60 ≧ F_th, and F50> F60, it is determined that a flicker with a light quantity change period of 8,33 ms is generated (under a flicker light source with a commercial power supply frequency of 60 Hz). Note that when F50 ≧ F_th, F60 ≧ F_th, and F50 = F60, the light amount change period of the flicker light source cannot be determined, and therefore it may be determined that no flicker occurs or flicker cannot be detected.

  In addition, when F50 ≧ F_th and F60 ≧ F_th, the light amount change period of the flicker light source is determined. However, when F50 ≧ F_th and F60 ≧ F_th, the flicker detection accuracy is low, so the flicker detection accumulation is performed again. May be.

  As described above, among a plurality of photometric results obtained by performing photometry a plurality of times, a plurality of photometric results having a first photometric interval are obtained by changing a set of photometric results to obtain a first An evaluation value is calculated. Further, a second evaluation value is calculated by obtaining a plurality of photometric results of different photometric intervals, each of which has a second interval different from the first interval, by changing the set of photometric results. Based on the first evaluation value and the second evaluation value, the light quantity change characteristic of the light from the photometric target is calculated. For example, when the first evaluation value is less than the threshold value (F50 <F_th) and the second evaluation value is greater than or equal to the threshold value (F60 ≧ F_th), the light quantity change period of light from the photometric target is the first commercial power supply frequency ( 50 Hz) is calculated to be the reciprocal of twice the frequency. Further, when the first evaluation value is equal to or greater than the threshold value (F50 ≧ F_th) and the second evaluation value is equal to or greater than the threshold value (F60 ≧ F_th), the comparison between the first evaluation value and the second evaluation value is performed. A light quantity change period is calculated based on the result.

  By performing such a calculation process, even if the photometric result changes due to a different factor from the change in the amount of light from the subject, such as the movement of the subject or a change in composition, the light amount change characteristic of the light from the subject is measured. It can be calculated accurately.

  Further, in step S103, the ICPU 112 obtains the timing of the flicker feature point when the light source is under the flicker light source. FIG. 5 is a diagram for explaining an example of a method for calculating the peak timing of the light quantity of the flicker light source, which is an example of the timing of the flicker feature point.

  The point where the maximum value is obtained among AE (1) to AE (12) is P2 (t (m), AE (m)), and the point of the previous photometric result is P1 (t (m-1). ), AE (m−1)), and the point of the next photometric result is P3 (t (m + 1), AE (m + 1)). Then, a straight line passing through two points of AE (m−1) and AE (m + 1) (P1 in the example of FIG. 5) and P2 is obtained as L1 = at + b, and AE (m−1) and A point having a larger AE (m + 1) (P3 in the example of FIG. 5) is passed through, and a straight line having the inclination −a is set to L2. When the intersection of L1 and L2 is obtained, the peak timing t_peak when the accumulation start time for flicker detection is set to 0 ms and the peak photometric value AE_peak corresponding to the light quantity at the peak can be calculated.

  In FIG. 5, as an example of a method for calculating the timing of the flicker feature point, the method for calculating the timing at which the light amount becomes the maximum (peak) in the change in the amount of flicker light is described, but the light amount is the minimum (bottom). You may calculate the timing which becomes.

  In step S104, the camera microcomputer 101 generates a flicker synchronization signal from the flicker frequency obtained in step S103 and the light amount change timing. As shown in FIG. 6, the flicker synchronization signal is a signal that is generated every cycle of the light amount change of the flicker light source and synchronized with a predetermined timing of the light amount change of the flicker light source. FIG. 6 is a diagram showing the relationship between the change in the amount of light of the flicker light source and the generation timing of the flicker synchronization signal and the shutter start signal.

  In FIG. 6, a time lag from the shutter start signal until the shutter 104 actually travels and starts to expose the first line of the imaging region of the image sensor 103 is defined as T_ShutterResponse. In addition, the time T_Run from the start of exposure of the first line in the imaging region of the image sensor 103 to the start of exposure of the last line is set. Note that when the exposure of all the imaging regions of the imaging element 103 is started simultaneously, T_Run = 0 may be set.

The flicker synchronization signal generation timing t_Flicker is expressed by the following expression (3) when the accumulation start time for flicker detection is set to 0 ms.
t_Flicker = t_peak−T_ShutterResponse− (T_Run + TVmax) / 2 + T × n (3)

  Here, the light quantity change period T of the flicker light source and the peak timing t_peak when the flicker detection accumulation start time is set to 0 ms are calculated in step S103. n is a natural number, and TVmax is a shutter speed that is a threshold value for determining whether or not to perform shutter control to reduce the influence of flicker, and is set in advance.

  When the shutter speed is slower than 1/100 second, exposure is performed in a period of one cycle or more of the light amount change period of the flicker light source, so that the influence of flicker is reduced. Even if the exposure period is less than one period of the light quantity change period of the flicker light source, if the exposure period is close to one period of the light quantity change period of the flicker light source, the effect of flicker is relatively high. It is thought that there are few. Therefore, in this embodiment, when the shutter speed is faster than 8 ms, shutter control for reducing the influence of flicker is performed, and TVmax = 1/125 (seconds).

Further, the camera microcomputer 101 sets T_ShutterWait, which is a wait time from the flicker synchronization signal to the shutter start signal instructing the start of running of the shutter 104. The camera microcomputer 101 changes T_ShutterWait for each shutter speed, and the timing at which the light quantity change of the flicker light source is small comes to the center of the time from the start of exposure of the first line in the imaging region of the image sensor 103 to the end of exposure of the last line. To control. For example, T_ShutterWait is set as shown in Expression (4).
T_ShutterWait = (TVmax−TV) / 2 (4)
(However, TV <1/125)

  By setting T_ShutterWait as described above, control is performed so that the peak timing of the light amount of the flicker light source is at the center of the time from the start of exposure of the first line to the end of exposure of the last line in the imaging region of the image sensor 103. it can. FIG. 7 is a view showing a table in which the value of T_ShutterWait and the value of the shutter speed are associated with each other, and the table shown in FIG. 7 may be stored in the memory 102 or the like in advance.

  As described above, the example in which the timing of the peak of the light amount of the flicker light source is calculated in step S103 and the generation timing of the flicker synchronization signal is set based on the timing of the peak of the light amount of the flicker light source has been described. However, when the bottom timing of the light amount of the flicker light source is calculated in step S103, the generation timing of the flicker synchronization signal may be set based on the bottom timing of the light amount of the flicker light source.

  Thereafter, in step S105, the camera microcomputer 101 determines whether or not the switch SW2 for instructing the user to start the shooting operation is turned on by operating the release button. If the switch SW2 is not turned on, the process returns to step S101, and the series of operations in steps S101 to S104 is repeated to update the flicker light source light quantity change period and the flicker light source peak timing to the latest. To go. If the series of operations in steps S101 to S104 are repeated with a cycle of about 100 ms, for example, even if the fluctuation of the light amount change cycle of the flicker light source is about ± 0, 4 Hz, the deviation of the light amount change cycle within 100 ms is a maximum of ± It is about 0.4ms. Therefore, it is possible to perform shutter control that accurately reduces the influence of flicker, regardless of when the switch SW2 is turned on.

  Instead of repeating the operations in steps S101 to S104 in the same way, the photometric operation performed in step S101 and the flicker detection operation performed in steps S102 to S104 may be performed at different periods. As described above, a period of about 100 ms is sufficient for the flicker detection operation. However, in order to improve the responsiveness to a change in luminance of the subject, the photometry operation is performed with a period shorter than the period of the flicker detection operation, for example, about 50 ms. You may make it perform.

  If the switch SW2 is ON, the process proceeds to step S106. In step S106, the camera microcomputer 101 generates a shutter start signal by delaying the first flicker synchronization signal after SW2 is turned on by T_ShutterWait according to the determined shutter speed. Thereafter, the shutter 104 is driven according to the generated shutter start signal, and photographing is performed.

  As described above, as shutter control for reducing the influence of flicker, the shutter start signal is delayed by T_ShutterWait according to the shutter speed with respect to the flicker synchronization signal. Therefore, as shown in FIG. 6, even when the shutter speed is 1/1000 second or 1/200 second, the peak timing of the light amount of the flicker light source is from the start of exposure of the first line of the imaging region of the image sensor 103. It comes to the center of the time until the end of the exposure of the last line. In this way, by controlling the shooting timing based on the timing of the flicker feature points, it is possible to reduce exposure unevenness in one image due to the influence of the flicker. When shooting is completed, the camera microcomputer 101 determines in step S107 whether continuous shooting (continuous shooting) is performed. Whether or not continuous shooting is performed may be determined based on whether or not the state where SW2 is ON is maintained, or based on whether or not the continuous shooting mode is selected as the operation mode. You may judge.

  When continuous shooting is not performed, the process returns to S101, and when continuous shooting is performed, the process proceeds to step S108.

  In step S108, the camera microcomputer 101 determines the presence or absence of flicker. Here, the determination result in step S103 may be used. If there is no flicker, the process proceeds to step S109, and if there is flicker, the process proceeds to step S110.

  Here, an operation sequence between frames for continuous shooting (between shooting when performing continuous shooting) will be described with reference to FIG. FIGS. 8A and 8B are diagrams showing an operation sequence of the photometric sensor 108 and the ICPU 112 between frames for continuous shooting. FIG. 8A shows a case where there is no flicker, and FIG. 8B shows a case where there is a flicker. . In step S109, the photometric sensor 108 and the ICPU 112 operate as shown in FIG. 8A, and in step S110, the photometric sensor 108 and the ICPU 112 operate as shown in FIG. 8A.

  First, the operation sequence of the photometric sensor 108 and the ICPU 112 between the frames for continuous shooting when there is no flicker will be described with reference to FIG.

  The half mirror 105 that has been in the mirror-up state to guide the light beam to the image sensor 103 at the time of shooting moves to the mirror-down state to guide the light beam to the photometric sensor 108 after shooting. Immediately after moving from the mirror-up state to the mirror-down state, the half mirror 105 bounces (hereinafter referred to as a mirror bounce) due to an impact associated with the movement stop. When the mirror bounds converge and the half mirror 105 is in a stable mirror-down state, the photometric sensor 108 accumulates charges (hereinafter referred to as AE and tracking accumulation) and an image for obtaining an image signal used for photometry and subject tracking. Read the signal. The readout of the image signal accompanying the AE and tracking accumulation is preferably short in order to increase the frame speed (continuous shooting speed) of continuous shooting. Therefore, when the CCD is used for the photometric sensor 108, the above-described pixel addition reading is performed, and when the CMOS is used, the above-described thinning-out reading is performed. Then, the ICPU 112 performs calculation related to subject tracking (hereinafter referred to as tracking calculation) and photometry calculation based on the obtained image signal.

  The photometric sensor 108 accumulates electric charges (hereinafter referred to as accumulation for face detection) and reads out the image signal for obtaining an image signal used for detecting the face of the subject after reading out the image signal associated with AE and tracking accumulation. In order to perform face detection with high accuracy, the readout of the image signal accompanying the face detection accumulation is performed by setting the pixel addition number of the pixel addition readout and the number of thinned lines for the thinning readout rather than the readout of the image signal accompanying the accumulation for AE and tracking. Reduce. In the present embodiment, all pixel readout is performed without performing pixel addition readout or thinning readout. Then, the ICPU 112 performs a calculation related to the face detection of the subject (hereinafter referred to as a face detection calculation) based on the obtained image signal. The result of the face detection calculation is used for the following tracking calculation and photometry calculation. For example, the tracking calculation is performed using the face area of the subject detected by the face detection calculation as a tracking target, or the photometric calculation is performed by increasing the weight of the face area of the subject detected by the face detection calculation.

  Here, in order to increase the frame speed (continuous shooting speed) of continuous shooting, the face detection accumulation is preferably performed in parallel with the tracking calculation and the photometry calculation by the ICPU 112. In addition, since the image signal reading accompanying the face detection accumulation may be performed in a state where the light beam is not guided to the photometric sensor 108, a half mirror is used in order to increase the frame speed (continuous shooting speed) of continuous shooting. This is preferably performed while moving 105 to the mirror-up state.

  When the mirror bound after movement converges and the half mirror 105 is in a stable mirror-up state, the next photographing (exposure) is performed.

  When there is no flicker, continuous shooting is performed in such an operation sequence until the SW2 ON state is released. That is, charge accumulation for flicker detection and image signal reading (hereinafter referred to as flicker detection accumulation / reading) are not performed, flicker is not newly detected, and timings of flicker feature points are not calculated.

  Next, the operation sequence of the photometric sensor 108 and the ICPU 112 between the frames for continuous shooting when there is flicker will be described with reference to FIG.

  When the mirror bound converges and the half mirror 105 is in a stable mirror-down state, the photometric sensor 108 accumulates charges for flicker detection and reads out image signals (hereinafter referred to as flicker detection accumulation / readout). The flicker detection accumulation / reading is performed by a method similar to the method described in step S102 in FIG.

  Note that it is unlikely that the light source changes to another light source having a different flicker frequency during continuous shooting, and the frequency serving as a reference for the flicker frequency during continuous shooting may be considered constant. Therefore, the number of times of accumulation of charges for flicker detection may be less than the number of times performed in step S102 of FIG. 2 as long as the peak timing of the light amount of the flicker light source can be calculated. For example, the calculation of the peak timing of the light amount of the flicker light source only needs to have an accumulation count corresponding to at least one cycle of the light amount change period of the flicker light source. If the flicker light amount change period is about 8,33 ms, the peak timing of the light amount of the flicker light source can be accurately calculated by accumulating 5 times or more, and about 10 ms if accumulating. As described above, by performing simple flicker detection accumulation for calculating the peak timing of the light amount of the flicker light source between the frames for continuous shooting, the frame speed (continuous shooting speed) for continuous shooting is reduced. Can be suppressed.

  Then, the ICPU 112 performs flicker detection calculation based on the obtained image signal. This flicker detection calculation is performed by the same method as described in step S103 of FIG. As described above, the reference frequency of the flicker frequency during continuous shooting may be considered to be constant. Therefore, here, the peak timing of the light amount of the flicker light source is determined without determining the light amount change period of the flicker light source. You may calculate only. At this time, the timing of the flicker feature point represented by the latest detection result among the detection results is calculated.

  After the end of the flicker detection calculation, the camera microcomputer 101 updates the flicker synchronization signal to the latest one based on the detection result of the flicker detection calculation. That is, the shooting timing is controlled based on the latest flicker feature point timing calculated after the previous shooting.

  When the flicker detection accumulation / readout is completed, the photometric sensor 108 performs AE, tracking accumulation, and image signal readout. Here, in order to increase the frame speed (continuous shooting speed) for continuous shooting, the AE and tracking accumulation are preferably performed in parallel with the flicker detection calculation by the ICPU 112.

  The subsequent face detection accumulation and various calculations are the same as when there is no flicker described with reference to FIG.

  After the photometry calculation is completed, the camera microcomputer 101 generates a shutter start signal by delaying the latest flicker synchronization signal by T_ShutterWait according to the shutter speed determined based on the latest photometry calculation result. Take a picture.

  When there is flicker, continuous shooting is performed in such an operation sequence until the SW2 ON state is released.

  As described above, according to the present invention, even when there is a slight fluctuation in the commercial power supply frequency, the peak timing of the light amount of the flicker light source is calculated between the frames for continuous shooting, and each shooting is performed in accordance with the calculated peak timing. Therefore, a good image can be acquired.

  In the above embodiment, an example is described in which the half mirror 105 is provided and accumulation for various uses is performed by the photometric sensor 108 when the half mirror between the frames for continuous shooting is in the mirror down state. There may be a configuration without this. In that case, the photometric sensor 108 may not be provided, and the image sensor 103 may perform accumulation for various uses similar to the photometric sensor 108.

  Further, the order of various accumulations by the photometric sensor 108 shown in FIG. 8 is an example, and various accumulations may be performed in different orders.

  In FIG. 8, the accumulation of electric charges for obtaining an image signal used for photometry and the accumulation of electric charges for obtaining an image signal used for subject tracking are collectively performed as one accumulation. However, the accumulation may be performed separately. Absent.

  In addition, it may be configured not to perform subject tracking or subject face detection, and may be configured not to perform flicker detection accumulation when there is no flicker between frames for continuous shooting, and to perform flicker detection accumulation when there is flicker. That's fine. When flicker is present, flicker detection accumulation is performed, so the frame speed for continuous shooting will be lower than when there is no flicker. However, the effect of flicker can be reduced accurately, and shooting is performed under a flicker light source. Even in this case, a good image can be obtained. On the other hand, since there is no flicker detection accumulation when there is no flicker, it is possible to prevent unnecessary reduction in the frame speed of continuous shooting.

  The present invention can also be realized by executing the following processing. That is, software (program) that realizes the functions of this embodiment is supplied to a system or apparatus via a network or various storage media, and a computer (or CPU, MPU, etc.) of the system or apparatus reads out and executes the program. It is processing to do.

  In the above embodiment, the imaging apparatus to which the present invention is applied has been described. However, the present invention may be applied to an electronic device such as a PC that does not have an imaging function. For example, the light change characteristic of light from a photometric object may be calculated by an electronic device to which the present invention is applied, and the calculation result may be transmitted from the electronic device to an external device such as an imaging device.

  As mentioned above, although preferable embodiment of this invention was described, this invention is not limited to these embodiment, A various deformation | transformation and change are possible within the range of the summary.

DESCRIPTION OF SYMBOLS 100 Camera body 101 Camera microcomputer 103 Image pick-up element 105 Half mirror 108 Photometric sensor 112 ICPU

Claims (15)

A charge storage sensor;
Control means for controlling the driving of the sensor;
Calculation means for calculating a light quantity change characteristic of light from a subject based on a plurality of data obtained by performing a plurality of continuous charge accumulation and reading using the sensor by the control means. And
The calculation means calculates a first evaluation value by calculating a plurality of differences between the data obtained by the first interval among the plurality of data by changing a data set, and the first evaluation value is calculated by each other. The second evaluation value is calculated by obtaining a plurality of differences between the data obtained at the second interval different from the interval of the data by changing the data set, and the first evaluation value and the second evaluation value An electronic device characterized in that the light quantity change characteristic is calculated based on The first interval is set based on a reciprocal of a frequency twice the first frequency of the commercial power source,
2. The electronic device according to claim 1, wherein the second interval is set based on a reciprocal of a frequency twice as high as a second frequency different from the first frequency of a commercial power source. When the first evaluation value is less than a predetermined threshold value and the second evaluation value is greater than or equal to the threshold value, the calculation means has a light amount change period of 2 of the first frequency as the light amount change characteristic. The electronic apparatus according to claim 2, wherein the electronic apparatus calculates a reciprocal of the double frequency.   When the first evaluation value is greater than or equal to the threshold value and the second evaluation value is less than the threshold value, the calculating means has a reciprocal of the frequency at which the light quantity change period is twice the second frequency. The electronic device according to claim 3, wherein the electronic device is calculated as follows.   When the first evaluation value is less than the threshold value and the second evaluation value is less than the threshold value, the calculation means is the reciprocal of the frequency at which the light quantity change period is twice the first frequency. The electronic device according to claim 4, wherein the electronic device is calculated not to be a reciprocal of a frequency twice the second frequency.   When the first evaluation value is greater than or equal to the threshold value and the second evaluation value is greater than or equal to the threshold value, the calculation means compares the first evaluation value with the second evaluation value. The electronic device according to claim 4, wherein the light amount change period is calculated based on the electronic device.   When the first evaluation value is greater than or equal to the threshold value and the second evaluation value is greater than or equal to the threshold value, and the second evaluation value is greater than the first evaluation value, The electronic apparatus according to claim 6, wherein the light quantity change period is calculated to be a reciprocal of a frequency that is twice the first frequency.   When the first evaluation value is greater than or equal to the threshold value and the second evaluation value is greater than or equal to the threshold value, and the first evaluation value is greater than the second evaluation value, The electronic apparatus according to claim 6, wherein the light quantity change period is calculated to be a reciprocal of a frequency that is twice the second frequency.   When the first evaluation value is equal to or greater than the threshold value and the second evaluation value is equal to or greater than the threshold value, the calculating means is configured such that the first evaluation value is equal to the second evaluation value. 9. The light quantity change period is calculated not to be a reciprocal of a frequency twice the first frequency and a reciprocal of a frequency twice the second frequency. The electronic device as described in.   The control means controls the driving of the sensor so as to accumulate charges at intervals shorter than the reciprocal of the frequency twice the first frequency and the second frequency of a commercial power supply, and controls the plurality of data. The electronic device according to claim 2, wherein the electronic device is acquired.   The control means drives the sensor at a predetermined frame rate based on a least common multiple of a frequency twice the first frequency and a frequency twice the second frequency, and performs the plurality of consecutive charges. The electronic device according to claim 2, wherein the electronic device is controlled to perform accumulation. The electronic apparatus according to claim 11 , wherein the control unit controls the sensor so as to perform charge accumulation and readout 12 times continuously at the predetermined frame rate. A control step for controlling the driving of the charge storage type sensor;
A calculation step of calculating a light quantity change characteristic of light from the subject based on a plurality of data obtained by performing a plurality of continuous charge accumulation and reading using the sensor by the control step. And
The calculation step calculates a first evaluation value by obtaining a plurality of differences between the data obtained by the first interval among the plurality of data by changing a data set, and the first evaluation value is calculated by each other. The second evaluation value is calculated by obtaining a plurality of differences between the data obtained at the second interval different from the interval of the data by changing the data set, and the first evaluation value and the second evaluation value The light quantity change characteristic calculation method, wherein the light quantity change characteristic is calculated based on the method.   A program for causing a computer to execute the calculation method according to claim 13.   A computer-readable storage medium storing a program for causing a computer to execute the calculation method according to claim 13.