JP5444651B2 - Camera device, photographing method thereof and photographing control program - Google Patents

Description

  The present invention relates to a camera apparatus having a configuration capable of flash photography, a photography method thereof, and a photography control program.

Conventionally, it is possible to shoot a subject with an optimal exposure amount regardless of the position of the main subject within the angle of view, without being affected by uneven flash light (strobe light) during flash photography. For example, Patent Document 1 below describes a technique for adjusting the light emission amount using distance information to a main subject, lens aperture diameter information, and the like.
JP-A-8-327886

  However, according to the above technique, it is possible to always ensure proper exposure for the main subject, but the amount of flash light applied to the subject within the angle of view decreases in proportion to the square of the distance. Proper exposure cannot be ensured for the subject in the background portion located behind the subject or the foreground portion located in front. Therefore, the amount of exposure overshoots in the foreground part, resulting in overexposure (brightness saturation), and the background part is underexposed and blackout (darkness) occurs. There was a problem that the unnatural state was not improved.

  The present invention has been made in view of such conventional problems, and provides a camera device capable of obtaining an image in which the brightness of each part is natural even in flash photography, a photography method thereof, and a photography control program. With the goal.

In order to solve the above-described problem, the camera device according to the first aspect of the present invention includes an imaging unit that captures an image of a subject and obtains a captured image, and a light-emitting unit that irradiates photographing auxiliary light toward the subject. In the camera apparatus, distance acquisition means for acquiring the distance to each part of the subject within the angle of view and the distance to the main subject, and emission of shooting auxiliary light at a light emission amount suitable for shooting the main subject by the light emission means Correction that corrects the brightness of each part of the captured image acquired by the imaging unit in accordance with the distance to each part of the subject acquired by the distance acquiring unit and the distance to the main subject at the time of predetermined shooting with operation Means, and a recording control means for performing control to record a photographed image corrected by the correcting means as a final photographed image ,
The correction means corrects the brightness of each part of the subject to be reduced when the distance to each part of the subject is closer than the distance to the main subject, based on the distance to the main subject. When the distance to each part of the subject is longer than the distance to the main subject, correction is made to increase the brightness of each part of the subject .

  In the camera device according to the second aspect of the present invention, a second parallax exists between the first captured image and the first captured image acquired by the imaging unit. A second imaging unit configured to acquire a captured image, wherein the distance acquisition unit is acquired by the second imaging unit simultaneously with the first captured image acquired by the imaging unit and the first captured image; The distance to the respective parts of the subject within the angle of view is obtained based on the second photographed image, and the correction unit is configured to obtain the first photographed image obtained by the imaging unit and the second photographed during the predetermined photographing. Using one of the second captured images acquired by the imaging unit as a correction target, the brightness of each part of the correction target is corrected according to the distance to each part of the subject acquired by the distance acquisition unit. It is characterized by that.

  In the camera device according to the third aspect of the present invention, the reference distance acquisition unit that acquires the distance to the main subject within the angle of view, and the optical axis of the incident light to the second imaging unit A neutral density filter movable to an inserted insertion position and a release position deviated from the optical axis, and a position control means for controlling the position of the neutral density filter to the insertion position during the predetermined photographing, The correction unit corrects the brightness of each part of the first captured image acquired by the imaging unit during the predetermined shooting according to the distance to each part of the subject acquired by the distance acquisition unit, and In the first photographed image, a distance to each part of the subject acquired by the distance acquisition unit corresponds to a foreground portion that is closer than a distance to the main subject acquired by the reference distance acquisition unit. The brightness of each part is corrected to the brightness of the corresponding part of the second photographed image acquired by the second imaging means in a state where the position of the neutral density filter is controlled to the insertion position by the position control means. It is characterized by doing.

  In the camera device according to the fourth aspect of the present invention, the distance to each part of the subject acquired by the distance acquisition unit in the first photographed image corrected by the correction unit is the reference distance acquisition. Noise reduction means for performing noise reduction processing to a degree corresponding to the distance acquired by the distance acquisition means on each part corresponding to a background portion farther than the distance to the main subject acquired by the means, the recording control means Is characterized in that control is performed to record the first captured image after the noise reduction processing by the noise reduction means as a final captured image.

  In the camera device according to the fifth aspect of the present invention, distance measuring light emitting means for irradiating the subject with a light pulse for distance measurement is provided, and the distance acquisition means includes the light emission for distance measurement. The distance to each part of the subject within the angle of view is acquired based on the time required for the light pulse emitted by the means to reach the object and be reflected and returned from there. .

  In the camera device according to the sixth aspect of the present invention, the focal length of the photographing optical system capable of adjusting the focal length and the focal length of the photographing optical system are focused on subjects located at different distances. The corresponding distance is controlled to be changed in order to different known focal lengths, and the imaging control means is configured to cause the imaging means to capture a subject and acquire a plurality of captured images each time the focal length is changed. The distance acquisition means is based on a plurality of captured images acquired by the imaging means according to the control of the imaging control means and a distance corresponding to a focal length at the time of acquisition of each of the plurality of captured images. The distance to each part of the subject is acquired.

  In the camera device according to the seventh aspect of the present invention, reference distance acquisition means for acquiring a distance to a main subject within an angle of view, and the distance acquisition means in a photographed image corrected by the correction means The distance to each part of the subject acquired by the above is determined in accordance with the distance acquired by the distance acquiring unit in each part corresponding to the background portion farther than the distance to the main subject acquired by the reference distance acquiring unit. Noise reduction means for performing noise reduction processing is provided, and the recording control means performs control to record a captured image after the noise reduction processing by the noise reduction means as a final captured image.

  Further, in the camera device according to the invention of claim 8, the light emission amount of the photographing auxiliary light is a light emission amount capable of irradiating a subject with an appropriate irradiation amount to a subject located at a different distance from each other, The corresponding distance is controlled in sequence to different known light emission amounts to cause the light emission means to perform a plurality of light emission operations, and at the same time, the image pickup means images the subject in accordance with the light emission operations according to the respective light emission amounts. Imaging control means for acquiring a plurality of images, and the correction means targets a predetermined captured image among a plurality of captured images acquired by the imaging means according to the control of the imaging control means. Other than a plurality of captured images, the distance at the time of acquisition of each captured image is based on the distance corresponding to the amount of light emission at the time of acquisition and the distance to each part of the subject acquired by the distance acquisition means. A target portion having a distance corresponding to the amount is specified, and partial images of a plurality of subject portions having different distances specified in each captured image are combined with a plurality of corresponding subject portions to be corrected. The brightness of each part is corrected.

In the camera device according to the ninth aspect of the present invention, a subject located at the center of the angle of view, an arbitrary subject within the angle of view designated by the user, or an angle within the angle of view where the face is detected. A specifying unit that specifies a subject as a main subject is provided, and the correction unit performs the imaging when performing a predetermined shooting with a light emission operation of a shooting auxiliary light suitable for shooting the main subject specified by the specifying unit by the light emitting unit. The brightness of each part of the captured image acquired by the means is corrected according to the distance to each part of the subject acquired by the distance acquisition means and the distance to the main subject.
Further, in the camera device according to the invention of claim 10, the correcting means is used by the imaging means at the time of predetermined photographing accompanied by a light emitting operation of photographing auxiliary light suitable for photographing the main subject by the light emitting means. The brightness of each part of the acquired photographed image is corrected with a correction magnification according to the difference between the distance to each part of the subject acquired by the distance acquisition unit and the distance to the main subject.
In addition, in the photographing method according to the invention of claim 11, in a camera apparatus comprising: an imaging unit that captures an image of a subject and obtains a captured image; and a light emitting unit that irradiates photographing auxiliary light toward the subject. Obtaining a distance to each part of the subject within the angle of view and a distance to the main subject when performing a predetermined photographing accompanied by a light emission operation of a photographing auxiliary light with a light emission amount suitable for photographing the main subject by the light emitting means; A step of correcting the brightness of each part of the captured image acquired by the imaging unit according to the distance to each part of the acquired subject and the distance to the main subject, and the corrected captured image as a final captured image look including the step of recording a step of the correction, the relative to the distance to the main subject, near than the distance to the distance the main subject to each part of the subject If it corrected to lower the brightness of each part of the object, when the distance to each part of the object is farther than the distance to the main subject that is corrected so as to raise the brightness of each part of the subject Features.

In addition, in the photographing control program according to the twelfth aspect of the present invention, a camera apparatus comprising: an imaging unit that captures an image of a subject and obtains a captured image; and a light emitting unit that emits photographing auxiliary light toward the subject. The distance between the subject and each of the subject within the angle of view and the distance to the main subject when performing predetermined shooting accompanied by a light emission operation of the auxiliary shooting light with a light emission amount suitable for photographing the main subject by the light emitting means. A procedure for correcting the brightness of each part of the captured image acquired by the imaging unit according to the distance to each part of the acquired subject and the distance to the main subject, and the corrected captured image to execute the steps of recording as a final photographed image, wherein the step of correcting, the with respect to the distance to the main subject, the distance to each part of the subject is the When the distance to the subject is shorter, the brightness of each part of the subject is corrected to be lowered.When the distance to each part of the subject is farther than the distance to the main subject, the brightness of each part of the subject is corrected. It is characterized by correcting so as to increase

  According to the present invention, it is possible to obtain an image in which the brightness of each part is natural even in flash photography.

Hereinafter, an embodiment of the present invention will be described with reference to the drawings.
(Embodiment 1)
FIG. 1 is an external perspective view showing a stereo camera 1 according to this embodiment. The stereo camera 1 has a pair of left and right lenses 3a and 3b on the front of the camera body 2, and is configured so that an arbitrary subject can be photographed simultaneously from different positions on the left and right via the lenses 3a and 3b. Yes. Further, on the front surface of the camera body 2, a flash light emitting unit 4, which is a light emitting means for irradiating a subject with strobe light (shooting auxiliary light) as necessary, is provided above the pair of lenses 3 a and 3 b. A shutter switch 5 is provided on the upper surface of the camera body 2. Although not shown in the drawing, the camera body 2 is provided with various switches other than the shutter switch 5 including a power switch and a mode switch. The shutter switch 5 is configured to have a so-called half shutter function capable of two-stage operation including a half-press operation (half shutter) and a full-press operation.

  FIG. 2 is a block diagram showing an outline of the electrical configuration of the stereo camera 1. The stereo camera 1 has a pair of imaging blocks 11a and 11b. Each imaging block 11a and 11b has lens blocks 12a and 12b, optical system driving units 13a and 13b, optical system control units 14a and 14b, and imaging. It consists of elements 15a and 15b and AD converters 16a and 16b. In the following description, if necessary, one shooting block 11a is referred to as a main shooting block, and the other shooting block 11b is referred to as a sub shooting block.

  The lens blocks 12a and 12b include the lenses 3a and 3b and a diaphragm (not shown). The lenses 3a and 3b have a parallel optical axis, and each lens group includes a focus adjustment lens. Yes. The optical system driving units 13a and 13b are composed of a lens motor for adjusting the focus by driving the lens group in the optical axis direction, and actuators for mechanically driving the lens shutter and the diaphragm. The control units 14 a and 14 b control the driving of the lens motor and the actuator based on a command from the control unit 18.

  The imaging elements 15a and 15b are CCDs in the present embodiment, and are driven by a driving circuit (not shown) to convert an optical image of the subject formed by the lenses 3a and 3b into an electrical signal to be used as an imaging signal. Output. Note that the image sensors 15a and 15b may be other image sensors such as a CMOS sensor. In the present embodiment, the image pickup device 15b on the sub photographing block 11b side is the second image pickup means of the present invention. The AD conversion units 16a and 16b convert the imaging signals output from the imaging elements 15a and 15b into digital signals, that is, image data, and output them to the image processing unit 17, respectively.

  That is, the stereo camera 1 includes two optical systems (shooting optical systems) and an image pickup system that are independent from each other, so that an arbitrary subject can be shot simultaneously from different positions on the left and right as described above.

  The image processing unit 17 includes image data input from the AD conversion units 16a and 16b, more specifically, an image composed of pixel information of color components corresponding to the color arrangement of the color filters provided on the light receiving surfaces of the image sensors 15a and 15b. Various filter processing (pre-filter processing) such as color conversion, flaw correction, and size conversion for converting data (in this embodiment, Bayer data corresponding to the Bayer array) into RGB data having RGB color components for each pixel (Resolution conversion) processing and image data compression / decompression processing are performed. Furthermore, at the time of flash photography, which will be described later, it functions as distance acquisition means, correction means, and noise reduction means of the present invention, and distance measurement, which will be described later, based on image data acquired (captured) by both of the imaging blocks 11a and 11b. Then, correction processing relating to image quality including luminance correction for each pixel for image data, and noise reduction are performed.

  The stereo camera 1 also includes an image processing memory 19 that temporarily stores image data being processed by the image processing unit 17, a recording memory 20 that records a compressed image, and the shutter for the user to operate the stereo camera 1. The camera has a camera operation unit 21, a display unit 22, the flash light emitting unit 4, and a flash control unit 23, which include various switches including the switch 5.

  The display unit 22 includes a display device such as a liquid crystal panel disposed on the back surface (not shown) of the camera body 2 and a driving circuit thereof, and displays an image processed by the image processing unit 17. The flash light emitting unit 4 is a light emitting tube such as a xenon tube, which is a light emission source of strobe light, and a reflector. The flash control unit 23 includes a light emitting capacitor, a charging circuit thereof, a driving circuit for the light emitting tube, a dimming circuit. And controls the light emission operation and the light emission time (light emission amount) of the flash light emission unit 4 in accordance with a command from the control unit 18.

  The control unit 18 includes a CPU and its peripheral circuits, a ROM in which various control programs are stored, and a working RAM. The control unit 18 operates as described above by operating based on the control program and the stitch operation contents in the camera operation unit 21. Control each part. The control program includes a program used for AF (automatic focus) control by a contrast detection method and AE (automatic exposure) control including light amount adjustment at the time of flash photography. Various types of data used are also stored. Further, a shooting notification program for causing the stereo camera 1 to perform the operation described later by causing the control unit 18 to function as the recording control unit and the reference distance acquisition unit of the present invention during flash shooting is also included.

  Next, in the stereo camera 1, for example, when the flash shooting mode is set by the user, for example, an auto mode that automatically emits light according to the brightness of the subject or a forced flash mode that always emits light is set. The operation will be described with reference to the flowchart of FIG.

  At the time of flash photography, in the stereo camera 1, first, the control unit 18 initializes the imaging elements (CCD) 15a and 15b of the pair of photographing blocks 11a and 11b (sets operation parameters such as charge accumulation time), and performs predetermined processing. The subject imaging operation at the frame rate is started (step SA1). Thereafter, when the shutter switch 5 is half-pressed at an arbitrary time (YES in Step SA2), the control unit 18 performs AF control at that time, and in this embodiment, the subject located at the center in the angle of view is set as the main subject. Then, focusing on that portion is performed (step SA3).

  Note that the main subject to be focused does not have to be in the center of the angle of view. For example, an arbitrary portion within the angle of view specified in advance by the user, or a human face detected by a known face detection technique. It is also possible to use a subject that is automatically set as described above. In the AF process, the position adjustment of the lens groups constituting the lenses 3a and 3b described above may be individually performed on the main photographing block 11a side and the sub photographing block 11b side, or the sub photographing. The position adjustment on the block 11b side may be linked to the position adjustment on the main photographing block 11a side.

  Subsequently, after the AF control is finished, the brightness of the main subject is measured based on the image acquired (captured) by the imaging device (CCD) 15a of the main imaging block 11a immediately before (or immediately after) (step SA4). ) The flash emission amount suitable for photographing the main subject is calculated (step SA5). The amount of light emitted at this time is the distance to the subject corresponding to the adjustment position of the lens group in the focused state, that is, the distance to the main subject is set as the adjustment position of the lens group prepared in advance. It is acquired from a distance acquisition table indicating the distance to the corresponding subject, and is obtained by calculating based on the acquired distance and the brightness of the subject. The acquired distance to the subject is sent to the image processing unit 17. Thereafter, the controller 18 sets shooting conditions such as a shutter speed, ISO sensitivity, and aperture diameter (aperture value) for obtaining an appropriate exposure based on the light emission amount (step SA6).

  Eventually, when the shutter switch 5 is fully pressed (YES in step SA7), exposure of the image sensors 15a and 15b of the pair of imaging blocks 11a and 11b is started under the set imaging conditions (step SA8), and the exposure period During this time, the flash light emitting unit 4 is caused to emit flash light having a predetermined light emission amount calculated previously (step SA9), and exposure is terminated when a time corresponding to the shutter speed is reached (step SA10). As a result, different image data (Bayer data) acquired individually under the same shooting conditions are input to the image processing unit 17.

  Thereafter, in the stereo camera 1, the image processing unit 17 performs the above-described pre-filter processing on each input image data to convert the image data to RGB data (step SA <b> 11), and each RGB data Is converted to an image size designated in advance by the user, and the converted RGB data is temporarily stored in the image processing memory 19 (step SA12). Each RGB data of this resolution conversion is a photographed image.

  In the following, the side acquired by the main shooting block 11a described above is referred to as a main shooting image, and the side acquired by the sub shooting block 11b is referred to as a sub shooting image. It shall be called a stereo image. In the present embodiment, the main photographed image is the first photographed image of the present invention, and the sub photographed image is the second photographed image of the present invention.

  Subsequently, the image processing unit 17 performs a distance measurement process based on the stereo image, and removes the distance (from the camera body 2) in each of all the subject parts in the photographed image excluding the main subject part to be focused. ) Is measured (step SA13).

As is well known, in the stereo image, as described above, the optical axes of the lenses 3a and 3b are parallel to each other, and as shown in FIG. 5, the imaging surfaces (light receiving surfaces) of both the imaging elements 15a and 15b. In a configuration in which the u-axis and u′-axis of A and B are in the same direction on a straight line and the distance b is secured between the elements, the focal length is f and the position of the subject is the spatial coordinates (X, Y, Z )
X = bu / (u−u ′)
Y = bv / (u−u ′)
Z = bf / (u−u ′)
It can be expressed as

  This is because, when the distance Z from the camera to the subject is constant and bf, which is a camera parameter, is constant, imaging of one of the subject images (optical images) formed on both imaging surfaces A and B is performed. This means that it is inversely proportional to the difference between the position on the u-axis of the surface A and the position on the u′-axis of the other imaging surface B, that is, the parallax. At this time, the position on the v-axis is the same as the position on the v′-axis, and the position on the u-axis and the position on the u′-axis are the same from the camera. This differs depending on the distance Z to the subject. The difference between the position on the u-axis and the position on the u′-axis is parallax, and the smaller the distance Z (the farther the subject is), the smaller it becomes.

  In the distance measurement process in step SA13, the distance information of all parts of the subject is measured based on this. FIG. 4 is a flowchart showing distance measurement processing by the image processing unit 17.

  In this process, first, feature points for one line are extracted by performing edge detection on the main captured image with reference to the main captured image of the stereo images (step SA101). Next, the sub-photographed image is searched for a point determined to have the highest correlation with each feature point for one line extracted within the predetermined search range set by feature-based matching, and the searched point is a corresponding point. And a horizontal shift amount (parallax) between the feature point of the main captured image and the corresponding point of the sub captured image is calculated (step SA102), and the calculation result is used as distance data corresponding to the recorded image. Store in the processing memory (step SA103).

  The above processing is repeated while sequentially changing the processing target lines, and when distance data of feature points can be obtained for all lines (YES in step SA104), the main subject is obtained for the distance data of each feature point. And the distance from the camera at all feature points based on the result and the distance of the main subject acquired in step SA5 described above. Calculate (step SA105). Furthermore, an area surrounded by a plurality of feature points having substantially the same distance from the camera in the main photographed image is assumed to be a subject portion having the same distance, and the image is divided into a plurality of subject areas for each same distance ( In step SA106), distance information in units of pixels is acquired by assigning the distance of the feature point surrounding the subject area to each pixel in the same subject area (step SA107). This completes the distance measurement process.

  Subsequently, returning to the processing of FIG. 3, the image processing unit 17 corrects the luminance of the main captured image for each pixel in accordance with the distance from the camera (step SA14). In such processing, the correction magnification corresponding to the distance from the camera is determined for each of the plurality of subject areas described above, and the luminance of each pixel is corrected with the correction magnification for each subject area including each pixel.

  FIG. 6 is a conceptual diagram showing a correction magnification acquisition table T1 used for such correction. The correction magnification acquisition table T1 corresponds to the distance to the subject corresponding to each of the distance ranges divided in advance, and the correction magnification of the brightness that varies depending on the distance to the main subject that is the calculation reference of the flash emission amount at the time of shooting. Each correction magnification is a magnification determined in advance according to the increase / decrease in the amount of flash light irradiation caused by the difference in distance from the main subject.

  In the above correction, the luminance of each pixel is corrected with the correction magnification indicated by the correction magnification acquisition table T1, and the distance (distance range) to the main subject is used as a reference, and the distance within the subject area is shorter than that. The brightness of the pixel is lowered, and conversely, the brightness of the pixel in the subject area farther than that is raised. Thereby, the excess or deficiency of the brightness is corrected according to the increase or decrease in the amount of flash light irradiation caused by the difference in distance from the main subject in each pixel in each subject area, and in each pixel in each subject area, Appropriate luminance is obtained when the distance to the subject in each subject area is the same as the distance to the main subject.

  Therefore, in the corrected image (main photographed image), the exposure amount is overexposed in the foreground part, resulting in overexposure (luminance saturation), or the exposure amount is insufficient in the background part. As a result, an unnatural state in which blackout (a completely dark state) occurs is improved.

  Further, the image processing unit 17 performs noise reduction according to the distance to the subject for pixels in each subject area excluding the region corresponding to the main subject of the image (main photographed image) (step SA15). ).

  FIG. 7 is a conceptual diagram showing a noise reduction level acquisition table T2 used for such processing. The noise reduction level acquisition table T2 corresponds to the distance to the subject corresponding to each of the distance ranges divided in advance, and the noise reduction level varies depending on the distance to the main subject that is a calculation reference of the flash emission amount at the time of shooting. Is shown. As shown in the figure, each noise reduction level is determined in advance only for a subject area that is farther than the distance (distance range) to the main subject, and in this embodiment, there are three levels: large, medium, and small. .

  In the noise reduction process, a higher level of noise reduction process is applied to the pixels in the subject area where the distance to the subject in the area is longer than the distance (distance range) to the main subject. As a result, noise that becomes more prominent in the image area is reduced as the subject area has a smaller amount of flash light irradiation than the main subject and has a larger luminance increase rate (correction magnification) at the time of luminance correction in step SA14.

  Therefore, in the processed image (main photographed image), the noise of the background subject portion is reduced while maintaining the image quality of the main subject portion.

  Thereafter, the image processing unit 17 performs color correction such as white balance on the image after noise reduction (step SA16), and the image after color correction is displayed on the display unit 22 (step SA17). The color-corrected image is compressed by the image processing unit 17 (step SA18), and finally recorded in the recording memory 20.

  As described above, at the time of flash shooting with the stereo camera 1 of the present embodiment, the shot image acquired on the main shooting block 11a side is finally recorded, and the above-described luminance correction processing is performed on the shot image. As a result, the overexposure amount in the foreground part may cause overexposure (brightness saturation) in the foreground part, or the exposure amount may be insufficient in the background part, resulting in blackout (pure darkness). You can improve the unnatural state. Therefore, it is possible to obtain an image in which the brightness of each part is natural even in flash photography. Furthermore, in the present embodiment, by performing the noise reduction process described above, the image quality of the main subject portion is maintained with respect to noise generated in the subject portion of the background due to the natural brightness of each portion in the image. Since it can be reduced as it is, a higher quality image can be obtained.

  FIG. 8 is an explanatory diagram showing a difference between an image obtained when the above-described flash photography is performed in a room and an image obtained by photography using another photography method. FIG. 6A shows a stereo camera 1 at the time of shooting, a main subject (person) A, foreground subjects (desks and chairs) B and C located in front of it, and a background subject (door) located behind them. It is a top view which shows the positional relationship with window and D) and E. FIG. FIG. 5B shows an example of an image in which the brightness of each part is natural when shooting without using a flash in a sufficiently bright environment, and FIG. 6C shows an image in a dark environment. An example of an image with noticeable noise obtained when performing high-sensitivity shooting, FIG. 6D is an image obtained when performing general flash shooting in a dark environment, and is applied to the foreground subjects B and C. An example of an image in which overexposure occurs and the background objects D and E are blacked out, and FIG. 8E is an example of an image obtained when the flash shooting of the present embodiment is performed in a dark environment. is there. As shown in the figure, by performing the above-described flash photography, the brightness of each part is natural as in the case shown in FIG. 5B, and the background D is different from that shown in FIG. , E noise can be obtained.

  In addition to the above, in the present embodiment, the distance from the camera in each part of the subject in the image necessary for the luminance correction processing is based on a stereo image (main captured image and sub-captured image) captured simultaneously in one shooting. Therefore, the color of each part of the subject is compared with the distance from the camera in each part of the subject, for example, compared to the case where the flash light is pre-flashed before the actual shooting and obtained from the luminance information of each part of the subject in the captured image. It is possible to obtain an accurate distance without being affected by. Therefore, appropriate luminance correction processing can be performed regardless of the color of the subject, and an image in which the brightness of each part is more natural can be obtained with certainty. In addition, unlike the third embodiment to be described later, it is possible to cope with flash photography for a moving subject.

  Regarding the noise reduction of the background subject portion described above, when the background subject is close to the main subject, the noise is slight, and the distance to the background subject is so far that the noise becomes significant. In many cases, the subject portion is blurred. Therefore, the noise reduction process described above does not necessarily have to be performed. For example, it may be abolished or the user may be able to set the presence or absence of the process.

(Embodiment 2)
Next, a second embodiment of the present invention will be described. As in the first embodiment, the present embodiment relates to a stereo camera that includes two optical systems and an imaging system that are independent from each other and can simultaneously photograph an arbitrary subject from different positions on the left and right.

  FIG. 9 is a block diagram showing an outline of the electrical configuration of the stereo camera 51 in the present embodiment. As is apparent from the figure, since it is the stereo camera 1 (FIG. 2) described in the first embodiment, the same portions are denoted by the same reference numerals and only different portions will be described.

  That is, the stereo camera 51 is provided with an ND filter (dark filter) 52 for reducing the amount of light incident on the image sensor 15b between the lens 33b and the image sensor 15b of the sub photographing block 11b. Yes. The optical system drive unit 13b of the sub photographing block 11b includes an actuator that mechanically drives the ND filter 52. The optical system control unit 14b drives the actuator based on a command from the control unit 18. By controlling, the ND filter 52 can move to the insertion position (position shown in the figure) inserted on the optical axis of the incident light to the image sensor 15b and the release position off the optical path. Yes. That is, the control unit 18 functions as the position control means of the present invention.

  The stereo camera 51 of the present embodiment operates as follows during flash photography under the control of the control unit 18. Hereafter, the operation | movement at the time of flash imaging | photography in the stereo camera 51 of this embodiment is demonstrated according to the flowchart of FIG.

  Also in the present embodiment, at the time of flash photographing, as in the first embodiment, the control unit 18 first initializes the image sensors (CCD) 15a and 15b of the pair of photographing blocks 11a and 11b, thereby obtaining a predetermined value. The subject imaging operation at the frame rate is started (step SB1). After that, when the shutter switch 5 is half-pressed (YES in step SB2), focusing on the main subject is performed by AF control at that time (step SB3). .

  After the AF control ends, unlike the first embodiment, first, it is determined whether or not there is a sub-subject within the angle of view that is closer to the main subject than the main subject, and such a sub-subject exists. Only in the case where it has been (YES in step SB4), the above-described ND filter 52 is inserted into the optical system of the sub photographing block 11b (step SB5). In step SB4, for example, when adjusting the position of the lens groups constituting the lenses 3a and 3b described above by AF control, for example, the change of the high-frequency component is sequentially performed also in regions other than the main subject (other than the center of the screen). Confirmation is performed by confirming whether or not a peak appears in the high frequency component while the position of the lens group is closer to the in-focus position.

  Subsequently, in the stereo camera 51, as in steps SA4 to SA13 in FIG. 3 described in the first embodiment, a stereo image is acquired by the image pickup devices 15a and 15b with the main shooting block 11a and the sub shooting block 11b. The image processing unit 17 performs a distance measurement process based on the stereo image (see FIG. 4), and each of all the subject parts (feature points described above) in the photographed image excluding the main subject part that is a focus target. The distance from the camera body 2 is measured (steps SB6 to SB15).

  Thereafter, the image processing unit 17 corrects the luminance of the main captured image for each pixel according to the distance from the camera by a luminance correction process different from that of the first embodiment (step SB16). FIG. 11 is a flowchart showing the brightness correction process.

  In such processing, the following processing is performed for each pixel. First, with respect to the target pixel, it is confirmed whether or not the distance to the subject in the subject area including the target pixel is closer than the appropriate distance in the flash light emitted in step SB11, that is, the distance to the main subject. In this case (YES in step SB101), the luminance of the pixel is corrected to the luminance of the corresponding pixel in the image data with the ND filter (sub-photographed image) (step SB102). That is, the luminance of the pixel in the subject area corresponding to the sub-subject that is closer to the camera than the main subject is replaced with the luminance of the pixel of the corresponding sub-photographed image.

  Further, when the distance to the subject in the subject area including the target pixel is longer than the appropriate distance (step SB101 is NO, step SB103 is YES), the brightness of the pixel is changed to the brightness correction process in the first embodiment. Similar to (step SA14 in FIG. 3), correction is performed with a correction magnification corresponding to the distance (step SB104). Furthermore, when the distance to the subject in the subject area including the target pixel is equal to the appropriate distance (NO in both steps SB101 and SB103), the luminance of the pixel is maintained as it is without performing luminance correction (step SB5). ). Then, the above processing is repeated while changing the target pixel, and when the processing is completed for all the pixels (YES in step SB106), the luminance correction processing is ended.

  Subsequently, returning to the processing of FIG. 10, the noise reduction according to the distance to the subject for each subject area excluding the region corresponding to the main subject of the main captured image described in the first embodiment. Processing is performed (step SB17). Thereafter, color correction is performed on the main photographed image and the corrected image is compressed and recorded in the recording memory 20 by processing similar to steps SA16 to SA19 in FIG. 3 described in the first embodiment. (Steps SB18 to SB21).

  As described above, also in the stereo camera 51 of the present embodiment, at the time of flash photography, the brightness of each part of the main photographed image that is finally recorded is obtained from the camera in the brightness correction process of step SB16 different from the first embodiment. By correcting according to the distance, it is possible to obtain an image in which the brightness of each part is natural even in flash photography. Further, the same noise as in the first embodiment is added to the image after the brightness correction. By performing the reduction process, a higher quality image can be obtained. In addition, flash photography for a moving subject can also be handled.

  In addition to the above, in the present embodiment, during flash shooting, if there is a sub-subject within the angle of view that is closer to the main subject than the main subject, the sub-photographing block 11b side selects the subject via the ND filter 52. When sub-images are acquired by capturing images and the luminance of the main captured image is corrected pixel by pixel according to the distance from the camera in the luminance correction process, it corresponds to sub-subjects that are closer to the camera than the main subject. For the pixels in the subject area, the luminance is replaced with the luminance of the pixel of the corresponding sub-photographed image, and the luminance of the other pixels is corrected in the same manner as in the first embodiment. In other words, the brightness of the foreground part of the main subject (the part corresponding to the sub-subject) that is likely to be overexposed is replaced with the brightness of the pixel on the side of the sub-photographed image, so that the overexposure in the foreground part is substantially taken. At the time, the ND filter 52 prevents it.

  Therefore, unlike the first embodiment, the foreground portion not only prevents whiteout, but also does not use image flash in a sufficiently bright environment without any loss of image information due to luminance saturation during shooting. It is possible to ensure image quality that is closer to that when shooting.

(Embodiment 3)
Next, a third embodiment of the present invention will be described. As in the first embodiment, the present embodiment relates to a stereo camera that includes two optical systems and an imaging system that are independent from each other and can simultaneously photograph an arbitrary subject from different positions on the left and right. The stereo camera of the present embodiment has the electrical configuration shown in FIG. 2, and the control unit 18 functions as an imaging control unit and a correction unit of the present invention during flash photography, and performs the following operation on the stereo camera. It is configured to

  12 and 13 are flowcharts showing the operation at the time of flash photographing of the stereo camera in the present embodiment.

  Also in the present embodiment, at the time of flash photographing, as in the first embodiment, the control unit 18 first initializes the image sensors (CCD) 15a and 15b of the pair of photographing blocks 11a and 11b, thereby obtaining a predetermined value. The subject imaging operation at the frame rate is started (step SC1). When the shutter switch 5 is half-pressed (YES in step SC2), the main subject is focused by AF control (step SC3). When the AF control is completed, the brightness of the main subject is measured based on the image captured by the image sensor (CCD) 15a of the main imaging block 11a (step SC4).

  Subsequently, in the present embodiment, the appropriate light emission amount that is the flash light emission amount according to the distance to the main subject is calculated in the same manner as in the first embodiment, and the subjects at a plurality of positions whose distances from the camera are different from each other. A plurality of levels of flash emission suitable for photographing is calculated (step SC5). Here, the amount of flash emission at each stage is the range of each distance division (1) when the range before and after the distance to the main subject is divided into a plurality of ranges in the distance range from the closest distance that can be taken to infinity. .0m to 3.0m, etc.). The calculated relationship between the flash emission amount at each stage and the range of each distance section is stored in an internal memory (RAM). Thereafter, photographing conditions such as shutter speed, ISO sensitivity, aperture diameter (aperture value) for obtaining an appropriate exposure according to the appropriate light emission amount are set (step SC6).

  Thereafter, when the shutter switch 5 is fully pressed (YES in step SC7), the flash emission amount is set to a light emission amount at a stage corresponding to the subject at the farthest distance (step SC8), and then exposure is started (step SC8). SC9) During the exposure period, the flash light emitting unit 4 is caused to emit flash light having a predetermined light emission amount calculated previously (step SC10), and the exposure is terminated when the time corresponding to the shutter speed is reached (step SC10). SC11). Subsequently, until the imaging operation with all the flash emission amounts including the appropriate emission amount calculated in step SC5 is completed (NO in step SC13), the flash emission amount is set to the next emission amount (closer distance). The light emission amount corresponding to the subject is sequentially changed (step SC14), and the imaging and temporary recording of the imaging data in steps SC9 to SC12 are repeated without changing the imaging conditions other than the flash light emission amount.

  Here, although not shown in the figure, during continuous shooting by repeating the above steps SC9 to SC12, when the flash light emission amount is set to an appropriate light emission amount, the image pickup devices 15a and 15b of the pair of image pickup blocks 11a and 11b, respectively. , And a set of imaging data is temporarily recorded in the image processing memory 19, and when the flash emission amount is set to an emission amount other than the appropriate emission amount, the image sensor 15a (sub-imaging block 11b) of the main imaging block 11a is set. Only the image pickup device 15b) is driven, and single image pickup data is temporarily recorded in the image processing memory 19. Further, at the time of recording the imaging data at each time, the control unit 18 associates with each imaging data, and stores the above-described distance division range corresponding to the flash light emission amount when the imaging data is captured in the internal memory (RAM). .

  After that, when the imaging operation with the flash emission amount at all stages is completed (YES in step SC13), the image processing unit 17 sets all the imaging data temporarily recorded in the image processing memory 19 as targets. The pre-filter processing and resolution conversion described above are performed (steps SC15 and SC16). As a result, a stereo image acquired under flash emission with an appropriate amount of light emission and a plurality of captured images acquired under flash emission with multiple levels of light emission corresponding to different distances are generated in the image processing memory 19. Is done.

  Subsequently, after the image processing unit 17 performs the above-described distance measurement processing based on the stereo image (see FIG. 4) and acquires distance information for each pixel (step SC17), the control unit 18 performs the distance for each pixel. Based on the information, the main captured image of the stereo image and the plurality of captured images are synthesized (step SC18).

  In such composition processing, a subject area including a group of pixels having distance information included in the range of the corresponding distance category from the captured image, with the main captured image as a base image and each of a plurality of other captured images as targets. Are cut out, and the cut-out partial image is overwritten and synthesized on the corresponding area of the main photographed image. For example, when the subject described in FIG. 8A exists in the image, the portion corresponding to the main subject A in the main photographed image is left and it corresponds to the other subjects B, C, D, and E. For the part to be shot, each partial image of the subject area corresponding to the subject whose flash emission amount set at the time of shooting was the appropriate flash amount was cut out and overwritten from different shot images of the plurality of shot images. Synthesize.

  As a result, as a combined image, all the subject portions A to E having different distances from the camera are secured with the same brightness as when an appropriate amount of flash light is emitted regardless of the distance. For example, an image substantially similar to the image obtained when shooting is performed without using a flash in a sufficiently bright environment illustrated in FIG. 8B, for example.

  Thereafter, the image obtained by the above synthesis process is used as a captured image, color correction and compression are performed in the same manner as steps SA16 to SA19 in FIG. 3 described in the first embodiment, and the compressed image data is stored in the recording memory 20. (Steps SC19 to SC22).

  As described above, in the present embodiment, at the time of flash photography, the light emission quantity of the flash light at each photography is a multi-stage light emission quantity including an appropriate light emission quantity according to the distance to the main subject, and is different from each other. By performing continuous shooting that changes to multiple levels of light emission depending on the distance, and cutting out and synthesizing a plurality of captured images obtained based on the above distance, all the distances from the camera are different from each other Finally, an image in which the same brightness is secured as when the subject portion is irradiated with an appropriate amount of flash emission regardless of the distance is acquired as a captured image.

  Therefore, an image with a natural brightness of each part can be obtained even in flash photography. In addition, there is no worry that noise will occur in the background subject part that is farther from the camera than the main subject, or image information will be lost in the foreground subject part that is closer to the camera than the main subject. A high quality image can be obtained.

(Embodiment 4)
Next, a fourth embodiment of the present invention will be described. Unlike the first to third embodiments, the present embodiment relates to a camera that acquires distance information (distance information for each pixel) of each subject portion in an image by an optical time-of-flight measurement method. Here, the optical flight time measurement method is based on the time (flight time: flight of time) required for a distance measuring light pulse to reach an object and reflect back from the object. It is a method of measuring the distance.

  That is, the camera according to the present embodiment, although not shown, emits pulsed light having a wavelength in the near-infrared region toward the subject, separately from the flash light emitting unit 4 and the flash control unit 23, on the stereo camera 1 shown in FIG. A light emitting unit (ranging light emitting means) including a predetermined light emitting element to irradiate and a light emission control unit for controlling the light emission based on a command from the control unit 18 and an image sensor 15b on the sub photographing block 11b side are provided. Is replaced with a CMOS sensor. Further, the control unit 18 functions as a distance acquisition unit and an imaging control unit of the present invention at the time of flash photography, and is configured to cause the stereo camera to perform the following operations.

  FIG. 14 is a flowchart showing an operation at the time of flash photography based on the control of the control unit 18 in the camera of the present embodiment. The basic operation is the same as that shown in FIG. 3 in the first embodiment. That is, in the present embodiment, the control unit 18 performs the same processing as Steps SA1 to SA6 in FIG. 3 (Steps SD1 to SD6), and when the shutter switch 5 is fully pressed (YES in Step SD7), the near infrared Distance measurement using light is performed (step SD8).

  FIG. 15 is a flowchart showing details of the distance measurement. In this process, first, an exposure time of the CMOS sensor (not shown) is set (step SD101). The exposure time set here is a very short time, and the initial value of the different exposure time corresponding to a different measurement distance (distance in steps of a predetermined distance) in the predetermined measurement distance range (maximum or minimum of the measurement distance range). It is.

  Next, the exposure of the CMOS sensor with the set exposure time is started (step SD102), and then the near-infrared light (pulse light) is immediately emitted to the light emitting unit (not shown) (step SD013), and the exposure time is set. Exposure is terminated (step SD104), and imaging data (Bayer data) that is an image for distance measurement (hereinafter referred to as a distance measurement image) is temporarily recorded in the image processing memory 19 (step SD105). ). In the imaging data recorded at this time, the pixel value of only the pixel data of the subject portion whose distance from the camera is at a distance (measurement distance) corresponding to the exposure time set in step SD101 is greater than or equal to a certain value.

  Subsequently, the exposure time (measurement distance) is sequentially changed until a plurality of imaging operations (distance measurement) with exposure at all exposure times according to the distance to be measured is completed (NO in step SD106). (Step SD107), the imaging and the temporary recording of the imaging data in steps SD102 to SD105 described above are repeated. In addition, at the time of recording each time of imaging data, the control unit 18 associates with each imaging data, and stores the exposure time when imaging them in the internal memory (RAM) as measurement distance information.

  Eventually, when a plurality of imaging operations (distance measurement) involving exposure for all exposure times are completed (YES in step SD106), the control unit 18 temporarily captures each imaging data recorded in the image processing memory 19. And distance data for each pixel is acquired based on the measurement distance corresponding to the exposure time set at the time of acquisition of the respective imaging data (at the time of imaging) (step SD108). That is, for each imaging data, a pixel having a pixel value greater than or equal to a certain value is confirmed, and a measurement distance corresponding to the imaging data is acquired as distance data thereof.

  Further, the distance data for each pixel acquired here is corrected in accordance with the parallax between each captured image data, that is, the distance measurement image, and the captured image acquired in steps SD9 to SD13 described later, so that the captured image for recording is recorded. The distance information for each pixel is acquired (step SD109). This completes the distance measurement process.

  Subsequently, returning to the processing of FIG. 4, the same processing as Steps SA8 to SA12 of FIG. 3 is performed (Steps SD9 to SD13). At this time, only the image sensor 15a on the main imaging block 11a side is driven to perform a single imaging. Get an image. Thereafter, the image processing unit 17 performs brightness correction processing similar to that of the first embodiment on the acquired captured image data based on the distance information for each pixel acquired by the distance measurement processing in step SD8. In addition to performing noise reduction processing, color correction processing, and compression processing, the control unit 18 records the processed image data in the recording memory 20 (steps SD14 to SD19).

  Also in the present embodiment described above, as in the first embodiment, an image in which the brightness of each part is natural can be obtained even in flash photography. Furthermore, appropriate luminance correction processing can be performed regardless of the color of the subject, and an image in which the brightness of each part is more natural can be reliably obtained.

  In the present embodiment, in the configuration having two image pickup systems, the case where the image pickup element of one image pickup system is a CMOS sensor and it is used as a distance measurement sensor by the optical time-of-flight measurement method has been described. Such a distance measuring sensor may be used as it is for capturing a recorded image. Further, the timing for performing distance measurement using near-infrared light is not limited to immediately after the shutter switch 5 is fully pressed, but may be immediately after a captured image for recording is acquired (immediately after step SD13).

  In addition, here, a case has been described in which the distance measurement using near infrared light described above is performed during flash photography based on the same operation as in the first embodiment, but during flash photography by distance measurement using near infrared light. The method for acquiring the distance information for each pixel of the acquired recording image for recording can also be applied during flash shooting based on the same operation as that of the second embodiment described above.

(Embodiment 5)
Next, a fifth embodiment of the present invention will be described. Unlike the fourth embodiment, the present embodiment performs a plurality of AF processes by shifting the focal length of the distance information (distance information for each pixel) of each subject portion in the image, thereby obtaining a plurality of pieces of information. The present invention relates to a camera acquired based on the degree of blur in an image.

  The configuration of the camera according to the present embodiment is a configuration including a single optical system and an imaging system, for example, the configuration shown in FIG. Further, the control unit 18 functions as an imaging control unit of the present invention at the time of flash photography, and is configured to cause the stereo camera to perform the following operation. That is, the basic operation at the time of flash photography is the same as the operation shown in FIG. 14 in the fourth embodiment and is not shown, but in the present embodiment, the explanation at the timing immediately after the shutter switch 5 is fully pressed is given. Instead of the distance measurement using near infrared light (step SD8), distance measurement by AF control described below is performed.

  FIG. 16 is a flowchart showing details of the distance measurement. In this process, first, the focal distance is set to the nearest distance (closest distance that can be photographed) within the measurement distance range, and the AF process is performed to move the optical system to a position corresponding thereto (step SE101). Next, in this state, the subject is imaged and the captured image is recorded (step SE102). That is, imaging data (Bayer data), which is a distance measurement image (hereinafter referred to as a distance measurement image), is temporarily recorded in the image processing memory 19. In the imaging data recorded at this time, the spatial frequency of the subject portion whose distance from the camera is the distance (measurement distance) corresponding to the focal length set in step SE101 is the highest.

  Subsequently, until the image is acquired by moving the optical system to a position corresponding to all the focal lengths corresponding to the distance to be measured (distances determined in advance by a predetermined distance) (NO in step SE103), the focus is increased. While sequentially changing the distance (step SE104), the imaging in step SE102 and the temporary recording of the imaging data are repeated. In addition, at the time of recording each time of imaging data, the control unit 18 associates with each imaging data, and stores the focal distance when the images are captured in the internal memory (RAM) as measurement distance information.

  Eventually, when the acquisition of images at all focal lengths is completed (YES in step SE103), the image processing unit 17 uses the frequency components between the images for each piece of imaging data temporarily recorded in the image processing memory 19. Are divided into a plurality of subject areas at the same distance, and the measurement distance corresponding to the focal length of the distance measurement image having the highest spatial frequency of each subject area is acquired from the control unit 18. The distance to the subject in the subject area is acquired (step SE105). Further, by assigning a distance in the subject area to each pixel in the same subject area, distance information in units of pixels is acquired and stored (step SE106).

  Thereafter, the optical system is moved to a position corresponding to the main subject detected by the AF control (step SD3 in FIG. 14) that was performed before the distance measurement process, toward the recording of the recording image (step SE107). This completes the distance measurement process.

  Also in the present embodiment described above, as in the first and fourth embodiments, an image in which the brightness of each part is more natural can be obtained even in flash photography. Furthermore, appropriate luminance correction processing can be performed regardless of the color of the subject, and an image in which the brightness of each part is more natural can be reliably obtained.

  In the present embodiment, as in the case of a general camera, a case where distance measurement by AF control is performed in a camera having a single optical system and an imaging system has been described. However, distance measurement by AF control is described. Can also be performed in a stereo camera having two image pickup systems described in the first and fourth embodiments.

  Further, here, the case where the distance measurement by the AF control described above is performed at the time of flash photographing based on the same operation as in the first embodiment has been described. However, for the recording acquired at the time of flash photographing by the distance measurement by the AF control. The method for acquiring the distance information for each pixel of the captured image can also be applied during flash photographing based on the same operation as in the second embodiment.

It is an external appearance perspective view of the stereo camera which shows 1st Embodiment. It is a block diagram of the stereo camera. It is a flowchart which shows the operation | movement at the time of flash photography of the stereo camera. It is a flowchart which shows the distance measurement process of the stereo camera. It is a figure which shows the distance measurement method from a stereo image. It is a conceptual diagram which shows a correction magnification acquisition table. It is a conceptual diagram which shows a noise reduction level acquisition table. It is explanatory drawing which shows the difference between the image obtained by flash photography, and the image obtained by imaging | photography with another imaging method. It is a block diagram of the stereo camera which shows 2nd Embodiment. It is a flowchart which shows the operation | movement at the time of flash photography of the stereo camera. It is a flowchart which shows the brightness correction process of the stereo camera. It is a flowchart which shows the operation | movement at the time of flash photography of the stereo camera in 3rd Embodiment. It is a flowchart following FIG. It is a flowchart which shows the operation | movement at the time of flash photography of the stereo camera in 4th Embodiment. It is a flowchart which shows the distance measurement process of the embodiment. It is a flowchart which shows the distance measurement process in the camera of 5th Embodiment.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Stereo camera 2 Camera body 3a, 3b Lens 4 Flash light emission part 11a, 11b Shooting block 12a, 12b Lens block 13a, 13b Optical system drive part 14a, 14b Optical system control part 15a, 15b Image pick-up element 16a, 16b AD conversion part 17 Image processing unit 18 Control unit 23 Flash control unit 51 Stereo camera 52 ND filter T1 Correction magnification acquisition table T2 Noise reduction level acquisition table

Claims (12)

In a camera apparatus including an imaging unit that captures an image of a subject and obtains a captured image, and a light-emitting unit that irradiates shooting auxiliary light toward the subject.
Distance acquisition means for acquiring the distance to each part of the subject within the angle of view and the distance to the main subject;
The brightness of each part of the captured image acquired by the imaging unit is acquired by the distance acquisition unit at the time of predetermined imaging accompanied by the emission operation of the auxiliary shooting light with a light emission amount suitable for imaging the main subject by the light emitting unit. Correction means for correcting according to the distance to each part of the subject and the distance to the main subject,
A recording control unit that performs control to record the captured image corrected by the correcting unit as a final captured image ;
The correction means corrects the brightness of each part of the subject to be reduced when the distance to each part of the subject is closer than the distance to the main subject, based on the distance to the main subject. When the distance to each part of the camera is longer than the distance to the main subject , the camera apparatus is corrected so as to increase the brightness of each part of the subject . In addition to the first captured image acquired by the imaging unit, the image capturing unit includes a second imaging unit that acquires a second captured image in which a parallax exists between the first captured image and the first captured image.
The distance acquisition means is within an angle of view based on the first captured image acquired by the imaging means and the second captured image acquired by the second imaging means simultaneously with the first captured image. Get the distance to each part of the subject,
The correction unit uses the first captured image acquired by the imaging unit during the predetermined shooting and the second captured image acquired by the second imaging unit as a correction target, and performs the correction. The camera device according to claim 1, wherein the brightness of each part of the target is corrected according to the distance to each part of the subject acquired by the distance acquisition unit. Reference distance acquisition means for acquiring the distance to the main subject within the angle of view;
A neutral density filter movable to an insertion position inserted on the optical axis of incident light to the second imaging means and a release position off the optical axis;
Position control means for controlling the position of the neutral density filter to the insertion position at the time of the predetermined photographing,
The correction unit corrects the brightness of each part of the first captured image acquired by the imaging unit during the predetermined shooting according to the distance to each part of the subject acquired by the distance acquisition unit, and In each of the first captured images, the brightness of each part corresponding to the foreground portion in which the distance to each part of the subject acquired by the distance acquisition unit is closer than the distance to the main subject acquired by the reference distance acquisition unit. And correcting the brightness of each corresponding part of the second photographed image acquired by the second imaging means in a state where the position of the neutral density filter is controlled to the insertion position by the position control means. The camera device according to claim 2. In the first captured image after correction by the correction unit, the distance to each part of the subject acquired by the distance acquisition unit corresponds to a background portion farther than the distance to the main subject acquired by the reference distance acquisition unit. In each part to be provided with noise reduction means for performing noise reduction processing of a degree according to the distance acquired by the distance acquisition means,
The camera apparatus according to claim 3, wherein the recording control unit performs control to record the first captured image after the noise reduction processing by the noise reducing unit as a final captured image. Ranging light emitting means for irradiating a distance measuring light pulse toward the subject,
The distance acquisition means is configured so that each part of the subject within the angle of view is based on the time required for the light pulse emitted from the distance measuring light emitting means to reach the object and be reflected from the object. The camera apparatus according to claim 1, wherein the distance to the camera is acquired. A photographic optical system with adjustable focal length;
The focal length of this photographic optical system is a focal length that focuses on subjects located at different distances, and the corresponding distances are sequentially changed to different known focal lengths, and each time the focal length is changed. Imaging control means for causing the imaging means to capture a subject and acquiring a plurality of captured images,
The distance acquisition means is based on a plurality of captured images acquired by the imaging means according to the control of the imaging control means and a distance corresponding to a focal length at the time of acquisition of each of the plurality of captured images. The camera apparatus according to claim 1, wherein the distance to each part of the subject in the camera is acquired. Reference distance acquisition means for acquiring the distance to the main subject within the angle of view;
In each of the portions corresponding to the background portion where the distance to each part of the subject acquired by the distance acquisition unit is farther than the distance to the main subject acquired by the reference distance acquisition unit in the photographed image corrected by the correction unit. A noise reduction means for performing a noise reduction process of a degree according to the distance acquired by the distance acquisition means,
The camera apparatus according to any one of claims 1, 2, 5, and 6, wherein the recording control unit performs control to record a captured image after the noise reduction processing by the noise reducing unit as a final captured image. . The light emission amount of the photographing auxiliary light is a light amount that can irradiate a subject with an appropriate irradiation amount to a subject located at a different distance, and the corresponding distance is sequentially controlled to a known different light emission amount. An imaging control unit that causes the unit to perform a plurality of light emission operations, and causes the imaging unit to capture a subject in accordance with a light emission operation according to each light emission amount, thereby acquiring a plurality of captured images;
The correction unit sets a predetermined captured image among a plurality of captured images acquired by the imaging unit according to the control of the imaging control unit as a correction target, and adds a plurality of captured images other than the correction target to each of the captured images. Based on the distance corresponding to the light emission amount at the time of acquisition and the distance to each part of the subject acquired by the distance acquisition unit, the subject portion of the distance corresponding to the light emission amount at the time of acquisition of each captured image is specified, The brightness of each part of the correction target is corrected by synthesizing the partial images of the plurality of subject parts at different distances specified for each captured image with the corresponding subject parts of the correction target. The camera device according to claim 1. A specifying means for specifying a subject located at the center of the angle of view, an arbitrary subject within the angle of view designated by the user, or a subject within the angle of view detected by the face as a main subject;
The correction means adjusts the brightness of each part of the photographed image acquired by the imaging means at the time of predetermined photographing accompanied by the light emission operation of the auxiliary photographing light suitable for photographing the main subject identified by the identifying means by the light emitting means. The camera apparatus according to claim 1, wherein the correction is performed according to a distance to each part of the subject acquired by the distance acquisition unit and a distance to the main subject. The correction means uses the distance acquisition means to determine the brightness of each part of the photographed image obtained by the imaging means during a predetermined photographing involving a light emission operation of photographing auxiliary light suitable for photographing the main subject by the light emitting means. The camera device according to claim 1, wherein correction is performed at a correction magnification according to a difference between the acquired distance to each part of the subject and the distance to the main subject. Shooting assistance with a light emission amount suitable for photographing the main subject by the light emitting means in a camera apparatus comprising an imaging means for capturing an image of a subject and acquiring a photographed image and a light emitting means for emitting photographing auxiliary light toward the subject When performing predetermined shooting with light emission,
Obtaining the distance to each part of the subject within the angle of view and the distance to the main subject;
Correcting the brightness of each part of the captured image acquired by the imaging means according to the distance to each part of the acquired subject and the distance to the main subject;
Look including the step of recording the captured image after the correction as a final photographed image,
The correcting step is based on the distance to the main subject, and when the distance to each part of the subject is closer than the distance to the main subject, corrects to reduce the brightness of each part of the subject, An imaging method comprising: correcting the brightness of each part of the subject to be increased when the distance to each part of the subject is longer than the distance to the main subject . A computer having a camera apparatus including an imaging unit that captures an image of a subject and obtains a captured image, and a light emitting unit that irradiates shooting auxiliary light toward the subject
When performing a predetermined shooting with a shooting auxiliary light emission operation with a light emission amount suitable for shooting the main subject by the light emitting means,
A procedure for obtaining the distance to each part of the subject within the angle of view and the distance to the main subject;
A procedure for correcting the brightness of each part of the captured image acquired by the imaging unit according to the distance to each part of the acquired subject and the distance to the main subject;
And a procedure for recording the corrected captured image as a final captured image ,
The correcting step is based on the distance to the main subject, and when the distance to each part of the subject is closer than the distance to the main subject, corrects the brightness of each part of the subject to decrease, An imaging control program for correcting to increase the brightness of each part of the subject when the distance to each part of the subject is longer than the distance to the main subject .

Images