JP2017038300A - Image processing apparatus and method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image processing apparatus capable of outputting both an image, the size of which is reduced by reducing the image blur, and an image maintaining the size, when shooting under conditions with large image blur.SOLUTION: An image processing apparatus includes an image generating section for generating a first development image from a first image captured in the imaging section, an image blur judgement section for judging whether or not there is image blur of the first image, and an image output section for outputting a first development image when the image blur judgement section judges that there is no image blur. When the image blur judgement section judges that there is an image blur, the imaging section captures a second image under imaging conditions different from those of the first image, the image generating section generates a second development image having a resolution different from that of the first development image from the second image, and the image output section outputs the second development image in addition to the first development image.SELECTED DRAWING: Figure 2

Description

  The present invention relates to an image processing apparatus and method in an imaging apparatus, and more particularly to an image processing apparatus and method related to image blur control.

  A normal imaging apparatus performs exposure control based on peripheral luminance at the time of imaging and captures an image so as to obtain an appropriate exposure. In addition, by performing pixel addition processing to generate an image by adding adjacent pixels to each other in the captured image, the brightness of the image can be obtained without amplifying the signal even under conditions of insufficient light quantity such as in a low illumination environment. Can be secured.

  In general, when imaging is performed under conditions of insufficient light quantity such as in a low illuminance environment, the exposure time becomes long, and thus image blur due to camera shake or subject blur tends to occur. On the other hand, by performing pixel addition processing on the captured image and generating an image so as to have an appropriate exposure, an appropriate image with low image blur can be obtained. However, by performing pixel addition processing, the generated image size (resolution) is reduced.

  Patent Document 1 proposes a technique for selectively setting a mode and determining whether to perform pixel addition processing or output an image signal without executing pixel addition processing according to the mode setting or the like. Has been. The user can select a mode in which the pixel addition process is not executed when a large-size image is desired.

JP 2006-352610 A

  However, in the technique described in Patent Document 1, whether or not the pixel addition process can be performed is limited by the user selectively setting the mode. In addition, only one of a small-size image with reduced image blur and an image with a size specified by the user that does not reduce image blur is generated according to the conditions at the time of imaging, so they cannot be obtained simultaneously. . In other words, when shooting is performed so as to reduce image blurring, only a small-sized image is output, so that even if the user wants to obtain a large-sized image after the fact, no response can be made.

  The present invention has been made in view of the above-described problems, and when shooting under conditions where image blur is large, an image in which the size is reduced by reducing the image blur, and an image in which the size is maintained. An object of the present invention is to provide an image processing apparatus and method capable of outputting both of them.

In order to solve the above problems, an image processing apparatus according to a first aspect of the present invention includes an image generation unit that generates a first developed image from a first image captured by an imaging unit; An image blur determining unit that determines whether or not there is an image blur of the image; an image output unit that outputs the first developed image when the image blur determining unit determines that there is no image blur; and When the image blur determination unit determines that there is image blur, the imaging unit captures a second image under an imaging condition different from the first image, and the image generation unit A second developed image having a resolution different from that of the first developed image is generated from the second image, and the image output unit outputs the second developed image in addition to the first developed image.
An image processing method according to a second aspect of the present invention generates a first developed image from a captured first image and determines whether there is an image blur of the first image. When it is determined that there is no image blur, the first developed image is output, and when it is determined that there is image blur, the second image is output under different imaging conditions from the first image. A second developed image having a resolution different from that of the first developed image from the second image, and outputting the first developed image and the second developed image; .

  According to the present invention, it is possible to generate an image with little image blur and provide a user-friendly image even when shooting under conditions where image blur is likely to occur.

1 is a block diagram of an image processing apparatus according to a first embodiment of the present invention. It is a figure which shows the flowchart which shows the image processing method in the 1st Embodiment of this invention.

(First embodiment)
DESCRIPTION OF EXEMPLARY EMBODIMENTS Hereinafter, preferred embodiments to which the invention is applied will be described in detail with reference to the accompanying drawings. FIG. 1 is a block diagram of a digital camera 100 as an example of an image processing apparatus according to this embodiment. The digital camera 100 includes a photographing lens 10, a mechanical shutter 12 having a diaphragm function, an image sensor 14 as an imaging unit that converts an optical image into an electric signal, and an analog signal output from the image sensor 14 that is converted into a digital signal. A D converter 16 is provided.

  The digital camera 100 includes a timing generation circuit 18 that supplies a clock signal and a control signal to the image sensor 14 and the A / D converter 16, and the timing generation circuit 18 is controlled by a memory control circuit 22 and a system control circuit 50. In addition to the mechanical shutter 12, the timing generation circuit 18 controls the reset timing of the image sensor 14, whereby the accumulation time can be controlled as an electronic shutter. Therefore, the timing generation circuit 18 can function as a shutter for moving image shooting or the like.

  The digital camera 100 includes an image processing circuit 20, and the image processing circuit 20 performs predetermined pixel interpolation processing and color conversion processing on data from the A / D converter 16 or data from the memory control circuit 22. In addition, an electronic zoom function is realized by performing image clipping and scaling processing by the image processing circuit 20.

  The image processing circuit 20 performs predetermined calculation processing using the captured image data, and the system control circuit 50 controls the exposure control unit 40 and the distance measurement control unit 42 based on the obtained calculation result. Do. Thus, TTL AF (autofocus) processing, AE (automatic exposure) processing, and EF (flash pre-emission) processing are realized. Further, the image processing circuit 20 performs predetermined arithmetic processing using the captured image data, and also performs TTL AWB (auto white balance) processing based on the obtained arithmetic result.

  Furthermore, the image processing circuit 20 functions as an image generation unit that develops an image captured by the image sensor 14 and generates a developed image. Image development refers to performing predetermined processing on image data read from the image sensor 14 and A / D-converted to convert the image data into a displayable format. The developed image refers to an image after development that can be displayed.

  Furthermore, the image processing circuit 20 functions as an image blur determination unit that determines image blur of an image captured by the image sensor 14. A specific image blur determination method will be described later.

  The digital camera 100 includes a memory control circuit 22, and the memory control circuit 22 controls the A / D converter 16, the timing generation circuit 18, the image processing circuit 20, the memory 30, and the compression / decompression circuit 32. Data output from the A / D converter 16 is written into the memory 30 via the image processing circuit 20 and the memory control circuit 22 or directly via the memory control circuit 22. The digital camera 100 includes an image display unit 28 including a TFT, an LCD, and the like, and the display image written in the memory 30 is displayed by the image display unit 28 via the memory control circuit 22.

  Further, the memory control circuit 22 functions as an image output unit that outputs the developed image stored in the memory 30 to the image display unit 28, the recording medium 200, or the like.

  The electronic viewfinder function can be realized by sequentially displaying image data captured using the image display unit 28. In the present embodiment, the digital camera 100 causes the image display unit 28 to function as an electronic viewfinder during standby in which the camera is operating in the imaging mode and no imaging preparation instruction or imaging start instruction is input. That is, the digital camera 100 continuously captures images at a predetermined rate (for example, 30 frames / second), generates a display image (hereinafter also referred to as an EVF image) from the captured images, and displays it on the image display unit 28. .

  The image display unit 28 can arbitrarily turn on / off the display according to an instruction from the system control circuit 50. When the display is turned off, the power consumption of the digital camera 100 can be significantly reduced. it can.

  The digital camera 100 includes a memory 30 for storing captured still images and moving images, and the memory 30 has a sufficient storage capacity for storing a predetermined number of still images and a predetermined time of moving images. Thereby, in the case of continuous shooting or panoramic shooting in which a plurality of still images are continuously shot, it is possible to write a large amount of images to the memory 30 at high speed. The memory 30 can also be used as a work area for the system control circuit 50.

  The digital camera 100 includes a compression / decompression circuit 32 that compresses and decompresses image data by adaptive discrete cosine transform (ADCT) or the like. The compression / decompression circuit 32 reads an image stored in the memory 30, performs compression processing or decompression processing, and writes the processed data to the memory 30.

  The digital camera 100 includes an exposure control unit 40 that controls the mechanical shutter 12 having an aperture function. The exposure control unit 40 also has a flash light control function in conjunction with the flash 48.

  The digital camera 100 includes a drive control unit 38 that controls reading drive of the image sensor 14, a distance measurement control unit 42 that controls focusing of the photographing lens 10, and a zoom control unit 44 that controls zooming of the photographing lens 10. The digital camera 100 includes a flash 48. The flash 48 also has an AF auxiliary light projecting function and a flash light control function.

  The exposure control unit 40 and the distance measurement control unit 42 are controlled using the TTL method. Based on the calculation result obtained by calculating the image data captured by the image processing circuit 20, the system control circuit 50 controls the exposure control unit 40 and the distance measurement control unit 42.

  The digital camera 100 includes a system control circuit 50 that controls the entire digital camera 100 as an image processing apparatus.

  The digital camera 100 includes operation units 60, 62, 64, 66, 70 and 72 for inputting various operation instructions of the system control circuit 50. The operation units 60, 62, 64, 66, 70, and 72 are configured by a single or a plurality of combinations such as switches, dials, touch panels, pointing by line-of-sight detection, and voice recognition devices.

  Here, the operation units 60, 62, 64, 66, 70, and 72 will be specifically described. The mode dial switch 60 is a dial for switching and setting each function mode such as power-off, automatic shooting mode, shooting mode, panoramic shooting mode, moving image shooting mode, playback mode, and PC connection mode.

  The shutter switch 62 includes a first shutter switch SW1. The first shutter switch SW1 is turned ON while the shutter button is being operated (half-pressed), and instructs to start operations such as AF (autofocus) processing, AE (automatic exposure) processing, and AWB (auto white balance) processing.

  The shutter switch 64 includes a second shutter switch SW2. The second shutter switch SW2 is turned on when the operation of the shutter button is completed (fully pressed). When the second shutter switch SW2 is turned ON, in the case of flash photography, the digital camera 100 performs the EF (flash pre-emission) process and then exposes the image sensor 14 for the exposure time determined by the AE process. The flash 48 emits light during this exposure period, and the exposure control unit 40 shields the flash 48 simultaneously with the end of the exposure period, thereby terminating the exposure to the image sensor 14. Thereafter, the digital camera 100 performs a reading process of reading a signal from the image sensor 14 and writing image data to the memory 30 via the A / D converter 16 and the memory control circuit 22. Further, development processing is performed using the calculation results in the image processing circuit 20 and the memory control circuit 22. Further, the digital camera 100 reads out image data from the memory 30, performs compression processing by the compression / decompression circuit 32, and then performs recording processing to write the image data on the recording medium 200.

  The display changeover switch 66 is a switch for switching the display of the image display unit 28. When the user operates the display changeover switch 66 to turn off the display of the image display unit 28, current is supplied to the image display unit 28 including a TFT, an LCD, and the like when photographing using the optical viewfinder 104. It is possible to cut off and save power.

  The various operation units 70 include various buttons, a touch panel, a rotary dial, and the like. For example, a menu button, a set button, a macro button, a multi-page playback page break button, a flash setting button, a single shooting / continuous shooting / self-timer switching button, and the like. is there. Menu move + (plus) button, menu move-(minus) button, playback image move + (plus) button, playback image move-(minus) button, shooting image quality selection button, exposure compensation button, date / time setting button, etc. There is also.

  The zoom switch unit 72 is a zoom operation unit in which a user gives an instruction to change the magnification of a captured image. The zoom switch 72 includes a tele switch that changes the imaging field angle to the telephoto side, and a wide switch that changes the wide angle side. Using the operation of the zoom switch unit 72 as a trigger, the zoom control unit 44 can be instructed to change the imaging field angle of the photographic lens 10 to perform an optical zoom operation. The operation of the zoom switch unit 72 can also trigger an electronic zooming change of the imaging angle of view by image cropping by the image processing circuit 20 or pixel interpolation processing.

  The subject detection unit 74 detects a subject such as a human face from image data generated by the image processing circuit 20 using an image processing technique such as pattern matching. In the image display unit 28, information display elements such as a subject (face) frame surrounding a subject (for example, a face) detected by the subject detection unit 74 may be superimposed and displayed.

  The power supply unit 86 includes an arbitrary power source such as a primary battery of an alkaline battery, a secondary battery such as a NiCd battery, a NiMH battery, or a Li ion battery, or an AC adapter. The interface 90 is an interface with a recording medium such as a memory card or a hard disk, and the connector 92 is a connector for connecting to a recording medium such as a memory card or a hard disk.

  The optical finder 104 is a window that allows a user to visually recognize a scene close to the imaging range by the imaging device 14, and performs imaging using only the optical finder 104 without using the electronic finder function of the image display unit 28. It is possible.

  The communication unit 110 has various communication functions such as USB, IEEE 1394, LAN, and wireless communication. The connector 112 includes a connector for connecting the digital camera 100 to another device for wired communication by the communication unit 110 or an antenna used for wireless communication by the communication unit 110.

  The recording medium 200 includes a recording medium such as a memory card or a hard disk. The recording medium 200 includes a recording unit 202 composed of a semiconductor memory, a magnetic disk, or the like, an interface 204 with the digital camera 100, and a connector 206 for connecting with the digital camera 100.

  FIG. 2 is a diagram illustrating a flowchart of the image processing method according to the present embodiment. First, in step S201, when the shutter switches 62 and 64 are pressed, the digital camera 100 captures a first image. The first image is captured by all pixel readout. All-pixel readout means that pixels read from the image sensor 14 are used as they are without pixel addition. In step S202, the digital camera 100 develops the first image to generate a first developed image.

  In step S203, the digital camera 100 calculates a first blur amount BL1 of the image from the EVF image captured before capturing the first image, and determines whether image blur is occurring. The EVF image is an image that is continuously captured at a predetermined rate for display on the image display unit 28 as an electronic viewfinder. The EVF image is always generated and temporarily stored in the memory 30 regardless of whether the shutter switches 62 and 64 are pressed, and displayed on the image display unit 28. In step S203, the first blur amount BL1 is calculated using the EVF image generated immediately before the first image is captured. Image blur in the first image can be predicted from the image blur in the EVF image.

  As a calculation method of the first blur amount BL1, for example, the first blur amount BL1 is calculated by calculating frequency characteristics by digitally processing an EVF image and calculating the sharpness of the image. If the calculated first blur amount BL1 is larger than the threshold value BL_TH for image blur, it is determined that the image is blurred. If the calculated first blur amount BL1 is less than the threshold value BL_TH for image blur, it is determined that the image is not blurred. The threshold value BL_TH may be arbitrarily determined according to the allowable range of image blur to be obtained.

  If it is determined in step S203 that the image is not blurred, in step S204, the digital camera 100 calculates a second blur amount BL2 of the image from the first image to determine whether the image is blurred. To do. The method for calculating the second blur amount BL2 is the same as the method for calculating the first blur amount BL1. When the calculated second blur amount BL2 is larger than the threshold BL_TH2 in the image blur amount, it is determined that the image is blurred, and when it is equal to or smaller than the threshold BL_TH2, it is determined that the image is not blurred. The threshold value BL_TH2 may be arbitrarily determined according to the allowable range of image blur to be obtained.

  If it is determined in step S204 that the image is not blurred, in step S205, the digital camera 100 outputs the first developed image generated in step S202.

  If it is determined in step S203 or step S204 that the image is blurred, in step S206, the digital camera 100 captures the second image under an imaging condition different from that for capturing the first image. Specifically, the second image is captured by pixel addition readout (for example, 4-pixel addition readout of 2 vertical pixels and 2 horizontal pixels). Pixel addition reading means that the pixels read from the image sensor 14 are added to each other according to a predetermined rule. By performing pixel addition reading, noise can be reduced and sensitivity can be improved, so that exposure time can be shortened and image blurring can be reduced. On the other hand, the resolution (size) of an image obtained by performing pixel addition is reduced.

  Here, the read condition may be changed based on the value of the first blur amount BL1 calculated in step S203. For example, when the first blur amount BL1 is larger than the threshold value BL_TH3 in the image blur, the second image may be picked up by nine-pixel addition readout of three vertical pixels and three horizontal pixels in order to reduce the image blur. . On the other hand, when BL1 is equal to or less than the threshold value BL_TH3, the second image may be captured by 4-pixel addition reading of 2 vertical pixels and 2 horizontal pixels.

  Further, the reading condition may be changed based on the value of the second blur amount BL2 calculated in step S204. For example, when the second blur amount BL2 is larger than the threshold value BL_TH4 in the image blur, the second image may be picked up by nine-pixel addition readout of three vertical pixels and three horizontal pixels in order to reduce the image blur. . On the other hand, when the second blur amount BL2 is equal to or less than the threshold value BL_TH4, the second image may be captured by 4-pixel addition reading of 2 vertical pixels and 2 horizontal pixels. In addition, the second image may be captured by, for example, 4-pixel average reading of 2 vertical pixels and 2 horizontal pixels.

  That is, when the first blur amount BL1 or the second blur amount BL2 is larger than a predetermined value, the blur of the image is large, so that the pixel addition number for pixel addition reading is increased. On the other hand, when the first blur amount BL1 is less than or equal to a predetermined value, the blur of the image is small, so that the pixel addition number for pixel addition reading is reduced. With such a configuration, it is possible to suppress the degree of image blur compensation by changing the degree of image blur compensation in accordance with the magnitude of the blur amount.

  In step S207, the digital camera 100 develops the second image to generate a second developed image. In step S208, the digital camera 100 outputs the first developed image generated in step S202 and the second developed image generated in step S207.

  In the present embodiment, the process of step S203 may be omitted. That is, after step S202, the determination of the first blur amount BL1 of the EVF image is omitted, and the process proceeds to step S204. The processing after step S204 is the same as described above.

(Second Embodiment)
Next, a second embodiment will be described. In the second embodiment, the method for capturing the second image in step S206 in the flowchart of FIG. 2 and the method for generating the second developed image in step S207 are different from those in the first embodiment.

  In the present embodiment, in step S206, the second image is captured by all-pixel readout, and is captured with a sensitivity S2 that is higher in sensitivity than the sensitivity S1 when the first image is captured. By imaging with high sensitivity, the exposure time can be shortened and image blurring can be reduced.

  Here, the sensitivity S2 may be changed based on the value of the first blur amount BL1 calculated in step S203. For example, when the first blur amount BL1 is larger than the threshold BL_TH3 for image blur, the digital camera 100 captures an image by setting the sensitivity S2 to the sensitivity S_Hi, for example. On the other hand, when the first blur amount BL1 is equal to or less than the threshold value BL_TH3, the digital camera 100 captures an image with the sensitivity S2 set to a sensitivity S_Low lower than the sensitivity S_Hi. With such a configuration, imaging can be performed with sensitivity suitable for the amount of blur while reducing image blur.

  Further, the sensitivity S2 may be changed based on the value of the second blur amount BL2 calculated in step S204. For example, when the second blur amount BL2 is larger than the threshold BL_TH4 for image blur, the digital camera 100 captures an image by setting the sensitivity S2 to the sensitivity S_Hi, for example. On the other hand, when the second blur amount BL2 is equal to or less than the threshold value BL_TH4, the digital camera 100 captures an image with the sensitivity S2 set to a sensitivity S_Low lower than the sensitivity S_Hi. With such a configuration, imaging can be performed with sensitivity suitable for the amount of blur while reducing image blur.

  Next, in step S207, the digital camera 100 performs image reduction with the vertical reduction ratio 1/2 and the horizontal reduction ratio 1/2, for example, by averaging from the second image captured in step S206. A second developed image is generated with a reduced size. Noise can be reduced by performing image reduction by averaging.

  Here, the image reduction ratio may be changed based on the value of the first blur amount BL1 calculated in step S203. For example, when the first blur amount BL1 is larger than the threshold value BL_TH3 in the image blur, the digital camera 100 reduces the image blur with, for example, the vertical reduction ratio 1/3 and the horizontal reduction ratio 1/3. To develop a developed image. When the first blur amount BL1 is equal to or less than the threshold value BL_TH3, the digital camera 100 performs image reduction with a vertical reduction ratio of 1/2 and a horizontal reduction ratio of 1/2 to generate a developed image. With such a configuration, an image having an image size suitable for the amount of blur can be obtained while reducing image blur.

  Further, the image reduction ratio may be changed based on the value of the second blur amount BL2 calculated in step S204. For example, when the second blur amount BL2 is larger than the threshold value BL_TH4 in the image blur, the digital camera 100 reduces the image blur with, for example, the vertical reduction ratio 1/3 and the horizontal reduction ratio 1/3. To develop a developed image. When the second blur amount BL2 is equal to or less than the threshold value BL_TH4, the digital camera 100 generates a developed image by performing image reduction with a vertical reduction ratio of 1/2 and a horizontal reduction ratio of 1/2. With such a configuration, an image having an image size suitable for the amount of blur can be obtained while reducing image blur.

  Since other parts are the same as those in the first embodiment, detailed description thereof is omitted. Also by the image processing apparatus and the image processing method according to the present embodiment, the same effects as those of the first embodiment can be obtained.

(Third embodiment)
Next, a third embodiment will be described. In the third embodiment, the method for capturing the second image in step S206 and the method for generating the second developed image in step S207 are different from those in the first embodiment and the second embodiment.

  In step S206, the second image is picked up at the high shutter speed while being picked up with the same sensitivity as the sensitivity S1 when the first image is picked up by reading all pixels. That is, for example, the image is captured at the second shutter speed SS2 = SS1 × 1/4 that is faster (smaller) than the first shutter speed (exposure time) SS1 when the first image is captured.

  In step S207, for example, 4-pixel addition of 2 vertical pixels and 2 horizontal pixels is performed from the captured second image so that the exposure is appropriate, and the second developed image is generated by reducing the image size. By performing pixel addition as described above, noise can be reduced and an image with appropriate exposure can be generated.

  Since other parts are the same as those in the first embodiment, detailed description thereof is omitted. Also by the image processing apparatus and the image processing method according to the present embodiment, the same effects as those of the first embodiment can be obtained.

(Fourth embodiment)
Next, a fourth embodiment will be described. In the fourth embodiment, the BL2 calculation method in step S204 is different from that in the first embodiment.

  In step S204, as a method for calculating the second blur amount BL2, a method of calculating the second blur amount BL2 using a motion vector by a known template matching process using the EVF image and the first image is used. It's okay.

  Since other parts are the same as those in the first embodiment, detailed description thereof is omitted.

(Other embodiments)
The present invention supplies a program that realizes one or more functions of the above-described embodiments to a system or apparatus via a network or a storage medium, and one or more processors in a computer of the system or apparatus read and execute the program This process can be realized. It can also be realized by a circuit (for example, ASIC) that realizes one or more functions.

Claims (17)

An image generation unit that generates a first developed image from the first image captured by the imaging unit;
An image blur determination unit that determines whether there is an image blur of the first image;
An image output unit that outputs the first developed image when the image blur determination unit determines that there is no image blur; and
With
When the image blur determination unit determines that there is the image blur, the imaging unit captures a second image under an imaging condition different from that of the first image, and the image generation unit includes the second image generation unit. A second developed image having a resolution different from that of the first developed image is generated from the image, and the image output unit outputs the second developed image in addition to the first developed image. Image processing device.   The image processing apparatus according to claim 1, wherein the imaging unit performs all pixel readout for the first image and performs pixel addition readout for the second image.   The image processing apparatus according to claim 1, wherein the imaging unit performs all-pixel reading for the first image and performs pixel average reading for the second image.   The image processing according to claim 1, wherein the imaging unit captures the first image with a first sensitivity, and captures the second image with a higher sensitivity than the first sensitivity. apparatus.   The image processing apparatus according to claim 4, wherein the image generation unit reduces and develops the second image.   The image pickup unit picks up the first image with a first exposure time, and picks up the second image with an exposure time shorter than the first exposure time. Image processing device.   The image processing apparatus according to claim 6, wherein the image generation unit develops the second image by adding pixels. The imaging unit is configured to capture a third image before capturing the first image,
The image blur determination unit determines the image blur by calculating a first blur amount from the third image and predicting a blur amount of the first image. 8. The image processing apparatus according to any one of items 7 to 7.   The image blur determination unit determines that the image blur is present when the first blur amount is greater than a predetermined value, and there is no image blur when the first blur amount is equal to or less than the predetermined value. The image processing apparatus according to claim 8, wherein the determination is performed.   The image processing apparatus according to claim 1, wherein the image blur determination unit determines the image blur by calculating a second blur amount from the first image.   The image blur determination unit calculates a second blur amount from the first image, determines that there is the image blur when the first blur amount is larger than a predetermined value, and the first blur is determined. When the amount is less than a predetermined value and the second blur amount is larger than the predetermined value, it is determined that there is the image blur, and when the first blur amount is less than the predetermined value, the first blur amount is determined. 9. The image processing apparatus according to claim 8, wherein when the blur amount of 2 is equal to or less than a predetermined value, it is determined that there is no image blur.   The said imaging part performs pixel addition reading by changing the pixel addition number of said 2nd image based on said 1st blurring amount, Any one of Claim 8, 9, 11 characterized by the above-mentioned. The image processing apparatus described.   The said image generation part changes the resolution by changing the reduction rate of the said 2nd developed image based on the said 1st blurring amount, The any one of Claim 8, 9, 11, 12 characterized by the above-mentioned. The image processing apparatus according to item.   The image processing apparatus according to claim 13, wherein the imaging unit captures the second image by changing sensitivity based on the first blur amount.   The image processing apparatus according to claim 10, wherein the imaging unit performs pixel addition reading by changing a pixel addition number of the second image based on the second blur amount.   The said image generation part changes the resolution by changing the reduction rate of the said 2nd developed image based on the said 2nd blurring amount, The any one of Claim 10, 11, 15 characterized by the above-mentioned. The image processing apparatus described. Generating a first developed image from the captured first image;
Determining whether there is an image blur of the first image;
Outputting the first developed image when it is determined that there is no image blur;
When it is determined that there is an image blur, a second image is captured under an imaging condition different from that of the first image, and a second resolution having a resolution different from that of the first developed image is determined from the second image. Generating a developed image and outputting the first developed image and the second developed image;
An image processing method comprising:

Images