JP5396231B2 - Imaging device - Google Patents

Description

  The present invention relates to an imaging apparatus that obtains an image having blur without depending on the depth of field of a lens.

  In general, in photographing by an imaging device, the smaller the aperture value at the time of photographing, that is, the larger the lens diameter and the wider the aperture, the shallower the depth of field and the narrower the focusing range. An image that emphasizes the subject of interest may be obtained using this phenomenon. For example, when shooting a flower or a portrait, it is to obtain an image in which a subject such as a background other than the subject of interest is effectively blurred while focusing on the flower or person as the subject of interest. In order to realize so-called beautiful blurring, it is preferable to use a large aperture lens with a small open aperture value. However, large-aperture lenses tend to be expensive due to many constraints on their design.

  Therefore, shooting is performed using a relatively inexpensive lens with a large open aperture value, and the blur of the image obtained by this shooting is weakened by using image processing technology to increase the blur of the part other than the subject of interest. There is a technique for creating an image that takes advantage of the blur effect as described above. For example, Patent Document 1 discloses a technique for creating an image in which an attention subject is emphasized by making the blur condition between a region including the attention subject set in the image different from other regions using an image processing technique. doing.

JP 2005-303983 A

  The technique disclosed in Patent Document 1 is for monitoring intruders, and is divided into two areas, an area including the subject of interest and other areas, and the degree of blur of each area is determined in advance. It is adjusted by the degree of blur. Therefore, the purpose is simply to emphasize the subject of interest such as an intruder. In other words, the effect of blurring is not used for production, but a favorite image that causes aesthetics is not created.

  SUMMARY OF THE INVENTION An object of the present invention is to provide an imaging apparatus that acquires an image having effective blur by performing blur processing that changes the intensity of blur without depending on the depth of field of a lens.

In order to achieve the above object, an aspect of the imaging apparatus according to the present invention includes an imaging unit that captures an image of a subject and acquires imaging data, and a subject position of a target subject to be focused on an image plane based on the imaging data. Position information acquisition means for acquiring information, and blur characteristic data representing the intensity of blur when performing processing to blur the captured image according to the distance on the image plane with the subject position as a reference According to the distance on the image plane from the subject position according to the blur data storage means, the subject position obtained by the position information acquisition means, and the blur characteristic data stored in the blur data storage means and the blur processing anda blurring processing means for performing the image based on the imaging data, the blur data storage means, the target object scene in the real space And to store the said blur characteristic data for the blur characteristic data and the far side for the side closer than.

  ADVANTAGE OF THE INVENTION According to this invention, the imaging device which acquires the image which has an effective blur which raise | generates the aesthetics by performing the blurring process which changes the intensity | strength of blur without depending on the depth of field of a lens can be provided.

1 is a block diagram illustrating a configuration example of an imaging apparatus according to an embodiment of the present invention. The figure which shows an example of the relationship between the distance from a reference point, and the intensity | strength of blur. 6 is a flowchart illustrating an operation example of the imaging apparatus according to the embodiment of the present invention. The figure explaining the outline of the example of the image to which blur was added. The figure which shows an example of the relationship between the distance from a reference point, and the weight of the blur added.

  Hereinafter, an embodiment of the present invention will be described with reference to the drawings. FIG. 1 shows a configuration example of an imaging apparatus according to an embodiment of the present invention. The imaging apparatus includes a camera body 100 and an interchangeable lens 200. The interchangeable lens 200 includes a lens 202, a lens microcomputer 204, a lens driver 206, a diaphragm 208, a lens flash (Flash) memory 210, and a subject distance calculation unit 212. The lens 202 includes one or more lenses. The lens microcomputer 204 is connected to the microcomputer 115 of the camera body 100 via an interface (I / F) 150, and sends and receives information to and from each other. The lens 202 collects an optical image of a subject (not shown) on the image sensor 102. The lens 202 is driven by a lens driver 206 controlled by the lens microcomputer 204. The diaphragm 208 is also driven by a driver (not shown) controlled by the lens microcomputer 204. The lens flash memory 210 stores information about the lens such as the relationship between the position of each lens constituting the lens 202 and the distance from the subject to be focused.

  The subject distance calculation unit 212 refers to the information stored in the lens flash memory 210 and calculates a subject distance that is a distance between the imaging device and the target subject in focus.

  The image sensor 102 has a plurality of photodiodes arranged on a two-dimensional plane, and color filters of three colors of red (R), green (G), and blue (B) are provided on the front surface of the photodiodes. For example, it has a configuration arranged in a so-called Bayer array. In such an image sensor 102, each photodiode in each pixel receives light collected by the lens 202 and performs photoelectric conversion. This photoelectric conversion converts the amount of light into an electrical signal (analog image signal), and outputs it to the analog processing unit 103. The image sensor 102 may be a CMOS system or a CCD system, and the system is not limited. The image sensor 102 preferably has an electronic shutter function capable of electronically controlling the exposure time. Further, the image sensor 102 is provided with a mechanical shutter 101, and the exposure time during which light enters the image sensor 102 can be controlled by driving the mechanical shutter 101.

  The analog processing unit 103 performs waveform shaping on the analog image signal input from the image sensor 102 while reducing reset noise and the like. Further, the analog processing unit 103 performs gain-up processing so that the brightness of the image becomes the target brightness. The analog processing unit 103 outputs the processed analog image signal to the A / D conversion unit 104.

  The A / D conversion unit 104 converts the processed analog image signal input from the analog processing unit 103 into a digital image signal (hereinafter referred to as image data). The image data converted into a digital signal by the A / D conversion unit 104 is temporarily stored in the SDRAM 106 via the bus 105.

  The bus 105 is a transfer path for transferring various data handled in the camera to each unit in the camera. The bus 105 includes an A / D conversion unit 104, an SDRAM 106, an image processing unit 107, an AE processing unit 108, an AF processing unit 109, an image compression / decompression unit 110, a memory I / F 111, and an LCD driver 113. The microcomputer 115, the blur characteristic determination unit 122, and the blur addition calculation unit 124 are connected. The SDRAM 106 is a storage unit that temporarily stores various data such as image data obtained by the A / D conversion unit 104 and image data processed by the image processing unit 107 and the image compression / decompression unit 110.

  The image processing unit 107 includes a WB correction unit 1071 that performs white balance (WB) correction processing of image data, and a synchronization processing unit 1072 that performs synchronization processing from image data based on the Bayer array to image data having RGB information for each pixel. For example, a color reproduction processing unit 1073 that performs various color-related adjustments such as gamma correction, and a noise reduction (NR) processing unit 1074 that reduces noise by performing coring processing or the like are included. The image processing unit 107 reads image data stored in the SDRAM 106 and performs various image processing. The processed image data is stored in the SDRAM 106 again.

  The AE processing unit 108 calculates subject luminance using the image data. Further, the AE processing unit 108 determines the ISO sensitivity during shooting, the aperture, the shutter speed, and the like based on the calculated subject luminance. The data for calculating the subject brightness may be an output of a dedicated photometric sensor. The AF processing unit 109 extracts high-frequency component signals from the image data, integrates the extracted high-frequency component signals, and acquires a focus evaluation value for AF. At this time, the AF processing unit 109 acquires position information of the focal point in the image.

  The image compression / decompression unit 110 reads image data having RGB information from the SDRAM 106 when image data is recorded, and compresses the data according to a predetermined method such as a JPEG compression method. The compressed image data is temporarily stored in the SDRAM 106 and then recorded on the recording medium 112 via the memory I / F 111. Here, the recording medium 112 is, for example, a recording medium including a memory card that can be attached to and detached from the camera body, and is not particularly limited. The image compression / decompression unit 110 decompresses the compressed image data recorded on the recording medium 112 when the image data is reproduced. A liquid crystal display (LCD) 114 displays the decompressed image data, for example, under the control of the LCD driver 113.

  The microcomputer 115 comprehensively controls various sequences of the camera body. An operation unit 116 and a flash memory 117 are connected to the microcomputer 115. The operation unit 116 is, for example, an operation member such as a power button, a release button, and various key inputs. When the operation unit 116 is operated by the user, the microcomputer 115 receives signals from the operation unit 116 and executes various sequences.

The flash memory 117 stores various parameters such as a white balance correction coefficient for preset WB correction and a low-pass filter coefficient, various programs executed by the microcomputer 115, and the like. The flash memory 117 has a blur characteristic data storage area 117a. The blur characteristic data storage area 117a, blur characteristic data D _f are stored. The blur characteristic data D _f is the distance from the reference point, and a data on the relationship between the intensity of blur to be added to the image captured (the degree of blurring the image). Here, an example of a blur characteristic data D _f in FIG. The intensity of the blur added to the image (the degree to which the image is blurred) is changed according to the distance from the reference point on the plane of the obtained image, with the focused subject in focus as the reference point. In addition, the intensity of blur added to the image (the degree to which the image is blurred) is changed according to the distance in real space from the imaging device to the subject of interest. Curves A, B, and C in FIG. 2 represent the relationship of the blur intensity to the distance from the reference point on the image plane (hereinafter referred to as “blur characteristic”). Flash in the memory 117, the curve A, it is a relation shown in B and C blur characteristic data _{D f} are stored as discrete data. The blur characteristic data D _f, with the target subject is the reference point without adding the blurred image (without processing to blur the image), the distance from the reference point in the obtained image increases, adding blur Has a characteristic of increasing the intensity (increasing the degree of blurring of the image). Here, the curves A, B, and C indicate the blur characteristics when the distances in the real space from the imaging device to the subject of interest are different. For example, the curve A is a blur characteristic when the subject of interest is at infinity, the curve B is a blur characteristic with respect to a reference distance (for example, 2 m, etc.), and the curve C is close to the subject of interest. This is a blur characteristic with respect to (for example, 50 cm). As shown in this figure, when the distance from the reference point in the obtained image is the same as the intensity of the blur added to the image (the degree of blurring the image), the distance in the real space from the imaging device to the subject of interest is close. The stronger the relationship.

  The microcomputer 115 controls various sequences according to a program stored in the flash memory 117, reads parameters necessary for the various sequences from the flash memory 117, and issues commands to the blocks in FIG.

  The blur processing unit 120 includes a blur characteristic determination unit 122 and a blur addition calculation unit 124. The blur characteristic determining unit 122 is based on the relationship between the distance from the reference point and the blur intensity stored in the flash memory 117 according to the shooting condition, for example, the subject distance calculated by the subject distance calculating unit 212. The relationship between the position in the image and the intensity of the blur to be added is determined.

  The blur addition calculation unit 124 performs, for example, a low-pass filtering process based on the relationship between the position in the image determined by the blur characteristic determination unit 122 and the intensity of the blur to be added, and adds blur to the image.

  As described above, for example, the imaging device 102, the analog processing unit 103, the A / D conversion unit 104, and the like function as an imaging unit as a whole, and the subject distance calculation unit 212 functions as a distance acquisition unit, for example, an AF processing unit 109. Functions as a position information acquisition unit and a focus target subject tracking unit, for example, the flash memory 117 functions as a blur data storage unit, and for example, the blur addition calculation unit 124 functions as a blur processing unit.

  Next, the operation of the imaging apparatus according to the present embodiment, particularly the operation related to the blur processing will be described with reference to the drawings. Except for the operation related to the blur processing, the operation is the same as that of the conventional imaging apparatus. First, FIG. 3 shows a flowchart showing an example of the imaging operation of the imaging apparatus according to the present embodiment.

  In step S <b> 110, image data is acquired by the operations of the image sensor 102, the analog processing unit 103, and the A / D conversion unit 104. Further, the AE processing unit 108 uses the exposure condition determination table pre-recorded in the flash memory 117 of the camera body 100 based on information obtained from the photometric sensor or the like, and at the time of shooting, the ISO sensitivity, aperture, shutter speed, etc. To decide. The lens driver 206 drives the lens 202 under the control of the microcomputer 115 and the lens microcomputer 204 to change the focus position. At the same time, the AF processing unit 109 extracts high-frequency component signals from the image data, integrates the extracted high-frequency component signals, calculates a focus evaluation value for AF, and determines a position with the highest focus evaluation value. . The lens driver 206 sets the focus position of the lens at a position where the focus evaluation value is high based on the focus evaluation value determined by the AF processing unit 109.

  At this time, the AF processing unit 109 acquires position information on the image plane of the focused subject in focus.

  Further, the subject distance calculation unit 212 refers to the relationship between the position of each lens constituting the lens 202 stored in advance in the lens flash memory 210 and the distance to the subject to be focused, and the lens 202 set by the lens driver 206. The subject distance, which is the distance between the imaging device and the subject of interest, is calculated based on the position of the subject. However, if focusing fails, a preset reference distance is set as the subject distance. Based on the determined ISO sensitivity during shooting, aperture, shutter speed, and the like, the imaging apparatus performs shooting under the control of the microcomputer 115. At that time, in the case of still image shooting, the mechanical shutter 101 is driven, and in other cases, that is, in the case of moving image shooting and live view execution, the electronic shutter of the image sensor 102 is used.

  In step S <b> 120, the image processing unit 107 performs the above-described various image processing such as converting RAW data obtained by photographing into YCbCr data, for example. Although YCbCr data is used here, it may be converted into RGB data. In step S130, the microcomputer 115 determines whether the camera setting is in the blur addition mode. If the result of this determination is that there is no blur addition mode, the process moves to step S160.

On the other hand, in the blur addition mode, in step S140, the blur characteristic determination unit 122 stores the blur characteristic data D that is stored in the flash memory 117 and is the relationship between the distance from the reference point and the blur intensity as illustrated in FIG. _{Based on f} and the subject distance calculated in step S110, the relationship between the position in the image and the intensity of the blur to be added is determined.

The blur characteristic determining unit 122 reads out the blur characteristic of the blur characteristic data D _f stored in the flash memory 117 when there is a blur characteristic that matches the subject distance. When the blur characteristic with the same subject distance is not stored, the blur characteristic determination unit 122 reads the two closest blur characteristic data among the stored blur characteristics, and uses them to calculate the blur characteristic by linear interpolation. and, then, the discrete data of blur characteristic data D _f, for example, complemented with splines complementing, obtain a smooth characteristic.

  The calculation of the blur characteristic may be controlled so that the blur characteristic is maintained without being updated when the subject distance does not change to a predetermined value or more during live view or moving image shooting. At this time, for example, among the blur characteristics stored in the flash memory 117, the blur characteristics closest to the distance to the subject may be used. Alternatively, the in-focus range of the imaging apparatus is divided into a plurality of in-focus distance ranges that do not overlap each other, and the blur characteristics and the in-focus distance range are associated with each other and stored in the flash memory 117, and Control may be performed using a corresponding blur characteristic based on the distance. By such control, the amount of calculation can be reduced and the processing speed can be increased. Further, it is possible to prevent a minute change in the blur characteristic caused by the distance calculation error.

  Next, in step S150, the blur addition calculation unit 124 performs a low-pass filtering process on each pixel in the image, and adds blur to the image (performs the process of blurring the image). At this time, the blur intensity is based on the blur characteristic determined in step S140, and the reference point is a focal point on the image plane acquired by the AF processing unit 109 in step S110. A plurality of low-pass filter coefficients are prepared in advance, and various blur amounts are created by performing low-pass filtering processing by changing the low-pass filter coefficients. Here, if the blur is added to the image (processing for blurring the image) before the synchronization processing by the synchronization processing unit 1072 is performed, a false color may be generated in the synchronization processing. Therefore, blur is added after the synchronization processing to prevent this false color.

  FIG. 4 shows an outline of an example of an image to which blur addition is made in this way. In FIGS. 4A and 4B, the subject of interest is a person and is focused on the position of the person. Therefore, in FIGS. 4A and 4B, the reference point is the position of the person. The distance between the imaging device and the person is relatively long in the case of FIG. 4A and relatively close in the case of FIG. Therefore, in the case of FIG. 4A, for example, the characteristic of the curve A in FIG. 2 is used, and in the case of FIG. 4B, for example, the characteristic of the curve C in FIG. As a result, in the case of FIG. 4 (a), as shown in the figure, the person who is the subject of interest is focused, and the blur around it is relatively weak. The blur is relatively weak even if it is somewhat distant from the person in the image data. On the other hand, in the case of FIG. 4B, as shown in the figure, the person who is the subject of interest is focused, and the blur around it is relatively strong. Then, in the image data, the blur suddenly becomes stronger when the user is away from the person.

  In step S <b> 160, the microcomputer 115 displays the generated image on the LCD 114 via the LCD driver 113. In step S170, the microcomputer 115 determines whether the imaging apparatus is recording a moving image or has taken a still image. In this determination, whether or not moving images are being recorded is determined as moving images are being recorded from when the moving image recording button is pressed to when it is pressed again in the moving image recording mode, and otherwise moving images are not being recorded. Whether or not a still image has been photographed is determined to have been photographed when the release button is pressed in the still image photographing mode, and not photographed otherwise. As a result of this determination, if it is determined that the moving image is not being recorded or a still image is not being photographed, the processing is terminated.

  As a result of the determination in step S170, if it is determined that a moving image is being recorded or a still image is being shot, in step S180, the microcomputer 115 causes the image compression / decompression unit 110 to compress the generated image in, for example, JPEG format. . For example, a JPEG file is created for a still image, and a Motion JPEG file is created for a moving image. The microcomputer 115 records the created file on the recording medium 112 via the memory I / F 111. Note that the recording format is not limited to the JPEG format, but the TIFF format or H.264 format. H.264 format or the like may be used.

  According to the imaging apparatus of the present embodiment, an appropriate degree of blur without depending on the lens, for example, the focused subject as a reference, and the blur intensity according to the distance from the reference point on the plane on the image data. It is possible to acquire an image that causes an aesthetic appearance that effectively adds a blur condition that changes the image quality. Unlike image processing using, for example, a personal computer after shooting, shooting can be performed while checking the degree of blur on the LCD 114 during shooting. At that time, the intensity of the blur to be added depends on the distance from the focal point on the image and also on the distance in the real space up to the subject distance, so the image was taken using a large-diameter lens without depending on the lens. Such natural beautiful blur can be realized on the image. In addition, according to the present embodiment, since processing is performed in conjunction with focusing by autofocus, a similar effect can be obtained for moving images, and there is no possibility of adding blur to the focal point.

  Hereinafter, modifications of the imaging device according to the present embodiment will be described. Here, differences from the first embodiment will be described.

  The first modification is different from the first embodiment in the method of adding blur. In the first embodiment, in step S150, low-pass processing corresponding to the blur characteristic obtained in step S140 is performed on each pixel. On the other hand, in the present modification, an image with blur is created by the following procedure. That is, an image (referred to as a “blurred image”) obtained by performing uniform low-pass filtering on the entire image (referred to as “original image”) obtained in step S120 is created. Here, using the focal point as a reference point, a predetermined value α that approaches 0 as the distance from the reference point increases as shown in FIG. 5 is prepared. Then, using this value α, (α × [original image data] + (1−α) × [blurred image data]) is calculated for each pixel, and the weight of the blur amount varies depending on the position in the image. Calculate the value. With this processing, since α is always 0 at the in-focus point, blur is not added, and an image that becomes more blurred as the distance from the in-focus point increases can be acquired. According to the present modification, the amount of calculation can be reduced, and the blur addition process can be speeded up.

  Next, a second modification will be described. In general, the blur closer to the imaging device than the focal point is large, and the blur far away is small. Therefore, in the second modification, the focal point is used as a reference point, and the side closer to the imaging device than the reference point (for example, the lower side in the image) and the side farther from the imaging device than the reference point (for example, the upper side in the image) correspond respectively. A blur characteristic is prepared and stored in the flash memory 117. Then, blur is added by properly using these blur characteristics. Thereby, a natural blur having a difference between so-called “front blur” and “back blur” can be realized.

  Next, a third modification will be described. In the first embodiment, a focal point is used as a reference point, and blurs having different intensities according to the distance from the reference point on the image plane are added to the image. On the other hand, in the present modification, a horizontal reference line passing through the reference point on the image plane is formed, and blurs having different intensities according to the distance from the reference line are added to the image. That is, as the distance from the reference line increases in the vertical direction on the image plane, images with different blur intensities are created. This is because, under general shooting conditions, the difference in the real space distance from each subject in the vertical direction to the imaging device in the acquired image is the difference in the real space distance from each subject in the horizontal direction in the acquired image to the imaging device. This is because it is often larger than the difference. By processing in this way, the amount of calculation can be reduced, and the processing speed can be increased. At this time, a function of detecting the orientation of the imaging apparatus such as the vertical position or the horizontal position may be added to the imaging apparatus, and the vertical direction may be determined using the detection result.

  Next, a fourth modification will be described. In this modification, a blur characteristic set corresponding to each lens type (for example, fisheye, standard, telephoto, etc.) is prepared and stored in the lens flash memory 210, and is read out to add blur. Also, a blur characteristic set corresponding to the focal length of the lens may be prepared in the flash memory 117, and the focal length of the lens may be stored in the lens flash memory 210. In the zoom lens, the focal length of the lens at the time of shooting may be acquired, and blur may be added using a blur characteristic set prepared for each focal length of the lens. Further, the aperture value at the time of photographing may be acquired, and blurring may be performed using a blur characteristic set prepared for each aperture value.

  Next, a fifth modification will be described. In the first embodiment, as shown in FIG. 2, the blur characteristics are as follows: curve A is a blur characteristic with respect to infinity, curve B is a blur characteristic with respect to a reference distance (for example, 2 m), and curve C is with respect to a close distance (for example, 50 cm). The blur characteristics were used. That is, the farther the focal point is, the weaker the blur intensity is added, and the closer the focal point is, the stronger the blur intensity is added. On the other hand, in this modification, the curve A is a blur characteristic with respect to the closest distance, the curve B is a blur characteristic with respect to the reference distance, and the curve C is a blur characteristic with respect to infinity. As a result, the intensity of the blur that combines the optically generated blur and the blur added by this processing is always relatively strong, so that the depth of field as captured with a telephoto lens or a macro lens can be obtained regardless of the distance. A shallow lens effect can be obtained. As a result, it is possible to obtain a miniature photographic-like image that was taken using a tilt lens.

  As described above, the five modified examples are not limited to being used independently, and naturally, the modified examples may be appropriately combined. Note that the present invention is not limited to the above-described embodiment as it is, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. In addition, various inventions can be formed by appropriately combining a plurality of components disclosed in the embodiment. For example, even if some constituent elements are deleted from all the constituent elements shown in the embodiment, the problem described in the column of problems to be solved by the invention can be solved and the effect of the invention can be obtained. The configuration in which this component is deleted can also be extracted as an invention.

DESCRIPTION OF SYMBOLS 100 ... Camera body, 101 ... Mechanical shutter, 102 ... Image sensor, 103 ... Analog processing part, 104 ... A / D conversion part, 105 ... Bus, 106 ... SDRAM, 107 ... Image processing part, 1071 ... WB correction part, 1072 ... Synchronization processing unit, 1073 ... Color reproduction processing unit, 1074 ... Noise reduction (NR) processing unit, 108 ... AE processing unit, 109 ... AF processing unit, 110 ... Image compression / decompression unit, 111 ... Memory I / F, 112 DESCRIPTION OF SYMBOLS ... Recording medium, 113 ... Liquid crystal display (LCD) driver, 114 ... LCD, 115 ... Microcomputer, 116 ... Operation part, 117 ... Flash memory, 117a ... Blur characteristic data storage area, 120 ... Blur processing part, 122 ... Blur characteristic Determination unit 124... Blur addition calculation unit 150 .. I / F 200. Interchangeable lens 202. ... lens driver 206 ... lens microcomputer, 208 ... lens Flash memory, 210 ... object distance calculation unit, 212 ... aperture, D f _... blur characteristic data.

Claims (8)

Imaging means for imaging a subject and acquiring imaging data;
Position information acquisition means for acquiring information of a subject position of a subject of interest as a focusing target on an image plane based on the imaging data;
Blur data storage means for storing blur characteristic data representing the intensity of blur when performing the process of blurring the captured image according to the distance on the image plane with respect to the subject position;
In accordance with the subject position obtained by the position information acquisition unit and the blur characteristic data stored in the blur data storage unit, a blur process according to a distance on the image plane from the subject position is captured. Blur processing means for the image based on the data;
Equipped with,
The blur data storage means stores the blur characteristic data for a side closer to the subject of interest in real space and the blur characteristic data for a far side.
An imaging apparatus characterized by that. The blur processing means has the blur intensity read from the blur data storage means up and down the reference line in the image according to a distance from a horizontal reference line passing through the subject position on the image plane. depending on the imaging apparatus according to claim 1, characterized in that the blur processing. Further comprising distance acquisition means for acquiring a real space distance from the imaging device to the subject of interest;
The blur data storage means stores a plurality of the blur characteristic data according to the difference in the real space distance.
The imaging apparatus according to claim 1 or 2, wherein A focusing target subject tracking unit that tracks the target subject that is the focus target that moves when acquiring the imaging data and focuses the target subject;
The distance acquisition unit updates information on a real space distance from the imaging device to the target subject according to a change in focus accompanying the movement of the target subject,
The position information acquisition unit updates information on the position of the target subject on the image plane in accordance with a change in focus accompanying the movement of the target subject.
The imaging apparatus according to claim 3. The focusable range of the imaging device is divided into a plurality of focus distance ranges according to distances that do not overlap each other,
The blur data storage means stores the blur characteristic data associated with each focus distance range,
The blur processing means is
Selecting the in-focus distance range including a real space distance from the imaging device to the subject of interest;
Performing the blur processing on the image according to the blur characteristic data associated with the focus distance range;
The imaging apparatus according to claim 3 or 4, wherein   The blur data storage means includes the blur characteristic data when the real space distance is infinity, the blur characteristic data when the real space distance is close, and the real space distance is the infinity and the close distance. The image pickup apparatus according to claim 3, wherein the blur characteristic data in the case of a distance between them is stored.   The blur processing means includes the blur characteristic data having the same real space distance among the plurality of blur characteristic data stored in the blur data storage means, or the two blur characteristic data having the close real space distances. The imaging apparatus according to claim 3, wherein the blur processing is performed on the image using blur characteristic data obtained by interpolation from the image. The blur data storage means includes a plurality of blurs corresponding to at least one of a plurality of types of photographing lenses, a plurality of focal lengths of a photographing lens capable of changing a focal length, and a plurality of aperture values of the photographing lens. the imaging apparatus according to any one of claims 1 to 7, wherein storing the characteristic data.

Images