JP5461896B2 - Imaging system and imaging method - Google Patents

Description

  The present invention relates to an imaging system and an imaging method.

  Japanese Patent Application Laid-Open No. 2004-133867 discloses a camera including a multipoint automatic focus detection apparatus that allows a photographer to select one area from a plurality of focus detection areas and execute autofocus in that area.

  The camera disclosed in Patent Document 1 performs autofocus in an area close to the selected area when an effective defocus amount is not obtained in the area selected by the photographer.

JP 2002-023042 A

  In the above invention, an in-focus image can be obtained in the vicinity of the selected region. However, for example, when the selected region is in the vicinity of the optical axis (the image center), in the image obtained in this way, the image is obtained at a location far from the selected region, that is, a location where the image height is large (image periphery). The subject that is positioned may be out of focus even at the same distance as the selected area. In such a case, it is possible to create an image focused on the subject by performing image processing on the image of the subject located at a location where the image height is large.

  Due to the characteristics of the optical system, the shape of the point image is almost rotationally symmetric in the vicinity of the optical axis even when the focus is shifted. Therefore, it is possible to correct the focus shift by relatively simple (simple) image processing. However, as the distance from the optical axis increases, that is, as the image height increases, the shape of the point image becomes rotationally asymmetric. In this case, in a place where the image height is large, complicated image processing must be performed in order to correct the focus shift. Therefore, there is a problem that complicated image processing is required in order to obtain an image in focus for the entire image.

  The present invention was invented in order to solve such problems, and an object thereof is to obtain an image that is entirely in focus by simple image processing.

An imaging system according to an aspect of the present invention includes an in-focus position moving unit configured to move the in-focus position from the first in-focus position to the second in-focus position with respect to the first subject after the first object is focused; An image acquisition unit that captures images at the in-focus position and acquires image data, an image processing unit that performs image processing on the acquired image data, and an in- focus position between the first in-focus position and the second in-focus position A focus position difference calculation unit that calculates a difference; and an image recovery value calculation unit that calculates an image recovery value based on the focus position difference, and the image processing unit performs the image processing based on the image recovery value. Do.

In the imaging method according to another aspect of the present invention, after focusing on the first subject, the in-focus position is moved from the first in-focus position to the second in-focus position with respect to the first subject, and imaging is performed at the second in-focus position. To obtain image data, calculate a focus position difference between the first focus position and the second focus position, calculate an image recovery value based on the focus position difference, and Then, image processing is performed based on the image restoration value .

  With these aspects, for example, it is possible to acquire image data focused on a subject that requires complex image processing, and focus on the subject that can create a focused image by simple image processing. Match.

  According to the present invention, it is possible to obtain a focused image as a whole while performing relatively simple image processing.

1 is a schematic block diagram of an imaging system according to a first embodiment. It is a graph which shows the relationship between image height and spherical aberration. It is an image figure for demonstrating the relationship between a to-be-photographed object's shape and image height. It is a flowchart which shows the control at the time of imaging | photography of 1st Embodiment. It is an image in the case of image | photographing by 1st Embodiment. It is an image image explaining the focus position in the 1st subject and the 2nd subject. It is a schematic block diagram of the imaging system of 2nd Embodiment. It is a flowchart which shows the control at the time of imaging | photography of 2nd Embodiment. It is an image image in the case of image | photographing by 2nd Embodiment. It is a schematic block diagram of the imaging system of 3rd Embodiment.

  A first embodiment of the present invention will be described with reference to FIG. FIG. 1 is a schematic block diagram of an imaging system according to the first embodiment. Here, a digital still camera (hereinafter referred to as a camera) will be described as an imaging system.

  The camera includes an optical system 1, an image sensor 2, a focus lens moving unit 3, a focus lens position detection unit 4, a focus position storage unit 5, a focus position difference calculation unit 6, and an image processing unit 7. , An image display unit 8, an image storage unit 9, and a control unit 10.

  The optical system 1 includes, for example, a plurality of lenses and a diaphragm. Focus adjustment is performed by moving some or all of the plurality of lenses along the optical axis as a focus lens. Here, the characteristics of the optical system 1 will be described.

  The optical system 1 is configured by combining a plurality of lenses. The optical system 1 is designed so that an image of a subject is formed on the light receiving surface of the image sensor 2. By the way, the optical system 1 is usually designed so that the aberration is minimized on the optical axis. On the other hand, the aberration increases as the distance from the optical axis increases (the image height increases). For example, as shown in FIG. 2, the spherical aberration increases as the image height increases. For this reason, it is difficult to form images of all subjects in the composition determined by the photographer with the same amount of aberration.

  The relationship between the image height and the shape of the subject will be described with reference to FIG. FIG. 3 shows a state when a plurality of points provided on the subject side are imaged by the optical system. Here, there are a plurality of points on the subject side, and each point is discretely arranged on the optical axis and in a direction away from the optical axis (a direction in which the object height increases). In FIG. 3, images of points (point images) Ia0 to Ia4 and Ib0 to Ib4 on the subject side are shown. Note that the point image in FIG. 3 is not actually taken but is a result of simulation.

  FIG. 3A shows a case where a point (subject) on the optical axis is focused and photographed. In FIG. 3A, since the point on the optical axis is in focus, the area of the formed point image (subject image) Ia0 is small. On the other hand, as the image height increases, the focus shift increases, so the area of the point images Ia1 to Ia4 increases. Moreover, as the image height increases, the shape of the point image becomes rotationally asymmetric. This is due to the influence of aberrations such as coma and astigmatism.

  For a subject image that is out of focus, it is possible to create a focused image by performing image processing. In this image processing, even if an image is out of focus, an image that is in focus can be created by relatively simple image processing if the aberration caused by the defocus is rotationally symmetric. On the other hand, when the aberration is rotationally asymmetric, complicated image processing is required. Note that when the aberration is rotationally symmetric, the point image also has a rotationally symmetric shape.

  FIG. 3B shows a case where a plurality of the same points as those in FIG. 3A are photographed, and the photograph is performed by focusing on a point at a position where the image height is the largest. As can be seen from the point image in FIG. 3B, the point image Ib4 at the position where the image height is the highest is not perfectly point-shaped due to the influence of aberration even when the image is in focus. That is, the area of the point image is larger than the point image Ia0 on the optical axis in FIG. Also, the shape of the point image is difficult to say rotationally symmetric. However, the point image has a smaller shape than the point image Ia4 having the same image height in FIG. Therefore, although the shape of the point image is rotationally asymmetric, the rotational symmetry is better than that of the point image Ia4.

  In FIG. 3B, the point image Ib0 on the optical axis is an out-of-focus image because the point at which the image height is large is focused (the area of the point image is large). However, the optical system 1 is designed so that aberrations are reduced on the optical axis. Therefore, the shape of the point image Ib0 on the optical axis is almost rotationally symmetric with respect to the optical axis. The other point images Ib1 to Ib3 are also rotationally asymmetric.

  As described above, although the shapes of the point image point image Ib0 to the point image Ib4 also vary in FIG. 3B, as a whole, the variation in the shape of the point image is smaller than that in FIG. . Therefore, by performing shooting in the state of FIG. 3B, it is possible to obtain an image in which the entire image is in focus by relatively simple image processing as compared with the image processing in FIG.

  In the present embodiment, shooting is performed utilizing the characteristics of the optical system 1, and an image in which the entire image is in focus is created by simple image processing.

  The focus lens moving unit 3 moves the focus lens along the optical axis direction by an actuator or the like. When focus adjustment is automatically performed by autofocus, the focus lens moving unit 3 moves the focus lens along the optical axis direction when the release button is pressed by a predetermined amount. Since the in-focus position is changed by moving the focus lens, the focus lens moving unit 3 can be called an in-focus position moving unit.

  The focus lens position detection unit 4 detects the position of the focus lens in the optical axis direction.

  The in-focus position storage unit 5 stores the position of the focus lens corresponding to the in-focus position when the subject is in focus. The in-focus position storage unit 5 stores the position of the focus lens corresponding to the in-focus position when the photographer presses the release button by a predetermined amount during auto-focus and focuses on the subject.

  The in-focus position difference calculation unit 6 performs calculation using the data in the in-focus position storage unit 5 (the position of the focus lens). For example, data when the in-focus position storage unit 5 focuses on the first subject (the focus lens position corresponding to the first in-focus position) and data when in-focus with the second subject (focus) If there is a lens position corresponding to the second focus position), the focus position difference between the first subject and the second subject is calculated from the two data.

  The image sensor 2 outputs an electrical signal corresponding to the light incident on the light receiving surface as image data at a predetermined timing. The imaging element 2 is an imaging element of a format called a CCD (charge coupled device) or a CMOS (complementary metal oxide semiconductor) sensor, or other various types.

  The image processing unit 7 includes a focus position detection unit 11, an image recovery value calculation unit 12, and an image recovery unit 13.

  The in-focus position detection unit 11 performs in-focus determination in the in-focus area based on the luminance component of the electrical signal output from the image sensor 2 and detects the in-focus position. In this embodiment, a focus area is set in a predetermined area including the optical axis, and the focus position is detected in the focus area. Here, the position of the focus lens when the subject is focused is detected as the focused position.

  The image recovery value calculation unit 12 calculates an image recovery value for the electrical signal output from the image sensor 2 based on the focus position difference calculated by the focus position difference calculation unit 6. The image recovery value is a value for correcting the obtained image data so that the entire image is in focus. Here, the image restoration value is a numerical value corresponding to each pixel on a one-to-one basis. However, one image recovery value may be associated with a plurality of pixels.

  The image restoration unit 13 corrects the image data based on the image restoration value calculated by the image restoration value calculation unit 12. The corrected image data is output to the image display unit 8 and the image storage unit 9.

  In addition, the image processing unit 7 performs other processes such as white balance adjustment and gradation / level correction. The image data processed by the image processing unit 7 is output to the image display unit 8 and the image storage unit 9.

  The image processing unit 7 includes a CPU, a ROM, a RAM, and the like. The ROM stores a control program and each data. Each function of the image processing unit 7 is exhibited by the CPU executing calculations based on the control program stored in the ROM.

  The image display unit 8 is a color liquid crystal display (LCD) panel or an organic EL (OEL) display panel. The image display unit 8 displays a captured image based on the signal corrected by the image recovery unit 13.

  The image storage unit 9 stores the image data corrected by the image recovery unit 13.

  The control unit 10 is connected to the optical system 1, the image pickup device 2, the focus lens moving unit 3, the image processing unit 7, and the like, and controls the entire camera including these. The control unit 10 includes a CPU, a ROM, a RAM, and the like. The ROM stores a control program and each data. Each function of the control unit 10 is exhibited by the CPU executing calculations based on the control program stored in the ROM.

  Next, control at the time of shooting of the present embodiment will be described with reference to the flowchart of FIG. Here, in the composition determined by the photographer as shown in FIG. 5, there is an example in which the first subject is near the center of the optical axis and the second subject is at the end of the composition, that is, at a position where the image height is large. Will be described. In the following, a person holding a bouquet in FIG. 5B is referred to as a first subject 15, and a person holding a hand with the first subject is referred to as a second subject 16.

  First, the camera position is determined by the photographer so that the second subject 16 falls within the focusing area.

  In step S100, when it is detected that the photographer has pressed the release button by a predetermined amount, the second subject 16 is focused ((a) in FIG. 5). The position of the focus lens corresponding to the second focus position with respect to the second subject 16 is stored in the focus position storage unit 5.

  In step S101, the camera position is changed by the photographer so that the first subject 15 falls within the in-focus area. As a result, the second subject 16 moves toward the end in the image displayed on the image display unit 8. This determines the composition ((b) in FIG. 5). Since step S101 is an action by the photographer, it is not included in the control of the imaging system. In the following, the action by the photographer is not included in the control of the imaging system.

  In step S102, when the release button is once released and the photographer detects that the release button has been pressed a predetermined amount again, the first subject 15 is focused.

  In step S103, a focus position difference is calculated from the position of the focus lens corresponding to the second focus position and the position of the focus lens corresponding to the first focus position with respect to the first subject 15. For example, as shown in FIG. 6, the first subject 15 and the second subject 16 have different in-focus positions because the distance from the camera is different. In step S103, the difference between the position of the focus lens corresponding to the first focus position and the position of the focus lens corresponding to the second focus position is calculated as the focus position difference.

  In step S104, when the photographer detects that the release button is further pressed by a predetermined amount, the focus lens moves to the position of the focus lens corresponding to the second focus position, and photographing is performed. As a result, shooting is performed focusing on the second subject 16 with a composition having the first subject 15 as the center of the image, and image data is obtained.

  In step S105, an image restoration value is calculated based on the focus position difference. Image processing is performed using this image recovery value, but the target of image processing is image data obtained by focusing on the second subject 16 and shooting. The image restoration value is a value for correcting the image data so that an image focused on the first subject 15 is obtained. The image restoration value is calculated based on the focus position difference from a preset lookup table (LUT).

  In step S106, image processing based on the image restoration value is performed on the image data obtained by photographing. The image data obtained by photographing is image data obtained by photographing focused on the second subject 16 as described above. Here, the image of the first subject 15 is an image out of focus, that is, an image with degraded image quality. However, the amount of aberration that causes image quality deterioration is almost rotationally symmetric. Therefore, it is possible to recover the deterioration of image quality in the image of the first subject 15 with relatively simple image processing. On the other hand, since the image of the second subject 16 is shot in a state where the second subject 16 is in focus, the image is focused on the periphery of the image. However, the image quality of the image is degraded due to the influence of aberration. However, the aberration causing image quality degradation is small and the rotational symmetry is improved. Therefore, as in the case of the first subject 15, it is possible to recover the deterioration of the image quality in the image of the second subject 16 by relatively simple image processing. In some cases, the image processing used for the first subject 15 can also be used for the second subject 16.

  In step S107, an image subjected to image processing based on the image correction value is displayed on the image display unit 8. The image data is stored in the image storage unit 9. Note that an image before correction obtained by focusing the second subject 16 is not displayed on the image display unit 8.

  The position of the camera when focused on the first subject 15 and the position of the camera when focused on the second subject 16 may be detected by, for example, a position sensor, an acceleration sensor, or a gyroscope. Then, the movement amount may be calculated from the detection result, and the image restoration value may be corrected. If the amount of movement is known, the distance between the first subject 15 and the second subject 16 in the composition can be calculated. Thereby, the image height of the second subject 16 can be calculated. Then, the image height of the second subject 16 may be calculated based on the movement amount, and the image restoration value may be corrected based on the image height. When the focus position difference between the first subject 15 and the second subject 16 is substantially zero, the image restoration value is determined by the image height.

  The effect of 1st Embodiment of this invention is demonstrated.

  When the composition at the time of shooting is a composition in which the first subject is located at the center, the second subject having an image height higher than that of the first subject in the composition at the time of shooting is focused. The image data obtained in this way is image data in which the second subject is in focus. In this case, since the second subject is focused and photographed, when performing image processing on the second subject (for example, image processing that makes the second subject image more focused) Image processing can be simplified. In the image data obtained here, the first subject may not be in focus. However, even in such a case, since the focus shift (blur) generated in the first subject near the optical axis is rotationally symmetric, it is possible to create a sharply focused image by relatively simple image processing. . Therefore, a clear image (an in-focus image) is created by performing image processing on the first subject. As a result, an image in which the entire image is in focus can be obtained by simple image processing.

  By calculating the image restoration value based on the focus position difference between the first focus position and the second focus position, it is possible to obtain an image in which the first subject and the second subject are in focus.

  By storing the second in-focus position in the in-focus position storage unit 5, the in-focus position difference can be quickly calculated and shooting can be performed quickly.

  By not displaying an image based on the image data obtained by focusing on the second subject on the image display unit 8, an image that is not in focus on the first subject is prevented from being displayed on the image display unit 8. be able to. This prevents the photographer from feeling unnatural.

  Next, a second embodiment of the present invention will be described with reference to FIG. FIG. 7 is a schematic block diagram of the imaging system of the second embodiment.

  The image processing unit 20 of the second embodiment includes a focus position detection unit 23, an image recovery value calculation unit 12, an image recovery unit 13, and a subject recognition unit 21. In the second embodiment, the focus lens moving unit 22 is different from the first embodiment.

  The subject recognition unit 21 detects a subject from the image acquired via the image sensor 2. The detection of the subject is performed by recognizing a portion that is a face candidate of the subject by, for example, the Viola-Jones method, a method using a Gabor filter and graph matching, or the like. The subject recognizing unit 21 is not limited to recognizing only a portion that is a face candidate of the subject, and it is sufficient that it can recognize the subject.

  The focus position detection unit 23 performs focus on the AF point (ranging point) selected by the photographer and detects the focus position. In addition, the subject detected by the subject recognition unit 21 is focused, and the focus position is detected.

  The focus lens moving unit 22 moves the focus lens along the optical axis direction so as to focus on the subject having the highest image height from among the subjects detected by the subject recognition unit 21 during shooting. The focus lens moving unit 22 moves the focus lens along the optical axis direction so as to focus on the subject corresponding to the AF point selected by the photographer.

  Next, control at the time of shooting according to the present embodiment will be described with reference to the flowchart of FIG. Here, an example will be described in which the photographer focuses on a person holding a bouquet in the composition of FIG. In the following, as in FIG. 5, a person holding a bouquet is referred to as a first subject 15, and a person holding a bouquet and a hand is referred to as a second subject 16.

  In step S <b> 200, the subject recognition unit 21 detects the first subject 15 and the second subject 16. Here, as shown in FIG. 9A, the image display unit 8 indicates that the first subject 15 and the second subject 16 have been detected by surrounding the face portions of the first subject 15 and the second subject 16 with a rectangular frame. To display.

  In step S201, the second subject 16 having the largest image height among the detected subjects is extracted.

  In step S202, when it is detected that the release button has been pressed by a predetermined amount, the first subject 15 selected by the photographer is focused.

  Here, focusing is performed on an AF point selected by the photographer from among a plurality of AF points. For example, a plurality of AF points are arranged as shown in FIG. 9B, from which a photographer can select. Here, the AF point on the first subject 15 at the center of the screen is selected. When the AF point is selected by the photographer, the selected AF point is displayed in red, for example, as shown in FIG. 9C, and the AF points other than the face portion of the first subject 15 are turned off. Also good. At that time, the AF point on the second subject 16 may not be displayed. This can prevent the photographer from being unnatural. Note that the AF point may be provided only in the vicinity of the optical axis and at a location where the image height is large, without being arranged over the entire surface as shown in FIG. 9B.

  In step S203, it is determined whether or not the first subject 15 and the second subject 16 match. Here, the first subject 15 is the subject selected by the photographer, and the second subject 16 is the subject having the highest image height among the subjects detected by the subject recognition unit 21. If the second subject 16 and the first subject 15 do not match, the process proceeds to step S204, and if they match, the process proceeds to step S210. In the composition shown in FIG. 9, since the second subject 16 having the highest image height and the first subject 15 selected by the photographer are different subjects, the process proceeds to step S204.

  Here, it is determined whether or not the first subject 15 and the second subject 16 match. However, even if it is determined whether or not the distance between the first subject 15 and the second subject 16 is smaller than a predetermined value. good. In this case, when the distance between the first subject 15 and the second subject 16 is greater than or equal to a predetermined value, the process proceeds to step S204. If the distance between the first subject 15 and the second subject 16 is smaller than the predetermined value, the process proceeds to step S210.

  In step S204, the first focus position with respect to the first subject 15 is stored. That is, the position of the focus lens corresponding to the first focus position is stored.

  In step S205, when it is detected by the photographer that the release button has been further pressed by a predetermined amount, the second subject 16 is focused, and then photographing is performed.

  In step S206, a focus position difference is detected from the position of the focus lens corresponding to the first focus position and the position of the focus lens corresponding to the second focus position with respect to the second subject 16.

  In step S207, an image restoration value is calculated based on the focus position difference. The image restoration value is calculated based on the focus position difference from a preset look-up table (LUT) or function.

  In step S208, the image restoration value is corrected according to the state of the optical system 1. The state of the optical system 1 is, for example, focal length information. For example, when the optical system 1 is a zoom lens, the state of occurrence of aberration varies depending on whether it is a wide-angle lens or a telephoto lens. That is, the same focus shift (in-focus position difference) and different aberrations occur. Therefore, in this embodiment, the image recovery value is corrected according to the state of the optical system 1. By correcting the image restoration value according to the state of the optical system 1, an accurate image restoration value can be calculated.

  Further, the image restoration value is corrected according to the characteristics of the optical system 1. The characteristics of the optical system 1 are determined when the optical system 1 is designed, and are represented by, for example, aberration information, PSF, LSF, and MTF. Therefore, the image restoration value can be corrected by setting a correction value in advance according to the characteristics of the optical system 1. Such characteristics of the optical system 1 change according to the position of the subject in the composition, that is, the image height. By correcting the image restoration value according to the characteristics of the optical system 1, an accurate image restoration value can be calculated. Here, the second subject 16 has a large image height in the composition, but since the second subject 16 is in focus, the influence of the aberration is smaller than that of the first subject 15. Therefore, the correction value for the second subject 16 is smaller than the correction value for the first subject 15.

  The state in which the point (subject) with the highest image height is in focus is the state shown in FIG. In this state, the uppermost point image is the smallest. Here, since each point on the subject side is on the same plane (no deviation occurs in the direction along the optical axis), no in-focus position difference occurs in each point image. Nevertheless, the point image at the bottom (on the optical axis) has spread. Therefore, when a focus position difference is generated, the point image at the lowest stage (on the optical axis) is further spread than the state of FIG.

  In the first embodiment, the image restoration value is calculated based on the focus position difference. However, that alone only corrects the amount added by the difference in focus position. That is, the point image spread depending on the in-focus position is only restored to the lowest state in FIG. On the other hand, in the present embodiment, the image restoration value is corrected according to the characteristics of the optical system 1. Therefore, the point image in the lowermost stage in FIG. 3B can be made smaller.

  Note that, when the focus position difference between the first focus position of the first subject 15 and the second focus position of the second subject 16 is substantially zero, the state of the optical system 1 and the characteristics of the optical system 1 Determines the image recovery value.

  In step S209, the captured image data is corrected (image processing) based on the image recovery value. The image data obtained by shooting is image data focused on the second subject 16. By focusing on the subject with the highest image height and shooting, it is possible to obtain an image focused on the second subject 16 with the highest image height. On the other hand, the image data obtained by photographing is image data in which the first subject 15 is not in focus, but the first subject 15 is located on the optical axis side with respect to the second subject 16. Therefore, a focused image can be created by performing relatively simple image processing.

  If it is determined in step S203 that the second subject 16 and the first subject 15 match, shooting is performed in step S210. This is a case where the subject selected by the photographer as a focus target is at a position where the image height is the highest in the composition. For example, this is a case where the AF point selected by the photographer in the composition shown in FIG. In step S210, when it is detected that the release button is further pressed by a predetermined amount, the subject corresponding to the AF point selected by the photographer is focused, and then photographing is performed.

  In step S211, an image correction value is calculated according to the state of the optical system 1 and the characteristics of the optical system 1 by the same method as in step S208.

  In step S212, correction (image processing) based on the image correction value is performed on the obtained image data.

  In step S213, the image that has undergone image processing is displayed on the image display unit 8. Further, the image data is stored in the image storage unit 9.

  In the present embodiment, the subject is detected by the subject recognition unit 21, but without providing the subject recognition unit 21, the focus position is detected based on the AF point selected by the photographer, and based on the focus position difference. The image correction value may be calculated.

  The effect of 2nd Embodiment of this invention is demonstrated.

  The subject recognizing unit 21 detects the subject and focuses on the second subject having the highest image height in the composition to perform shooting. As a result, the second subject with the highest image height is brought into focus. Can be obtained. At this time, the aberration in the second subject is reduced. Similarly, the first subject near the optical axis also has substantially rotationally symmetric aberration. Therefore, focused images can be created for both the first subject and the second subject by simple image processing.

  When the subject corresponding to the AF point selected by the photographer from the plurality of AF points is at the position where the image height is the highest in the composition, the subject corresponding to the selected AF point is focused and shot. Thereby, an image intended by the photographer can be obtained.

  By calculating the image recovery value according to the state of the optical system 1, it is possible to obtain an image that is further in focus.

  By calculating the image recovery value according to the characteristics of the optical system 1, and particularly calculating the image recovery value according to the image height, it is possible to obtain a more focused image.

  Image processing can be performed quickly by storing the state of the optical system 1 and the characteristics of the optical system 1 in advance.

  By providing a plurality of AF points, the subject can be focused without moving the camera.

  Next, a third embodiment of the present invention will be described with reference to FIG. FIG. 10 is a schematic block diagram of the imaging system of the third embodiment.

  The imaging system according to the third embodiment includes an imaging device and a processing device. In the present embodiment, a case where a camera is used as the imaging device and a computer is used as the processing device will be described. However, it is not limited to these.

  The camera includes an optical system 1, an image sensor 2, a focus lens moving unit 22, a focus lens position detection unit 4, a focus position storage unit 5, a focus position difference calculation unit 6, and a first image processing unit. 32, a first image display unit 33, a recording unit 30, a first communication unit 31, and a control unit 10. About the same structure as 2nd Embodiment, the code | symbol same as 3rd Embodiment is attached | subjected and description here is abbreviate | omitted.

  The first image processing unit 32 includes a focus position detection unit 23, an image recovery value calculation unit 12, and a subject recognition unit 21.

  The recording unit 30 records image data obtained by the image sensor 2. The recording unit 30 records the image correction value calculated by the image recovery value calculation unit 12. The image data and the image correction value are recorded with a correlation.

  The first communication unit 31 reads out the image data and the image correction value recorded in the recording unit 30, and sends a signal of the image data and the image recovery value to the second communication unit 34 of the computer via radio.

  The computer includes a second communication unit 34, a second image processing unit 35, a second image display unit 36, and an image storage unit 37.

  The second communication unit 34 receives the image data and the image correction value signal sent from the first communication unit 31. The received signal is sent to the second image processing unit 35.

  The second image processing unit 35 includes an image restoration unit 38. The image restoration unit 38 performs image processing on the received image data based on the image correction value.

  The second image display unit 36 displays an image based on the image data created by the second image processing unit 35. The image storage unit 37 stores the image data created by the second image processing unit 35.

  In the imaging system of the third embodiment, the image data obtained by the imaging device 2 and the image restoration value calculated by the image restoration value calculation unit 12 are stored in the recording unit 30, and the first communication unit 31 transmits the image restoration value. The image data and the image restoration value are transmitted to the second communication unit 34. Then, image processing is performed by the image recovery unit 38 based on the image data and the image recovery value received by the second communication unit 34 of the computer, and a focused image is created for the entire image.

  The effect of the third embodiment of the present invention will be described.

  By sending the image data and the image restoration value from the first communication unit 31 of the camera to the second communication unit 34 of the computer, the storage capacity of the camera can be reduced. In addition, image processing in the camera can be reduced. Further, image processing can be performed at any time by a computer set at a location away from the camera.

  In each embodiment, the case where there are two subjects in the composition has been described. However, the present invention is not limited to this, and even when there are three or more subjects in the composition, shooting is performed by the above method. It can be carried out.

  The configuration of each embodiment is not limited to the above configuration, and can be realized by a combination of hardware and software. Moreover, it is also possible to combine each embodiment.

  In this case, the imaging system includes a main storage device such as a CPU and a RAM, and a computer-readable storage medium in which a program for realizing all or part of the above processing is stored. Here, this program is called an image processing program. Then, the CPU reads out the image processing program stored in the storage medium and executes information processing / calculation processing, thereby realizing the same processing as that of the imaging system.

  Here, the computer-readable recording medium refers to a magnetic disk, a magneto-optical disk, a CD-ROM, a DVD-ROM, a semiconductor memory, and the like. Alternatively, the image processing program may be distributed to a computer via a communication line, and the computer that has received the distribution may execute the image processing program.

  It goes without saying that the present invention is not limited to the above-described embodiments, and includes various modifications and improvements that can be made within the scope of the technical idea.

DESCRIPTION OF SYMBOLS 1 Optical system 2 Image pick-up element 3, 22 Focus lens moving part 4 Focus lens position detection part 5 Focus position storage part 6 Focus position difference calculation part 7, 20 Image processing part 8 Image display part 10 Control part 11 Focus position detection Unit 12 Image recovery value calculation unit 13, 38 Image recovery unit 15 First subject 16 Second subject 21 Subject recognition unit 30 Recording unit 31 First communication unit 32 First image processing unit 33 First image display unit 34 Second communication unit 35 Second image processing unit 36 Second image display unit

Claims (17)

A first focus position when the first subject is focused, and a focus position moving unit that moves the focus position to a second focus position different from the first focus position;
An image acquisition unit that performs imaging at the second in-focus position and acquires image data;
An image processing unit that performs image processing on the acquired image data;
An in-focus position difference calculating unit that calculates an in-focus position difference between the first in-focus position and the second in-focus position;
An image recovery value calculation unit that calculates an image recovery value based on the focus position difference,
The imaging system, wherein the image processing unit performs the image processing based on the image recovery value.   2. The imaging according to claim 1, wherein the second focus position is a focus position at which a second subject located farther from the optical axis than the first subject in the composition at the time of shooting is focused. system. Provided with a subject detection unit that detects the subject from the composition,
The imaging system according to claim 2, wherein the second subject is at a position farthest from the optical axis among the detected subjects.   The imaging system according to any one of claims 1 to 3, further comprising a focus position storage unit that stores at least one of the first focus position and the second focus position. . When the first subject is at a position farthest from the optical axis among a plurality of subjects, the image acquisition unit performs imaging at the first focus position and acquires image data. The imaging system according to any one of claims 1 to 4. The imaging system according to claim 1, wherein the image recovery value calculation unit corrects the image recovery value based on an image height of the first subject.   The imaging system according to claim 1, wherein the image restoration value calculation unit corrects the image restoration value according to a state of an optical system.   The imaging system according to claim 1, wherein the image restoration value calculation unit corrects the image restoration value according to characteristics of an optical system.   The imaging system according to claim 7 or 8, wherein the image restoration value calculation unit stores at least one of a state of the optical system and a characteristic of the optical system.   The imaging system according to claim 1, wherein the focus position moving unit moves the focus position based on a distance measuring point selected from a plurality of distance measuring points. .   The imaging system according to claim 3, further comprising an image display unit that displays the detected position of the subject.   The imaging system according to claim 11, wherein the image display unit does not display a distance measuring point other than the detected vicinity of the subject.   The imaging system according to claim 11 or 12, wherein the image display unit does not display an image based on image data obtained by focusing on the second subject. An imaging device including the in-focus position moving unit and the image acquisition unit;
The imaging system according to claim 1, further comprising: an image processing apparatus including the image processing unit. The imaging apparatus includes a first communication unit that transmits the image data,
The imaging system according to claim 14, wherein the image processing apparatus includes a second communication unit that receives the image data transmitted from the first communication unit.   16. The imaging system according to claim 1, wherein the focusing position moving unit moves the focus lens along the optical axis direction. When obtaining an image focused on the first subject, the focus position is moved from the first focus position with respect to the first subject to the second focus position after focusing on the first subject;
Shooting at the second in-focus position to obtain image data,
Calculating a focus position difference between the first focus position and the second focus position;
An image restoration value is calculated based on the focus position difference,
An imaging method comprising performing image processing on the acquired image data based on the image recovery value.