JP2018005008A - Camera body and interchangeable lens - Google Patents

Abstract

PROBLEM TO BE SOLVED: To solve the problem in which conventionally, when a picture-taking lens is changed, a range capable of focus detection has been unknown.SOLUTION: A camera body comprises: a mounting unit to which an interchangeable lens is mounted; an image pick-up element that has a plurality of focus detection-purpose pixels receiving light passing through the interchangeable lens to output a focus detection signal; a reception unit that receives information on an optical property from he interchangeable lens; a focus detection unit that detects a focusing state of the interchangeable lens by means of the focus detection signal output from the image pick-up element; and a setting unit that sets a range for detecting the focusing state from the optical property of the interchangeable lens and information about the focus detection-purpose pixel.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a camera body and an interchangeable lens.

  2. Description of the Related Art Conventionally, a camera using an image sensor having a focus detection pixel is known (for example, Patent Document 1). Conventionally, when the photographing lens is changed, there is a problem that the range in which focus detection is possible is not known.

Japanese Unexamined Patent Publication No. 2015-43026

According to the first aspect, the camera body includes a mounting portion on which the interchangeable lens is mounted, an imaging element having a plurality of focus detection pixels that receive light that has passed through the interchangeable lens and output a focus detection signal; A receiving unit that receives information on optical characteristics from the interchangeable lens, a focus detection unit that detects the in-focus state of the interchangeable lens based on a focus detection signal output from the imaging device, and the optical characteristics and the focus of the interchangeable lens A setting unit that sets a range in which the in-focus state is detected from the information related to the detection pixels.
According to the second aspect, the interchangeable lens is included in the imaging element from the mounting unit to which the camera body having the imaging element is mounted, the storage unit that stores information on the exit pupil of the imaging optical system, and the camera body. A receiving unit that receives information related to focus detection pixels, a setting unit that sets a range for detecting a focus state from information related to the exit pupil of the imaging optical system and information related to the focus detection pixels, and the setting unit. A transmission unit configured to transmit information regarding the set range to the camera body.

It is a cross-sectional view explaining the structure of the imaging device by embodiment of this invention. It is a block diagram explaining the principal part structure of the control system of the image pick-up element by embodiment. It is a figure explaining an image sensor. It is a schematic diagram explaining the relationship between the position where an imaging pixel was provided, and vignetting. It is a schematic diagram explaining the imaging range set on an imaging surface. It is a schematic diagram explaining the relationship between a to-be-photographed object and the defocus amount for every partial range. It is a figure which shows typically an example of the image to which the blurring effect was given. It is a schematic diagram for demonstrating an example of the blurring effect. It is a flowchart explaining the operation | movement in the case of producing | generating still image data. It is a flowchart explaining the operation | movement in the case of producing | generating moving image data. It is a flowchart explaining the operation | movement at the time of giving a blurring effect. It is a flowchart explaining the operation | movement at the time of giving a blurring effect. It is a block diagram explaining the principal part structure of the control system of the interchangeable lens by 2nd and 3rd embodiment.

-First embodiment-
An interchangeable lens according to the present embodiment and a camera body including the interchangeable lens will be described with reference to the drawings.
FIG. 1 is a cross-sectional view illustrating a configuration of a digital camera 100 including a camera body 200 to which an interchangeable lens 300 according to an embodiment is attached. For convenience of explanation, a coordinate system including an x-axis, a y-axis, and a z-axis is set as illustrated.

  The digital camera 100 includes a camera body 200 and an interchangeable lens 300, and the interchangeable lens 300 is a so-called mirrorless camera that is mounted via a mount (not shown). An interchangeable lens 300 having various imaging optical systems can be attached to the camera body 200 via a mount portion. The mount part is provided with electrical contacts 201 and 202. When the camera body 200 and the interchangeable lens 300 are coupled, an electrical connection is established through the electrical contacts 201 and 202.

  The interchangeable lens 300 includes an imaging optical system 1, a drive mechanism 3, a lens data unit 4, and a lens control unit 7. The imaging optical system 1 is an optical system for forming a subject image on the imaging surface of the imaging element 8 and is composed of a plurality of lenses including a focus adjustment lens. The lens control unit 7 includes a CPU, a ROM, a RAM, and the like, and is an arithmetic circuit that controls each component of the interchangeable lens 300 and executes various data processing based on a control program. The lens control unit 7 transmits / receives various information to / from the camera body 200 via the electrical contacts 201 and 202. The drive mechanism 3 is controlled by the lens control unit 7, and moves the focus adjustment lens constituting the imaging optical system 1 in the direction of the optical axis L (z) according to the lens drive amount input from the camera body 200 side via the electrical contact 201. Drive to the in-focus position along the axial direction. The lens data unit 4 is configured by, for example, a non-volatile recording medium, and stores various lens information related to the interchangeable lens 300, for example, the position and brightness (open F value) of the exit pupil of the imaging optical system 1 and the like. Yes.

  Inside the camera body 200, a control unit 5, an image sensor control circuit 6, an image sensor 8, an electronic viewfinder (EVF) 9, and an eyepiece 10 are provided. The camera body 200 is provided with an operation unit 11. A liquid crystal monitor 17 is provided on the back of the camera body 200. In the imaging element 8, imaging pixels such as a CCD and a CMOS are two-dimensionally arranged (rows and columns) on the xy plane. The imaging pixels of the imaging device 8 are provided with R (red), G (green), and B (blue) color filters, respectively. The image sensor 8 receives a light beam incident through the imaging optical system 1 to capture a subject image, and outputs an image signal to the image sensor control circuit 6. The imaging signal is used as a signal for generating image data (image signal) and a signal for focus detection (focus detection signal). Since the image pickup device 8 picks up a subject image through the color filter, the image pickup signal output from the image pickup pixel of the image pickup device 8 has color information of the RGB color system. Details of the image sensor 8 will be described later.

The electronic viewfinder 9 displays an image corresponding to the display image data generated by the control unit 5. The electronic viewfinder 9 displays various information (shutter speed, aperture value, ISO sensitivity, etc.) related to the imaging conditions. The image and various information displayed on the electronic viewfinder 9 are observed by the user through the eyepiece 10.
The rear monitor 17 is a display unit such as a liquid crystal monitor, for example, and displays an image corresponding to the display image data generated by the control unit 5. Further, the rear monitor 17 displays various information (shutter speed, aperture value, ISO sensitivity, etc.) related to the imaging conditions.

  The operation unit 11 includes various switches provided corresponding to various operation members operated by the user, and outputs an operation signal corresponding to the operation of the operation member to the control unit 5. The operation member is, for example, a release button, a menu button for displaying a menu screen on the rear monitor 17 provided on the rear surface of the camera body 200, a cross key or a cross key operated when selecting and operating various settings, and the like. A determination button for determining the setting selected by the button, an operation mode switching button for switching the operation of the digital camera 100 between the shooting mode and the playback mode, an exposure mode switching button for setting the exposure mode, and the like.

  Furthermore, the control system of the camera body 200 will be described with reference to the block diagram shown in FIG. As shown in FIG. 2, the camera body 200 includes an A / D conversion unit 12, an image processing circuit 13, a focus detection calculation circuit 14, a body-lens communication unit 15, a map creation unit 16, and a memory 18. Have. The control unit 5 includes a CPU, a ROM, a RAM, and the like, and controls each component included in the camera body 200 and the interchangeable lens 300 attached to the camera body 200 based on a control program, and various data. An arithmetic circuit that executes processing. The control program is stored in a nonvolatile memory (not shown) in the control unit 5. The control unit 5 includes a calculation unit (setting unit) 51 as a function. The calculation unit (setting unit) 51 calculates, as an imaging range, a range on the imaging surface of the imaging element 8 in which the detection accuracy of a focus state (focus state) by a focus detection calculation circuit 14 described later is equal to or greater than a predetermined threshold ( Set). The details of the calculation unit 51 will be described later.

  The image sensor control circuit 6 is controlled by the control unit 5 and controls the driving of the image sensor 8 and the A / D converter 12 to cause the image sensor 8 to perform charge accumulation, image signal readout, and the like. The A / D converter 12 converts the analog imaging signal output from the imaging device 8 into digital. The image processing circuit 13 uses the image signal output from the image sensor 8 as an image signal, performs various image processing on the image signal to generate image data, and then adds additional information and the like to generate an image file. Generate. The image processing circuit 13 records the generated image file on a recording medium 19 such as a memory card. The image processing circuit 13 generates display image data to be displayed on the electronic viewfinder 9 and the rear monitor 17 based on the generated image data and the image data recorded on the recording medium 19.

  The focus detection calculation circuit 14 uses the imaging signal output from the imaging device 8 as a focus detection signal and calculates a defocus amount using a known phase difference detection method. The body-lens communication unit 15 is controlled by the control unit 5 and communicates with the lens control unit 7 in the interchangeable lens 300 via the electrical contacts 201 and 202 to transmit camera information (defocus amount, aperture value, etc.). And lens information. The map creation unit 16 creates a defocus map indicating the distribution of the defocus amount on the captured image using the result of the focus detection calculation by the focus detection calculation circuit 14. The memory 18 is configured by, for example, a non-volatile recording medium, and various types of information related to the image sensor 8, for example, the size of the image pickup surface of the image sensor 8 and a plurality of image pickup pixels 80 (see FIG. 3) provided in the image sensor 8. Reference) position, characteristics of the microlens 81 (see FIG. 3) of the imaging pixel 80, and the like. The storage medium 19 is a non-volatile storage medium such as a memory card, and stores an image file generated by the image processing circuit 13.

Next, the image sensor 8 in the present embodiment will be described in detail.
FIG. 3A is a plan view schematically showing a part of the region including the central portion of the image sensor 8, and FIG. 3B is a diagram schematically showing a cross section of one image pickup pixel 80. Also in FIG. 3, a coordinate system including the x-axis, y-axis, and z-axis is set in the same manner as in the example shown in FIG. In the imaging element 8, a plurality of imaging pixels 80 are two-dimensionally arranged in a row direction (x direction) and a column direction (y direction). The color filters (R: red filter, G: green filter, B: blue filter) described above are provided at each pixel position of the imaging pixel 80 according to, for example, the rules of the Bayer array. In FIG. 3A, the color of the color filter arranged in the imaging pixel 80 is schematically expressed as “R”, “G”, or “B”. Note that the imaging pixel 80 provided in the focus detection area may not include a color filter.

  The imaging pixel 80 includes a microlens 81 and a first photoelectric conversion unit 82 and a second photoelectric conversion unit 83 provided under one microlens 81. The first photoelectric conversion unit 82 and the second photoelectric conversion unit 83 are provided side by side in the x direction. In the example illustrated in FIG. 3, the first photoelectric conversion unit 82 is provided on the x direction + side, and the second photoelectric conversion unit 83 is provided on the x direction − side. Light incident through the different regions of the imaging optical system 1 is incident on the first photoelectric conversion unit 82 and the second photoelectric conversion unit 83. That is, a pair of subject light beams used by the focus detection calculation circuit 14 for phase difference detection calculation are incident.

As described above, the imaging pixel 80 is provided with any one of R, G, and B color filters. For this reason, according to the position where the imaging pixel 80 is provided, the output first imaging signal and second imaging signal are composed of color information of green, red, or blue. In the present embodiment, the focus detection calculation circuit 14 is a first signal obtained by sequentially arranging the first imaging signals output from the first photoelectric conversion unit 82, which are color information of one of green, red, and blue. By detecting the relative image shift amount between the sequence {an} and the second signal sequence {bn} in which the second imaging signals output from the second photoelectric conversion unit 83 are sequentially arranged, the imaging optical system 1 The focus adjustment state, that is, the defocus amount is detected.
Note that the image processing circuit 13 uses a signal obtained by adding the first imaging signal from the first photoelectric conversion unit 82 of the imaging pixel 80 and the second imaging signal from the second photoelectric conversion unit 83 as an image signal. , Generate image data.

  The relationship between the arrangement position of the imaging pixel 80 and the vignetting of the subject light passing through the exit pupil region of the imaging optical system 1 will be described with reference to FIG. FIG. 4 shows a case where the interchangeable lens 300 having the exit pupil located at a position different from the projection positions of the first photoelectric conversion unit 82 and the second photoelectric conversion unit 83 by the microlens 81 is attached. In addition, the imaging pixel 80-1 disposed in the vicinity of the optical axis of the imaging optical system 1 and the peripheral portion of the imaging surface of the imaging element 8, that is, a position at a so-called high image height that is large from the optical axis. The imaging pixel 80-2 is shown as a representative.

  In the imaging pixel 80-1 disposed in the vicinity of the optical axis, the light beam 861 that has passed through the pair of exit pupil regions 841 of the imaging optical system 1 is incident on the first photoelectric conversion unit 82-1. The light beam 871 that has passed through the pair of exit pupil regions 851 of the imaging optical system 1 enters the second photoelectric conversion unit 83-1 of the imaging pixel 80-1. As shown in the drawing, since the imaging pixel 80-1 is disposed in the vicinity of the optical axis of the imaging optical system 1, the light beams 861 and 871 are not vignetted by the structure of the interchangeable lens 300, the camera body 200, or the like. The light enters the conversion unit 82-1 and the second photoelectric conversion unit 83-1.

  In the imaging pixel 80-2 arranged at a high image height position, the light beam 862 that has passed through the pair of exit pupil regions 841 of the imaging optical system 1 enters the first photoelectric conversion unit 82-2. A part of the light beam 872 that has passed through the pair of exit pupil regions 851 of the imaging optical system 1 is incident on the second photoelectric conversion unit 83-2 of the imaging pixel 80-2. That is, in the imaging pixel 80-2 disposed at a high image height position, the amount of light incident on the second photoelectric conversion unit 83-2 is larger than the amount of light incident on the first photoelectric conversion unit 82-2. Few. Therefore, the first signal sequence {an} based on the first imaging signal output from the first photoelectric conversion unit 82-2 and the second signal based on the second imaging signal output from the second photoelectric conversion unit 83-2. The accuracy of the defocus amount calculated using the signal sequence {bn} is lowered. That is, the focus state detection accuracy decreases.

In the present embodiment, when an interchangeable lens 300 having a different exit pupil position is attached, or when the exit pupil position changes like a zoom lens, imaging included in a region where the focus state detection accuracy does not decrease. A focus detection calculation and generation of image data are performed using the imaging signal from the pixel 80.
The calculation unit 51 of the control unit 5 calculates, as an imaging range, a range in which a light beam that is less affected by vignetting is incident on the imaging surface of the imaging element 8. The calculation unit 51 calculates an imaging range based on information related to the imaging pixel 80 stored in the memory 18 and information related to the imaging optical system 1 received from the interchangeable lens 300 via the body-lens communication unit 15. The information regarding the imaging pixel 80 includes projection positions of the first photoelectric conversion unit 82 and the second photoelectric conversion unit 83 by the microlens 81 and information on the position of each imaging pixel 80 on the imaging surface. Information regarding the imaging optical system 1 includes information on the position of the exit pupil of the imaging optical system 1.

  For example, the calculation unit 51 calculates a range Δ in which the projection positions of the first photoelectric conversion unit 82 and the second photoelectric conversion unit 83 by the microlens 81 and the position of the exit pupil of the imaging optical system 1 do not overlap. Based on the calculated non-overlapping range Δ, the calculation unit 51 determines the range (hereinafter referred to as an effective range 91 (FIG. 5A) on the imaging surface of the imaging pixel 80 into which the luminous flux not affected by vignetting is incident. Reference))) is calculated, and a predetermined range included in the effective range 91 is set as the imaging range 92 (see FIG. 5A). The calculation unit 51 sets the imaging range 92 inside the calculated effective range 91.

  FIG. 5 schematically shows the relationship among the entire imaging range 90, the effective range 91, and the imaging range 92 of the imaging device 8. As illustrated in FIG. 5A, the calculation unit 51 sets a rectangular range inscribed in the effective range 91 as the imaging range 92. The calculation unit 51 sets the ratio of the long side to the short side of the imaging range 92, for example, 3: 2. Note that the ratio of the long side to the short side of the imaging range 92 is not limited to 3: 2, but may be set to an arbitrary ratio.

  The calculation unit 51 refers to information on the position of the imaging pixel 80 on the imaging surface and determines whether or not each imaging pixel 80 on the imaging surface is located within the imaging range 92. The calculation unit 51 uses the imaging pixel 80 included in the imaging range 92 for the focus detection calculation and selects it as the imaging pixel 80 for generating image data.

When the imaging range 92 is calculated, the control unit 5 outputs an imaging signal from the imaging pixel 80 of the imaging element 8 via the imaging element control circuit 6. Among the output imaging signals, the imaging signals from the imaging pixels 80 in the imaging range 92, that is, the imaging pixels 80 selected by the calculation unit 51 are used for focus detection calculation and image data generation. The focus detection calculation circuit 14 detects the focus state of the imaging optical system 1 by the phase difference detection method using the imaging signal output from the imaging pixel 80 in the imaging range 92 as a focus detection signal. The image processing circuit 13 is an image obtained by adding the first imaging signal output from the first photoelectric conversion unit 82 of the imaging pixel 80 in the imaging range 92 and the second imaging signal output from the second photoelectric conversion unit 83. Image data is generated based on the signal.
Note that the image sensor control circuit 6 outputs an imaging signal from the imaging pixels 80 within the imaging range 92 among the imaging pixels 80 of the imaging element 8 and outputs an imaging signal from the imaging pixels 80 outside the imaging range 92. It is not necessary.

  As shown in FIG. 5B, the focus detection calculation circuit 14 divides the imaging range 92 and sets a plurality of partial ranges 93. 5B shows an example in which the imaging range 92 is divided into 3 × 4 partial ranges 93, but the number of the partial ranges 93 is not limited to this example. The focus detection calculation circuit 14 sequentially arranges the first imaging signals output from the first photoelectric conversion unit 82 including color information of any one of green, red, and blue among the imaging pixels 80 included in the partial range 93. By detecting a relative image shift amount between the first signal sequence {an} and the second signal sequence {bn} in which the second imaging signals output from the second photoelectric conversion unit 83 are sequentially arranged. A defocus amount is calculated for each range 93. The focus detection calculation circuit 14 calculates the drive amount of the imaging optical system 1 calculated based on the defocus amount, and transmits it as a drive signal to the interchangeable lens 300 via the body-lens communication unit 15. The drive mechanism 3 of the interchangeable lens 300 drives the focus lens to the in-focus position according to the received drive signal. The map creation unit 16 creates a defocus map indicating the distribution of the defocus amount in the imaging range 92 using the defocus amount for each partial range 93 calculated by the focus detection calculation circuit 14.

  The image processing circuit 13 performs various image processing on the imaging signal output from the imaging pixel 80 within the imaging range 92 and digitally converted by the A / D conversion circuit 12 to generate image data. Furthermore, the image processing circuit 13 performs a blurring process based on the defocus amount on the image data using the defocus map generated by the map creating unit 16.

  The image processing circuit 13 sets the degree of enhancement of the blur effect based on the absolute value of the defocus amount value calculated for each partial range 93. In this case, the image processing circuit 13 uses the coefficient set based on the absolute value of the defocus amount value when performing image processing using a known method for obtaining the background blur effect. Set the degree of emphasis, that is, the amount of blur.

In the present embodiment, since the image processing circuit 13 performs different types of blurring, for example, the following modes are provided.
(1) Emphasize the blur effect as the defocus amount increases (first mode)
(2) Control the degree of emphasis on the front and rear blur effects of the focused subject (second mode)
(3) Based on the defocus amount, the blur effect is limited for a specific area (third mode).
(4) Select a subject to be focused and apply a blur effect to an area other than the selected subject (fourth mode)
Hereinafter, description will be made for each of the first to fourth modes. Each mode can be selected by the user. In this case, the user selects a desired mode by operating the operation unit 11 from, for example, a menu screen displayed on the rear monitor 17. Note that the user may select one of the first mode to the fourth mode described above, or select a plurality of modes and input images with different types of blur effects to the image processing circuit 13. It may be generated.

<First mode>
In the first mode, the coefficient for setting the blur amount described above is set so that the blur effect is more emphasized as the absolute value of the defocus amount value increases. Note that the increase / decrease in the blur effect may be continuously increased as the absolute value of the defocus amount is increased, or may be increased step by step for each predetermined increase amount.
As a result, the amount of blur in the range corresponding to the partial range 93 where the absolute value of the defocus amount is large increases. That is, the image processing circuit 13 generates image data in which the blur effect is emphasized more than the blur effect obtained from the optical characteristics of the imaging optical system 1. The image data in which the blur effect is emphasized is displayed as a live view image on the rear monitor 17.

  The blurring process will be described with reference to FIG. FIG. 6A schematically shows the imaging range 92 and the subjects S1 to S4 in the imaging range 92 in a superimposed manner. The subject S1 is located at the shortest distance from the digital camera 100 as compared to the other subjects S2 to S4. The subject S4 is located at the place where the distance from the digital camera 100 is the longest compared to the other subjects S1 to S3. The subjects S2 and S3 are located between the subjects S1 and S4 at a distance from the digital camera 100. That is, the subjects S1 to S4 are positioned so that the distance from the digital camera 100 increases in this order.

  FIG. 6B schematically shows a plurality of partial ranges 93 obtained by dividing the imaging range 92 of FIG. 6A and the subjects S1 to S4 in a superimposed manner. FIG. 6B shows a case where the imaging range 92 is divided into 5 × 7 partial ranges 93 as an example. As described above, the subjects S1 to S4 are positioned such that the distance from the digital camera 100 increases in this order. In a state in which the subject S2 is in focus, the defocus amount for each partial range 93 calculated by the focus detection calculation circuit 14 differs for each partial range 93 corresponding to each of the subjects S1 to S4.

  FIG. 6C shows an example of the defocus amount value in the partial range 93 corresponding to each of the subjects S1 to S4. In FIG. 6C, the partial range group 95-1 including a plurality of partial ranges 93 corresponding to the subject S1, and the partial range group 95-2 including a plurality of partial ranges 93 corresponding to the subject S2. A plurality of partial ranges 93 corresponding to S3 are collectively referred to as a partial range group 95-3, and a plurality of partial ranges 93 corresponding to the subject S4 are collectively referred to as a partial range group 95-4. In the following description, the reference numeral 95 is given to collectively refer to the partial range group. In the partial range 93 in which light from the subject S1 located closest to the digital camera 100 is incident, the value of the defocus amount is, for example, -D1. In the partial range 93 in which light from the subject S3 whose distance from the digital camera 100 is farther than the subject S2 is incident, the value of the defocus amount is D2. In the partial range 93 where the light from the subject S4 is incident, the defocus amount value is D3 (> D2) compared to the case of the subject S3. That is, the partial range group 95-1 includes a partial range 93 having a defocus amount value of −D1, and the partial range group 95-2 includes a partial range 93 having a defocus amount value of 0. The range group 95-3 includes a partial range 93 having a defocus amount value D2, and the partial range group 95-4 includes a partial range 93 having a defocus amount value D3.

  In the example shown in FIG. 6C, the absolute value of the defocus amount value is the partial range group 95-4 corresponding to the subject S4, the partial range group 95-1 corresponding to the subject S1, and the portion corresponding to the subject S3. It becomes smaller in the order of the range group 95-3. The image processing circuit 13 determines the blur amount determined according to the absolute value of the defocus amount value for each of the partial range groups 95-4, 95-1, and 95-3 corresponding to the subject S4, the subject S1, and the subject S3. To add a blur effect.

  FIG. 7 schematically shows image data generated by applying the blur effect to the partial range groups 95-4, 95-1, and 95-3 corresponding to the subjects S1, S3, and S4, respectively. In FIG. 7, for the sake of illustration, a rough oblique line is drawn in accordance with the magnitude of the blur effect. For the subjects S1, S3, and S4, the blur amount is emphasized based on the absolute value of the defocus amount value. Therefore, the degree of enhancement of the blur effect can be made larger than the blur effect obtained from the optical characteristics of the imaging optical system 1. Since the absolute value of the defocus amount is the maximum for the subject S4, the amount of blur applied by the image processing circuit 13 is the partial range group 95-4 corresponding to the subject S4, and the other subjects S1 and S3. It becomes larger than the corresponding partial range groups 95-1 and 95-3.

<Second mode>
In the second mode, the above-described coefficient for setting the blur amount is not necessarily set so that the degree of enhancement of the blur effect increases as the absolute value of the defocus amount increases. For example, the degree of enhancement of the blur effect on the subject S1 ahead (on the digital camera 100 side) of the subject S2 shown in FIGS. 6 and 7 is different from the degree of enhancement of the blur effect on the subjects S3 and S4 behind. As an example, the image processing circuit 13 sets the degree of enhancement of the blur effect, that is, the blur amount so that the degree of blur is similar to the asymmetry of the aberration of the imaging optical system 1 in the front-rear direction (optical axis direction). Set the coefficient for. In this case, the image processing circuit 13 sets a coefficient so that the blur amount for the front subject S1 is small, and sets the coefficient so that the blur amount for the rear subjects S3 and S4 is large. The image processing circuit 13 determines the coefficient for the front subject S1, the rear subject S3, based on the information about aberration included in the information about the imaging optical system 1 received from the interchangeable lens 300 via the body-lens communication unit 15. A coefficient for S4 is set. The relationship between the aberration of the imaging optical system 1, the defocus amount, and the coefficient is stored in the memory 18 as data associated based on the result of a test or the like performed in advance. The image processing circuit 13 refers to this data and sets a coefficient for each of the subjects S1, S3, and S4. In order to prevent the linearity of the blur effect from being lost in the vicinity of the in-focus subject S2, the difference in blur amount between the front subject S1 and the rear subjects S3 and S4 is set to a predetermined amount or less. It is preferable that a coefficient is set.

  The image processing circuit 13 generates image data by applying a blur effect with a blur amount based on the set coefficient for each partial range group 95 corresponding to each subject. Accordingly, the blur effect of the subject S1 generated in the second mode is smaller than the blur effect on the subject S1 generated in the first mode. In addition, the blur effect of the subjects S3 and S4 generated in the second mode is larger than the blur effect of the subjects S3 and S4 generated in the first mode.

<Third mode>
In the third mode, the blur effect is not applied to a predetermined defocus amount region in the imaging range 92, and the blur effect is applied to other defocus amount regions. For example, the image processing circuit 13 does not give the blur effect to the area corresponding to the face of the person detected using the known face recognition process within the imaging range 92, and the area other than the face (for example, hair or A blur effect is applied to (background). In this case, the image processing circuit 13 corresponds to the depth when the F value is 8, for example, so that the entire area of the face is in focus. The coefficient is set so that the blur amount corresponds to the depth in the case of 8. The depth is a distance range that can be regarded as being in focus. Moreover, said F value is an example and is not limited to this value.

  Note that the image processing circuit 13 gives a blur effect to a subject other than the face having the same distance information as the detected face, that is, a defocus amount (that is, the background), but with the face in focus. The degree of enhancement of the blur effect should be smaller than other background regions so that the blur condition does not become unnatural. Further, the present invention is not limited to the case where the blur effect is not given to the region corresponding to the person's face, and a blur effect with a reduced degree may be given. Further, when a human face is not detected, the image processing circuit 13 may give a blur effect by the blurring process in the first mode described above.

When a plurality of faces are detected in the imaging range 92, the image processing circuit 13 gives the blur effect according to the distance information of the partial range group 95 corresponding to each face, that is, the defocus amount. Decide whether or not. When a plurality of faces are included in the depth, the image processing circuit 13 performs any one of the following blurring processes (1) to (3). Which of the blurring processes (1) to (3) is to be performed can be selected by the user operating the operation unit 11 from a menu screen or the like displayed on the rear monitor 17.
(1) No blur effect is given to all faces.
(2) The blur effect is not given to the closest face, and the blur effect is given to other faces.
(3) Among the persons corresponding to a plurality of faces, the blur effect is not given to the face located at the middle between the nearest and farthest distance from the digital camera 100, and the blur is not given to other faces. Gives an effect.

  When performing the blurring process (2) or (3) above, the image processing circuit 13 identifies a face to which no blur effect is to be applied based on the defocus amount of the partial range group 95 corresponding to each detected face. To do. Further, when performing the blurring process of (2), the image processing circuit 13 is based on the defocus amount of the partial range group 95 corresponding to the face to which the blur effect is applied, as in the first mode. That is, a coefficient is set. When performing the blurring process of (3), the image processing circuit 13 performs the same process as in the first mode or the second mode based on the defocus amount of the partial range group 95 corresponding to the face to which the blur effect is to be applied. Set the amount of blur.

  When all of the detected plurality of faces are not included in the depth, the image processing circuit 13 captures the imaging range 92 so that the partial range group 95 corresponding to the closest face is in focus. Gives a blur effect. That is, the image processing circuit 13 performs the blurring process of any one of (1) to (3) described above on the partial range group 95 corresponding to the face included in the same depth as the closest face.

<4th mode>
In the fourth mode, the image processing circuit 13 focuses on a plurality of selected subjects in the imaging range 92 and applies a blur effect to other subjects. In the following description, it is assumed that a plurality of subjects in the imaging range 92 are included in the depth. The user selects a plurality of subjects to be focused by operating the operation unit 11 while observing the live view image displayed on the rear monitor 17. When the rear monitor 17 includes a touch panel, the user can select a subject by performing an operation (touch operation) to touch a desired subject on the displayed live view image.

  The image processing circuit 13 sets the image plane of the image data to be generated based on the defocus amounts of a plurality of subjects selected by the user (hereinafter referred to as “selected subjects”). That is, the image processing circuit 13 artificially creates an image plane different from the imaging plane of the imaging element 8 orthogonal to the optical axis on the image data. Hereinafter, a detailed description will be given.

  In the subjects S1 to S4 shown in FIG. 6, as described above, the distance from the digital camera 100 increases in the order of the subjects S1, S2, S3, and S4. It is assumed that the subjects S1 and S2 are selected as the selected subjects among the subjects S1 to S4. In this case, the image processing circuit 13 generates image data so that the subjects S1 and S2, which are the selected subjects, are in focus.

  FIG. 8 schematically shows the positional relationship in the optical axis direction of each of the subjects S1 to S4 and the imaging position of each of the subjects S1 to S4 in this case. As described above, when the subject S2 is in focus, the subject S2 forms the image S2-1 on the imaging surface P1 of the imaging element 8. Other subjects S1, S3, and S4 connect images S1-1, S3-1, and S4-1 to positions different from the imaging surface P1, respectively, according to the distance from the digital camera 100.

  In this state, since the subjects S1 and S2 are selected as the selected subjects, the image processing circuit 13 generates image data so that the plane including the images S1-1 and S2-1 becomes the image plane P2. . In this case, the image processing circuit 13 does not apply the blur effect to the partial range group 95-1 corresponding to the subject S1, but applies the blur effect to the partial range groups 95-3 and 95-4 corresponding to the subjects S3 and S4. Apply. At this time, the image processing circuit 13 refers to the defocus map, and sets the defocus amounts of the partial range groups 95-3 and 94-4 corresponding to the subjects S3 and S4 to the defocus amounts based on the image plane P2. After conversion, the degree of enhancement of the blur effect, that is, the coefficient is set based on the converted defocus amount.

Although FIG. 8 shows an example in which the image plane P2 is a plane, the present invention is not limited to this, and the image plane P2 may be a curved surface. Further, according to the user's selection, the image processing circuit 13 may determine whether the image plane P2 is a flat surface or a curved surface.
Further, the depth with respect to the image plane P2 in FIG. 8 may be set by the user. In this case, the control unit 5 calculates a value of an aperture (not shown) for obtaining the set depth, and drives the aperture to the lens control unit 7 of the interchangeable lens 300 via the body-lens communication unit 15. Let me control.
Further, the present invention is not limited to the case where the selected subject is selected by a user operation. For example, the image processing circuit 13 may select the subject recognized as the main subject in the image data as the selected subject. In this case, the image processing circuit 13 may select a face recognized using a known face recognition process as a selected subject, or may select a person having a recognized face as a selected subject.

  The image data on which the blur effect is applied according to at least one of the first mode to the fourth mode as described above is displayed as a live view image on the rear monitor 17. The live view image corresponding to the image data with the blur effect and the live view image corresponding to the image data without the blur effect are alternately displayed on the rear monitor 17 at predetermined time intervals. May be. In this case, the live view image corresponding to the image data to which the blur effect is applied may be displayed with an index, a color, or the like indicating that the blur effect is applied. Alternatively, the live view image corresponding to the image data on which the blur effect has been applied may be embossed and displayed.

  When generating still image data, when the user fully presses the release button while the live view image is displayed, the control unit 5 brings the focus lens to the in-focus position on the interchangeable lens 300. Drive. In this state, the map creation unit 16 creates a defocus map using the defocus amount calculated by the focus detection calculation circuit 14. The control unit 5 causes the image sensor 8 to perform a photographing operation via the image sensor control circuit 6.

  When performing the imaging operation, as preprocessing, the control unit 5 uses the F value so that a plurality of subjects S1 to S4 are included in the depth based on the defocus map generated when the live view image is displayed. And the diaphragm is driven with respect to the interchangeable lens 300. When all the subjects S1 to S4 are not included in the depth in the calculated F value, the control unit 5 causes the image sensor 8 to perform a shooting operation by focus bracketing. The control unit 5 is not limited to the one that calculates the F value based on the defocus map generated when the live view image is displayed and drives the diaphragm. For example, the control unit 5 may generate image data corresponding to the shooting distance of each of the subjects S1 to S4, that is, the number of defocus amounts by focus bracketing with reference to the defocus map. In this case, it is possible to generate image data with high resolution by increasing the number of image data generated by focus bracketing with the F value set small.

  The image processing circuit 13 generates still image data and moving image data for recording using the imaging signal output from the imaging pixel 80 in the imaging range 92 of the imaging device 8 by the imaging operation. In this case, the image processing circuit 13 may perform the above-described blur effect on the still image data or moving image data for recording or may not perform the blur effect. When the blur effect is not applied, the image processing circuit 13 stores the image data not subjected to the blur effect described above in the storage medium 19 in association with the defocus map generated during the photographing operation. When the image processing circuit 13 reproduces still image data and moving image data, the image processing circuit 13 performs blurring processing on the image data with reference to the defocus map, and the still image data or moving image data to which the blur effect is given is performed. Generate. Also in this case, according to the setting by the user, the image processing circuit 13 generates still image data or moving image data to which the blur effect is added in the first mode to the fourth mode described above. At the time of reproduction, the depth setting with the aperture control is not performed in the fourth mode.

When recording still image data or moving image data for which a blur effect is applied is generated, the image processing circuit 13 stores the generated still image data or moving image data to which the blur effect is added in association with the defocus map. Store in the medium 19. Further, in addition to the defocus map, the still image data and moving image data before the blur effect is added to the storage medium 19 in association with the still image data and the moving image data to which the blur effect generated during the shooting operation is added. You may remember.
Note that the degree of enhancement of the blur effect may be different between still image data for recording, moving image data, and live view images. In particular, in the case of a live view image, the enhancement degree of the blur effect is preferably larger than that in the case of still image data. In the live view image observed on the rear monitor 17, the visible range is narrow, so that the user can easily grasp the blur effect by increasing the degree of enhancement of the blur effect.
The degree of enhancement of the blur effect may be determined based on a user operation. In this case, the user operates the operation unit 11 to change a parameter that determines the degree of enhancement of the blur effect. The operation may be performed from the menu screen displayed on the rear monitor 17 via the operation unit 11, or a dedicated operation member may be provided.

  The operation of the digital camera 100 will be described with reference to the flowcharts shown in FIGS. FIG. 9 is a flowchart for explaining an operation when generating still image data, and FIG. 10 is a flowchart for explaining an operation when generating moving image data or a live view image. Each process shown in the flowcharts of FIGS. 9 and 10 is performed by executing a program in the control unit 5. This program is stored in a memory (not shown), and is activated and executed by the control unit 5.

  First, the case where the still image data shown in the flowchart of FIG. 9 is generated will be described. In step S1, the information regarding the imaging optical system 1 is received from the interchangeable lens 300 via the body-lens communication part 15, and it progresses to step S2. In step S <b> 2, the calculation unit 51 receives information regarding the position of the exit pupil of the information related to the imaging optical system 1 and information regarding the positions where the first photoelectric conversion unit 82 and the second photoelectric conversion unit 83 are projected by the microlens 81. Thus, an imaging range 92 in which the exit pupil is not vignetted on the imaging surface of the imaging device 8 is calculated. When the imaging range 92 is calculated, the process proceeds to step S3.

  In step S3, the imaging signal is output from the imaging pixel 80 of the imaging element 8 via the imaging element control circuit 6, and the process proceeds to step S4. In step S4, the focus detection calculation circuit 14 performs focus detection calculation using the imaging signal output from the imaging pixel 80 in the imaging range 92 as a focus detection signal, and calculates a defocus amount. The map creation unit 16 creates a defocus map using the defocus amount calculated by the focus detection calculation circuit 14, and proceeds to step S5.

  In step S5, the image processing circuit 13 adds the first imaging signal from the first photoelectric conversion unit 82 and the second imaging signal from the second photoelectric conversion unit 83 of the imaging pixel 80 inside the imaging range 92. Image data is generated using the image signal, and a blur effect is applied to each of the partial range groups 95-1, 95-2, 95-3, and 95-4 with reference to the defocus map created in step S3. The process proceeds to step S6. Details of the operation for providing the blur effect in step S5 will be described later. In step S6, the image with the blur effect generated in step S5 is displayed as a live view image on the electronic viewfinder 9 or the rear monitor 17, and the process proceeds to step S7.

In step S7, it is determined whether or not the release button has been fully pressed by the user. When an operation signal is output from the operation unit 11 in response to the user fully pressing the release button, an affirmative determination is made in step S7 and the process proceeds to step S8. If the release button is not fully pressed by the user and no operation signal is output from the operation unit 11, a negative determination is made in step S7 and the process returns to step S1.
If a negative determination is made in step S7, the process may return to step S3 instead of returning to step S1. In other words, the processing after the next frame may be performed using the imaging range 92 already calculated. However, when a different interchangeable lens 300 is attached, or when the position of the exit pupil changes due to zooming, the process returns to step S1, and information indicating the position of the exit pupil is acquired again to calculate the imaging range 92. .

  In step S <b> 8, the focus detection calculation circuit 14 calculates the drive amount of the imaging optical system 1 calculated based on the defocus amount, and transmits it as a drive signal to the interchangeable lens 300 via the body-lens communication unit 15. The drive mechanism 3 of the interchangeable lens 300 drives the focus lens to the in-focus position according to the received drive signal, and proceeds to step S9. In step S9, the focus detection calculation circuit 14 performs focus detection calculation using the imaging signal output from the imaging pixel 80 in the imaging range 92 as a focus detection signal, and calculates the defocus amount. The map creation unit 16 creates a defocus map using the defocus amount calculated by the focus detection calculation circuit 14, and proceeds to step S10.

  In step S10, an imaging signal is output from the imaging pixel 80 via the imaging element control circuit 6, an imaging operation is executed, and the process proceeds to step S11. In step S11, the image processing circuit 13 generates image data using the imaging signal output from the imaging pixel 80 in the imaging range 92 among the imaging signals output in step S10. The image processing circuit 13 associates the generated image data with the defocus map created in step S9, stores it in a storage medium (not shown), and proceeds to step S12. In step S12, it is determined whether continuous shooting is being performed. When continuous shooting is being performed, an affirmative determination is made in step S12 and the process returns to step S8. If it is not during continuous shooting, a negative determination is made in step S12, and the process ends.

  Next, a case where moving image data or a live view image shown in the flowchart of FIG. 10 is generated will be described. The processing shown in this flowchart starts when the user operates the operation unit 11 and gives an instruction to capture a moving image. Each processing from step S21 (information acquisition regarding the imaging optical system 1) to step S26 (live view image display) is from step S1 (information acquisition regarding the imaging optical system 1) to step S6 (live view image display) in FIG. This is the same as each process.

In step S27, the image data generated by the image processing circuit 13 and the defocus map are associated and stored in a storage medium (not shown), and the process proceeds to step S28. In step S28, it is determined whether or not to finish moving image capturing. When ending moving image capturing, that is, when an operation for ending moving image capturing is performed by the user and an operation signal is output from the operation unit 11, an affirmative determination is made in step S28 and the process proceeds to step S29. When moving image capturing is to be continued, that is, when an operation for ending moving image capturing is not performed by the user and an operation signal is not output from the operation unit 11, a negative determination is made in step S28 and the process returns to step S21. In step S29, it is determined whether or not to end the display of the live view image. When the display of the live view image is continued, that is, when the user does not perform an operation for ending the display of the live view image and no operation signal is output from the operation unit 11, a negative determination is made in step S28 and the process proceeds to step S21. Return. When the display of the live view image is ended, that is, when an operation for the end of the display of the live view image is performed by the user and an operation signal is output from the operation unit 11, an affirmative determination is made in step S <b> 29. finish.
In addition, when negative determination is made at steps S28 and S29, the process may return to step S23 instead of the process returning to step S21. In other words, the processing after the next frame may be performed using the imaging range 92 already calculated. However, when a different interchangeable lens 300 is attached or when the position of the exit pupil changes due to zooming, the process returns to step S21, and information indicating the position of the exit pupil is acquired again to calculate the imaging range 92. .

  With reference to FIG. 11 and FIG. 12, an example of the process for providing the blur effect in step S5 of FIG. 9 and step S25 of FIG. 10 will be described. FIG. 11 is a flowchart showing processing when the second mode is set, and FIG. 12 is a flowchart showing processing when the third mode is set.

First, the process in the second mode will be described with reference to FIG.
In step S31, information regarding the aberration of the imaging optical system 1 is acquired from the interchangeable lens 300, and the process proceeds to step S32. In step S32, a coefficient for the front subject S1 and a coefficient for the rear subjects S3 and S4 are set based on the acquired information on the aberration, and the process proceeds to step S33. In step S33, for each partial pixel group 95, image data to which a blur effect is applied with a blur amount based on the set coefficient is generated, and the second mode is terminated.

Next, processing in the third mode will be described with reference to FIG.
In step S41, face recognition processing is performed on the generated image data, and the process proceeds to step S42. In step S42, it is determined whether or not all of the detected faces are included in the depth. If all the faces are within the depth, an affirmative determination is made in step S42 and the process proceeds to step S43. If there is a face that is not included in the depth, a negative determination is made in step S42, and the process proceeds to step S50 described later.

  In step S43, it is determined whether or not a setting has been made so that no blur effect is applied to all faces. In the case of setting not to give the blur effect to all the faces, an affirmative determination is made in step S43 and the process proceeds to step S44. In step S44, a coefficient for determining the amount of blur for the partial range group 95 corresponding to the area other than the detected face is set, and the process proceeds to step S49 described later. If no setting has been made to not give the blur effect to all the faces, a negative determination is made in step S43 and the process proceeds to step S45.

  In step S45, it is determined whether or not a setting is made so as not to give the blur effect to the closest face. In the case of setting not to give the blur effect to the closest face, an affirmative determination is made in step S45 and the process proceeds to step S46. In step S46, the defocus amount of the partial range group 95 corresponding to the detected face is compared, the closest face, that is, the face to which the blur effect is not given is specified, and the process proceeds to step S48 described later.

  If the setting is made so that the blur effect is not given to the face at the intermediate position between the nearest and farthest, a negative determination is made in step S45 and the process proceeds to step S47. In step S47, the defocus amount of the partial range group 95 corresponding to the detected face is compared, a face at an intermediate position, that is, a face to which no blur effect is applied is specified, and the process proceeds to step S48 described later. In step S48, a coefficient for determining the blur amount for each partial range group 95 is set based on the defocus amount of the partial range group 95 corresponding to the face not specified in step S46 or step S47, and the process proceeds to step S49.

In step S49, for each partial range group 95, image data to which a blur effect is applied with a blur amount based on the coefficient set in step S44 or step S48 is generated, and the third mode is ended.
If there is a face that is not included in the depth in step S42, a negative determination is made in step S42 and the process proceeds to step S50, where the defocus amount of the partial range group 95 corresponding to the detected face is compared, and the closest The face is identified and the process proceeds to step S51. In step S51, a face included in the same depth as the closest face specified in step S50 is specified, and the process proceeds to step S43. Thereafter, the processes from step S43 to step S49 described above are performed on the plurality of faces specified in step S51.

According to the first embodiment described above, the following operational effects are obtained.
(1) The camera body 200 includes the image sensor 8, the focus detection calculation circuit 14, the calculation unit 51 of the control unit 5, and the rear monitor 17. The imaging element 8 has a plurality of imaging pixels 80 that receive a light beam that has passed through the imaging optical system 1 and output an image signal. The focus detection calculation circuit 14 detects the focus state of the imaging optical system 1 using the image signal output from the imaging element 8. The calculation unit 51 calculates a range where the focus state detection accuracy is equal to or higher than a predetermined threshold as the imaging range 92. The rear monitor 17 displays an image generated using the image signal output from the imaging pixel 80 within the calculated imaging range 92. Therefore, the focus detection calculation and the image data are performed using the imaging signal from the imaging pixel 80 provided in a range in which a light beam not affected by vignetting or less affected by vignetting is incident on the imaging surface of the image sensor 8. And the reduction in focus detection accuracy can be suppressed.

(2) The body-lens communication unit 15 receives information related to the exit pupil of the imaging optical system 1, and the calculation unit 51 receives the received information related to the exit pupil of the imaging optical system 1 and the first photoelectric conversion in the imaging pixel 80. The imaging range 92 is calculated using the information regarding the position projected by the micro lens 81 by the unit 82 and the second photoelectric conversion unit 83. Therefore, even when the interchangeable lens 300 having a different exit pupil position is attached, or even when the exit pupil position changes like a zoom lens, there is no vignetting effect or little vignetting effect. The focus detection calculation and the generation of image data can be performed using the imaging signal from the imaging pixel 80 in the imaging range 92 where the light beam enters.

(3) The focus detection calculation circuit 14 calculates the defocus amount for the partial range 93 obtained by dividing the imaging range 92. The map creation unit 16 creates a defocus map indicating the distribution of the defocus amount for each partial range 93. The image processing circuit 13 performs a blurring process on the image generated using the image signal, using the defocus map created by the map creating unit 16. The rear monitor 17 displays the image that has been subjected to the blurring process. Thereby, it is possible to generate image data on which a blur effect different from the blur effect obtained from the optical characteristics of the imaging optical system 1 is applied.

(4) The image processing circuit 13 performs the blurring process for each partial range 93 with the blur amount determined based on the size of the defocus amount. Thereby, it is possible to generate image data in which the blur effect is emphasized more than the blur effect obtained by the optical characteristics of the imaging optical system 1.

-Second Embodiment-
A second embodiment will be described. In the following description, the same components as those in the first embodiment are denoted by the same reference numerals, and different points will be mainly described. Points that are not particularly described are the same as those in the first embodiment. The present embodiment is different from the first embodiment in that an imaging range is calculated by a control unit included in the interchangeable lens, and the calculated imaging range is transmitted to the camera body 200.

  FIG. 13 is a block diagram illustrating a configuration of a control system of the interchangeable lens 300 according to the second embodiment. The lens control unit 7 of the interchangeable lens 300 according to the second embodiment includes a calculation unit 71. Similar to the calculation unit 51 included in the control unit 5 in the first embodiment, the calculation unit 71 is on the imaging surface of the image sensor 8 in which the focus state detection accuracy by the focus detection calculation circuit 14 is equal to or greater than a predetermined threshold. The range is calculated as the imaging range 92. In order to calculate the imaging range 92, the lens control unit 7 requests the interchangeable lens 300 to transmit information about the imaging element 8 via the electrical contacts 201 and 202 (see FIG. 1), and is transmitted in response to the request. Information on the image sensor 8 is received. Thereby, the lens control unit 7 indicates the size of the imaging surface of the imaging element 8 and the position of the projected image on which the first photoelectric conversion unit 82 and the second photoelectric conversion unit 83 are projected by the microlens 81 of the imaging pixel 80. Information indicating the position of each imaging pixel 80 on the imaging surface of the imaging element 8 is received.

  The calculation unit 71 calculates the imaging range 92 on the imaging surface using information regarding the position of the exit pupil of the imaging optical system 1 read from the lens data unit 4 and information regarding the imaging element 8 received from the camera body 200. To do. In this case, the calculation unit 71 is the same as the calculation unit 51 of the control unit 5 provided in the camera body 200 in the first embodiment, and the size of the imaging range 92, for example, the coordinate value of each vertex of the rectangular range Is calculated. The lens control unit 7 transmits information indicating the calculated size of the imaging range 92 to the control unit 5 of the camera body 200 via the electrical contact 202. The lens control unit 7 is not limited to the one that calculates the coordinate value of the vertex of the imaging range 92 and transmits the coordinate value. For example, the calculation unit 71 may transmit a determination result as to whether or not each imaging pixel 80 of the imaging element 8 is included in the imaging range 92 as information.

  In the camera body 200 that has received the information indicating the size of the imaging range 92 from the lens control unit 7, the output of the imaging signal from the imaging range 92 and the calculation of the defocus amount are the same as in the case of the first embodiment. Also, processing such as creation of a defocus map, generation and display of image data is performed. That is, in the second embodiment, the process performed in step S2 in FIG. 9 and step S22 in FIG. 10 is performed on the interchangeable lens 300 side.

According to the second embodiment described above, the following operational effects can be obtained.
The interchangeable lens 300 includes a lens data unit 4 and a lens control unit 7. The lens data unit 4 stores information related to the exit pupil of the imaging optical system 1. The calculation unit 71 of the lens control unit 7 is on the imaging surface of the imaging device 8 based on the information related to the imaging pixel 80 included in the imaging device 8 received from the camera body 200 and the information related to the exit pupil of the imaging optical system 1. The imaging range 92 is calculated, and the lens control unit 7 transmits information indicating the imaging range 92 to the camera body 200. Therefore, by calculating the imaging range 92 on the interchangeable lens 300 side, other calculations can be performed on the camera body 200 side. Thereby, it is possible to prevent the processing load on the entire digital camera 100 from being borne only by the camera body 200, and to reduce the processing load on the entire digital camera 100.

The interchangeable lens 300 according to the second embodiment described above may be modified as follows. In the present modification, the calculation of the imaging range 92 is performed by the lens control unit 7 of the interchangeable lens 300 and the control unit 5 of the camera body 200.
The main configuration of the control system of the interchangeable lens 300 of this modification is the same as that of the interchangeable lens 300 according to the second embodiment shown in FIG. The calculation unit 71 of the lens control unit 7 calculates information necessary for the control unit 5 of the camera body 200 to determine the imaging range 92 and transmits the calculated result to the camera body 200. The calculation unit 71 uses the position of the exit pupil of the imaging optical system 1 and the microlens 81 of the imaging pixel 80 as information necessary for calculating the imaging range 92 so that the first photoelectric conversion unit 82 and the second photoelectric conversion unit 83 A range Δ in which the position of the projected image to be projected does not overlap is calculated.

  First, the calculation unit 71 requests the camera body 200 to transmit information regarding the image sensor 8 via the electrical contacts 201 and 202, and receives information regarding the image sensor 8 transmitted in response to the request. Accordingly, the calculation unit 71 receives information indicating the positions of the projection images of the first photoelectric conversion unit 82 and the second photoelectric conversion unit 83 of the imaging pixel 80. The calculation unit 71 calculates a range Δ in which the position of the exit pupil of the imaging optical system 1 read from the lens data unit 4 and the position of the projection image received from the camera body 200 do not overlap. The lens control unit 7 transmits information indicating the calculated non-overlapping range Δ to the control unit 5 of the camera body 200 via the electrical contact 202.

  The calculation unit 51 of the control unit 5 of the camera body 200 that has received the information indicating the non-overlapping range Δ from the lens control unit 7 uses the non-overlapping range Δ as in the case of the first embodiment. Thus, the imaging range 92 is calculated. Thereafter, the control unit 5, the image sensor control circuit 6, the focus detection calculation circuit 14, and the image processing circuit 13 perform the same processing as the processing described in the first embodiment.

According to the modification of the second embodiment described above, the following operational effects are obtained.
The calculation unit 71 of the lens control unit 7 of the interchangeable lens 300 includes information on the position of the projected image by the microlens 81 of the first photoelectric conversion unit 82 and the second photoelectric conversion unit 83 of the imaging pixel 80 received from the camera body 200, and Based on the information on the position of the exit pupil of the imaging optical system 1, information necessary for calculating the imaging range 92 is calculated. Thereby, even when the information indicating the position of the exit pupil of the imaging optical system 1 cannot be acquired on the camera body 200 side, the imaging range 92 can be set.

The following modifications are also within the scope of the present invention, and one or a plurality of modifications can be combined with the above-described embodiment.
(1) The calculation unit 51 is not limited to selecting the vignetting-free imaging pixel 80 in the imaging range 92, but also for the imaging pixels 80 in a predetermined range outside the imaging range 92 (hereinafter referred to as an outer peripheral range). You can choose. Although the outer peripheral range is affected by vignetting, it is a range in which the amount of light beams incident on the first photoelectric conversion unit 82 and the second photoelectric conversion unit 83 is not significantly reduced. When focus detection is performed using imaging signals from the imaging pixels 80 included in the imaging range 92 and the outer peripheral range, the outer peripheral range is set so that the focus detection accuracy is equal to or higher than a predetermined threshold. That is, the outer peripheral range is a range that is set based on a threshold value of focus detection accuracy when focus detection is performed.

  The focus detection calculation circuit 14 detects the focus state of the imaging optical system 1 using the imaging signal output from the imaging pixel 80 inside the imaging range 92 and the outer peripheral range as a focus detection signal. The image processing circuit 13 adds the first imaging signal from the first photoelectric conversion unit 82 and the second imaging signal from the second photoelectric conversion unit 83 of the imaging pixel 80 inside the imaging range 92 and the outer peripheral range. Image data is generated using the image signal.

(2) It is not limited to what displays a live view image using the imaging signal from the imaging pixel 80 in the imaging range 92. FIG. For example, the image processing circuit 13 generates a live view image using imaging signals output from all the imaging pixels 80 of the imaging element 8, and the rear monitor 17 superimposes a frame or the like indicating the imaging range 92 on the live view image. May be displayed.

(3) The present invention is not limited to storing the still image data and moving image data generated based on the imaging signal output from the imaging pixel 80 in the imaging range 92 in the storage medium 19. Image data generated based on the imaging signals output from all the imaging pixels 80 of the imaging element 8, and still image data and moving images generated based on the imaging signals output from the imaging pixels 80 in the imaging range 92. Data may be associated with and stored in the storage medium 19. Alternatively, the image data corresponding to the imaging signals from all the imaging pixels 80 may be stored in the storage medium 19 in association with still image data or moving image data to which the blur effect is given. Also in this case, the defocus map may be stored in association with the still image data or the moving image data.

(4) When a large blur occurs in the live view image being displayed, the image processing circuit 13 may resize the generated image data and display it on the rear monitor 17 as a live view image. In this case, only the resized image may be displayed as a live view image, or the resized image may be displayed superimposed on the live view image. As a result, an image in which a large blur has occurred can be displayed as a reduced image, so that the user can easily determine the subject.

DESCRIPTION OF SYMBOLS 1 ... Imaging optical system, 4 ... Lens data part, 5 ... Control part,
6 ... Image sensor control circuit, 7 ... Lens control unit, 8 ... Image sensor,
9 ... Electronic viewfinder, 11 ... Operation unit, 13 ... Image processing circuit,
14 ... focus detection calculation circuit, 15 ... body-lens communication unit, 16 ... map creation unit,
51... Calculation unit, 71... Calculation unit, 80.
100 ... Digital camera, 200 ... Camera body, 300 ... Interchangeable lens

Claims (17)

A mounting part to which the interchangeable lens is mounted;
An image sensor having a plurality of focus detection pixels that receive light passing through the interchangeable lens and output a focus detection signal;
A receiver for receiving information on optical characteristics from the interchangeable lens;
A focus detection unit that detects the in-focus state of the interchangeable lens based on a focus detection signal output from the image sensor;
A camera body comprising: a setting unit that sets a range in which a focus state is detected from optical characteristics of the interchangeable lens and information on the focus detection pixels. The camera body according to claim 1,
The receiving unit is a camera body that receives information about an exit pupil of the interchangeable lens as information on optical characteristics of the interchangeable lens. The camera body according to claim 1 or 2,
The information relating to the focus detection pixel is a camera body that is an arrangement of the plurality of focus detection pixels and a position where light that has passed through the interchangeable lens enters the focus detection pixel via a microlens. The camera body according to any one of claims 1 to 3,
A camera body in which a plurality of photoelectric conversion units are provided for each focus detection pixel. The camera body according to any one of claims 1 to 4,
The focus detection unit calculates a defocus amount for a partial range obtained by dividing the range,
A camera body comprising a map creation unit that creates a map based on a distribution of defocus amounts for each partial range. The camera body according to claim 5,
A processing unit that performs a blurring process on an image generated using an image signal generated by the image sensor using the map created by the map creating unit,
A camera body in which an image subjected to blurring processing by the processing unit is displayed on a display unit. The camera body according to claim 6,
The camera body which performs the blurring process with the blurring amount determined based on the size of the defocus amount for each partial range. The camera body according to claim 6 or 7,
A camera body further comprising a storage unit that stores the blurred image and the created map in association with each other. The camera body according to claim 6 or 7,
A camera body further comprising a storage unit that stores an image generated from an image signal output from the range and the created map in association with each other. The camera body according to claim 6 or 7,
A camera body further comprising a storage unit that stores an image generated from an image signal output from the range, an image subjected to the blurring process, and the created map in association with each other. The camera body according to claim 5,
Using the map created by the map creation unit, a processing unit that adds, for each partial range, an enhancement effect determined based on the size of the defocus amount to an image output from the range;
And a display unit that displays an image to which the enhancement effect is added by the processing unit. The camera body according to claim 11,
The processing unit is a camera body that changes an enhancement degree of a blur amount based on an operation on an operation member with respect to the determined enhancement effect. The camera body according to claim 11 or 12,
A camera body further comprising a storage unit that stores the image on which the enhancement effect has been applied and the created map in association with each other. The camera body according to claim 11 or 12,
A camera body further comprising a storage unit that stores an image output from the range in association with the created map. The camera body according to claim 11 or 12,
A camera body further comprising a storage unit that stores an image output from the range, an image on which the enhancement effect is applied, and the created map in association with each other. A mounting portion to which a camera body having an image sensor is mounted;
A storage unit for storing information related to the exit pupil of the imaging optical system;
A receiving unit that receives information on focus detection pixels included in the image sensor from the camera body;
A setting unit for setting a range for detecting the in-focus state from information related to the exit pupil of the imaging optical system and information related to the focus detection pixels;
An interchangeable lens comprising: a transmission unit that transmits information about the range set by the setting unit to the camera body. The interchangeable lens according to claim 16,
The receiving unit receives an arrangement of the plurality of focus detection pixels and a position at which light that has passed through the interchangeable lens enters the focus detection pixels via a microlens;
The setting unit includes information on a position of the exit pupil of the imaging optical system, an arrangement of the plurality of focus detection pixels, and light that has passed through the interchangeable lens enters the focus detection pixels via a microlens. An interchangeable lens that sets information on the range based on the position to be operated.

Images