JP2017017440A - Imaging device and control method for the same - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an imaging device that can achieve an image having an excellent correction result when an imaging face is curved and image correction processing based on the optical characteristic of a lens is performed, and a control method for the same.SOLUTION: An imaging unit 22 is configured so that the imaging surface thereof is allowed to be curved, and captures an optical image formed on the imaging surface by an interchangeable lens 150. An image processor 24 performs image correction processing on the image data of the imaging unit 22 based on parameters representing the optical characteristic of the interchangeable lens 150. A curvature controller 26 sets a curvature when the imaging surface is curved, and curves the imaging surface so that the imaging surface has the set curvature. When the curvature of the imaging surface is set to a second curvature different from a first curvature conformed with the optical characteristic of the interchangeable lens 150, a system controller 50 corrects the parameters representing the optical characteristic of the interchangeable lens 150 to parameters corresponding to the second curvature, and causes the image processor 24 to perform image correction processing based on the corrected parameters.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an imaging apparatus having a curved imaging surface and a control method thereof.

  In recent years, the study and development of an image sensor (image sensor) whose imaging surface has a curved shape has been underway. Such an image sensor can receive light rays from a subject incident from a lens in a nearly vertical state on the imaging surface by curving the imaging surface. It is expected to be applied to products with large lenses. Japanese Patent Application Laid-Open No. 2004-228561 discloses a technique that enables the curved shape of the imaging surface of the imaging element to be dynamically switched.

  On the other hand, with the widespread use of digital single-lens reflex cameras with interchangeable lenses and so-called mirrorless single-lens cameras, there are increasing opportunities for users to take pictures while exchanging a plurality of lenses according to the shooting scene. Some interchangeable lenses have unique information (hereinafter referred to as lens information) according to the characteristics of the lens, and the lens information is stored in a flash ROM or the like inside the lens. There are many cases. The lens information may be held in the camera body. In this case, lens information about all the lenses that can be attached to the camera or some of them is held in a built-in flash ROM of the camera body. In many cases, a camera that can hold lens information in this way can add or modify lens information through application software, for example. The lens information may include parameters representing optical characteristics such as aberrations specific to the lens, and the camera performs various image correction processes on the captured image data based on the parameters. Sometimes. Furthermore, the camera may record the lens information as ancillary information of a recorded image in an image file or may be used for display purposes. In addition, Patent Document 2 discloses a technique for changing the curvature of the imaging surface of the imaging element built in the camera body based on lens information (optical characteristics such as aberrations unique to the lens).

JP 2012-182194 A JP 2007-208775 A

  By the way, in the future, as a case where the imaging surface of the image sensor is curved, not only when the incident light beam is intended to enter the state close to the imaging surface, but also for various other purposes. Conceivable. However, if the imaging surface is curved for another purpose other than making the incident light incident on the imaging surface in a nearly vertical state, the distortion characteristics of the imaging device, various aberration characteristics on the imaging surface, peripheral attenuation ( It is considered that the characteristics such as a decrease in peripheral light intensity will change. On the other hand, even when the imaging surface is curved for various purposes as described above, the camera is considered to perform various image correction processes based on the optical characteristics of the lens as described above. However, in such a case, an image obtained as a result of the image correction process may not necessarily be a good image.

  The present invention has been made in view of such problems, and can obtain an image with a good correction result even when the image pickup surface is curved and image correction processing based on the optical characteristics of the lens is performed. It is an object of the present invention to provide an imaging apparatus and a control method thereof.

  An imaging apparatus according to the present invention has an imaging surface that can be curved, an imaging unit that captures an optical image formed on the imaging surface by an optical lens to generate image data, and a parameter that represents optical characteristics of the optical lens. Based on the above, a correction unit that performs an image correction process on the image data of the imaging unit, and a curvature control that sets the curvature when the imaging surface is curved and curves the imaging surface so as to have the set curvature And when the curvature of the imaging surface is a second curvature different from the first curvature according to the optical characteristic of the optical lens, a parameter representing the optical characteristic of the optical lens is And a correction control unit that corrects the parameter according to the curvature of 2 and causes the correction unit to perform the image correction process based on the corrected parameter.

  According to the present invention, it is possible to obtain an image with a good correction result even when the imaging surface is curved and image correction processing based on the optical characteristics of the lens is performed.

It is a figure which shows the schematic structural example of the digital camera system of this embodiment. It is a figure which shows the schematic structural example of an imaging part. It is a figure which shows the example of schematic structure for the curvature control of the imaging surface of an imaging part. It is explanatory drawing of the pixel value reference image in the case of distortion correction. It is a figure used for description of the relationship between an image height and a lens distortion. It is a figure which shows an example of the distortion aberration table of a lens. It is a flowchart from starting of a camera to imaging | photography and the recording after imaging | photography.

<Example of schematic configuration of digital camera system>
FIG. 1 shows an example of the configuration of the digital camera system of this embodiment. The digital camera system of this embodiment includes a camera 100 that is a camera body, an interchangeable lens 150, and a recording medium 200. The interchangeable lens 150 and the recording medium 200 are detachable from the camera 100.

  In FIG. 1, the imaging unit 22 of the camera 100 has an imaging device composed of a CCD, a CMOS device, or the like. The imaging element of the imaging unit 22 converts an optical image formed on the imaging surface by the lens group 151 of the interchangeable lens 150 into an electrical signal. The imaging unit 22 has an A / D conversion processing function, and converts an analog imaging signal imaged by the imaging element into digital image data. In the present embodiment, the imaging element is an element that can be bent so that the imaging surface has, for example, a three-dimensional concave curved surface shape as described later, and the curved shape of the imaging surface can be dynamically switched. In other words, the curvature of the curved shape can be changed. The curvature control unit 26 variably controls the curved shape of the imaging element of the imaging unit 22 based on a command from the system control unit 50, that is, controls the curvature of the imaging surface. The detailed configurations of the image sensor and the curvature control unit 26 of the imaging unit 22 and the reason why the curvature of the curved shape of the imaging surface of the image sensor can be changed will be described later.

  The image processing unit 24 performs predetermined development processing and color conversion processing on the image data output from the imaging unit 22 or the image data supplied from the memory control unit 15. The image processing unit 24 performs geometric transformation processing such as distortion correction, pixel interpolation, resizing processing, and the like as an example of image correction processing. The image processing unit 24 performs predetermined calculation processing using the image data, and also performs TTL (through-the-lens) type AWB (auto white balance) processing based on the obtained calculation result. Further, the image processing unit 24 also performs predetermined calculation processing for generating information used when the system control unit 50 performs exposure control and distance measurement control using the image data. Information on the result of the predetermined arithmetic processing in the image processing unit 24 is sent to the system control unit 50.

  The system control unit 50 performs exposure control and distance measurement control based on information generated by predetermined calculation processing in the image processing unit 24. The system control unit 50 performs so-called TTL AE (automatic exposure) control and EF (flash automatic light control) control as exposure control. Further, the system control unit 50 performs AF (autofocus) as distance measurement control based on information on a predetermined calculation processing result by the image processing unit 24 and an AF evaluation value supplied from the AF evaluation value detection unit 23. Take control. The AF evaluation value detection unit 23 calculates an AF evaluation value from phase difference detection information detected by a so-called phase difference detection method, contrast information detected from digital image data, and the like, and uses the AF evaluation value information as a system. Output to the controller 50.

  Image data output from the imaging unit 22 is written into the memory 32 via the image processing unit 24 and the memory control unit 15 or via the memory control unit 15. The memory 32 has a storage capacity sufficient to store a predetermined number of still image data and moving image data and audio data for a predetermined time. The memory 32 also serves as an image display memory (so-called video memory). The D / A converter 13 converts the image display data stored in the memory 32 into an analog signal. The image display signal converted into an analog signal by the D / A converter 13 is sent to the display unit 28.

  The display unit 28 includes a display such as an LCD, and displays an image corresponding to the analog image signal from the D / A converter 13 on the screen of the display. Further, in the camera 100 of the present embodiment, the image data output from the imaging unit 22 is sequentially converted into analog data by the D / A converter 13 via the memory 32 and sent to the display unit 28. That is, in this case, the image captured by the imaging unit 22 is displayed on the display unit 28 in substantially real time, and the display unit 28 functions as a so-called electronic viewfinder.

  The nonvolatile memory 56 is an electrically erasable / recordable memory, and for example, a flash memory or the like is used. The nonvolatile memory 56 stores constants, programs, and the like for operating the system control unit 50. Here, the program is a program for executing various flowcharts described later in the present embodiment.

  The system control unit 50 controls the entire camera 100. The system control unit 50 implements each process according to the present embodiment, which will be described later, by executing the program recorded in the nonvolatile memory 56 described above. The system memory 52 is composed of RAM, and constants and variables for operation of the system control unit 50, programs read from the nonvolatile memory 56, and the like are expanded. The system control unit 50 also performs display control by controlling the memory 32, the D / A converter 13, the display unit 28, and the like. The system timer 53 is a time measuring unit that measures the time used for various controls and the time of a built-in clock.

  The mode switch 60, the first shutter switch 62, the second shutter switch 64, and the operation unit 70 are operation devices for a user interface for the user to input various operation instructions to the system control unit 50.

  The mode changeover switch 60 selects any one of a plurality of operation modes such as a live view display mode, a still image shooting mode, a moving image shooting mode, and a playback mode as the operation mode of the system control unit 50 (the operation mode of the camera 100). Used when switching to the operation mode. Note that the still image shooting mode includes an auto shooting mode, an auto scene discrimination mode, a manual mode, various scene modes for setting shooting for each shooting scene, a program AE mode, a custom mode, and the like. The system control unit 50 switches the operation mode of the camera 100 to any one of the still image shooting modes in accordance with the switching of the mode switch 60. In addition, the system control unit 50 can also assign each mode included in the still image shooting mode to other operation devices after switching to the still image recording shooting mode once by the mode switch 60. Yes. In this case, the system control unit 50 switches to one of the modes included in the still image shooting mode in accordance with an operation from another operation device. Note that the moving image shooting mode may also include a plurality of types of modes, as in the still image shooting mode.

  The first shutter switch 62 and the second shutter switch 64 are provided on the shutter button 61 of the camera 100. The first shutter switch 62 is turned on by a so-called half-press (shooting preparation instruction) operation of the shutter button 61, and generates a first shutter switch signal SW1. The system control unit 50 starts operations such as AF (auto focus) control, AE (automatic exposure) control, AWB (auto white balance) control, and EF (automatic flash light control) control by the first shutter switch signal SW1. To do. The second shutter switch 64 is turned on by a so-called full-press (shooting instruction) operation of the shutter button 61, and generates a second shutter switch signal SW2. Based on the second shutter switch signal SW2, the system control unit 50 starts control of a series of photographing operations from signal reading of the imaging unit 22 to image data writing to the recording medium 200.

  The operation unit 70 includes menu buttons, up / down / left / right four-way buttons, a set (SET) button, and the like. The operation unit 70 may include a controller wheel that can detect a rotation operation by the user. When a rotation operation is performed by the user, the controller wheel generates an electrical pulse signal according to the operation amount. The system control unit 50 controls each unit of the camera 100 based on the pulse signal. Further, the system control unit 50 can determine the angle at which the controller wheel is rotated, how many rotations, and the like are based on this pulse signal. The controller wheel may be any operation device that can detect a rotation operation. For example, the controller wheel may be a dial that rotates in response to a user's rotation operation to generate a pulse signal. . Further, the controller wheel may be one that detects a rotation operation of a user's finger or the like on the controller wheel (a so-called touch wheel), such as a so-called touch sensor, without rotating the controller wheel itself. Further, the buttons of the operation unit 70 can be used as various function buttons such that functions are appropriately assigned for each scene by selecting and operating various function icons displayed on the display unit 28. ing. Examples of the function buttons include an end button, a return button, an image advance button, a jump button, a narrowing button, and an attribute change button. When a menu button provided as one of the buttons of the operation unit 70 is pressed, the system control unit 50 causes the display unit 28 to display various menu screens that can be set. As a result, the user can make various settings intuitively using the menu screen displayed on the display unit 28 and the four-way buttons and the set buttons.

  As an example, the user uses the operation unit 70 to input an operation input for setting an aperture value (F value) or an operation input for setting a zoom position when the interchangeable lens 150 is an electric zoom lens. It becomes possible. The user can also set the operation mode of the camera 100 to various shooting modes such as a live view display mode, a moving image shooting mode, and a still image shooting mode by using the operation unit 70. Become. In addition, the user can also input settings for suppressing the occurrence of scratches and dark shading according to the dark current amount of the imaging element, which will be described later, to the camera 100 by using the operation unit 70, for example. It becomes. In addition, the user can input special effect settings for obtaining special effect images in various shooting scenes to the camera 100 by using the operation unit 70, for example.

  The power supply control unit 80 includes a battery detection circuit, a DC-DC converter, a switch circuit that switches a block to be energized, and the like, and detects whether or not a battery is attached, the type of battery, and the remaining battery level. Further, the power supply control unit 80 controls the DC-DC converter based on the detection results and the instructions of the system control unit 50, and supplies necessary voltages in each unit including the recording medium 200 for a necessary period.

  The power supply unit 40 includes a primary battery such as an alkaline battery or a lithium battery, a secondary battery such as a NiCd battery, a NiMH battery, or a Li battery, an AC adapter, and the like, and supplies power to not only each part of the camera 100 but also the interchangeable lens 150. Supply. The recording medium I / F 18 is an interface with the recording medium 200. The recording medium 200 is a recording medium such as a semiconductor memory or a magnetic disk for recording a photographed image. The semiconductor memory includes a memory card, and the magnetic disk includes a hard disk. The main body side lens I / F 55 is an interface for exchanging information with the interchangeable lens 150 side.

  The interchangeable lens 150 is a lens that can be attached to and detached from the camera 100. The interchangeable lens 150 includes a lens group 151 that includes a focus, a zoom, a diaphragm mechanism, and the like. The interchangeable lens 150 also includes a lens control unit 152 that controls each unit of the lens group 151 and a lens I / F 153 for exchanging information with the main body side lens I / F 55 in the camera 100. Furthermore, the interchangeable lens 150 also has a lens information storage unit 154 that stores lens information as described later.

<Schematic configuration example of image sensor>
In FIG. 2, the example of schematic structure of the image pick-up element in the image pick-up part 22 in this embodiment is shown. In FIG. 2, a unit pixel 201 includes a photodiode (PD) 202, a transfer switch 203, a floating diffusion (FD) 204, an amplification MOS amplifier 205 that functions as a source follower, a selection switch 206, and a reset switch 207. The imaging device of the imaging unit 22 includes a signal line 208, a constant current source 209 serving as a load of the amplification MOS amplifier 205, a control line 210, an output amplifier 211, a vertical scanning circuit 212, a readout circuit 213, and a horizontal scanning circuit 214. . In FIG. 2, for simplification of the drawing, only the unit pixels 201 are shown as 4 rows × 4 columns, but actually, a great number of unit pixels 201 are two-dimensionally arranged.

  The PD 202 of the unit pixel 201 converts light into electric charge. Charges generated by photoelectric conversion in the PD 202 are transferred by the transfer switch 203 based on the transfer pulse φTX, and are temporarily stored in the FD 204. The FD 204, the amplification MOS amplifier 205, and the constant current source 209 constitute a floating diffusion amplifier. The signal charge of the unit pixel 201 selected by the selection switch 206 by the selection pulse φSEL is converted into a voltage and output to the reading circuit 213 through the signal line 208. The readout circuit 213 selects a signal to be output based on a drive signal supplied from the horizontal scanning circuit 214 via the control line 210. A signal output from the readout circuit 213 is output to the outside of the image sensor through the output amplifier 211. The charge accumulated in the FD 204 is removed by driving the reset switch 207 with the reset pulse φRES. Further, the vertical scanning circuit 212 selects the transfer switch 203, the selection switch 206, and the reset switch 207.

<Configuration example for curvature control of imaging surface>
Hereinafter, an outline of a mechanism for changing the curvature of the imaging surface of the imaging element in the imaging unit 22 will be described with reference to FIG. 3. FIG. 3 is a schematic cross-sectional view of the imaging unit 22 and the curvature control unit 26 disposed in the imaging unit 22.

  The imaging unit 22 illustrated in FIG. 1 includes an imaging chip 301, a pedestal 303, and a bottom plate 306. The imaging chip 301 is a main part of the imaging element and has a plate shape. An imaging region in which the plurality of unit pixels 201 described above are two-dimensionally arranged is formed in the plate-shaped central portion 301c of the imaging chip 301. The surface on which the imaging region is formed is the imaging surface 301a. It has become. Peripheral circuits such as the constant current source 209, the control line 210, the output amplifier 211, the vertical scanning circuit 212, the reading circuit 213, and the horizontal scanning circuit 214 described above are arranged on the peripheral portion 301 d of the imaging chip 301.

  The pedestal 303 supports the peripheral portion 301d of the imaging chip 301 from the back side when the imaging surface 301a of the imaging chip 301 is curved so as to have a concave curved surface shape. The pedestal 303 has an opening 305 in the center. The pedestal 303 has a flat surface 304 on the surface side where the imaging chip 301 is disposed and around the opening end of the opening 305. The peripheral portion 301d of the imaging chip 301 is fixed to the flat surface 304 of the pedestal 303 via an adhesive layer. In addition, the base 303 is provided with a bottom plate 306 that closes the opening 305 on the back side of the surface on which the imaging chip 301 is disposed. The bottom plate 306 is made of a rigid plate-like material that is not curved or the like, and is fixed to the bottom surface of the pedestal 303, that is, the back surface with respect to the surface on which the imaging chip 301 is disposed, via an adhesive layer, for example. Thereby, the opening 305 is sealed by the imaging chip 301 and the bottom plate 306.

  Further, the curvature control unit 26 having the suction unit 307 is attached to the bottom plate 306. The suction unit 307 sucks the gas in the opening 305 hermetically closed by the imaging chip 301 and the bottom plate 306, and adjusts the atmospheric pressure (negative pressure) in the opening 305. That is, the imaging surface 301a of the imaging chip 301 is curved into a concave curved surface shape by the suction unit 307 reducing the atmospheric pressure in the opening 305 to be lower than the external atmospheric pressure. The curvature control unit 26 variably controls the curvature of the concave curved surface shape of the imaging surface 301 a of the imaging chip 301 by variably adjusting the atmospheric pressure (negative pressure) in the opening 305 by suction control of the suction unit 307. A dotted line in FIG. 3 shows an example when the curvature of the imaging chip 301 is changed by the curvature control unit 26 to change the curvature.

  Here, the reason why the curvature of the curved shape of the imaging surface of the imaging element can be changed in the present embodiment will be briefly described. In the camera 100 of the present embodiment, the curvature of the imaging surface of the imaging device is controlled for various purposes as exemplified below.

  For example, assuming that the imaging surface of the imaging device is a flat surface, the incident angle of light incident on the imaging surface of the imaging device via the lens is, for example, farther from the lens optical axis, and the lens angle of view becomes wider (focal length is larger). The shorter it is, the further away from the angle perpendicular to the imaging surface. In particular, the fact that the incident angle of light incident on the imaging surface departs from the angle perpendicular to the imaging surface becomes prominent in the periphery of the imaging surface of the image sensor away from the optical axis of the lens. As described above, when the incident angle of the light incident on the imaging surface is away from the angle perpendicular to the imaging surface, the influence of various optical aberrations such as field curvature aberration, distortion, and lateral chromatic aberration increases. In this case, if the imaging surface of the imaging device is curved so that the incident angle of light on the imaging surface approaches an angle perpendicular to the tangent to the imaging surface, field curvature aberration, distortion, lateral chromatic aberration, etc. It is possible to suppress the influence of various optical aberrations. Further, since these optical aberrations and so-called peripheral dimming characteristics (peripheral light amount drop) also change depending on the F value of the lens and the diaphragm, it is conceivable to control the curvature of the imaging surface in accordance with these F values. Thus, suppressing the influence of various optical aberrations such as field curvature, distortion, lateral chromatic aberration, and peripheral light reduction is considered as one of the purposes for controlling the curvature of the imaging surface of the imaging device. In this embodiment, for the purpose of correcting optical characteristics such as various optical aberrations such as field curvature, distortion, lateral chromatic aberration, and peripheral light reduction, a curvature when the imaging surface of the imaging device is curved is set. . In the case of this embodiment, the curvature set to correct these optical characteristics is the first curvature. Note that the first curvature when the imaging surface is curved is a curvature for correction corresponding to any one of various optical aberrations such as curvature of field, distortion, lateral chromatic aberration, and peripheral dimming. There may be a curvature that can correct each of these characteristics to some extent. In the present embodiment, the first curvature includes a case where the curvature is zero, that is, a case where the imaging surface is flat.

  Further, for example, when the image sensor is bent, stress (stress) is generated in the image sensor. As described above, when stress (stress) is generated in the image sensor, it is known that the dark current amount of the image sensor changes. Specifically, when the curvature of the image sensor is increased to increase the stress applied to the image sensor, the dark current amount of the image sensor decreases. On the other hand, if the amount of dark current is small, scratches and dark shading in the image sensor are less likely to occur. Therefore, for example, if the curvature at the time of bending the image sensor is increased, the amount of dark current can be reduced, and the occurrence of scratches and dark shading can be suppressed. Thus, reducing the amount of dark current and suppressing the occurrence of scratches and dark shading can be considered as one of the purposes for controlling the curvature of the imaging surface of the imaging device. In the present embodiment, the curvature set for controlling the dark current amount to suppress scratches and dark shading is an example of the second curvature. If the correspondence relationship between a plurality of curvatures and each dark current amount is obtained in advance, the dark current amount can be controlled by setting the curvature.

  For example, when the imaging surface of the imaging device is curved, it is considered that various special effect images in various shooting scenes can be obtained. In this case, a special effect setting for any one of the shooting scenes is selected from among a plurality of types of special effect settings corresponding to various shooting scenes, for example, by user operation input, and the special effect setting for the selected shooting scene is selected. Thus, curvature control of the image sensor is performed. As described above, obtaining a special effect image based on any special effect setting selected from special effect settings for various shooting scenes can be considered as one of the purposes of controlling the curvature of the imaging surface of the imaging device. In this embodiment, the curvature set for obtaining special effect images of various shooting scenes is an example of the second curvature.

<Description of image correction processing>
In the camera of the present embodiment, the image processing unit 24 is an example of a correction unit, and performs various image correction processes such as correcting image distortion based on the optical characteristics of the lens as described above. Yes. In the present embodiment, as an example of the image correction processing performed by the image processing unit 24, there is a case where an image distortion component corresponding to optical characteristics such as aberration of the interchangeable lens 150 is corrected by image processing. . In the present embodiment, the image processing unit 24 performs image correction processing based on lens information held in the interchangeable lens 150 or the camera body.

  Hereinafter, the distortion correction based on the lens information will be described as an example, and the image correction process performed by the image processing unit 24 will be described. Note that distortion correction by image processing is a technique that has already been performed in many digital cameras integrated with a lens, and a detailed description thereof will be omitted here, but the following processing is generally performed. ing.

  FIG. 4A is a diagram illustrating a pixel value reference image when distortion correction is performed. FIG. 4A illustrates a reference coordinate image 402 that represents an image before distortion correction by the image processing unit 24 as two-dimensional coordinates, and output coordinates that represent an image after correction by the image processing unit 24 as two-dimensional coordinates. It is a figure which shows the image 401. FIG. In the example of FIG. 4A, the coordinates of the imaging center are O (x0, y0), the coordinates of a certain pixel before correction are P ′ (x ′, y ′), and after the pixel is corrected. The coordinates of the pixel are P (x, y). In the example of FIG. 4A, the distance from the imaging center coordinates O (x0, y0) to the corrected pixel coordinates P (x, y), that is, the image height corresponding to the coordinates P (x, y). Is represented by “h”. Similarly, the distance from the imaging center coordinate O (x0, y0) to the coordinate P ′ (x ′, y ′) of the pixel before correction, that is, the image height corresponding to the coordinate P ′ (x ′, y ′) is “ h ′ ”. Here, the image height h corresponding to the coordinates P (x, y) is expressed as an output image height h, and the image height h ′ corresponding to the coordinates P ′ (x ′, y ′) is expressed as a reference image height h ′. . The distortion rate D (h) indicating the degree of distortion in the distortion aberration is obtained by the following equation (1) using the reference image height h ′ and the output image height h.

  D (h) = h ′ / h (1)

  Here, when the output image height h and the reference image height h ′ are the same, the distortion rate D (h) is “1”, and no distortion is generated. However, in the case of a general lens, as the distance from the coordinates O (x0, y0) of the imaging center increases, that is, as the image height increases, the distortion D (h) decreases and the amount of distortion increases.

  FIG. 4B is a diagram illustrating four image heights h1, h2, h3, and h4 as specific image heights with respect to the example of FIG. 4A. These four image heights h1, h2, h3, and h4 are h1 <h2 <h3 <h4. As described above, the distortion rate D (h) decreases and the amount of distortion increases as the image height increases. Therefore, in these examples of h1 to h4, the influence of distortion increases as the image height increases. ing.

  FIG. 5 is a diagram illustrating the distortion rate D (h) corresponding to the image heights h1, h2, h3, and h4 illustrated in FIG. 4B when the distortion is a so-called barrel distortion. . The horizontal axis in FIG. 5 indicates the output image height h, and the vertical axis indicates the distortion D (h) with respect to the output image height h.

  The data of the distortion rate D (h) shown in FIG. 5 is included in the lens information as one of the parameters representing the optical characteristics of the lens, and the lens information storage unit 154 of the interchangeable lens 150 or the nonvolatile memory of the camera 100 56. In the case of the camera 100 of this embodiment, lens information including the distortion D (h) shown in FIG. 5 as one of parameters is sent to the image processing unit 24 under the control of the system control unit 50. Then, the image processing unit 24 performs image correction on the uncorrected YUV image represented by the reference coordinate image 402 shown in FIG. 4B and the like based on the distortion data shown in FIG. Process. As a result, the image processing unit 24 generates a corrected image represented by the output coordinate image 401 shown in FIG.

  Note that the data of the distortion rate D (h) may be held as data corresponding to all the pixels of the output image of the imaging unit 22, but the amount of distortion data corresponding to all the pixels becomes enormous. Actually, the data amount is reduced by holding only a part of the distortion rate data. Note that the image processing unit 24 obtains distortion data that is not held from the distortion data that is held, for example, by interpolation. To explain with a specific example, when only distortion data at four points h1, h2, h3, and h4 are held as shown in FIG. 5, the distortion data corresponding to image heights other than these four points are interpolated. It is calculated by. For example, the distortion data corresponding to the image height h12 in FIG. 5 is obtained by interpolation from the distortion data corresponding to the image heights h1 and h2. Although FIG. 5 shows an example in which four pieces of distortion data are held corresponding to four image heights, the number of pieces of distortion data held is not limited to this example.

<Example of distortion aberration table in which distortion rate data is set>
As described above, the distortion rate data held as one of the parameters representing the optical characteristics of the lens is, for example, as a distortion aberration table as shown in FIG. 6A, the lens information storage unit 154 of the interchangeable lens 150 or the camera. It is stored in 100 non-volatile memories 56. When the distortion table is stored in the lens information storage unit 154 of the interchangeable lens 150, for example, the camera 100 reads the distortion table data from the lens information storage unit 154 when the interchangeable lens 150 is attached. To the non-volatile memory 56. On the other hand, when the distortion table is stored in the nonvolatile memory 56 of the camera 100, for example, the distortion table corresponding to a plurality of interchangeable lenses that can be attached to the camera 100 is prepared in the nonvolatile memory 56. In this case, the camera 100 acquires data representing the lens type from the interchangeable lens 150, and reads out a distortion aberration table corresponding to the lens type from the nonvolatile memory 56. In this way, when only the lens type data is acquired, the communication amount when the interchangeable lens 150 is attached to the camera 100 can be reduced.

  In the example of FIG. 6A, when the interchangeable lens 150 is, for example, a zoom lens, the distortion data d11 corresponding to the focal lengths FL1 to FL5 (zoom position) and the image heights h1 to h4 of the zoom lens. It is an example of the distortion aberration table which showed -d54. Data corresponding to the distortion aberration table shown in FIG. 6A is stored as one of the parameters included in the lens information, for example, in the lens information storage unit 154 of the interchangeable lens 150 or the nonvolatile memory 56 of the camera 100. ing. Note that the distortion aberration table illustrated in FIG. 6A is applied when the curvature of the imaging surface of the imaging unit 22 is zero, that is, the imaging surface is a flat surface that is not curved. In FIG. 6A, as an example, the distortion d23 is a distortion corresponding to the focal length FL2 and the image height h3. In addition, in the example of FIG. 6A, only five focal lengths FL1 to FL5 are listed, but in the focal length and the distortion rate as in the case of the image height and the distortion described in FIG. Interpolation is also applicable. For example, the distortion corresponding to the image height h4 at the intermediate focal length FL1 and the focal length FL2 in FIG. 6A is the distortion d14 obtained from the focal length FL1 and the image height h4, and the focal length FL2. It can be obtained by interpolation with the distortion rate d24 obtained from the image height h4. The calculation of the focal length and the distortion rate by such interpolation is performed by, for example, the system control unit 50, and the focal length and the distortion rate data calculated by the interpolation are stored in the memory 32, for example.

  Note that, as described above, the camera 100 according to the present embodiment has functions of various shooting modes such as the live view display mode, the moving image shooting mode, and the still image shooting mode. These shooting modes can be switched. When the shooting mode is switched in this way, settings such as resolution, image size, number of read pixels, and angle of view are switched according to the shooting mode after the switching. Specifically, the drive mode of the imaging unit 22 is switched to a drive mode set according to the resolution, image size, readout pixel number, and angle of view in the switched shooting mode. As described above, when the resolution, the image size, the number of readout pixels, and the angle of view change according to the operation mode of the camera 100 and the driving mode of the imaging unit 22 is switched, the distortion aberration table also has the driving mode at that time. What you need is needed. For this reason, the system control unit 50, based on the distortion aberration table as shown in FIG. 6A, distortion aberration corresponding to various shooting modes such as a live view display mode, a moving image shooting mode, and a still image shooting mode. Tables are set and stored in the memory 32 or the like.

<Example of distortion table in which distortion aberration data corresponding to the curvature of the imaging surface is set>
The distortion aberration table of FIG. 6A is a table when the imaging surface of the imaging unit 22 is a flat surface, but the imaging surface of the imaging unit 22 is curved as in the present embodiment. In this case, for example, a distortion table as shown in FIG. 6B is used. 6B, the system control unit 50, which is an example of a correction control unit, corrects the distortion table in FIG. 6A according to the curvature of the imaging surface of the imaging unit 22. Is generated. A detailed description of a process in which the system control unit 50 corrects the distortion aberration table according to the curvature of the imaging surface will be described later.

  FIG. 6B shows a distortion aberration table when the curvature of the imaging surface of the imaging unit 22 is, for example, the curvature c1. The distortion aberration table of FIG. 6B shows the distortion corresponding to the focal lengths FL1 to FL5 of the zoom lens and the image heights h1 to h4 shown in FIG. 5 when the curvature of the imaging surface is the curvature c1. It is a table in which rates d11_c1 to d54_c1 are shown. In the example of FIG. 6B, interpolation can be applied to the focal length and the distortion rate as in the case of FIG.

  In FIG. 6B, for example, the distortion d23_c1 is a distortion corresponding to the focal length FL2 and the image height h3. Here, when it is assumed that each distortion in FIG. 6B is determined only by the curvature c1 of the imaging surface, for example, the distortion d23_c1 can be expressed as the following Expression (2).

  d23_c1 = d23 · F (c1) (2)

  Note that d23 in FIG. 2 is a distortion d23 corresponding to the focal length FL2 and the image height h3 in FIG. 6A, and F (c1) in equation (2) is a distortion correction coefficient. . The distortion correction coefficient F (c1) is a coefficient uniquely determined according to the curvature c1 of the imaging surface. Similarly, the other distortion rates in FIG. 6B can be calculated by multiplying the distortion correction coefficient F (c1).

  That is, in the distortion aberration table of FIG. 6B, the distortion correction coefficient F (c1) corresponding to the curvature c1 is expressed by the equation (2) for each of the distortion ratios d11 to d54 of the distortion aberration table of FIG. It is a table obtained by multiplying like. In the case of this embodiment, the system control unit 50 corrects the distortion aberration table of FIG. 6A by multiplying by the distortion correction coefficient F (c1) corresponding to the curvature c1, as shown in FIG. 6B. It is a distortion aberration table.

  In this embodiment, the image processing unit 24 performs the pre-correction represented by the reference coordinate image 402 shown in FIG. 4B based on the distortion rate data in the distortion correction table shown in FIG. An image correction process is performed on the YUV image. Thereby, even when the imaging surface of the imaging unit 22 is curved with a curvature c1, the distortion is corrected from the image processing unit 24 as in the output coordinate image 401 shown in FIG. Will be output.

<Processing procedure during shooting and change procedure of distortion correction table according to curvature>
FIG. 7 is a flowchart illustrating the flow from the shooting of a still image to the recording thereof when the camera 100 is activated in, for example, a still image shooting mode. Note that, when the camera is activated, various processes such as initializing each part, corresponding processing of various user operations, AE and AF processing, and setting the imaging surface to the first curvature according to the optical characteristics of the lens are performed. Only the part relating to the change to the curvature of 2 and the correction of the distortion correction table will be described. 7 is performed by the system control unit 50 controlling each unit.

  In the flowchart of FIG. 7, when a power ON instruction is input from the user via the operation unit 70 to the camera 100, the system control unit 50 first causes the interchangeable lens to be added to the camera 100 as a process of step S <b> 701. It is determined whether or not 150 is attached. In step S701, the system control unit 50 cannot obtain a signal from the interchangeable lens 150. If the system control unit 50 determines that the interchangeable lens 150 is not attached, the process proceeds to step S703. On the other hand, if the system control unit 50 determines in step S701 that the interchangeable lens 150 is attached because a signal or the like is obtained from the interchangeable lens 150, the process proceeds to step S702.

  In step S <b> 703, the system control unit 50 reads default lens information stored in advance in the nonvolatile memory 56 and stores it in the memory 32. Note that the default lens information is information prepared in advance to enable control for processing after step S704 described later even when the interchangeable lens 150 is not attached to the camera 100. As an example, the default lens information is information including a distortion aberration table in which distortion data corresponding to a predetermined focal length and a plurality of image heights are set in the distortion aberration table as described above. Yes. The default lens information can also be used when the interchangeable lens 150 attached to the camera 100 is a lens that does not hold lens information. After step S703, the system control unit 50 advances the process to step S704.

  In step S <b> 702, the system control unit 50 acquires the lens information stored in the lens information storage unit 154 of the interchangeable lens 150 via the main body side lens I / F 55 and stores the lens information in the memory 32. The lens information in this case is lens information unique to the interchangeable lens 150, and is information including a distortion aberration table as shown in FIG. 6A as a parameter representing the optical characteristics of the interchangeable lens 150, for example. Yes. The system control unit 50 may acquire lens information corresponding to the interchangeable lens 150 from a plurality of lens information stored in advance in the nonvolatile memory 56. After step S702, the system control unit 50 advances the process to step S704.

  In step S <b> 704, the system control unit 50 determines whether or not to change the curvature of the imaging surface by a user operation or the like via the operation unit 70, for example. In the present embodiment, the determination of the curvature change in step S704 is performed based on whether the first curvature corresponding to the optical characteristics of the interchangeable lens 150 is changed to a second curvature different from the first curvature. It is a judgment. In the present embodiment, the user operation via the operation unit 70 in step S704 inputs, for example, the setting for suppressing the occurrence of scratches and dark shading according to the dark current amount of the image sensor described above to the camera 100. Can be mentioned. Further, the user operation via the operation unit 70 in step S704 may be an operation for inputting special effect settings for obtaining special effect images in various shooting scenes to the camera 100, for example. If the system control unit 50 determines in step S704 that the curvature of the imaging surface is to be changed, the system control unit 50 proceeds to step S705. If the system control unit 50 determines that the curvature is not to be changed, the process proceeds to step S705. The process proceeds to S707.

  In step S <b> 705, the system control unit 50 controls the curvature control unit 26 to change the curvature of the imaging surface of the imaging unit 22. Specifically, the system control unit 50 controls the curvature control unit 26 to change the curvature of the imaging surface from the first curvature corresponding to the optical characteristics of the interchangeable lens 150 and to control the dark current amount of the imaging element and specially. The second curvature is changed according to the effect setting or the like. After step S705, the system control unit 50 advances the process to step S706.

  In step S706, the system control unit 50 uses the current curvature (second curvature) of the imaging surface, for example, the distortion aberration table shown in FIG. 6A described above in the lens information stored in the memory 32. ), The table is corrected as described with reference to FIG. Then, the system control unit 50 stores the corrected distortion aberration table data in another area in the memory 32. That is, the system control unit 50 retains the distortion aberration table stored in the memory 32 in step S702 or S703 without being overwritten, and stores the corrected distortion aberration table in another area of the memory 32. Save. Thereby, for example, when it becomes necessary to correct the distortion aberration table according to another curvature later, it is possible to omit reading the distortion aberration table from the interchangeable lens 150 or the nonvolatile memory 56, thereby speeding up the processing. It will be planned. After step S707, the system control unit 50 advances the process to step S707.

  In step S707, the system control unit 50 determines whether a release has been performed based on whether the second shutter switch 64 has been operated. If it is determined in step S707 that a release has been made, the system control unit 50 advances the process to step S708. If the system control unit 50 determines that a release has not been made, the process returns to step S704.

  In step S <b> 708, the system control unit 50 controls the shutter 101, the imaging unit 22, the memory control unit 15, and the like to perform still image shooting processing, and the raw image data obtained by the still image shooting processing is stored in the memory 32. Save. After step S708, the system control unit 50 advances the process to step S709.

  In step S <b> 709, the system control unit 50 controls the image processing unit 24 to read RAW image data from the memory 32. At this time, the image processing unit 24 performs development processing on the RAW image data read from the memory 32 and stores the YUV image data obtained by the development processing in the memory 32. After step S709, the system control unit 50 advances the process to step S710.

  In step S710, the system control unit 50 controls the image processing unit 24 to read from the memory 32 the distortion aberration table corrected according to the current curvature (second curvature) as described above. Therefore, the image processing unit 24 at this time performs distortion correction processing by image processing using the corrected distortion aberration table. The image processing unit 24 holds the image data after the distortion correction processing by the image processing in the memory 32. After step S710, the system control unit 50 advances the process to step S711.

  In step S <b> 711, the system control unit 50 controls the image processing unit 24 to read out the image data after the distortion correction processing by the above-described image processing from the memory 32. At this time, the image processing unit 24 performs compression processing on the image data. The system control unit 50 records the compressed image data on the recording medium 200, and then ends the process of the flowchart of FIG.

  In the example of FIG. 7, the case where the shooting mode of the camera 100 is the still image shooting mode is described. However, in the camera 100 of the present embodiment, the shooting mode is the live view display mode, the moving image shooting mode, or the like. However, distortion aberration correction corresponding to the curvature can be performed as described above.

  As described above, the camera 100 of the present embodiment has a parameter (table) that represents the optical characteristics of the interchangeable lens 150 when the curvature of the imaging surface is changed or when the interchangeable lens 150 is attached. Correction is performed using a correction coefficient prepared in advance. And the camera 100 of this embodiment can perform the image correction process suitable for the curvature of the imaging surface rapidly by performing the image correction process using the parameter after the correction. Thereby, according to the camera 100 of this embodiment, the image of a favorable correction result can be obtained.

  In the above example, only the correction coefficient corresponding to the curvature c1 of the imaging surface has been described as an example of the distortion correction coefficient. However, the camera 100 according to the present embodiment has a plurality of distortions corresponding to a plurality of curvatures. The correction coefficient is stored in advance in the nonvolatile memory 56 in the camera 100. As described above, when the curvature of the imaging surface of the imaging unit 22 is changed for various reasons, the system control unit 50 selects a distortion according to the curvature from among the distortion correction coefficients stored in the nonvolatile memory 56. Select and read the correction coefficient. Further, the system control unit 50 corrects the distortion aberration table as described above using the distortion correction coefficient, and stores the corrected distortion aberration table in the memory 32. At this time, the system control unit 50 also updates the setting of the distortion aberration table according to various shooting modes such as the live view display mode, the moving image shooting mode, and the still image shooting mode. Then, the system control unit 50 reads the corrected distortion aberration table from the memory 32 when the image correction process is performed by the image processing unit 24, thereby performing the image correction process using the corrected distortion aberration table. The image processing unit 24 performs the processing. Thereby, the image processing unit 24 can quickly perform the distortion correction process according to the curvature change.

  In the above-described embodiment, the correction of the distortion of the lens has been described as an example. However, the same can be applied to other aberrations such as the correction of the chromatic aberration of magnification, and also due to the optical characteristics of the lens. The present invention can be similarly applied to shading correction such as peripheral light reduction. That is, various aberration tables and shading correction tables prepared in advance as one of the parameters of the lens information are corrected according to the curvature of the imaging surface, thereby correcting various aberrations and shading corrections adapted to the curvature of the imaging surface. Is possible. For example, in the case of magnification chromatic aberration correction, the imaging surface of the imaging unit 22 is set to the first curvature based on magnification chromatic aberration data that is one of the parameters of lens information. In this case, the image processing unit 24 performs image correction processing based on the chromatic aberration data of magnification. For example, when the imaging surface of the imaging unit 22 has the second curvature in order to perform the above-described dark current control and special effect setting according to a user operation or the like, the system control unit 50 performs the magnification chromatic aberration table. Is corrected according to the second curvature. As a result, the image processing unit 24 performs image correction processing using the corrected magnification chromatic aberration table. Similarly, in the case of shading correction, the shading correction table is corrected when the curvature is changed, and the image processing unit 24 performs image correction processing using the corrected table.

<Other embodiments>
In the above-described embodiment, the parameter of the lens information acquired from the interchangeable lens 150 or read from the nonvolatile memory 56 is corrected according to the curvature. However, the correction parameters (such as the distortion aberration table described above) used for the image correction process are new. May be created. The system control unit 50 functions as a generation unit that generates a correction parameter corresponding to the optical characteristics of the optical lens. When the interchangeable lens 150 is attached to the camera 100, a plurality of curvature patterns corresponding to the type of the interchangeable lens 150 are provided. A plurality of correction parameters corresponding to are created. Specifically, the system control unit 50 acquires or reads only the lens type information of the interchangeable lens 150 from the nonvolatile memory 56. The lens type in this case is a type representing a short focus lens, a zoom lens, or the like. For example, when the lens type indicates a zoom lens, each focal length of the interchangeable lens 150 as described with reference to FIG. Therefore, the system control unit 50 obtains a plurality of curvature patterns that can correspond to each focal length in the lens type based on the information on the lens type, and generates a plurality of correction parameters corresponding to the respective curvature patterns. It is stored in the memory 32. When the curvature of the imaging surface is changed, the system control unit 50 reads out a correction parameter corresponding to the curvature at that time from the memory 32 and causes the image processing unit 24 to perform image correction processing. Thereby, it is not necessary to perform data communication with the interchangeable lens 150 every time the curvature of the imaging surface is changed, and the amount of communication can be reduced. In the case of this example, it is not necessary to generate a correction parameter (such as the above-described distortion aberration table) every time the curvature of the imaging surface is changed, so that the image processing unit 24 can perform a quick image correction process. .

  Further, in the above-described embodiment, an example in which the curvature of the imaging surface can be dynamically switched according to the characteristics of the lens, etc. has been given, but the curvature of the imaging surface is a fixed curvature according to the characteristics of a specific lens. May have been made. Also in this example, as described above, the process of correcting the aberration table corresponding to the optical characteristics of the lens and performing image correction using the corrected table can be applied. As an example, for a camera whose curvature of the imaging surface is determined for the purpose of correcting distortion when combined with a specific lens, for example, an existing lens that is assumed to be used in a camera having a flat imaging surface. It can be applied to the case where is mounted. In this example, the camera 100 is a camera to which the interchangeable lens 150 can be attached and detached, and the imaging surface of the imaging unit 22 of the camera 100 has an imaging surface so as to have a curvature according to the optical characteristics of a specific lens. Is assumed to be curved. In the case of this example, the curvature of the imaging surface is fixed to a curvature corresponding to the optical characteristics of a specific lens. Therefore, the curvature control unit 26 for changing the curvature as described in FIG. 1 is not necessarily provided. unnecessary. In the case of this example, the image processing unit 24 performs image correction processing on the image data of the imaging unit 22 based on a parameter representing the optical characteristic of the attached interchangeable lens 150. When the interchangeable lens 150 having an optical characteristic different from that of the specific lens is attached, the system control unit 50 sets the parameter representing the optical characteristic of the interchangeable lens 150 (the above-described table) as the curvature (fixed) of the imaging surface. Modify the parameter (table) according to the curvature. An example of the interchangeable lens 150 having optical characteristics different from that of a specific lens is a camera lens in which the curvature of the imaging surface is zero, that is, the imaging surface is a flat surface. Thus, the image processing unit 24 performs image correction processing based on the corrected parameter (table). In this way, even when an existing lens whose imaging surface is for a flat surface is attached to a camera whose curvature of the imaging surface is determined corresponding to a specific lens, the imaging surface is curved. Thus, it is possible to minimize the deterioration of the aberration characteristics.

  In addition, in the above-described embodiment, the camera 100 capable of exchanging the lens is taken as an example, but the camera may be a so-called lens-integrated camera. In the lens-integrated camera in this case, the curvature of the imaging surface is a curvature corresponding to the optical characteristics of the lens (first curvature), and image correction processing is performed based on parameters according to the optical characteristics of the lens. Is called. In this lens-integrated camera, for example, when the curvature of the imaging surface is changed to the second curvature for the purpose of setting the special effect, the parameter corresponding to the optical characteristic of the lens is the curvature. Will be modified accordingly. Thereby, also in the lens-integrated camera, as in the case of the above-described embodiment, the image correction process adapted to the curvature of the imaging surface is performed, and an image with a good correction result can be obtained.

  The present invention supplies a program that realizes one or more functions of the above-described embodiments to a system or apparatus via a network or a storage medium, and one or more processors in a computer of the system or apparatus read and execute the program This process can be realized. It can also be realized by a circuit (for example, ASIC) that realizes one or more functions.

  The above-described embodiments are merely examples of implementation in carrying out the present invention, and the technical scope of the present invention should not be construed as being limited thereto. That is, the present invention can be implemented in various forms without departing from the technical idea or the main features thereof.

  100 Camera, 150 Interchangeable Lens, 22 Imaging Unit, 24 Image Processing Unit, 26 Curvature Control Unit, 32 Memory, 50 System Control Unit, 151 Lens Group, 154 Lens Information Storage Unit

Claims (11)

An image pickup unit configured to be able to bend the image pickup surface, pick up an optical image formed on the image pickup surface by an optical lens, and generate image data;
Correction means for performing image correction processing on image data of the imaging means based on a parameter representing optical characteristics of the optical lens;
Curvature control means for setting a curvature when the imaging surface is curved and curving the imaging surface so as to be the set curvature,
When the curvature of the imaging surface is a second curvature different from the first curvature according to the optical characteristics of the optical lens, a parameter representing the optical characteristics of the optical lens is set as the second curvature. An image pickup apparatus comprising: a correction control unit that corrects the parameter according to the parameter and causes the correction unit to perform the image correction process based on the corrected parameter. The optical lens is a detachable interchangeable lens,
The parameter representing the optical characteristics of the optical lens depends on the mounted interchangeable lens from among the parameters acquired from the mounted interchangeable lens or a plurality of parameters stored in advance corresponding to the plurality of interchangeable lenses. Selected parameters,
The optical characteristic of the optical lens consists of a plurality of types of optical characteristics,
The imaging apparatus according to claim 1, wherein the correction unit performs the image correction processing based on a parameter representing at least one of the plurality of types of optical characteristics. The imaging means generates the image data by performing imaging in a drive mode set to any one of a plurality of types of drive modes,
The correction means sets a parameter according to the drive mode of the imaging means based on a parameter representing the optical characteristics of the optical lens, performs the image correction processing based on the set parameter,
The correction control means corrects a parameter set according to the drive mode to a parameter according to the second curvature, and causes the correction means to perform the image correction processing based on the corrected parameter. The imaging apparatus according to claim 1, wherein the imaging apparatus is characterized.   The correction control means uses the correction coefficient selected according to the second curvature from a plurality of correction coefficients prepared in advance according to the plurality of curvatures, and sets the parameter according to the second curvature. The imaging apparatus according to claim 1, wherein the imaging apparatus is corrected to a specific parameter. The curvature control means includes
The curvature of the imaging surface of the imaging means is set to the first curvature based on a parameter representing the optical characteristics of the optical lens,
When the dark current amount generated in the imaging means is controlled, the curvature setting of the imaging surface is changed to the second curvature according to the controlled dark current amount. The imaging device according to any one of 1 to 4. The curvature control means includes
The curvature of the imaging surface of the imaging means is set to the first curvature based on a parameter representing the optical characteristics of the optical lens,
When causing the imaging means to capture a special effect image corresponding to any one of a plurality of types of special effect settings corresponding to a plurality of types of shooting scenes, according to the one special effect setting, The imaging apparatus according to claim 1, wherein the setting of the curvature of the imaging surface is changed to the second curvature. In an imaging device in which an optical lens is detachable,
An image pickup unit configured to be able to bend the image pickup surface and to generate an image data by picking up an optical image formed on the image pickup surface by a mounted optical lens;
Curvature control means for setting a curvature when the imaging surface is curved and curving the imaging surface so as to be the set curvature,
Generating means for generating a plurality of correction parameters respectively corresponding to a plurality of curvature patterns when the imaging surface is curved according to the type of the mounted optical lens;
And a correction unit that performs an image correction process on the image data of the imaging unit using a correction parameter selected from the plurality of correction parameters based on the curvature of the imaging surface. apparatus. In an imaging device in which an optical lens is detachable,
Imaging means for generating an image data by imaging an optical image formed on the imaging surface by a mounted optical lens having a curved imaging surface so as to have a curvature according to the optical characteristics of a specific optical lens When,
Correction means for performing image correction processing on image data of the imaging means based on a parameter representing optical characteristics of the mounted optical lens;
When an optical lens having a different optical characteristic from that of the specific optical lens is mounted, the parameter indicating the optical characteristic of the different optical lens is corrected to a parameter corresponding to the curvature of the imaging surface, and the corrected parameter An image pickup apparatus comprising: a correction control unit that causes the correction unit to perform the image correction process based on the image. An imaging unit having an imaging surface capable of being bent, and imaging an optical image formed on the imaging surface by an optical lens to generate image data;
A correcting unit performing an image correction process on the image data of the imaging unit based on a parameter representing an optical characteristic of the optical lens;
A curvature control unit setting a curvature when the imaging surface is curved, and curving the imaging surface to have the set curvature;
When the curvature of the imaging surface is a second curvature different from the first curvature according to the optical characteristics of the optical lens, the correction control means sets a parameter representing the optical characteristics of the optical lens as the first curvature. And a step of causing the correction means to perform the image correction process based on the corrected parameter. A method for controlling an imaging device in which an optical lens is detachable,
An imaging unit having an imaging surface capable of being bent, and imaging an optical image formed on the imaging surface by an optical lens mounted thereon to generate image data;
A curvature control unit setting a curvature when the imaging surface is curved, and curving the imaging surface to have the set curvature;
Generating a plurality of correction parameters respectively corresponding to a plurality of curvature patterns when the imaging surface is curved according to the type of the mounted optical lens;
And a correction unit including a step of performing an image correction process on the image data of the imaging unit using a correction parameter selected from the plurality of correction parameters based on the curvature of the imaging surface. A method for controlling the imaging apparatus. A method for controlling an imaging device in which an optical lens is detachable,
A step in which an imaging means whose imaging surface is curved so as to have a curvature according to the optical characteristics of a specific optical lens captures an optical image formed on the imaging surface by a mounted optical lens and generates image data; When,
Correcting the image data of the imaging unit based on a parameter representing the optical characteristics of the mounted optical lens;
When an optical lens different from the specific optical lens is mounted, the correction control unit corrects the parameter representing the optical characteristics of the different optical lens to a parameter corresponding to the curvature of the imaging surface, and the correction is made. And a step of causing the correction means to perform the image correction processing based on a parameter.

Images