WO2020159160A1 - Dispositif optique comprenant une lentille liquide et ayant une fonction de correction d'aberration chromatique et procédé de traitement d'image - Google Patents

Dispositif optique comprenant une lentille liquide et ayant une fonction de correction d'aberration chromatique et procédé de traitement d'image Download PDF

Info

Publication number
WO2020159160A1
WO2020159160A1 PCT/KR2020/001163 KR2020001163W WO2020159160A1 WO 2020159160 A1 WO2020159160 A1 WO 2020159160A1 KR 2020001163 W KR2020001163 W KR 2020001163W WO 2020159160 A1 WO2020159160 A1 WO 2020159160A1
Authority
WO
WIPO (PCT)
Prior art keywords
channel
information
field
image
correction
Prior art date
Application number
PCT/KR2020/001163
Other languages
English (en)
Korean (ko)
Inventor
정재욱
Original Assignee
엘지이노텍(주)
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 엘지이노텍(주) filed Critical 엘지이노텍(주)
Publication of WO2020159160A1 publication Critical patent/WO2020159160A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/95—Computational photography systems, e.g. light-field imaging systems
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B3/00—Simple or compound lenses
    • G02B3/12—Fluid-filled or evacuated lenses
    • G02B3/14—Fluid-filled or evacuated lenses of variable focal length
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0075—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for altering, e.g. increasing, the depth of field or depth of focus
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B7/00—Mountings, adjusting means, or light-tight connections, for optical elements
    • G02B7/02—Mountings, adjusting means, or light-tight connections, for optical elements for lenses
    • G02B7/04—Mountings, adjusting means, or light-tight connections, for optical elements for lenses with mechanism for focusing or varying magnification
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration

Definitions

  • An embodiment relates to an optical device and an image processing method including a liquid lens and having chromatic aberration correction.
  • a camera lens including a solid lens is designed such that chromatic aberration is suppressed as much as possible, so that a separate chromatic aberration correction is not required in an image process step after taking an image.
  • the chromatic aberration can be corrected easily because the user can directly remove chromatic aberration through candidate correction, the chromatic aberration amount is very small, and the shape in which the chromatic aberration is generated is symmetrical up/down/left/right.
  • chromatic aberration exhibits the same aspect as a camera lens including a solid lens in normal shooting, that is, in a normal state, in which an auto-focusing (AF) function is performed.
  • AF auto-focusing
  • chromatic aberration is largely generated and the amount of chromatic aberration varies depending on the OIS driving frequency, but OIS function is performed. It will increase approximately 5 to 8 times compared to when it is not.
  • the OIS driving frequency means a frequency for the shaking of a user who uses a camera lens.
  • a camera lens including a liquid lens Since the use of tilting of the interface between the two liquids, the shape of chromatic aberration is also asymmetrical up/down/left/right. Due to this, there is a problem that the image quality of the photographed image is significantly deteriorated.
  • An embodiment includes a liquid lens capable of correcting chromatic aberration and providing improved image quality, and provides an optical device and an image processing method having a chromatic aberration correction function.
  • An optical device includes a lens unit including a liquid lens; An image sensor receiving information of light passing through the lens unit through an R channel receiving a red wavelength range, a G channel receiving a green wavelength range, and a B channel receiving a blue wavelength range; And shifting information of light received through at least one correction channel among the R channel, the G channel, and the B channel by a preset movement amount corresponding to the driving information of the liquid lens and field information on the image sensor of the correction channel. It may include an image processing unit.
  • the correction channel may be a B channel and an R channel
  • the G channel may be a reference channel
  • the image processing unit maps and stores a correction angle of the liquid lens for each of a plurality of compensation angles, and stores the first movement amount of each field and the R channel of the image sensor of the B channel for each of the correction angles.
  • a look-up table that maps and stores the second movement amount for each field on the image sensor; The first movement amount for each field of the B channel corresponding to the compensation angle corresponding to the driving information of the liquid lens, and the second movement amount for each field of the R channel corresponding to the compensation angle are output from the lookup table.
  • Control unit And shifting information of the light received on the B channel by the first movement amount for each field output from the lookup table by field, and receiving information on the light received on the R channel by the second movement amount for each field output from the lookup table.
  • An image shifting unit may be shifted for each field.
  • the image processing unit may include a correction angle determining unit corresponding to a compensation angle corresponding to the driving information of the liquid lens and obtaining a preset correction angle of the liquid lens; A movement amount determination unit corresponding to the correction angle and determining a first movement amount for each field on the image sensor of the B channel and a second movement amount for each field on the image sensor of the R channel; And an image shifting unit shifting the information of the light received through the B channel by the first movement amount for each field, and shifting the information of the light received by the R channel by the second movement amount for each field.
  • the optical device may generate a corrected final image by synthesizing information of light received on the G channel, information of light received on the B channel and shifted, and information on light received on the R channel and shifted.
  • a synthetic part may be further included.
  • the optical device may further include a hand shake detection unit that converts user hand shake information corresponding to the driving information of the liquid lens into a compensation angle.
  • the image stabilization unit may include a gyro sensor that senses the degree of image stabilization of the user and converts the driving information of the liquid lens with respect to the sensed image amount to a compensation angle.
  • a gyro sensor that senses the degree of image stabilization of the user and converts the driving information of the liquid lens with respect to the sensed image amount to a compensation angle.
  • a lens unit including a liquid lens; An image sensor that receives information of light passing through the lens unit; And an image processing unit for correcting the information of the light, comprising: converting driving information of the liquid lens into a compensation angle; Obtaining a correction angle of the preset liquid lens corresponding to the compensation angle; Corresponding to the correction angle, the field information on the image sensor of at least one correction channel among the R channel receiving the red wavelength range, the G channel receiving the green wavelength range, and the B channel receiving the blue wavelength range. Determining a corresponding preset movement amount; And shifting information of light received through the correction channel by the determined amount of movement for each field on the image sensor.
  • the correction channel may be an R channel and a B channel
  • the G channel may be a reference channel
  • the determining of the movement amount may include determining a first movement amount for each field on the image sensor of the B channel that corresponds to the correction angle;
  • the method may include determining a second movement amount for each field on the image sensor of the R channel corresponding to the correction angle.
  • the shifting step may include shifting information of light received through the B channel by the first movement amount for each field on the image sensor; And shifting the information of the light received through the R channel by the second movement amount for each field on the image sensor.
  • the image processing method may generate a corrected final image by synthesizing information of light received on the G channel, information of light received on the R channel and shifted, and information of light received on the B channel and shifted. It may further include a step.
  • the optical device and the image processing method including a liquid lens according to an embodiment and having a chromatic aberration correction function are improved by correcting chromatic aberration by shifting information of light received through a compensation channel by a preset amount of movement for each field according to the degree of hand movement of the user It can provide image quality.
  • FIG. 1 is a block diagram of an optical device according to an embodiment.
  • FIG. 2 is a cross-sectional view of the liquid lens unit including the liquid lens illustrated in FIG. 1.
  • FIG. 3 shows an implementation example according to an embodiment of the optical device shown in FIG. 1.
  • FIG. 4 shows a planar shape according to the embodiment of the image sensor shown in FIG. 1.
  • FIG. 7 is a block diagram according to an embodiment of the image processing unit illustrated in FIG. 1.
  • FIG. 9 is a block diagram according to another embodiment of the image processing unit shown in FIG. 1.
  • FIG. 10 is a flowchart illustrating an image processing method according to an embodiment.
  • FIG. 11 is a view for explaining chromatic aberration correction according to an embodiment.
  • FIG. 12 is a diagram for describing an image in which chromatic aberration is corrected by an optical device and an image processing method according to an embodiment.
  • the terms used in the embodiments of the present invention are for describing the embodiments and are not intended to limit the present invention.
  • the singular form may also include the plural form unless specifically stated in the phrase, and is combined with A, B, C when described as “at least one (or more than one) of A and B, C”. It can contain one or more of all possible combinations.
  • first, second, A, B, (a), and (b) may be used. These terms are only for distinguishing the component from other components, and the term is not limited to the nature, order, or order of the component.
  • a component when a component is described as being'connected','coupled' or'connected' to another component, the component is not only directly connected, coupled or connected to the other component, but also to the component It may also include the case of'connected','coupled' or'connected' due to another component between the other components.
  • top (top) or bottom (bottom) when described as being formed or disposed in the “top (top) or bottom (bottom)” of each component, the top (top) or bottom (bottom) is not only when two components are in direct contact with each other, but also one It also includes a case in which another component described above is formed or disposed between two components.
  • up (up) or down (down) when expressed as “up (up) or down (down)”, it may include the meaning of the downward direction as well as the upward direction based on one component.
  • the variable lens may be a variable focus lens. Also, the variable lens may be a lens whose focus is adjusted.
  • the variable lens may be at least one of a liquid lens, a polymer lens, a liquid crystal lens, a VCM type, and an SMA type.
  • the liquid lens may include a liquid lens including one liquid and a liquid lens including two liquids.
  • the liquid lens including one liquid may change the focus by adjusting the membrane disposed at a position corresponding to the liquid, and for example, the focus may be changed by pressing the membrane by the electromagnetic force of the magnet and the coil.
  • the liquid lens including two liquids may control the interface formed by the conductive liquid and the non-conductive liquid by using a voltage applied to the liquid lens, including the conductive liquid and the non-conductive liquid.
  • the polymer lens can change the focus of the polymer material through a driving unit such as a piezo.
  • the liquid crystal lens can change the focus by controlling the liquid crystal by electromagnetic force.
  • the VCM type can change the focus by adjusting the solid lens or the lens assembly including the solid lens through an electromagnetic force between the magnet and the coil.
  • the SMA type may use a shape memory alloy to control a solid lens or a lens assembly including the solid lens to change focus.
  • the optical device having the chromatic aberration correction function according to the embodiment will be described as including a liquid lens as a variable lens, and the image processing method according to the embodiment will be described as being performed at an optical device including a liquid lens as a variable lens.
  • the embodiment is not limited thereto. That is, the following description of the optical device can be applied to an optical device including a variable lens other than a liquid lens, and the description of the following image processing method is performed by an optical device including a variable lens other than a liquid lens It can also be applied to the video processing method.
  • FIG. 1 is a block diagram of an optical device 100 according to an embodiment, and includes a lens unit (or lens assembly) 110, an image sensor 120, an image processing unit 130, and an image synthesis unit 140. Can.
  • the lens unit 110 may include a liquid lens 110A.
  • the embodiment is not limited to the liquid lens 110A having a specific structure.
  • FIG. 2 is a cross-sectional view of a liquid lens unit including the liquid lens 110A shown in FIG. 1.
  • the liquid lens unit illustrated in FIG. 2 may include a liquid lens 110A and first and second connecting substrates 116 and 118.
  • the liquid lens 110A includes a plurality of different types of liquids LQ1, LQ2, first to third plates P1, P2, P3, first and second electrodes E1, E2, and an insulating layer 119. It may include.
  • a plurality of liquids is accommodated in a cavity (CA:cavity), the first liquid having a conductivity (LQ1) and non-conductive and can be embodied as a non-conductive material such as oil (oil) 2 liquid (or insulating liquid) (LQ2).
  • the first liquid LQ1 and the second liquid LQ2 do not mix with each other, and an interface BO may be formed at a contact portion between the first and second liquids LQ1 and LQ2.
  • the first liquid LQ1 may be disposed on the second liquid LQ2, or the second liquid LQ2 may be disposed on the first liquid LQ1.
  • the inner surface of the first plate P1 may form a side wall i of the cavity CA.
  • the first plate P1 may include upper and lower openings having a predetermined inclined surface. That is, the cavity CA may be defined as an area surrounded by an inclined surface of the first plate P1, a first opening contacting the second plate P2, and a second opening contacting the third plate P3.
  • the diameter of the wider opening among the first and second openings may vary depending on the field of view (FOV) required by the liquid lens 110A or the role of the liquid lens 110A.
  • the interface BO formed by the two liquids may move along the inclined surface of the cavity CA by the driving voltage.
  • the first liquid LQ1 and the second liquid LQ2 may be filled, received, or disposed in the cavity CA of the first plate P1. Further, the cavity CA is a site through which light passes. Therefore, the first plate P1 may be made of a transparent material, or may contain impurities so that light transmission is not easy.
  • First and second electrodes E1 and E2 may be disposed on one surface and the other surface of the first plate P1, respectively.
  • the plurality of first electrodes E1 are spaced apart from the second electrode E2 and may be disposed on the upper surface, side surfaces, and lower surfaces of the first plate P1.
  • the second electrode E2 is disposed in at least a portion of the lower surface of the first plate P1 and may directly contact the first liquid LQ1.
  • the plurality of first electrodes E1 may correspond to individual electrodes that can be electrically separated from each other, and the plurality of second electrodes E2 may correspond to common electrodes that may not be electrically separated from each other. have. A portion of the second electrode E2 disposed on the other surface of the first plate P1 may be exposed to the first liquid LQ1 having conductivity.
  • the second plate P2 may be disposed on the upper surface of the first electrode E1 and the cavity CA.
  • the third plate P3 may be disposed under the second electrode E2 and under the cavity CA.
  • the second plate P2 and the third plate P3 may be disposed to face each other with the first plate P1 therebetween. Also, at least one of the second plate P2 or the third plate P3 may be omitted.
  • Each of the second and third plates P2 and P3 is a region through which light passes, and may be made of a translucent material.
  • each of the second and third plates P2 and P3 may be made of glass, and may be formed of the same material for convenience of processing.
  • the second plate P2 may have a configuration that allows the incident light to proceed into the cavity CA of the first plate P1.
  • the third plate P3 may have a configuration that allows light passing through the cavity CA of the first plate P1 to be emitted.
  • the third plate P3 may directly contact the first liquid LQ1.
  • the insulating layer 119 may be disposed while covering a part of the lower surface of the second plate P2 in the upper region of the cavity CA. That is, the insulating layer 119 may be disposed between the second liquid LQ2 and the second plate P2. In addition, the insulating layer 119 may be disposed while covering at least a portion of the first electrode E1 forming the sidewall of the cavity CA. In addition, the insulating layer 119 may be disposed on the lower surface of the first plate P1, covering a portion of the second electrode E2 and the first plate P1 and the first electrode E1. Due to this, the contact between the first electrode E1 and the first liquid LQ1 and the contact between the first electrode E1 and the second liquid LQ2 may be blocked by the insulating layer 119.
  • the insulating layer 119 covers one electrode (eg, the first electrode E1) of the first and second electrodes E1 and E2, and the other electrode (eg, the second electrode E2). )) to expose a portion of the first liquid (LQ1) having conductivity so that electrical energy is applied.
  • one electrode eg, the first electrode E1 of the first and second electrodes E1 and E2, and the other electrode (eg, the second electrode E2).
  • the first connecting substrate 116 and the second connecting substrate 118 serve to supply voltage to the liquid lens 110A.
  • the first electrode E1 may be electrically connected to the first connection substrate 116
  • the second electrode E2 may be electrically connected to the second connection substrate 118.
  • the optical device including the liquid lens 110A has an Auto-Focusing (AF) function or image stabilization or image stabilization (OIS: Optical) Image Stabilizer) function.
  • AF Auto-Focusing
  • OIS Optical
  • FIG. 3 shows an implementation example according to an embodiment of the optical device 100 shown in FIG. 1.
  • the lens unit 110 of the optical device 100 illustrated in FIG. 3 may include a first lens unit 150, a liquid lens 110A, and a second lens unit 160.
  • the optical device 100 may further include a filter 170 and an image sensor 120.
  • the imaging surface 120S illustrated in FIG. 3 may correspond to the imaging surface of the image sensor 120 illustrated in FIG. 1.
  • each of the first lens unit 150 and the second lens unit 160 is a solid lens, and may be implemented as glass or plastic, but the embodiment is the first lens unit 150 and the first 2 It is not limited to each specific material of the lens unit 160. Also, at least one of the first lens unit 150 or the second lens unit 160 may be omitted.
  • the liquid lens 110A is illustrated between the first lens unit 150 and the second lens unit 160, unlike the liquid lens 110A, the first lens unit ( It may be disposed on the left side of the 150) or the right side of the second lens unit 160.
  • the first lens unit 150 may include two lenses 152 and 154, but may also include fewer or more than two lenses.
  • the second lens unit 160 may include three lenses 162, 164, and 166, but may also include fewer or more lenses than three.
  • the filter 170 may filter light corresponding to a specific wavelength range for light passing through the first lens unit 150, the liquid lens 110A, and the second lens unit 160.
  • the filter 170 may be an infrared (IR) blocking filter or an ultraviolet (UV) blocking filter, but embodiments are not limited thereto.
  • the filter 170 may be disposed between the lens unit 110 and the imaging surface 120S of the image sensor 120. In some cases, the filter 170 may be omitted.
  • the image sensor 120 converts light passing through the lens unit 110 into an image, and outputs the converted image to the image processing unit 130. That is, the image sensor 120 has a lens through an R channel receiving a red wavelength range, a G channel receiving a green wavelength range, and a B channel receiving a blue wavelength range. Information of the light passing through the unit 110 may be received.
  • the image processing unit 130 serves to correct chromatic aberration of the image output from the image sensor 120.
  • chromatic aberration may mean the degree to which information (or an image) of light received through the correction channel is shifted compared to information (or an image) of light received through the reference channel. The meaning of chromatic aberration will be described later in detail.
  • The'correction channel' means a channel to be corrected among R channels, G channels and B channels
  • the'reference channel' means a channel that is a reference for correcting the correction channels among R channels, G channels and B channels. do. That is, the degree to which the image received by the correction channel is shifted based on the image received by the reference channel corresponds to chromatic aberration.
  • the correction channels are described as B channels and R channels, and G channels are reference channels, but embodiments are not limited thereto.
  • the image processing unit 130 is configured to correspond to field information on the image sensor 120 of the driving information of the liquid lens 110A and the correction channel of the information of the light received through at least one correction channel of the R channel, the G channel, and the B channel. Chromatic aberration can be corrected by shifting by a set amount of movement.
  • the driving information of the liquid lens 110A may be information about the degree of hand movement of the user (hereinafter, referred to as “hand shake information”).
  • hand shake information information about the degree of hand movement of the user
  • the image processing unit 130 shifts the information (for example, an image) of the light received through the correction channel by the amount of movement for each field.
  • FIG. 4 shows a planar shape according to the embodiment 120A of the image sensor 120 shown in FIG. 1, the horizontal axis represents the position in the x-axis direction, and the vertical axis represents the y-axis position perpendicular to the x-axis.
  • the aforementioned “field” indicates a position relative to the optical axis on the imaging surface 120S of the image sensor 120. That is, the field indicates a relative position of the image sensor 120 in the radial direction with respect to the center of the image sensor 120.
  • a field at the center of the image sensor 120 is 0.0f, and the entire area of the image sensor 120 is radially based on the center.
  • the field of 50% of the point is ⁇ 0.5f
  • the edge field of the image sensor 120 is ⁇ 1.0.
  • FIG. 5 shows the relationship between the amount of chromatic aberration (hereinafter referred to as'aberration amount') and the field of the image sensor 120 when the interface BO of the liquid lens 110A is not tilted
  • FIG. 6 shows the liquid lens ( Shows the relationship between the aberration amount and the field of the image sensor 120 when the interface BO of 110A) is tilted.
  • the horizontal axis represents the aberration amount
  • the vertical axis represents the physical position of the image sensor 120. That is, a value obtained by normalizing the physical position of the vertical axis corresponds to the field.
  • 'BR' represents the amount of chromatic aberration between the B channel and the R channel
  • 'BG' represents the amount of chromatic aberration between the B channel and the G channel.
  • the sign of the field is (+) on the upper side and the sign of the field is (-) on the lower side with respect to the axis representing the aberration amount.
  • the sign (ie, direction) of this field is meaningless because the camera lens is rotationally symmetric about the optical axis.
  • the sign of the field ie the direction of the field, is not taken into account.
  • the sign (ie, direction) of this field must be considered because the camera lens is not rotationally symmetric about the optical axis.
  • the sign of the field ie the direction of the field.
  • the amount of movement for each field required to correct chromatic aberration in the image processing unit 130 may be determined in advance for each driving information (for example, hand-shake information) of the liquid lens 110A. This will be described as follows with reference to FIGS. 7 to 9.
  • FIG. 7 is a block diagram according to an embodiment 130A of the image processing unit 130 shown in FIG. 1.
  • the image processing unit 130A may include a control unit 134, a look-up-table (LUT) 136 and an image shifting unit 138.
  • the LUT 136 maps and stores the correction angles of the liquid lens 110A for a plurality of compensation angles in advance, and stores the first movement amount and R channel for each field on the image sensor 120 of the B channel for each of the correction angles.
  • the second movement amount for each field on the sensor 120 may be mapped and stored in advance.
  • the correction angle stored in the LUT 136 may be applied to the liquid lens 110A and replaced with a driving voltage that controls the interface of the liquid lens 110A.
  • the LUT 136 shown in FIG. 8 maps and stores the compensation angle and the compensation angle, and stores the compensation angle and the first and second movement amounts for each field.
  • the unit of each of the first and second movement amounts illustrated in FIG. 8 is the number of pixels. In the case of FIG. 8, only fields having a positive (+) sign are stored in the LUT 136, but fields having a negative (-) sign may also be stored in the LUT 136.
  • the control unit 134 looks up the first movement amount for each field of the B channel corresponding to the compensation angle corresponding to the image stabilization information and the second movement amount for each field of the R channel corresponding to the compensation angle ( 136). That is, using the compensation angle corresponding to the hand-shake information as the address of the LUT 136, the control unit 134 determines the first and second movement amounts for each field of the B and R channels stored in the corresponding address of the LUT 136. It can be output to the image shifting unit 138.
  • the optical device may further include a camera shake detection unit 50.
  • the camera shake detection unit 50 may convert camera shake information corresponding to driving information of the liquid lens 110A into a compensation angle, and output the converted compensation angle to the controller 134.
  • the camera shake detection unit 50 may include a gyro sensor 52.
  • the gyro sensor 52 senses the degree of the user's hand-shake, converts the hand-shake information about the sensed hand-shake to a compensation angle, and outputs the converted result to the controller 134. It is not limited to the specific implementation examples of unit 50.
  • the compensation angle when the compensation angle is “0”, there is no first and second movement amount for each field.
  • the compensation angle when the compensation angle is '0.3 degrees', the compensation angle is 0.42, and the first movement amount for each field in fields 0, 0.2, 0.4, 0.6, 0.8, and 1 is -0.1, 0.5, 0.4, -0.2, -0.4, respectively.
  • the second movement amount per field in fields 0, 0.2, 0.4, 0.6, 0.8, and 1 is 0, 0.4, 0.6, 0.6, 0.8, and 1.9, respectively.
  • the spacing between fields is 0.2, but this is only an example, and may be larger or smaller than 0.2. As the distance between fields is smaller, the amount of movement is further subdivided, so that chromatic aberration can be accurately corrected.
  • the image shifting unit 138 shifts the information (for example, an image) of light received in the B channel for each field by the first movement amount for each field output from the LUT 136, and images the shifted result through the output terminal OUT2 Output to the synthesis unit 140.
  • the image shifting unit 138 shifts the information (for example, an image) of light received on the R channel by the second movement amount per field output from the LUT 136 for each field, and outputs the shifted result to the output terminal OUT2. Output to the image synthesis unit 140 through.
  • the image shifting unit 138 receives the information of the light received from the image sensor 120 through the input terminal IN1 in the B channel, and receives the information of the light received from the image sensor 120 through the input terminal IN2 through the R channel. Can receive Alternatively, the image shifting unit 138 receives information of light including both the information of the light received from the image sensor 120 through the input terminal IN1 or IN2 in the B channel and the information of the light received through the R channel, and from the received light information. It is also possible to separate information of light received on the B channel and information of light received on the R channel.
  • the image shifting unit 138 displays information of the light received through the B channel in fields 0, 0.2, 0.4, 0.6, 0.8, and 1, respectively, -0.1, 0.5, and 0.4. , -0.2, -0.4 and 0.7 pixels, and the information of the light received through the R channel is 0, 0.4, 0.6, 0.6, 0.8 and 1.9 pixels in fields 0, 0.2, 0.4, 0.6, 0.8 and 1, respectively. Shift it.
  • FIG. 9 is a block diagram according to another embodiment 130B of the image processing unit 130 shown in FIG. 1.
  • the image processing unit 130B may include a correction angle determination unit 133, a movement amount determination unit 135, and an image shifting unit 138.
  • a correction angle determination unit 133 may be included in the image processing unit 130B.
  • a movement amount determination unit 135 may be included in the image processing unit 130B.
  • an image shifting unit 138 may be included in the image processing unit 130B.
  • FIG. 9 the same reference numerals are used for the same components as in FIG. 7, and overlapping descriptions are omitted.
  • the correction angle determination unit 133 obtains a correction angle of the preset liquid lens 110A corresponding to the compensation angle output from the image stabilization unit 50 and outputs the correction angle to the movement amount determination unit 135.
  • the correction angle determination unit 133 may be implemented in the form of a look-up table 133A using a compensation angle as an address and a correction angle as data stored at each address.
  • the correction angle determining unit 133 may map a plurality of correction angles for each compensation angle in advance and store them in the form of a lookup table 133A.
  • the correction angle determination unit 133 may output the correction angle mapped to the compensation angle output from the image stabilization unit 50 to the movement amount determination unit 135.
  • the correction angle determined by the correction angle determination unit 133 may be output to the liquid lens driving unit (not shown) through the output terminal OUT3.
  • the liquid lens driving unit generates a driving voltage for driving the liquid lens 110A in response to the correction angle output from the correction angle determination unit 133, thereby tilting the angle ⁇ of the interface BO of the liquid lens 110A. Can be adjusted.
  • the movement amount determination unit 135 corresponds to the correction angle output from the correction angle determination unit 133, and the first movement amount per field on the image sensor 120 of the preset B channel and each field on the image sensor 120 of the R channel.
  • the second movement amount may be determined, and the determined result may be output to the image shifting unit 138.
  • the movement amount determination unit 135 may be implemented in the form of a look-up table 135A that uses correction angles as addresses and first and second movement amounts for each field as data stored in each address. have. To this end, the movement amount determination unit 135 may map a plurality of correction angles and first and second movement amounts for each field in advance and store them in the form of a look-up table 135A. In this case, the movement amount determination unit 135 may output first and second movement amounts for each field mapped to the correction angle output from the correction angle determination unit 133 to the image shifting unit 138.
  • the image synthesizing unit 140 synthesizes information of light received on the G channel, information of light received on the B channel and shifted, and information on light received on the R channel and shifted, and synthesized results.
  • the final image with corrected chromatic aberration can be output through the output terminal OUT1.
  • the image synthesizing unit 140 extracts the information of the light received through the G channel from the information of the light output from the image sensor 120, the information of the light received and shifted by the B channel, and the received and shifted by the R channel.
  • the information of the light may be received from the image processing unit 130, and information of the light received through the extracted G channel, information of the light received and shifted through the B channel, and information of the light received and shifted through the R channel may be synthesized.
  • the final image output through the output terminal OUT1 may be displayed on a display (not shown), but the embodiment is not limited thereto.
  • the above-described image processing unit 130 and the image synthesis unit 140 may be respectively implemented in separate configurations, or may serve as the above-described image processing unit 130 and the image synthesis unit 140 in one control unit.
  • FIG. 10 is a flowchart illustrating an image processing method 200 according to an embodiment.
  • the image processing method 200 illustrated in FIG. 10 may be performed by the optical device 100 illustrated in FIG. 1, or may also be performed by an optical device having a configuration different from the configuration illustrated in FIG. 1.
  • the optical device 100 illustrated in FIG. 1 may perform the image processing method 200 illustrated in FIG. 10 or may perform another image processing method illustrated in FIG. 10.
  • the image processing method 200 illustrated in FIG. 10 is performed by the optical device 100 illustrated in FIG. 1.
  • Step 210 information on the hand-shake, which is information on the degree of the user's hand-shake, is converted into a compensation angle (step 210).
  • Step 210 may be performed by the image stabilization unit 50 shown in FIGS. 7 and 9.
  • a correction angle of the preset liquid lens 110A corresponding to the compensation angle is obtained (step 220).
  • the step 220 may be performed by the control unit 134 and the LUT 136 illustrated in FIG. 7, or may be performed by the correction angle determination unit 133 illustrated in FIG. 9.
  • Step 220 a predetermined amount of movement for each field corresponding to the correction angle and corresponding to field information on the image sensor 120 of at least one correction channel among R channels, G channels, and B channels is determined (230 and 240) step). Steps 230 and 240 may be performed by the control unit 134 and the LUT 136 illustrated in FIG. 7, or may be performed by the movement amount determining unit 135 illustrated in FIG. 9.
  • the correction channels are R and B channels, and the G channel can be a reference channel.
  • the first movement amount for each field on the image sensor 120 of the preset B channel corresponding to the correction angle may be determined (step 230).
  • a second movement amount for each field on the image sensor 120 of the preset R channel corresponding to the correction angle may be determined (step 240).
  • operation 240 is performed, but the embodiment is not limited thereto. That is, after the 240th step is performed, the 230th step may be performed, and the 230th and 240th steps may be simultaneously performed.
  • Steps 250 and 260 may be performed by the image shifting unit 138 illustrated in FIGS. 7 and 9.
  • the correction channels are R channels and B channels
  • the reference channel is G channels
  • image information eg, an image
  • the first movement amount may be shifted for each field on the sensor 120 (step 250).
  • Step 260 information (eg, an image) of the light received through the R channel may be shifted by a second amount of movement for each field on the image sensor 120 (Step 260).
  • the 260th step is illustrated, but the embodiment is not limited thereto. That is, after step 260 is performed, step 250 may be performed, and steps 250 and 260 may be performed at the same time. Alternatively, step 250 may be performed after step 230 is performed, and step 260 may be performed after step 240 is performed.
  • steps 220 to 260 illustrated in FIG. 10 may be performed by the image processing unit 130.
  • step 260 information of the light received through the G channel (eg, an image), information of the light received through the R channel and shifted (eg, an image), and information of the light received through the B channel and shifted (eg, an image) , Image) may be synthesized, and the synthesized result may be generated as a final image in which chromatic aberration is corrected (step 270 ).
  • Step 270 may be performed by the image synthesis unit 140 illustrated in FIG. 1.
  • the information of the light received through the G channel is referred to as an'G channel image'
  • the information of the light received through the R channel is referred to as an'R channel image'
  • the information of the light received through the B channel is' B channel image.
  • FIG. 11 is a view for explaining chromatic aberration correction according to an embodiment.
  • the image of which chromatic aberration is suppressed can be obtained by increasing and decreasing the size of the image by the amount of chromatic aberration of the lens for each R channel, G channel and B channel of the image having chromatic aberration.
  • the image IM1 output from the image sensor 120 has chromatic aberration.
  • the chromatic aberration may mean a difference in size of an image for each wavelength.
  • the G-channel image GAM
  • the first size difference obtained by subtracting the size of the G-channel image from the R-channel image size is referred to as' ⁇ '
  • the B-channel image size Let's suppose the second size difference subtracting the size of the image is' ⁇ '.
  • the result of subtracting the first size difference ( ⁇ ) from the size of the image of the R channel (RIM), the result of subtracting the second size difference ( ⁇ ) from the size of the image of the B channel (BIM), and the G channel When synthesizing the image GIM of, an image IM2 with corrected (or suppressed) chromatic aberration may be obtained.
  • the largest value is the chromatic aberration. It corresponds.
  • a chromatic aberration of 10 ⁇ m means that the largest size difference among image size differences of the R channel, the G channel, and the B channel is 10 ⁇ m.
  • the chromatic aberration of the image generated from the optical signal passing through the lens unit 110 in the state where the interface BO of the liquid lens 110A is tilted has a different size between the images of the R channel, the G channel, and the B channel.
  • the images of R channel, G channel and B channel appear in shifted form.
  • the G channel is the reference channel among the R channels, the G channels, and the B channels
  • the R channel image R1 is shifted based on the G channel image GIM.
  • Chromatic aberration appears. For this reason, referring to FIG.
  • the optical device 100 and the image processing method 200 may correct chromatic aberration by shifting the image of each of the correction channel, for example, the B channel and the R channel according to image stabilization information.
  • FIG. 12 is a diagram for describing an image in which chromatic aberration is corrected by the optical device 100 and the image processing method 200 according to the embodiment.
  • 0.9f to -0.9f denote a field
  • 0 degrees and 0.6 degrees denote compensation angles.
  • the compensation angle of '0 degree' is a steady state without shaking, and as shown in FIG. 2, there is no tilting at the interface BO.
  • the compensation angle of '0.6 degrees' may mean that the shaking motion is maximized, and as illustrated in FIG. 2, the inclined angle ⁇ of the interface BO is 0.6 degrees.
  • the image of the chromatic aberration corrected is obtained by shifting and synthesizing the image of the R channel and the image of the B channel by a predetermined amount of movement for each field according to the compensation angle obtained according to the image stabilization information. Can be seen.
  • the optical device may include a device capable of processing or analyzing an optical signal.
  • the optical device may include a camera/video device, a telescope device, a microscope device, an interferometer device, a photometer device, a polarimeter device, a spectrometer device, a reflectometer device, an autocollimator device, and a lens meter device.
  • the optical device may be implemented as a portable device such as a smart phone, a notebook computer, and a tablet computer.
  • a portable device such as a smart phone, a notebook computer, and a tablet computer.
  • Such an optical device may include a display unit for outputting an image (not shown), a battery for supplying power to each unit (not shown), and a main body housing for mounting each unit and the battery.
  • the optical device may further include a communication module capable of communicating with other devices and a memory unit capable of storing data.
  • the communication module and the memory unit may also be mounted in the body housing.
  • a lens unit including a liquid lens; An image sensor that receives information of light passing through the lens unit; And an image processing unit for correcting the information of light, a recording medium recording a program for executing an image processing method performed in an optical device, the function of converting information on the degree of hand shake of a user into a compensation angle and corresponding to the compensation angle At least, the function to obtain a predetermined correction angle of the liquid lens, and at least one of the R channel corresponding to the correction angle and the R channel receiving the red wavelength range, the G channel receiving the green wavelength range, and the B channel receiving the blue wavelength range.
  • the function of determining the amount of movement implemented by the program recorded on the computer-readable recording medium corresponds to the correction angle, and the function of determining the first amount of movement for each field on the preset B channel image sensor and the correction angle And it may include a function for determining the second movement amount for each field on the preset R channel image sensor.
  • the shifting function implemented by a program recorded on a computer-readable recording medium is a function of shifting the information of light received on the B channel by a first movement amount for each field on the image sensor and the information of light received on the R channel.
  • a function of shifting by the second movement amount for each field on the sensor may be included.
  • the computer-readable recording medium further includes a function of synthesizing the information of the light received on the G channel, the information of the light received on the R channel and shifted, and the information of the light received on the B channel and shifted to generate a corrected final image. You can record the program you implement.
  • the computer-readable recording medium includes any kind of storage device that stores data that can be read by a computer system.
  • Examples of computer-readable recording media include ROM, RAM, CD-ROM, magnetic tape, floppy disks, and optical data storage devices.
  • the computer-readable recording medium can also be distributed over network coupled computer systems so that the computer readable code is stored and executed in a distributed fashion.
  • functional programs, codes, and code segments for implementing the image processing method can be easily inferred by programmers in the technical field to which the present invention pertains.
  • the optical device and the image processing method including the liquid lens according to the embodiment and having chromatic aberration correction function include a camera/video device, a telescope device, a microscope device, an interferometer device, a photometer device, a polarimeter device, a spectrometer device, a reflectometer device, and an autocollimator It can be used in devices, lens meter devices, smartphones, notebook computers, tablet computers, and the like.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Computing Systems (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Studio Devices (AREA)

Abstract

Dispositif optique d'un mode de réalisation comprenant une unité de lentille qui contient une lentille liquide ; un capteur d'image qui reçoit des informations de lumière traversant l'unité de lentille par l'intermédiaire d'un canal R qui reçoit une plage de longueur d'onde rouge, un canal G qui reçoit une plage de longueur d'onde verte et un canal B qui reçoit une plage de longueur d'onde bleue ; et une unité de traitement d'image qui décale des informations de lumière, reçues par l'intermédiaire d'au moins un canal de correction parmi le canal R, le canal G et le canal B, par une quantité de mouvement prédéfinie correspondant à des informations de conduite de la lentille liquide et des informations de champ sur le capteur d'image du canal de correction.
PCT/KR2020/001163 2019-01-30 2020-01-23 Dispositif optique comprenant une lentille liquide et ayant une fonction de correction d'aberration chromatique et procédé de traitement d'image WO2020159160A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR1020190012084A KR20200094509A (ko) 2019-01-30 2019-01-30 액체 렌즈를 포함하며 색수차 보정 기능을 갖는 광학 기기 및 영상 처리 방법
KR10-2019-0012084 2019-01-30

Publications (1)

Publication Number Publication Date
WO2020159160A1 true WO2020159160A1 (fr) 2020-08-06

Family

ID=71841536

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2020/001163 WO2020159160A1 (fr) 2019-01-30 2020-01-23 Dispositif optique comprenant une lentille liquide et ayant une fonction de correction d'aberration chromatique et procédé de traitement d'image

Country Status (2)

Country Link
KR (1) KR20200094509A (fr)
WO (1) WO2020159160A1 (fr)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100819301B1 (ko) * 2006-12-20 2008-04-03 삼성전자주식회사 모바일 기기용 카메라 모듈의 손떨림 보정 방법 및 장치
JP2009219123A (ja) * 2008-03-12 2009-09-24 Thomson Licensing 色収差を補正する方法
KR101121014B1 (ko) * 2010-12-22 2012-03-16 중앙대학교 산학협력단 다중 컬러 필터 조리개에 의해 촬영된 저노출 영상의 색상 개선 장치 및 방법
KR101125765B1 (ko) * 2011-01-24 2012-03-27 중앙대학교 산학협력단 다중 컬러 필터 조리개를 구비한 촬상 장치에 의해 촬영된 영상의 깊이 정보를 기반으로 한 컬러 채널 정렬장치 및 방법
KR20180102418A (ko) * 2017-03-07 2018-09-17 엘지이노텍 주식회사 액체 렌즈를 포함하는 카메라 모듈 및 광학 기기

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100819301B1 (ko) * 2006-12-20 2008-04-03 삼성전자주식회사 모바일 기기용 카메라 모듈의 손떨림 보정 방법 및 장치
JP2009219123A (ja) * 2008-03-12 2009-09-24 Thomson Licensing 色収差を補正する方法
KR101121014B1 (ko) * 2010-12-22 2012-03-16 중앙대학교 산학협력단 다중 컬러 필터 조리개에 의해 촬영된 저노출 영상의 색상 개선 장치 및 방법
KR101125765B1 (ko) * 2011-01-24 2012-03-27 중앙대학교 산학협력단 다중 컬러 필터 조리개를 구비한 촬상 장치에 의해 촬영된 영상의 깊이 정보를 기반으로 한 컬러 채널 정렬장치 및 방법
KR20180102418A (ko) * 2017-03-07 2018-09-17 엘지이노텍 주식회사 액체 렌즈를 포함하는 카메라 모듈 및 광학 기기

Also Published As

Publication number Publication date
KR20200094509A (ko) 2020-08-07

Similar Documents

Publication Publication Date Title
WO2011078614A2 (fr) Module d'appareil photographique
WO2014014222A1 (fr) Module de caméra
WO2014003492A1 (fr) Module de caméra
EP2868076A1 (fr) Module de caméra
WO2018135851A1 (fr) Lentille liquide, module de caméra et dispositif optique les comprenant
WO2018128518A1 (fr) Module d'appareil de prise de vues et instrument optique le comprenant
WO2020122594A1 (fr) Ensemble lentilles et module de caméra le comprenant
WO2019164335A1 (fr) Module à lentille et module caméra comprenant celui-ci
WO2019088353A1 (fr) Module de caméra comprenant une lentille liquide et instrument optique
WO2020209492A1 (fr) Caméra pliée et dispositif électronique le comprenant
WO2018194195A1 (fr) Terminal mobile
WO2019225984A1 (fr) Lentille liquide, module de caméra et instrument optique la comprenant
WO2020189992A1 (fr) Module de caméra
WO2018151527A1 (fr) Lentille liquide et module de caméra la comprenant
WO2018182348A1 (fr) Module d'appareil photographique comprenant une lentille liquide
WO2018147670A1 (fr) Module de caméra comprenant une lentille liquide, et dispositif optique
WO2018182349A1 (fr) Lentille liquide, module de caméra et dispositif optique le comprenant
WO2018139894A1 (fr) Module de lentille liquide et module de caméra le comprenant
WO2021246826A1 (fr) Module de caméra
WO2018164524A1 (fr) Lentille liquide, module d'appareil photographique et instrument optique les incluant
WO2021040341A1 (fr) Dispositif de commande de capteur et module de camera
WO2020159160A1 (fr) Dispositif optique comprenant une lentille liquide et ayant une fonction de correction d'aberration chromatique et procédé de traitement d'image
WO2021006592A1 (fr) Dispositif de commande de lentille de liquide
WO2019212280A1 (fr) Module de caméra double comprenant des lentilles liquides
WO2020242135A1 (fr) Lentille liquide et ensemble lentille la comprenant

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20748793

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20748793

Country of ref document: EP

Kind code of ref document: A1