WO2017148109A1 - 一种彩色成像装置以及获取彩色图像的方法 - Google Patents
一种彩色成像装置以及获取彩色图像的方法 Download PDFInfo
- Publication number
- WO2017148109A1 WO2017148109A1 PCT/CN2016/096086 CN2016096086W WO2017148109A1 WO 2017148109 A1 WO2017148109 A1 WO 2017148109A1 CN 2016096086 W CN2016096086 W CN 2016096086W WO 2017148109 A1 WO2017148109 A1 WO 2017148109A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- color
- filter
- color filter
- image
- imaging
- Prior art date
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/10—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
- H04N23/125—Colour sequential image capture, e.g. using a colour wheel
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/10—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/10—Circuitry of solid-state image sensors [SSIS]; Control thereof for transforming different wavelengths into image signals
- H04N25/11—Arrangement of colour filter arrays [CFA]; Filter mosaics
- H04N25/13—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements
- H04N25/134—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements based on three different wavelength filter elements
Definitions
- Embodiments of the present invention relate to the field of image processing technologies, and in particular, to a color imaging device and a method for acquiring a color image.
- Color imaging technology has been widely used in digital cameras, mobile phones and other devices.
- Color imaging sensors include imaging sensors that only capture grayscale images.
- the imaging sensor can record the light intensity information by converting the incident light signal into an electrical signal. Since the imaging sensor captures only the grayscale image, the color cannot be sensed. Therefore, in order to obtain a color photograph, the technician distinguishes different colors by covering the color filter on the imaging sensor.
- a conventional color imaging sensor includes a microlens array, a color filter, and an imaging sensor, and the three are fabricated together.
- the color filter currently widely used is a red (English: red, abbreviation: R) green (English: blue, abbreviation: B) filter, which is implemented by a plurality of Bayer arrays.
- Each Bayer array is arranged in a 2*2 matrix, including 4 sub-units, 4 sub-units are 2 green filters, 1 red filter and 1 blue filter.
- the filter of each color corresponds to a pixel on the imaging sensor, so that the pixel can be sensitive to the corresponding color, so that each pixel records one color information of red, green and blue, and then performs color space interpolation. Processing, you can get a color image.
- each sub-unit of the color filter needs to be accurately mapped to each pixel of the imaging sensor, and thus the structure of the color filter Fine, color filter registration also exists
- the machining process is more complicated. The larger the imaging area of the color imaging sensor, the smaller the pixel size and the more difficult the processing.
- the embodiment of the invention provides a color imaging device and a method for acquiring a color image, which are used to solve the problem that the color filter is difficult to process in the prior art.
- an embodiment of the present invention provides a color imaging apparatus including a main lens, a microlens array, and an imaging sensor sequentially arranged on an optical path;
- the main lens includes at least two coaxial axes and is relatively fixed in position Single lens;
- the apparatus further comprising a first color filter disposed at an aperture stop of the main lens;
- the main lens, the first color filter, the microlens array, and the imaging The sensor is parallel and coaxial;
- the microlens array includes 1 microlens;
- the imaging sensor is located at a focal plane of the microlens array; wherein the imaging sensor comprises 1*M*N pixels, and light is from any one And a pixel array covering the M*N of the imaging sensor when the microlens reaches the imaging sensor, and covering the l*M*N pixels included in the imaging sensor when the light reaches the imaging sensor from the one microlens
- l, M and N are both positive integers;
- the first color filter comprises at least one filter capable of filtering
- the color filter is disposed at the aperture stop of the main lens, and the microlens array is located on the image plane of the main lens, and the light emitted by the scene passes through the main lens and the color filter, and is imaged on the microlens array. After passing through the microlens array, light of different colors reaches different pixels of the imaging sensor, so that a color image can be obtained.
- the size of the color filter is not smaller than the size of the main lens in the corresponding direction in any direction perpendicular to the axis, which is much larger than the size of each unit in the color filter directly processed on the surface of the imaging sensor. Therefore, the processing difficulty of the color filter is greatly reduced. And the color filter no longer needs to be machined onto the imaging sensor.
- the color filter is processed simultaneously with the imaging sensor, and the color filter is modified together with the imaging sensor. In the embodiment of the invention, the color filter is not processed onto the imaging sensor, so when modified, Modified separately.
- the distance dn of each pixel in the imaging sensor from the pixel at the center of the imaging sensor is:
- ni represents the nith pixel of the pixel in the horizontal direction from the center of the imaging sensor
- nj the njth pixel of the pixel in the vertical direction from the center of the imaging sensor
- disn represents the nth pixel
- Npixelx represents the number of pixels in the horizontal direction in the imaging sensor
- Npixely represents the vertical direction in the imaging sensor
- D indicates the diameter of the main lens
- d indicates the diameter of the microlens
- F indicates the focal length of the main lens
- f indicates the focal length of the microlens.
- the light when the light reaches the imaging sensor through the microlens located at the center of the microlens array, it just covers M*N pixels, and as the position of the microlens is farther away from the position of the center of the microlens array, the light is tilted through the microlens.
- the pixel pitch of the imaging sensor if the pixel pitch of the imaging sensor is constant, light transmitted from a certain microlens at the periphery will be irradiated onto pixels other than the pixel corresponding to the microlens, causing crosstalk between the pixels.
- the above-described design can be made for the distance between each pixel in the imaging sensor.
- the first color filter comprises M*N sub-units arranged in an array; wherein one sub-unit corresponds to a monochromatic filter of one color.
- the monochrome filter described here is a filter implemented by coating, and the color cannot be changed.
- the first color filter is a red, green and blue RGB filter
- the red, green and blue RGB filters comprise M*N subunits corresponding to a green filter, a red filter and a blue A filter, wherein M and N are integers greater than or equal to 2.
- the red, green and blue RGB filters are distributed in a Bayer array. It is possible to avoid crosstalk between pixels caused by multiple colors.
- the first color filter comprises M*N methods arranged in an array a filter of the cavity structure, and the cavity of the filter of the Faber cavity structure is filled with liquid crystal or filled with an electro-optical crystal for changing when the voltage applied to the cavity of the filter of the Fabry-chamber structure changes The color that is filtered out.
- the first color filter is designed by using a Faber cavity structure, so that the color filtered by the filter included in the first color filter can be changed, and the transmission spectrum of the first color filter is changed, thereby being able to be changed.
- the color filtered by the first color filter obtains scene information of different bands to realize multi-spectral imaging.
- the device further includes a first receiving module, a first control module, a first processing module, and a first combining module;
- the first receiving module is configured to acquire a first image capturing instruction of color imaging, where the first image capturing instruction carries an acquiring mode;
- the first control module is configured to send a first adjustment instruction to the first processing module when the acquisition mode is a hyperspectral imaging mode, where the first adjustment instruction is used to indicate that the first processing module changes L times the color filtered by the M*N Fabry-chamber structure filter included in the first color filter; the L is equal to the number of colors that can be filtered by the filter of the Faber cavity structure;
- the first processing module is configured to, after receiving the adjustment instruction, adjust a voltage to change a color filtered by a filter of M*N Faber cavity structures included in the first color filter, and use the After the first control module adjusts, the first color filter acquires one frame image, and adjusts the voltage again to change the color filtered by the filter of the M*N Fabry-chamber structure included in the first color filter until reaching The number of colors that can be filtered by the filter of the Faber cavity structure, thereby obtaining an L frame image; wherein the filtered color of the M*N Fabry-chamber structure filter after each adjustment is different, arbitrary The filtered color of each M*N Faber cavity structure filter in the first color filter after the adjustment is different;
- a first synthesizing module configured to perform processing on the L-frame image by the first processing module to obtain a color image.
- Multispectral imaging can be achieved by the above design.
- the first control module is further configured to:
- the acquiring mode is a red, green, and blue RGB imaging mode
- sending a second adjustment instruction to the first processing module where the second adjustment instruction is used to instruct the first processing module to modify the first color filter
- the color filtered by the filter of the M*N Faber cavity structure included in the slice, and the filtered color of the M*N Faber cavity structure filter includes only red, green and blue;
- the first processing module is further configured to: after receiving the adjustment instruction sent by the first control module, adjust a voltage to filter the filter of the M*N Faber cavity structure included in the first color filter.
- the color, and the filtered color of the adjusted M*N Faber cavity structure filter includes only red, green, and blue; and the first color filter is used to acquire a color image.
- the first color filter is disposed on a rotating structure, and the rotating structure further includes at least one second color filter and a rotating shaft for adjusting by rotating a rotating shaft of the rotating structure
- One of the first color filter and the at least one second color filter is coaxial with the main lens, the microlens array, and the imaging sensor;
- the at least one second color filter and the first color filter comprise the same number and arrangement of monochrome filters, and any two of the first color filter and the at least one second color filter A monochrome filter of the same color is not included in the color filter.
- Multi-spectral imaging can be achieved by the above-described rotational structure design.
- the device further includes a second receiving module, a second control module, a second processing module, and a second combining module;
- the second receiving module is configured to acquire a second image capturing instruction for color imaging, where the second image capturing instruction carries an acquisition mode;
- the second control module is configured to rotate a rotation axis of the rotation structure when the acquisition mode is a hyperspectral imaging mode, and adjust the first color filter and the at least one included in the rotation structure
- One color filter of the second color filter is coaxial with the main lens, the microlens array, and the imaging sensor, and sends a shooting instruction for capturing one frame of image to the second processing module;
- the second processing module is configured to use the one color after receiving the shooting instruction
- the filter acquires a frame image, and sends a completion instruction to the second processing module to complete the image of one frame;
- the second control module is further configured to, when receiving the completion instruction sent by the second processing module, rotate the rotation axis of the rotation structure again, and adjust the first color filter included in the rotation structure and Another color filter of the at least one second color filter is coaxial with the main lens, the microlens array, and the imaging sensor, and transmits a shot for capturing one frame of image to the second processing module again. And instructing, when determining that the L color filters included in the rotation structure are all used, sending a synthesis instruction to the second synthesis module, the synthesis instruction being used to instruct the second synthesis module to perform the second processing
- the L frame image obtained by the module is subjected to fusion processing, and the L is a positive integer greater than 1, thereby acquiring an L frame image;
- the second synthesis module After receiving the synthesis indication sent by the second control module, the second synthesis module performs fusion processing on the L frame image to obtain a color image.
- Multi-spectral color imaging can be achieved by the design of the above-described rotating structure.
- the first color filter is an RGB filter
- the second control module is further configured to rotate a rotation axis of the rotation structure when the acquisition mode is the RGB imaging mode, and adjust the first color filter and the main lens included in the rotation structure And the microlens array and the imaging sensor are coaxial, and send a shooting instruction for capturing one frame of image to the second processing module;
- the second processing module is configured to acquire a color image by using the first color filter after receiving the shooting instruction.
- the embodiment of the present invention further provides a method for acquiring a color image by using an image capturing device, wherein the image capturing device includes the color imaging device of the first aspect, and the first of the color imaging devices
- the color filter is a Faber cavity structure, and the method includes:
- the image acquisition device receives a first image acquisition instruction for acquiring color imaging, and the acquisition mode carried in the first image acquisition instruction is a hyperspectral imaging mode;
- the image capture device adjusts one of the first color filter and the at least one second color filter included in the rotation structure by rotating a rotation axis of the rotation structure and the main lens a microlens array, and an imaging sensor coaxial; and using the one color filter to acquire a frame image; rotating the rotation axis of the rotation structure again, adjusting the first color filter and the Another color filter of the at least one second color filter is coaxial with the main lens, the microlens array, and the imaging sensor until the L color filters included in the rotation structure are used, the L Is a positive integer greater than 1, thereby obtaining an L frame image;
- the image acquisition device performs fusion processing on the L frame image to obtain a color image.
- the size of the color filter is not smaller than the size of the main lens in the corresponding direction in any direction perpendicular to the axis, which is much larger than the size of each unit in the color filter directly processed on the surface of the imaging sensor. Therefore, the processing difficulty of the color filter is greatly reduced. And the color filter no longer needs to be machined onto the imaging sensor.
- the color filter is processed simultaneously with the imaging sensor, and the color filter is modified together with the imaging sensor.
- the color filter is not processed onto the imaging sensor, so when modified, it can be separately modify. And with the above design, it is possible to obtain multi-spectral color images.
- the method further includes:
- the image acquisition device receives a second image acquisition instruction for acquiring color imaging, and the acquisition mode carried in the second image acquisition instruction is a red, green, and blue RGB imaging mode;
- the image capture device adjusts the first color filter to be coaxial with the main lens, the microlens array, and the imaging sensor, and obtains a color image using the first color filter.
- an embodiment of the present invention provides a method for acquiring a color image by using an image capturing device, wherein the image capturing device includes the color imaging device of the first aspect, and the color imaging device includes a first color.
- the filter is disposed on the rotating structure, and the method includes:
- the image acquisition device receives a first image acquisition instruction for acquiring color imaging, and the acquisition mode carried in the first image acquisition instruction is a hyperspectral imaging mode;
- the image acquisition device adjusts a voltage to change a color filtered by the filter of the M*N Faber cavity structure included in the first color filter, and acquires a frame image by using the first color filter, and adjusts again
- the voltage is changed by the color filtered by the filter of the M*N Faber cavity structure included in the first color filter until the number of colors that can be filtered by the filter of the Fabry-chamber structure is obtained, thereby obtaining L a frame image; wherein the filtered color of each adjusted M*N Faber cavity structure filter is different, and each M*N Faber in the first color filter after any two adjustments
- the color filtered by the filter of the cavity structure is different; the L is equal to the number of colors that can be filtered by the filter of the Faber cavity structure;
- the image acquisition device performs fusion processing on the L frame image to obtain a color image.
- the size of the color filter is not smaller than the size of the main lens in the corresponding direction in any direction perpendicular to the axis, which is much larger than the size of each unit in the color filter directly processed on the surface of the imaging sensor. Therefore, the processing difficulty of the color filter is greatly reduced. And the color filter no longer needs to be machined onto the imaging sensor.
- the color filter is processed simultaneously with the imaging sensor, and the color filter is modified together with the imaging sensor.
- the color filter is not processed onto the imaging sensor, so when modified, it can be separately modify. And with the above design, it is possible to obtain multi-spectral color images.
- the method further includes:
- the image acquisition device receives a second image acquisition instruction for acquiring color imaging, and the acquisition mode carried in the second image acquisition instruction is a red, green, and blue RGB imaging mode;
- the image acquisition device adjusts a voltage to filter the color filtered by the filter of the M*N Fabry-chamber structure included in the first color filter, and the adjusted filter of the M*N Faber cavity structure
- the filtered colors include only red, green, and blue;
- the image acquisition device acquires a color image using the first color filter.
- FIG. 1 is a schematic structural view of a color sensor provided by the prior art
- FIG. 2 is a schematic diagram of a color imaging device according to an embodiment of the present invention.
- FIG. 3 is a schematic diagram of another color imaging device according to an embodiment of the present invention.
- FIG. 4 is a schematic cross-sectional view showing a corresponding relationship between a microlens and an imaging sensor according to an embodiment of the present invention
- FIG. 5 is a schematic diagram of a main surface of a corresponding relationship between a microlens and an imaging sensor according to an embodiment of the present invention
- FIG. 6 is a schematic diagram of light offset according to an embodiment of the present invention.
- FIG. 7 is a schematic structural diagram of a first color filter according to an embodiment of the present disclosure.
- FIG. 8A is a schematic diagram of an optical path according to an embodiment of the present invention.
- FIG. 8B is a schematic diagram of color information recorded by an imaging sensor according to an embodiment of the present invention.
- FIG. 9 is a schematic structural diagram of a liquid crystal method according to an embodiment of the present invention.
- FIG. 10 is a schematic diagram of a structure of an electro-optical crystal Faber cavity according to an embodiment of the present invention.
- FIG. 11 is a schematic diagram of still another color imaging device according to an embodiment of the present invention.
- FIG. 12 is a schematic diagram of a rotating structure according to an embodiment of the present invention.
- FIG. 13 is a schematic diagram of color of a color filter in a rotating structure according to an embodiment of the present invention.
- FIG. 14 is a schematic diagram of still another color imaging device according to an embodiment of the present invention.
- FIG. 15 is a flowchart of a method for acquiring a color image by using an image collection device according to an embodiment of the present invention.
- FIG. 16 is a flowchart of another method for acquiring a color image by using an image capturing device according to an embodiment of the present invention.
- FIG. 17 is a flowchart of still another method for acquiring a color image by using an image acquisition device according to an embodiment of the present invention.
- Embodiments of the present invention provide a color imaging apparatus and a method for acquiring a color image, which are used to solve the problem of difficulty in processing a color filter in the prior art.
- the specific application scenario of the embodiment of the present invention may be the same as the traditional CMOS/CCD color imaging sensor, and may be a camera lens or a mobile phone camera or the like that needs to be imaged to obtain a color image.
- the method and the device are based on the same inventive concept. Since the principles of the method and the device for solving the problem are similar, the implementation of the device and the method can be referred to each other, and the repeated description is not repeated.
- the color imaging device includes a main lens, a microlens array, and an imaging sensor sequentially arranged on an optical path; the color imaging device further includes a color filter disposed at an aperture stop of the main lens; the main lens The color filter, the microlens array, and the imaging sensor are parallel and coaxial; the microlens array includes 1 microlens; 1 microlens has the same focal length; the imaging sensor is located at the micro a focal plane of the lens array; the imaging sensor comprising L*M*N pixels, a lens array covering the M*N of the imaging sensor when light reaches the imaging sensor from any one of the microlenses, and light from the L When the microlens reaches the imaging sensor, it covers L*M*N pixels included in the imaging sensor, that is, the imaging sensor includes L M*N pixel arrays, and each M*N pixel array corresponds to one microlens L L* M*N pixel arrays correspond to
- the color filter includes at least one filter capable of filtering out at least one color; a size of the color filter in either direction perpendicular to the axis is not less than a size of the main lens in a corresponding direction.
- the color filter is disposed at the aperture stop of the main lens, and the microlens array is located on the image plane of the main lens, and the light emitted by the scene passes through the main lens and the color filter, and is imaged on the microlens array. After passing through the microlens array, different colors of light reach different pixels of the imaging sensor, thereby enabling Get a color image.
- the size of the color filter is not smaller than the size of the main lens in the corresponding direction in any direction perpendicular to the axis, which is much larger than the size of each unit in the color filter directly processed on the surface of the imaging sensor. Therefore, the processing difficulty of the color filter is greatly reduced. And the color filter no longer needs to be machined onto the imaging sensor.
- the color filter is processed simultaneously with the imaging sensor, and the color filter is modified together with the imaging sensor. In the embodiment of the invention, the color filter is not processed onto the imaging sensor, so when modified, it can be separately modify.
- FIG. 3 exemplifies a case where the main lens includes two single lenses.
- the color image forming apparatus includes a main lens 201, a microlens array 202, and an imaging sensor 203 which are sequentially arranged on an optical path transmission path; the main lens 201 includes a first single lens 201a and a second single lens 201b.
- the main lens may include a plurality of single lenses, which are not specifically limited in the embodiment of the present invention.
- the apparatus also includes a first color filter 204 disposed at an aperture stop of the main lens.
- Two single lenses in the main lens 201, the first color filter 204, the microlens array 202, and the imaging sensor 203 are parallel and coaxial.
- the microlens array 202 includes 1 microlens; the microlens array 202 can be fixed with the imaging sensor 203; wherein, when any one of the microlenses reaches the imaging sensor, the M of the imaging sensor is covered a pixel array of *N, when the light reaches the imaging sensor from the l microlens, covering 1*M*N pixels included in the imaging sensor, that is, the imaging sensor includes 1 M*N pixel array, each One M*N pixel array corresponds to one microlens, and L M*N pixel arrays correspond to one microlens.
- l, M and N are both positive integers.
- one microlens corresponds to a 2*2 pixel array formed by four pixels of the imaging sensor 203.
- the four squares in 4 represent 4 pixels of the imaging sensor 203, and the circle represents a microlens.
- the first color filter 204 includes at least one filter, and the at least one filter can filter at least one color. That is, the filter can be a monochrome filter, which can only filter out one color, and can also be a filter that can transmit light of different colors under different conditions.
- the size of the first color filter 204 in either direction perpendicular to the axis is not less than the size of the main lens 201 in the corresponding direction.
- the size of the first color filter 204 in any direction perpendicular to the axis is not smaller than the size of the main lens 201 in the corresponding direction, that is, the color filter 204 can be completely in the direction perpendicular to the axis.
- the main lens 201 is covered.
- the first color filter 204 has a circular structure in a direction perpendicular to the axis
- the main lens 201 is also a circular structure in a direction perpendicular to the axis
- the diameter of the first color filter 204 is not less than the main lens 201. diameter of.
- the main lens described herein includes a plurality of single lenses, and the size of the main lens is based on the largest single lens.
- the light when the light reaches the imaging sensor through the microlens located at the center of the microlens array, it just covers M*N pixels, and as the position of the microlens is farther away from the position of the center of the microlens array, the light is tilted through the microlens.
- the pixel pitch of the imaging sensor is constant, light transmitted from a certain microlens at the periphery will be irradiated onto pixels other than the pixel corresponding to the microlens, causing crosstalk between the pixels.
- the distance between each pixel in the imaging sensor can be set. Specifically, the distance dis n between each pixel in the imaging sensor and the pixel located at the center of the imaging sensor is:
- n i n i represents the distance of the center pixel of the pixel image sensor in a horizontal direction
- n j n j denotes the distance of the center pixel of the pixels of the imaging sensor in the vertical direction
- dis n a distance representing the pixel of the nth pixel and the center of the imaging sensor, n (n i , n j )
- N pixelx represents the number of pixels in the horizontal direction in the imaging sensor
- N pixely represents The number of pixels in the vertical direction in the imaging sensor
- D represents the diameter of the main lens
- d represents the diameter of the microlens
- F represents the focal length of the main lens
- f represents the focal length of the microlens.
- the present invention designs the pixel pitch on the imaging sensor. Specifically, the position of the center pixel is (0, 0), and the position of the (n i , n j )th pixel is The increase in pixel spacing can simultaneously reduce crosstalk between different pixels within the same sub-image caused by diffraction effects.
- P is the number of microlenses in the horizontal/vertical direction; D is the diameter of the main lens; d is the diameter of the microlens; F is the focal length of the main lens; f is the focal length of the microlens; ⁇ h P is The offset of the outer lens of the main lens after passing through the outermost microlens.
- the first color filter 204 includes M*N sub-units arranged in an array; wherein one sub-unit corresponds to a monochromatic filter of one color.
- the color of any two monochromatic filters may be different or the same, and may include a plurality of colors, and are arranged in any of the M*N subunits, which is not specifically limited in the present invention. That is to say, M*N monochrome filters can include M*N colors.
- the monochrome filter described here is a filter implemented by coating, and the color cannot be changed.
- the first color filter 204 includes the same number of sub-units as the number of pixels corresponding to one microlens.
- the color filter 204 includes not only three colors of RGB, multi-spectral imaging can be obtained, Get scene information from different bands.
- the first color filter 204 may be an RGB filter, and the M*N sub-units included in the RGB filter respectively can record three color information corresponding to the green filter, the red filter, and the blue filter.
- the arrangement of the green filter, the red filter, and the blue filter in the M*N subunits is not specifically limited in this embodiment of the present invention, and may be specifically arranged in an array of Bayer arrays.
- the first color filter 204 is a 2*2 bayer array structure capable of recording three kinds of color information. That is, the color filter 204 includes four sub-units, two sub-units corresponding to green, one sub-unit corresponding to red, and one sub-unit corresponding to blue.
- the first color filter 204 is disposed at the aperture stop of the main lens 201, and the microlens is located at the image plane of the main lens 201. After the light emitted by the scene passes through the main lens 201 and the first color filter 204, the microlens can be imaged. On the array. After passing through the microlens array, the different colored lights are separated and reach different pixels of the imaging sensor 203, as shown in Figure 8A. The color information recorded by the imaging sensor 203 is as shown in FIG. 8B. Since the initial image recorded by the imaging sensor 203 contains only light intensity information, the initial image is only a grayscale image, and the color information needs to be recognized by the pixel position.
- the corresponding four pixels carrying different color information after each microlens may be fused into one pixel, and the four pixels are located in one Bayer array.
- the rendered image is thus capable of recording the original complete color and intensity information.
- the structure of the color filter 204 can be designed in such a manner that the color filtered by the filter included in the first color filter 204 can be changed, and the transmission spectrum of the first color filter 204 changes. Therefore, multi-spectral imaging can be realized by changing the color filtered by the first color filter 204 to obtain scene information of different bands.
- the first color filter 204 includes M*N Faber cavity structure filters arranged in an array, and the cavity of the Faber cavity structure filter is filled with liquid crystal or filled with an electro-optic crystal for The filtered color changes when the voltage applied to both sides of the cavity of the filter of the Faber cavity structure changes.
- the Faber cavity consists of two glass plates that are parallel or have a small wedge angle.
- the opposite inner surfaces of the two glass plates have high reflectivity.
- the change in the spacing of the two mirrors changes the transmission spectrum.
- the two mirrors are the distances of the inner surfaces of the two glass sheets whose inner surface has high reflectivity.
- Spectral transmittance can be expressed as:
- F F represents the fineness of the Faber cavity
- I represents the light intensity of the transmitted light
- I 0 represents the light intensity of the incident light
- m represents the refractive index of the medium
- d d represents the pitch of the two mirrors
- ⁇ represents the incidence of the light.
- Angle, ⁇ represents the wavelength.
- the spectral transmittance of the Faber cavity can be controlled by changing the refractive index of the medium.
- the change in the refractive index of the medium can be achieved by materials having electro-optical effects, such as liquid crystals and electro-optical crystals, whose refractive index changes under the action of an applied electric field.
- FIG. 9 it is a schematic diagram of a liquid crystal cell structure.
- the liquid crystal cell cavity is also filled with liquid crystal in the cavity of the Faber cavity.
- the Faber cavity is in order from the outside to the inside: a glass plate 601, a conductive electrode 602, a liquid crystal molecular guiding layer 603, and a liquid crystal 604.
- the liquid crystal is the innermost layer of the Faber cavity.
- the inner surface of the glass plate 601 has a high reflectance, so that two symmetrical glass plates form a mirror.
- a voltage can be applied to the entire Faber cavity through the conductive electrode 602.
- the liquid crystal is filled inside the Faber cavity.
- the liquid crystal has optical anisotropy, and the refractive index in the long axis direction of the molecule is different from the refractive index in the short axis direction.
- FIG. 10 it is a schematic diagram of the structure of the electro-optical crystal Faber cavity.
- the electro-optical crystal Faber cavity is also filled with an electro-optic crystal in the cavity of the Faber cavity.
- the Faber cavity is in order from the outside to the inside: a glass plate 701, a conductive electrode 702, and an electro-optic crystal 703.
- An electro-optic crystal is a crystalline material having an electrooptic effect.
- the refractive index of the electro-optic crystal changes as the voltage applied to the electro-optic crystal changes.
- the electro-optic crystal material may be occluded potassium dihydrogen phosphate (DKDP), ammonium dihydrogen phosphate (ADP) or the like.
- DKDP potassium dihydrogen phosphate
- ADP ammonium dihydrogen phosphate
- the first color filter 204 is a Faber cavity filter
- the filter 204 when implementing multi-spectral imaging, Take multiple frames of images and change the filter once per frame. That is, change the cavity voltage of the Fabry cavity of the filter. Then take an L frame image.
- L is the total number of spectral channels that can be achieved by the Fabry-Perot filter, ie the number of colors that can be filtered by the Fabry-Perot filter.
- the L frame image is subjected to fusion processing to obtain a multispectral color image.
- the first color filter 204 includes a plurality of filters of a Faber cavity structure.
- the cavity voltage of each Faber cavity is adjusted so that the spectral transmittances of any two Faber cavities are different, so that multi-spectral color images can be obtained without multi-frame imaging.
- multi-frame shooting can also be performed to make the spatial resolution of the obtained multi-spectral color image higher.
- the apparatus further includes a first receiving module 801, a first control module 802, a first processing module 803, and a first synthesis module. 804;
- the first receiving module 801 is configured to acquire a first image capturing instruction for color imaging, where the first image capturing instruction carries an acquisition mode.
- the first control module 802 is configured to send a first adjustment instruction to the first processing module 803 when the acquisition mode is a hyperspectral imaging mode, where the first adjustment instruction is used to indicate the first processing
- the module 803 changes the color filtered by the filter of the M*N Faber cavity structure included in the first color filter 204 for L times; the L is equal to the filter that can be filtered by the filter of the Faber cavity structure. The number of colors.
- the first processing module 803 is configured to: after receiving the adjustment instruction sent by the first control module 802, adjust a voltage to change the M*N Faber cavity structure included in the first color filter 204.
- the color filtered by the filter is adjusted by the first control module 802, and the first color filter 204 acquires a frame image, and the voltage is changed again to change the M*N methods included in the first color filter 204.
- the color filtered by the filter of the cavity structure until the number of colors that can be filtered by the filter of the Faber cavity structure is obtained, thereby obtaining an L frame image; wherein, each adjusted M*N Faber
- the filters filtered by the cavity structure are different in color, and the filters filtered by the M*N Fabry-chamber structures in the first color filter 204 are adjusted differently.
- the first synthesizing module 804 is configured to perform processing on the L frame image by the first processing module 803 to obtain a color image.
- the first control module 802 is further configured to: when identifying the acquisition mode as a red, green, and blue RGB imaging mode, issue a second adjustment instruction to the first processing module 803, where the second adjustment The instruction is used to instruct the first processing module 803 to change the color filtered by the filter of the M*N Faber cavity structure included in the first color filter 204, and the adjusted M*N Fapreo cavity
- the filtered color of the structured filter only includes red, green and blue;
- the first processing module 803 is further configured to: after receiving the adjustment instruction sent by the first control module 802, adjust the voltage to change the filtering of the M*N Faber cavity structure included in the first color filter 204.
- the color filtered by the slice, and the filtered color of the adjusted M*N Faber cavity structure filter includes only red, green, and blue; and the first color filter 204 is used to acquire a color image.
- the first color filter 204 includes a plurality of monochrome filters, that is, the monochrome filter is implemented by coating, the color cannot be changed, and the first color filter 204 may also be disposed on the rotating structure 205.
- the revolving structure 205 further includes at least one second color filter for adjusting one of the first color filter 204 and the at least one second color filter by rotating the rotation structure 205
- the main lens 201, the microlens array 202, and the imaging sensor 203 are coaxial.
- the at least one second color filter and the first color filter 204 include the same number and arrangement of monochrome filters, and any of the first color filter 204 and the at least one second color filter Monochrome filters of the same color are not included in the two color filters.
- the rotation structure 205 includes four color filters.
- Each of the second color filters may include four sub-units, each of which corresponds to a monochromatic filter of one color. It may include 4*4 colors, as shown in Fig. 13, and each numeral in Fig. 13 represents one color.
- the four color filters included in the rotating structure 205 may also be filters of a Faber cavity structure.
- the spectral transmittance of each Faber cavity or the adjustment rotation structure 205 can be adjusted to take multiple frames of images to obtain more spectral image information.
- the device may further include a second receiving module 901, a second control module 902, a second processing module 903, and a second combining module 904, as shown in FIG.
- the second receiving module 901 is configured to acquire a second image capturing instruction of color imaging, where the second image capturing instruction carries an acquiring mode;
- the second control module 902 is configured to rotate a rotation axis of the rotation structure 205 when the acquisition mode is a hyperspectral imaging mode, and adjust the first color filter 204 included in the rotation structure 205 and One of the at least one second color filter is coaxial with the main lens 201, the microlens array 202, and the imaging sensor 203, and is sent to the second processing module 903 for capturing a frame image.
- the second processing module 903 is configured to acquire one frame image by using the one color filter after receiving the shooting instruction, and send a completion instruction for capturing one frame of image to the second processing module 903;
- the second control module 902 is further configured to, when receiving the completion instruction sent by the second processing module 903, rotate the rotation axis of the rotation structure 205 again, and adjust the first portion included in the rotation structure 205.
- the other of the color filter 204 and the at least one second color filter is coaxial with the main lens 201, the microlens array 202, and the imaging sensor 203, and is again directed to the second processing module 903.
- the second synthesis module performs a fusion process on the L frame image captured by the second processing module 903, where L is a positive integer greater than 1, thereby acquiring an L frame image;
- the second synthesis module 904 After receiving the synthesis indication sent by the second control module 902, the second synthesis module 904 performs fusion processing on the L frame image to obtain a color image.
- the second control module 902 is further configured to rotate the rotation of the rotation structure 205 when the acquisition mode is determined to be an RGB imaging mode.
- the first color filter 204 included in the rotation structure 205 is coaxial with the main lens 201, the microlens array 202, and the imaging sensor 203, and is sent to the second processing module 903 for shooting. a shooting instruction for one frame of image;
- the second processing module 903 is configured to acquire a color image by using the first color filter 204 after receiving the shooting instruction.
- the embodiment of the invention further provides a method for acquiring a color image by an image acquisition device, the image acquisition device comprising a color imaging device, wherein the color imaging device adopts the above-mentioned rotation structure.
- the method includes:
- the image collection device receives a first image acquisition instruction for acquiring color imaging, and the first image acquisition instruction carries an acquisition mode of a hyperspectral imaging mode.
- the image acquisition device adjusts one of the first color filter and the at least one second color filter included in the rotation structure by rotating a rotation axis of the rotation structure.
- a main lens, a microlens array, and an imaging sensor are coaxial; and use the one color filter to acquire a frame image; rotating the rotation axis of the rotation structure again to adjust the first color filter included in the rotation structure
- another color filter of the at least one second color filter is coaxial with the main lens, the microlens array, and the imaging sensor until L color filters in the rotating structure are used, Let L be a positive integer greater than 1, thereby acquiring an L frame image.
- the image capturing device performs fusion processing on the L frame image to obtain a color image.
- the method for acquiring a color image by using an image capturing device may include:
- the image collection device receives a first image acquisition instruction for acquiring color imaging, where the first image acquisition instruction carries an acquisition mode.
- the image collection device determines the acquisition mode. When the acquisition mode is the RGB imaging mode, S1204 is performed. When the acquisition mode is the hyperspectral imaging mode, S1203 is performed.
- the image acquisition device adjusts one of the first color filter and the at least one second color filter included in the rotation structure by rotating a rotation axis of the rotation structure a main lens, a microlens array, and an imaging sensor are coaxial; and use the one color filter to acquire a frame image; rotating the rotation axis of the rotation structure again to adjust the first color filter included in the rotation structure And another color filter of the at least one second color filter is coaxial with the main lens, the microlens array, and the imaging sensor until L color filters in the rotating structure are used, Let L be a positive integer greater than 1, thereby acquiring an L frame image. Execute S1205.
- the image capturing device performs a fusion process on the L frame image to obtain a color image.
- the embodiment of the invention further provides a method for acquiring a color image by an image acquisition device, the image acquisition device comprising a color imaging device, wherein the color imaging device adopts the above-mentioned Faber cavity filter.
- the method includes:
- the image collection device receives a first image acquisition instruction for acquiring color imaging, and the acquisition mode carried in the first image acquisition instruction is a hyperspectral imaging mode.
- the image acquisition device adjusts a voltage to change a color filtered by a filter of M*N Faber cavity structures included in the first color filter, and acquires a frame image by using the first color filter. Adjusting the voltage again to change the color filtered by the filter of the M*N Faber cavity structure included in the first color filter until the number of colors that can be filtered by the filter of the Faber cavity structure is reached, thereby Get an L frame image.
- the filtered color of the M*N Faber cavity structure filter after each adjustment is different, and the M*N Fapo cavity structures in the first color filter sheet adjusted any two times are The color filtered by the filter is different; the L is equal to the number of colors that can be filtered by the filter of the Faber cavity structure.
- the image collection device performs fusion processing on the L frame image to obtain a color image.
- the method may further include:
- the image acquisition device receives a second image acquisition instruction for acquiring color imaging, and the acquisition mode carried in the second image acquisition instruction is an RGB imaging mode;
- the image acquisition device adjusts a voltage to filter the color filtered by the filter of the M*N Fabry-chamber structure included in the first color filter, and the adjusted filter of the M*N Faber cavity structure
- the filtered colors include only red, green, and blue;
- the image acquisition device acquires a color image using the first color filter.
- embodiments of the present invention can be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment, or a combination of software and hardware. Moreover, the invention can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) including computer usable program code.
- computer-usable storage media including but not limited to disk storage, CD-ROM, optical storage, etc.
- the computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture comprising the instruction device.
- the apparatus implements the functions specified in one or more blocks of a flow or a flow and/or block diagram of the flowchart.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- Spectroscopy & Molecular Physics (AREA)
- Color Television Image Signal Generators (AREA)
Abstract
本发明实施例提供一种彩色成像装置以及获取彩色图像的方法,用以解决对彩色滤波片加工难度较大的问题。彩色成像装置包括在光路传输路径上依次排列的主透镜,微透镜阵列,以及成像传感器;装置还包括设置于主透镜的孔径光阑处的第一彩色滤波片;主透镜,第一彩色滤波片,微透镜阵列,以及成像传感器平行且共轴;成像传感器位于微透镜阵列的焦点处;其中,光从一个微透镜到达成像传感器时覆盖成像传感器的M*N的像素阵列;第一彩色滤波片包括至少一个能够过滤出至少一个颜色的滤波片;第一彩色滤波片在垂直于轴线的任一方向上的尺寸不小于主透镜在对应方向上的尺寸。
Description
本申请要求在2016年02月29日提交中国专利局、申请号为201610112996.4、发明名称为“一种彩色成像装置以及获取彩色图像的方法”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
本发明实施例涉及图像处理技术领域,尤其涉及一种彩色成像装置以及获取彩色图像的方法。
彩色成像技术目前已经普遍应用于数码相机、手机等设备。彩色成像传感器中包括只能捕获灰度图像的成像传感器。成像传感器通过将入射光信号转换为电信号,可以记录下光强信息,由于成像传感器捕获的只是灰度图像,无法感受颜色。因此为了获得彩色照片,技术人员通过在成像传感器上覆盖彩色滤波片来区分不同的色彩。因此,如图1所示,传统的彩色成像传感器包括微透镜阵列、彩色滤波片以及成像传感器,并且三者是制作在一起的。
目前普遍采用的彩色滤波片为红(英文:red,简称R)绿(英文:Green,简称:G)蓝(英文:blue,简称:B)滤波片,通过多个拜耳(Bayer)阵列实现。每个Bayer阵列呈2*2矩阵排列,包括4个子单元,4个子单元分别为2个绿色滤波片,1个红色滤波片和1个蓝色滤波片。每一个颜色的滤波片对应成像传感器上的一个像素,从而使的该像素能够对相应的颜色感光,这样每个像素记录红绿蓝三色中的一种颜色信息,再通过色彩空间插值法进行处理,即可获得彩色图像。
由于在彩色成像传感器制作时,彩色滤波片中一个子单元大小与成像传感器的一个像素尺寸相当,需要将彩色滤波片的每个子单元精确对应到成像传感器的每一个像素,因而彩色滤波片的结构精细,彩色滤波片的配准也存
在较大的难度,加工过程比较复杂。彩色成像传感器的成像面积越大,像素尺寸越小,加工的难度就越大。
发明内容
本发明实施例提供一种彩色成像装置以及获取彩色图像的方法,用以解决现有技术中存在的对彩色滤波片加工难度大的问题。
第一方面,本发明实施例提供了一种彩色成像装置,包括在光路传输路径上依次排列的主透镜,微透镜阵列,以及成像传感器;所述主透镜包括至少两个共轴且位置相对固定的单透镜;所述装置还包括设置于所述主透镜的孔径光阑处的第一彩色滤波片;所述主透镜,所述第一彩色滤波片,所述微透镜阵列,以及所述成像传感器平行且共轴;所述微透镜阵列包括l个微透镜;所述成像传感器位于所述微透镜阵列的焦平面;其中,所述成像传感器包括l*M*N个像素,光从任意一个微透镜到达所述成像传感器时覆盖所述成像传感器的M*N的像素阵列,且光从所述l个微透镜到达所述成像传感器时覆盖所述成像传感器包括的l*M*N个像素;其中,l、M和N均为正整数;所述第一彩色滤波片包括至少一个能够过滤出至少一种颜色的滤波片;所述第一彩色滤波片在垂直于轴线的任一方向上的尺寸不小于所述主透镜在对应方向上的尺寸。
彩色滤波片设置于主透镜的孔径光阑处,微透镜阵列位于主透镜的像平面,场景发出的光线经过主透镜和彩色滤波片后,成像在微透镜阵列上。经过微透镜阵列后,不同颜色的光线到达成像传感器的不同像素上,从而能够得到彩色图像。本发明实施例中彩色滤波片的尺寸在垂直于轴线的任一方向上不小于所述主透镜在对应方向上的尺寸,远大于直接加工在成像传感器表面的彩色滤波片中每个单元的尺寸,因此大大降低了彩色滤波片的加工难度。并且彩色滤波片不再需要加工到成像传感器上。现有技术中彩色滤波片与成像传感器同时加工产生的,一旦修改彩色滤波片就连带成像传感器一起修改,本发明实施例中彩色滤波片并不要加工到成像传感器上,因此在修改时,可
以单独修改。
在一种可能的设计中,所述成像传感器中各个像素与位于所述成像传感器的中心的像素的距离disn为:
其中,ni表示在水平方向上距离所述成像传感器的中心的像素的第ni个像素;nj表示在垂直方向上距离所述成像传感器的中心的像素的第nj个像素;disn表示所述第n个像素与所述成像传感器的中心的像素的距离,n=(ni,nj);Npixelx表示所述成像传感器中的水平方向上的像素个数;Npixely表示所述成像传感器中的垂直方向上的像素个数;D表示所述主透镜的直径;d表示所述微透镜的直径;F表示所述主透镜的焦距;f表示所述微透镜的焦距。
其中,光通过位于位于微透镜阵列中心的微透镜到达成像传感器时,刚好覆盖M*N个像素,随着微透镜的位置距离微透镜阵列中心的位置偏离越远,光经过微透镜会发生倾斜,尤其是在外围时,如果成像传感器的像素间距不变,从处于外围的某个微透镜透射的光会照射到该微透镜对应的像素之外的像素上,引起像素间的串扰。为了防止像素之间出现串扰,可以对所述成像传感器中的各个像素之间的距离进行上述设计。
在一种可能的设计中,所述第一彩色滤波片包括以阵列排列的M*N个子单元;其中,一个子单元对应一种颜色的单色滤波片。
这里所述的单色滤波片是以镀膜实现的滤波片,颜色不能更改。
在一种可能的设计中,所述第一彩色滤波片为红绿蓝RGB滤波片,所述红绿蓝RGB滤波片包括的M*N个子单元分别对应绿色滤波片、红色滤波片以及蓝色滤波片,其中,M和N均为大于等于2的整数。
在一种可能的设计中,所述红绿蓝RGB滤波片呈Bayer阵列分布。能够避免多种颜色带来的像素间的串扰。
在一种可能的设计中,所述第一彩色滤波片包括以阵列排列的M*N个法
珀腔结构的滤波片,且法珀腔结构的滤波片的腔体内填充为液晶或者填充为电光晶体,用于在施加于法珀腔结构的滤波片的腔体的两侧电压变化时,变化所过滤出的颜色。
通过上述设计,将第一彩色滤波片采用法珀腔结构设计,使得第一彩色滤波片包括的滤波片所过滤出的颜色可以变化,第一彩色滤波片的透射光谱发生变化,从而能够通过改变第一彩色滤波片所过滤出的颜色获得不同波段的场景信息,实现多光谱成像。
在一种可能的设计中,所述装置还包括第一接收模块、第一控制模块、第一处理模块以及第一合成模块;
所述第一接收模块,用于获取彩色成像的第一图像采集指令,所述第一图像采集指令携带采集模式;
所述第一控制模块,用于识别所述采集模式为高光谱成像模式时,向所述第一处理模块发出第一调节指令,所述第一调节指令用于指示所述第一处理模块更改L次所述第一彩色滤波片包括的M*N个法珀腔结构的滤波片所过滤出的颜色;所述L等于所述法珀腔结构的滤波片所能过滤出的颜色数量;
所述第一处理模块,用于在接收到所述调节指令后,调节电压更改所述第一彩色滤波片包括的M*N个法珀腔结构的滤波片所过滤出的颜色,使用所述第一控制模块调节后所述第一彩色滤波片获取一帧图像,再次调节电压更改所述第一彩色滤波片包括的M*N个法珀腔结构的滤波片所过滤出的颜色,直到达到所述法珀腔结构的滤波片所能过滤出的颜色数量,从而获取L帧图像;其中,每次调节后的M*N个法珀腔结构的滤波片所过滤出的颜色不相同,任意两次调节后的所述第一彩色滤波片中各M*N个法珀腔结构的滤波片所过滤出的颜色均不相同;
第一合成模块,用于对所述第一处理模块处理得到所述L帧图像进行融合处理得到彩色图像。
通过上述设计能够实现多光谱成像。
在一种可能的设计中,所述第一控制模块,还用于:
在识别所述采集模式为红绿蓝RGB成像模式时,向所述第一处理模块发出第二调节指令,所述第二调节指令用于指示所述第一处理模块更改所述第一彩色滤波片包括的M*N个法珀腔结构的滤波片所过滤出的颜色,且调节后的M*N个法珀腔结构的滤波片所过滤出的颜色仅包括红色、绿色和蓝色;
所述第一处理模块,还用于在接收到所述第一控制模块发送的调节指令后,调节电压更改所述第一彩色滤波片包括的M*N个法珀腔结构的滤波片所过滤出的颜色,且调节后的M*N个法珀腔结构的滤波片所过滤出的颜色仅包括红色、绿色和蓝色;并使用所述第一彩色滤波片获取彩色图像。
通过上述设计,能够在多光谱成像以及普通成像中自由切换。
在一种可能的设计中,所述第一彩色滤波片设置于轮转结构,所述轮转结构还包括至少一个第二彩色滤波片以及旋转轴,用于通过旋转所述轮转结构的旋转轴,调节所述第一彩色滤波片和所述至少一个第二彩色滤波片中的一个彩色滤波片与所述主透镜,微透镜阵列,以及成像传感器共轴;
所述至少一个第二彩色滤波片与所述第一彩色滤波片包括的单色滤波片数量和排列方式相同,所述第一彩色滤波片和所述至少一个第二彩色滤波片中任意两个彩色滤波片中不包括颜色相同的单色滤波片。
通过上述轮转结构设计,能够实现多光谱成像。
在一种可能的设计中,所述装置还包括第二接收模块,第二控制模块、第二处理模块以及第二合成模块;
所述第二接收模块,用于获取彩色成像的第二图像采集指令,所述第二图像采集指令携带采集模式;
所述第二控制模块,用于在识别所述采集模式为高光谱成像模式时,旋转所述轮转结构的旋转轴,调节所述轮转结构包括的所述第一彩色滤波片和所述至少一个第二彩色滤波片中的一个彩色滤波片与所述主透镜、微透镜阵列、以及成像传感器共轴,并向所述第二处理模块发送用于拍摄一帧图像的拍摄指令;
所述第二处理模块,用于在接收到所述拍摄指令后,使用所述一个彩色
滤波片获取一帧图像,并向所述第二处理模块发送拍摄完成一帧图像的完成指令;
所述第二控制模块,还用于在接收到所述第二处理模块发送的完成指令时,再次旋转所述轮转结构的旋转轴,调节所述轮转结构包括的所述第一彩色滤波片和所述至少一个第二彩色滤波片中的另一个彩色滤波片与所述主透镜、微透镜阵列、以及成像传感器共轴,并再次向所述第二处理模块发送用于拍摄一帧图像的拍摄指令;在确定所述轮转结构包括的L个彩色滤波片均被使用时,向所述第二合成模块发送合成指令,所述合成指令用于指示所述第二合成模块对所述第二处理模块拍摄得到的L帧图像进行融合处理,所述L为大于1的正整数,从而获取L帧图像;
所述第二合成模块在接收到所述第二控制模块发送的合成指示后,对所述L帧图像进行融合处理得到彩色图像。
通过上述轮转结构的设计,能够实现多光谱彩色成像。
在一种可能的设计中,所述第一彩色滤波片为RGB滤波片;
所述第二控制模块,还用于在识别所述采集模式为RGB成像模式时,旋转所述轮转结构的旋转轴,调节所述轮转结构包括的所述第一彩色滤波片与所述主透镜、微透镜阵列、以及成像传感器共轴,并向所述第二处理模块发送用于拍摄一帧图像的拍摄指令;
所述第二处理模块,用于在接收到所述拍摄指令后,使用所述第一彩色滤波片获取彩色图像。
通过上述设计,可以在需要拍摄普通彩色图像以及多光谱彩色图像中切换。
第二方面,本发明实施例还提供了一种通过图像采集设备获取彩色图像的方法,其特征在于,所述图像采集设备包括第一方面所述彩色成像装置,且彩色成像装置中的第一彩色滤波片为法珀腔结构,所述方法包括:
所述图像采集设备接收获取彩色成像的第一图像采集指令,所述第一图像采集指令中携带的采集模式为高光谱成像模式;
所述图像采集设备通过旋转所述轮转结构的旋转轴,调节所述轮转结构包括的所述第一彩色滤波片和所述至少一个第二彩色滤波片中的一个彩色滤波片与所述主透镜、微透镜阵列、以及成像传感器共轴;并使用所述一个彩色滤波片获取一帧图像;再次旋转所述轮转结构的旋转轴,调节所述轮转结构包括的所述第一彩色滤波片和所述至少一个第二彩色滤波片中的另一个彩色滤波片与所述主透镜、微透镜阵列、以及成像传感器共轴,直到所述轮转结构包括的L个彩色滤波片均被使用,所述L为大于1的正整数,从而获取L帧图像;
所述图像采集设备对所述L帧图像进行融合处理得到彩色图像。
本发明实施例中彩色滤波片的尺寸在垂直于轴线的任一方向上不小于所述主透镜在对应方向上的尺寸,远大于直接加工在成像传感器表面的彩色滤波片中每个单元的尺寸,因此大大降低了彩色滤波片的加工难度。并且彩色滤波片不再需要加工到成像传感器上。现有技术中彩色滤波片与成像传感器同时加工产生的,一旦修改彩色滤波片就连带成像传感器一起修改,本发明实施例中彩色滤波片并不要加工到成像传感器上,因此在修改时,可以单独修改。并且同过上述设计能够实现获取多光谱彩色图像。
在一种可能的设计中,当所述第一彩色滤波片为RGB滤波片时,所述方法还包括:
所述图像采集设备接收获取彩色成像的第二图像采集指令,所述第二图像采集指令中携带的采集模式为红绿蓝RGB成像模式;
所述图像采集设备调节所述第一彩色滤波片与所述主透镜、微透镜阵列、以及成像传感器共轴,并使用所述第一彩色滤波片获得彩色图像。
第三方面,本发明实施例提供了一种通过图像采集设备获取彩色图像的方法,其特征在于,所述图像采集设备包括第一方面的彩色成像装置,所述彩色成像装置包括的第一彩色滤波片设置于轮转结构,所述方法包括:
所述图像采集设备接收获取彩色成像的第一图像采集指令,所述第一图像采集指令中携带的采集模式为高光谱成像模式;
所述图像采集设备调节电压更改所述第一彩色滤波片包括的M*N个法珀腔结构的滤波片所过滤出的颜色,并使用所述第一彩色滤波片获取一帧图像,再次调节电压更改所述第一彩色滤波片包括的M*N个法珀腔结构的滤波片所过滤出的颜色,直到达到所述法珀腔结构的滤波片所能过滤出的颜色数量,从而获取L帧图像;其中,每次调节后的M*N个法珀腔结构的滤波片所过滤出的颜色不相同,任意两次调节后的所述第一彩色滤波片中各M*N个法珀腔结构的滤波片所过滤出的颜色均不相同;所述L等于所述法珀腔结构的滤波片所能过滤出的颜色数量;
所述图像采集设备对所述L帧图像进行融合处理得到彩色图像。
本发明实施例中彩色滤波片的尺寸在垂直于轴线的任一方向上不小于所述主透镜在对应方向上的尺寸,远大于直接加工在成像传感器表面的彩色滤波片中每个单元的尺寸,因此大大降低了彩色滤波片的加工难度。并且彩色滤波片不再需要加工到成像传感器上。现有技术中彩色滤波片与成像传感器同时加工产生的,一旦修改彩色滤波片就连带成像传感器一起修改,本发明实施例中彩色滤波片并不要加工到成像传感器上,因此在修改时,可以单独修改。并且同过上述设计能够实现获取多光谱彩色图像。
在一种可能的设计中,所述方法还包括:
所述图像采集设备接收获取彩色成像的第二图像采集指令,所述第二图像采集指令中携带的采集模式为红绿蓝RGB成像模式;
所述图像采集设备调节电压更改所述第一彩色滤波片包括的M*N个法珀腔结构的滤波片所过滤出的颜色,且调节后的M*N个法珀腔结构的滤波片所过滤出的颜色仅包括红色、绿色和蓝色;
所述图像采集设备使用所述第一彩色滤波片获取彩色图像。
通过上述实现方式,可以在需要拍摄普通彩色图像以及多光谱彩色图像中切换。
图1为现有技术提供的彩色传感器结构示意图;
图2为本发明实施例提供的一种彩色成像装置示意图;
图3为本发明实施例提供的另一种彩色成像装置示意图;
图4为本发明实施例提供的微透镜与成像传感器对应关系剖面示意图;
图5为本发明实施例提供的微透镜与成像传感器对应关系主面示意图;
图6为本发明实施例提供的光线偏移示意图;
图7为本发明实施例提供的第一彩色滤波片结构示意图;
图8A为本发明实施例提供的光路示意图;
图8B为本发明实施例提供的成像传感器记录的颜色信息示意图;
图9为本发明实施例提供的液晶法珀腔结构示意图;
图10为本发明实施例提供的电光晶体法珀腔结构示意图;
图11为本发明实施例提供的又一种彩色成像装置示意图;
图12为本发明实施例提供的轮转结构示意图;
图13为本发明实施例提供的轮转结构中彩色滤波片颜色示意图;
图14为本发明实施例提供的再一种彩色成像装置示意图;
图15为本发明实施例提供的一种通过图像采集设备获取彩色图像的方法流程图;
图16为本发明实施例提供的另一种通过图像采集设备获取彩色图像的方法流程图;
图17为本发明实施例提供的又一种通过图像采集设备获取彩色图像的方法流程图。
为了使本发明的目的、技术方案和优点更加清楚,下面将结合附图对本发明作进一步地详细描述,显然,所描述的实施例仅仅是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其它实施例,都属于本发明保护的
范围。
本发明实施例提供一种彩色成像装置以及获取彩色图像的方法,用以解决现有技术中存在的对彩色滤波片加工难度大问题。本发明实施例具体应用场景可以与传统的CMOS/CCD彩色成像传感器相同,具体可以是相机的镜头或者手机摄像头等等需要成像的设备上,来获取彩色图像。其中,方法和装置是基于同一发明构思的,由于方法及装置解决问题的原理相似,因此装置与方法的实施可以相互参见,重复之处不再赘述。
需要说明的是,本发明实施例的说明书和权利要求书及附图中涉及的术语“第一”、“第二”等是用于区别类似的对象,而不必用于描述特定的顺序或先后次序。
参见图2,为本发明实施例提供的一种彩色成像装置示意图。彩色成像装置中包括在光路传输路径上依次排列的主透镜,微透镜阵列,以及成像传感器;该彩色成像装置还包括设置于所述主透镜的孔径光阑处的彩色滤波片;所述主透镜,所述彩色滤波片,所述微透镜阵列,以及所述成像传感器平行且共轴;所述微透镜阵列包括l个微透镜;l个微透镜的焦距相同;所述成像传感器位于所述微透镜阵列的焦平面;所述成像传感器包括L*M*N个像素,光从任意一个微透镜到达所述成像传感器时覆盖所述成像传感器的M*N的像素阵列,且光从所述L个微透镜到达所述成像传感器时覆盖所述成像传感器包括的L*M*N个像素,即成像传感器器包括L个M*N的像素阵列,每个M*N的像素阵列对应一个微透镜,L个M*N的像素阵列对应L个微透镜。其中,L、M和N均为正整数。
所述彩色滤波片包括至少一个能够过滤出至少一种颜色的滤波片;所述彩色滤波片在垂直于轴线的任一方向上的尺寸不小于所述主透镜在对应方向上的尺寸。
彩色滤波片设置于主透镜的孔径光阑处,微透镜阵列位于主透镜的像平面,场景发出的光线经过主透镜和彩色滤波片后,成像在微透镜阵列上。经过微透镜阵列后,不同颜色的光线到达成像传感器的不同像素上,从而能够
得到彩色图像。本发明实施例中彩色滤波片的尺寸在垂直于轴线的任一方向上不小于所述主透镜在对应方向上的尺寸,远大于直接加工在成像传感器表面的彩色滤波片中每个单元的尺寸,因此大大降低了彩色滤波片的加工难度。并且彩色滤波片不再需要加工到成像传感器上。现有技术中彩色滤波片与成像传感器同时加工产生的,一旦修改彩色滤波片就连带成像传感器一起修改,本发明实施例中彩色滤波片并不要加工到成像传感器上,因此在修改时,可以单独修改。
参见图3,为本发明实施例提供的一种彩色成像装置。图3以主透镜包括两个单透镜为例。彩色成像装置中包括在光路传输路径上依次排列的主透镜201,微透镜阵列202,以及成像传感器203;所述主透镜201包括第一单透镜201a和第二单透镜201b。当然主透镜可以包括多个单透镜,本发明实施例对此不作具体限定。所述装置还包括设置于所述主透镜的孔径光阑处的第一彩色滤波片204。
所述主透镜201中的两个单透镜,所述第一彩色滤波片204,所述微透镜阵列202,以及所述成像传感器203平行且共轴。
所述微透镜阵列202包括l个微透镜;所述微透镜阵列202可以与所述成像传感器203固定在一起;其中,光从任意一个微透镜到达所述成像传感器时覆盖所述成像传感器的M*N的像素阵列,光从所述l个微透镜到达所述成像传感器时覆盖所述成像传感器包括的l*M*N个像素,即成像传感器器包括l个M*N的像素阵列,每个M*N的像素阵列对应一个微透镜,L个M*N的像素阵列对应l个微透镜。其中,l、M和N均为正整数。
如图4所示的剖面图以及图5所示的主面图,以M=N=2为例,一个微透镜对应于所述成像传感器203的4个像素形成的2*2像素阵列,图4中的4个正方形表示成像传感器203的4个像素,圆形表示一个微透镜。
所述第一彩色滤波片204包括至少一个滤波片,该至少一个滤波片至少能过滤出至少一种颜色。即滤波片可以是单色滤波片,仅能过滤出一种颜色,还可以是不同条件下能透射不同颜色的光的滤波片。
所述第一彩色滤波片204在垂直于轴线的任一方向上的尺寸不小于所述主透镜201在对应方向上的尺寸。
其中,所述第一彩色滤波片204在垂直于轴线的任一方向上的尺寸不小于所述主透镜201在对应方向上的尺寸,也就是说在垂直于轴线的方向上彩色滤波片204能够完全覆盖主透镜201。例如,在垂直于轴线的方向上第一彩色滤波片204为圆形结构,在垂直于轴线的方向上主透镜201也为圆形结构,则第一彩色滤波片204的直径不小于主透镜201的直径。这里所述的主透镜包括多个单透镜,且主透镜的尺寸以最大的单透镜为准。
其中,光通过位于位于微透镜阵列中心的微透镜到达成像传感器时,刚好覆盖M*N个像素,随着微透镜的位置距离微透镜阵列中心的位置偏离越远,光经过微透镜会发生倾斜,尤其是在外围时,如果成像传感器的像素间距不变,从处于外围的某个微透镜透射的光会照射到该微透镜对应的像素之外的像素上,引起像素间的串扰。
为了防止像素之间出现串扰,可以对所述成像传感器中的各个像素之间的距离进行设置。具体设置为:所述成像传感器中各个像素与位于所述成像传感器的中心的像素的距离disn为:
其中,ni表示在水平方向上距离所述成像传感器的中心的像素的第ni个像素;nj表示在垂直方向上距离所述成像传感器的中心的像素的第nj个像素;disn表示所述第n个像素与所述成像传感器的中心的像素的距离,n=(ni,nj);Npixelx表示所述成像传感器中的水平方向上的像素个数;Npixely表示所述成像传感器中的垂直方向上的像素个数;D表示所述主透镜的直径;d表示所述微透镜的直径;F表示所述主透镜的焦距;f表示所述微透镜的焦距。
上述公式通过如下方式计算得到:
为解决光线经过微透镜发生偏移而产生的串扰,本发明将对成像传感器
上的像素间距进行设计。具体来说,设中心像素的位置为(0,0),第(ni,nj)个像素的位置为像素间隔的增大同时可以减小由衍射效应造成的同一个子图像内不同像素间的串扰。
根据几何关系可以求出在以图像中心为中心的坐标轴上,外围光线经过最外侧的微透镜后的偏移量:
其中,P为水平/垂直方向上微透镜的个数;D为主透镜的直径;d为微透镜的直径;F表示所述主透镜的焦距;f表示所述微透镜的焦距;ΔhP为主透镜外围光线经过最外侧微透镜后的偏移量。
每个微透镜相应的外围光线偏移量为,如图6所示:
可选地,第一彩色滤波片204包括以阵列排列的M*N个子单元;其中,一个子单元对应一种颜色的单色滤波片。任意两个单色滤波片的颜色可以不同,也可以相同,并且可以包括多个颜色,在M*N个子单元中任意排列,本发明对此不作具体限定。也就说M*N个单色滤波片可以包括M*N个颜色。这里所述的单色滤波片是以镀膜实现的滤波片,颜色不能更改。
这里第一彩色滤波片204包括的子单元数与一个微透镜对应的像素数相同。当彩色滤波片204中不仅仅包括RGB三种颜色时,能够获得多光谱成像,
得到不同波段的场景信息。
可选地,第一彩色滤波片204可以是RGB滤波片,所述RGB滤波片包括的M*N个子单元分别对应绿色滤波片、红色滤波片以及蓝色滤波片能够记录三种颜色信息。绿色滤波片、红色滤波片以及蓝色滤波片在M*N个子单元排列方式本发明实施例对此不作具体限定,具体可以以Bayer阵列的排列方式来排列。
例如,如图7所示,M=N=2,第一彩色滤波片204为2*2的bayer阵列结构,能够记录三种颜色信息。即彩色滤波片204包括4个子单元,两个子单元对应绿色,一个子单元对应红色,一个子单元对应蓝色。
第一彩色滤波片204设置于主透镜201的孔径光阑处,微透镜位于主透镜201的像平面,场景发出的光线经过主透镜201和第一彩色滤波片204后,正好能够成像在微透镜阵列上。经过微透镜阵列后,不同颜色的光线分开,到达成像传感器203的不同像素上,如图8A所示。成像传感器203记录的颜色信息如图8B所示,由于成像传感器203记录的初始图像只包含光强信息,初始图像仅是灰度图,颜色信息需要通过像素位置来辨识。
在后续根据成像传感器203上携带的颜色信息处理得到彩色图像时,可以通过如下方式实现:
可以在每个微透镜后对应的4个携带不同颜色信息的像素融合为一个像素,并且该4个像素位于一个Bayer阵列中。从而所呈现的图像能够记录原始的完整的颜色和强度信息。
可选地,本发明实施例还可以对彩色滤波片204的结构进行设计,使得第一彩色滤波片204包括的滤波片所过滤出的颜色可以变化,第一彩色滤波片204的透射光谱发生变化,从而能够通过改变第一彩色滤波片204所过滤出的颜色获得不同波段的场景信息,实现多光谱成像。具体的,所述第一彩色滤波片204包括以阵列排列的M*N个法珀腔结构的滤波片,且法珀腔结构的滤波片的腔体内填充为液晶或者填充为电光晶体,用于在施加于法珀腔结构的滤波片的腔体的两侧电压变化时,变化所过滤出的颜色。
法珀腔是由两块平行或者呈较小楔角的两块玻璃板组成,两块玻璃板相对的内表面具有高反射率。当入射光的频率满足共振条件时,其透射频谱会出现很高的峰值,对应着很高的透射率。两个反射镜间距的变化改变透射光谱。两个反射镜为内表面具有高反射率的两块玻璃板的内表面的距离。
光谱透射率可以表示为:
其中FF表示法珀腔的精细度,I表示透射光的光强度,I0表示入射光的光强度,m表示介质的折射率,dd表示两个反射镜的间距,θ表示光线的入射角,λ表示波长。本发明实施例中可以通过改变介质的折射率对法珀腔的光谱透射率进行控制。介质的折射率的改变可以通过具有电光效应的材料来实现,如液晶和电光晶体,该材料的折射率会在外加电场的作用下发生变化。
如图9所示,为液晶法珀腔结构示意图。液晶法珀腔也就是法珀腔的腔体内填充为液晶。法珀腔中由外向内依次分别为:玻璃板601、导电电极602、液晶分子导向层603、液晶604。液晶为法珀腔的最内层。其中,玻璃板601的内表面具有高反射率,从而对称的两块玻璃板形成了反射镜。通过导电电极602可以向整个法珀腔施加电压。在法珀腔内部填充液晶。液晶具有光学各向异性,沿分子长轴方向上的折射率不同于短轴方向上的折射率。在导电电极602上施加电压后,在两块导电电极之间形成电场,在电场作用下,液晶分子会发生偏转,从而折射率会发生相应的变化。
如图10所示,为电光晶体法珀腔结构示意图。电光晶体法珀腔也就是法珀腔的腔体内填充为电光晶体。法珀腔中由外向内依次分别为:玻璃板701、导电电极702、电光晶体703。电光晶体是具有电光效应的晶体材料。随着加载到电光晶体上的电压的变化,电光晶体的折射率发生变化。电光晶体材料可以为氛化磷二氢钾(DKDP)、磷酸二氢铵(ADP)等等。
当第一彩色滤波片204为一个法珀腔滤波片时,在实现多光谱成像时,
拍摄多帧图像,每拍摄一帧更改一次滤波片。即更改滤波片的法珀腔的腔体电压。然后拍摄L帧图像。L为该法珀腔滤波片的能够实现的总的光谱通道数,即所述法珀腔滤波片所能过滤出的颜色数量。对L帧图像进行融合处理从而得到多光谱彩色图像。
第一彩色滤波片204包括多个法珀腔结构的滤波片。调节各个法珀腔的腔体电压,使得任意两个法珀腔的光谱透射率不相同,从而不需要多帧拍摄既能够获得多光谱彩色图像。当然也可以进行多帧拍摄使得得到的多光谱彩色图像空间分辨率更高。
在第一彩色滤波片204为法珀腔结构的滤波片时,如图11所示,所述装置还包括第一接收模块801、第一控制模块802、第一处理模块803以及第一合成模块804;
所述第一接收模块801,用于获取彩色成像的第一图像采集指令,所述第一图像采集指令携带采集模式。
所述第一控制模块802,用于识别所述采集模式为高光谱成像模式时,向所述第一处理模块803发出第一调节指令,所述第一调节指令用于指示所述第一处理模块803更改L次所述第一彩色滤波片204包括的M*N个法珀腔结构的滤波片所过滤出的颜色;所述L等于所述法珀腔结构的滤波片所能过滤出的颜色数量。
所述第一处理模块803,用于在接收到所述第一控制模块802发送的所述调节指令后,调节电压更改所述第一彩色滤波片204包括的M*N个法珀腔结构的滤波片所过滤出的颜色,使用所述第一控制模块802调节后所述第一彩色滤波片204获取一帧图像,再次调节电压更改所述第一彩色滤波片204包括的M*N个法珀腔结构的滤波片所过滤出的颜色,直到达到所述法珀腔结构的滤波片所能过滤出的颜色数量,从而获取L帧图像;其中,每次调节后的M*N个法珀腔结构的滤波片所过滤出的颜色不相同,任意两次调节后的所述第一彩色滤波片204中各M*N个法珀腔结构的滤波片所过滤出的颜色均不相同。
所述第一合成模块804,用于对所述第一处理模块803处理得到所述L帧图像进行融合处理得到彩色图像。
可选地,所述第一控制模块802,还可以用于在识别所述采集模式为红绿蓝RGB成像模式时,向所述第一处理模块803发出第二调节指令,所述第二调节指令用于指示所述第一处理模块803更改所述第一彩色滤波片204包括的M*N个法珀腔结构的滤波片所过滤出的颜色,且调节后的M*N个法珀腔结构的滤波片所过滤出的颜色仅包括红色、绿色和蓝色;
所述第一处理模块803,还用于在接收到所述第一控制模块802发送的调节指令后,调节电压更改所述第一彩色滤波片204包括的M*N个法珀腔结构的滤波片所过滤出的颜色,且调节后的M*N个法珀腔结构的滤波片所过滤出的颜色仅包括红色、绿色和蓝色;并使用所述第一彩色滤波片204获取彩色图像。
可选地,当第一彩色滤波片204包括多个单色滤波片时,即单色滤波片通过镀膜实现,不能更改颜色,所述第一彩色滤波片204还可以设置于轮转结构205,所述轮转结构205还包括至少一个第二彩色滤波片,用于通过旋转所述轮转结构205调节所述第一彩色滤波片204和所述至少一个第二彩色滤波片中的一个彩色滤波片与所述主透镜201,微透镜阵列202,以及成像传感器203共轴。
所述至少一个第二彩色滤波片与所述第一彩色滤波片204包括的单色滤波片数量和排列方式相同,所述第一彩色滤波片204和所述至少一个第二彩色滤波片中任意两个彩色滤波片中不包括颜色相同的单色滤波片。
例如:如图12所示,轮转结构205中包括4个彩色滤波片。每个第二彩色滤波片可以包括4个子单元,每个子单元对应一个颜色的单色滤波片。可以包括4*4种颜色,如图13所示,图13中每个数字表示一种颜色。当然还可以设置4个第二彩色滤波片中包括一个RGB滤波片。可以在不需要多光谱成像时,采用RGB滤波片获得彩色图像。
通过上述实现方式,可以在需要拍摄普通彩色图像以及多光谱彩色图像
中切换。
当然,轮转结构205中包括的4个彩色滤波片还可以是法珀腔结构的滤波片。可以调节每个法珀腔的光谱透射率或调节轮转结构205拍摄多帧图像,以获取更多的光谱图像信息。
基于上述轮转结构205,如图14所示,所述装置还可以包括第二接收模块901,第二控制模块902、第二处理模块903以及第二合成模块904;
所述第二接收模块901,用于获取彩色成像的第二图像采集指令,所述第二图像采集指令携带采集模式;
所述第二控制模块902,用于在识别所述采集模式为高光谱成像模式时,旋转所述轮转结构205的旋转轴,调节所述轮转结构205包括的所述第一彩色滤波片204和所述至少一个第二彩色滤波片中的一个彩色滤波片与所述主透镜201、微透镜阵列202、以及成像传感器203共轴,并向所述第二处理模块903发送用于拍摄一帧图像的拍摄指令;
所述第二处理模块903,用于在接收到所述拍摄指令后,使用所述一个彩色滤波片获取一帧图像,并向所述第二处理模块903发送拍摄完成一帧图像的完成指令;
所述第二控制模块902,还用于在接收到所述第二处理模块903发送的完成指令时,再次旋转所述轮转结构205的旋转轴,调节所述轮转结构205包括的所述第一彩色滤波片204和所述至少一个第二彩色滤波片中的另一个彩色滤波片与所述主透镜201、微透镜阵列202、以及成像传感器203共轴,并再次向所述第二处理模块903发送用于拍摄一帧图像的拍摄指令;在确定所述轮转结构205包括的L个彩色滤波片均被使用时,向所述第二合成模块904发送合成指令,所述合成指令用于指示所述第二合成模块对所述第二处理模块903拍摄得到的L帧图像进行融合处理,所述L为大于1的正整数,从而获取L帧图像;
所述第二合成模块904在接收到所述第二控制模块902发送的合成指示后,对所述L帧图像进行融合处理得到彩色图像。
可选地,在所述第一彩色滤波片204为RGB滤波片时,所述第二控制模块902,还用于在识别所述采集模式为RGB成像模式时,旋转所述轮转结构205的旋转轴,调节所述轮转结构205包括的所述第一彩色滤波片204与所述主透镜201、微透镜阵列202、以及成像传感器203共轴,并向所述第二处理模块903发送用于拍摄一帧图像的拍摄指令;
所述第二处理模块903,用于在接收到所述拍摄指令后,使用所述第一彩色滤波片204获取彩色图像。
本发明实施例还提供了一种通过图像采集设备获取彩色图像的方法,所述图像采集设备包括彩色成像装置,该彩色成像装置采用上述轮转结构。
如图15所示,所述方法包括:
S1101,所述图像采集设备接收获取彩色成像的第一图像采集指令,所述第一图像采集指令中携带采集模式为高光谱成像模式。
S1102,所述图像采集设备通过旋转所述轮转结构的旋转轴,调节所述轮转结构包括的所述第一彩色滤波片和所述至少一个第二彩色滤波片中的一个彩色滤波片与所述主透镜、微透镜阵列、以及成像传感器共轴;并使用所述一个彩色滤波片获取一帧图像;再次旋转所述轮转结构的旋转轴,调节所述轮转结构包括的所述第一彩色滤波片和所述至少一个第二彩色滤波片中的另一个彩色滤波片与所述主透镜、微透镜阵列、以及成像传感器共轴,直到所述轮转结构中的L个彩色滤波片均被使用,所述L为大于1的正整数,从而获取L帧图像。
S1103,所述图像采集设备对所述L帧图像进行融合处理得到彩色图像。
可选地,当轮转结构中的所述第一彩色滤波片为RGB滤波片,通过图像采集设备获取彩色图像的方法,如图16所示,可以包括:
S1201,所述图像采集设备接收获取彩色成像的第一图像采集指令,所述第一图像采集指令中携带采集模式。
S1202,所述图像采集设备确定所述采集模式。当采集模式为RGB成像模式时,执行S1204。当采集模式为高光谱成像模式时,执行S1203。
S1203,所述图像采集设备通过旋转所述轮转结构的旋转轴,调节所述轮转结构包括的所述第一彩色滤波片和所述至少一个第二彩色滤波片中的一个彩色滤波片与所述主透镜、微透镜阵列、以及成像传感器共轴;并使用所述一个彩色滤波片获取一帧图像;再次旋转所述轮转结构的旋转轴,调节所述轮转结构包括的所述第一彩色滤波片和所述至少一个第二彩色滤波片中的另一个彩色滤波片与所述主透镜、微透镜阵列、以及成像传感器共轴,直到所述轮转结构中的L个彩色滤波片均被使用,所述L为大于1的正整数,从而获取L帧图像。执行S1205。
S1204,调节所述RGB滤波片与所述主透镜、微透镜阵列、以及成像传感器共轴,并使用所述RGB滤波片获得彩色图像。
S1205,所述图像采集设备对所述L帧图像进行融合处理得到彩色图像。
本发明实施例还提供了一种通过图像采集设备获取彩色图像的方法,所述图像采集设备包括彩色成像装置,该彩色成像装置采用上述法珀腔滤波片。
如图17所示,该方法包括:
S1301,所述图像采集设备接收获取彩色成像的第一图像采集指令,所述第一图像采集指令中携带的采集模式为高光谱成像模式。
S1302,所述图像采集设备调节电压更改所述第一彩色滤波片包括的M*N个法珀腔结构的滤波片所过滤出的颜色,并使用所述第一彩色滤波片获取一帧图像,再次调节电压更改所述第一彩色滤波片包括的M*N个法珀腔结构的滤波片所过滤出的颜色,直到达到所述法珀腔结构的滤波片所能过滤出的颜色数量,从而获取L帧图像。
其中,每次调节后的M*N个法珀腔结构的滤波片所过滤出的颜色不相同,任意两次调节后的所述第一彩色滤波片中各M*N个法珀腔结构的滤波片所过滤出颜色均不相同;所述L等于所述法珀腔结构的滤波片所能过滤出的颜色数量。
S1303,所述图像采集设备对所述L帧图像进行融合处理得到彩色图像。
可选地,所述方法还可以包括:
所述图像采集设备接收获取彩色成像的第二图像采集指令,所述第二图像采集指令中携带的采集模式为RGB成像模式;
所述图像采集设备调节电压更改所述第一彩色滤波片包括的M*N个法珀腔结构的滤波片所过滤出的颜色,且调节后的M*N个法珀腔结构的滤波片所过滤出的颜色仅包括红色、绿色和蓝色;
所述图像采集设备使用所述第一彩色滤波片获取彩色图像。
通过上述实现方式,可以在需要拍摄普通彩色图像以及多光谱彩色图像中切换。
本领域内的技术人员应明白,本发明的实施例可提供为方法、系统、或计算机程序产品。因此,本发明可采用完全硬件实施例、完全软件实施例、或结合软件和硬件方面的实施例的形式。而且,本发明可采用在一个或多个其中包含有计算机可用程序代码的计算机可用存储介质(包括但不限于磁盘存储器、CD-ROM、光学存储器等)上实施的计算机程序产品的形式。
本发明是参照根据本发明实施例的方法、设备(系统)、和计算机程序产品的流程图和/或方框图来描述的。应理解可由计算机程序指令实现流程图和/或方框图中的每一流程和/或方框、以及流程图和/或方框图中的流程和/或方框的结合。可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式处理机或其他可编程数据处理设备的处理器以产生一个机器,使得通过计算机或其他可编程数据处理设备的处理器执行的指令产生用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的装置。
这些计算机程序指令也可存储在能引导计算机或其他可编程数据处理设备以特定方式工作的计算机可读存储器中,使得存储在该计算机可读存储器中的指令产生包括指令装置的制造品,该指令装置实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能。
这些计算机程序指令也可装载到计算机或其他可编程数据处理设备上,使得在计算机或其他可编程设备上执行一系列操作步骤以产生计算机实现的
处理,从而在计算机或其他可编程设备上执行的指令提供用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的步骤。
尽管已描述了本发明的优选实施例,但本领域内的技术人员一旦得知了基本创造性概念,则可对这些实施例作出另外的变更和修改。所以,所附权利要求意欲解释为包括优选实施例以及落入本发明范围的所有变更和修改。显然,本领域的技术人员可以对本发明进行各种改动和变型而不脱离本发明的精神和范围。这样,倘若本发明的这些修改和变型属于本发明权利要求及
其等同技术的范围之内,则本发明也意图包含这些改动和变型在内。
Claims (15)
- 一种彩色成像装置,其特征在于,包括在光路传输路径上依次排列的主透镜,微透镜阵列,以及成像传感器;所述主透镜包括至少两个共轴且位置相对固定的单透镜;所述装置还包括设置于所述主透镜的孔径光阑处的第一彩色滤波片;所述主透镜,所述第一彩色滤波片,所述微透镜阵列,以及所述成像传感器平行且共轴;所述微透镜阵列包括l个微透镜;所述成像传感器位于所述微透镜阵列的焦平面;其中,所述成像传感器包括l*M*N个像素,光从任意一个微透镜到达所述成像传感器时覆盖所述成像传感器的M*N的像素阵列,且光从所述l个微透镜到达所述成像传感器时覆盖所述成像传感器包括的l*M*N个像素;其中,l、M和N均为正整数;所述第一彩色滤波片包括至少一个能够过滤出至少一种颜色的滤波片;所述第一彩色滤波片在垂直于轴线的任一方向上的尺寸不小于所述主透镜在对应方向上的尺寸。
- 如权利要求1或2所述的装置,其特征在于,所述第一彩色滤波片包括以阵列排列的M*N个子单元;其中,一个子单元对应一种颜色的单色滤波片。
- 如权利要求3所述的装置,其特征在于,所述第一彩色滤波片为红绿蓝RGB滤波片,所述红绿蓝RGB滤波片包括的M*N个子单元分别对应绿色滤波片、红色滤波片以及蓝色滤波片,其中,M和N均为大于等于2的整数。
- 如权利要求4所述的装置,其特征在于,所述红绿蓝RGB滤波片呈Bayer阵列分布。
- 如权利要求1或2所述的装置,其特征在于,所述第一彩色滤波片包括以阵列排列的M*N个法珀腔结构的滤波片,且法珀腔结构的滤波片的腔体内填充为液晶或者填充为电光晶体,用于在施加于法珀腔结构的滤波片的腔体的两侧电压变化时,变化所过滤出的颜色。
- 如权利要求6所述的装置,其特征在于,所述装置还包括第一接收模块、第一控制模块、第一处理模块以及第一合成模块;所述第一接收模块,用于获取彩色成像的第一图像采集指令,所述第一图像采集指令携带采集模式;所述第一控制模块,用于识别所述采集模式为高光谱成像模式时,向所述第一处理模块发出第一调节指令,所述第一调节指令用于指示所述第一处理模块更改L次所述第一彩色滤波片包括的M*N个法珀腔结构的滤波片所过滤出的颜色;所述L等于所述法珀腔结构的滤波片所能过滤出的颜色数量;所述第一处理模块,用于在接收到所述调节指令后,调节电压更改所述第一彩色滤波片包括的M*N个法珀腔结构的滤波片所过滤出的颜色,使用所述第一控制模块调节后所述第一彩色滤波片获取一帧图像,再次调节电压更改所述第一彩色滤波片包括的M*N个法珀腔结构的滤波片所过滤出的颜色,直到达到所述法珀腔结构的滤波片所能过滤出的颜色数量,从而获取L帧图像;其中,每次调节后的M*N个法珀腔结构的滤波片所过滤出的颜色不相同,任意两次调节后的所述第一彩色滤波片中各M*N个法珀腔结构的滤波片所过 滤出的颜色均不相同;第一合成模块,用于对所述第一处理模块处理得到所述L帧图像进行融合处理得到彩色图像。
- 如权利要求7所述的装置,其特征在于,所述第一控制模块,还用于:在识别所述采集模式为红绿蓝RGB成像模式时,向所述第一处理模块发出第二调节指令,所述第二调节指令用于指示所述第一处理模块更改所述第一彩色滤波片包括的M*N个法珀腔结构的滤波片所过滤出的颜色,且调节后的M*N个法珀腔结构的滤波片所过滤出的颜色仅包括红色、绿色和蓝色;所述第一处理模块,还用于在接收到所述第一控制模块发送的调节指令后,调节电压更改所述第一彩色滤波片包括的M*N个法珀腔结构的滤波片所过滤出的颜色,且调节后的M*N个法珀腔结构的滤波片所过滤出的颜色仅包括红色、绿色和蓝色;并使用所述第一彩色滤波片获取彩色图像。
- 如权利要求3至5任一项所述的装置,其特征在于,所述第一彩色滤波片设置于轮转结构,所述轮转结构还包括至少一个第二彩色滤波片以及旋转轴,用于通过旋转所述轮转结构的旋转轴,调节所述第一彩色滤波片和所述至少一个第二彩色滤波片中的一个彩色滤波片与所述主透镜,微透镜阵列,以及成像传感器共轴;所述至少一个第二彩色滤波片与所述第一彩色滤波片包括的单色滤波片数量和排列方式相同,所述第一彩色滤波片和所述至少一个第二彩色滤波片中任意两个彩色滤波片中不包括颜色相同的单色滤波片。
- 如权利要求9所述的装置,其特征在于,所述装置还包括第二接收模块,第二控制模块、第二处理模块以及第二合成模块;所述第二接收模块,用于获取彩色成像的第二图像采集指令,所述第二图像采集指令携带采集模式;所述第二控制模块,用于在识别所述采集模式为高光谱成像模式时,旋转所述轮转结构的旋转轴,调节所述轮转结构包括的所述第一彩色滤波片和所述至少一个第二彩色滤波片中的一个彩色滤波片与所述主透镜、微透镜阵 列、以及成像传感器共轴,并向所述第二处理模块发送用于拍摄一帧图像的拍摄指令;所述第二处理模块,用于在接收到所述拍摄指令后,使用所述一个彩色滤波片获取一帧图像,并向所述第二处理模块发送拍摄完成一帧图像的完成指令;所述第二控制模块,还用于在接收到所述第二处理模块发送的完成指令时,再次旋转所述轮转结构的旋转轴,调节所述轮转结构包括的所述第一彩色滤波片和所述至少一个第二彩色滤波片中的另一个彩色滤波片与所述主透镜、微透镜阵列、以及成像传感器共轴,并再次向所述第二处理模块发送用于拍摄一帧图像的拍摄指令;在确定所述轮转结构包括的L个彩色滤波片均被使用时,向所述第二合成模块发送合成指令,所述合成指令用于指示所述第二合成模块对所述第二处理模块拍摄得到的L帧图像进行融合处理,所述L为大于1的正整数,从而获取L帧图像;所述第二合成模块在接收到所述第二控制模块发送的合成指示后,对所述L帧图像进行融合处理得到彩色图像。
- 如权利要求10所述的装置,其特征在于,所述第一彩色滤波片为RGB滤波片;所述第二控制模块,还用于在识别所述采集模式为RGB成像模式时,旋转所述轮转结构的旋转轴,调节所述轮转结构包括的所述第一彩色滤波片与所述主透镜、微透镜阵列、以及成像传感器共轴,并向所述第二处理模块发送用于拍摄一帧图像的拍摄指令;所述第二处理模块,用于在接收到所述拍摄指令后,使用所述第一彩色滤波片获取彩色图像。
- 一种通过图像采集设备获取彩色图像的方法,其特征在于,所述图像采集设备包括如权利要求9所述的彩色成像装置,所述方法包括:所述图像采集设备接收获取彩色成像的第一图像采集指令,所述第一图像采集指令中携带的采集模式为高光谱成像模式;所述图像采集设备通过旋转所述轮转结构的旋转轴,调节所述轮转结构包括的所述第一彩色滤波片和所述至少一个第二彩色滤波片中的一个彩色滤波片与所述主透镜、微透镜阵列、以及成像传感器共轴;并使用所述一个彩色滤波片获取一帧图像;再次旋转所述轮转结构的旋转轴,调节所述轮转结构包括的所述第一彩色滤波片和所述至少一个第二彩色滤波片中的另一个彩色滤波片与所述主透镜、微透镜阵列、以及成像传感器共轴,直到所述轮转结构包括的L个彩色滤波片均被使用,所述L为大于1的正整数,从而获取L帧图像;所述图像采集设备对所述L帧图像进行融合处理得到彩色图像。
- 如权利要求12所述的方法,其特征在于,当所述第一彩色滤波片为RGB滤波片时,所述方法还包括:所述图像采集设备接收获取彩色成像的第二图像采集指令,所述第二图像采集指令中携带的采集模式为红绿蓝RGB成像模式;所述图像采集设备调节所述第一彩色滤波片与所述主透镜、微透镜阵列、以及成像传感器共轴,并使用所述第一彩色滤波片获得彩色图像。
- 一种通过图像采集设备获取彩色图像的方法,其特征在于,所述图像采集设备包括如权利要求6所述的彩色成像装置,所述方法包括:所述图像采集设备接收获取彩色成像的第一图像采集指令,所述第一图像采集指令中携带的采集模式为高光谱成像模式;所述图像采集设备调节电压更改所述第一彩色滤波片包括的M*N个法珀腔结构的滤波片所过滤出的颜色,并使用所述第一彩色滤波片获取一帧图像,再次调节电压更改所述第一彩色滤波片包括的M*N个法珀腔结构的滤波片所过滤出的颜色,直到达到所述法珀腔结构的滤波片所能过滤出的颜色数量,从而获取L帧图像;其中,每次调节后的M*N个法珀腔结构的滤波片所过滤出的颜色不相同,任意两次调节后的所述第一彩色滤波片中各M*N个法珀腔结构的滤波片所过滤出的颜色均不相同;所述L等于所述法珀腔结构的滤波片所能过滤出的颜色数量;所述图像采集设备对所述L帧图像进行融合处理得到彩色图像。
- 如权利要求14所述的方法,其特征在于,还包括:所述图像采集设备接收获取彩色成像的第二图像采集指令,所述第二图像采集指令中携带的采集模式为红绿蓝RGB成像模式;所述图像采集设备调节电压更改所述第一彩色滤波片包括的M*N个法珀腔结构的滤波片所过滤出的颜色,且调节后的M*N个法珀腔结构的滤波片所过滤出的颜色仅包括红色、绿色和蓝色;所述图像采集设备使用所述第一彩色滤波片获取彩色图像。
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP16892295.3A EP3410704A1 (en) | 2016-02-29 | 2016-08-19 | Color imaging device, and method for obtaining color images |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201610112996.4A CN107135380B (zh) | 2016-02-29 | 2016-02-29 | 一种彩色成像装置以及获取彩色图像的方法 |
CN201610112996.4 | 2016-02-29 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2017148109A1 true WO2017148109A1 (zh) | 2017-09-08 |
Family
ID=59721906
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2016/096086 WO2017148109A1 (zh) | 2016-02-29 | 2016-08-19 | 一种彩色成像装置以及获取彩色图像的方法 |
Country Status (3)
Country | Link |
---|---|
EP (1) | EP3410704A1 (zh) |
CN (1) | CN107135380B (zh) |
WO (1) | WO2017148109A1 (zh) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111901501A (zh) * | 2019-05-05 | 2020-11-06 | 深圳光启高端装备技术研发有限公司 | 一种全彩全景成像装置 |
CN113905164A (zh) * | 2021-10-09 | 2022-01-07 | 奕目(上海)科技有限公司 | 光场成像系统以及通过光场成像系统采集光场信息的方法 |
Families Citing this family (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111476215A (zh) * | 2020-05-25 | 2020-07-31 | 上海菲戈恩微电子科技有限公司 | 生物特征鉴别结构及方法及使用其的显示装置及电子设备 |
CN110798605B (zh) * | 2019-11-29 | 2021-05-28 | 维沃移动通信有限公司 | 摄像模组及电子设备 |
JP7309640B2 (ja) * | 2020-03-18 | 2023-07-18 | 株式会社東芝 | 光学検査装置 |
CN115802183B (zh) * | 2021-09-10 | 2023-10-20 | 荣耀终端有限公司 | 图像处理方法及其相关设备 |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101500085A (zh) * | 2008-01-28 | 2009-08-05 | 索尼株式会社 | 图像摄取装置 |
CN103686102A (zh) * | 2012-09-14 | 2014-03-26 | 株式会社理光 | 摄像装置以及摄像系统 |
CN104580950A (zh) * | 2013-10-28 | 2015-04-29 | 全视科技有限公司 | 多透镜阵列模块中的紧凑间隔件 |
US20150201142A1 (en) * | 2013-09-10 | 2015-07-16 | Rambus Inc. | Image sensor with threshold-based output encoding |
CN105093472A (zh) * | 2015-08-25 | 2015-11-25 | 华为技术有限公司 | 成像装置和成像方法 |
Family Cites Families (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103486532B (zh) * | 2013-08-28 | 2015-01-21 | 成都谱视科技有限公司 | 基于可见光滤光片的太阳光导入装置 |
-
2016
- 2016-02-29 CN CN201610112996.4A patent/CN107135380B/zh not_active Expired - Fee Related
- 2016-08-19 WO PCT/CN2016/096086 patent/WO2017148109A1/zh active Application Filing
- 2016-08-19 EP EP16892295.3A patent/EP3410704A1/en not_active Withdrawn
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101500085A (zh) * | 2008-01-28 | 2009-08-05 | 索尼株式会社 | 图像摄取装置 |
CN103686102A (zh) * | 2012-09-14 | 2014-03-26 | 株式会社理光 | 摄像装置以及摄像系统 |
US20150201142A1 (en) * | 2013-09-10 | 2015-07-16 | Rambus Inc. | Image sensor with threshold-based output encoding |
CN104580950A (zh) * | 2013-10-28 | 2015-04-29 | 全视科技有限公司 | 多透镜阵列模块中的紧凑间隔件 |
CN105093472A (zh) * | 2015-08-25 | 2015-11-25 | 华为技术有限公司 | 成像装置和成像方法 |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111901501A (zh) * | 2019-05-05 | 2020-11-06 | 深圳光启高端装备技术研发有限公司 | 一种全彩全景成像装置 |
CN113905164A (zh) * | 2021-10-09 | 2022-01-07 | 奕目(上海)科技有限公司 | 光场成像系统以及通过光场成像系统采集光场信息的方法 |
Also Published As
Publication number | Publication date |
---|---|
CN107135380A (zh) | 2017-09-05 |
EP3410704A1 (en) | 2018-12-05 |
CN107135380B (zh) | 2019-05-28 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2017148109A1 (zh) | 一种彩色成像装置以及获取彩色图像的方法 | |
US20210010864A1 (en) | Hyperspectral imaging apparatus and method | |
EP2380345B1 (en) | Improving the depth of field in an imaging system | |
US7932932B2 (en) | Method and apparatus for a chopped two-chip cinematography camera | |
JP5399215B2 (ja) | 多眼カメラ装置および電子情報機器 | |
JP4652634B2 (ja) | 撮像装置 | |
US8228418B2 (en) | Anti-aliasing spatial filter system | |
JP5619294B2 (ja) | 撮像装置及び合焦用パラメータ値算出方法 | |
CN107750345A (zh) | 多光谱成像仪 | |
WO2013042323A1 (ja) | ライトフィールド撮像装置、および画像処理装置 | |
US9398272B2 (en) | Low-profile lens array camera | |
WO2010052593A1 (en) | Camera design for the simultaneous capture of near-infrared and visible images | |
US11812149B2 (en) | Zoomable image sensor and image sensing method | |
US11756975B2 (en) | Image sensor and image sensing method to generate high sensitivity image through thin lens element and micro lens array | |
WO2021136469A1 (zh) | 一种图像传感器、分光滤色器件及图像传感器的制备方法 | |
CN102918355A (zh) | 三维摄像装置、光透过部、图像处理装置及程序 | |
WO2004057858A1 (en) | A color imaging system and a method in a color imaging system | |
US20140285702A1 (en) | Three-chip camera apparatus | |
CN102474649B (zh) | 三维摄像装置及透光板 | |
US20130092819A1 (en) | Prismatic image replication for obtaining color data from a monochrome detector array | |
US10095100B2 (en) | Panoramic viewing system and method thereof | |
US7176967B1 (en) | Method and apparatus for a two-chip cinematography camera | |
US20230145952A1 (en) | Hyperspectral Imaging Device | |
WO2019019813A1 (zh) | 一种感光组件 | |
JP7173727B2 (ja) | 画像撮像装置 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
WWE | Wipo information: entry into national phase |
Ref document number: 2016892295 Country of ref document: EP |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
ENP | Entry into the national phase |
Ref document number: 2016892295 Country of ref document: EP Effective date: 20180828 |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 16892295 Country of ref document: EP Kind code of ref document: A1 |