CN108391102A - Image sensing apparatus, image processing equipment, computing device and image reconstructing method - Google Patents

Image sensing apparatus, image processing equipment, computing device and image reconstructing method Download PDF

Info

Publication number
CN108391102A
CN108391102A CN201810439116.3A CN201810439116A CN108391102A CN 108391102 A CN108391102 A CN 108391102A CN 201810439116 A CN201810439116 A CN 201810439116A CN 108391102 A CN108391102 A CN 108391102A
Authority
CN
China
Prior art keywords
colour filter
color
element array
image
filter element
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201810439116.3A
Other languages
Chinese (zh)
Inventor
陶霖密
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tsinghua University
Original Assignee
Tsinghua University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tsinghua University filed Critical Tsinghua University
Priority to CN201810439116.3A priority Critical patent/CN108391102A/en
Publication of CN108391102A publication Critical patent/CN108391102A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/10Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
    • H04N23/13Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths with multiple sensors
    • H04N23/16Optical arrangements associated therewith, e.g. for beam-splitting or for colour correction
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00Details of colour television systems
    • H04N9/64Circuits for processing colour signals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00Details of colour television systems
    • H04N9/64Circuits for processing colour signals
    • H04N9/646Circuits for processing colour signals for image enhancement, e.g. vertical detail restoration, cross-colour elimination, contour correction, chrominance trapping filters

Abstract

Colour image sensing equipment, image processing equipment, Color Image Reconstruction method and computing device.Color image sensor includes two imaging sensors and two first color colour filter element array, and imaging sensor is corresponded with first color colour filter element array, each imaging sensor area, sensing element quantity and arrangement mode having the same;Each member color colour filter element array includes the colour filter member of at least one primary colors, and the color for the colour filter member that two kinds of first color colour filter members include is different, and two first color colour filter element array compositions have the panchromatic colour filter element array of whole primary colors.Colour image sensing equipment according to the present invention, the signal-to-noise ratio of colour image sensing equipment can be significantly increased, the quantity of sensor assembly is merely added simultaneously, the volume of single sensor and camera lens is not increased, the manufacture difficulty and cost of single sensor are not increased so that the present invention is easy to use in the mobile devices such as mobile phone;The anti-noise ability for improving color image sensor improves the accuracy of color reduction.

Description

Image sensing apparatus, image processing equipment, computing device and image reconstructing method
Technical field
The present invention relates generally to colour image sensing technology, relates more specifically to colour image sensing equipment and obtains number The device of word coloured image may be used as various mobile phones, tablet computer, laptop, digital camera, DV etc. Digital color image, video acquisition device further relate to the rendering and arrangement of the color filter element array of colour image sensing equipment Method and image reconstructing method.
Background technology
Digital color image sensing equipment is digital camera, DV, the digital pictures such as mobile phone, tablet computer The component of most critical in equipment, for the optical imagery of lens focus to be converted to digital color image.Colour image sensing Equipment is collectively constituted by color filter element array and imaging sensor two parts.The function of imaging sensor (Image Sensor) The brightness transition for being the visible light being emitted onto on sensor is electric signal, and is digitized in subsequent processing, and gray scale is generated (black and white) image.Coloured image is generated in order to obtain the colouring information in nature, is typically employed in the surface of imaging sensor The method for needing to cover one layer of color filter element array (Color Filter Array, CFA), by color filter element array and figure As sensor two parts collectively constitute colour image sensing equipment.
The effect of digital image sensor is the intensity digitized of the visible light being emitted onto on sensor, generates gray scale (black and white) image.Since a width digital picture is the pel array made of multiple pixel arrangements, correspondingly, imaging sensor is The sensing element array being arranged in by multiple sensing elements, wherein each sensing element independently to the intensity (brightness) of the light received into Digitized generates a pixel in digital picture.Colour image sensing equipment is to cover coloured silk on the surface of imaging sensor Color colour filter element array, and corresponded with the sensing element array on imaging sensor so that imaging sensor can be to visible light The light intensity (brightness) of middle different colours is digitized, and after the reconstruct of computing device, generates coloured image.Fig. 1 is shown The structure composition schematic diagram of colour image sensing equipment, 1 indication color colour filter element array of label, label 2 indicate imaging sensor, Imaging sensor is rearranged by sensing element, and R=Red indicate that red color filter member, G=Green indicate green color member in figure, B=Blue indicates that blue color member, T=Transparency indicate that transparent colour filter member, colour filter member and sensing element correspond.
Color digital image equipment can be divided into three kinds according to the quantity of its internal color image sensor:(1) it is equipped with The color digital image sensing equipment of single image sensor, the colour image sensing equipment by imaging sensor and covering thereon Three color colour filter element array formed, the colour picture signal of acquired only one third, the signal passes through computing device After processing, coloured image is reconstructed.Color image sensor based on single image sensor have sensor area is small, price just Preferably, many advantages, such as manufacturing method is ripe, with the development of computing device, at present on a large scale be used for mobile phone, tablet computer, In the various digital image devices such as digital camera, DV.(2) the color digital image equipment of multiple image sensor, such as The external world is injected there are one polygon prism is divided in the DV of 3CCD, the DV etc. of 3CMOS, equipment inside Visible light is divided into red, green, blue three beams, is received respectively by three independent imaging sensors (CCD or cmos image sensor), And it is quantified as color digital image.There is no colour filter element array on 3CCD or 3CMOS color image sensors, but needs optical point Light microscopic, bulky, manufacture is complicated, is currently only used in some medium-and-large-sized digital cameras.(3) stacked multiple image sensor Color digital image equipment, i.e. X3 color image sensors (Japanese Sigma house journals), which uses three layer three Color structure, i.e., the imaging sensor of three layers overlapping are respectively blue, green, red image sensor from top to bottom.It is extraneous incident Light in blue portion first by first layer blue image sensor absorb and digitize, second layer green image sensor absorb The red image sensor of green portion in incident light and digitlization, third layer absorbs remaining light and digitizes, to Generate color digital image.Due to the stacking of sensor in X3 color image sensors, upper layer sensor and its circuit are to light With certain attenuation so that the light that underlying transducer can receive is greatly decreased.In order to solve this problem, this Class imaging sensor improves signal-to-noise ratio by increasing the area of the sensing element contained by the area and sensor of sensor, to make It is larger to obtain entire camera volume, is generally used in the medium-and-large-sized digital camera such as slr camera.
The technical research of existing colour image sensing equipment also concentrates on the color rendering and arrangement mode of color filter member On, such as most common color filter element array is Bayer color filter element array in color image sensor, by 2x2 RGGB (red green and green is blue) colour filter member repeated arrangement forms.
There are two types of basic generation types for color filter element array, and one is the random rows of the color filter of a variety of colors member Row form color filter element array, and another kind is first to form a colour filter tuple by the colour filter member of different colours, then again by filtering Color tuple repeated arrangement forms color filter element array.Above two arrangement mode has relevant patent, wherein about colour The patent of colour filter tuple is more, and the technology of main existing color filter tuple is listed in table 1.
Table 1:The color of colour filter tuple and arrangement in color filter element array
The color filter element array of the prior art has following main feature:
1) colour filter element array is by three colors or four color colour filter member random alignments or repeated arrangement is formed in groups, colour filter tuple tool There are 2x2,2x4,3x3, the diversified forms such as 4x4;
2) the colour filter member in color filter tuple has determining arrangement mode;
3) each colorful digital sensing equipment includes a color filter element array and an imaging sensor, and sensor On each sensing element only acquire the signal of a color in three colors or four colors.
Although above-mentioned color filter element array adds the color digital image sensing equipment that imaging sensor is formed by image Sensing equipment is transformed to color digital image sensing equipment from gray level image sensing equipment, but its colour filter element array filters off 2/3 light, only 1/3 light are actually reached imaging sensor and are imaged, and computing device is based on coloured silk using certain algorithm The 1/3 obtained signal reconstruct of sampling of color image sensing equipment goes out coloured image.
Since each sensing element has inevitable stochastical sampling noise, 1/3 color samples to reduce coloured image The signal-to-noise ratio of sensor, while independent random noise is introduced in the sampling of the color in each pixel.This problem is passing In the medium-and-large-sized cameras such as the slr camera of system, micro- one camera, mm professional camera special, by increasing the area of sensor and correspondingly increasing The camera lens of camera so that each sensing element obtains more light, improves the signal-to-noise ratio of imaging and is alleviated.But with The mobile devices such as mobile phone it is universal, in order to reduce the volume and weight of coloured image image-forming module, cromogram used in mobile phone As the area of the imaging sensor in sensing equipment is extremely limited, and pixel number is continuously improved, single pixel in imaging sensor Area constantly reduce.To cause colour image sensing equipment in insufficient light, noise is relatively low, seriously affects cromogram As the quality of sensing equipment acquired coloured image in illumination deficiency.And the color digital image processing in later stage is calculated with enhancing Method (as shown in a in Fig. 8), it is difficult to inhibit the random coloration noise caused by imaging session.
The above problem can not be as traditional camera by increasing the area of imaging sensor and correspondingly increasing mirror Head solves.The mobile-phone manufacturers such as Huawei improve the noise of image by increasing the scheme for the gray scale camera that one assists Than to partly alleviate the above problem.For example, mobile phone of the Huawei in the models such as its P9 and P9 Plus, cruel group is in its Cool1 Etc. in the mobile phone of models, be proposed the dual camera scheme that colour imagery shot adds gray scale camera, colour imagery shot is used for obtaining The color of object, and gray scale camera is used for obtaining the light and shade details of object.Then it is handled with color digital image and is enhanced calculation Method (referring to the b in Fig. 8) merges coloured image and gray level image so that the coloured image taken pictures under half-light can also make Object has abundant details.To inhibit the global noise of coloured image, the quality of coloured image is improved.But due to upper It states in scheme, colour image sensing equipment of colour imagery shot itself does not change, therefore, in colour image sensing equipment There is no improve for signal-to-noise ratio.Due to the noise of redgreenblue in colour image sensing equipment be it is random and mutually independent, this The scheme of kind dual camera can enhance the details of image, but cannot still remove and derive from colour image sensing in coloured image The noise of equipment, i.e. color noise in coloured image.
Other than the dual camera scheme of above-mentioned colour+black and white, also there is mobile phone to use dual camera scheme, such as based on double The stereo camera of camera, the optical zoom based on dual camera.For example, the double of 7 Plus of iPhone of Apple Inc. take the photograph As head, it is using two identical color digital image sensing equipments but the different scheme of camera lens, the i.e. camera lens of its dual camera Wide-angle+telephoto lens, for realizing the fusion of optical zoom and digital zoom.These dual cameras are all based on existing colour and take the photograph As the combination of head and colour imagery shot or gray scale camera, then algorithm software is used to obtain color image enhancement, optical zoom The multiple functions such as fusion, stereoscopic vision with digital zoom, but as above-mentioned dual camera scheme, set in colour image sensing Standby this is not innovated with it.
Invention content
In view of the foregoing, it is proposed that the present invention.
According to an aspect of the invention, there is provided a kind of image sensing apparatus, including two imaging sensors and two First color colour filter element array, imaging sensor are corresponded with first color colour filter element array, each imaging sensor face having the same Product, sensing element quantity and arrangement mode;Each member color colour filter element array includes the colour filter member of at least one primary colors, first yuan of color The colour filter member that colour filter element array includes is different from the color for the colour filter member that binary color colour filter member includes, and two first color colour filter members Array composition has the panchromatic colour filter element array of whole primary colors.
Optionally, whole primary colors are made of the first primary colors, the second primary colors, third primary color.
Optionally, first yuan of color colour filter element array is arranged by the colour filter member of the first primary colors and the colour filter member equal proportion of the second primary colors It arranges, binary color colour filter element array is made of the colour filter member of third primary color.
Optionally, first yuan of color colour filter element array is arranged by the colour filter member of the first primary colors and the colour filter member equal proportion of the second primary colors It arranges, binary color colour filter element array is rearranged by the colour filter member and colourless colour filter member equal proportion of third primary color.
Optionally, first yuan of color colour filter element array is arranged by the colour filter member of the first primary colors and the colour filter member equal proportion of third primary color It arranges, binary color colour filter element array is rearranged by the colour filter member of the second primary colors and the colour filter member equal proportion of third primary color.
Optionally, the first primary colors and the second primary colors are respectively red and blue, and third primary color is green.
According to another aspect of the present invention, a kind of image sensing apparatus, including two imaging sensors and two are provided First color colour filter element array, is referred to as the first imaging sensor and the second imaging sensor, first yuan of color colour filter element array and Binary color colour filter element array, imaging sensor are corresponded with first color colour filter element array, the biography that the second imaging sensor has The first quantity of sense is more than the sensing element quantity that the first imaging sensor has;Each member color colour filter element array includes at least one face The colour filter member of color, the colour filter member quantity that binary color colour filter element array has are more than the colour filter that first yuan of color colour filter element array has First quantity;First and second yuan of colors colour filter element array composition has the panchromatic colour filter element array of whole primary colors.
Optionally, the sensing element quantity that the sensing element quantity that the first imaging sensor has has with the second imaging sensor The ratio of number of sensing element is a:b<=1:2, such as a:B=36:64.
Optionally, whole primary colors are made of the first primary colors, the second primary colors, third primary color.
Optionally, first yuan of color colour filter element array is arranged by the colour filter member of the first primary colors and the colour filter member equal proportion of the second primary colors It arranges, binary color colour filter element array is made of the colour filter member of third primary color.
Optionally, first yuan of color colour filter element array is arranged by the colour filter member of the first primary colors and the colour filter member equal proportion of the second primary colors It arranges, binary color colour filter element array is rearranged by the colour filter member and colourless colour filter member equal proportion of third primary color.
Optionally, the first primary colors and the second primary colors are respectively red and blue, and third primary color is green.
According to another aspect of the present invention, a kind of image sensing apparatus, including more than two imaging sensor are provided With more than two first color colour filter element array, imaging sensor is corresponded with first color colour filter element array, each imaging sensor Area, sensing element quantity and arrangement mode having the same;Each member color colour filter element array includes the filter of at least one primary colors Color member, the colour filter member that different member color colour filter element array include is different, and described two above first color colour filter element array compositions have complete The panchromatic colour filter element array of portion's primary colors.
According to another aspect of the present invention, provide a kind of image sensing apparatus include more than two imaging sensor and More than two member color colour filter element array, imaging sensor are corresponded with first color colour filter element array, at least two image sensings Utensil has different sensing element quantity;Each member color colour filter element array includes the colour filter member of at least one primary colors, different member colors The colour filter member that colour filter element array includes is different, and described two above first color colour filter element array compositions have the panchromatic filter of whole primary colors Color element array.
According to another aspect of the present invention, a kind of image processing equipment, including front any one of them image are provided Sensing equipment and image processor, wherein described image processor are obtained respectively based on the signal that each imaging sensor samples A corresponding sub- coloured image is based on each corresponding sub- coloured image, and synthesis obtains final full-color image, wherein In the case that the corresponding first color colour filter element array of one imaging sensor includes the colour filter member of multiple primary colors, image processor is based on The signal that described image sensor samples obtains the sub- coloured image of monochrome for corresponding to each of multiple primary colors;Scheme at one As the corresponding first color colour filter element array of sensor include single primary colors colour filter member in the case of, image processor is based on prime number figure As the signal that sensor sample obtains, the sub- coloured image of monochrome for corresponding to single primary colors is obtained;It is corresponded in an imaging sensor First color colour filter element array include colourless colour filter member in the case of, based on the signal that described image sensor samples, also Obtain corresponding grey scale image;And image processor is based on single sub- coloured image corresponding with each imaging sensor, synthesis Final colo(u)r picture.
According to another aspect of the present invention, a kind of computing device, including image processing equipment above-mentioned are provided.
Optionally, the computing device is smart mobile phone, tablet computer, laptop, digital camera, DV In one kind.
According to another aspect of the present invention, a kind of signal obtained using aforementioned image sensing apparatus is provided to reconstruct coloured silk The image reconstructing method of color image includes obtaining each corresponding son colour based on the signal that each imaging sensor samples Image is based on each corresponding sub- coloured image, and synthesis obtains final full-color image, wherein in an imaging sensor In the case that corresponding member color colour filter element array includes the colour filter member of multiple primary colors, sampled based on described image sensor Signal obtains the sub- coloured image of monochrome for corresponding to each of multiple primary colors;In the corresponding first color colour filter member of an imaging sensor In the case that array includes the colour filter member of single primary colors, based on the signal that described image sensor samples, obtain corresponding single The sub- coloured image of monochrome of a primary colors;Include colourless colour filter member in the corresponding first color colour filter element array of an imaging sensor In the case of, based on the signal that described image sensor samples, also obtain corresponding grey scale image;And it is based on and each image The corresponding single sub- coloured image of sensor, and there are gray level image, it is also based on gray level image, synthesis is final Coloured image.
The colour image sensing equipment according to the ... of the embodiment of the present invention being made of double image sensor and double color filtration element array, The signal-to-noise ratio of colour image sensing equipment can be significantly increased, while merely adding the quantity of sensor assembly, does not increase list The volume of a sensor and camera lens does not increase the manufacture difficulty and cost of single sensor so that the present invention is easy in mobile phone etc. It is used in mobile device;Colour image sensing equipment according to the ... of the embodiment of the present invention containing more than two imaging sensors and corresponding Restructing algorithm, improve the anti-noise ability of color image sensor, improve color reduction accuracy, to improve coloured silk The performance of color image sensing equipment.
Description of the drawings
From the detailed description below in conjunction with the accompanying drawings to the embodiment of the present invention, these and/or other aspects of the invention and Advantage will become clearer and be easier to understand, wherein:
Fig. 1 shows the structure composition schematic diagram of traditional colour image sensing equipment.
A and b in Fig. 2 together illustrate a concrete example of double color filter element array according to the ... of the embodiment of the present invention Son.
A and b in Fig. 3 together illustrate another concrete example of double color filter element array according to the ... of the embodiment of the present invention Son.
A and b in Fig. 4 together illustrate another concrete example of double color filter element array according to the ... of the embodiment of the present invention Son.
A and b in Fig. 5 together illustrate another concrete example of double color filter element array according to the ... of the embodiment of the present invention Son.
A and b in Fig. 6 together illustrate another concrete example of double color filter element array according to the ... of the embodiment of the present invention Son.
A and b in Fig. 7 together illustrate the double color filter element array and dual image sensing of colour image sensing equipment Device.
A in Fig. 8 shows traditional coloured image being made of single colour filter element array and single image sensor The signal acquisition of sensor is exported with color digital image;B in Fig. 8 shows traditional by single colour filter element array and single The signal of the acquisition for the color image sensor that imaging sensor is formed, with the grey acquired in another imaging sensor The processing of word image co-registration, enhanced color digital image output;C in Fig. 8 shows according to the ... of the embodiment of the present invention by two The signal acquisition and color digital image for the colour image sensing equipment that a colour filter element array and two imaging sensors are formed Output.
Specific implementation mode
In order to make those skilled in the art more fully understand the present invention, with reference to the accompanying drawings and detailed description to this hair It is bright to be described in further detail.
Herein, colour image sensing equipment is made of imaging sensor and colour filter element array, and imaging sensor is by passing Sense member composition, colour filter element array are made of colour filter identical permutation.
In order to make those skilled in the art more fully understand the present invention, first general color image sensor is simply introduced Operation principle.As shown in Figure 1, colour image sensing equipment is made of imaging sensor and color filter element array two parts, Wherein color filter element array there are many color rendering mode and arrangement mode, common trait be color filter element array at least Including trichromatic colour filter is first (for example, three color of red, green, blue or blueness, Huang, product red trichromatism), referred to as panchromatic colour filter element array (panchromatic- CFA), it should be noted that here include at least trichromatic colour filter member, it is not required that each filter The color of color member filtering is exactly primary colors, as long as but the color that is filtered of color filter element array combine and contain three primary colors .In colored sensing equipment, the sensing element one in colour filter member and imaging sensor in the panchromatic colour filter element array One corresponds to, and repeated arrangement forms the colour image sensing equipment of pixel more than one.
The approach of traditional raising coloured image signal-to-noise ratio is to improve the manufacturing method or technique of imaging sensor, to drop The sampling noise of low sensor itself;Or increase the area of each sensing element in imaging sensor, it can there are two types of realize way Diameter, first, increasing the area of imaging sensor, to increase the area of each sensing element;Second is that certain in image area sensor In the case of, the pixel quantity of imaging sensor is reduced, to improve the area of each sensing element.But increase the face of sensor Product needs correspondingly to increase the size of camera lens, and the volume and modern mobile devices to increase entire colour imagery shot module are small The requirement of type is runed counter to;And reduce the pixel number of colour image sensing equipment, then it is even more and current colour image sensing equipment Development trend and the market demand are opposite.Therefore, the realization means of above-mentioned raising coloured image signal-to-noise ratio, in current image sensing Under device manufacturing process, minimized, under the trend of high pixelation in mobile device, it is infeasible.
In order to solve above-mentioned problem, the present invention is added the method for double color filter element array using double image sensor, increased The gross area of imaging sensor, to improve the signal-to-noise ratio of colour image sensing equipment.Therefore, the present invention proposes one kind and is based on The colour image sensing equipment of double image sensor, including double image sensor, double colours corresponding with each imaging sensor Colour filter element array, and the Color Image Reconstruction method based on double image sensor.With reference to the base for illustrating the present invention Present principles and specific implementation mode.
One, image sensing apparatus according to a first embodiment of the present invention
Image sensing apparatus according to a first embodiment of the present invention includes two imaging sensors and two first color colour filter members Array (hereinafter often referred to as double color filter element array), imaging sensor is corresponded with first color colour filter element array, each Imaging sensor area having the same, sensing element quantity and arrangement mode;Each member color colour filter element array includes at least one The colour filter member of kind primary colors, the face for the colour filter member that the colour filter member that first yuan of color colour filter element array includes includes with binary color colour filter member Color is different, and two first color colour filter element array compositions have the panchromatic colour filter element array of whole primary colors.
Each imaging sensor is formed by sensing identical permutation, and light intensity signal is converted to electric signal, is become after digitlization The brightness value of light intensity.The panchromatic colour filter that two colour filter element array are made of two first color colour filter element array (meta- CFA) Element array (panchromatic-CFA).
In one example, whole primary colors are made of the first primary colors, the second primary colors, third primary color, such as RGB three is former Color.
1. pair color filter element array
The permutation and combination method example of various double color filter element array is provided below in conjunction with the accompanying drawings.In all figures and in text The no color of colourless expression, the colour filter member of all-transparent, is indicated with T (Transparency is transparent).R=Red is red in figure Color, G=Green greens, B=Blue blues, T=Transparency are transparent.
(1) the first example of double color filter element array
In the first example, first yuan of color colour filter element array is by the colour filter member of the first primary colors and the colour filter member of the second primary colors etc. Ratio arranges, and binary color colour filter element array is made of the colour filter member of third primary color.Fig. 2 shows the double of such case One specific example of color filter element array, a in wherein Fig. 2 show (or the first yuan of color filter of a member color colour filters element array Color element array), it is arranged by red blue dichromatism equal proportion, the b in Fig. 2 shows (or second yuan of b member color colour filters element array Color colour filter element array), wherein a kind of only color of green.First color colour filter element array (the i.e. first yuan of color colour filter element array of a+b two With binary color colour filter element array) constitute the panchromatic colour filter element array with red green blue tricolor.Double color filter element array First exemplary feature is distributed to three primary colors in a manner of 1+2 in two first color colour filter element array, for RGB three primary colors, Altogether there are three types of combination, in addition in Fig. 2 a and the examples that show together of b other than, it is also bluish-green+red, red green+blue equal two kinds it is double-colored+ Monochromatic first color colour filter element array, combination form panchromatic colour filter element array.Wherein monochromatic first color colour filter element array is substantially It is the colour filter of monochrome, with the low inherent advantage of manufacturing cost.
(2) the second example of double color filter element array
In the second example, first yuan of color colour filter element array is by the colour filter member of the first primary colors and the colour filter member of the second primary colors etc. Ratio arranges, colour filter member and colourless colour filter member equal proportion arrangement group of the binary color colour filter element array by third primary color At.A and b in Fig. 3 together illustrate a specific example of double color filter element array in the case of this kind, wherein a members color Colour filter element array is arranged by red blue dichromatism equal proportion, b members color colour filter element array by green, the arrangement of colourless dichromatism equal proportion and At.The first color colour filter element array of a+b two constitute the panchromatic colour filter element array with red green blue tricolor+colourless.Double colored filters The second exemplary feature of color element array be by three primary colors add it is colourless be distributed in a manner of 2+2 in two first color colour filter element array, Altogether there are three types of combination, in addition in Fig. 3 a and the examples that show together of b other than, also bluish-green+red nothing is red green+blue without two kinds equal Double-colored first color colour filter element array, combination form panchromatic colour filter element array.
(3) the third example of double color filter element array
In third example, first yuan of color colour filter element array is by the colour filter member of the first primary colors and the colour filter member of third primary color etc. Ratio arranges, and binary color colour filter element array is arranged by the colour filter member of the second primary colors and the colour filter member equal proportion of third primary color Composition.A and b in Fig. 4 together illustrate the specific example of double color filter element array in this case, and wherein a members color is filtered Color element array is arranged by bluish-green dichromatism equal proportion, and b member color colour filter element array is arranged by red green two color equal proportion.a+b Two first color colour filter element array constitute the panchromatic colour filter element array with red green blue tricolor.Double color filter element array thirds Exemplary feature is distributed to three primary colors in a manner of 2+2 in two first color colour filter element array, and there are three types of combinations altogether, in addition to figure Other than the example that a and b in 4 are shown together, also bluish-green+Lan Hong, two kinds of red green+Lan Hong etc. double-colored first color colour filter member battle array Row, combination form panchromatic colour filter element array.
Above-mentioned first enumerates to the exhaustive that the double color filter element array examples of third are not the present invention, is based on dual sensor The color of double color filters member be not limited to the standard of RGB, can be other forms, for example, red green blue tricolor can use blueness Yellow product red trichromatism substitution, colourless four of RGB can use the pinkish red colourless four colors substitution of bluish yellow.According to the double colored filters of above three Color element array embodiment, bluish yellow product red trichromatism or yellow pinkish red colourless four color can correspondingly form more examples.
2. the sample rate corresponding with double arrangement modes of color filter element array and image weight of colour image sensing equipment Structure method
(1) sample rate corresponding with double first examples of color filter element array and image reconstructing method
Double color filter element array of colour image sensing equipment using in such as Fig. 2 a and b together shown in a+b two The panchromatic colour filter element array with red green blue tricolor that a member color colour filter element array is formed, and a member color colour filter element array packets Colour filter member containing two kinds of colors, and b member color colour filters element array includes only then a kind of colour filter member of color;Colour image sensing equipment Double image sensor include two imaging sensors, described two imaging sensor areas having the same, sensing element numbers The identical sensor parameters such as amount and arrangement mode.In this example, b colour filter element array adds the achromatic map that imaging sensor is formed As sensor is fully sampled, and a colour filter element array adds two kinds of colors in the two tone image sensor that imaging sensor is formed to be 1/2 sampling, can reconstruct the image of two width monochrome using compressed sensing, interpolation scheduling algorithm, two sensors obtained three Primary colour image merges, and after the Color Image Processings algorithm such as noise reduction, sharpening, image enhancement, exports color digital image.
(2) sample rate corresponding with double second examples of color filter element array and image reconstructing method
Double color filter element array of colour image sensing equipment use as in Fig. 3 a and b together shown in a+b two The panchromatic colour filter element array with red green blue tricolor that first color colour filter element array is formed, in a, b member color colour filter element array Include the colour filter member of two kinds of colors, and b member color colour filter element array included two kinds of colors in there is a kind of color to be colourless;It is colored The double image sensor of image sensing apparatus includes two imaging sensors, described two imaging sensor faces having the same The identical sensor parameters such as product, sensing element quantity and arrangement mode.In the present embodiment, a, b colour filter element array add image sensing Two kinds of colors are 1/2 sampling in the two tone image sensor that device is formed, and can be reconstructed using compressed sensing, interpolation scheduling algorithm One width coloured image and a width gray level image.Wherein B colour filters element array adds the two tone image sensor that imaging sensor is formed In, the image that the obtained data of sensing element corresponding to colourless colour filter member obtain after reconstruct is gray level image.By coloured silk The fusion treatment scheduling algorithm of joint noise reduction, sharpening, image enhancement and the gray-scale map and cromogram of color image and gray level image Afterwards, color digital image is exported.
(3) sample rate corresponding with double third examples of color filter element array and image reconstructing method
Double color filter element array of colour image sensing equipment use as in Fig. 4 a and b together shown in a+b two The panchromatic colour filter element array with red green blue tricolor that first color colour filter element array is formed, and a, b member color colour filter element array are equal The colour filter member for including two kinds of colors, therefore, wherein it is the color having in two colour filter element array, such as Fig. 4 to have a kind of color In a and b in green.The double image sensor of colour image sensing equipment include two imaging sensors, described two The identical sensor parameters such as imaging sensor area having the same, sensing element quantity and arrangement mode.In the present embodiment, A, b colour filters element array adds two kinds of colors in the two tone image sensor that imaging sensor is formed to be 1/2 sampling, using compression Perception, interpolation scheduling algorithm can reconstruct the image of four width monochrome, and it is the same wherein to have the color of two images.This four width Monochrome image fusion becomes coloured image, after noise reduction, sharpening, image enhancement scheduling algorithm, exports color digital image.
Two, image sensing apparatus according to a second embodiment of the present invention
Image sensing apparatus according to a second embodiment of the present invention, including two imaging sensors and two first color colour filter members Array is referred to as the first imaging sensor and the second imaging sensor, first yuan of color colour filter element array and binary color filter Color element array, imaging sensor are corresponded with first color colour filter element array, and the sensing element quantity that the second imaging sensor has is more In the sensing element quantity that the first imaging sensor has;Each member color colour filter element array includes the colour filter of at least one color Member, the colour filter member quantity that binary color colour filter element array has are more than the colour filter member quantity that first yuan of color colour filter element array has; First and second yuan of colors colour filter element array composition has the panchromatic colour filter element array of whole primary colors.The image of second embodiment The difference of sensing equipment and the image sensing apparatus of first embodiment is:It is each in the image sensing apparatus of first embodiment Imaging sensor area having the same, sensing element quantity and arrangement mode;And in the image sensing apparatus of second embodiment, The sensing element quantity that second imaging sensor has is more than the sensing element quantity that the first imaging sensor has;Each member color colour filter Element array all includes the colour filter member of at least one color.
The permutation and combination side of double base color colour filter element array in image sensing apparatus according to second embodiment is described below Formula, imaging sensor and sample rate and image reconstructing method example.
1. the first example
Double color filter element array of color image sensor use the first color filters of the a+b two as shown in a and b in Fig. 5 The panchromatic colour filter element array with red green blue tricolor that color element array is formed, and a member color colour filter element array includes two kinds of face The colour filter member of color, and b member color colour filters element array includes only then a kind of colour filter member of color;The dual image of color image sensor passes Sensor includes two imaging sensors.Two imaging sensors have different sensing element quantity, and with b member color colour filters The corresponding imaging sensor of element array has the more sensing element numbers of imaging sensor more corresponding than a member color colour filter element array Amount.Correspondingly, b colour filters element array ratio a members color colour filter element array has more colour filters member.
In the embodiment shown in a and b in Fig. 5, the ratio of number of sensing element is a:B=36:64, but be embodied In, can have using a variety of different ratios, but on the whole, a:b<=1:2.In the present embodiment, b colour filter element array adds image The monochrome image sensor that sensor is formed is fully sampled, and a colour filter element array adds the bicolorable graph that imaging sensor is formed It is partial pixel sampling as two kinds of colors are 1/2 samplings in sensor, and for b monochrome image sensors.Using pressure Contracting perception, interpolation scheduling algorithm can reconstruct the monochrome image of two width both full-pixels, the list further obtained with another sensor Color image combines and forms coloured image, after the Color Image Processings algorithm such as noise reduction, sharpening, image enhancement, exports colored number Word image.
2. the second example
Double color filter element array of colour image sensing equipment use the first colors of a+b two as shown in a and b in Fig. 6 The panchromatic colour filter element array with red green blue tricolor that colour filter element array is formed includes in a, b member color colour filter element array The colour filter member of two kinds of colors, and b member color colour filter element array included two kinds of colors in there is a kind of color to be colourless;Coloured image The double image sensor of sensing equipment includes two imaging sensors.Two imaging sensors have different sensing elements Quantity, and imaging sensor corresponding with b member color colour filter element array is passed with image more corresponding than a member color colour filter element array The more sensing element quantity of sensor.Correspondingly, b colour filters element array ratio a members color colour filter element array has more colour filters member.Fig. 6 In a and b shown in embodiment in, the ratio of number of sensing element is a:B=36:64, but in specific implementation, may be used A variety of different ratios, but on the whole, a:b<=1:2.
In this example, a colour filter element array adds two kinds of colors in the two tone image sensor that imaging sensor is formed to be 1/2 Sampling, and be partial pixel sampling for b imaging sensors.It can be reconstructed using compressed sensing, interpolation scheduling algorithm The monochrome image of two width both full-pixels.B colour filter element array adds two kinds of colors in the two tone image sensor that imaging sensor is formed For 1/2 sampling, two width monochrome images can be reconstructed, wherein the obtained data of the sensing element corresponding to colourless colour filter member are passed through The image obtained after reconstruct is gray level image.The monochrome image that two sensors obtain combines and forms a width coloured image and a width Gray level image.By joint noise reduction, sharpening, image enhancement and the gray-scale map and cromogram of coloured image and gray level image After fusion treatment scheduling algorithm, color digital image is exported.
Description above is exemplary, and not restrictive or exhaustive, can be carried out within the scope of inventive concept Modification substitutes or expands.
For example, in image sensing apparatus hereinbefore, containing there are two imaging sensors and two first color colour filter element array, no It is preferable example to cross this, alternatively, can contain first color colour filter element array of more imaging sensors and corresponding number, such as Containing there are three imaging sensor and three first color colour filter element array, at this point it is possible to embodiment there are two types of having, one kind is each figure As sensor area, sensing element quantity and arrangement mode having the same;Another kind, which is at least two imaging sensors, to be had not With sensing element quantity, in two kinds of embodiments, imaging sensor is all corresponded with first color colour filter element array.
According to a third embodiment of the present invention, a kind of image reconstructing method is provided, is obtained from aforementioned image sensing apparatus Signal reconstructs coloured image, including:It is colored that each corresponding son is obtained based on the signal that each imaging sensor samples Image is based on each corresponding sub- coloured image, and synthesis obtains final full-color image, wherein in an imaging sensor In the case that corresponding member color colour filter element array includes the colour filter member of multiple primary colors, sampled based on described image sensor Signal obtains the sub- coloured image of monochrome for corresponding to each of multiple primary colors;In the corresponding first color colour filter member of an imaging sensor In the case that array includes the colour filter member of single primary colors, based on the signal that described image sensor samples, obtain corresponding single The sub- coloured image of monochrome of a primary colors;Include colourless colour filter member in the corresponding first color colour filter element array of an imaging sensor In the case of, based on the signal that described image sensor samples, also obtain corresponding grey scale image;And it is based on and each image The corresponding single sub- coloured image of sensor, and there are gray level image, it is also based on gray level image, synthesis is final Coloured image.
A, b, c in Fig. 8 show traditional coloured image preparation method and colorful digital according to the ... of the embodiment of the present invention Image obtainment method, a in wherein Fig. 8 is shown traditional to be made of single colour filter element array and single image sensor The signal acquisition of colour image sensing equipment carries out color digital image reconstruct to the signal of acquisition, then carries out colorful digital Image procossing and enhancing, finally obtain color digital image output;B in Fig. 8 shows traditional by single colour filter element array The signal of the acquisition of the colour image sensing equipment formed with single image sensor is by color digital image restructing algorithm Color digital image is obtained after reason, is then merged with the gray-scale image acquired in another imaging sensor and is carried out cromogram As processing and enhancing, color digital image output is obtained after enhancing;C in Fig. 8 shows according to the ... of the embodiment of the present invention by two The signal for the colour image sensing equipment that a colour filter element array and two imaging sensors are formed is via color digital image weight Structure algorithm obtains color digital image, after processing and enhancing, obtains color digital image output.
A kind of the method to sum up present invention offer colour image sensing equipment and obtain color digital image, is provided in particular in The colour image sensing equipment that a kind of double color filter element array and corresponding double image sensor are formed.Described is double colored Colour filter element array includes two first color colour filter element array, each first color colour filter element array in described two first color colour filter element array It all include the colour filter of one or two kinds of colors (it should be noted that color here refers to colour, including white, i.e., colourless) Member, two kinds of first color colour filter element array have a different colors, and the color of two first color colour filter element array combine to be formed it is panchromatic Color filter element array.The double image sensor includes two imaging sensors, first color colour filter element array covering It is corresponded in the sensing element on described image sensor surface and on imaging sensor.Double color filter element array And the colour image sensing equipment that corresponding double image sensor is formed constitutes coloured image camera plus components such as camera lenses. Output and known double color filter element array of the computing device of coloured image camera based on double image sensor are installed The arrangement mode of middle colour filter member, using image reconstruction algorithm, as interpolation algorithm, compressed sensing algorithm reconstruct coloured image Tri- color values of RGB form coloured image.The double image sensor and corresponding restructing algorithm, improve colour image sensing The anti-noise ability of equipment improves the accuracy of color reduction, to improve the performance of color image sensor.
In conclusion the innovative point of the colour image sensing equipment containing double image sensor of the embodiment of the present invention be with Lower aspect:
(1) double color filter element array, it is characterized in that:
Each first color colour filter element array includes the colour filter of one or two kinds of colors in (1.1) two first color colour filter element array Member,
(1.2) two first color colour filter element array have different colors,
(1.3) and the color of two first color colour filter element array combines to form panchromatic color filter element array;
(2) the colour image sensing equipment being made of double color filter element array and double image sensor, it is characterized in that:
(2.1) two color filter element array,
(2.2) two imaging sensors,
(2.3) two image sensor combinations form three primary colors output,
(2.4) or two image sensor combinations form four colors (for example, three primary colors add white) and export,
(2.5) after Color Image Processing and enhancing, coloured image is exported.
Colour image sensing equipment is the key modules of the mobile devices such as mobile phone, adds free hand drawing in traditional single colour filter element array As sensor combination under, the performance of color image sensor is already close to the limit.The present invention is colour image sensing equipment neck The important breakthrough in domain, can be widely used in that mobile phone etc. is small-sized, in mobile device, provide the quality of coloured image.It is of the present invention The colour image sensing equipment that double image sensor forms is added by double color filtration element array, colour signal obtain and coloured image Reconstruct etc. (c in Fig. 8) and traditional colour image sensing being made of single colour filter element array and single image sensor Device have essence difference, also add with traditional color image sensor the color digital image that gray level image sensor is formed at As system has the difference (a in Fig. 8 and b) of essence.
Image processing equipment according to a fourth embodiment of the present invention, including aforementioned image sensing apparatus and image processor, Wherein described image processor obtains each corresponding sub- coloured image, base based on the signal that each imaging sensor samples In each corresponding sub- coloured image, synthesis obtains final full-color image, wherein corresponding in an imaging sensor In the case that first color colour filter element array includes the colour filter member of multiple primary colors, image processor is sampled based on described image sensor The signal arrived obtains the sub- coloured image of monochrome for corresponding to each of multiple primary colors;In the corresponding first color filter of an imaging sensor In the case that color element array includes the colour filter member of single primary colors, letter that image processor is sampled based on prime number imaging sensor Number, obtain the sub- coloured image of monochrome for corresponding to single primary colors;Include in the corresponding first color colour filter element array of an imaging sensor In the case of colourless colour filter member, based on the signal that described image sensor samples, corresponding grey scale image is also obtained;And Image processor is based on single sub- coloured image corresponding with each imaging sensor, synthesizes final colo(u)r picture.
According to a fifth embodiment of the present invention, a kind of computing device, including aforementioned image processing equipment are provided.Computing device Can be smart mobile phone mobile phone, tablet computer, laptop, digital camera, DV etc..
Other than the above method and equipment, embodiments herein can also be computer program product comprising meter Calculation machine program instruction, it is above-mentioned that the computer program instructions make that the processor executes this specification when being run by processor The step in the data processing method according to the various embodiments of the application described in " illustrative methods " part.
The computer program product can be write with any combination of one or more programming languages for holding The program code of row the embodiment of the present application operation, described program design language includes object oriented program language, such as Java, C++ etc. further include conventional procedural programming language, such as " C " language or similar programming language.Journey Sequence code can be executed fully, partly execute on a user device, is independent soft as one on the user computing device Part packet executes, part executes or on a remote computing completely in remote computing device on the user computing device for part Or it is executed on server.
In addition, embodiments herein can also be computer readable storage medium, it is stored thereon with computer program and refers to It enables, the computer program instructions make the processor execute above-mentioned " the exemplary side of this specification when being run by processor The step in the data processing method according to the various embodiments of the application described in method " part.
The arbitrary combination of one or more readable mediums may be used in the computer readable storage medium.Readable medium can To be readable signal medium or readable storage medium storing program for executing.Readable storage medium storing program for executing for example can include but is not limited to electricity, magnetic, light, electricity Magnetic, the system of infrared ray or semiconductor, device or device, or the arbitrary above combination.Readable storage medium storing program for executing it is more specific Example (non exhaustive list) includes:Electrical connection, portable disc with one or more conducting wires, hard disk, random access memory Device (RAM), read-only memory (ROM), erasable programmable read only memory (EPROM or flash memory), optical fiber, portable compact disc Read-only memory (CD-ROM), light storage device, magnetic memory device or above-mentioned any appropriate combination.
Various embodiments of the present invention are described above, above description is exemplary, and non-exclusive, and It is not limited to disclosed each embodiment.Without departing from the scope and spirit of illustrated each embodiment, for this skill Many modifications and changes will be apparent from for the those of ordinary skill in art field.Therefore, protection scope of the present invention is answered This is subject to the protection scope in claims.

Claims (10)

1. a kind of image sensing apparatus, including two imaging sensors and two first color colour filter element array, imaging sensor and member Color colour filter element array corresponds,
Each imaging sensor area, sensing element quantity and arrangement mode having the same;
Each member color colour filter element array includes the colour filter member of at least one primary colors, the colour filter that first yuan of color colour filter element array includes Member is different from the color for the colour filter member that binary color colour filter member includes, and two first color colour filter element array compositions have whole primary colors Panchromatic colour filter element array.
2. image sensing apparatus according to claim 1, which is characterized in that the whole primary colors is by the first primary colors, second Primary colors, third primary color composition.
3. image sensing apparatus according to claim 2, which is characterized in that first yuan of color colour filter element array is by the first primary colors Colour filter member and the colour filter member equal proportion of the second primary colors arrange, binary color colour filter element array by third primary color colour filter member Composition.
4. image sensing apparatus according to claim 2, which is characterized in that first yuan of color colour filter element array is by the first primary colors Colour filter member and the colour filter member equal proportion of the second primary colors arrange, binary color colour filter element array by third primary color colour filter member It is rearranged with colourless colour filter member equal proportion.
5. a kind of image sensing apparatus, including two imaging sensors and two first color colour filter element array, are referred to as first Imaging sensor and the second imaging sensor, first yuan of color colour filter element array and binary color colour filter element array, imaging sensor It is corresponded with first color colour filter element array,
The sensing element quantity that second imaging sensor has is more than the sensing element quantity that the first imaging sensor has;
Each member color colour filter element array includes the colour filter member of at least one color, the colour filter that binary color colour filter element array has First quantity is more than the colour filter member quantity that first yuan of color colour filter element array has;First and second yuan of colors colour filter element array composition Panchromatic colour filter element array with whole primary colors.
6. a kind of image sensing apparatus, including more than two imaging sensor and more than two first color colour filter element array, figure Picture sensor is corresponded with first color colour filter element array,
Each imaging sensor area, sensing element quantity and arrangement mode having the same;
Each member color colour filter element array includes the colour filter member of at least one primary colors, the colour filter that different member color colour filter element array include First different, described two above first color colour filter element array compositions have the panchromatic colour filter element array of whole primary colors.
7. a kind of image sensing apparatus, including more than two imaging sensor and more than two first color colour filter element array, figure Picture sensor is corresponded with first color colour filter element array,
At least two imaging sensors have different sensing element quantity;
Each member color colour filter element array includes the colour filter member of at least one primary colors, the colour filter that different member color colour filter element array include First different, described two above first color colour filter element array compositions have the panchromatic colour filter element array of whole primary colors.
8. a kind of image processing equipment, including such as claim 1 to 7 any one of them image sensing apparatus and image procossing Device,
Wherein described image processor obtains each corresponding sub- cromogram based on the signal that each imaging sensor samples Picture is based on each corresponding sub- coloured image, and synthesis obtains final full-color image,
Wherein in the case where the corresponding first color colour filter element array of an imaging sensor includes the colour filter member of multiple primary colors, image The signal that processor is sampled based on described image sensor obtains the sub- cromogram of monochrome for corresponding to each of multiple primary colors Picture;In the case where the corresponding first color colour filter element array of an imaging sensor includes the colour filter member of single primary colors, image procossing The signal that device is sampled based on prime number imaging sensor obtains the sub- coloured image of monochrome for corresponding to single primary colors;Scheme at one In the case of including colourless colour filter member as the corresponding first color colour filter element array of sensor, sampled based on described image sensor The signal arrived also obtains corresponding grey scale image;And image processor is based on single son coloured silk corresponding with each imaging sensor Color image synthesizes final colo(u)r picture.
9. a kind of computing device, including image processing equipment as claimed in claim 8.
10. a kind of reconstructing coloured image using the signal that such as claim 1 to 7 any one of them image sensing apparatus obtains Image reconstructing method, including
Each corresponding sub- coloured image is obtained based on the signal that each imaging sensor samples, is based on each correspondence Sub- coloured image, synthesis obtain final full-color image,
Wherein in the case where the corresponding first color colour filter element array of an imaging sensor includes the colour filter member of multiple primary colors, it is based on The signal that described image sensor samples obtains the sub- coloured image of monochrome for corresponding to each of multiple primary colors;
In the case where the corresponding first color colour filter element array of an imaging sensor includes the colour filter member of single primary colors, based on described The signal that imaging sensor samples obtains the sub- coloured image of monochrome for corresponding to single primary colors;
In the case where the corresponding first color colour filter element array of an imaging sensor includes colourless colour filter member, it is based on described image The signal that sensor sample obtains also obtains corresponding grey scale image;And
Based on single sub- coloured image corresponding with each imaging sensor, and there are gray level image, go back base In gray level image, final colo(u)r picture is synthesized.
CN201810439116.3A 2018-05-09 2018-05-09 Image sensing apparatus, image processing equipment, computing device and image reconstructing method Pending CN108391102A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810439116.3A CN108391102A (en) 2018-05-09 2018-05-09 Image sensing apparatus, image processing equipment, computing device and image reconstructing method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810439116.3A CN108391102A (en) 2018-05-09 2018-05-09 Image sensing apparatus, image processing equipment, computing device and image reconstructing method

Publications (1)

Publication Number Publication Date
CN108391102A true CN108391102A (en) 2018-08-10

Family

ID=63070759

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810439116.3A Pending CN108391102A (en) 2018-05-09 2018-05-09 Image sensing apparatus, image processing equipment, computing device and image reconstructing method

Country Status (1)

Country Link
CN (1) CN108391102A (en)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102348075A (en) * 2010-07-23 2012-02-08 美商豪威科技股份有限公司 Image sensor with dual element color filter array and three channel color output
KR20130020435A (en) * 2011-08-19 2013-02-27 한경대학교 산학협력단 Apparatus and method for reconstructing color image based on multi-spectrum using bayer color filter array camera
US20140160326A1 (en) * 2012-12-06 2014-06-12 Aptina Imaging Corporation Color filter arrangements for fused array imaging systems
US20150109494A1 (en) * 2012-07-06 2015-04-23 Fujifilm Corporation Color imaging element and imaging device
CN105578066A (en) * 2015-12-18 2016-05-11 广东欧珀移动通信有限公司 Imaging method, imaging device and electronic device
CN107707789A (en) * 2016-08-08 2018-02-16 谷歌有限责任公司 Monochromatic color mapping is carried out using monochromatic imager and color mapped sensors
CN208820948U (en) * 2018-05-09 2019-05-03 清华大学 Image sensing apparatus

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102348075A (en) * 2010-07-23 2012-02-08 美商豪威科技股份有限公司 Image sensor with dual element color filter array and three channel color output
KR20130020435A (en) * 2011-08-19 2013-02-27 한경대학교 산학협력단 Apparatus and method for reconstructing color image based on multi-spectrum using bayer color filter array camera
US20150109494A1 (en) * 2012-07-06 2015-04-23 Fujifilm Corporation Color imaging element and imaging device
US20140160326A1 (en) * 2012-12-06 2014-06-12 Aptina Imaging Corporation Color filter arrangements for fused array imaging systems
CN105578066A (en) * 2015-12-18 2016-05-11 广东欧珀移动通信有限公司 Imaging method, imaging device and electronic device
CN107707789A (en) * 2016-08-08 2018-02-16 谷歌有限责任公司 Monochromatic color mapping is carried out using monochromatic imager and color mapped sensors
CN208820948U (en) * 2018-05-09 2019-05-03 清华大学 Image sensing apparatus

Similar Documents

Publication Publication Date Title
US8462238B2 (en) Camera design for the simultaneous capture of near-infrared and visible images
EP2664153B1 (en) Imaging system using a lens unit with longitudinal chromatic aberrations and method of operating
CN107534735B (en) Image processing method, device and the terminal of terminal
CN105430359B (en) Imaging method, imaging sensor, imaging device and electronic device
TWI504276B (en) Image sensor for capturing a color image
CN1971927B (en) Physical information acquiring method, physical information acquiring device and semiconductor device
US8031243B2 (en) Apparatus, method, and medium for generating image
JP2009511960A (en) System and method for high performance color filter mosaic array
JP2004228662A (en) Image pickup apparatus
CN106911876A (en) For the method and apparatus of output image
CN111131798B (en) Image processing method, image processing apparatus, and imaging apparatus
CN108712608A (en) Terminal device image pickup method and device
CN107431770A (en) Adaptive line brightness domain video pipeline framework
CN108419022A (en) Control method, control device, computer readable storage medium and computer equipment
CN108024054A (en) Image processing method, device and equipment
CN110493583A (en) Image processing method, device, electronic equipment and computer readable storage medium
CN208820948U (en) Image sensing apparatus
CN101288296A (en) Reconstructing a full color image from an image encoded by a bayer pattern
CN108370422A (en) Visible and near-infrared image system and method are acquired using single matrix sensor
CN106791734A (en) The method of device, electronic installation and IMAQ for IMAQ
CN102801984A (en) Color image sensor and method for acquiring color digital images
CN101282486A (en) Image processing device
CN109005363A (en) Image formation control method, device, electronic equipment and storage medium
CN108391102A (en) Image sensing apparatus, image processing equipment, computing device and image reconstructing method
Matasaru Mobile phone camera possibilities for spectral imaging

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination