CN106534822A - Control method, control device, and electronic device - Google Patents
Control method, control device, and electronic device Download PDFInfo
- Publication number
- CN106534822A CN106534822A CN201611079139.5A CN201611079139A CN106534822A CN 106534822 A CN106534822 A CN 106534822A CN 201611079139 A CN201611079139 A CN 201611079139A CN 106534822 A CN106534822 A CN 106534822A
- Authority
- CN
- China
- Prior art keywords
- pixel
- image
- unit
- merging
- original
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/10—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/40—Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled
- H04N25/41—Extracting pixel data from a plurality of image sensors simultaneously picking up an image, e.g. for increasing the field of view by combining the outputs of a plurality of sensors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/40—Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled
- H04N25/44—Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled by partially reading an SSIS array
- H04N25/447—Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled by partially reading an SSIS array by preserving the colour pattern with or without loss of information
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/64—Circuits for processing colour signals
- H04N9/646—Circuits for processing colour signals for image enhancement, e.g. vertical detail restoration, cross-colour elimination, contour correction, chrominance trapping filters
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/64—Circuits for processing colour signals
- H04N9/73—Colour balance circuits, e.g. white balance circuits or colour temperature control
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/79—Processing of colour television signals in connection with recording
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Color Television Image Signal Generators (AREA)
Abstract
The invention discloses a control method of an electronic device. The method comprises steps of: firstly, controlling an image sensor to output the combined image and the color block image of the same scene; secondly, converting the color block image into an imitated original image and converting the imitated original image into an imitated original true color image; Then, converting the combined image into a combined true color image; next, determining whether or not the remaining capacity of the memory is less than or equal to a predetermined threshold; and finally, if yes, saving the combined true color image or the imitated original true color image according to the image parameters, and saving the combined true color image and the imitated original true color image if not. In addition, the present invention also discloses a control device and an electronic device. The control method, the control device and the electronic device according to the invention save the combined true color image and/or the imitated original true color image according to the capacity of the memory and the image parameters so as to avoid blindness of fixedly saving one of the images or simultaneously saving the two images, thereby improving customer satisfaction.
Description
Technical field
The present invention relates to imaging technique, more particularly to a kind of control method, control device and electronic installation.
Background technology
A kind of existing imageing sensor includes sensitive pixel elements array and is arranged on sensitive pixel elements array
Filter unit array, each filter unit array cover one sensitive pixel elements of correspondence, each sensitive pixel elements bag
Include multiple photosensitive pixels.During work, image sensor exposure output can be controlled and merge image, be merged image and can pass through image
Processing method changes into merging rgb image and preserves.Merging image includes merging pel array, same photosensitive pixel list
Multiple photosensitive pixels of unit merge output as corresponding merging pixel.Thus, the signal to noise ratio for merging image can be improved, so
And, the resolution for merging image is reduced.It is of course also possible to control the patch image that image sensor exposure exports high pixel, color
Block image includes original pixel array, each photosensitive pixel one original pixels of correspondence.However, due to same filter unit pair
The multiple original pixels colors answered are identical, cannot equally improve the resolution of patch image.Accordingly, it would be desirable to pass through interpolation calculation
High pixel patch image is changed into mode the imitative original image of high pixel, and imitative original image can include imitative in Bel's array arrangement
Original pixel.Imitative original image can change into imitative original rgb image by image processing method and preserve.In actual applications,
Respective advantage is respectively present due to merging rgb image and imitating original rgb image, is preserved at random or fixed selection is preserved wherein
A kind of image may choose a kind of ropy image, and two kinds of images are all preserved and can waste hardware resource.
The content of the invention
It is contemplated that at least solving one of technical problem present in prior art.For this purpose, the present invention needs offer one
Plant control method, control device and electronic installation.
A kind of control method, for controlling electronic installation, the electronic installation includes imaging device and memorizer, it is described into
As device includes imageing sensor, described image sensor includes sensitive pixel elements array and is arranged on the photosensitive pixel list
Filter unit array on element array, each described filter unit array cover one sensitive pixel elements of correspondence,
Each described sensitive pixel elements includes multiple photosensitive pixels, and the control method is comprised the following steps:
The merging image and patch image of control described image sensor output Same Scene, the merging image include closing
And pel array, multiple photosensitive pixels merging outputs of the same sensitive pixel elements are used as a merging pixel, institute
Stating patch image includes the image pixel elements of predetermined array arrangement, and described image pixel cell includes multiple original pixels, often
One original pixels of the individual photosensitive pixel correspondence;
The patch image is changed into into imitative original image, the imitative original image includes the imitative original pixel of array arrangement, described
Imitative original pixel includes current pixel, and the original pixels include associated pixel corresponding with the current pixel, it is described will be described
The step of patch image changes into the imitative original image comprises the following steps:
Judge whether the color of the current pixel is identical with the color of the associated pixel;
When the color of the current pixel is identical with the color of the associated pixel, by the pixel value of the associated pixel
As the pixel value of the current pixel;With
When the color of the current pixel is different from the color of the associated pixel, according to the pixel of associated pixel unit
Value calculates the pixel value of the current pixel by the first interpolation algorithm, and described image pixel cell includes the associated pixel list
Unit, the color of the associated pixel unit are identical with the current pixel and adjacent with the current pixel;
The merging image is changed into into merging rgb image;
The imitative original image is changed into into imitative original rgb image;
Judge the residual capacity of the memorizer whether less than or equal to predetermined threshold;
When the residual capacity is less than or equal to the predetermined threshold, according to the merging rgb image and the imitative original
The image parameter of rgb image selects to preserve the merging rgb image or the imitative former rgb image to the memorizer;With
When the residual capacity is more than the predetermined threshold, the merging rgb image and the imitative former true coloured picture are preserved
Picture.
In some embodiments, the predetermined array includes Bel's array.
In some embodiments, described image pixel cell includes the original pixels of 2*2 arrays.
In some embodiments, the pixel value according to associated pixel unit is by described in the calculating of the first interpolation algorithm
The step of pixel value of current pixel, comprises the following steps:
Calculate the gradual change amount in the associated pixel all directions;
Calculate the weight in the associated pixel all directions;With
According to the gradual change amount and current pixel described in the weight calculation pixel value.
In some embodiments, the control method is inserted by first in the pixel value according to associated pixel unit
Comprise the following steps before the step of value-based algorithm calculates the pixel value of the current pixel:
White balance compensation is done to the patch image;
The control method is in the pixel value according to associated pixel unit by working as described in the calculating of the first interpolation algorithm
Comprise the following steps after the step of pixel value of preceding pixel:
White balance compensation reduction is done to the imitative original image.
In some embodiments, the control method is inserted by first in the pixel value according to associated pixel unit
Comprise the following steps before the step of value-based algorithm calculates the pixel value of the current pixel:
Compensating bad point is done to the patch image.
In some embodiments, the control method is inserted by first in the pixel value according to associated pixel unit
Comprise the following steps before the step of value-based algorithm calculates the pixel value of the current pixel:
Crosstalk compensation is done to the patch image.
In some embodiments, the control method is inserted by first in the pixel value according to associated pixel unit
Comprise the steps after the step of value-based algorithm calculates the pixel value of the current pixel:
Carry out lens shape correction, demosaicing, noise reduction and edge sharpening to process to the imitative original image.
In some embodiments, described change into the merging image includes following step at the step of merging rgb image
Suddenly:
Using the second interpolation algorithm by the merging image change into it is corresponding with the imitative original image go back original image, it is described
The complexity of the second interpolation algorithm is less than first interpolation algorithm;With
The original image of going back is changed into into the merging rgb image.
A kind of control device, for controlling electronic installation, the electronic installation includes imaging device and memorizer, it is described into
As device includes imageing sensor, described image sensor includes sensitive pixel elements array and is arranged on the photosensitive pixel list
Filter unit array on element array, each described filter unit array cover one sensitive pixel elements of correspondence,
Each described sensitive pixel elements includes multiple photosensitive pixels, and the control device includes the first control module, the first conversion mould
Block, the second conversion module, the 3rd conversion module, judge module, the first preserving module and the second preserving module.
First control module is used for the merging image and color lump figure for controlling described image sensor output Same Scene
Picture, the merging image include merging pel array, and multiple photosensitive pixels of the same sensitive pixel elements merge output and make
For a merging pixel, the patch image includes the image pixel elements of predetermined array arrangement, described image pixel list
Unit includes multiple original pixels, each one described original pixels of the photosensitive pixel correspondence.
For the patch image is changed into imitative original image, the imitative original image includes array to first conversion module
The imitative original pixel of arrangement, the imitative original pixel include current pixel, and the original pixels include corresponding with the current pixel
Associated pixel, first conversion module include judging unit, the first computing unit and the second computing unit.
The judging unit is used to judge whether the color of the current pixel is identical with the color of the associated pixel.
First computing unit for the color in the current pixel it is identical with the color of the associated pixel when, will
Pixel value of the pixel value of the associated pixel as the current pixel.
Second computing unit for the color in the current pixel it is different from the color of the associated pixel when, root
The pixel value of the current pixel, described image pixel list are calculated by the first interpolation algorithm according to the pixel value of associated pixel unit
Unit includes the associated pixel unit, the color of the associated pixel unit it is identical with the current pixel and with the current picture
Element is adjacent.
Second conversion module for by it is described merging image change into merging rgb image.
3rd conversion module imitates original rgb image for the imitative original image is changed into.
Whether the judge module is used for the residual capacity for judging the memorizer less than or equal to predetermined threshold.
First preserving module for the residual capacity be less than or equal to the predetermined threshold when, according to the conjunction
And the image parameter of rgb image and the imitative former rgb image selects to preserve the merging rgb image or described imitative former very color
Image is to the memorizer.
Second preserving module is for when the residual capacity is more than the predetermined threshold, the preservation merging is very color
Image and the imitative former rgb image.
In some embodiments, the predetermined array includes Bel's array.
In some embodiments, described image pixel cell includes the original pixels of 2*2 arrays.
In some embodiments, second computing unit include the first computation subunit, the second computation subunit and
3rd computation subunit.
First computation subunit is used to calculate the gradual change amount in the associated pixel all directions.
Second computation subunit is used to calculate the weight in the associated pixel all directions.
3rd computation subunit for according to the gradual change amount and current pixel described in the weight calculation pixel
Value.
In some embodiments, first conversion module includes that white balance compensation unit and white balance compensation reduction are single
Unit.
The white balance compensation unit is for doing white balance compensation to the patch image.
The white balance compensation reduction unit is reduced for white balance compensation is done to the imitative original image.
In some embodiments, first conversion module includes compensating bad point unit.
The compensating bad point unit is for doing compensating bad point to the patch image.
In some embodiments, first conversion module includes crosstalk compensation unit.
The crosstalk compensation unit is for doing crosstalk compensation to the patch image.
In some embodiments, first conversion module includes processing unit.
The processing unit is sharp for carrying out lens shape correction, demosaicing, noise reduction and edge to the imitative original image
Change is processed.
In some embodiments, second conversion module includes the first conversion unit and the second conversion unit.
First conversion unit for using the second interpolation algorithm by it is described merging image change into and the imitative artwork
Original image is gone back as corresponding, the complexity of second interpolation algorithm is less than first interpolation algorithm;With
Second conversion unit is for changing into the merging rgb image by the original image of going back.
A kind of electronic installation includes imaging device, memorizer and the control device.
In some embodiments, the electronic installation includes mobile phone or panel computer.
In some embodiments, the imaging device includes Front camera or rearmounted camera.
The control method of the present invention, control device and electronic installation are preserved according to the capacity and image parameter of memorizer and are merged
Rgb image and/or imitative original rgb image, it is to avoid fixed to preserve one of which image or while preserve that two kinds of images bring is blind
Mesh, improves user satisfaction.
The additional aspect and advantage of the present invention will be set forth in part in the description, and partly will become from the following description
Obtain substantially, or recognized by the practice of the present invention.
Description of the drawings
The above-mentioned and/or additional aspect and advantage of the present invention will become from the description with reference to accompanying drawings below to embodiment
Substantially with it is easy to understand, wherein:
Fig. 1 is the schematic flow sheet of the control method of embodiment of the present invention.
Fig. 2 is another schematic flow sheet of the control method of embodiment of the present invention.
Fig. 3 is the high-level schematic functional block diagram of the control device of embodiment of the present invention.
Fig. 4 is the high-level schematic functional block diagram of the first conversion module of embodiment of the present invention.
Fig. 5 is the high-level schematic functional block diagram of the electronic installation of embodiment of the present invention.
Fig. 6 is the module diagram of the imageing sensor of embodiment of the present invention.
Fig. 7 is the circuit diagram of the imageing sensor of embodiment of the present invention.
Fig. 8 is the schematic diagram of the filter unit of embodiment of the present invention
Fig. 9 is the structural representation of the imageing sensor of embodiment of the present invention.
Figure 10 is the merging image state schematic diagram of embodiment of the present invention.
Figure 11 is the view of the patch image of embodiment of the present invention.
Figure 12 is the view of the control method of embodiment of the present invention.
Figure 13 is the schematic flow sheet of the control method of some embodiments of the invention.
Figure 14 is the high-level schematic functional block diagram of the second computing unit of some embodiments of the invention.
Figure 15 is the schematic flow sheet of the control method of some embodiments of the invention.
Figure 16 is the high-level schematic functional block diagram of the first conversion module of some embodiments of the invention.
Figure 17 is the image pixel elements schematic diagram of the patch image of some embodiments of the invention.
Figure 18 is the schematic flow sheet of the control method of some embodiments of the invention.
Figure 19 is the high-level schematic functional block diagram of the first conversion module of some embodiments of the invention.
Figure 20 is the schematic flow sheet of the control method of some embodiments of the invention.
Figure 21 is the high-level schematic functional block diagram of the second conversion module of some embodiments of the invention.
Main element symbol description:
Electronic installation 1000, imaging device 100, imageing sensor 10, sensitive pixel elements array 12, sensitive pixel elements
12a, photosensitive pixel subelement 120, photosensitive pixel 122, sensor devices 1222, transfer tube 1224, source follower 124, modulus
Transducer 126, adder 128, filter unit array 14, filter unit 14a, control device 200, the first control module
210th, the first conversion module 220, the second conversion module 230, the 3rd conversion module 240, judge module 250, the first preserving module
260th, the second preserving module 270, judging unit 221, the first computing unit 222, the second computing unit 223, first calculate son list
First 2232, second computation subunit 2234, the 3rd computation subunit 2236, the reduction of white balance compensation unit 224, white balance compensation
Unit 225, compensating bad point unit 226, crosstalk compensation unit 227, processing unit 228, the first conversion unit 232, second are converted
Unit 234.
Specific embodiment
Embodiments of the present invention are described below in detail, the embodiment of the embodiment is shown in the drawings, wherein
Same or similar label represents same or similar element or the element with same or like function from start to finish.Lead to below
It is exemplary to cross the embodiment being described with reference to the drawings, and is only used for explaining the present invention, and it is not intended that to limit of the invention
System.
Refer to Fig. 1, the control method of embodiment of the present invention, for controlling electronic installation 1000, electronic installation 1000
Including imaging device 100 and memorizer, imaging device 100 includes imageing sensor 10, and imageing sensor 10 includes photosensitive pixel
Cell array 12 and the filter unit array 14 being arranged on sensitive pixel elements array 12, each filter unit array 14
One sensitive pixel elements 12a of correspondence is covered, each sensitive pixel elements 12a includes multiple photosensitive pixels 122, control method bag
Include following steps:
S210:The merging image and patch image of control imageing sensor output Same Scene, merging image includes merging
Pel array, multiple photosensitive pixels of same sensitive pixel elements merge output as a merging pixel, and patch image includes
The image pixel elements of predetermined array arrangement, image pixel elements include multiple original pixels, each photosensitive pixel correspondence one
Original pixels;
S220:Patch image is changed into into imitative original image, imitative original image includes the imitative original pixel of array arrangement, imitate original pixel
Including current pixel, original pixels include associated pixel corresponding with current pixel;
S230:Image will be merged and change into merging rgb image;
S240:Imitative original image is changed into into imitative original rgb image;
S250:Judge the residual capacity of memorizer whether less than or equal to predetermined threshold;
S260:When residual capacity is less than or equal to predetermined threshold, according to merging rgb image and imitative original rgb image
Image parameter is selected to preserve and merges rgb image or imitative original rgb image to memorizer;With
S270:When residual capacity is more than predetermined threshold, preserves and merge rgb image and imitative original rgb image.
Fig. 2 is referred to, in some embodiments, step S220 is comprised the following steps:
S221:Judge whether the color of current pixel is identical with the color of associated pixel;
S222:In the color of current pixel and the identical color of associated pixel, using the pixel value of associated pixel as work as
The pixel value of preceding pixel;With
S223:In the color of current pixel and the different color of associated pixel, according to the pixel value of associated pixel unit
The pixel value of current pixel is calculated by the first interpolation algorithm, image pixel elements include associated pixel unit, associated pixel list
The color of unit is identical with current pixel and adjacent with current pixel.
Refer to Fig. 3 and Fig. 4, the control device 200 of embodiment of the present invention, for controlling electronic installation 1000, electronics
Device 1000 includes imaging device 100 and memorizer, and imaging device 100 includes imageing sensor 10, and imageing sensor 10 includes
Sensitive pixel elements array 12 and the filter unit array 14 being arranged on sensitive pixel elements array 12, each optical filter list
Element array 14 covers one sensitive pixel elements 12a of correspondence, and each sensitive pixel elements 12a includes multiple photosensitive pixels 122, controls
Device processed 200 include the first control module 210, the first conversion module 220, the second conversion module 230, the 3rd conversion module 240,
Judge module 250, the first preserving module 260, the second preserving module 270.First control module 210 is used to control imageing sensor
The merging image and patch image of 10 output Same Scenes, merging image includes merging pel array, same sensitive pixel elements
Multiple photosensitive pixels 122 of 12a merge output as a merging pixel, and patch image includes the image slices of predetermined array arrangement
Plain unit, image pixel elements include multiple original pixels, each one original pixels of correspondence of photosensitive pixel 122.First conversion
For patch image is changed into imitative original image, imitative original image includes the imitative original pixel of array arrangement to module 220, imitates original pixel bag
Current pixel is included, original pixels include associated pixel corresponding with current pixel, and the first conversion module 220 includes judging unit
221st, the first computing unit 222 and the second computing unit 223.Judging unit 221 is used to judge the color of current pixel and associate
Whether the color of pixel is identical.First computing unit 222 in the color of current pixel and the identical color of associated pixel,
Using the pixel value of associated pixel as current pixel pixel value.Second computing unit 223 for the color in current pixel with
When the color of associated pixel is different, the picture of current pixel is calculated according to the pixel value of associated pixel unit by the first interpolation algorithm
Element value, image pixel elements include associated pixel unit, the color of associated pixel unit it is identical with current pixel and with current picture
Element is adjacent.Second conversion module 230 changes into merging rgb image for will merge image.3rd conversion module 240 is used for will
Imitative original image changes into imitative original rgb image.Judge module 250 is used to judge whether the residual capacity of memorizer is less than or equal to
Predetermined threshold.First preserving module 260 for residual capacity be less than or equal to predetermined threshold when, according to merge rgb image and
The image parameter of imitative original rgb image is selected to preserve and merges rgb image or imitative original rgb image to memorizer.Second preserving module
270 merge rgb image and imitative original rgb image for when residual capacity is more than predetermined threshold, preserving.
In other words, step S210 can be realized by the first control module 210 that step S220 can be by the first conversion module
220 realize, step S230 can be realized by the second conversion module 230 that step S240 can be realized by the 3rd conversion module 240,
Step S250 can be realized by judge module 250 that step S260 can be realized by the first preserving module 260, and step S270 can be with
Realized by the second preserving module 270.
Fig. 5 is referred to, the electronic installation 1000 of embodiment of the present invention includes imaging device 100, memorizer and the present invention
The control device 200 of embodiment, in other words the control device 200 of embodiment of the present invention can apply to enforcement of the present invention
The electronic installation 1000 of mode.
The control method of the present invention, control device 200 and electronic installation 1000 are according to the capacity and image parameter of memorizer
Preserve and merge rgb image and/or imitative original rgb image, it is to avoid be fixed to preserve one of which image or while preserve two kinds of images
The blindness brought, improves user satisfaction.
In some embodiments, electronic installation 1000 includes that the electronics that mobile phone or panel computer etc. possess imaging device sets
Standby, here does not do any restriction.The electronic installation 1000 of embodiment of the present invention is mobile phone.
In some embodiments, imaging device 100 includes Front camera or rearmounted camera.
It is appreciated that in the case where the residual capacity of the memorizer of electronic installation 1000 is enough, conjunction can be preserved simultaneously
And rgb image and imitative original rgb image.
So, it is possible to use merge rgb image and the respective advantage of imitative original rgb image so that user can be according to certainly
The demand of body selects any one image.
It is appreciated that in the case of the residual capacity deficiency of the memorizer of electronic installation 1000, control device 200 can root
Selected according to the image parameter for merging rgb image and imitative original rgb image.
Thus, can avoid while storing the huge load that two images are brought to memorizer.
In some embodiments, the image parameter for merging rgb image and imitative original rgb image can be white balance compensation
Parameter.According to the white balance compensation parameter of two images, it is determined that the wherein more high image of quality is preserved.
In some embodiments, the image parameter for merging rgb image and imitating original rgb image can be the contrast of image
Value.By contrast formula algorithm, it can be determined that whether the focusing of two images is accurate, judges the focusing of which image in other words more
Accurately, focus accurate image to ensure the definition of the image for preserving so as to retain.Contrast formula algorithm is existing image pair
Burnt algorithm, here are not detailed.
In some embodiments, the image parameter for merging rgb image and imitative original rgb image can be brightness of image
Value.When image brightness values exceed luminance threshold, imitative original rgb image can be preserved to improve the resolution of image.It is bright in image
When angle value is less than or equal to luminance threshold, can preserve and merge image with using the effect of merging pixel to improve imageing sensor
10 photoperceptivity.
Fig. 6 to Fig. 9 is seen also, the imageing sensor 10 of embodiment of the present invention includes sensitive pixel elements array 12
With the filter unit array 14 being arranged on sensitive pixel elements array 12.
Further, sensitive pixel elements array 12 includes multiple sensitive pixel elements 12a, each sensitive pixel elements
12a includes multiple adjacent photosensitive pixels 122.Each photosensitive pixel 122 includes sensor devices 1222 and a transfer tube
1224, wherein, sensor devices 1222 can be photodiode, and transfer tube 1224 can be MOS transistor.
Filter unit array 14 includes multiple filter units 14a, and each filter unit 14a covers one sense of correspondence
Light pixel unit 12a.
Specifically, in some examples, filter unit array 14 includes Bayer array, in other words, adjacent four
Filter unit 14a is respectively red filter blade unit, a blue filter blade unit and two green filter blade units.
Filter unit 14a of the same color of each sensitive pixel elements 12a correspondences, if sensitive pixel elements
Include altogether n adjacent sensor devices 1222 in 12a, then filter unit 14a covers sensitive pixel elements
N sensor devices 1222 in 12a, filter unit 14a can be Construction integrations, it is also possible to be filtered by n independent son
Piece assembly and connection is together.
In some embodiments, each sensitive pixel elements 12a includes four adjacent photosensitive pixels 122, adjacent two
Individual photosensitive pixel 122 collectively forms a photosensitive pixel subelement 120, photosensitive pixel subelement 120 also include a source electrode with
With device 124 and an analog-digital converter 126.Sensitive pixel elements 12a also includes an adder 128.Wherein, a light-sensitive image
One termination electrode of each transfer tube 1224 in sub-prime unit 120 is connected to the cathode electrode of correspondence sensor devices 1222, often
The other end of individual transfer tube 1224 is commonly connected to the gate electrode of source follower 124, and passes through 124 source of source follower
Pole electrode is connected to an analog-digital converter 126.Wherein, source follower 124 can be MOS transistor.Two photosensitive pixels
Subelement 120 is connected to adder 128 by respective source follower 124 and analog-digital converter 126.
In other words, adjacent four in a sensitive pixel elements 12a of the imageing sensor 10 of embodiment of the present invention
Individual sensor devices 1222 share filter unit 14a with color, each correspondence of sensor devices 1,222 one transmission of connection
Pipe 1224, the shared source follower 124 of two neighboring sensor devices 1222 and an analog-digital converter 126, adjacent four
Individual sensor devices 1222 share an adder 128.
Further, four adjacent sensor devices 1222 are in 2*2 array arrangements.Wherein, a photosensitive pixel subelement
Two sensor devices 1222 in 120 may be at same row.
In imaging, when the two photosensitive pixel subelements 120 covered under same filter unit 14a, four senses in other words
When optical device 1222 exposes simultaneously, pixel can be merged and then exportable merging image.
Specifically, sensor devices 1222 are for being converted into electric charge by illumination, and the electric charge for producing is proportional to intensity of illumination
Relation, transfer tube 1224 is for being turned on or off come control circuit according to control signal.When circuit turn-on, source follower
124 for being converted into voltage signal by the charge signal that 1222 Jing illumination of sensor devices is produced.Analog-digital converter 126 is used for voltage
Signal is converted to digital signal.Adder 128 is exported jointly for two ways of digital signals is added.
Figure 10 is referred to, the imageing sensor 10 of embodiment of the present invention can with the imageing sensor 10 of 16M for example
So that the photosensitive pixel 122 of 16M is merged into 4M, in other words, output merges image, after merging, the sizableness of photosensitive pixel 122
In becoming 4 times of original size, so as to improve the light sensitivitys of photosensitive pixel 122.Further, since in imageing sensor 10
Noise major part is all random noise, for the photosensitive pixel 122 before merging, it is possible to wherein one or two picture
There is noise in element, and after four photosensitive pixels 122 to be merged into a big photosensitive pixel 122, noise is reduced to this
The impact of big pixel, that is to say and reduce noise, improve signal to noise ratio.
But while 122 size of photosensitive pixel becomes big, as pixel value is reduced, the resolution for merging image also will drop
It is low.
In imaging, when four sensor devices 1222 covered under same filter unit 14a expose successively, can be with defeated
Go out patch image.
Specifically, sensor devices 1222 are for being converted into electric charge by illumination, and the electric charge for producing is proportional to intensity of illumination
Relation, transfer tube 1224 is for being turned on or off come control circuit according to control signal.When circuit turn-on, source follower
124 for being converted into voltage signal by the charge signal that 1222 Jing illumination of sensor devices is produced.Analog-digital converter 126 is used for voltage
Signal is converted to digital signal.
Figure 11 is referred to, with the imageing sensor 10 of 16M for example, the imageing sensor 200 of embodiment of the present invention
The photosensitive pixel 122 of 16M can also be kept to export, export patch image in other words, patch image includes image pixel elements, be schemed
As pixel cell includes the original pixels of 2*2 array arrangements, the size of the original pixels is identical with 122 size of photosensitive pixel, so
And as filter unit 14a for covering adjacent four sensor devices 1222 is same color, also say immediately, although four photosensitive
Device 1222 exposes respectively, but it is identical to cover its filter unit 14a color, therefore, each image pixel elements of output
Adjacent four original pixels colors it is identical, still cannot improve the resolution of image.
The control method of embodiment of the present invention, can be used for processing the patch image for exporting, to obtain imitative original
Image.
It is appreciated that merging image in output, four adjacent homochromy photosensitive pixels 122 are exported with merging pixel, such as
This, the four adjacent merging pixels merged in image are still considered as typical Bayer array, can direct controlled device
200 process to export merging rgb image.And patch image each photosensitive pixel 122 in output is exported respectively, due to adjacent
Four 122 colors of photosensitive pixel are identical, therefore, the color of four adjacent original pixels of image pixel elements is identical, is
Atypical Bayer array.And control device 200 cannot be directly processed to atypia Bayer array, in other words, in figure
When adopting same control device 200 as sensor 10, it is that the rgb image of compatible both of which exports the conjunction under i.e. merging patterns
And rgb image output and the imitative former rgb image output under color lump pattern, patch image need to be converted into imitative original image, or
Say the pixel arrangement that the image pixel elements of atypia Bayer array are converted into typical Bayer array.
Imitative original image includes the imitative original pixel in Bayer array arrangement.Imitative original pixel includes current pixel, original pixels bag
Include associated pixel corresponding with current pixel.
Figure 12 is referred to, by taking Figure 12 as an example, current pixel is R3 ' 3 ' and R5 ' 5 ', and corresponding associated pixel is respectively R33
And B55.
Obtain current pixel R3 ' 3 ' when, due to R3 ' 3 ' it is identical with the color of corresponding associated pixel R33, therefore turn
During change directly using the pixel value of R33 as R3 ' 3 ' pixel value.
When current pixel R5 ' 5 ' are obtained, as R5 ' 5 ' is differed with the color of corresponding associated pixel B55, it is clear that no
The side by interpolation according to the associated pixel unit of R5 ' 5 ' can be needed directly using the pixel value of B55 as the pixel value of R5 ' 5 '
Formula is calculated.
It should be noted that the above and pixel value hereinafter are construed broadly to mean the color attribute numerical value for the pixel,
Such as color-values.
Associated pixel unit include it is multiple, such as 4, identical with current pixel and adjacent with the current pixel image of color
Original pixels in pixel cell.
It should be noted that adjacent herein should be interpreted broadly, by taking Figure 12 as an example, 5 ' corresponding associated pixels of R5 ' are
B55, with B55 be located image pixel elements it is adjacent and and 5 ' color identical associated pixel units of R5 ' be located image slices
Plain unit is respectively the image pixel elements that R44, R74, R47, R77 are located, and not spatially apart from the image at B55 places
The farther other red image pixels units of pixel cell.Wherein, the red original pixels spatially closest with B55
Respectively R44, R74, R47 and R77, in other words, the associated pixel unit of R5 ' 5 ' is made up of R44, R74, R47 and R77, R5 '
5 ' is identical with the color of R44, R74, R47 and R77 and adjacent.
Thus, for the current pixel of different situations, in different ways original pixels are converted into imitative original pixel, from
And patch image is converted into into imitative original image, the optical filter of special Bayer array structure during due to shooting image, is employed, is carried
High signal noise ratio (snr) of image, and in image processing process, interpolation processing is carried out to patch image by interpolation algorithm, is improve
The resolution and resolution of image.
Figure 13 is referred to, in some embodiments, step S223 is comprised the following steps:
S2232:Calculate the gradual change amount in associated pixel unit all directions;
S2234:Calculate the weight in associated pixel unit all directions;With
S2236:According to gradual change amount and the pixel value of weight calculation current pixel.
Refer to Figure 14, in some embodiments, the second computing unit 223 include the first computation subunit 2232,
Two computation subunits 2234 and the 3rd computation subunit 2236.Step S2232 can be realized by the first computation subunit 2232, be walked
Rapid S2234 can be realized by the second computation subunit 2234 that step S2236 can be realized by the 3rd computation subunit 2236.Or
Person says that the first computation subunit 2232 is used to calculate the gradual change amount in associated pixel unit all directions, the second computation subunit
2234 are used to calculate the weight in associated pixel unit all directions, and the 3rd computation subunit 2236 is for according to gradual change amount and power
The pixel value of re-computation current pixel.
Specifically, interpolation processing mode is reference picture energy gradual change in different directions, will be corresponding with current pixel
The identical and adjacent associated pixel unit of color according to gradual change weight size in different directions, by the side of linear interpolation
Formula is calculated the pixel value of current pixel.Wherein, on the less direction of energy variation amount, reference specific gravity is larger, therefore,
Weight during interpolation calculation is larger.
In some examples, for convenience of calculating, only consider both horizontally and vertically.
R5 ' 5 ' is obtained by R44, R74, R47 and R77 interpolation, and it is identical to there is no color in the horizontal and vertical directions
Original pixels, therefore need the first component that the color in the horizontal and vertical directions is calculated according to associated pixel unit.Wherein, water
Component square upwards is that R45 and R75, vertically-oriented component can pass through R44, R74, R47 and R77 respectively for R54 and R57
It is calculated.
Specifically, R45=R44*2/3+R47*1/3, R75=2/3*R74+1/3*R77, R54=2/3*R44+1/3*
R74, R57=2/3*R47+1/3*R77.
Then, calculate respectively in gradual change amount both horizontally and vertically and weight, in other words, according to the color in difference
The gradual change amount in direction, to determine the reference weight of the different directions in interpolation, in the little direction of gradual change amount, weight is larger, and
The larger direction of gradual change amount, weight are less.Wherein, gradual change amount X1=| R45-R75 | in the horizontal direction, in vertical direction
Gradual change amount X2=| R54-R57 |, W1=X1/ (X1+X2), W2=X2/ (X1+X2).
Thus, being calculated according to above-mentioned, 5 '=(2/3*R45+1/3*R75) * W2+ (2/3*R54+1/3* of R5 '
R57)*W1.It is appreciated that if X1 is more than X2, W1 is more than W2, therefore the weight of horizontal direction is W2 when calculating, and Vertical Square
To weight be W1, vice versa.
Thus, the pixel value of current pixel can be calculated according to interpolation algorithm.According to the above-mentioned process to associated pixel
Original pixels can be converted into the imitative original pixel in typical Bayer array arrangement by mode, in other words, four adjacent 2*2 battle arrays
The imitative original pixel of row includes that a redness imitates original pixel, and two imitative original pixel of green and a blueness imitate original pixel.
It should be noted that the mode of interpolation includes but is not limited to only considering when calculating vertically disclosed in the present embodiment
With the mode of the pixel value of horizontal both direction same color, for example, can also refer to the pixel value of other colors.
Figure 15 and Figure 16 is referred to, in some embodiments, before step S223, includes step:
S224:White balance compensation is done to patch image;
Include step after step S223:
S225:White balance compensation reduction is done to imitative original image.
In some embodiments, the first conversion module 220 includes white balance compensation unit 224 and white balance compensation reduction
Unit 225.Step S224 can be realized by white balance compensation unit 224 that step S225 can be by white balance compensation reduction unit
225 realize.In other words, white balance compensation unit 224 for doing white balance compensation, white balance compensation reduction unit to patch image
225 reduce for doing white balance compensation to imitative original image.
Specifically, in some instances, during patch image to be converted into imitative original image, in Interpolation Process,
Red and blue imitative original pixel, can also be with reference to green often not only with reference to the color with the original pixels of its color identical passage
The color weight of the original pixels of passage, therefore, need to carry out white balance compensation before interpolation, it is white to exclude in interpolation calculation
The impact of balance.In order to not destroy the white balance of patch image, therefore, need for imitative original image to carry out white balance after interpolation
Compensation reduction, is reduced according to the yield value of red, green and blueness in the compensation during reduction.
Thus, the impact of the white balance in Interpolation Process can be excluded, and the imitative original image obtained after enabling to interpolation
Keep the white balance of patch image.
Referring to Figure 15 and Figure 16, in some embodiments, before step S223, include step:
S226:Compensating bad point is done to patch image.
In some embodiments, the first conversion module 220 includes compensating bad point unit 226.Step S226 can be by bad
Point compensating unit 226 is realized.In other words, compensating bad point unit 226 is for doing compensating bad point to patch image.
It is appreciated that being limited to manufacturing process, may there is bad point in imageing sensor 10, bad point is not generally with light sensitivitys
Change and same color is presented all the time, the presence of bad point will affect picture quality, therefore, it is the accurate of guarantee interpolation, not by bad
The impact of point, needs carry out compensating bad point before interpolation.
Specifically, during compensating bad point, original pixels can be detected, is bad when a certain original pixels are detected
During point, compensating bad point can be carried out according to the pixel value of other original images of its image pixel elements being located.
Thus, impact of the bad point to interpolation processing can be excluded, picture quality is improved.
Referring to Figure 15 and Figure 16, in some embodiments, before step S223, include step:
S227:Crosstalk compensation is done to patch image.
In some embodiments, the first conversion module 220 includes crosstalk compensation unit 227.Step S227 can be by going here and there
Disturb compensating unit 227 to realize.In other words, crosstalk compensation unit 227 is for doing crosstalk compensation to patch image.
Specifically, four photosensitive pixels 122 in a sensitive pixel elements 12a cover the optical filter of same color, and
The difference of light sensitivitys is there may be between photosensitive pixel 122, so as to imitate in the imitative former rgb image that original image conversion is exported
Solid color regions occur fixed pattern spectral noise, affect the quality of image.Accordingly, it would be desirable to carry out crosstalk compensation to patch image.
In some embodiments, setting compensation parameter is comprised the following steps:Predetermined luminous environment is provided;Imaging device is set
Imaging parameters;Shoot multi-frame images;Process multiple image to obtain crosstalk compensation parameter;With crosstalk compensation parameter is stored in
In image processing apparatus.
Explanation is explained above, crosstalk compensation is carried out, is needed in 10 manufacture process of imageing sensor of imaging device 100
Compensating parameter is obtained, and the relevant parameter of crosstalk compensation is preset in the memorizer of imaging device 100 or imaging device is installed
In 100 electronic installation 1000 such as mobile phone or panel computer.
Predetermined luminous environment for example may include the colour temperature of the even tabula rasas of LED, 5000K or so, 1000 lux of brightness or so, imaging
Parameter may include yield value, fast gate value and lens location.After setting relevant parameter, the acquisition of crosstalk compensation parameter is carried out.
In processing procedure, the imaging parameters first in the luminous environment of setting to set obtain multiple patch images, and
A patch image is merged into, the influence of noise using individual patch image as calibration basis can be so reduced.
Figure 17 is referred to, by taking the image pixel elements Gr in Figure 17 as an example, which includes Gr1, Gr2, Gr3 and Gr4, and crosstalk is mended
It is that light sensitivitys there may be the photosensitive pixel of difference by compensating into originally calibrating to same level to repay purpose.The image pixel
The average pixel value of unit is Gr_avg=(Gr1+Gr2+Gr3+Gr4)/4, can characterize substantially the photosensitive of this four photosensitive pixels
The average level of degree, is worth based on this meansigma methods, calculates Gr1/Gr_avg respectively, Gr2/Gr_avg, Gr3/Gr_avg and
Gr4/Gr_avg, it will be understood that by calculating the pixel value of each original pixels and the mean pixel of the image pixel elements
The ratio of value, can reflect the deviation of each original pixels and basic value substantially, record four ratios and remember as compensating parameter
Record in the memorizer of relevant apparatus, each original pixels is compensated with being transferred in imaging, so as to reduce crosstalk,
Improve picture quality.
Generally, should also verify whether set parameter is accurate after setting crosstalk compensation parameter.
In proof procedure, a patch image is obtained with identical luminous environment and imaging parameters first, foundation is calculated
Compensating parameter carry out crosstalk compensation to the patch image, calculate the Gr ' after compensation _ avg, Gr ' 1/Gr ' _ avg, Gr ' 2/Gr ' _
Avg, Gr ' 3/Gr ' _ avg and Gr ' 4/Gr ' _ avg.Whether accurately compensating parameter is judged according to result of calculation, judgement can be according to grand
See and consider with two angles of microcosmic.Microcosmic refers to some original pixels, and after compensation, still deviation is larger, is easily made after imaging
User perceives, and macroscopic view is then from global angle, when that is to say that the total number of the original pixels that deviation is still suffered from after compensation is more,
Even if now individually the deviation of each original pixels is little, but still can be perceived as overall.Therefore, should
Arrange and one proportion threshold value is set for microcosmic, one proportion threshold value and an amount threshold need to be set for macroscopic view.Such as
This, can to arrange crosstalk compensation parameter verify, it is ensured that compensating parameter it is correct, to reduce shadow of the crosstalk to picture quality
Ring.
Figure 18 and Figure 19 is referred to, in some embodiments, after step S223, also includes step:
S228:Eyeglass shadow correction, demosaicing, noise reduction and edge sharpening are carried out to imitative original image to process.
In some embodiments, the first conversion module 220 includes processing unit 228.Step S228 can be single by processing
Unit 228 realizes, in other words, processing unit 228 is for carrying out eyeglass shadow correction, demosaicing, noise reduction and side to imitative original image
Edge Edge contrast.
It is appreciated that patch image is converted into after imitative original image, it is typical Bayer array to imitate original pixel arrangement, can be adopted
Processed with processing meanss 200, processing procedure includes that eyeglass shadow correction, demosaicing, noise reduction and edge sharpening are processed,
Thus, imitative original rgb image can be obtained after processing exporting to user.
Figure 20 and Figure 21 is referred to, in some embodiments, step S230 is comprised the following steps:
S232:Using the second interpolation algorithm will merge image change into it is corresponding with imitative original image go back original image, second inserts
The complexity of value-based algorithm is less than the first interpolation algorithm;With
S234:Original image will be gone back and change into merging rgb image.
In some embodiments, the second conversion module 230 includes the first conversion unit 232 and the second conversion unit 234.
First conversion unit 232 for using the second interpolation algorithm will merge image change into it is corresponding with imitative original image go back original image,
The complexity of the second interpolation algorithm is less than the first interpolation algorithm.Second conversion unit 234 changes into merging for going back original image
Rgb image.In other words, step S232 can be realized by the first conversion unit 232 that step S234 can be single by the second conversion
Unit 234 realizes.
In some embodiments, the time complexity and space complexity of the second interpolation algorithm is all than the first interpolation algorithm
It is little.The complexity of algorithm includes time complexity and space complexity, time complexity be used for that metric algorithm needs to expend when
Between, space complexity is to need the memory space for expending for metric algorithm.The little explanation algorithm of time complexity needs what is expended
Time is few, and the little explanation algorithm of space complexity needs the memory space for expending little, therefore, be conducive to carrying using the second interpolation algorithm
High arithmetic speed so that process of taking pictures is more smooth, improves Consumer's Experience.
In some embodiments, the second interpolation algorithm can will simply merge image quadruplication without Jing
Other complex calculations are crossed, so as to obtain corresponding with imitative original image going back original image.
It is appreciated that after the first conversion unit 232 and the conversion of the second conversion unit 234 obtain imitative original rgb image,
Noise reduction can be carried out to imitative original rgb image and edge sharpening is processed, thus, the imitative former true of better quality is obtained after processing
Coloured picture picture is exported to user.
In the description of embodiments of the present invention, it is to be understood that term " " center ", " longitudinal direction ", " horizontal ", " length
Degree ", " width ", " thickness ", " on ", D score, "front", "rear", "left", "right", " vertical ", " level ", " top ", " bottom ", " interior ",
" outward ", the orientation or position relationship of the instruction such as " clockwise ", " counterclockwise " based on orientation shown in the drawings or position relationship, is only
It is to describe for the ease of describing embodiments of the present invention and simplifying, rather than indicates or imply that the device or element of indication are necessary
With specific orientation, with specific azimuth configuration and operation, therefore it is not intended that restriction to embodiments of the present invention.
Additionally, term " first ", " second " are only used for describing purpose, and it is not intended that indicating or implying relative importance
Or the implicit quantity for indicating indicated technical characteristic.Thus, define " first ", the feature of " second " can express or
Implicitly include one or more feature.In the description of embodiments of the present invention, " multiple " are meant that two
Individual or two or more, unless otherwise expressly limited specifically.
In the description of embodiments of the present invention, it should be noted that unless otherwise clearly defined and limited, term
" installation ", " being connected ", " connection " should be interpreted broadly, for example, it may be fixedly connected, or be detachably connected, or one
The connection of body ground;Can be mechanically connected, or electrically connect or mutually can communicate;Can be joined directly together, it is also possible to logical
Cross intermediary to be indirectly connected to, can be connection or the interaction relationship of two elements of two element internals.For ability
For the those of ordinary skill in domain, above-mentioned term specifically containing in embodiments of the present invention can be understood as the case may be
Justice.
In embodiments of the present invention, unless otherwise clearly defined and limited, fisrt feature second feature it
" on " or D score can include the first and second feature directly contacts, it is also possible to be not directly to connect including the first and second features
Touch but by the other characterisation contact between them.And, fisrt feature second feature " on ", " top " and " on
Including fisrt feature directly over second feature and oblique upper, or to be merely representative of fisrt feature level height special higher than second in face "
Levy.Fisrt feature second feature " under ", " lower section " and " below " including fisrt feature immediately below second feature and tiltedly under
Side, or fisrt feature level height is merely representative of less than second feature.
Above disclosure provides many different embodiments or example is used for realizing embodiments of the present invention not
Same structure.In order to simplify the disclosure of embodiments of the present invention, above the part and setting of specific examples are described.When
So, they are only merely illustrative, and purpose does not lie in the restriction present invention.Additionally, embodiments of the present invention can be in different examples
Repeat reference numerals and/or reference letter in son, this repetition are for purposes of simplicity and clarity, itself not indicate to be begged for
By the relation between various embodiments and/or setting.Additionally, the various specific technique that embodiments of the present invention are provided
With the example of material, but those of ordinary skill in the art can be appreciated that the application of other techniques and/or making for other materials
With.
In the description of this specification, reference term " embodiment ", " some embodiments ", " schematically enforcement
The description of mode ", " example ", " specific example " or " some examples " etc. means the tool described with reference to the embodiment or example
Body characteristicses, structure, material or feature are contained at least one embodiment or example of the present invention.In this manual,
Identical embodiment or example are not necessarily referring to the schematic representation of above-mentioned term.And, the specific features of description, knot
Structure, material or feature can be combined in one or more any embodiment or example in an appropriate manner.
In flow chart or here any process described otherwise above or method description are construed as, expression includes
It is one or more for realizing specific logical function or process the step of the module of code of executable instruction, fragment or portion
Point, and the scope of the preferred embodiment of the present invention includes other realization, wherein the suitable of shown or discussion can not be pressed
Sequence, including according to involved function by it is basic simultaneously in the way of or in the opposite order, carry out perform function, this should be of the invention
Embodiment person of ordinary skill in the field understood.
Expression or here logic described otherwise above and/or step, for example, are considered use in flow charts
In the order list of the executable instruction for realizing logic function, may be embodied in any computer-readable medium, for
Instruction execution system, device or equipment (as computer based system, the system including processing module or other can be from instruction
The system of execution system, device or equipment instruction fetch execute instruction) use, or combine these instruction execution systems, device or
Equipment and use.For the purpose of this specification, " computer-readable medium " can be it is any can include, store, communicating, propagating or
Transmission procedure is used for instruction execution system, device or equipment or with reference to these instruction execution systems, device or equipment
Device.The more specifically example (non-exhaustive list) of computer-readable medium is including following:Connect up with one or more
Electrical connection section (electronic installation), portable computer diskette box (magnetic device), random access memory (RAM), read only memory
(ROM), erasable edit read-only storage (EPROM or flash memory), fiber device, and portable optic disk is read-only deposits
Reservoir (CDROM).In addition, computer-readable medium can even is that the paper that can print described program thereon or other are suitable
Medium, because for example by carrying out optical scanning to paper or other media edlin, interpretation can then be entered or if necessary with which
His suitable method is processed to electronically obtain described program, is then stored in computer storage.
It should be appreciated that each several part of embodiments of the present invention can be with hardware, software, firmware or combinations thereof come real
It is existing.In the above-described embodiment, multiple steps or method can be with storages in memory and by suitable instruction execution system
The software or firmware of execution is realizing.For example, if realized with hardware, with another embodiment, ability can be used
Any one of following technology known to domain or their combination are realizing:With for realizing logic function to data signal
The discrete logic of logic gates, the special IC with suitable combinational logic gate circuit, programmable gate array
(PGA), field programmable gate array (FPGA) etc..
Those skilled in the art are appreciated that to realize all or part of step that above-described embodiment method is carried
Suddenly the hardware that can be by program to instruct correlation is completed, and described program can be stored in a kind of computer-readable storage medium
In matter, the program upon execution, including one or a combination set of the step of embodiment of the method.
Additionally, each functional unit in various embodiments of the present invention can be integrated in a processing module, also may be used
Being that unit is individually physically present, it is also possible to which two or more units are integrated in a module.It is above-mentioned integrated
Module both can be realized in the form of hardware, it would however also be possible to employ the form of software function module is realized.The integrated module
If using in the form of software function module realize and as independent production marketing or use when, it is also possible to be stored in a calculating
In machine read/write memory medium.
Storage medium mentioned above can be read only memory, disk or CD etc..
Although embodiments of the invention have been shown and described above, it is to be understood that above-described embodiment is example
Property, it is impossible to limitation of the present invention is interpreted as, one of ordinary skill in the art within the scope of the invention can be to above-mentioned
Embodiment is changed, changes, replacing and modification.
Claims (21)
1. a kind of control method, for controlling electronic installation, it is characterised in that the electronic installation includes imaging device and storage
Device, the imaging device include imageing sensor, and described image sensor includes sensitive pixel elements array and is arranged on described
Filter unit array on sensitive pixel elements array, it is described photosensitive that each described filter unit array covers correspondence one
Pixel cell, each described sensitive pixel elements include multiple photosensitive pixels, and the control method is comprised the following steps:
The merging image and patch image of control described image sensor output Same Scene, the merging image include merging picture
Pixel array, multiple photosensitive pixels of the same sensitive pixel elements merge output as a merging pixel, the color
Block image includes the image pixel elements of predetermined array arrangement, and described image pixel cell includes multiple original pixels, each institute
State photosensitive pixel one original pixels of correspondence;
The patch image is changed into into imitative original image, the imitative original image includes the imitative original pixel of array arrangement, the imitative original
Pixel includes current pixel, and the original pixels include associated pixel corresponding with the current pixel, described by the color lump
The step of image changes into the imitative original image comprises the following steps:
Judge whether the color of the current pixel is identical with the color of the associated pixel;
When the color of the current pixel is identical with the color of the associated pixel, using the pixel value of the associated pixel as
The pixel value of the current pixel;With
It is when the color of the current pixel is different from the color of the associated pixel, logical according to the pixel value of associated pixel unit
The pixel value that the first interpolation algorithm calculates the current pixel is crossed, described image pixel cell includes the associated pixel unit,
The color of the associated pixel unit is identical with the current pixel and adjacent with the current pixel;
The merging image is changed into into merging rgb image;
The imitative original image is changed into into imitative original rgb image;
Judge the residual capacity of the memorizer whether less than or equal to predetermined threshold;
When the residual capacity is less than or equal to the predetermined threshold, according to the merging rgb image and the imitative former very coloured silk
The image parameter of image selects to preserve the merging rgb image or the imitative former rgb image to the memorizer;With
When the residual capacity is more than the predetermined threshold, the merging rgb image and the imitative former rgb image are preserved.
2. control method as claimed in claim 1, it is characterised in that the predetermined array includes Bel's array.
3. control method as claimed in claim 1, it is characterised in that described image pixel cell includes the described of 2*2 arrays
Original pixels.
4. control method as claimed in claim 1, it is characterised in that the pixel value according to associated pixel unit is by the
The step of one interpolation algorithm calculates the pixel value of the current pixel comprises the following steps:
Calculate the gradual change amount in the associated pixel all directions;
Calculate the weight in the associated pixel all directions;With
According to the gradual change amount and current pixel described in the weight calculation pixel value.
5. control method as claimed in claim 1, it is characterised in that the control method is described according to associated pixel unit
Pixel value the step of calculate the pixel value of the current pixel by the first interpolation algorithm before comprise the following steps:
White balance compensation is done to the patch image;
The control method calculates the current picture by the first interpolation algorithm in the pixel value according to associated pixel unit
Comprise the following steps after the step of pixel value of element:
White balance compensation reduction is done to the imitative original image.
6. control method as claimed in claim 1, it is characterised in that the control method is described according to associated pixel unit
Pixel value the step of calculate the pixel value of the current pixel by the first interpolation algorithm before comprise the following steps:
Compensating bad point is done to the patch image.
7. control method as claimed in claim 1, it is characterised in that the control method is described according to associated pixel unit
Pixel value the step of calculate the pixel value of the current pixel by the first interpolation algorithm before comprise the following steps:
Crosstalk compensation is done to the patch image.
8. control method as claimed in claim 1, it is characterised in that the control method is described according to associated pixel unit
Pixel value comprised the steps after the step of the first interpolation algorithm calculates the pixel value of the current pixel:
Carry out lens shape correction, demosaicing, noise reduction and edge sharpening to process to the imitative original image.
9. control method as claimed in claim 1, it is characterised in that described that the merging image is changed into into the true coloured picture of merging
As the step of comprise the following steps:
Using the second interpolation algorithm by the merging image change into it is corresponding with the imitative original image go back original image, described second
The complexity of interpolation algorithm is less than first interpolation algorithm;With
The original image of going back is changed into into the merging rgb image.
10. a kind of control device, for controlling electronic installation, it is characterised in that the electronic installation includes imaging device and deposits
Reservoir, the imaging device include imageing sensor, and described image sensor includes sensitive pixel elements array and is arranged on institute
The filter unit array on sensitive pixel elements array is stated, each described filter unit array covers one sense of correspondence
Light pixel unit, each described sensitive pixel elements include multiple photosensitive pixels, and the control device includes:
First control module, first control module are used to control the merging image that described image sensor exports Same Scene
And patch image, the merging image includes merging pel array, and the multiple photosensitive pixels of the same sensitive pixel elements are closed
And export as a merging pixel, the patch image includes the image pixel elements of predetermined array arrangement, the figure
As pixel cell includes multiple original pixels, each one described original pixels of the photosensitive pixel correspondence;
First conversion module, first conversion module is for changing into imitative original image, the imitative artwork by the patch image
Imitative original pixel as including array arrangement, the imitative original pixel include current pixel, and the original pixels include current with described
The corresponding associated pixel of pixel, first conversion module include:
Judging unit, the judging unit are used to judging the color of the color of the current pixel and the associated pixel whether phase
Together;
First computing unit, color of first computing unit for the color in the current pixel and the associated pixel
When identical, using the pixel value of the associated pixel as the current pixel pixel value;With
Second computing unit, color of second computing unit for the color in the current pixel and the associated pixel
When different, the pixel value of the current pixel is calculated according to the pixel value of associated pixel unit by the first interpolation algorithm, it is described
Image pixel elements include the associated pixel unit, the color of the associated pixel unit it is identical with the current pixel and with
The current pixel is adjacent;
Second conversion module, second conversion module for by it is described merging image change into merging rgb image;
3rd conversion module, the 3rd conversion module imitate original rgb image for the imitative original image is changed into;
Whether judge module, the judge module are used for the residual capacity for judging the memorizer less than or equal to predetermined threshold;
First preserving module, first preserving module for the residual capacity be less than or equal to the predetermined threshold when,
Select to preserve the merging rgb image or institute according to the image parameter for merging rgb image and the imitative former rgb image
Imitative original rgb image is stated to the memorizer;With
Second preserving module, second preserving module for the residual capacity be more than the predetermined threshold when, preserve institute
State merging rgb image and the imitative former rgb image.
11. control devices as claimed in claim 10, it is characterised in that the predetermined array includes Bel's array.
12. control devices as claimed in claim 10, it is characterised in that described image pixel cell includes the institute of 2*2 arrays
State original pixels.
13. control devices as claimed in claim 10, it is characterised in that second computing unit includes:
First computation subunit, first computation subunit are used to calculate the gradual change amount in the associated pixel all directions;
Second computation subunit, second computation subunit are used to calculate the weight in the associated pixel all directions;With
3rd computation subunit, the 3rd computation subunit is for current according to the gradual change amount and the weight calculation
The pixel value of pixel.
14. control devices as claimed in claim 10, it is characterised in that first conversion module includes:
White balance compensation unit, the white balance compensation unit is for doing white balance compensation to the patch image;With
White balance compensation reduction unit, the white balance compensation reduction unit is for doing white balance compensation also to the imitative original image
It is former.
15. control devices as claimed in claim 10, it is characterised in that first conversion module includes:
Compensating bad point unit, the compensating bad point unit is for doing compensating bad point to the patch image.
16. control devices as claimed in claim 10, it is characterised in that first conversion module includes:
Crosstalk compensation unit, the crosstalk compensation unit is for doing crosstalk compensation to the patch image.
17. control devices as claimed in claim 10, it is characterised in that first conversion module includes:
Processing unit, the processing unit is for carrying out lens shape correction, demosaicing, noise reduction and side to the imitative original image
Edge Edge contrast.
18. control devices as claimed in claim 10, it is characterised in that second conversion module includes:
First conversion unit, first conversion unit for using the second interpolation algorithm by it is described merging image change into and institute
State that imitative original image is corresponding to go back original image, the complexity of second interpolation algorithm is less than first interpolation algorithm;With
Second conversion unit, second conversion unit is for changing into the merging rgb image by the original image of going back.
19. a kind of electronic installations, it is characterised in that include:
Imaging device;
Memorizer;With
Control device as described in claim 10-18 any one.
20. electronic installations as claimed in claim 19, it is characterised in that the electronic installation includes mobile phone or panel computer.
21. electronic installations as claimed in claim 19, it is characterised in that the imaging device includes Front camera or rearmounted phase
Machine.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201611079139.5A CN106534822B (en) | 2016-11-29 | 2016-11-29 | Control method, control device and electronic device |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201611079139.5A CN106534822B (en) | 2016-11-29 | 2016-11-29 | Control method, control device and electronic device |
Publications (2)
Publication Number | Publication Date |
---|---|
CN106534822A true CN106534822A (en) | 2017-03-22 |
CN106534822B CN106534822B (en) | 2018-06-29 |
Family
ID=58353499
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201611079139.5A Active CN106534822B (en) | 2016-11-29 | 2016-11-29 | Control method, control device and electronic device |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN106534822B (en) |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2018099005A1 (en) * | 2016-11-29 | 2018-06-07 | 广东欧珀移动通信有限公司 | Control method, control device, and electronic device |
WO2018098977A1 (en) * | 2016-11-29 | 2018-06-07 | 广东欧珀移动通信有限公司 | Image processing method, image processing device, imaging device, manufacturing method, and electronic device |
US10382709B2 (en) | 2016-11-29 | 2019-08-13 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Image processing method and apparatus, and electronic device |
US10432905B2 (en) | 2016-11-29 | 2019-10-01 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Method and apparatus for obtaining high resolution image, and electronic device for same |
CN110413805A (en) * | 2018-04-25 | 2019-11-05 | 杭州海康威视数字技术股份有限公司 | A kind of image storage method, device, electronic equipment and storage medium |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN1438804A (en) * | 2002-02-15 | 2003-08-27 | 佳能株式会社 | Noting control of recording available volume in recording medium for image information storage |
TW563365B (en) * | 2001-09-24 | 2003-11-21 | Winbond Electronics Corp | Image compensation processing method of digital camera |
CN101076075A (en) * | 2006-05-16 | 2007-11-21 | 明基电通股份有限公司 | Image storing method and its computer fetch medium |
CN101296295A (en) * | 2007-04-23 | 2008-10-29 | 奥林巴斯映像株式会社 | Image storage device, photographing apparatus, and image storage device control method |
CN105516698A (en) * | 2015-12-18 | 2016-04-20 | 广东欧珀移动通信有限公司 | Imaging method of image sensor, imaging device and electronic device |
-
2016
- 2016-11-29 CN CN201611079139.5A patent/CN106534822B/en active Active
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
TW563365B (en) * | 2001-09-24 | 2003-11-21 | Winbond Electronics Corp | Image compensation processing method of digital camera |
CN1438804A (en) * | 2002-02-15 | 2003-08-27 | 佳能株式会社 | Noting control of recording available volume in recording medium for image information storage |
CN101076075A (en) * | 2006-05-16 | 2007-11-21 | 明基电通股份有限公司 | Image storing method and its computer fetch medium |
CN101296295A (en) * | 2007-04-23 | 2008-10-29 | 奥林巴斯映像株式会社 | Image storage device, photographing apparatus, and image storage device control method |
CN105516698A (en) * | 2015-12-18 | 2016-04-20 | 广东欧珀移动通信有限公司 | Imaging method of image sensor, imaging device and electronic device |
Cited By (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2018099005A1 (en) * | 2016-11-29 | 2018-06-07 | 广东欧珀移动通信有限公司 | Control method, control device, and electronic device |
WO2018098977A1 (en) * | 2016-11-29 | 2018-06-07 | 广东欧珀移动通信有限公司 | Image processing method, image processing device, imaging device, manufacturing method, and electronic device |
US10194126B2 (en) | 2016-11-29 | 2019-01-29 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Image processing method, imaging apparatus, and method performed thereby |
US10382709B2 (en) | 2016-11-29 | 2019-08-13 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Image processing method and apparatus, and electronic device |
US10382675B2 (en) | 2016-11-29 | 2019-08-13 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Image processing method and apparatus, and electronic device including a simulation true-color image |
US10432905B2 (en) | 2016-11-29 | 2019-10-01 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Method and apparatus for obtaining high resolution image, and electronic device for same |
CN110413805A (en) * | 2018-04-25 | 2019-11-05 | 杭州海康威视数字技术股份有限公司 | A kind of image storage method, device, electronic equipment and storage medium |
US11368648B2 (en) | 2018-04-25 | 2022-06-21 | Hangzhou Hikvision Digital Technology Co., Ltd. | Image storage method and apparatus, and electronic device and storage medium |
Also Published As
Publication number | Publication date |
---|---|
CN106534822B (en) | 2018-06-29 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN106454289B (en) | Control method, control device and electronic installation | |
CN106341670B (en) | Control method, control device and electronic installation | |
CN106504218B (en) | Control method, control device and electronic device | |
CN106507067B (en) | Control method, control device and electronic installation | |
CN106454054B (en) | Control method, control device and electronic device | |
CN106412407B (en) | Control method, control device and electronic device | |
CN106534822B (en) | Control method, control device and electronic device | |
CN106507080B (en) | Control method, control device and electronic device | |
CN106412592B (en) | Image processing method, image processing apparatus, imaging device and electronic device | |
CN106791477B (en) | Image processing method, image processing apparatus, imaging device and manufacturing method | |
CN106507069B (en) | Control method, control device and electronic device | |
CN106604001B (en) | Image processing method, image processing apparatus, imaging device and electronic device | |
CN106454288B (en) | Control method, control device, imaging device and electronic installation | |
CN106507018B (en) | Control method, control device and electronic device | |
CN106507019B (en) | Control method, control device, electronic device | |
CN106506984A (en) | Image processing method and device, control method and device, imaging and electronic installation | |
CN103685992A (en) | Method for generating high dynamic range image and image sensor | |
CN106713790B (en) | Control method, control device and electronic device | |
CN106488203B (en) | Image processing method, image processing apparatus, imaging device and electronic installation | |
CN105578079B (en) | Imaging sensor and picture quality regulation method, imaging device and method and mobile terminal | |
CN106507068B (en) | Image processing method and device, control method and device, imaging and electronic device | |
CN106504217A (en) | Image processing method, image processing apparatus, imaging device and electronic installation |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant | ||
CP01 | Change in the name or title of a patent holder |
Address after: Changan town in Guangdong province Dongguan 523860 usha Beach Road No. 18 Patentee after: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS Corp.,Ltd. Address before: Changan town in Guangdong province Dongguan 523860 usha Beach Road No. 18 Patentee before: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS Corp.,Ltd. |
|
CP01 | Change in the name or title of a patent holder |