CN105578067A - Image generation method and device, terminal equipment - Google Patents

Image generation method and device, terminal equipment Download PDF

Info

Publication number
CN105578067A
CN105578067A CN201510964168.9A CN201510964168A CN105578067A CN 105578067 A CN105578067 A CN 105578067A CN 201510964168 A CN201510964168 A CN 201510964168A CN 105578067 A CN105578067 A CN 105578067A
Authority
CN
China
Prior art keywords
picture element
image
pixel
element amount
unit picture
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201510964168.9A
Other languages
Chinese (zh)
Other versions
CN105578067B (en
Inventor
雷辉
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Oppo Mobile Telecommunications Corp Ltd
Original Assignee
Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Oppo Mobile Telecommunications Corp Ltd filed Critical Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority to CN201510964168.9A priority Critical patent/CN105578067B/en
Publication of CN105578067A publication Critical patent/CN105578067A/en
Application granted granted Critical
Publication of CN105578067B publication Critical patent/CN105578067B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70Circuitry for compensating brightness variation in the scene
    • H04N23/74Circuitry for compensating brightness variation in the scene by influencing the scene brightness using illuminating means
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80Camera processing pipelines; Components thereof
    • H04N23/81Camera processing pipelines; Components thereof for suppressing or minimising disturbance in the image signal generation

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Image Processing (AREA)

Abstract

The invention provides an image generation method and device, and terminal equipment. An image sensor that is provided in advance includes a photosensitive pixel array and an optical filter arranged on the photosensitive pixel array, the optical filter includes a filtering unit array, each filtering unit covers m*n photosensitive pixels which form a merged pixel, m*n>1, brightness information of a photographing environment is obtained, a unit pixel quantity P corresponding to the brightness information is determined according to a preset strategy, 1<=P<=m*n, and outputs of a plurality of photosensitive pixels which belong to a same merged pixel is correspondingly processed according to the unit pixel quantity, thereby generating an image of corresponding resolution. Adjustment of the light inlet quantity of a unit pixel is realized through dynamic adjustment of the unit pixel quantity according to the brightness condition of the photographing environment, and the image of corresponding resolution is generated, thereby suppressing noisy points of the image, and improving definition of the image.

Description

Image generating method, device and terminal equipment
Technical field
The present invention relates to technical field of image processing, particularly relate to a kind of image generating method, device and terminal equipment.
Background technology
Along with the development of intelligent terminal, terminal equipment gets more and more, such as: mobile phone, IPAD, wearing smart machine etc.
Take pictures and contain much small components and parts, wherein, imageing sensor is the key factor determining image quality.But the light of photo environment is in real time all in change, and existing imageing sensor exists too much image noise at the image of low irradiance environment generation, cause not fogging clear grade not enough.
Summary of the invention
The present invention is intended to solve one of technical problem in correlation technique at least to a certain extent.
For this reason, first object of the present invention is to propose a kind of image generating method, to the method achieve according to photo environment light situation dynamic conditioning unit picture element amount with the light-inletting quantity of unit of adjustment's pixel, generates the image of corresponding resolution, thus suppress image noise, improve the definition of image.
Second object of the present invention is to propose a kind of video generation device.
3rd object of the present invention is to propose a kind of terminal equipment.
For reaching above-mentioned purpose, first aspect present invention embodiment proposes a kind of image generating method, comprise: the imageing sensor provided in advance comprises: photosensitive pixel array, and the filter be arranged on described photosensitive pixel array, wherein, described filter comprises filter unit array, and each filter unit covers m*n photosensitive pixel and forms and merges pixel, wherein, m*n>1; Said method comprising the steps of:
Obtain the monochrome information of photo environment, determine the unit picture element amount P corresponding with described monochrome information according to preset strategy, wherein, 1<=P<=m*n; Belong to the output of the multiple photosensitive pixels in same described merging pixel according to described unit picture element amount alignment processing, and then generate the image of corresponding resolution.
The image generating method of the embodiment of the present invention, by obtaining the monochrome information of photo environment, determines the unit picture element amount P corresponding with described monochrome information according to preset strategy, wherein, and 1<=P<=m*n; Belong to the output of the multiple photosensitive pixels in same described merging pixel according to described unit picture element amount alignment processing, and then generate the image of corresponding resolution.Thus, to achieve according to photo environment light situation dynamic conditioning unit picture element amount with the light-inletting quantity of unit of adjustment's pixel, generate the image of corresponding resolution, thus suppress image noise, improve the definition of image.
For reaching above-mentioned purpose, second aspect present invention embodiment proposes a kind of video generation device, comprising: imageing sensor and image processor, wherein,
Described imageing sensor comprises: photosensitive pixel array, and is arranged on the filter on described photosensitive pixel array, wherein, described filter comprises filter unit array, each filter unit covers m*n photosensitive pixel and forms and merges pixel, wherein, and m*n>1;
Described image processor comprises: acquisition module, for obtaining the monochrome information of photo environment; Determination module, for determining the unit picture element amount P corresponding with described monochrome information according to preset strategy, wherein, 1<=P<=m*n; Processing module, for belonging to the output of the multiple photosensitive pixels in same described merging pixel according to described unit picture element amount alignment processing, and then generates the image of corresponding resolution.
The video generation device of the embodiment of the present invention, by obtaining the monochrome information of photo environment, determines the unit picture element amount P corresponding with described monochrome information according to preset strategy, wherein, and 1<=P<=m*n; Belong to the output of the multiple photosensitive pixels in same described merging pixel according to described unit picture element amount alignment processing, and then generate the image of corresponding resolution.Thus, to achieve according to photo environment light situation dynamic conditioning unit picture element amount with the light-inletting quantity of unit of adjustment's pixel, generate the image of corresponding resolution, thus suppress image noise, improve the definition of image.
For reaching above-mentioned purpose, third aspect present invention embodiment proposes a kind of terminal equipment, comprises video generation device as above.
The terminal equipment of the embodiment of the present invention, by obtaining the monochrome information of photo environment, determines the unit picture element amount P corresponding with described monochrome information according to preset strategy, wherein, and 1<=P<=m*n; Belong to the output of the multiple photosensitive pixels in same described merging pixel according to described unit picture element amount alignment processing, and then generate the image of corresponding resolution.Thus, to achieve according to photo environment light situation dynamic conditioning unit picture element amount with the light-inletting quantity of unit of adjustment's pixel, generate the image of corresponding resolution, thus suppress image noise, improve the definition of image.
Accompanying drawing explanation
The present invention above-mentioned and/or additional aspect and advantage will become obvious and easy understand from the following description of the accompanying drawings of embodiments, wherein:
Fig. 1 is the perspective view of the imageing sensor that the embodiment of the present invention provides;
Fig. 2 is the flow chart of the image generating method of one embodiment of the invention;
Fig. 3 is the filter unit array schematic diagram in imageing sensor provided by the invention;
Fig. 4 is for exporting full-scale image in different resolution schematic diagram;
Fig. 5 is 1/2 full-scale image in different resolution schematic diagram;
Fig. 6 is 1/4 full-scale image in different resolution schematic diagram;
Fig. 7 is the structural representation of the video generation device of one embodiment of the invention;
Fig. 8 is the structural representation of the terminal equipment of one embodiment of the invention;
Fig. 9 is the structural representation of the terminal equipment of another embodiment of the present invention.
Embodiment
Be described below in detail embodiments of the invention, the example of described embodiment is shown in the drawings, and wherein same or similar label represents same or similar element or has element that is identical or similar functions from start to finish.Be exemplary below by the embodiment be described with reference to the drawings, be intended to for explaining the present invention, and can not limitation of the present invention be interpreted as.
Below with reference to the accompanying drawings the image generating method of the embodiment of the present invention, device and terminal equipment are described.
Particularly, the image generating method that the present embodiment provides is configured in the terminal equipment with imageing sensor and is specifically described.It should be noted that the type of terminal equipment is a lot, such as: mobile phone, IPAD, Intelligent worn device etc.
Fig. 1 is the perspective view of the imageing sensor that the embodiment of the present invention provides.
In terminal equipment, arrange imageing sensor 1 in advance, wherein, imageing sensor 1 can be CCD or cmos sensor.
See Fig. 1, imageing sensor 1 comprises: photosensitive pixel array 11, and the filter be arranged on described photosensitive pixel array 11, wherein, described filter comprises filter unit array 12, each filter unit 121 covers m*n photosensitive pixel 111 and forms and merges pixel, wherein, and m*n>1.
Based on the imageing sensor that Fig. 1 provides, implement image generating method provided by the invention.
Fig. 2 is the flow chart of the image generating method of one embodiment of the invention.
As shown in Figure 2, this image generating method comprises the following steps:
Step 101, obtains the monochrome information of photo environment, determines the unit picture element amount P corresponding with described monochrome information according to preset strategy, wherein, and 1<=P<=m*n.
Particularly, ambient brightness is a key factor of effect diagram image-position sensor image quality.Because the bright situation of photo environment is real-time change, when the brightness of photo environment is too low, there is too much image noise in the image of generation, makes not fogging clear.
Therefore, in order to the resolution of the real-time bright situation adjustment output image according to photo environment, to improve image quality, when taking pictures, the monochrome information of Real-time Obtaining photo environment is needed.
It should be noted that, can according to the monochrome information of concrete application scenarios Real-time Obtaining photo environment in several ways.Such as:
The first example: can by the monochrome information of concrete light meter Real-time Obtaining photo environment.Wherein, light meter can need to select according to embody rule, and the present embodiment is not restricted this.Or,
The second example: the photosensitive information that can obtain photo environment, according to the monochrome information of photosensitive information Real-time Obtaining photo environment.
Wherein, the particular content of photosensitive information is a lot, such as: sensitivity value and ISO value, or, the automatic exposure value (AutomaticExposure, AE) of camera lens.Therefore, can be obtained the photosensitive information of photo environment by different photo-sensitive cells according to application scenarios, the present embodiment is not restricted this.Such as:
When user is when autodyning, the automatic exposure value AE obtaining face can be passed through, according to the monochrome information of the size Real-time Obtaining photo environment of the automatic exposure value AE of face.Or;
When user takes pictures in the night mode, can pass through to obtain sensitivity value ISO value, according to the monochrome information of the size Real-time Obtaining photo environment of sensitivity value ISO value.
It should be noted that, the monochrome information mode of above Real-time Obtaining photo environment is only and illustrates, can select the monochrome information of suitable mode Real-time Obtaining photo environment as required.
Due to the corresponding different handling object of different monochrome informations and criterion, therefore, pre-set the strategy corresponding with monochrome information.And then the strategy according to presetting determines the unit picture element amount P corresponding with described monochrome information, wherein, 1<=P<=m*n.
It should be noted that, unit picture element amount P represents the photosensitive pixel quantity that in follow-up output image, each unit picture element comprises, and the unit picture element amount P under light environment is less than the unit picture element amount P under half-light environment.Unit picture element amount P is larger, and mean that the pixel of output image is fewer, resolution is lower; Unit picture element amount P is less, and mean that the pixel of output image is more, resolution is higher.
In order to how explanation clearly obtains the monochrome information of photo environment, and determine the unit picture element amount P corresponding with described monochrome information according to preset strategy, illustrate as follows:
The first example, determine unit picture element amount P by automatic exposure value AE, specifically comprise:
Obtain the automatic exposure value AE of the camera of photo environment.
1) if AE is more than or equal to threshold value, then illustrate that photo environment is half-light environment, therefore, the unit picture element amount P corresponding with half-light environment is m*n, mean that in follow-up output image, each unit picture element comprises m*n photosensitive pixel, each unit picture element combines the light-inletting quantity of m*n photosensitive pixel, could suppress the image noise that half-light environment brings, and improves the definition of output image.
2) if AE is less than threshold value, then illustrate that photo environment is light environment, therefore, the unit picture element amount P corresponding with light environment is 1, mean that in follow-up output image, each unit picture element comprises 1 photosensitive pixel, enough, the image of output is enough clear for the light-inletting quantity of each photosensitive pixel.
The second example, determine unit picture element amount P by sensitivity value ISO, specifically comprise:
Obtain the sensitivity value ISO of photo environment;
1) when ISO is less than or equal to the first default thresholding, then illustrate that photo environment is light environment, therefore, the unit picture element amount P corresponding with light environment is 1, mean that in follow-up output image, each unit picture element comprises 1 photosensitive pixel, enough, the image of output is enough clear for the light-inletting quantity of each photosensitive pixel.
2) when ISO is greater than described first thresholding and is less than or equal to the second default thresholding, then illustrate photo environment and above-mentioned 1) compared with dimmed.Therefore, corresponding with now environment unit picture element amount is P1,1<P1<m*n.Mean that in follow-up output image, each unit picture element comprises P1 photosensitive pixel, each unit picture element combines the light-inletting quantity of P1 photosensitive pixel, could suppress the image noise that now photo environment brings, and improves the definition of output image.
3) when ISO is greater than described second thresholding and be less than or equal to the 3rd default thresholding, then illustrate photo environment and above-mentioned 2) compared with darker.Therefore, the unit picture element amount corresponding with now environment is P2, wherein, and 1<P2<m*n, and P2>P1.Mean that in follow-up output image, each unit picture element comprises P2 photosensitive pixel, each unit picture element combines the light-inletting quantity of P2 photosensitive pixel, could suppress the image noise that now photo environment brings, and improves the definition of output image.
4) when ISO is greater than described 3rd thresholding, then illustrate photo environment and above-mentioned 3) compared with dimmed further, therefore, the unit picture element amount P corresponding with half-light environment is m*n.Mean that in follow-up output image, each unit picture element comprises m*n photosensitive pixel, each unit picture element combines the light-inletting quantity of m*n photosensitive pixel, could suppress the image noise that half-light environment brings, and improves the definition of output image.
It should be noted that, above situation only illustrates, can select according to practical situations or adjust concrete obtain manner and the determination strategy to unit picture element amount P.
Step 102, belongs to the output of the multiple photosensitive pixels in same described merging pixel, and then generates the image of corresponding resolution according to described unit picture element amount alignment processing.
Particularly, the photosensitive pixel array 11 of the imageing sensor 1 shown in Fig. 1 determines the max pixel value of output image, and the resolution sizes of image depends on that the pixel of image is how many.When the unit picture element amount P corresponding with the monochrome information of photo environment is 1, with full-scale resolution model output image, the i.e. max pixel value of image; When the unit picture element amount P corresponding with monochrome information of taking pictures is not 1, pixel value is merged by the output of P the photosensitive pixel 111 belonged in same merging pixel being added reading according to unit picture element amount P, reduce the pixel of output image, that is the resolution of output image also reduces, thus exchange more light-inletting quantity for, improve the definition of output image.
Therefore, belong to the output of the multiple photosensitive pixels in same described merging pixel according to the unit picture element amount P alignment processing corresponding with monochrome information, and then generate the image of corresponding resolution.
Due to 1<=P<=m*n, therefore, the processing procedure for the output of the multiple photosensitive pixels belonged in same described merging pixel is different, and composition graphs 3 is described as follows:
Fig. 3 is the filter unit array schematic diagram in imageing sensor provided by the invention.
See Fig. 1 and Fig. 3, cover 2*2 photosensitive pixel 111 for each filter unit 121 and be described:
The first example:
As unit picture element amount P=1, according to the output of each photosensitive pixel in same described merging pixel, and then generate the image of full-scale resolution.
Particularly, as unit picture element amount P=1, illustrate that light situation is better when taking pictures.That is, in Fig. 1 imageing sensor 1 photosensitive pixel array 11 in the light-inletting quantity of each photosensitive pixel 111 comparatively large, photosensitive degree is better, and the image of output is very clear.Therefore, merging treatment is carried out in the output that need not be combined each photosensitive pixel 111 in pixel.But directly obtain the output of each photosensitive pixel in same described merging pixel, export full-scale image in different resolution.
Fig. 4 is for exporting full-scale image in different resolution schematic diagram, and see Fig. 4, by the implementation process of the first example, with full-scale resolution output image, each unit picture element namely in output image comprises a photosensitive pixel.
The second example:
As unit picture element amount 1<P<m*n, the output of P the photosensitive pixel belonged in same described merging pixel is added and obtains merging pixel value, according to described merging pixel value, and then generate the image of corresponding 1/P resolution.
Particularly, as unit picture element amount 1<P<m*n, illustrate that light situation is general when taking pictures.That is, see Fig. 1, in the photosensitive pixel array 11 of imageing sensor 1, the light-inletting quantity of each photosensitive pixel 111 is moderate, and photosensitive degree is moderate, and the image of output is clear not.Therefore, need the output of P the photosensitive pixel belonged in same described merging pixel to be added to obtain to merge pixel value, according to described merging pixel value, and then generate the image of corresponding 1/P resolution.Contain P photosensitive pixel in each unit picture element of i.e. output image, combine the light-inletting quantity of P photosensitive pixel, make up the defect of single photosensitive pixel light-inletting quantity deficiency, noise is suppressed.Thus the details performance by sacrificing resolution and image, improve light-inletting quantity, and then improve the definition of output image.
Fig. 5 is 1/2 full-scale image in different resolution schematic diagram, see Fig. 5, supposes unit picture element amount P=2, and by the implementation process of the second example, export 1/2 full-scale image in different resolution, each unit picture element namely in output image comprises 2 photosensitive pixels.
The third example:
As unit picture element amount P=m*n, the output belonging to photosensitive pixel all in same described merging pixel is added to obtain merges pixel value, according to described merging pixel value, and then generate the image of corresponding 1/m*n resolution.
Particularly, as unit picture element amount P=m*n, illustrate that light situation is very dark when taking pictures.That is, see Fig. 1, in the photosensitive pixel array 11 of imageing sensor 1, the light-inletting quantity of each photosensitive pixel 111 is less, and photosensitive degree is poor, and image noise is more, causes the image of output very unclear.Therefore, need the output belonging to photosensitive pixel all in same described merging pixel to be added to obtain to merge pixel value, according to described merging pixel value, and then generate the image of corresponding 1/m*n resolution.Contain m*n photosensitive pixel in each unit picture element of i.e. output image, combine the light-inletting quantity of m*n photosensitive pixel, make up the defect of single photosensitive pixel light-inletting quantity deficiency, noise is suppressed.Thus the details performance by sacrificing resolution and image, improve light-inletting quantity, and then improve the definition of output image.
Fig. 6 is 1/4 full-scale image in different resolution schematic diagram, see Fig. 6, supposes unit picture element amount P=4, and by the implementation process of the third example, export 1/4 full-scale image in different resolution, each unit picture element namely in output image comprises 4 photosensitive pixels.
In sum, when the present intensity of photo environment does not reach preset requirement, merged by the output being combined multiple photosensitive pixel in pixel, although reduce the resolution of output image, the granularity of details performance is slightly poor, but can increase the light-inletting quantity of each pixel, improves photosensitive degree, inhibitory effect noise, improves the definition of image.Its concrete principle is as follows:
Assuming that the output of original each photosensitive pixel is S, noise is N, merges pixel and comprises m photosensitive pixel, the merging pixel value then merging pixel is n*m*S, and the noise merging pixel is m*N, at n=2, when m=2, the noise of resulting pixel is about n*m*N/2.Therefore the brightness merging image gets a promotion under low-light level environment, inhibits and affects noise, and the signal to noise ratio of image improves.
It should be noted that except 2*2 structure, also have 3*3,4*4, or even any n*m structure (n, m are natural number, and n*m is greater than 1), be appreciated that the number of sequencable photosensitive pixel 111 on photosensitive pixel array 11 is limited.As, if the merging pixel value of photosensitive pixel array 11 is 16M, adopts the merging dot structure of 2*2 can obtain the merging image of 4M pixel, and adopt 4*4 structure just can only obtain the merging image of 1M pixel.Therefore the merging dot structure of 2*2 is a preferred arrangement mode, under sacrificing the prerequisite of pixel less, promote image brightness and definition as far as possible.
The image generating method of the present embodiment, by obtaining the monochrome information of photo environment, determines the unit picture element amount P corresponding with described monochrome information according to preset strategy, wherein, and 1<=P<=m*n; Belong to the output of the multiple photosensitive pixels in same described merging pixel according to described unit picture element amount alignment processing, and then generate the image of corresponding resolution.Thus, to achieve according to photo environment light situation dynamic conditioning unit picture element amount with the light-inletting quantity of unit of adjustment's pixel, generate the image of corresponding resolution, thus suppress image noise, improve the definition of image.
Based on above-described embodiment, further, in order to improve data-handling efficiency, arrange register in advance in terminal equipment, the merging dot structure adopting 2*2 is example, the acquisition efficiency how improving and merge pixel value is described, specifically comprises the following steps:
Gather the output of row k and kth+1 row in described photosensitive pixel array and stored in described register, wherein k=2n-1, n are natural number, k+1 is less than or equal to total line number of described photosensitive pixel array; And
From described register, extract the output of described row k and kth+1 row, the output of multiple photosensitive pixel in described merging pixel is added and obtains merging pixel value.
Specifically, first gather the photosensitive pixel 111 of the first row in photosensitive pixel array 11 and the second row output and stored in register.Such as: the output addition acquisition merging pixel value by position coordinates being four photosensitive pixels 111 of 1-1,1-2,2-1,2-2, wherein the left side digitized representation of position coordinates is capable, digits right representative row.
By that analogy, until process last group four photosensitive pixels 111 of the first row and the second row.
By above processing mode, gather the output of the photosensitive pixel 111 of row k and kth+1 row exposed in real time in photosensitive pixel array 11 successively and stored in register, wherein k=2n-1, n are natural number, k+1 is less than or equal to total line number of photosensitive pixel array 11.Until the output of whole photosensitive pixel 111 has all processed in photosensitive pixel array 11.
From described register, extract the output of described row k and kth+1 row, the output of multiple photosensitive pixel in same merging pixel is added and obtains merging pixel value, and then generate the image of respective pixel according to all merging pixel values.
As can be seen here, register can be made full use of to realize the process of the output reading of photosensitive pixel array, buffer memory and merging, improve image processing efficiency.
In order to realize above-described embodiment, the present invention also proposes a kind of video generation device.
Fig. 7 is the structural representation of the video generation device of one embodiment of the invention.
As shown in Figure 7, this video generation device comprises:
Imageing sensor 1 and image processor 2, wherein,
The structure of described imageing sensor 1 is see Fig. 1, specifically comprise: photosensitive pixel array 11, and the filter be arranged on described photosensitive pixel array 11, wherein, described filter comprises filter unit array 12, each filter unit 121 covers m*n photosensitive pixel 111 and forms and merges pixel, wherein, and m*n>1; ;
Described image processor 2 comprises: acquisition module 21, determination module 22 and processing module 23, wherein,
Acquisition module 21, for obtaining the monochrome information of photo environment;
Determination module 22, for determining the unit picture element amount P corresponding with described monochrome information according to preset strategy, wherein, 1<=P<=m*n;
Particularly, in one embodiment,
Described acquisition module 21 is for obtaining the sensitivity value ISO of photo environment;
Described determination module 22 for:
When ISO is less than or equal to the first default thresholding, determine unit picture element amount P=1;
When ISO is greater than described first thresholding and is less than or equal to the second default thresholding, determine unit picture element amount P=P1, wherein, 1<P1<m*n;
When ISO is greater than described second thresholding and is less than or equal to the 3rd default thresholding, determine unit picture element amount P=P2, wherein, 1<P2<m*n, and P2>P1;
When ISO is greater than described 3rd thresholding, determine unit picture element amount P=m*n.
In another embodiment,
Described acquisition module 21 is for obtaining the automatic exposure value AE of photo environment;
Described determination module 22 for:
When AE is more than or equal to default threshold value, determine unit picture element amount P=m*n;
When AE is less than described threshold value, determine unit picture element amount P=1.
Processing module 23, for belonging to the output of the multiple photosensitive pixels in same described merging pixel according to described unit picture element amount alignment processing, and then generates the image of corresponding resolution.
Particularly, in one embodiment, as unit picture element amount P=1, described processing module 23 for:
According to the output of each photosensitive pixel in same described merging pixel, and then generate the image of full-scale resolution.
In another embodiment, as unit picture element amount 1<P<m*n, described processing module 23 for:
The output of P the photosensitive pixel belonged in same described merging pixel is added to obtain and merges pixel value, according to described merging pixel value, and then generate the image of corresponding 1/P resolution.
In another embodiment, as unit picture element amount P=m*n, described processing module 23 for:
The output belonging to photosensitive pixel all in same described merging pixel is added to obtain and merges pixel value, according to described merging pixel value, and then generate the image of corresponding 1/m*n resolution.
It should be noted that, the aforementioned explanation to image generating method embodiment illustrates the video generation device being also applicable to this embodiment, repeats no more herein.
The video generation device of the embodiment of the present invention, by obtaining the monochrome information of photo environment, determines the unit picture element amount P corresponding with described monochrome information according to preset strategy, wherein, and 1<=P<=m*n; Belong to the output of the multiple photosensitive pixels in same described merging pixel according to described unit picture element amount alignment processing, and then generate the image of corresponding resolution.Thus, to achieve according to photo environment light situation dynamic conditioning unit picture element amount with the light-inletting quantity of unit of adjustment's pixel, generate the image of corresponding resolution, thus suppress image noise, improve the definition of image.
In order to realize above-described embodiment, the present invention also proposes a kind of terminal equipment.This terminal equipment comprises: the as above video generation device carried of embodiment.
Wherein, described terminal equipment type is a lot, such as, comprise: mobile phone, IPAD or, Intelligent worn device.
It should be noted that, the aforementioned explanation to image generating method embodiment illustrates the terminal equipment being also applicable to this embodiment, repeats no more herein.
The terminal equipment of the embodiment of the present invention, by obtaining the monochrome information of photo environment, determines the unit picture element amount P corresponding with described monochrome information according to preset strategy, wherein, and 1<=P<=m*n; Belong to the output of the multiple photosensitive pixels in same described merging pixel according to described unit picture element amount alignment processing, and then generate the image of corresponding resolution.Thus, to achieve according to photo environment light situation dynamic conditioning unit picture element amount with the light-inletting quantity of unit of adjustment's pixel, generate the image of corresponding resolution, thus suppress image noise, improve the definition of image.
Fig. 8 is the structural representation of the terminal equipment of one embodiment of the invention, as shown in Figure 8, this terminal equipment comprises: video generation device 10, the central processing unit 20 be connected with described video generation device 10 and external memory 30, described central processing unit 20 is for controlling described external memory 30 memory image.
It should be noted that, the aforementioned explanation to image generating method embodiment illustrates the terminal equipment being also applicable to this embodiment, and it is similar that it realizes principle, repeats no more herein.
Fig. 9 is the structural representation of the terminal equipment of another embodiment of the present invention, as shown in Figure 9, this terminal equipment comprises: video generation device 10, the central processing unit 20 be connected with described video generation device 10 and display unit 40, described central processing unit 20 shows image for controlling described display unit 40.
It should be noted that, the aforementioned explanation to image generating method embodiment illustrates the terminal equipment being also applicable to this embodiment, and it is similar that it realizes principle, repeats no more herein.
In the description of this specification, specific features, structure, material or feature that the description of reference term " embodiment ", " some embodiments ", " example ", " concrete example " or " some examples " etc. means to describe in conjunction with this embodiment or example are contained at least one embodiment of the present invention or example.In this manual, to the schematic representation of above-mentioned term not must for be identical embodiment or example.And the specific features of description, structure, material or feature can combine in one or more embodiment in office or example in an appropriate manner.In addition, when not conflicting, the feature of the different embodiment described in this specification or example and different embodiment or example can carry out combining and combining by those skilled in the art.
In addition, term " first ", " second " only for describing object, and can not be interpreted as instruction or hint relative importance or imply the quantity indicating indicated technical characteristic.Thus, be limited with " first ", the feature of " second " can express or impliedly comprise at least one this feature.In describing the invention, the implication of " multiple " is at least two, such as two, three etc., unless otherwise expressly limited specifically.
Describe and can be understood in flow chart or in this any process otherwise described or method, represent and comprise one or more for realizing the module of the code of the executable instruction of the step of specific logical function or process, fragment or part, and the scope of the preferred embodiment of the present invention comprises other realization, wherein can not according to order that is shown or that discuss, comprise according to involved function by the mode while of basic or by contrary order, carry out n-back test, this should understand by embodiments of the invention person of ordinary skill in the field.
In flow charts represent or in this logic otherwise described and/or step, such as, the sequencing list of the executable instruction for realizing logic function can be considered to, may be embodied in any computer-readable medium, for instruction execution system, device or equipment (as computer based system, comprise the system of processor or other can from instruction execution system, device or equipment instruction fetch and perform the system of instruction) use, or to use in conjunction with these instruction execution systems, device or equipment.With regard to this specification, " computer-readable medium " can be anyly can to comprise, store, communicate, propagate or transmission procedure for instruction execution system, device or equipment or the device that uses in conjunction with these instruction execution systems, device or equipment.The example more specifically (non-exhaustive list) of computer-readable medium comprises following: the electrical connection section (electronic installation) with one or more wiring, portable computer diskette box (magnetic device), random access memory (RAM), read-only memory (ROM), erasablely edit read-only memory (EPROM or flash memory), fiber device, and portable optic disk read-only memory (CDROM).In addition, computer-readable medium can be even paper or other suitable media that can print described program thereon, because can such as by carrying out optical scanner to paper or other media, then carry out editing, decipher or carry out process with other suitable methods if desired and electronically obtain described program, be then stored in computer storage.
Should be appreciated that each several part of the present invention can realize with hardware, software, firmware or their combination.In the above-described embodiment, multiple step or method can with to store in memory and the software performed by suitable instruction execution system or firmware realize.Such as, if realized with hardware, the same in another embodiment, can realize by any one in following technology well known in the art or their combination: the discrete logic with the logic gates for realizing logic function to data-signal, there is the application-specific integrated circuit (ASIC) of suitable combinational logic gate circuit, programmable gate array (PGA), field programmable gate array (FPGA) etc.
Those skilled in the art are appreciated that realizing all or part of step that above-described embodiment method carries is that the hardware that can carry out instruction relevant by program completes, described program can be stored in a kind of computer-readable recording medium, this program perform time, step comprising embodiment of the method one or a combination set of.
In addition, each functional unit in each embodiment of the present invention can be integrated in a proxy module, also can be that the independent physics of unit exists, also can be integrated in a module by two or more unit.Above-mentioned integrated module both can adopt the form of hardware to realize, and the form of software function module also can be adopted to realize.If described integrated module using the form of software function module realize and as independently production marketing or use time, also can be stored in a computer read/write memory medium.
The above-mentioned storage medium mentioned can be read-only memory, disk or CD etc.Although illustrate and describe embodiments of the invention above, be understandable that, above-described embodiment is exemplary, can not be interpreted as limitation of the present invention, and those of ordinary skill in the art can change above-described embodiment within the scope of the invention, revises, replace and modification.

Claims (18)

1. an image generating method, it is characterized in that, the imageing sensor provided in advance comprises: photosensitive pixel array, and the filter be arranged on described photosensitive pixel array, wherein, described filter comprises filter unit array, and each filter unit covers m*n photosensitive pixel and forms and merges pixel, wherein, m*n>1; Said method comprising the steps of:
Obtain the monochrome information of photo environment, determine the unit picture element amount P corresponding with described monochrome information according to preset strategy, wherein, 1<=P<=m*n;
Belong to the output of the multiple photosensitive pixels in same described merging pixel according to described unit picture element amount alignment processing, and then generate the image of corresponding resolution.
2. the method for claim 1, is characterized in that, the monochrome information of described acquisition photo environment, determines the unit picture element amount P corresponding with described monochrome information according to preset strategy, and wherein, 1<=P<=m*n, comprising:
Obtain the sensitivity value ISO of photo environment;
When ISO is less than or equal to the first default thresholding, determine unit picture element amount P=1;
When ISO is greater than described first thresholding and is less than or equal to the second default thresholding, determine unit picture element amount P=P1, wherein, 1<P1<m*n;
When ISO is greater than described second thresholding and is less than or equal to the 3rd default thresholding, determine unit picture element amount P=P2, wherein, 1<P2<m*n, and P2>P1;
When ISO is greater than described 3rd thresholding, determine unit picture element amount P=m*n.
3. the method for claim 1, is characterized in that, the monochrome information of described acquisition photo environment, determines the unit picture element amount P corresponding with described monochrome information according to preset strategy, and wherein, 1<=P<=m*n, comprising:
Obtain the automatic exposure value AE of photo environment;
When AE is more than or equal to predetermined threshold value, determine unit picture element amount P=m*n;
When AE is less than described threshold value, determine unit picture element amount P=1.
4. the method for claim 1, is characterized in that, as unit picture element amount P=1, and the described output belonging to the multiple photosensitive pixels in same described merging pixel according to described unit picture element amount alignment processing, and then generate the image of corresponding resolution, comprising:
According to the output of each photosensitive pixel in same described merging pixel, and then generate the image of full-scale resolution.
5. the method for claim 1, it is characterized in that, as unit picture element amount 1<P<m*n, the described output belonging to the multiple photosensitive pixels in same described merging pixel according to described unit picture element amount alignment processing, and then generate the image of corresponding resolution, comprising:
The output of P the photosensitive pixel belonged in same described merging pixel is added to obtain and merges pixel value, according to described merging pixel value, and then generate the image of corresponding 1/P resolution.
6. the method for claim 1, it is characterized in that, as unit picture element amount P=m*n, the described output belonging to the multiple photosensitive pixels in same described merging pixel according to described unit picture element amount alignment processing, and then generate the image of corresponding resolution, comprising:
The output belonging to photosensitive pixel all in same described merging pixel is added to obtain and merges pixel value, according to described merging pixel value, and then generate the image of corresponding 1/m*n resolution.
7. the method as described in as arbitrary in claim 1-6, is characterized in that, also comprise:
The analog signal output that described photosensitive pixel produces is converted to digital signal to export.
8. a video generation device, is characterized in that, comprising: imageing sensor and image processor, wherein,
Described imageing sensor comprises: photosensitive pixel array, and is arranged on the filter on described photosensitive pixel array, wherein, described filter comprises filter unit array, each filter unit covers m*n photosensitive pixel and forms and merges pixel, wherein, and m*n>1;
Described image processor comprises:
Acquisition module, for obtaining the monochrome information of photo environment;
Determination module, for determining the unit picture element amount P corresponding with described monochrome information according to preset strategy, wherein, 1<=P<=m*n;
Processing module, for belonging to the output of the multiple photosensitive pixels in same described merging pixel according to described unit picture element amount alignment processing, and then generates the image of corresponding resolution.
9. device as claimed in claim 8, it is characterized in that, described acquisition module is used for:
Obtain the sensitivity value ISO of photo environment;
Described determination module is used for:
When ISO is less than or equal to the first default thresholding, determine unit picture element amount P=1;
When ISO is greater than described first thresholding and is less than or equal to the second default thresholding, determine unit picture element amount P=P1, wherein, 1<P1<m*n;
When ISO is greater than described second thresholding and is less than or equal to the 3rd default thresholding, determine unit picture element amount P=P2, wherein, 1<P2<m*n, and P2>P1;
When ISO is greater than described 3rd thresholding, determine unit picture element amount P=m*n.
10. device as claimed in claim 8, it is characterized in that, described acquisition module is used for:
Obtain the automatic exposure value AE of photo environment;
Described determination module is used for:
When AE is more than or equal to default threshold value, determine unit picture element amount P=m*n;
When AE is less than described threshold value, determine unit picture element amount P=1.
11. devices as claimed in claim 8, it is characterized in that, as unit picture element amount P=1, described processing module is used for:
According to the output of each photosensitive pixel in same described merging pixel, and then generate the image of full-scale resolution.
12. devices as claimed in claim 8, it is characterized in that, as unit picture element amount 1<P<m*n, described processing module is used for:
The output of P the photosensitive pixel belonged in same described merging pixel is added to obtain and merges pixel value, according to described merging pixel value, and then generate the image of corresponding 1/P resolution.
13. devices as claimed in claim 8, it is characterized in that, as unit picture element amount P=m*n, described processing module is used for:
The output belonging to photosensitive pixel all in same described merging pixel is added to obtain and merges pixel value, according to described merging pixel value, and then generate the image of corresponding 1/m*n resolution.
14. as arbitrary in claim 8-13 as described in device, it is characterized in that, described processing module also for:
The analog signal output that described photosensitive pixel produces is converted to digital signal to export.
15. 1 kinds of terminal equipments, is characterized in that, comprising: the video generation device as described in as arbitrary in claim 8-14.
16. equipment as claimed in claim 15, it is characterized in that, described terminal equipment comprises:
Mobile phone, IPAD or, Intelligent worn device.
17. equipment as claimed in claim 15, is characterized in that, also comprise: the central processing unit be connected with described video generation device and external memory, described central processing unit is for controlling described external memory memory image.
18. equipment as claimed in claim 15, is characterized in that, also comprise: the central processing unit be connected with described video generation device and display unit, and described central processing unit is for controlling described display unit display image.
CN201510964168.9A 2015-12-18 2015-12-18 image generating method, device and terminal device Active CN105578067B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510964168.9A CN105578067B (en) 2015-12-18 2015-12-18 image generating method, device and terminal device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510964168.9A CN105578067B (en) 2015-12-18 2015-12-18 image generating method, device and terminal device

Publications (2)

Publication Number Publication Date
CN105578067A true CN105578067A (en) 2016-05-11
CN105578067B CN105578067B (en) 2017-08-25

Family

ID=55887673

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510964168.9A Active CN105578067B (en) 2015-12-18 2015-12-18 image generating method, device and terminal device

Country Status (1)

Country Link
CN (1) CN105578067B (en)

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106341670A (en) * 2016-11-29 2017-01-18 广东欧珀移动通信有限公司 Control method, control device and electronic device
CN107800952A (en) * 2016-09-06 2018-03-13 中兴通讯股份有限公司 Mobile terminal is taken pictures processing method and processing device
WO2018099007A1 (en) * 2016-11-29 2018-06-07 广东欧珀移动通信有限公司 Control method, control device, and electronic device
WO2018099011A1 (en) * 2016-11-29 2018-06-07 广东欧珀移动通信有限公司 Image processing method, image processing device, imaging device, and electronic device
CN108154853A (en) * 2017-11-27 2018-06-12 国网北京市电力公司 Liquid crystal on silicon shows the control method of equipment
US10382709B2 (en) 2016-11-29 2019-08-13 Guangdong Oppo Mobile Telecommunications Corp., Ltd. Image processing method and apparatus, and electronic device
US10440265B2 (en) 2016-11-29 2019-10-08 Guangdong Oppo Mobile Telecommunications Corp., Ltd. Image processing method and apparatus, electronic device and control method
CN110475066A (en) * 2019-08-20 2019-11-19 Oppo广东移动通信有限公司 Control method, imaging device and electronic equipment
CN110876015A (en) * 2018-08-31 2020-03-10 北京小米移动软件有限公司 Method and device for determining image resolution, electronic equipment and storage medium

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1448662A (en) * 2002-03-29 2003-10-15 陈烈涛 Flue duct heat pipe evaporator and separated heat pipe system therefor
CN103531603A (en) * 2013-10-30 2014-01-22 上海集成电路研发中心有限公司 CMOS (complementary metal-oxide semiconductor) image sensor
WO2015083683A1 (en) * 2013-12-05 2015-06-11 オリンパス株式会社 Imaging device, and operation method for imaging device

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1448662A (en) * 2002-03-29 2003-10-15 陈烈涛 Flue duct heat pipe evaporator and separated heat pipe system therefor
CN103531603A (en) * 2013-10-30 2014-01-22 上海集成电路研发中心有限公司 CMOS (complementary metal-oxide semiconductor) image sensor
WO2015083683A1 (en) * 2013-12-05 2015-06-11 オリンパス株式会社 Imaging device, and operation method for imaging device

Cited By (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107800952A (en) * 2016-09-06 2018-03-13 中兴通讯股份有限公司 Mobile terminal is taken pictures processing method and processing device
US10382709B2 (en) 2016-11-29 2019-08-13 Guangdong Oppo Mobile Telecommunications Corp., Ltd. Image processing method and apparatus, and electronic device
US10438320B2 (en) 2016-11-29 2019-10-08 Guangdong Oppo Mobile Telecommunications Corp., Ltd. Image processing method and apparatus, and electronic device
WO2018099005A1 (en) * 2016-11-29 2018-06-07 广东欧珀移动通信有限公司 Control method, control device, and electronic device
WO2018099011A1 (en) * 2016-11-29 2018-06-07 广东欧珀移动通信有限公司 Image processing method, image processing device, imaging device, and electronic device
US10440265B2 (en) 2016-11-29 2019-10-08 Guangdong Oppo Mobile Telecommunications Corp., Ltd. Image processing method and apparatus, electronic device and control method
US10249021B2 (en) 2016-11-29 2019-04-02 Guangdong Oppo Mobile Telecommunications Corp., Ltd. Image processing method and apparatus, and electronic device
WO2018099007A1 (en) * 2016-11-29 2018-06-07 广东欧珀移动通信有限公司 Control method, control device, and electronic device
US10382675B2 (en) 2016-11-29 2019-08-13 Guangdong Oppo Mobile Telecommunications Corp., Ltd. Image processing method and apparatus, and electronic device including a simulation true-color image
US10264178B2 (en) 2016-11-29 2019-04-16 Guangdong Oppo Mobile Telecommunications Corp., Ltd. Control method and apparatus, and electronic device
US10432905B2 (en) 2016-11-29 2019-10-01 Guangdong Oppo Mobile Telecommunications Corp., Ltd. Method and apparatus for obtaining high resolution image, and electronic device for same
CN106341670A (en) * 2016-11-29 2017-01-18 广东欧珀移动通信有限公司 Control method, control device and electronic device
CN108154853A (en) * 2017-11-27 2018-06-12 国网北京市电力公司 Liquid crystal on silicon shows the control method of equipment
CN110876015A (en) * 2018-08-31 2020-03-10 北京小米移动软件有限公司 Method and device for determining image resolution, electronic equipment and storage medium
CN110876015B (en) * 2018-08-31 2021-04-13 北京小米移动软件有限公司 Method and device for determining image resolution, electronic equipment and storage medium
CN110475066A (en) * 2019-08-20 2019-11-19 Oppo广东移动通信有限公司 Control method, imaging device and electronic equipment

Also Published As

Publication number Publication date
CN105578067B (en) 2017-08-25

Similar Documents

Publication Publication Date Title
CN105578067A (en) Image generation method and device, terminal equipment
CN105611185A (en) Image generation method and device and terminal device
CN109005364B (en) Imaging control method, imaging control device, electronic device, and computer-readable storage medium
CN108322646B (en) Image processing method, image processing device, storage medium and electronic equipment
US7884868B2 (en) Image capturing element, image capturing apparatus, image capturing method, image capturing system, and image processing apparatus
CN102801918B (en) Picture pick-up device and the method for controlling this picture pick-up device
CN105592270B (en) image brightness compensation method, device and terminal device
CN105430359A (en) Imaging method, image sensor, imaging device and electronic device
KR20170094243A (en) Method for generating high-dynamic range image, camera device, terminal and imaging method
CN108024056B (en) Imaging method and device based on dual camera
CN109040607B (en) Imaging control method, imaging control device, electronic device and computer-readable storage medium
US20140063288A1 (en) Imaging apparatus, electronic device and method providing exposure compensation
CN105578075A (en) Method for generating high-dynamic range image, photographing device and terminal
CN105578072A (en) Imaging method, imaging device and electronic device
CN109005367B (en) High dynamic range image generation method, mobile terminal and storage medium
CN105578065A (en) Method for generating high-dynamic range image, photographing device and terminal
CN108024057A (en) Background blurring processing method, device and equipment
CN105578080A (en) Imaging method, image sensor, imaging device and electronic device
US20220198625A1 (en) High-dynamic-range image generation with pre-combination denoising
CN108322651A (en) Image pickup method and device, electronic equipment, computer readable storage medium
CN105578081A (en) Imaging method, image sensor, imaging device and electronic device
CN105430360A (en) Imaging method, image sensor, imaging device and electronic device
CN115297257B (en) Method, device and equipment for acquiring multiple paths of video streams
CN104010134B (en) For forming the system and method with wide dynamic range
JP2019145097A (en) Setting device and method, program, and storage medium

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CP03 Change of name, title or address

Address after: Changan town in Guangdong province Dongguan 523860 usha Beach Road No. 18

Patentee after: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP., Ltd.

Address before: Changan town in Guangdong province Dongguan 523859 usha Beach Road No. 18

Patentee before: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP., Ltd.

CP03 Change of name, title or address